2024-02-21T07:30:02.373 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T07:30:02.373 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi --verbose --archive /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311 --description fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/orig.config.yaml 2024-02-21T07:30:02.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:30:02.536 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311 branch: wip-vshankar-testing-20240216.060239 description: fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} email: vshankar@redhat.com first_in_suite: false job_id: '7569311' kernel: client: branch: testing flavor: default kdb: true sha1: 1130e053228021b1be9cac260b5ed52c5a9027c5 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240216.060239 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240216.060239 sha1: e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9275 sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 sleep_before_teardown: 0 subset: 805/1024 suite: fs:workload suite_branch: wip-vshankar-testing-20240216.060239 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABq3/artMQBkN1Ql1hO4MSkY3sikJEVMzCZG/+2std8s60rb4V+in2DLqkSTzv5sg6XQE4i8Lhx+hcdEc+SvoY= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6aCInOFSF360JZMBeUckUwL80ZeVFRCcgJ48fg7L0LunU59aHFTzAVazDlWkAzvyftqLqJO+F6D3yZrlHmj7Y= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1B0xZ16DhDXJZ5ClgNzYsiuU+sg2ZmyyDdgZWx1ZeB/AukG67zU/PeVGlgmTyhVv/GQkIzAjCk+2ydaEsJuNk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-21_07:17:34 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-21T07:30:02.536 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa; will attempt to use it 2024-02-21T07:30:02.537 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks 2024-02-21T07:30:02.537 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-21T07:30:02.538 INFO:teuthology.task.internal:Checking packages... 2024-02-21T07:30:02.562 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '25296a8f176256aea5ed8b5850b25167dce0ae33' 2024-02-21T07:30:02.562 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-21T07:30:02.562 INFO:teuthology.packaging:ref: None 2024-02-21T07:30:02.563 INFO:teuthology.packaging:tag: None 2024-02-21T07:30:02.563 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240216.060239 2024-02-21T07:30:02.563 INFO:teuthology.packaging:sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:30:02.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240216.060239 2024-02-21T07:30:02.700 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1514.g25296a8f 2024-02-21T07:30:02.701 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-21T07:30:02.712 INFO:teuthology.task.internal:no buildpackages task found 2024-02-21T07:30:02.712 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-21T07:30:02.725 INFO:teuthology.task.internal:Saving configuration 2024-02-21T07:30:02.745 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-21T07:30:02.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T07:30:02.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.084229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABq3/artMQBkN1Ql1hO4MSkY3sikJEVMzCZG/+2std8s60rb4V+in2DLqkSTzv5sg6XQE4i8Lhx+hcdEc+SvoY='} 2024-02-21T07:30:02.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.086030', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6aCInOFSF360JZMBeUckUwL80ZeVFRCcgJ48fg7L0LunU59aHFTzAVazDlWkAzvyftqLqJO+F6D3yZrlHmj7Y='} 2024-02-21T07:30:02.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.087585', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1B0xZ16DhDXJZ5ClgNzYsiuU+sg2ZmyyDdgZWx1ZeB/AukG67zU/PeVGlgmTyhVv/GQkIzAjCk+2ydaEsJuNk='} 2024-02-21T07:30:02.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-21T07:30:02.838 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-02-21T07:30:02.838 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-02-21T07:30:02.838 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-02-21T07:30:02.838 INFO:teuthology.run_tasks:Running task console_log... 2024-02-21T07:30:02.955 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c3ef430d0>, signals=[15]) 2024-02-21T07:30:02.955 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-21T07:30:02.961 INFO:teuthology.task.internal:Opening connections... 2024-02-21T07:30:02.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:30:02.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:30:03.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:30:03.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:30:03.147 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:30:03.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:30:03.241 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-21T07:30:03.249 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-02-21T07:30:03.267 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-02-21T07:30:03.268 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-02-21T07:30:03.324 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-02-21T07:30:03.324 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:30:03.325 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:30:03.326 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:30:03.326 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:30:03.326 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:30:03.327 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-02-21T07:30:03.352 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-02-21T07:30:03.369 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-02-21T07:30:03.369 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-02-21T07:30:03.426 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:30:03.427 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:30:03.428 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:30:03.428 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-02-21T07:30:03.451 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-02-21T07:30:03.470 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-02-21T07:30:03.470 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-02-21T07:30:03.526 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-02-21T07:30:03.526 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-02-21T07:30:03.526 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:30:03.527 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:30:03.528 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-02-21T07:30:03.543 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-21T07:30:03.554 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-21T07:30:03.563 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-21T07:30:03.563 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:30:03.566 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:30:03.568 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:30:03.583 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-21T07:30:03.590 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-21T07:30:03.590 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:30:03.623 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:30:03.625 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:30:03.686 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-21T07:30:03.753 INFO:teuthology.run_tasks:Running task kernel... 2024-02-21T07:30:03.771 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'} 2024-02-21T07:30:03.771 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-02-21T07:30:03.771 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-02-21T07:30:03.771 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:30:03.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:30:03.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-02-21T07:30:03.995 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:30:03.995 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1130e053228021b1be9cac260b5ed52c5a9027c5"... 2024-02-21T07:30:03.995 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-02-21T07:30:04.012 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-361.el9.x86_64 2024-02-21T07:30:04.012 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:30:04.013 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-21T07:30:04.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-02-21T07:30:06.789 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - AppStream 6.2 MB/s | 6.7 MB 00:01 2024-02-21T07:30:08.798 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2024-02-21T07:30:12.707 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.0 MB 00:03 2024-02-21T07:30:14.705 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-21T07:30:19.806 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.1 MB 00:01 2024-02-21T07:30:21.332 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 15 kB 00:00 2024-02-21T07:31:41.789 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 261 kB/s | 20 MB 01:20 2024-02-21T07:31:46.705 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-21T07:31:49.106 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-02-21T07:31:49.111 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-02-21T07:31:49.111 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-02-21T07:31:49.111 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-02-21T07:31:49.111 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-02-21T07:31:49.111 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 1 Package 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 375 M 2024-02-21T07:31:49.112 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-02-21T07:31:58.355 INFO:teuthology.orchestra.run.smithi100.stdout:linux-firmware-20240109-142.el9.noarch.rpm 41 MB/s | 375 MB 00:09 2024-02-21T07:31:58.356 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:31:58.356 INFO:teuthology.orchestra.run.smithi100.stdout:Total 41 MB/s | 375 MB 00:09 2024-02-21T07:31:58.356 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-02-21T07:31:58.439 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-02-21T07:31:58.439 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-02-21T07:32:00.897 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-02-21T07:32:00.897 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-02-21T07:32:07.194 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-02-21T07:32:07.457 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-21T07:32:07.537 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:32:08.750 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:32:08.750 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware-20240109-142.el9.noarch 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:32:09.138 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-02-21T07:32:09.445 INFO:teuthology.task.kernel:Downloading kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T07:32:09.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:32:09.597 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ 2024-02-21T07:32:09.598 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-21T07:32:09.600 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-02-21T07:33:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21 07:33:13 URL:https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm [332924888/332924888] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-21T07:33:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-02-21 07:33:13-- 2024-02-21T07:33:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 1m 4s 2024-02-21T07:33:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 318M in 1m 4s (4.99 MB/s) 2024-02-21T07:33:13.920 INFO:teuthology.task.kernel:Installing kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T07:33:13.921 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-21T07:33:15.843 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-02-21T07:33:15.915 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-02-21T07:33:15.995 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-02-21T07:33:23.445 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.8.0_rc4_g1130e0532280-1 ######################################## 2024-02-21T07:33:37.627 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-21T07:33:59.821 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-21T07:33:59.821 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/System.map 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/config 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto 2024-02-21T07:33:59.899 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-21T07:33:59.900 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu 2024-02-21T07:33:59.901 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ansi_cprng.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/anubis.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/arc4.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_memcpy.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_pq.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-21T07:33:59.902 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_tx.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_xor.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/raid6test.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authenc.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authencesn.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blake2b_generic.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_common.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_generic.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/camellia_generic.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast5_generic.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast6_generic.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast_common.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ccm.ko 2024-02-21T07:33:59.903 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cmac.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crc32_generic.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_engine.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_user.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cts.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/des_generic.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/dh_generic.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/echainiv.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/essiv.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/fcrypt.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/khazad.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4hc.ko 2024-02-21T07:33:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/md4.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/michael_mic.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcbc.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcrypt.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/rmd160.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/seed.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/serpent_generic.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tcrypt.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tea.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_common.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_generic.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/vmac.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/wp512.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xcbc.ko 2024-02-21T07:33:59.905 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xor.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xxhash_generic.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_pad.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/custom_method.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/ec_sys.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/platform_profile.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbs.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbshc.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/video.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/acard-ahci.ko 2024-02-21T07:33:59.906 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ahci_platform.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ata_generic.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/libahci_platform.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_acpi.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ali.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_amd.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_artop.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atiixp.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atp867x.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd640.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd64x.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cypress.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_efar.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt366.ko 2024-02-21T07:33:59.907 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt37x.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it8213.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it821x.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_jmicron.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_marvell.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_mpiix.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_netcell.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ninja32.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87410.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87415.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_oldpiix.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_opti.ko 2024-02-21T07:33:59.908 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_optidma.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pcmcia.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_piccolo.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_rdc.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sch.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_serverworks.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sil680.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sis.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sl82c105.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_triflex.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_via.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pdc_adma.ko 2024-02-21T07:33:59.909 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_inic162x.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_mv.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_nv.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_promise.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_qstor.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil24.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sis.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_svw.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sx4.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_uli.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_via.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_vsc.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay/ks0108.ko 2024-02-21T07:33:59.910 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma/bcma.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe/aoe.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/brd.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd/drbd.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/floppy.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/loop.ko 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx 2024-02-21T07:33:59.911 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/nbd.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk/null_blk.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/pktcdvd.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/rbd.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/virtio_blk.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkfront.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram/zram.ko 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char 2024-02-21T07:33:59.912 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hangcheck-timer.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/via-rng.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/lp.ko 2024-02-21T07:33:59.913 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave/mwave.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ppdev.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tlclk.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/uv_mmtimer.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/virtio_console.ko 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq 2024-02-21T07:33:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-21T07:33:59.915 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-aes.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-sha.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca/dca.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-21T07:33:59.916 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/amd64_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/e752x_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/edac_mce_amd.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3000_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3200_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5100_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5400_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7300_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7core_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i82975x_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/ie31200_edac.ko 2024-02-21T07:33:59.917 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/sb_edac.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/x38_edac.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/edd.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-ich.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-appleir.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-aureal.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-axff.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-dr.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elecom.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elo.ko 2024-02-21T07:33:59.918 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-emsff.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gaff.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gt683r.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gyration.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtekff.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-hyperv.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-icade.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-keytouch.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-kye.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lcpower.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-led.ko 2024-02-21T07:33:59.919 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lenovo.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-multitouch.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-ortek.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-penmount.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-petalynx.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-picolcd.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-pl.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-plantronics.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-primax.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-rmi.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-common.ko 2024-02-21T07:33:59.920 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-saitek.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-samsung.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sjoy.ko 2024-02-21T07:33:59.921 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sony.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-speedlink.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-steelseries.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sunplus.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tivo.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tmff.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-topseed.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-twinhan.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-uclogic.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-waltop.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-wiimote.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-xinmo.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zpff.ko 2024-02-21T07:33:59.922 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zydacron.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/uhid.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/wacom.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_balloon.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_utils.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_vmbus.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru3.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7414.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7418.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adc128d818.ko 2024-02-21T07:33:59.923 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1025.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1026.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1029.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1031.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm9240.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ads7828.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7410.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7411.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7462.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7470.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7475.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7x10.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/amc6821.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/applesmc.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asb100.ko 2024-02-21T07:33:59.924 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asc7621.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/atxp1.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/coretemp.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dme1737.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds1621.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds620.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc1403.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc6w201.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71805f.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71882fg.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f75375s.ko 2024-02-21T07:33:59.925 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fam15h_power.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fschmd.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g760a.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g762.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl518sm.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl520sm.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5500_temp.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5k_amb.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmaem.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmpex.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina209.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina2xx.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/it87.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k10temp.ko 2024-02-21T07:33:59.926 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k8temp.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lineage-pem.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm63.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm73.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm75.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm77.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm78.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm80.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm83.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm85.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm87.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm90.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm92.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm93.ko 2024-02-21T07:33:59.927 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95234.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95241.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95245.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc2945.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4151.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4215.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4222.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4245.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4260.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4261.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max16065.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1619.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1668.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max197.ko 2024-02-21T07:33:59.928 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6639.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6650.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6697.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/mcp3021.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6683.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775-core.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct7802.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87360.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87427.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pcf8591.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-21T07:33:59.929 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/powr1220.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5627.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5636.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht15.ko 2024-02-21T07:33:59.930 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht21.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/shtc1.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sis5595.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47b397.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m1.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m192.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/thmc50.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp102.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp103.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp401.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp421.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via-cputemp.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via686a.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt1211.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt8231.ko 2024-02-21T07:33:59.931 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627ehf.ko 2024-02-21T07:33:59.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627hf.ko 2024-02-21T07:33:59.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83781d.ko 2024-02-21T07:33:59.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83791d.ko 2024-02-21T07:33:59.932 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83792d.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83793.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83795.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l785ts.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l786ng.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses 2024-02-21T07:33:59.935 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-21T07:33:59.936 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-21T07:33:59.937 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-dev.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-mux.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-smbus.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-stub.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_core.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-21T07:33:59.938 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp 2024-02-21T07:33:59.939 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-21T07:33:59.940 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/gameport.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/joydev.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/appletouch.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/bcm5974.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/cyapatp.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/sermouse.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-21T07:33:59.941 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/altera_ps2.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/arc_ps2.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/serio_raw.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/sparse-keymap.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-blinkm.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lm3530.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lp3944.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-ss4200.ko 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger 2024-02-21T07:33:59.942 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache/bcache.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-bio-prison.ko 2024-02-21T07:33:59.943 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache-smq.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-crypt.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-delay.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-flakey.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-log-userspace.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-multipath.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-queue-length.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-raid.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-round-robin.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-service-time.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-switch.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-thin-pool.ko 2024-02-21T07:33:59.944 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-verity.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid0.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid1.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid10.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid456.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptbase.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptctl.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptfc.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptlan.ko 2024-02-21T07:33:59.945 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptsas.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptscsih.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptspi.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_ich.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_sch.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/mfd-core.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/sm501.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/viperboard.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/vx855.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/wl1273-core.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds9802als.ko 2024-02-21T07:33:59.946 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds990x.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/bh1770glc.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710/cb710.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/at24.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/max6875.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/enclosure.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/hpilo.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29003.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29020.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-21T07:33:59.947 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-me.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-txe.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_7xx1.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_core.ko 2024-02-21T07:33:59.948 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tsl2550.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_balloon.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding/bonding.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-21T07:33:59.949 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dummy.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/eql.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-21T07:33:59.950 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros 2024-02-21T07:33:59.951 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-21T07:33:59.952 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-21T07:33:59.953 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-21T07:33:59.954 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dnet.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ethoc.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/fealnx.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-21T07:33:59.955 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf 2024-02-21T07:33:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/jme.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-21T07:33:59.957 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia 2024-02-21T07:33:59.958 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek 2024-02-21T07:33:59.959 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc 2024-02-21T07:33:59.960 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti 2024-02-21T07:33:59.961 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/geneve.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-21T07:33:59.962 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ifb.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvlan.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvtap.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mii.ko 2024-02-21T07:33:59.963 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/net_failover.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/netconsole.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/nlmon.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/amd.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm87xx.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/broadcom.ko 2024-02-21T07:33:59.964 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/cicada.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/davicom.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/dp83640.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/et1011c.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/icplus.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/lxt.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/marvell.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/micrel.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/national.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/phylink.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/qsemi.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/realtek.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/smsc.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/ste10Xp.ko 2024-02-21T07:33:59.965 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/vitesse.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_async.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppoe.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppox.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pptp.ko 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip 2024-02-21T07:33:59.966 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slhc.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slip.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/sungem_phy.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tap.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_random.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tun.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/veth.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/virtio_net.ko 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3 2024-02-21T07:33:59.967 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan/vxlan.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netfront.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb/ntb.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme-core.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport.ko 2024-02-21T07:33:59.968 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_cs.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_pc.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_serial.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/xen-pcifront.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/i82092.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/pd6729.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl 2024-02-21T07:33:59.969 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acerhdf.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-21T07:33:59.970 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/hdaps.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel_ips.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-21T07:33:59.971 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps_parport.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/pps_core.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp.ko 2024-02-21T07:33:59.972 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp_kvm.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-em3027.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-21T07:33:59.973 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-max6900.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-21T07:33:59.974 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-x1205.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-9xxx.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-sas.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-xxxx.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/BusLogic.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/a100u2w.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/advansys.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-21T07:33:59.975 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/am53c974.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/atp870u.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa/bfa.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ch.ko 2024-02-21T07:33:59.976 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dc395x.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-21T07:33:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dmx3191d.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esp_scsi.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic/fnic.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hpsa.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hptiop.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hv_storvsc.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/initio.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ipr.ko 2024-02-21T07:33:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ips.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci/isci.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc/libfc.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas/libsas.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid 2024-02-21T07:33:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvumi.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pmcraid.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla1280.ko 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx 2024-02-21T07:33:59.980 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/raid_class.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_debug.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ses.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/st.ko 2024-02-21T07:33:59.981 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/stex.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/virtio_scsi.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/wd719x.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb/ssb.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_file.ko 2024-02-21T07:33:59.982 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_iblock.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_mod.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_pscsi.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_user.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-21T07:33:59.983 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-21T07:33:59.984 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_gsm.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_hdlc.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/nozomi.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/arc_uart.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-21T07:33:59.985 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_aec.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_cif.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_pci_generic.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_sercos3.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-acm.ko 2024-02-21T07:33:59.986 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usblp.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usbtmc.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/mdc800.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/microtek.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/adutux.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/appledisplay.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi26.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi62.ko 2024-02-21T07:33:59.987 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ezusb.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/idmouse.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/iowarrior.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ldusb.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/legousbtower.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usb3503.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usblcd.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/uss720.ko 2024-02-21T07:33:59.988 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/yurex.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy/phy-generic.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/aircable.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ark3116.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ch341.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cp210x.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cyberjack.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/empeg.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-21T07:33:59.989 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_ti.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipaq.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipw.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ir-usb.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mct_u232.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7720.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7840.ko 2024-02-21T07:33:59.990 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/navman.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/omninet.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/opticon.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/option.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/oti6858.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/pl2303.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcaux.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcserial.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/quatech2.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/safe_serial.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/sierra.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ssu100.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/symbolserial.ko 2024-02-21T07:33:59.991 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_debug.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/visor.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/whiteheat.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/uas.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-21T07:33:59.992 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-karma.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/usb-storage.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio 2024-02-21T07:33:59.993 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_net.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_scsi.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/apple_bl.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/lcd.ko 2024-02-21T07:33:59.994 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_balloon.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_mmio.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_ring.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2482.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2490.ko 2024-02-21T07:33:59.995 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-21T07:33:59.996 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/wire.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/hpwdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/i6300esb.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ib700wdt.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ibmasr.ko 2024-02-21T07:33:59.997 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it87_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/machzwd.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/nv_tco.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/softdog.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/via_wdt.ko 2024-02-21T07:33:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/wdt_pci.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/xen_wdt.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-evtchn.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntalloc.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntdev.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-21T07:33:59.999 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-privcmd.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p/9p.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs/affs.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs/befs.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/binfmt_misc.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs/btrfs.ko 2024-02-21T07:34:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles/cachefiles.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph/ceph.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda/coda.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs/cramfs.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm/dlm.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs/f2fs.ko 2024-02-21T07:34:00.001 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/fat.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/msdos.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/vfat.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/cuse.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/fuse.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2/gfs2.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs/hfs.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus/hfsplus.ko 2024-02-21T07:34:00.002 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs/isofs.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs/jfs.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd/lockd.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix/minix.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs/netfs.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-21T07:34:00.003 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfs.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv3.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv4.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/grace.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/nfs_acl.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd/nfsd.ko 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2 2024-02-21T07:34:00.004 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2/nilfs2.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-celtic.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-centeuro.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-croatian.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-cyrillic.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-gaelic.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-greek.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-iceland.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-inuit.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-roman.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-romanian.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-turkish.ko 2024-02-21T07:34:00.005 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1250.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1251.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1255.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp737.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp775.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp850.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp852.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp855.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp857.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp860.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp861.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp862.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp863.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp864.ko 2024-02-21T07:34:00.006 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp865.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp866.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp869.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp874.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp932.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp936.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp949.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp950.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_euc-jp.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-1.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-13.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-14.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-15.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-2.ko 2024-02-21T07:34:00.007 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-3.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-4.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-5.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-6.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-7.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-9.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-r.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-ru.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-u.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_utf8.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-21T07:34:00.008 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs/overlay.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore/ramoops.ko 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs 2024-02-21T07:34:00.009 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs/reiserfs.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs/romfs.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client/cifs.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_arc4.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_md4.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs/squashfs.ko 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv 2024-02-21T07:34:00.010 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv/sysv.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf/udf.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs/ufs.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs/xfs.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu/rcutorture.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/torture.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-21T07:34:00.011 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/asn1_encoder.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc-itu-t.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc8.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libarc4.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libdes.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/libcrc32c.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lru_cache.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4_compress.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4hc_compress.ko 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math 2024-02-21T07:34:00.012 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math/cordic.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6/raid6_pq.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_bm.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_fsm.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_kmp.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd/zstd_compress.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm/hwpoison-inject.ko 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan 2024-02-21T07:34:00.013 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/6lowpan.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_dest.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_fragment.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_hop.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_mobility.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_routing.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_udp.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/garp.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/mrp.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/p8022.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/psnap.ko 2024-02-21T07:34:00.014 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/stp.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q/8021q.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_fd.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_rdma.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_virtio.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv/batman-adv.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/br_netfilter.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/bridge.ko 2024-02-21T07:34:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-21T07:34:00.016 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtables.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-21T07:34:00.017 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph/libceph.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/failover.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/pktgen.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_diag.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv4.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv6.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver/dns_resolver.ko 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa 2024-02-21T07:34:00.018 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/dsa_core.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_brcm.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_dsa.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_none.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_trailer.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ah4.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/esp4.ko 2024-02-21T07:34:00.019 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/fou.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/gre.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/inet_diag.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_gre.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_tunnel.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_vti.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipcomp.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipip.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-21T07:34:00.020 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-21T07:34:00.021 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_bic.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_dctcp.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_diag.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_highspeed.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_htcp.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_hybla.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_illinois.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_lp.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_scalable.ko 2024-02-21T07:34:00.022 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_vegas.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_veno.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_westwood.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_yeah.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tunnel4.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_diag.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_tunnel.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ah6.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/esp6.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/fou6.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_tunnel.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-21T07:34:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_vti.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ipcomp6.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-21T07:34:00.024 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-21T07:34:00.025 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/sit.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/tunnel6.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key/af_key.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_core.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_eth.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip6.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_netlink.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ppp.ko 2024-02-21T07:34:00.026 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc/llc.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154/mac802154.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls/mpls_gso.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-21T07:34:00.027 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-21T07:34:00.028 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conncount.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-21T07:34:00.029 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table.ko 2024-02-21T07:34:00.030 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_log_syslog.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_irc.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_sip.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_tables.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_log.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-21T07:34:00.031 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_chain_nat.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_compat.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_ct.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fib.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_hash.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_limit.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_log.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_masq.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_nat.ko 2024-02-21T07:34:00.032 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_numgen.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_queue.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_quota.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_redir.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject_inet.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_socket.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_tunnel.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_AUDIT.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CT.ko 2024-02-21T07:34:00.033 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_DSCP.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HL.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HMARK.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LED.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LOG.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NETMAP.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFLOG.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_RATEEST.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_SECMARK.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-21T07:34:00.034 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TEE.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TPROXY.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TRACE.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_addrtype.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_bpf.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cgroup.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cluster.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_comment.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connbytes.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlabel.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlimit.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connmark.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_conntrack.ko 2024-02-21T07:34:00.035 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cpu.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dccp.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_devgroup.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dscp.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ecn.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_esp.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hashlimit.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_helper.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hl.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipcomp.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_iprange.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipvs.ko 2024-02-21T07:34:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_l2tp.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_length.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_limit.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mac.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mark.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_multiport.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nat.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nfacct.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_osf.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_owner.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_physdev.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_pkttype.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_policy.ko 2024-02-21T07:34:00.037 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_quota.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_rateest.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_realm.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_recent.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_sctp.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_set.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_socket.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_state.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_statistic.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_string.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_tcpmss.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_time.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_u32.ko 2024-02-21T07:34:00.038 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink/netlink_diag.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh/nsh.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/openvswitch.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-geneve.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-gre.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-vxlan.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet/af_packet_diag.ko 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds 2024-02-21T07:34:00.039 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_rdma.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_tcp.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_csum.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_gact.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_mirred.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_nat.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_pedit.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_police.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_simple.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_skbedit.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_vlan.ko 2024-02-21T07:34:00.040 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_basic.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_bpf.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_flow.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_fw.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_route.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_u32.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_cmp.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_ipset.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_meta.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_nbyte.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_text.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_u32.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_choke.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_codel.ko 2024-02-21T07:34:00.041 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_drr.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_fq.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_gred.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hfsc.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hhf.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_htb.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_ingress.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio_lib.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_multiq.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_netem.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_pie.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_plug.ko 2024-02-21T07:34:00.042 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_prio.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_qfq.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_red.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfb.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfq.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_tbf.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_teql.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp_diag.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-21T07:34:00.043 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/sunrpc.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/diag.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/tipc.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix/unix_diag.ko 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock 2024-02-21T07:34:00.044 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys 2024-02-21T07:34:00.045 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys/trusted.ko 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib/irqbypass.ko 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias.bin 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.alias.bin 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.bin 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.modinfo 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep.bin 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.devname 2024-02-21T07:34:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.order 2024-02-21T07:34:00.047 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.softdep 2024-02-21T07:34:00.047 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols 2024-02-21T07:34:00.047 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols.bin 2024-02-21T07:34:00.047 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T07:34:00.051 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g1130e0532280 2024-02-21T07:34:00.051 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-21T07:34:00.073 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-02-21T07:34:00.073 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-21T07:34:00.073 INFO:teuthology.orchestra.run.smithi100.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g1130e0532280 /lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T07:34:00.073 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:for file in vmlinuz System.map config; do 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280"; then 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout: cp "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280" 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout: fi 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:done 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:new-kernel-pkg --remove 6.8.0-rc4-g1130e0532280 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g1130e0532280.img 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.8.0-rc4-g1130e0532280 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-02-21T07:34:00.074 INFO:teuthology.orchestra.run.smithi100.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-21T07:34:00.075 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-21T07:34:00.075 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g1130e0532280 2024-02-21T07:34:00.075 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-02-21T07:34:00.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-02-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-02-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-02-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-02-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 68.el9 2024-02-21T07:34:00.150 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8264254 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-02-21T07:34:00.151 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:34:00.152 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T07:34:00.153 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T07:34:00.153 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.8.0-rc4-g1130e0532280 2024-02-21T07:34:00.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T07:34:00.694 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-02-21T07:34:02.102 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-21T07:34:02.135 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-02-21T07:34:02.138 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-02-21T07:34:02.153 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.HVGCrLircK 2024-02-21T07:34:02.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HVGCrLircK 2024-02-21T07:34:02.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.HVGCrLircK 2024-02-21T07:34:02.369 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.HVGCrLircK is 6KB 2024-02-21T07:34:02.418 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.HVGCrLircK 2024-02-21T07:34:02.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T07:34:02.506 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-21T07:34:02.506 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-21T07:34:02.507 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-21T07:34:02.507 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280.conf 2024-02-21T07:34:02.508 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280 2024-02-21T07:34:02.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-02-21T07:34:32.675 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-21T07:34:32.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:34:32.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:35:07.324 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-21T07:35:16.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:35:16.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:35:34.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-02-21T07:35:46.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:35:46.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:35:47.364 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-02-21T07:35:47.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:35:47.984 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc4-g1130e0532280"... 2024-02-21T07:35:47.984 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-02-21T07:35:48.023 INFO:teuthology.orchestra.run.smithi100.stdout:6.8.0-rc4-g1130e0532280 2024-02-21T07:35:48.023 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g1130e0532280 vs 6.8.0-rc4-g1130e0532280 2024-02-21T07:35:48.023 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T07:35:48.023 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T07:35:49.024 DEBUG:teuthology.parallel:result is None 2024-02-21T07:35:49.025 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-21T07:35:49.032 INFO:teuthology.task.internal:Creating test directory... 2024-02-21T07:35:49.033 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:35:49.044 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:35:49.046 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:35:49.088 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-21T07:35:49.095 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-21T07:35:49.101 INFO:teuthology.task.internal:Creating archive directory... 2024-02-21T07:35:49.101 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:35:49.106 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:35:49.109 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:35:49.160 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-21T07:35:49.167 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-21T07:35:49.167 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:35:49.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:35:49.184 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:35:49.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:35:49.200 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:35:49.204 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:35:49.226 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:35:49.274 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.282 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.295 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.307 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.321 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.387 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:35:49.393 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-21T07:35:49.401 INFO:teuthology.task.internal:Configuring sudo... 2024-02-21T07:35:49.401 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:35:49.405 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:35:49.407 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:35:49.469 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-21T07:35:49.479 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-21T07:35:49.479 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:35:49.485 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:35:49.488 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:35:49.518 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:49.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:49.744 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:49.821 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:49.908 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:35:49.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:35:49.978 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:50.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:50.078 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:50.161 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:50.206 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:35:50.206 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:35:50.275 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:50.320 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:35:50.374 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:50.460 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:35:50.502 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:35:50.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:35:50.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-02-21T07:35:50.578 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2024-02-21T07:35:50.580 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-02-21T07:35:50.616 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:35:50.654 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:35:51.068 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-21T07:35:51.076 INFO:teuthology.task.internal:Starting timer... 2024-02-21T07:35:51.076 INFO:teuthology.run_tasks:Running task pcp... 2024-02-21T07:35:51.089 INFO:teuthology.run_tasks:Running task selinux... 2024-02-21T07:35:51.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-02-21T07:35:51.220 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-02-21T07:35:51.224 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2024-02-21T07:35:51.282 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2024-02-21T07:35:51.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-02-21T07:35:51.346 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-02-21T07:35:51.348 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-21T07:35:51.349 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-02-21T07:35:51.405 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-02-21T07:35:51.405 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2024-02-21T07:35:51.426 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2024-02-21T07:35:51.427 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-02-21T07:35:51.446 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-02-21T07:35:51.447 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-02-21T07:35:51.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:35:51.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:35:51.524 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:35:51.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:35:51.554 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:35:51.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:35:51.583 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-21T07:35:51.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:35:51.677 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:35:51.711 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:35:51.748 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-21T07:35:51.758 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-21T07:35:51.775 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-21T07:35:51.779 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi156.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-21T07:41:44.563 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-02-21T07:41:44.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:41:44.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:41:44.712 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-02-21T07:41:44.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-02-21T07:41:44.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-02-21T07:41:44.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:41:44.954 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-02-21T07:41:45.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-02-21T07:41:45.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-21T07:41:45.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:41:45.122 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-02-21T07:41:45.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-02-21T07:41:45.192 INFO:teuthology.run_tasks:Running task clock... 2024-02-21T07:41:45.206 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-21T07:41:45.207 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:41:45.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:41:45.214 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:41:45.215 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:41:45.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:41:45.217 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:41:45.249 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:41:45.265 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:41:45.267 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:41:45.282 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:41:45.297 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2024-02-21T07:41:45.311 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2024-02-21T07:41:45.312 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-02-21T07:41:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:41:45.326 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-02-21T07:41:45.328 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:41:45.342 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:41:45.344 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:41:45.358 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:41:45.367 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:41:45.388 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.391 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.402 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:41:45.405 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:41:45.406 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-02-21T07:41:45.406 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.406 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.406 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.406 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.465 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-02-21T07:41:45.507 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-02-21T07:41:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:41:45.611 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:41:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:41:45.738 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:41:45.738 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-02-21T07:41:45.738 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.739 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.739 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.739 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:41:45.740 INFO:teuthology.run_tasks:Running task install... 2024-02-21T07:41:45.751 DEBUG:teuthology.task.install:project ceph 2024-02-21T07:41:45.751 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}} 2024-02-21T07:41:45.751 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'} 2024-02-21T07:41:45.752 INFO:teuthology.task.install:Using flavor: default 2024-02-21T07:41:45.763 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-21T07:41:45.763 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-21T07:41:45.764 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:41:45.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:41:45.768 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:41:45.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:41:45.770 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:41:45.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:41:45.918 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:41:45.919 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:41:45.920 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:41:45.920 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:41:45.994 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:41:45.994 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:41:46.032 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:41:46.032 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:41:46.033 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:41:46.043 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:41:46.043 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:41:46.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:41:46.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:41:46.062 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:41:46.131 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:41:46.143 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:41:46.143 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:41:46.165 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:41:46.165 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:41:46.165 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:41:46.194 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:41:46.195 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:41:46.212 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:41:46.263 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:41:46.276 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:41:46.278 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2024-02-21T07:41:46.280 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2024-02-21T07:41:46.344 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:41:46.410 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-02-21T07:41:46.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-02-21T07:41:46.412 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:41:46.501 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-02-21T07:41:46.505 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-02-21T07:41:46.516 INFO:teuthology.orchestra.run.smithi156.stdout:74 files removed 2024-02-21T07:41:46.543 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:41:46.647 INFO:teuthology.orchestra.run.smithi170.stdout:74 files removed 2024-02-21T07:41:46.674 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:41:46.854 INFO:teuthology.orchestra.run.smithi100.stdout:74 files removed 2024-02-21T07:41:46.893 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:41:47.238 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 202 kB/s | 82 kB 00:00 2024-02-21T07:41:47.286 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 256 kB/s | 82 kB 00:00 2024-02-21T07:41:47.653 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-02-21T07:41:47.680 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-02-21T07:41:47.947 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 149 kB/s | 82 kB 00:00 2024-02-21T07:41:48.028 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-02-21T07:41:48.106 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-02-21T07:41:48.414 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 19 MB/s | 6.7 MB 00:00 2024-02-21T07:41:48.447 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-02-21T07:41:48.508 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-02-21T07:41:49.006 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-02-21T07:41:49.666 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-02-21T07:41:49.890 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2024-02-21T07:41:49.900 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-02-21T07:41:50.933 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-21T07:41:51.452 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-02-21T07:41:52.773 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.0 MB 00:00 2024-02-21T07:41:53.425 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-02-21T07:41:53.988 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.0 MB 00:03 2024-02-21T07:41:56.064 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-02-21T07:41:57.390 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-02-21T07:41:58.742 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.1 MB 00:01 2024-02-21T07:42:00.152 INFO:teuthology.orchestra.run.smithi156.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 15 kB 00:00 2024-02-21T07:42:01.640 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.1 MB 00:01 2024-02-21T07:42:02.727 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 6.1 MB 00:01 2024-02-21T07:42:03.323 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2024-02-21T07:42:04.442 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2024-02-21T07:42:05.443 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2024-02-21T07:42:11.235 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-02-21T07:42:13.057 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 2.1 MB/s | 20 MB 00:09 2024-02-21T07:42:13.948 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:13.950 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:13.971 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:42:13.973 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:42:13.974 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:42:13.975 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:13.978 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:13.981 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:42:13.983 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:42:14.070 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-02-21T07:42:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-02-21T07:42:14.096 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-02-21T07:42:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-02-21T07:42:14.096 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-02-21T07:42:14.096 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:42:14.097 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:42:14.098 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:42:14.099 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:42:14.100 INFO:teuthology.orchestra.run.smithi100.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:42:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:42:14.102 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:14.103 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:42:14.104 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:42:14.105 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:14.106 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:42:14.107 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:42:14.108 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:42:14.109 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:42:14.110 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:42:14.110 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:42:14.110 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:42:14.111 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-02-21T07:42:14.112 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================================ 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout:Install 150 Packages 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 26 Packages 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:42:14.113 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 223 M 2024-02-21T07:42:14.114 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-02-21T07:42:14.853 INFO:teuthology.orchestra.run.smithi100.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-02-21T07:42:15.469 INFO:teuthology.orchestra.run.smithi100.stdout:(2/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 5.7 MB/s | 5.3 MB 00:00 2024-02-21T07:42:15.553 INFO:teuthology.orchestra.run.smithi100.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 1.7 MB/s | 145 kB 00:00 2024-02-21T07:42:15.861 INFO:teuthology.orchestra.run.smithi100.stdout:(4/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 6.9 MB/s | 2.1 MB 00:00 2024-02-21T07:42:15.903 INFO:teuthology.orchestra.run.smithi100.stdout:(5/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 844 kB/s | 886 kB 00:01 2024-02-21T07:42:16.087 INFO:teuthology.orchestra.run.smithi100.stdout:(6/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 6.6 MB/s | 1.5 MB 00:00 2024-02-21T07:42:17.163 INFO:teuthology.orchestra.run.smithi100.stdout:(7/176): ceph-common-19.0.0-1514.g25296a8f.el9. 7.6 MB/s | 20 MB 00:02 2024-02-21T07:42:18.032 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-02-21T07:42:18.788 INFO:teuthology.orchestra.run.smithi100.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 6.0 MB/s | 9.7 MB 00:01 2024-02-21T07:42:19.046 INFO:teuthology.orchestra.run.smithi100.stdout:(9/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x86 5.7 MB/s | 17 MB 00:02 2024-02-21T07:42:19.063 INFO:teuthology.orchestra.run.smithi100.stdout:(10/176): ceph-selinux-19.0.0-1514.g25296a8f.el 92 kB/s | 25 kB 00:00 2024-02-21T07:42:19.180 INFO:teuthology.orchestra.run.smithi100.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 1.8 MB/s | 217 kB 00:00 2024-02-21T07:42:19.280 INFO:teuthology.orchestra.run.smithi100.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 274 kB/s | 27 kB 00:00 2024-02-21T07:42:19.372 INFO:teuthology.orchestra.run.smithi100.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 342 kB/s | 31 kB 00:00 2024-02-21T07:42:19.656 INFO:teuthology.orchestra.run.smithi100.stdout:(14/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 2.6 MB/s | 743 kB 00:00 2024-02-21T07:42:19.764 INFO:teuthology.orchestra.run.smithi100.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 1.5 MB/s | 163 kB 00:00 2024-02-21T07:42:19.881 INFO:teuthology.orchestra.run.smithi100.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 1.1 MB/s | 127 kB 00:00 2024-02-21T07:42:20.073 INFO:teuthology.orchestra.run.smithi100.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 2.6 MB/s | 498 kB 00:00 2024-02-21T07:42:20.095 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 20 MB 00:19 2024-02-21T07:42:20.590 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:20.591 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:20.603 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:42:20.604 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:42:20.605 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:42:20.606 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:20.608 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:20.610 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:42:20.611 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:42:20.694 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:42:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:42:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:42:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-02-21T07:42:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:42:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:42:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:42:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:42:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:42:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:42:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:42:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:42:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:42:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:42:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-02-21T07:42:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:============================================================================================ 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:Install 150 Packages 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 26 Packages 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 223 M 2024-02-21T07:42:20.737 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-02-21T07:42:21.149 INFO:teuthology.orchestra.run.smithi100.stdout:(18/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 4.7 MB/s | 5.1 MB 00:01 2024-02-21T07:42:21.240 INFO:teuthology.orchestra.run.smithi100.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 498 kB/s | 45 kB 00:00 2024-02-21T07:42:21.357 INFO:teuthology.orchestra.run.smithi100.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 1.1 MB/s | 131 kB 00:00 2024-02-21T07:42:21.783 INFO:teuthology.orchestra.run.smithi170.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 9.1 kB/s | 6.6 kB 00:00 2024-02-21T07:42:22.007 INFO:teuthology.orchestra.run.smithi100.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 248 kB/s | 161 kB 00:00 2024-02-21T07:42:22.125 INFO:teuthology.orchestra.run.smithi100.stdout:(22/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x8 771 kB/s | 4.7 MB 00:06 2024-02-21T07:42:22.250 INFO:teuthology.orchestra.run.smithi100.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 2.3 MB/s | 298 kB 00:00 2024-02-21T07:42:22.317 INFO:teuthology.orchestra.run.smithi100.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 1.5 MB/s | 99 kB 00:00 2024-02-21T07:42:22.459 INFO:teuthology.orchestra.run.smithi100.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 605 kB/s | 85 kB 00:00 2024-02-21T07:42:22.584 INFO:teuthology.orchestra.run.smithi100.stdout:(26/176): python3-rados-19.0.0-1514.g25296a8f.e 556 kB/s | 320 kB 00:00 2024-02-21T07:42:22.926 INFO:teuthology.orchestra.run.smithi100.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 501 kB/s | 171 kB 00:00 2024-02-21T07:42:23.026 INFO:teuthology.orchestra.run.smithi100.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 317 kB/s | 31 kB 00:00 2024-02-21T07:42:23.226 INFO:teuthology.orchestra.run.smithi100.stdout:(29/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 4.0 MB/s | 3.1 MB 00:00 2024-02-21T07:42:23.318 INFO:teuthology.orchestra.run.smithi100.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 475 kB/s | 138 kB 00:00 2024-02-21T07:42:23.669 INFO:teuthology.orchestra.run.smithi100.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1514.g25296 4.0 MB/s | 1.8 MB 00:00 2024-02-21T07:42:23.793 INFO:teuthology.orchestra.run.smithi100.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 2.0 MB/s | 247 kB 00:00 2024-02-21T07:42:23.886 INFO:teuthology.orchestra.run.smithi100.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 570 kB/s | 52 kB 00:00 2024-02-21T07:42:23.961 INFO:teuthology.orchestra.run.smithi100.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 206 kB/s | 15 kB 00:00 2024-02-21T07:42:24.045 INFO:teuthology.orchestra.run.smithi100.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 3.1 MB/s | 264 kB 00:00 2024-02-21T07:42:24.237 INFO:teuthology.orchestra.run.smithi100.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 3.8 MB/s | 748 kB 00:00 2024-02-21T07:42:24.321 INFO:teuthology.orchestra.run.smithi100.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 221 kB/s | 18 kB 00:00 2024-02-21T07:42:24.521 INFO:teuthology.orchestra.run.smithi100.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 3.3 MB/s | 662 kB 00:00 2024-02-21T07:42:24.580 INFO:teuthology.orchestra.run.smithi100.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-02-21T07:42:24.621 INFO:teuthology.orchestra.run.smithi100.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-02-21T07:42:24.647 INFO:teuthology.orchestra.run.smithi100.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 843 kB/s | 20 kB 00:00 2024-02-21T07:42:24.683 INFO:teuthology.orchestra.run.smithi170.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 305 kB/s | 886 kB 00:02 2024-02-21T07:42:24.689 INFO:teuthology.orchestra.run.smithi100.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2024-02-21T07:42:24.722 INFO:teuthology.orchestra.run.smithi100.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 970 kB/s | 32 kB 00:00 2024-02-21T07:42:24.840 INFO:teuthology.orchestra.run.smithi100.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-02-21T07:42:24.898 INFO:teuthology.orchestra.run.smithi100.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 301 kB/s | 17 kB 00:00 2024-02-21T07:42:24.931 INFO:teuthology.orchestra.run.smithi100.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 311 kB/s | 10 kB 00:00 2024-02-21T07:42:24.959 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-02-21T07:42:24.965 INFO:teuthology.orchestra.run.smithi100.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-02-21T07:42:24.999 INFO:teuthology.orchestra.run.smithi100.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-21T07:42:25.008 INFO:teuthology.orchestra.run.smithi170.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 447 kB/s | 145 kB 00:00 2024-02-21T07:42:25.058 INFO:teuthology.orchestra.run.smithi100.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-02-21T07:42:25.108 INFO:teuthology.orchestra.run.smithi100.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-02-21T07:42:25.141 INFO:teuthology.orchestra.run.smithi100.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 750 kB/s | 24 kB 00:00 2024-02-21T07:42:25.183 INFO:teuthology.orchestra.run.smithi100.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-02-21T07:42:25.234 INFO:teuthology.orchestra.run.smithi100.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-02-21T07:42:25.275 INFO:teuthology.orchestra.run.smithi100.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-02-21T07:42:25.309 INFO:teuthology.orchestra.run.smithi100.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-21T07:42:25.468 INFO:teuthology.orchestra.run.smithi100.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-02-21T07:42:25.593 INFO:teuthology.orchestra.run.smithi100.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-02-21T07:42:25.669 INFO:teuthology.orchestra.run.smithi100.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2024-02-21T07:42:25.727 INFO:teuthology.orchestra.run.smithi100.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 14 MB/s | 811 kB 00:00 2024-02-21T07:42:25.733 INFO:teuthology.orchestra.run.smithi170.stdout:(4/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 1.1 MB/s | 5.3 MB 00:04 2024-02-21T07:42:25.778 INFO:teuthology.orchestra.run.smithi100.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2024-02-21T07:42:25.987 INFO:teuthology.orchestra.run.smithi100.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-02-21T07:42:26.053 INFO:teuthology.orchestra.run.smithi100.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-02-21T07:42:26.087 INFO:teuthology.orchestra.run.smithi100.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-02-21T07:42:26.287 INFO:teuthology.orchestra.run.smithi100.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2024-02-21T07:42:26.354 INFO:teuthology.orchestra.run.smithi100.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 3.4 MB/s | 227 kB 00:00 2024-02-21T07:42:26.388 INFO:teuthology.orchestra.run.smithi100.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 756 kB/s | 24 kB 00:00 2024-02-21T07:42:26.421 INFO:teuthology.orchestra.run.smithi100.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 557 kB/s | 18 kB 00:00 2024-02-21T07:42:26.497 INFO:teuthology.orchestra.run.smithi100.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-02-21T07:42:26.530 INFO:teuthology.orchestra.run.smithi100.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 972 kB/s | 32 kB 00:00 2024-02-21T07:42:26.600 INFO:teuthology.orchestra.run.smithi170.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 1.7 MB/s | 1.5 MB 00:00 2024-02-21T07:42:26.714 INFO:teuthology.orchestra.run.smithi100.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-02-21T07:42:26.756 INFO:teuthology.orchestra.run.smithi100.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.2 MB/s | 217 kB 00:00 2024-02-21T07:42:26.798 INFO:teuthology.orchestra.run.smithi100.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-02-21T07:42:26.840 INFO:teuthology.orchestra.run.smithi100.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-02-21T07:42:26.865 INFO:teuthology.orchestra.run.smithi100.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.7 MB/s | 41 kB 00:00 2024-02-21T07:42:26.907 INFO:teuthology.orchestra.run.smithi100.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-02-21T07:42:26.949 INFO:teuthology.orchestra.run.smithi100.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-02-21T07:42:26.991 INFO:teuthology.orchestra.run.smithi100.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-02-21T07:42:27.050 INFO:teuthology.orchestra.run.smithi100.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 824 kB/s | 47 kB 00:00 2024-02-21T07:42:27.083 INFO:teuthology.orchestra.run.smithi100.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-02-21T07:42:27.467 INFO:teuthology.orchestra.run.smithi100.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-02-21T07:42:27.481 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:27.482 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:42:27.497 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:42:27.498 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:42:27.500 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:42:27.501 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:27.503 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:42:27.506 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:42:27.507 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:42:27.542 INFO:teuthology.orchestra.run.smithi100.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 520 kB/s | 39 kB 00:00 2024-02-21T07:42:27.591 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2024-02-21T07:42:27.601 INFO:teuthology.orchestra.run.smithi100.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 714 kB/s | 41 kB 00:00 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:42:27.635 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:42:27.636 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:42:27.637 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:42:27.638 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:42:27.639 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:42:27.640 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:42:27.641 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:42:27.642 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:42:27.643 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:42:27.644 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:42:27.645 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:42:27.646 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:42:27.647 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:42:27.648 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:42:27.649 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:42:27.650 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:42:27.651 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:42:27.652 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:42:27.653 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout:Installing weak dependencies: 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================ 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout:Install 150 Packages 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 26 Packages 2024-02-21T07:42:27.654 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:42:27.655 INFO:teuthology.orchestra.run.smithi100.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 5.1 MB/s | 215 kB 00:00 2024-02-21T07:42:27.655 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 223 M 2024-02-21T07:42:27.655 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2024-02-21T07:42:27.677 INFO:teuthology.orchestra.run.smithi100.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 1.0 MB/s | 34 kB 00:00 2024-02-21T07:42:27.710 INFO:teuthology.orchestra.run.smithi100.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-02-21T07:42:27.752 INFO:teuthology.orchestra.run.smithi100.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-02-21T07:42:27.786 INFO:teuthology.orchestra.run.smithi100.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-02-21T07:42:27.820 INFO:teuthology.orchestra.run.smithi100.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2024-02-21T07:42:27.861 INFO:teuthology.orchestra.run.smithi100.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-21T07:42:27.895 INFO:teuthology.orchestra.run.smithi100.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-21T07:42:27.937 INFO:teuthology.orchestra.run.smithi100.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-02-21T07:42:27.979 INFO:teuthology.orchestra.run.smithi100.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2024-02-21T07:42:28.046 INFO:teuthology.orchestra.run.smithi100.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-21T07:42:28.088 INFO:teuthology.orchestra.run.smithi100.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 194 kB 00:00 2024-02-21T07:42:28.147 INFO:teuthology.orchestra.run.smithi100.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.7 MB/s | 217 kB 00:00 2024-02-21T07:42:28.189 INFO:teuthology.orchestra.run.smithi100.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 241 kB 00:00 2024-02-21T07:42:28.217 INFO:teuthology.orchestra.run.smithi170.stdout:(6/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 677 kB/s | 2.1 MB 00:03 2024-02-21T07:42:28.264 INFO:teuthology.orchestra.run.smithi100.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2024-02-21T07:42:28.306 INFO:teuthology.orchestra.run.smithi100.stdout:(98/176): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 103 kB 00:00 2024-02-21T07:42:28.347 INFO:teuthology.orchestra.run.smithi100.stdout:(99/176): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-02-21T07:42:28.351 INFO:teuthology.orchestra.run.smithi156.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-02-21T07:42:28.390 INFO:teuthology.orchestra.run.smithi100.stdout:(100/176): python3-requests-2.25.1-8.el9.noarch 2.7 MB/s | 113 kB 00:00 2024-02-21T07:42:28.432 INFO:teuthology.orchestra.run.smithi100.stdout:(101/176): python3-urllib3-1.26.5-5.el9.noarch. 4.5 MB/s | 187 kB 00:00 2024-02-21T07:42:28.982 INFO:teuthology.orchestra.run.smithi100.stdout:(102/176): ceph-test-19.0.0-1514.g25296a8f.el9. 4.8 MB/s | 47 MB 00:09 2024-02-21T07:42:29.016 INFO:teuthology.orchestra.run.smithi100.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 421 kB/s | 245 kB 00:00 2024-02-21T07:42:29.266 INFO:teuthology.orchestra.run.smithi100.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-02-21T07:42:29.383 INFO:teuthology.orchestra.run.smithi100.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-02-21T07:42:29.425 INFO:teuthology.orchestra.run.smithi100.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-02-21T07:42:29.459 INFO:teuthology.orchestra.run.smithi100.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 596 kB/s | 19 kB 00:00 2024-02-21T07:42:29.609 INFO:teuthology.orchestra.run.smithi100.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-02-21T07:42:29.642 INFO:teuthology.orchestra.run.smithi100.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 801 kB/s | 26 kB 00:00 2024-02-21T07:42:29.684 INFO:teuthology.orchestra.run.smithi100.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-02-21T07:42:29.710 INFO:teuthology.orchestra.run.smithi156.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 652 kB/s | 886 kB 00:01 2024-02-21T07:42:29.718 INFO:teuthology.orchestra.run.smithi100.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-02-21T07:42:29.752 INFO:teuthology.orchestra.run.smithi100.stdout:(112/176): luarocks-3.9.2-1.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-02-21T07:42:29.818 INFO:teuthology.orchestra.run.smithi100.stdout:(113/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-02-21T07:42:29.877 INFO:teuthology.orchestra.run.smithi100.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-02-21T07:42:29.919 INFO:teuthology.orchestra.run.smithi100.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-02-21T07:42:29.953 INFO:teuthology.orchestra.run.smithi100.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 989 kB/s | 32 kB 00:00 2024-02-21T07:42:29.987 INFO:teuthology.orchestra.run.smithi100.stdout:(117/176): python3-certifi-2021.10.8-2.el9.noar 459 kB/s | 15 kB 00:00 2024-02-21T07:42:30.028 INFO:teuthology.orchestra.run.smithi100.stdout:(118/176): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-02-21T07:42:30.052 INFO:teuthology.orchestra.run.smithi156.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 425 kB/s | 145 kB 00:00 2024-02-21T07:42:30.079 INFO:teuthology.orchestra.run.smithi100.stdout:(119/176): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-02-21T07:42:30.120 INFO:teuthology.orchestra.run.smithi100.stdout:(120/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.2 MB/s | 303 kB 00:00 2024-02-21T07:42:30.146 INFO:teuthology.orchestra.run.smithi100.stdout:(121/176): python3-colorama-0.4.4-12.el9.noarch 1.4 MB/s | 35 kB 00:00 2024-02-21T07:42:30.167 INFO:teuthology.orchestra.run.smithi170.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 1.3 MB/s | 4.7 MB 00:03 2024-02-21T07:42:30.188 INFO:teuthology.orchestra.run.smithi100.stdout:(122/176): python3-google-auth-2.27.0-1.el9.noa 4.8 MB/s | 203 kB 00:00 2024-02-21T07:42:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:(123/176): protobuf-compiler-3.14.0-13.el9.x86_ 712 kB/s | 863 kB 00:01 2024-02-21T07:42:30.347 INFO:teuthology.orchestra.run.smithi100.stdout:(124/176): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-02-21T07:42:30.380 INFO:teuthology.orchestra.run.smithi100.stdout:(125/176): python3-jaraco-8.2.1-3.el9.noarch.rp 330 kB/s | 11 kB 00:00 2024-02-21T07:42:30.406 INFO:teuthology.orchestra.run.smithi100.stdout:(126/176): python3-grpcio-tools-1.46.7-10.el9.x 828 kB/s | 144 kB 00:00 2024-02-21T07:42:30.431 INFO:teuthology.orchestra.run.smithi100.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 356 kB/s | 18 kB 00:00 2024-02-21T07:42:30.456 INFO:teuthology.orchestra.run.smithi100.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 467 kB/s | 23 kB 00:00 2024-02-21T07:42:30.481 INFO:teuthology.orchestra.run.smithi100.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-02-21T07:42:30.507 INFO:teuthology.orchestra.run.smithi100.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 398 kB/s | 20 kB 00:00 2024-02-21T07:42:30.549 INFO:teuthology.orchestra.run.smithi100.stdout:(131/176): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-02-21T07:42:30.599 INFO:teuthology.orchestra.run.smithi100.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2024-02-21T07:42:30.616 INFO:teuthology.orchestra.run.smithi100.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-02-21T07:42:30.641 INFO:teuthology.orchestra.run.smithi100.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-02-21T07:42:30.674 INFO:teuthology.orchestra.run.smithi100.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-02-21T07:42:30.700 INFO:teuthology.orchestra.run.smithi100.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2024-02-21T07:42:30.725 INFO:teuthology.orchestra.run.smithi100.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-02-21T07:42:30.750 INFO:teuthology.orchestra.run.smithi100.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 572 kB/s | 28 kB 00:00 2024-02-21T07:42:30.776 INFO:teuthology.orchestra.run.smithi100.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 622 kB/s | 31 kB 00:00 2024-02-21T07:42:30.777 INFO:teuthology.orchestra.run.smithi156.stdout:(4/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 1.9 MB/s | 5.3 MB 00:02 2024-02-21T07:42:30.809 INFO:teuthology.orchestra.run.smithi100.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-02-21T07:42:30.838 INFO:teuthology.orchestra.run.smithi100.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 969 kB/s | 59 kB 00:00 2024-02-21T07:42:30.863 INFO:teuthology.orchestra.run.smithi100.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 675 kB/s | 36 kB 00:00 2024-02-21T07:42:30.888 INFO:teuthology.orchestra.run.smithi100.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-02-21T07:42:30.922 INFO:teuthology.orchestra.run.smithi100.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-02-21T07:42:30.948 INFO:teuthology.orchestra.run.smithi100.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-02-21T07:42:30.981 INFO:teuthology.orchestra.run.smithi100.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2024-02-21T07:42:31.007 INFO:teuthology.orchestra.run.smithi100.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 344 kB/s | 20 kB 00:00 2024-02-21T07:42:31.040 INFO:teuthology.orchestra.run.smithi100.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-02-21T07:42:31.099 INFO:teuthology.orchestra.run.smithi100.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-02-21T07:42:31.311 INFO:teuthology.orchestra.run.smithi156.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-02-21T07:42:32.191 INFO:teuthology.orchestra.run.smithi100.stdout:(150/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-02-21T07:42:32.224 INFO:teuthology.orchestra.run.smithi100.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 68 kB 00:00 2024-02-21T07:42:32.358 INFO:teuthology.orchestra.run.smithi100.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 17 MB/s | 2.3 MB 00:00 2024-02-21T07:42:32.490 INFO:teuthology.orchestra.run.smithi100.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-02-21T07:42:32.525 INFO:teuthology.orchestra.run.smithi100.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-02-21T07:42:32.567 INFO:teuthology.orchestra.run.smithi100.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-02-21T07:42:32.751 INFO:teuthology.orchestra.run.smithi100.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 377 kB/s | 69 kB 00:00 2024-02-21T07:42:32.785 INFO:teuthology.orchestra.run.smithi100.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 35 kB 00:00 2024-02-21T07:42:32.818 INFO:teuthology.orchestra.run.smithi100.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 5.7 MB/s | 191 kB 00:00 2024-02-21T07:42:32.860 INFO:teuthology.orchestra.run.smithi100.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 254 kB 00:00 2024-02-21T07:42:32.927 INFO:teuthology.orchestra.run.smithi100.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-21T07:42:32.978 INFO:teuthology.orchestra.run.smithi100.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 8.6 MB/s | 433 kB 00:00 2024-02-21T07:42:32.986 INFO:teuthology.orchestra.run.smithi156.stdout:(6/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 740 kB/s | 2.1 MB 00:02 2024-02-21T07:42:33.020 INFO:teuthology.orchestra.run.smithi100.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 536 kB/s | 22 kB 00:00 2024-02-21T07:42:33.062 INFO:teuthology.orchestra.run.smithi100.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 107 kB 00:00 2024-02-21T07:42:33.137 INFO:teuthology.orchestra.run.smithi100.stdout:(164/176): librados2-19.0.0-1514.g25296a8f.el9. 1.6 MB/s | 3.4 MB 00:02 2024-02-21T07:42:33.162 INFO:teuthology.orchestra.run.smithi100.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 1.5 MB/s | 154 kB 00:00 2024-02-21T07:42:33.179 INFO:teuthology.orchestra.run.smithi100.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 3.3 MB/s | 135 kB 00:00 2024-02-21T07:42:33.204 INFO:teuthology.orchestra.run.smithi100.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 63 kB 00:00 2024-02-21T07:42:33.230 INFO:teuthology.orchestra.run.smithi100.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 564 kB/s | 28 kB 00:00 2024-02-21T07:42:33.288 INFO:teuthology.orchestra.run.smithi100.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-02-21T07:42:33.380 INFO:teuthology.orchestra.run.smithi100.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 16 MB/s | 2.1 MB 00:00 2024-02-21T07:42:33.464 INFO:teuthology.orchestra.run.smithi100.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-02-21T07:42:33.497 INFO:teuthology.orchestra.run.smithi100.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 4.1 MB/s | 438 kB 00:00 2024-02-21T07:42:33.523 INFO:teuthology.orchestra.run.smithi100.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 555 kB/s | 30 kB 00:00 2024-02-21T07:42:33.582 INFO:teuthology.orchestra.run.smithi100.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-02-21T07:42:33.632 INFO:teuthology.orchestra.run.smithi100.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-02-21T07:42:33.636 INFO:teuthology.orchestra.run.smithi156.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 2.0 MB/s | 4.7 MB 00:02 2024-02-21T07:42:33.765 INFO:teuthology.orchestra.run.smithi100.stdout:(176/176): ceph-mgr-diskprediction-local-19.0.0 726 kB/s | 7.4 MB 00:10 2024-02-21T07:42:33.775 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:42:33.775 INFO:teuthology.orchestra.run.smithi100.stdout:Total 11 MB/s | 223 MB 00:19 2024-02-21T07:42:33.913 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-02-21T07:42:34.289 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-02-21T07:42:34.289 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-02-21T07:42:34.724 INFO:teuthology.orchestra.run.smithi170.stdout:(8/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x86 2.6 MB/s | 17 MB 00:06 2024-02-21T07:42:34.842 INFO:teuthology.orchestra.run.smithi170.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 215 kB/s | 25 kB 00:00 2024-02-21T07:42:36.601 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-02-21T07:42:36.601 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-02-21T07:42:37.752 INFO:teuthology.orchestra.run.smithi156.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 2.4 MB/s | 9.7 MB 00:04 2024-02-21T07:42:37.861 INFO:teuthology.orchestra.run.smithi156.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 233 kB/s | 25 kB 00:00 2024-02-21T07:42:38.858 INFO:teuthology.orchestra.run.smithi170.stdout:(10/176): ceph-radosgw-19.0.0-1514.g25296a8f.el 1.1 MB/s | 9.7 MB 00:08 2024-02-21T07:42:39.225 INFO:teuthology.orchestra.run.smithi170.stdout:(11/176): ceph-common-19.0.0-1514.g25296a8f.el9 1.1 MB/s | 20 MB 00:18 2024-02-21T07:42:39.250 INFO:teuthology.orchestra.run.smithi170.stdout:(12/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 555 kB/s | 217 kB 00:00 2024-02-21T07:42:39.317 INFO:teuthology.orchestra.run.smithi170.stdout:(13/176): cephfs-shell-19.0.0-1514.g25296a8f.el 296 kB/s | 27 kB 00:00 2024-02-21T07:42:39.351 INFO:teuthology.orchestra.run.smithi170.stdout:(14/176): libcephfs-devel-19.0.0-1514.g25296a8f 311 kB/s | 31 kB 00:00 2024-02-21T07:42:39.576 INFO:teuthology.orchestra.run.smithi170.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 726 kB/s | 163 kB 00:00 2024-02-21T07:42:39.735 INFO:teuthology.orchestra.run.smithi170.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 800 kB/s | 127 kB 00:00 2024-02-21T07:42:39.943 INFO:teuthology.orchestra.run.smithi170.stdout:(17/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 1.2 MB/s | 743 kB 00:00 2024-02-21T07:42:40.644 INFO:teuthology.orchestra.run.smithi170.stdout:(18/176): libradosstriper1-19.0.0-1514.g25296a8 549 kB/s | 498 kB 00:00 2024-02-21T07:42:40.735 INFO:teuthology.orchestra.run.smithi170.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 493 kB/s | 45 kB 00:00 2024-02-21T07:42:41.061 INFO:teuthology.orchestra.run.smithi170.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 404 kB/s | 131 kB 00:00 2024-02-21T07:42:41.353 INFO:teuthology.orchestra.run.smithi170.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 553 kB/s | 161 kB 00:00 2024-02-21T07:42:41.870 INFO:teuthology.orchestra.run.smithi170.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 619 kB/s | 320 kB 00:00 2024-02-21T07:42:42.336 INFO:teuthology.orchestra.run.smithi170.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 639 kB/s | 298 kB 00:00 2024-02-21T07:42:42.512 INFO:teuthology.orchestra.run.smithi170.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 567 kB/s | 99 kB 00:00 2024-02-21T07:42:42.646 INFO:teuthology.orchestra.run.smithi170.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 638 kB/s | 85 kB 00:00 2024-02-21T07:42:44.030 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-02-21T07:42:44.135 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:42:44.188 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:42:44.225 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:42:44.316 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:42:44.387 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:42:44.480 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:42:44.641 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:42:44.667 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:42:44.864 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:42:45.286 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:42:45.340 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:42:45.499 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:42:45.543 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:42:45.629 INFO:teuthology.orchestra.run.smithi170.stdout:(26/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 919 kB/s | 5.1 MB 00:05 2024-02-21T07:42:45.672 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:42:45.706 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:42:45.862 INFO:teuthology.orchestra.run.smithi170.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 731 kB/s | 171 kB 00:00 2024-02-21T07:42:45.947 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:42:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 342 kB/s | 31 kB 00:00 2024-02-21T07:42:45.995 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:42:46.020 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:42:46.116 INFO:teuthology.orchestra.run.smithi170.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 871 kB/s | 138 kB 00:00 2024-02-21T07:42:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:42:46.180 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:42:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:42:46.314 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:42:46.330 INFO:teuthology.orchestra.run.smithi170.stdout:(30/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 859 kB/s | 3.1 MB 00:03 2024-02-21T07:42:46.340 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:42:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:42:46.724 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:42:46.765 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:42:46.807 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:42:47.161 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:42:47.324 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:42:47.410 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:42:47.535 INFO:teuthology.orchestra.run.smithi156.stdout:(10/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x8 1.2 MB/s | 17 MB 00:14 2024-02-21T07:42:47.594 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:42:47.658 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:42:47.697 INFO:teuthology.orchestra.run.smithi170.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1514.g25296 1.1 MB/s | 1.8 MB 00:01 2024-02-21T07:42:47.777 INFO:teuthology.orchestra.run.smithi156.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 902 kB/s | 217 kB 00:00 2024-02-21T07:42:47.910 INFO:teuthology.orchestra.run.smithi156.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 203 kB/s | 27 kB 00:00 2024-02-21T07:42:47.955 INFO:teuthology.orchestra.run.smithi170.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 959 kB/s | 247 kB 00:00 2024-02-21T07:42:47.972 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:42:48.010 INFO:teuthology.orchestra.run.smithi156.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 312 kB/s | 31 kB 00:00 2024-02-21T07:42:48.072 INFO:teuthology.orchestra.run.smithi170.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 448 kB/s | 52 kB 00:00 2024-02-21T07:42:48.142 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:42:48.164 INFO:teuthology.orchestra.run.smithi170.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 168 kB/s | 15 kB 00:00 2024-02-21T07:42:48.267 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:42:48.306 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:42:48.404 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:42:48.431 INFO:teuthology.orchestra.run.smithi170.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 989 kB/s | 264 kB 00:00 2024-02-21T07:42:48.469 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:42:48.501 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:42:48.545 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:42:48.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:42:48.652 INFO:teuthology.orchestra.run.smithi156.stdout:(14/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 1.1 MB/s | 743 kB 00:00 2024-02-21T07:42:48.695 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:42:48.739 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:42:48.797 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:42:48.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:42:48.898 INFO:teuthology.orchestra.run.smithi170.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 1.6 MB/s | 748 kB 00:00 2024-02-21T07:42:48.902 INFO:teuthology.orchestra.run.smithi156.stdout:(15/176): ceph-common-19.0.0-1514.g25296a8f.el9 973 kB/s | 20 MB 00:20 2024-02-21T07:42:48.928 INFO:teuthology.orchestra.run.smithi156.stdout:(16/176): libcephsqlite-19.0.0-1514.g25296a8f.e 594 kB/s | 163 kB 00:00 2024-02-21T07:42:48.982 INFO:teuthology.orchestra.run.smithi170.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 219 kB/s | 18 kB 00:00 2024-02-21T07:42:48.984 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:42:49.021 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:42:49.045 INFO:teuthology.orchestra.run.smithi156.stdout:(17/176): librados-devel-19.0.0-1514.g25296a8f. 895 kB/s | 127 kB 00:00 2024-02-21T07:42:49.069 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:42:49.102 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:42:49.107 INFO:teuthology.orchestra.run.smithi170.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2024-02-21T07:42:49.157 INFO:teuthology.orchestra.run.smithi170.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-02-21T07:42:49.191 INFO:teuthology.orchestra.run.smithi170.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-02-21T07:42:49.215 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:42:49.224 INFO:teuthology.orchestra.run.smithi170.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 615 kB/s | 20 kB 00:00 2024-02-21T07:42:49.266 INFO:teuthology.orchestra.run.smithi170.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-02-21T07:42:49.272 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:42:49.300 INFO:teuthology.orchestra.run.smithi170.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 955 kB/s | 32 kB 00:00 2024-02-21T07:42:49.370 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:42:49.386 INFO:teuthology.orchestra.run.smithi156.stdout:(18/176): libradosstriper1-19.0.0-1514.g25296a8 1.1 MB/s | 498 kB 00:00 2024-02-21T07:42:49.417 INFO:teuthology.orchestra.run.smithi170.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-02-21T07:42:49.459 INFO:teuthology.orchestra.run.smithi170.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 412 kB/s | 17 kB 00:00 2024-02-21T07:42:49.470 INFO:teuthology.orchestra.run.smithi156.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 541 kB/s | 45 kB 00:00 2024-02-21T07:42:49.509 INFO:teuthology.orchestra.run.smithi170.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-02-21T07:42:49.542 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:42:49.551 INFO:teuthology.orchestra.run.smithi170.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-02-21T07:42:49.585 INFO:teuthology.orchestra.run.smithi170.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-21T07:42:49.609 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:42:49.632 INFO:teuthology.orchestra.run.smithi170.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 661 kB 00:00 2024-02-21T07:42:49.637 INFO:teuthology.orchestra.run.smithi156.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 788 kB/s | 131 kB 00:00 2024-02-21T07:42:49.682 INFO:teuthology.orchestra.run.smithi170.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-02-21T07:42:49.715 INFO:teuthology.orchestra.run.smithi170.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 731 kB/s | 24 kB 00:00 2024-02-21T07:42:49.749 INFO:teuthology.orchestra.run.smithi170.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-02-21T07:42:49.788 INFO:teuthology.orchestra.run.smithi156.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 1.1 MB/s | 161 kB 00:00 2024-02-21T07:42:49.791 INFO:teuthology.orchestra.run.smithi170.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-02-21T07:42:49.825 INFO:teuthology.orchestra.run.smithi170.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2024-02-21T07:42:49.859 INFO:teuthology.orchestra.run.smithi170.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-02-21T07:42:50.017 INFO:teuthology.orchestra.run.smithi170.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-02-21T07:42:50.038 INFO:teuthology.orchestra.run.smithi156.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 1.3 MB/s | 320 kB 00:00 2024-02-21T07:42:50.118 INFO:teuthology.orchestra.run.smithi170.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 30 MB/s | 3.0 MB 00:00 2024-02-21T07:42:50.184 INFO:teuthology.orchestra.run.smithi170.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2024-02-21T07:42:50.235 INFO:teuthology.orchestra.run.smithi170.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2024-02-21T07:42:50.260 INFO:teuthology.orchestra.run.smithi170.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 5.2 MB/s | 134 kB 00:00 2024-02-21T07:42:50.296 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:42:50.313 INFO:teuthology.orchestra.run.smithi156.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 1.1 MB/s | 298 kB 00:00 2024-02-21T07:42:50.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:42:50.419 INFO:teuthology.orchestra.run.smithi170.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-02-21T07:42:50.463 INFO:teuthology.orchestra.run.smithi156.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 663 kB/s | 99 kB 00:00 2024-02-21T07:42:50.477 INFO:teuthology.orchestra.run.smithi170.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-02-21T07:42:50.503 INFO:teuthology.orchestra.run.smithi170.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 3.0 MB/s | 78 kB 00:00 2024-02-21T07:42:50.538 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:42:50.555 INFO:teuthology.orchestra.run.smithi156.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 931 kB/s | 85 kB 00:00 2024-02-21T07:42:50.582 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:42:50.611 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:42:50.653 INFO:teuthology.orchestra.run.smithi170.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-02-21T07:42:50.672 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:42:50.695 INFO:teuthology.orchestra.run.smithi170.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 5.4 MB/s | 227 kB 00:00 2024-02-21T07:42:50.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:42:50.728 INFO:teuthology.orchestra.run.smithi170.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 737 kB/s | 24 kB 00:00 2024-02-21T07:42:50.754 INFO:teuthology.orchestra.run.smithi170.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 719 kB/s | 18 kB 00:00 2024-02-21T07:42:50.774 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:42:50.787 INFO:teuthology.orchestra.run.smithi170.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2024-02-21T07:42:50.813 INFO:teuthology.orchestra.run.smithi170.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 1.2 MB/s | 32 kB 00:00 2024-02-21T07:42:50.938 INFO:teuthology.orchestra.run.smithi170.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-02-21T07:42:50.946 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:42:50.980 INFO:teuthology.orchestra.run.smithi170.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-02-21T07:42:51.022 INFO:teuthology.orchestra.run.smithi170.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-02-21T07:42:51.027 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:42:51.055 INFO:teuthology.orchestra.run.smithi170.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 2.0 MB/s | 69 kB 00:00 2024-02-21T07:42:51.081 INFO:teuthology.orchestra.run.smithi170.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2024-02-21T07:42:51.123 INFO:teuthology.orchestra.run.smithi170.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.5 MB/s | 238 kB 00:00 2024-02-21T07:42:51.157 INFO:teuthology.orchestra.run.smithi170.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-02-21T07:42:51.198 INFO:teuthology.orchestra.run.smithi170.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2024-02-21T07:42:51.224 INFO:teuthology.orchestra.run.smithi170.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.8 MB/s | 47 kB 00:00 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi170.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-02-21T07:42:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi170.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-02-21T07:42:51.900 INFO:teuthology.orchestra.run.smithi170.stdout:(81/176): ceph-mgr-diskprediction-local-19.0.0- 1.3 MB/s | 7.4 MB 00:05 2024-02-21T07:42:51.925 INFO:teuthology.orchestra.run.smithi170.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 331 kB/s | 39 kB 00:00 2024-02-21T07:42:51.935 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:42:51.950 INFO:teuthology.orchestra.run.smithi170.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 820 kB/s | 41 kB 00:00 2024-02-21T07:42:51.976 INFO:teuthology.orchestra.run.smithi170.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 215 kB 00:00 2024-02-21T07:42:52.001 INFO:teuthology.orchestra.run.smithi170.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 674 kB/s | 34 kB 00:00 2024-02-21T07:42:52.026 INFO:teuthology.orchestra.run.smithi170.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 865 kB/s | 43 kB 00:00 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi170.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-02-21T07:42:52.085 INFO:teuthology.orchestra.run.smithi170.stdout:(88/176): uuid-1.6.2-55.el9.x86_64.rpm 963 kB/s | 56 kB 00:00 2024-02-21T07:42:52.110 INFO:teuthology.orchestra.run.smithi170.stdout:(89/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-02-21T07:42:52.135 INFO:teuthology.orchestra.run.smithi170.stdout:(90/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-02-21T07:42:52.163 INFO:teuthology.orchestra.run.smithi170.stdout:(91/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-02-21T07:42:52.186 INFO:teuthology.orchestra.run.smithi170.stdout:(92/176): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-02-21T07:42:52.203 INFO:teuthology.orchestra.run.smithi170.stdout:(93/176): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2024-02-21T07:42:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:42:52.262 INFO:teuthology.orchestra.run.smithi170.stdout:(94/176): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-02-21T07:42:52.287 INFO:teuthology.orchestra.run.smithi170.stdout:(95/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 194 kB 00:00 2024-02-21T07:42:52.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:42:52.320 INFO:teuthology.orchestra.run.smithi170.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-02-21T07:42:52.346 INFO:teuthology.orchestra.run.smithi170.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-02-21T07:42:52.413 INFO:teuthology.orchestra.run.smithi170.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-02-21T07:42:52.446 INFO:teuthology.orchestra.run.smithi170.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-02-21T07:42:52.473 INFO:teuthology.orchestra.run.smithi170.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.0 MB/s | 124 kB 00:00 2024-02-21T07:42:52.498 INFO:teuthology.orchestra.run.smithi170.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 2.2 MB/s | 113 kB 00:00 2024-02-21T07:42:52.523 INFO:teuthology.orchestra.run.smithi170.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 3.7 MB/s | 187 kB 00:00 2024-02-21T07:42:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:42:52.602 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:42:52.647 INFO:teuthology.orchestra.run.smithi156.stdout:(26/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 1.4 MB/s | 5.1 MB 00:03 2024-02-21T07:42:52.680 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:42:52.772 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:42:52.814 INFO:teuthology.orchestra.run.smithi156.stdout:(27/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 1.4 MB/s | 3.1 MB 00:02 2024-02-21T07:42:52.818 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:42:52.839 INFO:teuthology.orchestra.run.smithi156.stdout:(28/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 891 kB/s | 171 kB 00:00 2024-02-21T07:42:52.840 INFO:teuthology.orchestra.run.smithi170.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 70 kB/s | 22 kB 00:00 2024-02-21T07:42:52.859 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:42:52.898 INFO:teuthology.orchestra.run.smithi156.stdout:(29/176): ceph-grafana-dashboards-19.0.0-1514.g 376 kB/s | 31 kB 00:00 2024-02-21T07:42:52.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:42:52.966 INFO:teuthology.orchestra.run.smithi170.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-02-21T07:42:52.974 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:42:53.006 INFO:teuthology.orchestra.run.smithi156.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 827 kB/s | 138 kB 00:00 2024-02-21T07:42:53.035 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:42:53.075 INFO:teuthology.orchestra.run.smithi170.stdout:(105/176): abseil-cpp-20211102.0-3.el9.x86_64.r 4.9 MB/s | 548 kB 00:00 2024-02-21T07:42:53.095 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:42:53.116 INFO:teuthology.orchestra.run.smithi170.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-02-21T07:42:53.150 INFO:teuthology.orchestra.run.smithi170.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 584 kB/s | 19 kB 00:00 2024-02-21T07:42:53.283 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:42:53.284 INFO:teuthology.orchestra.run.smithi170.stdout:(108/176): libarrow-9.0.0-10.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-02-21T07:42:53.317 INFO:teuthology.orchestra.run.smithi170.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 783 kB/s | 26 kB 00:00 2024-02-21T07:42:53.339 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:42:53.351 INFO:teuthology.orchestra.run.smithi170.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-02-21T07:42:53.368 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:42:53.384 INFO:teuthology.orchestra.run.smithi170.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-02-21T07:42:53.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:42:53.410 INFO:teuthology.orchestra.run.smithi170.stdout:(112/176): luarocks-3.9.2-1.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-02-21T07:42:53.477 INFO:teuthology.orchestra.run.smithi170.stdout:(113/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-02-21T07:42:53.527 INFO:teuthology.orchestra.run.smithi170.stdout:(114/176): python3-asyncssh-2.13.2-4.el9.noarch 11 MB/s | 548 kB 00:00 2024-02-21T07:42:53.535 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:42:53.560 INFO:teuthology.orchestra.run.smithi170.stdout:(115/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-02-21T07:42:53.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:42:53.594 INFO:teuthology.orchestra.run.smithi170.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-02-21T07:42:53.619 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:42:53.628 INFO:teuthology.orchestra.run.smithi170.stdout:(117/176): python3-devel-3.9.17-2.el9.x86_64.rp 217 kB/s | 245 kB 00:01 2024-02-21T07:42:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:42:53.653 INFO:teuthology.orchestra.run.smithi170.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-02-21T07:42:53.678 INFO:teuthology.orchestra.run.smithi170.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-02-21T07:42:53.682 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:42:53.720 INFO:teuthology.orchestra.run.smithi170.stdout:(120/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-02-21T07:42:53.754 INFO:teuthology.orchestra.run.smithi170.stdout:(121/176): python3-colorama-0.4.4-12.el9.noarch 1.0 MB/s | 35 kB 00:00 2024-02-21T07:42:53.787 INFO:teuthology.orchestra.run.smithi170.stdout:(122/176): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-02-21T07:42:53.813 INFO:teuthology.orchestra.run.smithi170.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-02-21T07:42:53.844 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:42:53.846 INFO:teuthology.orchestra.run.smithi170.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-02-21T07:42:53.888 INFO:teuthology.orchestra.run.smithi170.stdout:(125/176): python3-grpcio-1.46.7-10.el9.x86_64. 20 MB/s | 2.0 MB 00:00 2024-02-21T07:42:53.914 INFO:teuthology.orchestra.run.smithi170.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-02-21T07:42:53.939 INFO:teuthology.orchestra.run.smithi170.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-02-21T07:42:53.964 INFO:teuthology.orchestra.run.smithi170.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-02-21T07:42:53.989 INFO:teuthology.orchestra.run.smithi170.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-02-21T07:42:54.010 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:42:54.015 INFO:teuthology.orchestra.run.smithi170.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-02-21T07:42:54.073 INFO:teuthology.orchestra.run.smithi170.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-02-21T07:42:54.098 INFO:teuthology.orchestra.run.smithi170.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-02-21T07:42:54.124 INFO:teuthology.orchestra.run.smithi170.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-02-21T07:42:54.132 INFO:teuthology.orchestra.run.smithi156.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1514.g25296 1.4 MB/s | 1.8 MB 00:01 2024-02-21T07:42:54.140 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:42:54.149 INFO:teuthology.orchestra.run.smithi170.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-02-21T07:42:54.175 INFO:teuthology.orchestra.run.smithi170.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-02-21T07:42:54.191 INFO:teuthology.orchestra.run.smithi170.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-02-21T07:42:54.193 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:42:54.217 INFO:teuthology.orchestra.run.smithi170.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-02-21T07:42:54.234 INFO:teuthology.orchestra.run.smithi170.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-02-21T07:42:54.251 INFO:teuthology.orchestra.run.smithi170.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 918 kB/s | 31 kB 00:00 2024-02-21T07:42:54.255 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:42:54.276 INFO:teuthology.orchestra.run.smithi170.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-02-21T07:42:54.301 INFO:teuthology.orchestra.run.smithi170.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-02-21T07:42:54.327 INFO:teuthology.orchestra.run.smithi170.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-02-21T07:42:54.330 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:42:54.352 INFO:teuthology.orchestra.run.smithi170.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-02-21T07:42:54.377 INFO:teuthology.orchestra.run.smithi170.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-02-21T07:42:54.402 INFO:teuthology.orchestra.run.smithi170.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-02-21T07:42:54.428 INFO:teuthology.orchestra.run.smithi170.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-02-21T07:42:54.449 INFO:teuthology.orchestra.run.smithi156.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 782 kB/s | 247 kB 00:00 2024-02-21T07:42:54.453 INFO:teuthology.orchestra.run.smithi170.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-02-21T07:42:54.478 INFO:teuthology.orchestra.run.smithi170.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-02-21T07:42:54.528 INFO:teuthology.orchestra.run.smithi170.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-02-21T07:42:54.532 INFO:teuthology.orchestra.run.smithi156.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 628 kB/s | 52 kB 00:00 2024-02-21T07:42:54.595 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:42:54.607 INFO:teuthology.orchestra.run.smithi156.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 205 kB/s | 15 kB 00:00 2024-02-21T07:42:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:42:54.822 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:42:54.897 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:42:54.939 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:42:54.983 INFO:teuthology.orchestra.run.smithi156.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 703 kB/s | 264 kB 00:00 2024-02-21T07:42:54.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:42:55.047 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:42:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:42:55.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:42:55.197 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:42:55.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:42:55.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:42:55.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:42:55.477 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:42:55.517 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:42:55.551 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:42:55.603 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:42:55.647 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:42:55.787 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:42:55.850 INFO:teuthology.orchestra.run.smithi156.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 863 kB/s | 748 kB 00:00 2024-02-21T07:42:55.902 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:42:55.933 INFO:teuthology.orchestra.run.smithi156.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 219 kB/s | 18 kB 00:00 2024-02-21T07:42:55.957 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:42:56.051 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:42:56.058 INFO:teuthology.orchestra.run.smithi156.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2024-02-21T07:42:56.134 INFO:teuthology.orchestra.run.smithi156.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-02-21T07:42:56.168 INFO:teuthology.orchestra.run.smithi156.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-02-21T07:42:56.191 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:42:56.201 INFO:teuthology.orchestra.run.smithi156.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 614 kB/s | 20 kB 00:00 2024-02-21T07:42:56.251 INFO:teuthology.orchestra.run.smithi156.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-02-21T07:42:56.262 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:42:56.310 INFO:teuthology.orchestra.run.smithi156.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 542 kB/s | 32 kB 00:00 2024-02-21T07:42:56.427 INFO:teuthology.orchestra.run.smithi156.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-02-21T07:42:56.460 INFO:teuthology.orchestra.run.smithi156.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 515 kB/s | 17 kB 00:00 2024-02-21T07:42:56.494 INFO:teuthology.orchestra.run.smithi156.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 303 kB/s | 10 kB 00:00 2024-02-21T07:42:56.528 INFO:teuthology.orchestra.run.smithi156.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-02-21T07:42:56.561 INFO:teuthology.orchestra.run.smithi156.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-21T07:42:56.603 INFO:teuthology.orchestra.run.smithi156.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 16 MB/s | 661 kB 00:00 2024-02-21T07:42:56.645 INFO:teuthology.orchestra.run.smithi156.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-02-21T07:42:56.670 INFO:teuthology.orchestra.run.smithi156.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 978 kB/s | 24 kB 00:00 2024-02-21T07:42:56.696 INFO:teuthology.orchestra.run.smithi156.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.8 MB/s | 46 kB 00:00 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi156.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-02-21T07:42:56.805 INFO:teuthology.orchestra.run.smithi156.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-02-21T07:42:56.854 INFO:teuthology.orchestra.run.smithi170.stdout:(150/176): librados2-19.0.0-1514.g25296a8f.el9. 1.4 MB/s | 3.4 MB 00:02 2024-02-21T07:42:56.855 INFO:teuthology.orchestra.run.smithi156.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 683 kB/s | 34 kB 00:00 2024-02-21T07:42:56.904 INFO:teuthology.orchestra.run.smithi170.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2024-02-21T07:42:57.047 INFO:teuthology.orchestra.run.smithi156.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-02-21T07:42:57.062 INFO:teuthology.orchestra.run.smithi170.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 14 MB/s | 2.3 MB 00:00 2024-02-21T07:42:57.150 INFO:teuthology.orchestra.run.smithi156.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 29 MB/s | 3.0 MB 00:00 2024-02-21T07:42:57.189 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:42:57.225 INFO:teuthology.orchestra.run.smithi156.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2024-02-21T07:42:57.245 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:42:57.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi156.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-02-21T07:42:57.326 INFO:teuthology.orchestra.run.smithi156.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2024-02-21T07:42:57.334 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:42:57.445 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:42:57.496 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:42:57.571 INFO:teuthology.orchestra.run.smithi170.stdout:(153/176): ceph-test-19.0.0-1514.g25296a8f.el9. 2.1 MB/s | 47 MB 00:22 2024-02-21T07:42:57.593 INFO:teuthology.orchestra.run.smithi156.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2024-02-21T07:42:57.613 INFO:teuthology.orchestra.run.smithi170.stdout:(154/176): NetworkManager-libnm-1.45.91-1.el9.x 3.3 MB/s | 1.8 MB 00:00 2024-02-21T07:42:57.638 INFO:teuthology.orchestra.run.smithi170.stdout:(155/176): NetworkManager-team-1.45.91-1.el9.x8 630 kB/s | 41 kB 00:00 2024-02-21T07:42:57.651 INFO:teuthology.orchestra.run.smithi156.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-02-21T07:42:57.663 INFO:teuthology.orchestra.run.smithi170.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-02-21T07:42:57.685 INFO:teuthology.orchestra.run.smithi156.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-02-21T07:42:57.688 INFO:teuthology.orchestra.run.smithi170.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2024-02-21T07:42:57.714 INFO:teuthology.orchestra.run.smithi170.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 705 kB/s | 35 kB 00:00 2024-02-21T07:42:57.728 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:42:57.747 INFO:teuthology.orchestra.run.smithi170.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 191 kB 00:00 2024-02-21T07:42:57.759 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:42:57.781 INFO:teuthology.orchestra.run.smithi170.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2024-02-21T07:42:57.815 INFO:teuthology.orchestra.run.smithi170.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 12 MB/s | 802 kB 00:00 2024-02-21T07:42:57.835 INFO:teuthology.orchestra.run.smithi156.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 39 MB/s | 5.8 MB 00:00 2024-02-21T07:42:57.848 INFO:teuthology.orchestra.run.smithi170.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.5 MB/s | 433 kB 00:00 2024-02-21T07:42:57.850 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:42:57.869 INFO:teuthology.orchestra.run.smithi156.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 6.6 MB/s | 227 kB 00:00 2024-02-21T07:42:57.882 INFO:teuthology.orchestra.run.smithi170.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 331 kB/s | 22 kB 00:00 2024-02-21T07:42:57.903 INFO:teuthology.orchestra.run.smithi156.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 736 kB/s | 24 kB 00:00 2024-02-21T07:42:57.907 INFO:teuthology.orchestra.run.smithi170.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 107 kB 00:00 2024-02-21T07:42:57.933 INFO:teuthology.orchestra.run.smithi170.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-21T07:42:57.936 INFO:teuthology.orchestra.run.smithi156.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 540 kB/s | 18 kB 00:00 2024-02-21T07:42:57.958 INFO:teuthology.orchestra.run.smithi170.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-21T07:42:57.970 INFO:teuthology.orchestra.run.smithi156.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 4.3 MB/s | 144 kB 00:00 2024-02-21T07:42:57.983 INFO:teuthology.orchestra.run.smithi170.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-21T07:42:58.004 INFO:teuthology.orchestra.run.smithi156.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 946 kB/s | 32 kB 00:00 2024-02-21T07:42:58.009 INFO:teuthology.orchestra.run.smithi170.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 552 kB/s | 28 kB 00:00 2024-02-21T07:42:58.059 INFO:teuthology.orchestra.run.smithi170.stdout:(169/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 907 kB/s | 3.1 MB 00:03 2024-02-21T07:42:58.092 INFO:teuthology.orchestra.run.smithi170.stdout:(170/176): openssl-3.0.7-25.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2024-02-21T07:42:58.170 INFO:teuthology.orchestra.run.smithi156.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-02-21T07:42:58.204 INFO:teuthology.orchestra.run.smithi156.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.4 MB/s | 217 kB 00:00 2024-02-21T07:42:58.234 INFO:teuthology.orchestra.run.smithi170.stdout:(171/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 9.6 MB/s | 2.1 MB 00:00 2024-02-21T07:42:58.237 INFO:teuthology.orchestra.run.smithi156.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 174 kB 00:00 2024-02-21T07:42:58.271 INFO:teuthology.orchestra.run.smithi156.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 2.0 MB/s | 69 kB 00:00 2024-02-21T07:42:58.297 INFO:teuthology.orchestra.run.smithi156.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 1.6 MB/s | 41 kB 00:00 2024-02-21T07:42:58.338 INFO:teuthology.orchestra.run.smithi156.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-02-21T07:42:58.359 INFO:teuthology.orchestra.run.smithi170.stdout:(172/176): util-linux-2.37.4-18.el9.x86_64.rpm 7.3 MB/s | 2.2 MB 00:00 2024-02-21T07:42:58.372 INFO:teuthology.orchestra.run.smithi156.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.9 MB/s | 132 kB 00:00 2024-02-21T07:42:58.393 INFO:teuthology.orchestra.run.smithi170.stdout:(173/176): util-linux-core-2.37.4-18.el9.x86_64 1.4 MB/s | 438 kB 00:00 2024-02-21T07:42:58.408 INFO:teuthology.orchestra.run.smithi156.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 6.2 MB/s | 211 kB 00:00 2024-02-21T07:42:58.418 INFO:teuthology.orchestra.run.smithi170.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 165 kB/s | 30 kB 00:00 2024-02-21T07:42:58.439 INFO:teuthology.orchestra.run.smithi156.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-02-21T07:42:58.444 INFO:teuthology.orchestra.run.smithi170.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-02-21T07:42:58.473 INFO:teuthology.orchestra.run.smithi156.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2024-02-21T07:42:58.510 INFO:teuthology.orchestra.run.smithi170.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-02-21T07:42:58.515 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:42:58.516 INFO:teuthology.orchestra.run.smithi170.stdout:Total 5.9 MB/s | 223 MB 00:37 2024-02-21T07:42:58.560 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-02-21T07:42:58.629 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:42:58.754 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:42:58.835 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-02-21T07:42:58.835 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-02-21T07:42:58.873 INFO:teuthology.orchestra.run.smithi156.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-02-21T07:42:58.907 INFO:teuthology.orchestra.run.smithi156.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-02-21T07:42:58.932 INFO:teuthology.orchestra.run.smithi156.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.6 MB/s | 41 kB 00:00 2024-02-21T07:42:58.966 INFO:teuthology.orchestra.run.smithi156.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 6.3 MB/s | 215 kB 00:00 2024-02-21T07:42:58.991 INFO:teuthology.orchestra.run.smithi156.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 1.3 MB/s | 34 kB 00:00 2024-02-21T07:42:59.025 INFO:teuthology.orchestra.run.smithi156.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 43 kB 00:00 2024-02-21T07:42:59.067 INFO:teuthology.orchestra.run.smithi156.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-02-21T07:42:59.092 INFO:teuthology.orchestra.run.smithi156.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 2.2 MB/s | 56 kB 00:00 2024-02-21T07:42:59.126 INFO:teuthology.orchestra.run.smithi156.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2024-02-21T07:42:59.159 INFO:teuthology.orchestra.run.smithi156.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-02-21T07:42:59.193 INFO:teuthology.orchestra.run.smithi156.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-02-21T07:42:59.226 INFO:teuthology.orchestra.run.smithi156.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2024-02-21T07:42:59.260 INFO:teuthology.orchestra.run.smithi156.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 5.4 MB/s | 186 kB 00:00 2024-02-21T07:42:59.310 INFO:teuthology.orchestra.run.smithi156.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-02-21T07:42:59.441 INFO:teuthology.orchestra.run.smithi156.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 194 kB 00:00 2024-02-21T07:42:59.486 INFO:teuthology.orchestra.run.smithi156.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.7 MB/s | 217 kB 00:00 2024-02-21T07:42:59.520 INFO:teuthology.orchestra.run.smithi156.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 7.0 MB/s | 241 kB 00:00 2024-02-21T07:42:59.570 INFO:teuthology.orchestra.run.smithi156.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 23 MB/s | 1.1 MB 00:00 2024-02-21T07:42:59.604 INFO:teuthology.orchestra.run.smithi156.stdout:(98/176): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-02-21T07:42:59.637 INFO:teuthology.orchestra.run.smithi156.stdout:(99/176): python3-pycparser-2.20-6.el9.noarch.r 3.6 MB/s | 124 kB 00:00 2024-02-21T07:42:59.671 INFO:teuthology.orchestra.run.smithi156.stdout:(100/176): python3-requests-2.25.1-8.el9.noarch 3.3 MB/s | 113 kB 00:00 2024-02-21T07:42:59.705 INFO:teuthology.orchestra.run.smithi156.stdout:(101/176): python3-urllib3-1.26.5-5.el9.noarch. 5.5 MB/s | 187 kB 00:00 2024-02-21T07:42:59.840 INFO:teuthology.orchestra.run.smithi156.stdout:(102/176): python3-devel-3.9.17-2.el9.x86_64.rp 1.8 MB/s | 245 kB 00:00 2024-02-21T07:42:59.922 INFO:teuthology.orchestra.run.smithi156.stdout:(103/176): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-02-21T07:43:00.072 INFO:teuthology.orchestra.run.smithi156.stdout:(104/176): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-02-21T07:43:00.214 INFO:teuthology.orchestra.run.smithi156.stdout:(105/176): ceph-mgr-diskprediction-local-19.0.0 1.0 MB/s | 7.4 MB 00:07 2024-02-21T07:43:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:43:00.358 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:43:00.393 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:43:00.505 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-02-21T07:43:00.506 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-02-21T07:43:00.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:43:00.787 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:00.907 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:00.943 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:43:01.007 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:43:01.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:43:01.549 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:01.639 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:01.667 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:43:01.790 INFO:teuthology.orchestra.run.smithi156.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 196 kB/s | 309 kB 00:01 2024-02-21T07:43:01.831 INFO:teuthology.orchestra.run.smithi156.stdout:(107/176): abseil-cpp-20211102.0-3.el9.x86_64.r 312 kB/s | 548 kB 00:01 2024-02-21T07:43:02.023 INFO:teuthology.orchestra.run.smithi156.stdout:(108/176): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-02-21T07:43:02.765 INFO:teuthology.orchestra.run.smithi156.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 35 kB/s | 26 kB 00:00 2024-02-21T07:43:03.074 INFO:teuthology.orchestra.run.smithi156.stdout:(110/176): libarrow-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-02-21T07:43:03.091 INFO:teuthology.orchestra.run.smithi156.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 150 kB/s | 49 kB 00:00 2024-02-21T07:43:03.316 INFO:teuthology.orchestra.run.smithi156.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 279 kB/s | 67 kB 00:00 2024-02-21T07:43:03.750 INFO:teuthology.orchestra.run.smithi156.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 229 kB/s | 151 kB 00:00 2024-02-21T07:43:03.783 INFO:teuthology.orchestra.run.smithi156.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.8 MB/s | 838 kB 00:00 2024-02-21T07:43:04.092 INFO:teuthology.orchestra.run.smithi156.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 1.7 MB/s | 548 kB 00:00 2024-02-21T07:43:04.109 INFO:teuthology.orchestra.run.smithi156.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 134 kB/s | 43 kB 00:00 2024-02-21T07:43:04.232 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:04.280 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:04.309 INFO:teuthology.orchestra.run.smithi156.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 148 kB/s | 32 kB 00:00 2024-02-21T07:43:04.326 INFO:teuthology.orchestra.run.smithi156.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 69 kB/s | 15 kB 00:00 2024-02-21T07:43:04.551 INFO:teuthology.orchestra.run.smithi156.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 710 kB/s | 172 kB 00:00 2024-02-21T07:43:04.602 INFO:teuthology.orchestra.run.smithi156.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 1.3 MB/s | 358 kB 00:00 2024-02-21T07:43:04.810 INFO:teuthology.orchestra.run.smithi156.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-02-21T07:43:04.835 INFO:teuthology.orchestra.run.smithi156.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 151 kB/s | 35 kB 00:00 2024-02-21T07:43:04.913 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:04.959 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:05.126 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:43:05.126 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:43:05.126 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:05.176 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:05.269 INFO:teuthology.orchestra.run.smithi156.stdout:(123/176): ceph-test-19.0.0-1514.g25296a8f.el9. 1.7 MB/s | 47 MB 00:27 2024-02-21T07:43:05.294 INFO:teuthology.orchestra.run.smithi156.stdout:(124/176): python3-google-auth-2.27.0-1.el9.noa 419 kB/s | 203 kB 00:00 2024-02-21T07:43:05.411 INFO:teuthology.orchestra.run.smithi156.stdout:(125/176): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-02-21T07:43:05.528 INFO:teuthology.orchestra.run.smithi156.stdout:(126/176): python3-grpcio-tools-1.46.7-10.el9.x 565 kB/s | 144 kB 00:00 2024-02-21T07:43:05.553 INFO:teuthology.orchestra.run.smithi156.stdout:(127/176): python3-jaraco-8.2.1-3.el9.noarch.rp 41 kB/s | 11 kB 00:00 2024-02-21T07:43:05.637 INFO:teuthology.orchestra.run.smithi156.stdout:(128/176): python3-jaraco-classes-3.2.1-5.el9.n 78 kB/s | 18 kB 00:00 2024-02-21T07:43:05.754 INFO:teuthology.orchestra.run.smithi156.stdout:(129/176): python3-jaraco-collections-3.0.0-8.e 103 kB/s | 23 kB 00:00 2024-02-21T07:43:05.788 INFO:teuthology.orchestra.run.smithi156.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 83 kB/s | 19 kB 00:00 2024-02-21T07:43:05.896 INFO:teuthology.orchestra.run.smithi156.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 76 kB/s | 20 kB 00:00 2024-02-21T07:43:06.321 INFO:teuthology.orchestra.run.smithi156.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 1.8 MB/s | 1.0 MB 00:00 2024-02-21T07:43:06.346 INFO:teuthology.orchestra.run.smithi156.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 83 kB/s | 46 kB 00:00 2024-02-21T07:43:06.371 INFO:teuthology.orchestra.run.smithi156.stdout:(134/176): python3-more-itertools-8.12.0-2.el9. 166 kB/s | 79 kB 00:00 2024-02-21T07:43:06.547 INFO:teuthology.orchestra.run.smithi156.stdout:(135/176): python3-natsort-7.1.1-5.el9.noarch.r 256 kB/s | 58 kB 00:00 2024-02-21T07:43:06.639 INFO:teuthology.orchestra.run.smithi156.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-02-21T07:43:06.664 INFO:teuthology.orchestra.run.smithi156.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 56 kB/s | 16 kB 00:00 2024-02-21T07:43:06.781 INFO:teuthology.orchestra.run.smithi156.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 384 kB/s | 90 kB 00:00 2024-02-21T07:43:06.873 INFO:teuthology.orchestra.run.smithi156.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 121 kB/s | 28 kB 00:00 2024-02-21T07:43:06.906 INFO:teuthology.orchestra.run.smithi156.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 127 kB/s | 31 kB 00:00 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi156.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 779 kB/s | 188 kB 00:00 2024-02-21T07:43:07.099 INFO:teuthology.orchestra.run.smithi156.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 262 kB/s | 59 kB 00:00 2024-02-21T07:43:07.132 INFO:teuthology.orchestra.run.smithi156.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 159 kB/s | 36 kB 00:00 2024-02-21T07:43:07.249 INFO:teuthology.orchestra.run.smithi156.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 226 kB/s | 51 kB 00:00 2024-02-21T07:43:07.350 INFO:teuthology.orchestra.run.smithi156.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 916 kB/s | 230 kB 00:00 2024-02-21T07:43:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-02-21T07:43:07.514 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:43:07.548 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:43:07.579 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:43:07.604 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:43:07.616 INFO:teuthology.orchestra.run.smithi156.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 185 kB/s | 90 kB 00:00 2024-02-21T07:43:07.642 INFO:teuthology.orchestra.run.smithi156.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-02-21T07:43:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:43:07.667 INFO:teuthology.orchestra.run.smithi156.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 63 kB/s | 20 kB 00:00 2024-02-21T07:43:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:43:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:43:07.784 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:43:07.809 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:43:07.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:43:08.167 INFO:teuthology.orchestra.run.smithi156.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 383 kB/s | 192 kB 00:00 2024-02-21T07:43:08.171 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:43:08.227 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:08.326 INFO:teuthology.orchestra.run.smithi156.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2024-02-21T07:43:08.348 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:08.359 INFO:teuthology.orchestra.run.smithi156.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-02-21T07:43:08.378 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:08.434 INFO:teuthology.orchestra.run.smithi156.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 30 MB/s | 2.3 MB 00:00 2024-02-21T07:43:08.468 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:08.498 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:43:08.501 INFO:teuthology.orchestra.run.smithi156.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-02-21T07:43:08.535 INFO:teuthology.orchestra.run.smithi156.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 1.2 MB/s | 41 kB 00:00 2024-02-21T07:43:08.568 INFO:teuthology.orchestra.run.smithi156.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 7.2 MB/s | 246 kB 00:00 2024-02-21T07:43:08.602 INFO:teuthology.orchestra.run.smithi156.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-02-21T07:43:08.635 INFO:teuthology.orchestra.run.smithi156.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 35 kB 00:00 2024-02-21T07:43:08.658 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:43:08.669 INFO:teuthology.orchestra.run.smithi156.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 5.6 MB/s | 191 kB 00:00 2024-02-21T07:43:08.703 INFO:teuthology.orchestra.run.smithi156.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 7.5 MB/s | 254 kB 00:00 2024-02-21T07:43:08.706 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:43:08.734 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:08.753 INFO:teuthology.orchestra.run.smithi156.stdout:(160/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-02-21T07:43:08.787 INFO:teuthology.orchestra.run.smithi156.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 9.4 MB/s | 802 kB 00:00 2024-02-21T07:43:08.820 INFO:teuthology.orchestra.run.smithi156.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 6.5 MB/s | 433 kB 00:00 2024-02-21T07:43:08.837 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:08.846 INFO:teuthology.orchestra.run.smithi156.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-02-21T07:43:08.860 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:43:08.871 INFO:teuthology.orchestra.run.smithi156.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-21T07:43:08.896 INFO:teuthology.orchestra.run.smithi156.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-21T07:43:08.907 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:43:08.921 INFO:teuthology.orchestra.run.smithi156.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-21T07:43:08.938 INFO:teuthology.orchestra.run.smithi156.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 63 kB 00:00 2024-02-21T07:43:08.946 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:43:08.955 INFO:teuthology.orchestra.run.smithi156.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 831 kB/s | 28 kB 00:00 2024-02-21T07:43:08.970 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:43:08.987 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:43:08.989 INFO:teuthology.orchestra.run.smithi156.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 23 MB/s | 1.2 MB 00:00 2024-02-21T07:43:09.056 INFO:teuthology.orchestra.run.smithi156.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 22 MB/s | 2.1 MB 00:00 2024-02-21T07:43:09.106 INFO:teuthology.orchestra.run.smithi156.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 19 MB/s | 2.2 MB 00:00 2024-02-21T07:43:09.131 INFO:teuthology.orchestra.run.smithi156.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 5.9 MB/s | 438 kB 00:00 2024-02-21T07:43:09.157 INFO:teuthology.orchestra.run.smithi156.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 608 kB/s | 30 kB 00:00 2024-02-21T07:43:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:43:09.182 INFO:teuthology.orchestra.run.smithi156.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 6.2 MB/s | 321 kB 00:00 2024-02-21T07:43:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:43:09.215 INFO:teuthology.orchestra.run.smithi156.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2024-02-21T07:43:09.241 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:43:09.274 INFO:teuthology.orchestra.run.smithi156.stdout:(176/176): librados2-19.0.0-1514.g25296a8f.el9. 2.1 MB/s | 3.4 MB 00:01 2024-02-21T07:43:09.281 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:43:09.281 INFO:teuthology.orchestra.run.smithi156.stdout:Total 5.3 MB/s | 223 MB 00:41 2024-02-21T07:43:09.325 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2024-02-21T07:43:09.337 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:43:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:43:09.528 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:43:09.594 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:09.603 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2024-02-21T07:43:09.603 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2024-02-21T07:43:09.663 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:09.978 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:43:10.072 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:43:10.109 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:43:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:43:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:43:10.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:43:10.299 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:43:10.338 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:43:10.402 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:43:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:43:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:43:10.513 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:43:10.542 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:43:10.611 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:43:10.646 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:43:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:43:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:43:10.787 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:43:10.834 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:43:10.907 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:43:11.049 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:43:11.102 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:43:11.348 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2024-02-21T07:43:11.348 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2024-02-21T07:43:11.624 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:43:11.697 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:43:11.782 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:43:11.818 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:43:11.826 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:43:11.864 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:43:11.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:43:11.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:43:12.035 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:43:12.093 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:43:12.310 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:43:12.491 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:43:12.554 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:43:12.606 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:43:12.750 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:43:12.797 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:43:12.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:43:12.922 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:43:12.955 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:43:12.991 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:43:13.037 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:43:13.074 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:43:13.117 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:43:13.160 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:43:13.292 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:43:13.349 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:43:13.378 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:43:13.442 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:43:13.547 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:43:13.587 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:43:13.627 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:43:13.653 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:43:13.677 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:43:13.749 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:43:13.878 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:43:13.985 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:43:14.027 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:43:14.084 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:43:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:43:14.323 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:43:14.373 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:43:14.501 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:43:14.538 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:43:14.571 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:43:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:43:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:43:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:43:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:43:14.723 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:43:14.762 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:43:14.793 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:43:14.824 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:43:14.899 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:43:14.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:43:14.967 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:43:15.009 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:43:15.044 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:43:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:43:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:43:15.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:43:15.289 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:43:15.336 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:43:15.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:43:15.491 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:43:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:43:16.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:43:16.297 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:43:16.344 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:43:16.423 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:43:16.464 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:43:16.642 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:43:16.670 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:43:16.748 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:43:17.383 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:43:17.500 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:43:17.822 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-02-21T07:43:17.823 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:18.032 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:18.081 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:18.081 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:43:18.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:18.209 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2024-02-21T07:43:18.330 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:43:18.355 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:43:18.395 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:43:18.421 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:43:18.465 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:43:18.503 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:43:18.557 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:43:18.591 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:43:18.617 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:43:18.658 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:43:18.713 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:43:18.783 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:43:18.810 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:43:18.978 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:43:19.043 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:19.119 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:43:19.148 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:19.164 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:19.194 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:43:19.284 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:19.289 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:43:19.315 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:43:19.461 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:43:19.512 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:43:19.532 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:19.636 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:19.658 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:43:19.669 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:19.721 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:19.743 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:19.745 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:43:19.762 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:43:19.768 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:19.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:43:19.799 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:43:19.830 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:19.853 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:43:19.992 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:43:19.994 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:20.024 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:43:20.047 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:20.090 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:20.150 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:43:20.258 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:43:20.319 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:43:20.394 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:20.470 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:20.586 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:20.655 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:20.692 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:43:20.771 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:43:20.804 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:43:20.896 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:43:20.933 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:43:21.002 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:43:21.056 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:43:21.095 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:43:21.130 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:43:21.170 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:43:21.244 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:43:21.278 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:43:21.322 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:43:21.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:43:21.383 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:43:21.383 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:21.413 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:21.450 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:43:21.461 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:43:21.487 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:43:21.530 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:43:21.559 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:43:21.565 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:43:21.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:21.629 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:43:21.674 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:43:21.748 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:43:21.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:43:21.919 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:21.935 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:43:21.961 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:21.966 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:22.001 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:22.449 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:43:22.530 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:43:22.535 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:22.572 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:22.602 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:43:22.652 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:22.653 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:43:22.653 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:43:22.653 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:22.659 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:43:22.666 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:43:22.681 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:22.705 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:43:22.751 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:43:22.791 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:43:22.885 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:43:22.951 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:43:23.083 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:23.120 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:23.173 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:43:23.261 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:23.341 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:43:23.396 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:43:23.432 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:43:23.439 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:43:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:23.541 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:23.541 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:23.541 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:43:23.541 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:23.541 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:23.542 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:43:23.597 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:23.626 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:43:23.634 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:23.680 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:43:23.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:43:23.757 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:43:23.790 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:43:23.826 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:43:23.873 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:43:23.909 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:43:23.952 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:43:23.995 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:43:24.127 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:43:24.167 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:43:24.197 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:43:24.238 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:43:24.333 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:43:24.372 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:43:24.412 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:43:24.438 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:43:24.462 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:43:24.536 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:43:24.655 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:43:24.702 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:43:24.732 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:24.754 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:43:24.800 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:24.800 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:24.800 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:43:24.800 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:24.801 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:24.801 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:24.804 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:43:24.854 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:43:24.860 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:24.908 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:43:24.946 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:24.946 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:24.946 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:43:24.946 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:25.043 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:25.094 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:43:25.137 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:25.137 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:25.138 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:43:25.138 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:25.138 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:25.138 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:25.142 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:43:25.271 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:43:25.307 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:43:25.340 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:43:25.371 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:43:25.406 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:43:25.438 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:43:25.474 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:43:25.509 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:43:25.518 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:25.548 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:43:25.579 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:25.582 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:25.609 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:43:25.685 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:43:25.720 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:43:25.753 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:43:25.794 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:43:25.823 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:43:25.911 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:43:26.000 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:43:26.043 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:43:26.075 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:43:26.123 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:43:26.220 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:43:26.277 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:43:27.005 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:43:27.051 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:43:27.083 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:43:27.131 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:43:27.210 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:43:27.243 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:43:27.412 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:43:27.440 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:43:27.518 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:43:28.156 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:43:28.271 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:43:29.487 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:43:29.562 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:43:29.588 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:43:29.895 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:43:29.918 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:29.993 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:43:30.023 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:43:30.060 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:43:30.349 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:43:30.395 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:43:30.430 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:43:30.469 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:43:30.530 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:43:30.563 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:30.618 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:43:30.648 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:43:30.755 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:43:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:43:30.932 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:43:30.983 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:43:31.081 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:43:31.215 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:43:31.276 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:43:31.338 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:43:31.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:43:31.418 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:43:31.554 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:43:31.629 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:43:31.704 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:43:32.599 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:32.649 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:32.710 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:32.807 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:32.837 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:33.368 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:43:33.408 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:43:33.480 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:33.509 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:34.041 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:43:34.121 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:43:34.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:43:34.294 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:43:34.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:43:34.365 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:43:34.400 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:43:34.440 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:43:34.441 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:34.566 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:34.616 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:43:34.671 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:43:34.671 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:34.800 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:34.821 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:34.821 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-02-21T07:43:34.821 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-02-21T07:43:34.822 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:34.844 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:43:34.893 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:43:34.957 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:43:34.978 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:34.994 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:34.994 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:34.994 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:43:34.994 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:43:35.042 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:43:35.114 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:43:35.188 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:43:35.238 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:43:35.271 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:43:35.304 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:43:35.338 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:43:35.372 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:43:35.407 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:35.408 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:35.739 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:35.739 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:35.911 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:35.941 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:43:35.997 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:43:36.058 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:43:36.094 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:43:36.221 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:43:36.481 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:36.483 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:43:36.483 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-21T07:43:36.483 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:36.507 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:36.724 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:36.746 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:36.746 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:36.747 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:43:36.747 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:36.747 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:36.747 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:37.199 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:37.221 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:37.221 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:37.221 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:43:37.222 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:37.222 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:37.222 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:37.309 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:43:37.770 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:37.800 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:37.831 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:43:37.892 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:43:37.914 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:38.147 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:38.174 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:39.275 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:39.436 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:43:39.459 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:39.482 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:39.482 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:39.482 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:43:39.483 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:39.483 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:39.483 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:39.526 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:39.537 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:39.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:43:40.439 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:40.546 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:40.568 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:40.568 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:40.569 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:43:40.569 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:40.622 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:40.644 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:40.644 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:40.644 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:43:40.644 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:40.645 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:40.645 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:40.947 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:40.969 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:40.969 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:40.970 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:43:40.970 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:40.970 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:40.970 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:41.349 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:43:41.349 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:43:41.350 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:43:41.351 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:43:41.352 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:43:41.352 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:43:41.352 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:43:41.368 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:43:41.369 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:43:41.370 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:43:41.371 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:43:41.372 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:43:41.373 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:43:41.374 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:43:41.375 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:43:41.376 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:43:41.377 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:43:41.378 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:43:41.379 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:43:41.380 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:43:41.381 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:43:41.381 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:43:41.381 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:43:41.381 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:43:43.931 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:43:43.932 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:43.933 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.934 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.935 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:43:43.936 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:43:43.937 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:43:43.938 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.939 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:43:43.940 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:43:43.941 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:43:43.942 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:43:43.943 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:43:43.944 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:43:43.945 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:43:43.945 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:43:43.945 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:43:43.945 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-02-21T07:43:44.530 DEBUG:teuthology.parallel:result is None 2024-02-21T07:43:45.343 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:43:45.343 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2024-02-21T07:43:45.343 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2024-02-21T07:43:45.343 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2024-02-21T07:43:45.343 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2024-02-21T07:43:45.344 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2024-02-21T07:43:45.344 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /root 2024-02-21T07:43:45.344 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2024-02-21T07:43:45.344 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:43:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:43:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:43:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:43:45.508 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:45.523 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:43:45.523 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:45.523 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:43:45.523 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:43:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:43:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:43:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:43:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:43:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:43:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:43:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:43:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:43:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:43:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:43:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:43:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:43:46.875 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:46.912 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:46.931 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:46.994 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:47.019 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:43:47.020 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:47.020 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:43:47.020 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:47.020 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:43:47.020 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:47.228 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:47.250 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:43:47.250 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:47.250 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:43:47.250 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:47.251 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:43:47.251 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:47.704 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:47.726 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:43:47.726 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:47.726 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:43:47.726 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:47.727 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:43:47.727 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:47.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:43:47.807 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:43:47.823 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:43:47.847 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:43:47.927 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:43:47.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:43:47.994 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:43:48.019 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:43:48.046 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:43:48.046 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:43:48.197 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:43:48.197 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:48.251 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:48.279 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:43:48.282 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:43:48.311 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:43:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:43:48.373 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:43:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:43:48.402 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:48.403 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:43:48.435 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:43:48.468 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:43:48.515 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:43:48.557 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:43:48.581 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:43:48.608 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:43:48.632 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:43:48.637 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:43:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:43:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:48.672 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:48.844 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:48.844 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:48.927 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:48.951 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:43:48.983 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:43:49.010 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:43:49.036 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:43:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:43:49.640 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:43:49.672 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:49.773 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:43:49.926 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:43:49.949 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:49.972 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:43:49.972 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:49.972 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:43:49.972 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:49.973 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:43:49.973 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:50.017 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:50.027 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:43:50.073 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:43:50.931 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:43:50.969 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:43:50.991 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:51.036 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:51.058 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:43:51.058 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:51.058 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:43:51.058 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:51.112 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:51.133 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:43:51.133 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:51.134 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:43:51.134 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:51.134 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:43:51.134 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:51.438 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:43:51.460 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:43:53.949 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:43:53.950 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:43:53.951 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:43:53.952 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:43:53.953 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:43:53.954 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:43:53.955 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:43:53.956 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:43:53.957 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:43:53.958 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:43:53.959 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:43:53.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:43:53.961 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:43:53.962 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:43:53.963 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:43:53.964 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:43:55.852 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:43:55.893 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:43:55.922 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:43:55.950 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:43:56.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:43:56.250 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:43:56.289 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:43:56.329 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:43:56.382 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:43:56.458 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:43:56.500 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:43:56.535 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:43:56.566 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:43:56.596 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:43:56.660 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:56.712 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.713 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:43:56.714 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.715 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:43:56.716 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.717 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:43:56.718 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:43:56.719 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:43:56.720 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:43:56.721 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:43:56.722 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:43:56.723 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:43:56.724 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:43:56.725 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:43:56.726 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:43:56.726 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:43:56.726 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:43:56.726 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-02-21T07:43:56.761 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:43:57.339 DEBUG:teuthology.parallel:result is None 2024-02-21T07:43:57.364 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:57.401 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:57.420 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:43:58.240 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:43:58.313 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:43:58.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:43:58.435 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:43:58.467 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:43:58.492 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:43:58.518 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:43:58.544 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:43:58.544 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:58.629 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:43:58.657 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:43:58.695 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:43:58.695 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:58.780 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:43:58.806 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:43:58.840 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:43:58.865 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:43:58.892 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:43:58.925 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:43:58.957 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:43:58.997 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:43:59.030 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:43:59.055 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:43:59.080 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:43:59.106 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:43:59.123 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:43:59.129 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:59.129 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:59.309 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:43:59.309 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:59.384 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:43:59.408 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:43:59.441 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:43:59.467 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:43:59.493 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:43:59.558 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:44:04.561 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:44:04.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:44:04.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:44:04.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:44:04.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:44:04.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:44:04.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:44:04.583 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:44:04.584 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:44:04.585 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:44:04.586 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:44:04.587 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:44:04.588 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:44:04.589 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:44:04.590 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:44:04.591 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:44:04.592 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:44:04.593 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:44:04.594 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:44:04.595 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:44:04.596 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:44:04.597 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:44:07.403 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:44:07.404 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:44:07.405 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.406 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.407 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:44:07.408 INFO:teuthology.orchestra.run.smithi156.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:44:07.409 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:44:07.411 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:44:07.412 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:44:07.413 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:44:07.414 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:44:07.415 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:44:07.416 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:44:07.417 INFO:teuthology.orchestra.run.smithi156.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:44:07.418 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:44:07.419 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:44:07.419 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:07.419 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2024-02-21T07:44:08.010 DEBUG:teuthology.parallel:result is None 2024-02-21T07:44:08.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:44:08.159 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:44:08.232 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.232 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.233 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:44:08.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:44:08.461 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:44:08.482 INFO:teuthology.orchestra.run.smithi156.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.482 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.482 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:44:08.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:44:08.700 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:44:08.725 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.726 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:44:08.726 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:44:08.727 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-21T07:44:08.728 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:08.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:44:08.832 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:08.832 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:44:08.862 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:08.862 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:44:08.897 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-21T07:44:08.897 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:08.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:44:08.997 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:44:09.084 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:09.084 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:44:09.113 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:44:09.180 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:09.180 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:44:09.212 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:44:09.283 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-21T07:44:09.284 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:09.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:44:09.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:44:09.523 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:09.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:44:09.552 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:44:09.621 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:09.621 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:44:09.652 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:44:09.722 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-21T07:44:09.722 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:09.722 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:44:09.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:44:09.914 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:09.914 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:44:09.944 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:44:10.013 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:10.013 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:44:10.048 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:44:10.118 INFO:teuthology.run_tasks:Running task ceph... 2024-02-21T07:44:10.228 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-21T07:44:10.228 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-02-21T07:44:10.236 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /var/log/ceph 2024-02-21T07:44:10.238 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-02-21T07:44:10.315 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-21T07:44:10.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:44:10.320 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:44:10.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:44:10.401 INFO:tasks.ceph:Creating extra log directories... 2024-02-21T07:44:10.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:44:10.406 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:44:10.408 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:44:10.503 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-21T07:44:10.504 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-21T07:44:10.504 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-21T07:44:10.504 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:10.504 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:44:10.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:10.829 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:10.928 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:10.928 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:44:10.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:11.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:11.096 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:11.096 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:44:11.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:11.233 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:11.267 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-21T07:44:11.268 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-21T07:44:11.268 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'branch': 'wip-vshankar-testing-20240216.060239', 'description': 'fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7569311', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240216.060239'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'subvols': {'create': 2}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'ceph-fuse': {'client.0': {'mount_subvol_num': 0}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}, 'dry_run': True}, 'install': {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, 'kclient': {'client.0': {'mount_subvol_num': 1}, 'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240216.060239', 'sha1': 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'seed': 9275, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'sleep_before_teardown': 0, 'subset': '805/1024', 'suite': 'fs:workload', 'suite_branch': 'wip-vshankar-testing-20240216.060239', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABq3/artMQBkN1Ql1hO4MSkY3sikJEVMzCZG/+2std8s60rb4V+in2DLqkSTzv5sg6XQE4i8Lhx+hcdEc+SvoY=', 'smithi156.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6aCInOFSF360JZMBeUckUwL80ZeVFRCcgJ48fg7L0LunU59aHFTzAVazDlWkAzvyftqLqJO+F6D3yZrlHmj7Y=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1B0xZ16DhDXJZ5ClgNzYsiuU+sg2ZmyyDdgZWx1ZeB/AukG67zU/PeVGlgmTyhVv/GQkIzAjCk+2ydaEsJuNk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'subvols': {'create': 2}, 'cluster': 'ceph'}}, {'kclient': None}, {'exec': {'mon.a': ['ceph fs set cephfs balance_automate true']}}, {'check-counter': {}}, {'fwd_scrub': {'scrub_timeout': 900, 'sleep_between_iterations': 1}}, {'background_exec': {'mon.a': ['while sleep 13; do ceph tell mds.cephfs:0 flush journal; done']}}, {'workunit': {'clients': {'all': ['suites/iogen.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-21_07:17:34', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-21T07:44:11.268 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:44:11.276 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:44:11.278 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:44:11.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:44:11.330 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:44:11.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:44:11.418 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:11.418 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:44:11.473 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:44:11.474 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-02-21T07:44:11.522 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:44:11.522 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-02-21 07:43:36.942082171 +0000 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-02-21 07:41:13.839011960 +0000 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-02-21 07:41:13.839011960 +0000 2024-02-21T07:44:11.523 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-02-21 07:41:13.839011960 +0000 2024-02-21T07:44:11.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:44:11.609 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-02-21T07:44:11.610 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-02-21T07:44:11.610 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000345976 s, 1.5 MB/s 2024-02-21T07:44:11.613 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:44:11.669 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-02-21 07:43:36.943082145 +0000 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-02-21 07:41:14.387997805 +0000 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-02-21 07:41:14.387997805 +0000 2024-02-21T07:44:11.718 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-02-21 07:41:14.387997805 +0000 2024-02-21T07:44:11.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:44:11.803 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-02-21T07:44:11.804 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-02-21T07:44:11.804 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000347867 s, 1.5 MB/s 2024-02-21T07:44:11.808 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:44:11.862 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-02-21T07:44:11.909 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:44:11.909 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:11.909 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-02-21 07:43:36.943082145 +0000 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-02-21 07:41:14.952983237 +0000 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-02-21 07:41:14.952983237 +0000 2024-02-21T07:44:11.910 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-02-21 07:41:14.952983237 +0000 2024-02-21T07:44:11.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:44:12.001 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-02-21T07:44:12.001 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-02-21T07:44:12.001 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00030719 s, 1.7 MB/s 2024-02-21T07:44:12.005 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:44:12.062 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-02-21T07:44:12.108 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-02-21 07:43:36.944082119 +0000 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-02-21 07:41:15.523968515 +0000 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-02-21 07:41:15.523968515 +0000 2024-02-21T07:44:12.109 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-02-21 07:41:15.523968515 +0000 2024-02-21T07:44:12.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:44:12.196 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-02-21T07:44:12.196 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-02-21T07:44:12.196 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000336524 s, 1.5 MB/s 2024-02-21T07:44:12.201 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:44:12.258 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:12.258 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:12.258 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:44:12.277 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:44:12.277 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2024-02-21T07:44:12.335 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:44:12.335 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-02-21 07:43:59.887400722 +0000 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-02-21 07:40:35.281829659 +0000 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-02-21 07:40:35.281829659 +0000 2024-02-21T07:44:12.336 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-02-21 07:40:35.281829659 +0000 2024-02-21T07:44:12.336 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:44:12.405 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-02-21T07:44:12.405 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-02-21T07:44:12.405 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000122426 s, 4.2 MB/s 2024-02-21T07:44:12.406 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:44:12.464 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2024-02-21T07:44:12.521 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:44:12.521 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:12.521 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-02-21T07:44:12.521 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:12.521 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:12.522 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-02-21 07:43:59.887400722 +0000 2024-02-21T07:44:12.522 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-02-21 07:40:35.606824665 +0000 2024-02-21T07:44:12.522 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-02-21 07:40:35.606824665 +0000 2024-02-21T07:44:12.522 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-02-21 07:40:35.606824665 +0000 2024-02-21T07:44:12.522 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:44:12.591 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-02-21T07:44:12.591 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-02-21T07:44:12.591 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.00011733 s, 4.4 MB/s 2024-02-21T07:44:12.592 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:44:12.651 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2024-02-21T07:44:12.708 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:44:12.708 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:12.708 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-02-21T07:44:12.708 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:12.709 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:12.709 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-02-21 07:43:59.887400722 +0000 2024-02-21T07:44:12.709 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-02-21 07:40:35.938819564 +0000 2024-02-21T07:44:12.709 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-02-21 07:40:35.938819564 +0000 2024-02-21T07:44:12.709 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-02-21 07:40:35.938819564 +0000 2024-02-21T07:44:12.709 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:44:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-02-21T07:44:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-02-21T07:44:12.777 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000109474 s, 4.7 MB/s 2024-02-21T07:44:12.778 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:44:12.836 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2024-02-21 07:43:59.888400707 +0000 2024-02-21T07:44:12.892 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2024-02-21 07:40:36.261814601 +0000 2024-02-21T07:44:12.893 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2024-02-21 07:40:36.261814601 +0000 2024-02-21T07:44:12.893 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: 2024-02-21 07:40:36.261814601 +0000 2024-02-21T07:44:12.893 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:44:12.960 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2024-02-21T07:44:12.960 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2024-02-21T07:44:12.960 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000115441 s, 4.4 MB/s 2024-02-21T07:44:12.961 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:44:13.018 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:13.018 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:13.018 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:44:13.036 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:44:13.037 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-02-21T07:44:13.093 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:44:13.093 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-21 07:43:49.413162886 +0000 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-21 07:40:10.069318039 +0000 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-21 07:40:10.069318039 +0000 2024-02-21T07:44:13.094 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-21 07:40:10.069318039 +0000 2024-02-21T07:44:13.094 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:44:13.162 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-21T07:44:13.162 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-21T07:44:13.162 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000116855 s, 4.4 MB/s 2024-02-21T07:44:13.163 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:44:13.221 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-21 07:43:49.413162886 +0000 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-21 07:40:10.400309726 +0000 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-21 07:40:10.400309726 +0000 2024-02-21T07:44:13.278 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-21 07:40:10.400309726 +0000 2024-02-21T07:44:13.279 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:44:13.346 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-21T07:44:13.346 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-21T07:44:13.346 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000111492 s, 4.6 MB/s 2024-02-21T07:44:13.347 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:44:13.404 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 699 Links: 1 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:13.460 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-21 07:43:49.414162861 +0000 2024-02-21T07:44:13.461 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-21 07:40:10.723301615 +0000 2024-02-21T07:44:13.461 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-21 07:40:10.723301615 +0000 2024-02-21T07:44:13.461 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-21 07:40:10.723301615 +0000 2024-02-21T07:44:13.461 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:44:13.526 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-21T07:44:13.527 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-21T07:44:13.527 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.00010389 s, 4.9 MB/s 2024-02-21T07:44:13.528 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:44:13.584 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-02-21T07:44:13.639 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:44:13.639 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-02-21 07:43:49.414162861 +0000 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-02-21 07:40:11.058293203 +0000 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-02-21 07:40:11.058293203 +0000 2024-02-21T07:44:13.640 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-02-21 07:40:11.058293203 +0000 2024-02-21T07:44:13.640 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:44:13.705 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-02-21T07:44:13.705 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-02-21T07:44:13.706 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.3885e-05 s, 6.1 MB/s 2024-02-21T07:44:13.707 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:44:13.763 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:13.763 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T07:44:13.763 INFO:tasks.ceph:Generating config... 2024-02-21T07:44:13.764 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-21T07:44:13.764 INFO:tasks.ceph:[client] debug client = 20 2024-02-21T07:44:13.764 INFO:tasks.ceph:[client] debug ms = 1 2024-02-21T07:44:13.764 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-21T07:44:13.765 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-21T07:44:13.765 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-21T07:44:13.765 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mgr] cephsqlite lock renewal timeout = 900000 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-21T07:44:13.766 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-21T07:44:13.766 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-21T07:44:13.766 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-02-21T07:44:13.766 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-21T07:44:13.766 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-21T07:44:13.766 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-02-21T07:44:13.767 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2024-02-21T07:44:13.767 INFO:tasks.ceph:Setting up mon.a... 2024-02-21T07:44:13.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-21T07:44:13.933 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-02-21T07:44:13.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-21T07:44:14.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:44:14.165 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.156'), ('mon.c', '172.21.15.170')] 2024-02-21T07:44:14.166 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.156,172.21.15.170', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'cephsqlite lock renewal timeout': 900000}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-21T07:44:14.167 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:14.167 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T07:44:14.213 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.156 --add c 172.21.15.170 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid b9cc1397-a437-4ace-98ff-c29f55191169 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:fsid b9cc1397-a437-4ace-98ff-c29f55191169 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-02-21T07:44:14.351148+0000 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-02-21T07:44:14.351148+0000 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 17 (quincy) 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-02-21T07:44:14.356 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon.b 2024-02-21T07:44:14.357 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.c 2024-02-21T07:44:14.357 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-21T07:44:14.359 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T07:44:14.409 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b9cc1397-a437-4ace-98ff-c29f55191169... 2024-02-21T07:44:14.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:44:14.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:44:14.417 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:44:14.472 INFO:teuthology.orchestra.run.smithi156.stdout:[global] 2024-02-21T07:44:14.472 INFO:teuthology.orchestra.run.smithi156.stdout: chdir = "" 2024-02-21T07:44:14.472 INFO:teuthology.orchestra.run.smithi156.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: auth supported = cephx 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: filestore xattr use omap = true 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: mon clock drift allowed = 1.000 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: osd crush chooseleaf type = 0 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: auth debug = true 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on old message = true 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on bug = true 2024-02-21T07:44:14.473 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon pg warn max object skew = 0 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default size = 2 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow primary affinity = true 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd allow pg remap = true 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on no sortbitwise = false 2024-02-21T07:44:14.474 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon warn on too few osds = false 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon_allow_pool_size_one = true 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: osd default data pool replay window = 5 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon allow pool delete = true 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon cluster log file level = debug 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: debug asserts on shutdown = true 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon health detail to clog = false 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: mon host = "172.21.15.100,172.21.15.156,172.21.15.170" 2024-02-21T07:44:14.475 INFO:teuthology.orchestra.run.smithi156.stdout: ms die on skipped message = False 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: fsid = b9cc1397-a437-4ace-98ff-c29f55191169 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout:[osd] 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd journal size = 100 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub load threshold = 5.0 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd scrub max interval = 600 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd recover clone overlap = true 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd recovery max chunk = 1048576 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.476 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug shutdown = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug op order = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug verify stray on activate = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug trim objects = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd open classes on start = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug pg log writeout = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: osd map max advance = 10 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: journal zero on create = true 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:44:14.477 INFO:teuthology.orchestra.run.smithi156.stdout: filestore apply finisher threads = 3 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: bdev debug aio = true 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: osd debug misdirected ops = true 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore block size = 96636764160 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore compression mode = aggressive 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: bluestore fsck on mount = True 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluefs = 20 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: debug bluestore = 20 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: debug osd = 20 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: debug rocksdb = 10 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd full ratio = 0.9 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:44:14.478 INFO:teuthology.orchestra.run.smithi156.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: osd objectstore = bluestore 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: osd shutdown pgref assert = True 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr] 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: debug mgr = 20 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: mgr/telemetry/nag = false 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.479 INFO:teuthology.orchestra.run.smithi156.stdout:[mon] 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: debug mon = 20 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: debug paxos = 20 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: debug auth = 20 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon data avail warn = 5 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon mgr mkfs grace = 240 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd reporter subtree level = osd 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon osd prime pg temp = true 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:44:14.480 INFO:teuthology.orchestra.run.smithi156.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: # 1m isn't quite enough 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: mon op complaint time = 120 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout:[client] 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: rgw cache enabled = true 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable ops log = true 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: rgw enable usage log = true 2024-02-21T07:44:14.481 INFO:teuthology.orchestra.run.smithi156.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: client mount timeout = 600 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: debug client = 20 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.a] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.b] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mon.c] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.g] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.j] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.e] 2024-02-21T07:44:14.482 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.h] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.k] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.f] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.i] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.l] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout:[mds] 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds = 20 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: debug mds balancer = 20 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: debug ms = 1 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal fragment size max = 10000 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal merge size = 5 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal split bits = 3 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: mds bal split size = 100 2024-02-21T07:44:14.483 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug frag = True 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: mds debug scatterstat = True 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: mds op complaint time = 180 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: mds verify scatter = True 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: osd op complaint time = 180 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi156.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-02-21T07:44:14.484 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-02-21T07:44:14.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:44:14.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-02-21T07:44:14.487 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.100,172.21.15.156,172.21.15.170" 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on skipped message = False 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = b9cc1397-a437-4ace-98ff-c29f55191169 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-02-21T07:44:14.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore compression mode = aggressive 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 20 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 20 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-02-21T07:44:14.490 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 10 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd shutdown pgref assert = True 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-02-21T07:44:14.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-02-21T07:44:14.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: mon op complaint time = 120 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: client mount timeout = 600 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: debug client = 20 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-02-21T07:44:14.494 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.g] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.j] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.e] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.h] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.k] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.f] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.i] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.l] 2024-02-21T07:44:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:[mds] 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds = 20 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: debug mds balancer = 20 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal fragment size max = 10000 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal merge size = 5 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal split bits = 3 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds bal split size = 100 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug frag = True 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds debug scatterstat = True 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds op complaint time = 180 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: mds verify scatter = True 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: osd op complaint time = 180 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.496 INFO:teuthology.orchestra.run.smithi170.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.156,172.21.15.170" 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = b9cc1397-a437-4ace-98ff-c29f55191169 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-02-21T07:44:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore compression mode = aggressive 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-02-21T07:44:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: osd shutdown pgref assert = True 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.g] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.j] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.h] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.k] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.i] 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.l] 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal fragment size max = 10000 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 5 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split bits = 3 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split size = 100 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-02-21T07:44:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-02-21T07:44:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-02-21T07:44:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-02-21T07:44:14.611 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-21T07:44:14.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-21T07:44:14.757 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-21T07:44:14.757 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:14.757 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-21T07:44:14.807 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:14.807 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-21T07:44:14.856 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:44:14.856 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:14.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:44:14.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:44:15.047 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:44:15.047 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:15.143 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:44:15.143 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:15.143 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:44:15.143 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:44:15.188 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:44:15.188 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:15.245 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:44:15.245 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:15.245 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:44:15.245 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:44:15.290 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:44:15.290 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:15.347 INFO:tasks.ceph:Setting up mon nodes... 2024-02-21T07:44:15.348 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-21T07:44:15.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T07:44:15.526 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T07:44:15.537 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T07:44:15.606 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T07:44:15.609 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T07:44:15.677 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T07:44:15.680 INFO:tasks.ceph:Setting up mds nodes... 2024-02-21T07:44:15.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T07:44:15.855 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T07:44:15.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-21T07:44:15.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T07:44:16.127 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T07:44:16.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-21T07:44:16.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T07:44:16.409 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T07:44:16.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2024-02-21T07:44:16.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T07:44:16.699 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T07:44:16.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2024-02-21T07:44:16.802 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T07:44:16.865 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T07:44:16.868 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-21T07:44:16.896 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T07:44:16.993 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T07:44:16.996 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-02-21T07:44:17.023 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T07:44:17.117 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T07:44:17.119 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2024-02-21T07:44:17.145 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T07:44:17.240 INFO:teuthology.orchestra.run.smithi156.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T07:44:17.242 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2024-02-21T07:44:17.269 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T07:44:17.330 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T07:44:17.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-21T07:44:17.361 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T07:44:17.457 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T07:44:17.459 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-02-21T07:44:17.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T07:44:17.581 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T07:44:17.584 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2024-02-21T07:44:17.610 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T07:44:17.704 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T07:44:17.707 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2024-02-21T07:44:17.733 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-21T07:44:17.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-21T07:44:17.847 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-21T07:44:17.891 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-21T07:44:17.892 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi156.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T07:44:17.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-21T07:44:17.974 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:17.974 INFO:tasks.ceph:role: osd.0 2024-02-21T07:44:17.974 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:44:17.974 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:44:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:18.066 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:18.066 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:18.066 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:18.066 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:18.067 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:18.067 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:18.067 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:18.575 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-02-21T07:44:18.582 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-02-21T07:44:18.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-21T07:44:18.760 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-21T07:44:18.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-21T07:44:18.959 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:18.959 INFO:tasks.ceph:role: osd.3 2024-02-21T07:44:18.959 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:44:18.960 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:19.060 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:19.061 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:19.544 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-02-21T07:44:19.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-02-21T07:44:19.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-02-21T07:44:19.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-21T07:44:19.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-21T07:44:19.869 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:19.870 INFO:tasks.ceph:role: osd.6 2024-02-21T07:44:19.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:44:19.870 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:19.966 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:19.967 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:20.487 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-02-21T07:44:20.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-02-21T07:44:20.494 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-21T07:44:20.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-21T07:44:20.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-02-21T07:44:20.874 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:20.874 INFO:tasks.ceph:role: osd.9 2024-02-21T07:44:20.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:44:20.874 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:44:20.970 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:20.971 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:21.433 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-02-21T07:44:21.439 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-02-21T07:44:21.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2024-02-21T07:44:21.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-02-21T07:44:21.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:21.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.820+0000 7fa11560c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-21T07:44:21.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.824+0000 7fa11560c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-21T07:44:21.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.824+0000 7fa11560c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:44:21.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.825+0000 7fa11560c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:44:21.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.825+0000 7fa11560c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:44:21.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:21.831+0000 7fa11560c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-21T07:44:25.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-21T07:44:25.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:25.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.263+0000 7f3c7f4bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-21T07:44:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.263+0000 7f3c7f4bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-21T07:44:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.264+0000 7f3c7f4bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:44:25.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.264+0000 7f3c7f4bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:44:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.264+0000 7f3c7f4bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:44:25.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:25.266+0000 7f3c7f4bf640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-21T07:44:28.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-21T07:44:28.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:28.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.429+0000 7f4e99089640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-21T07:44:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.429+0000 7f4e99089640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-21T07:44:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.429+0000 7f4e99089640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:44:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.429+0000 7f4e99089640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:44:28.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.429+0000 7f4e99089640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:44:28.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:28.431+0000 7f4e99089640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-21T07:44:31.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-21T07:44:31.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:31.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.590+0000 7ff50eb24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-02-21T07:44:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.590+0000 7ff50eb24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-02-21T07:44:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.590+0000 7ff50eb24640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:44:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.590+0000 7ff50eb24640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:44:31.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.590+0000 7ff50eb24640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:44:31.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:44:31.592+0000 7ff50eb24640 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-02-21T07:44:34.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-02-21T07:44:34.609 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-21T07:44:34.640 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:34.640 INFO:tasks.ceph:role: osd.1 2024-02-21T07:44:34.641 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:44:34.641 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:34.710 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:34.742 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-02-21T07:44:34.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-02-21T07:44:34.744 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-21T07:44:34.815 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-21T07:44:34.888 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-21T07:44:34.956 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:34.956 INFO:tasks.ceph:role: osd.4 2024-02-21T07:44:34.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:44:34.957 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:44:35.022 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:35.023 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:35.023 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:35.024 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:35.024 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:35.024 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:35.024 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:35.055 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-02-21T07:44:35.057 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-02-21T07:44:35.057 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-02-21T07:44:35.128 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-21T07:44:35.200 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-21T07:44:35.267 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:35.267 INFO:tasks.ceph:role: osd.7 2024-02-21T07:44:35.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:44:35.267 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:35.335 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:35.336 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:35.336 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:35.368 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-02-21T07:44:35.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-02-21T07:44:35.370 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2024-02-21T07:44:35.441 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-21T07:44:35.511 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-02-21T07:44:35.578 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:35.578 INFO:tasks.ceph:role: osd.10 2024-02-21T07:44:35.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:44:35.579 DEBUG:teuthology.orchestra.run.smithi156:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:35.644 INFO:teuthology.orchestra.run.smithi156.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:35.645 INFO:teuthology.orchestra.run.smithi156.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:35.645 INFO:teuthology.orchestra.run.smithi156.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:35.645 INFO:teuthology.orchestra.run.smithi156.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:35.645 INFO:teuthology.orchestra.run.smithi156.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:35.677 INFO:teuthology.orchestra.run.smithi156.stdout:Discarding blocks...Done. 2024-02-21T07:44:35.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi156.front.sepia.ceph.com -o noatime 2024-02-21T07:44:35.679 DEBUG:teuthology.orchestra.run.smithi156:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2024-02-21T07:44:35.748 DEBUG:teuthology.orchestra.run.smithi156:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-02-21T07:44:35.818 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:44:35.915 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:35.909+0000 7fe1c5612640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-21T07:44:38.758 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-21T07:44:38.788 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:44:38.880 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:38.874+0000 7ff4c391d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-21T07:44:41.269 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:41.277 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:41.280 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:41.729 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-21T07:44:41.760 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:44:41.853 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:41.847+0000 7f1cff19a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-21T07:44:44.692 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-21T07:44:44.723 DEBUG:teuthology.orchestra.run.smithi156:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:44.814 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.808+0000 7f6bc8a15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-02-21T07:44:44.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.809+0000 7f6bc8a15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-02-21T07:44:44.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.809+0000 7f6bc8a15640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:44:44.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.809+0000 7f6bc8a15640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:44:44.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.809+0000 7f6bc8a15640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:44:44.815 INFO:teuthology.orchestra.run.smithi156.stderr:2024-02-21T07:44:44.809+0000 7f6bc8a15640 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-02-21T07:44:47.670 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-02-21T07:44:47.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-21T07:44:47.733 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:47.734 INFO:tasks.ceph:role: osd.2 2024-02-21T07:44:47.734 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:44:47.734 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:47.803 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:47.804 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:47.804 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:47.804 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:47.804 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:47.836 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-02-21T07:44:47.838 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-02-21T07:44:47.838 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-02-21T07:44:47.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-21T07:44:47.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-21T07:44:48.048 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:48.048 INFO:tasks.ceph:role: osd.5 2024-02-21T07:44:48.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:44:48.048 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:48.115 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:48.147 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-02-21T07:44:48.148 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-02-21T07:44:48.149 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-21T07:44:48.218 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-21T07:44:48.289 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-02-21T07:44:48.356 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:48.357 INFO:tasks.ceph:role: osd.8 2024-02-21T07:44:48.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:44:48.357 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:44:48.422 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:48.422 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:48.422 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:48.422 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:48.423 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:48.454 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-02-21T07:44:48.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-02-21T07:44:48.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-02-21T07:44:48.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-02-21T07:44:48.633 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-02-21T07:44:48.698 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:44:48.698 INFO:tasks.ceph:role: osd.11 2024-02-21T07:44:48.698 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:44:48.698 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:44:48.764 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:44:48.765 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:44:48.765 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:44:48.796 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-02-21T07:44:48.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-02-21T07:44:48.798 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2024-02-21T07:44:48.869 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-02-21T07:44:48.940 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:49.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.049+0000 7ff9f821f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-21T07:44:49.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.049+0000 7ff9f821f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-21T07:44:49.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.049+0000 7ff9f821f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:44:49.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.049+0000 7ff9f821f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:44:49.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.049+0000 7ff9f821f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:44:49.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:49.050+0000 7ff9f821f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-21T07:44:51.899 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-21T07:44:51.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:44:52.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:52.013+0000 7f95b239e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-21T07:44:54.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-21T07:44:54.885 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:54.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.965+0000 7f244ae12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-02-21T07:44:54.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.965+0000 7f244ae12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-02-21T07:44:54.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.965+0000 7f244ae12640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:44:54.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.966+0000 7f244ae12640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:44:54.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.966+0000 7f244ae12640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:44:54.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:54.966+0000 7f244ae12640 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-02-21T07:44:57.811 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-02-21T07:44:57.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:44:57.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.929+0000 7f9480614640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-02-21T07:44:57.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.930+0000 7f9480614640 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-02-21T07:44:57.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.930+0000 7f9480614640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:44:57.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.930+0000 7f9480614640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:44:57.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.930+0000 7f9480614640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:44:57.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:44:57.930+0000 7f9480614640 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-02-21T07:45:00.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-02-21T07:45:00.812 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-21T07:45:00.813 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:00.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-21T07:45:00.912 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:00.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-21T07:45:01.005 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.005 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-21T07:45:01.099 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2024-02-21T07:45:01.185 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2024-02-21T07:45:01.265 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-21T07:45:01.403 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-21T07:45:01.494 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.495 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-21T07:45:01.579 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:01.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-02-21T07:45:01.666 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.666 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-21T07:45:01.698 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-21T07:45:01.770 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.770 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-02-21T07:45:01.840 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.840 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2024-02-21T07:45:01.909 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.909 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2024-02-21T07:45:01.978 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:01.978 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-21T07:45:02.048 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:02.048 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-21T07:45:02.116 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:02.117 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-21T07:45:02.184 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:02.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-02-21T07:45:02.252 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.253 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-02-21T07:45:02.285 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.285 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-21T07:45:02.356 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.356 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-02-21T07:45:02.427 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.427 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2024-02-21T07:45:02.496 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.497 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2024-02-21T07:45:02.565 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.565 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-21T07:45:02.633 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.633 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-21T07:45:02.701 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-02-21T07:45:02.767 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:02.767 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-02-21T07:45:02.834 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:02.834 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-21T07:45:02.890 INFO:tasks.ceph:Adding keys to all mons... 2024-02-21T07:45:02.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:45:02.895 DEBUG:teuthology.orchestra.run.smithi156:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:45:02.897 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDPqdVlYAwXHxAAyNyjgQJYPXIJCjlcJqZ7Kw== 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a] 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDPqdVlln2wMhAAyirF6gRompjyXSSK8ODe1g== 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d] 2024-02-21T07:45:02.922 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDQqdVlKrhRBxAA1+IjjsodfvQCLJpDd+/Mmg== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.g] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDQqdVlVdEcGBAAspBIcVQy1g/f6BaD2AVN4A== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.j] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDQqdVl0bpqKRAAH1QqcloUTVX18COXouifsA== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDVqdVleDEFMRAAi5jztZc5T4JMF26QMGlqFQ== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDZqdVlXkzPDxAAsnuims70Yq0rUbIgg3HjNQ== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDcqdVl0KGfGRAA0BAPhWWsGYfF22PUuPK8RQ== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.9] 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDfqdVluNE4IxAAppz9kkRVjbW5hZ+azisqZQ== 2024-02-21T07:45:02.923 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDPqdVlzKLcIxAABBXfmo1gEQnDnkdNhBa60g== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDQqdVl/3lUMxAA8Mmrjg5aYw6ZNi/40I+VAg== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.e] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDQqdVlcWPwOhAAWldPEUAzxN+D6kUUf785Jg== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.h] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVl2ny3BhAA9DA13iA9rJEauDWap6VWFA== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.k] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVlEHwKDhAATpUS/BfKUF5G/63qpY5qyA== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDjqdVlufA9NhAA86ooUTnSo0I1ZeqWADXBxQ== 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-02-21T07:45:02.924 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDmqdVlxLIsNBAAV6yPhid+pH351B/bMRUX1Q== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDpqdVlEkuNMhAASh3rXv32/t6f1P2TceTlYA== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.10] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDsqdVl7pdFMBAAvvGwxuSKGlsloYzkwwdhEw== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.z] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDPqdVlCoMXKBAA2nBs3Ow4WANIikf49fAtOA== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVl2P1qExAAoIIu3o8JzY2PgbEgrCnkRw== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.f] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVlfisAGxAAJ+gbIHUEZ4nKMLCLW9yXCQ== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.i] 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVlFUJqIhAAw56OHVKQdjNP5L0gwAsKlA== 2024-02-21T07:45:02.925 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.l] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVl4dK9KRAAyR94VrobzbH/v5OfZzzF+g== 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDxqdVlLSkFAxAATlyNdHiltUjBeYkNdtcWFQ== 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD0qdVlnDrVABAAG3u4ajTgCXo1j7gdZdFNnA== 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.8] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD2qdVlalyfORAAljekN8wt9jf4KbvYZMIcPw== 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.11] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD5qdVlex97NxAA5/xsrAx5fHHPM10ibhKTyA== 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-02-21T07:45:02.926 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDRqdVlPkpDMhAAOT6Jewd0EqIEdjLPeeuz3Q== 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.x] 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPqdVlYAwXHxAAyNyjgQJYPXIJCjlcJqZ7Kw== 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.a] 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPqdVlln2wMhAAyirF6gRompjyXSSK8ODe1g== 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.d] 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDQqdVlKrhRBxAA1+IjjsodfvQCLJpDd+/Mmg== 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.g] 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDQqdVlVdEcGBAAspBIcVQy1g/f6BaD2AVN4A== 2024-02-21T07:45:02.928 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.j] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDQqdVl0bpqKRAAH1QqcloUTVX18COXouifsA== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.0] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDVqdVleDEFMRAAi5jztZc5T4JMF26QMGlqFQ== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.3] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDZqdVlXkzPDxAAsnuims70Yq0rUbIgg3HjNQ== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.6] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDcqdVl0KGfGRAA0BAPhWWsGYfF22PUuPK8RQ== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.9] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDfqdVluNE4IxAAppz9kkRVjbW5hZ+azisqZQ== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.y] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPqdVlzKLcIxAABBXfmo1gEQnDnkdNhBa60g== 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.b] 2024-02-21T07:45:02.929 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDQqdVl/3lUMxAA8Mmrjg5aYw6ZNi/40I+VAg== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.e] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDQqdVlcWPwOhAAWldPEUAzxN+D6kUUf785Jg== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.h] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVl2ny3BhAA9DA13iA9rJEauDWap6VWFA== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.k] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVlEHwKDhAATpUS/BfKUF5G/63qpY5qyA== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.1] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDjqdVlufA9NhAA86ooUTnSo0I1ZeqWADXBxQ== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.4] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDmqdVlxLIsNBAAV6yPhid+pH351B/bMRUX1Q== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.7] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDpqdVlEkuNMhAASh3rXv32/t6f1P2TceTlYA== 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.10] 2024-02-21T07:45:02.930 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDsqdVl7pdFMBAAvvGwxuSKGlsloYzkwwdhEw== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[mgr.z] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDPqdVlCoMXKBAA2nBs3Ow4WANIikf49fAtOA== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.c] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVl2P1qExAAoIIu3o8JzY2PgbEgrCnkRw== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.f] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVlfisAGxAAJ+gbIHUEZ4nKMLCLW9yXCQ== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.i] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVlFUJqIhAAw56OHVKQdjNP5L0gwAsKlA== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[mds.l] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVl4dK9KRAAyR94VrobzbH/v5OfZzzF+g== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.2] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDxqdVlLSkFAxAATlyNdHiltUjBeYkNdtcWFQ== 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.5] 2024-02-21T07:45:02.931 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD0qdVlnDrVABAAG3u4ajTgCXo1j7gdZdFNnA== 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.8] 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD2qdVlalyfORAAljekN8wt9jf4KbvYZMIcPw== 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout:[osd.11] 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQD5qdVlex97NxAA5/xsrAx5fHHPM10ibhKTyA== 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout:[client.0] 2024-02-21T07:45:02.932 INFO:teuthology.orchestra.run.smithi156.stdout: key = AQDRqdVlPkpDMhAAOT6Jewd0EqIEdjLPeeuz3Q== 2024-02-21T07:45:02.971 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDPqdVlYAwXHxAAyNyjgQJYPXIJCjlcJqZ7Kw== 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDPqdVlln2wMhAAyirF6gRompjyXSSK8ODe1g== 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQqdVlKrhRBxAA1+IjjsodfvQCLJpDd+/Mmg== 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.g] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQqdVlVdEcGBAAspBIcVQy1g/f6BaD2AVN4A== 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.j] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQqdVl0bpqKRAAH1QqcloUTVX18COXouifsA== 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-02-21T07:45:02.972 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDVqdVleDEFMRAAi5jztZc5T4JMF26QMGlqFQ== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDZqdVlXkzPDxAAsnuims70Yq0rUbIgg3HjNQ== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDcqdVl0KGfGRAA0BAPhWWsGYfF22PUuPK8RQ== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.9] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDfqdVluNE4IxAAppz9kkRVjbW5hZ+azisqZQ== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDPqdVlzKLcIxAABBXfmo1gEQnDnkdNhBa60g== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQqdVl/3lUMxAA8Mmrjg5aYw6ZNi/40I+VAg== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDQqdVlcWPwOhAAWldPEUAzxN+D6kUUf785Jg== 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.h] 2024-02-21T07:45:02.973 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVl2ny3BhAA9DA13iA9rJEauDWap6VWFA== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.k] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVlEHwKDhAATpUS/BfKUF5G/63qpY5qyA== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDjqdVlufA9NhAA86ooUTnSo0I1ZeqWADXBxQ== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDmqdVlxLIsNBAAV6yPhid+pH351B/bMRUX1Q== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDpqdVlEkuNMhAASh3rXv32/t6f1P2TceTlYA== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.10] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDsqdVl7pdFMBAAvvGwxuSKGlsloYzkwwdhEw== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.z] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDPqdVlCoMXKBAA2nBs3Ow4WANIikf49fAtOA== 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-02-21T07:45:02.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVl2P1qExAAoIIu3o8JzY2PgbEgrCnkRw== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVlfisAGxAAJ+gbIHUEZ4nKMLCLW9yXCQ== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.i] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVlFUJqIhAAw56OHVKQdjNP5L0gwAsKlA== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.l] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVl4dK9KRAAyR94VrobzbH/v5OfZzzF+g== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDxqdVlLSkFAxAATlyNdHiltUjBeYkNdtcWFQ== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD0qdVlnDrVABAAG3u4ajTgCXo1j7gdZdFNnA== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.8] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD2qdVlalyfORAAljekN8wt9jf4KbvYZMIcPw== 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.11] 2024-02-21T07:45:02.975 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD5qdVlex97NxAA5/xsrAx5fHHPM10ibhKTyA== 2024-02-21T07:45:02.976 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-02-21T07:45:02.976 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDRqdVlPkpDMhAAOT6Jewd0EqIEdjLPeeuz3Q== 2024-02-21T07:45:02.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:02.983 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:02.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:03.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.117 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.120 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.264 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.266 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.410 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.560 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.562 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:03.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.703 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.845 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.848 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.983 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:03.991 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.128 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.131 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:04.268 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:04.270 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:04.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.405 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.408 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.543 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.545 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.687 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.689 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.824 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.826 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:04.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.970 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:04.972 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.107 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.110 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.247 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.249 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.385 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:05.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:05.521 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:05.523 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:45:05.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.657 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.660 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.802 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.804 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.945 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:05.947 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:06.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:06.088 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:06.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:45:06.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.229 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.231 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.372 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.374 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.506 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.509 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.652 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.654 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:45:06.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:45:06.793 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:45:06.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:45:06.933 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-21T07:45:06.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-21T07:45:07.026 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:45:07.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-21T07:45:07.272 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-21T07:45:07.299 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:45:07.396 DEBUG:teuthology.orchestra.run.smithi156:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-21T07:45:07.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-21T07:45:07.450 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:45:07.547 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-21T07:45:07.574 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:45:07.582 DEBUG:teuthology.orchestra.run.smithi156:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:45:07.584 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:45:07.629 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-21T07:45:07.630 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-21T07:45:07.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-21T07:45:07.635 INFO:tasks.ceph.mon.a:Started 2024-02-21T07:45:07.635 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-21T07:45:07.635 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-21T07:45:07.639 INFO:tasks.ceph.mon.b:Started 2024-02-21T07:45:07.639 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-21T07:45:07.639 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-21T07:45:07.670 INFO:tasks.ceph.mon.c:Started 2024-02-21T07:45:07.671 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-21T07:45:07.671 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-21T07:45:07.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-21T07:45:07.676 INFO:tasks.ceph.mgr.x:Started 2024-02-21T07:45:07.676 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-21T07:45:07.676 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-21T07:45:07.678 INFO:tasks.ceph.mgr.y:Started 2024-02-21T07:45:07.678 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-02-21T07:45:07.678 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-02-21T07:45:07.680 INFO:tasks.ceph.mgr.z:Started 2024-02-21T07:45:07.681 INFO:tasks.ceph:Setting crush tunables to default 2024-02-21T07:45:07.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-02-21T07:45:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.855+0000 7f6690a00640 1 Processor -- start 2024-02-21T07:45:07.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.855+0000 7f6690a00640 1 -- start start 2024-02-21T07:45:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.857+0000 7f6690a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 0x7f668c0701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6690a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f668c0706f0 0x7f668c184880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:07.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6690a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c071c00 con 0x7f668c184dc0 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6690a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c18ac30 con 0x7f668c0706f0 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6690a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c187640 con 0x7f668c1805b0 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f668c0706f0 0x7f668c184880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f668c0706f0 0x7f668c184880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34944/0 (socket says 172.21.15.100:34944) 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f668a800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 0x7f668c0701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f668b200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f668c184dc0 0x7f668c06ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:34950/0 (socket says 172.21.15.100:34950) 2024-02-21T07:45:07.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 -- 172.21.15.100:0/2479292975 learned_addr learned my addr 172.21.15.100:0/2479292975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 -- 172.21.15.100:0/2479292975 >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 msgr2=0x7f668c0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 --2- 172.21.15.100:0/2479292975 >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 0x7f668c0701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 -- 172.21.15.100:0/2479292975 >> v1:172.21.15.170:6789/0 conn(0x7f668c184dc0 legacy=0x7f668c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6689e00640 1 -- 172.21.15.100:0/2479292975 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386765216 0 0) 0x7f668c071c00 con 0x7f668c184dc0 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f6681e00640 1 -- 172.21.15.100:0/2479292975 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c070d10 con 0x7f668c0706f0 2024-02-21T07:45:07.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.858+0000 7f668a800640 1 --2- 172.21.15.100:0/2479292975 >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 0x7f668c0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.860+0000 7f6681e00640 1 --2- 172.21.15.100:0/2479292975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0706f0 0x7f668c184880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f668c0cf190 tx=0x7f667402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f2d2815de92a30e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.860+0000 7f6689e00640 1 -- 172.21.15.100:0/2479292975 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031870 con 0x7f668c0706f0 2024-02-21T07:45:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.860+0000 7f6689e00640 1 -- 172.21.15.100:0/2479292975 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66740319d0 con 0x7f668c0706f0 2024-02-21T07:45:07.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.860+0000 7f6689e00640 1 -- 172.21.15.100:0/2479292975 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674031d60 con 0x7f668c0706f0 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 -- 172.21.15.100:0/2479292975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0706f0 msgr2=0x7f668c184880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 --2- 172.21.15.100:0/2479292975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0706f0 0x7f668c184880 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f668c0cf190 tx=0x7f667402b910 comp rx=0 tx=0).stop 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 -- 172.21.15.100:0/2479292975 shutdown_connections 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 --2- 172.21.15.100:0/2479292975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c0706f0 0x7f668c184880 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 --2- 172.21.15.100:0/2479292975 >> v2:172.21.15.170:3300/0 conn(0x7f668c1805b0 0x7f668c0701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 -- 172.21.15.100:0/2479292975 >> 172.21.15.100:0/2479292975 conn(0x7f668c0cf280 msgr2=0x7f668c0cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 -- 172.21.15.100:0/2479292975 shutdown_connections 2024-02-21T07:45:07.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.861+0000 7f6690a00640 1 -- 172.21.15.100:0/2479292975 wait complete. 2024-02-21T07:45:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.863+0000 7f6690a00640 1 Processor -- start 2024-02-21T07:45:07.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.863+0000 7f6690a00640 1 -- start start 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 0x7f668c222800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 0x7f668c16f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 0x7f668c0f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0f96f0 con 0x7f668c0706f0 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0f8e20 con 0x7f668c184dc0 2024-02-21T07:45:07.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6690a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0cdd90 con 0x7f668c1805b0 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6681e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 0x7f668c16f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6681e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 0x7f668c16f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59086/0 (socket says 172.21.15.100:59086) 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f6681e00640 1 -- 172.21.15.100:0/1935999904 learned_addr learned my addr 172.21.15.100:0/1935999904 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f668a800640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 0x7f668c222800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.865+0000 7f668b200640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 0x7f668c0f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 -- 172.21.15.100:0/1935999904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 msgr2=0x7f668c16f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 0x7f668c16f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 -- 172.21.15.100:0/1935999904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 msgr2=0x7f668c0f9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 0x7f668c0f9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 -- 172.21.15.100:0/1935999904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740094d0 con 0x7f668c0706f0 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668b200640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 0x7f668c0f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f668a800640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 0x7f668c222800 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f667c007e70 tx=0x7f667c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:07.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c003b90 con 0x7f668c0706f0 2024-02-21T07:45:07.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00f040 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c0ce070 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00de20 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.866+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c0f9310 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.867+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f667c004030 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.867+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f667c01fd60 con 0x7f668c0706f0 2024-02-21T07:45:07.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.868+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c070510 con 0x7f668c0706f0 2024-02-21T07:45:07.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.873+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f667c024060 con 0x7f668c0706f0 2024-02-21T07:45:07.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.946+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f668c0751d0 con 0x7f668c0706f0 2024-02-21T07:45:07.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.950+0000 7f6683400640 1 -- 172.21.15.100:0/1935999904 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f667c01a070 con 0x7f668c0706f0 2024-02-21T07:45:07.956 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-02-21T07:45:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 msgr2=0x7f668c222800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 0x7f668c222800 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f667c007e70 tx=0x7f667c00d4a0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 shutdown_connections 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f668c184dc0 0x7f668c0f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f668c1805b0 0x7f668c16f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 --2- 172.21.15.100:0/1935999904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f668c0706f0 0x7f668c222800 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 >> 172.21.15.100:0/1935999904 conn(0x7f668c0cf280 msgr2=0x7f668c214ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 shutdown_connections 2024-02-21T07:45:07.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:07.952+0000 7f6690a00640 1 -- 172.21.15.100:0/1935999904 wait complete. 2024-02-21T07:45:07.974 INFO:tasks.ceph:check_enable_crimson: False 2024-02-21T07:45:07.975 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-21T07:45:07.975 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:07.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-21T07:45:08.045 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:08.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-21T07:45:08.178 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:08.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-21T07:45:08.264 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:08.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-02-21T07:45:08.302 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:08.297+0000 7f0d1220f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:45:08.316 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:08.311+0000 7fa9f7441040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:45:08.355 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:08.350+0000 7f0d1220f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:45:08.370 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:08.365+0000 7fa9f7441040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:45:08.392 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:08.392 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-21T07:45:08.419 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:08.419 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-21T07:45:08.445 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:08.439+0000 7f562a04a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:45:08.487 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:08.487 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-21T07:45:08.506 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:08.500+0000 7f562a04a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:45:08.553 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2024-02-21T07:45:08.554 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-02-21T07:45:08.620 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:08.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-21T07:45:08.647 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:08.647 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-21T07:45:08.714 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:08.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-02-21T07:45:08.781 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-02-21T07:45:08.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-02-21T07:45:08.848 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 5087f197-fd25-4d04-8010-787a7afd62e3 0 2024-02-21T07:45:08.860 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:08.854+0000 7f0d1220f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:45:08.896 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:08.891+0000 7fa9f7441040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:45:08.914 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:08.908+0000 7f0d1220f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:45:08.954 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:08.948+0000 7fa9f7441040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:45:08.997 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:08.952+0000 7f0d1220f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:45:09.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.983+0000 7f347a1c7640 1 Processor -- start 2024-02-21T07:45:09.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.983+0000 7f347a1c7640 1 -- start start 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f347a1c7640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f347406f360 0x7f347406f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f347a1c7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3474184570 con 0x7f347406de80 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f347a1c7640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347406e2e0 con 0x7f3474184190 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f347a1c7640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347406f0f0 con 0x7f347406f360 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f34737fe640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3474184190 0x7f34741883a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:35164/0 (socket says 172.21.15.170:35164) 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f34737fe640 1 -- 172.21.15.170:0/2301271163 learned_addr learned my addr 172.21.15.170:0/2301271163 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.984+0000 7f3473fff640 1 --2- 172.21.15.170:0/2301271163 >> v2:172.21.15.156:3300/0 conn(0x7f347406f360 0x7f347406f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.985+0000 7f34727fc640 1 -- 172.21.15.170:0/2301271163 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725325648 0 0) 0x7f347406e2e0 con 0x7f3474184190 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.985+0000 7f34727fc640 1 -- 172.21.15.170:0/2301271163 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f345c003520 con 0x7f3474184190 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.985+0000 7f3473fff640 1 -- 172.21.15.170:0/2301271163 >> v1:172.21.15.170:6789/0 conn(0x7f3474184190 legacy=0x7f34741883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.985+0000 7f3473fff640 1 -- 172.21.15.170:0/2301271163 >> v1:172.21.15.100:6789/0 conn(0x7f347406de80 legacy=0x7f3474188ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.985+0000 7f3473fff640 1 -- 172.21.15.170:0/2301271163 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347406e570 con 0x7f347406f360 2024-02-21T07:45:09.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f3473fff640 1 --2- 172.21.15.170:0/2301271163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f347406f360 0x7f347406f7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f346c009d90 tx=0x7f346c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180448eca28eb5cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f34727fc640 1 -- 172.21.15.170:0/2301271163 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c02cb40 con 0x7f347406f360 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f34727fc640 1 -- 172.21.15.170:0/2301271163 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c02cca0 con 0x7f347406f360 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f34727fc640 1 -- 172.21.15.170:0/2301271163 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c034660 con 0x7f347406f360 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 -- 172.21.15.170:0/2301271163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f347406f360 msgr2=0x7f347406f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2301271163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f347406f360 0x7f347406f7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f346c009d90 tx=0x7f346c02bd90 comp rx=0 tx=0).stop 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 -- 172.21.15.170:0/2301271163 shutdown_connections 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2301271163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f347406f360 0x7f347406f7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 -- 172.21.15.170:0/2301271163 >> 172.21.15.170:0/2301271163 conn(0x7f34740fc040 msgr2=0x7f34740fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 -- 172.21.15.170:0/2301271163 shutdown_connections 2024-02-21T07:45:09.004 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.986+0000 7f347a1c7640 1 -- 172.21.15.170:0/2301271163 wait complete. 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.988+0000 7f347a1c7640 1 Processor -- start 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.988+0000 7f347a1c7640 1 -- start start 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347406de80 0x7f34741860b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 0x7f34740cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740cf150 con 0x7f347406de80 2024-02-21T07:45:09.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740d4590 con 0x7f3474184190 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f347a1c7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34741865f0 con 0x7f347406f360 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57576/0 (socket says 172.21.15.170:57576) 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 -- 172.21.15.170:0/2143788510 learned_addr learned my addr 172.21.15.170:0/2143788510 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3473fff640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 0x7f34740cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 -- 172.21.15.170:0/2143788510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 msgr2=0x7f34740cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 0x7f34740cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 -- 172.21.15.170:0/2143788510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347406de80 msgr2=0x7f34741860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347406de80 0x7f34741860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3472ffd640 1 -- 172.21.15.170:0/2143788510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c009a70 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.989+0000 7f3473fff640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 0x7f34740cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f3472ffd640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f346800b3e0 tx=0x7f346800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011830 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34680119b0 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468011d60 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34740d3a10 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34740d3fd0 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f346801a790 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.990+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3468019bb0 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.991+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3474068390 con 0x7f347406f360 2024-02-21T07:45:09.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:08.995+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3468039dd0 con 0x7f347406f360 2024-02-21T07:45:09.008 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:08.997+0000 7fa9f7441040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:45:09.016 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.009+0000 7f0d1220f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:45:09.056 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.051+0000 7fa9f7441040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:45:09.062 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.051+0000 7f0d1220f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:45:09.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.065+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5087f197-fd25-4d04-8010-787a7afd62e3", "id": 0} v 0) v1 -- 0x7f3474187700 con 0x7f347406f360 2024-02-21T07:45:09.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.071+0000 7f345bfff640 1 -- 172.21.15.170:0/2143788510 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5087f197-fd25-4d04-8010-787a7afd62e3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3468028070 con 0x7f347406f360 2024-02-21T07:45:09.077 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 msgr2=0x7f3474173970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f346800b3e0 tx=0x7f346800b8a0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 shutdown_connections 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3474184190 0x7f34740cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f347406f360 0x7f3474173970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 --2- 172.21.15.170:0/2143788510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347406de80 0x7f34741860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 >> 172.21.15.170:0/2143788510 conn(0x7f34740fc040 msgr2=0x7f3474186960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 shutdown_connections 2024-02-21T07:45:09.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.072+0000 7f347a1c7640 1 -- 172.21.15.170:0/2143788510 wait complete. 2024-02-21T07:45:09.085 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.080+0000 7f562a04a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:45:09.088 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new a7ecb7d7-d016-4fd7-9323-b9a3be4887b9 1 2024-02-21T07:45:09.101 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.095+0000 7fa9f7441040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:45:09.152 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.143+0000 7f562a04a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:45:09.171 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.165+0000 7f0d1220f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:45:09.199 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.193+0000 7f562a04a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:45:09.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.200+0000 7f4672fa0640 1 Processor -- start 2024-02-21T07:45:09.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.200+0000 7f4672fa0640 1 -- start start 2024-02-21T07:45:09.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4672fa0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f466c06d750 0x7f466c18c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4672fa0640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f466c18c7a0 0x7f466c06f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4672fa0640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c06bb70 con 0x7f466c18be80 2024-02-21T07:45:09.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4672fa0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c1897e0 con 0x7f466c06d750 2024-02-21T07:45:09.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4672fa0640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c0717f0 con 0x7f466c18c7a0 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f467279f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f466c18c7a0 0x7f466c06f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f467279f640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f466c18c7a0 0x7f466c06f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.170:50368/0 (socket says 172.21.15.170:50368) 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f467279f640 1 -- 172.21.15.170:0/1133444117 learned_addr learned my addr 172.21.15.170:0/1133444117 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.201+0000 7f4671f9e640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f466c18be80 0x7f466c06d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.170:36182/0 (socket says 172.21.15.170:36182) 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467179d640 1 --2- 172.21.15.170:0/1133444117 >> v2:172.21.15.100:3300/0 conn(0x7f466c06d750 0x7f466c18c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467279f640 1 -- 172.21.15.170:0/1133444117 >> v2:172.21.15.100:3300/0 conn(0x7f466c06d750 msgr2=0x7f466c18c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467279f640 1 --2- 172.21.15.170:0/1133444117 >> v2:172.21.15.100:3300/0 conn(0x7f466c06d750 0x7f466c18c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467279f640 1 -- 172.21.15.170:0/1133444117 >> v1:172.21.15.156:6789/0 conn(0x7f466c18be80 legacy=0x7f466c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467279f640 1 -- 172.21.15.170:0/1133444117 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c071ad0 con 0x7f466c18c7a0 2024-02-21T07:45:09.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f4670f9c640 1 -- 172.21.15.170:0/1133444117 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362677899 0 0) 0x7f466c06bb70 con 0x7f466c18be80 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.202+0000 7f467279f640 1 --2- 172.21.15.170:0/1133444117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18c7a0 0x7f466c06f9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f466c0d2e60 tx=0x7f466402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aaa2bda09a1fa7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4670f9c640 1 -- 172.21.15.170:0/1133444117 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466402cb20 con 0x7f466c18c7a0 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4670f9c640 1 -- 172.21.15.170:0/1133444117 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466402cc80 con 0x7f466c18c7a0 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4670f9c640 1 -- 172.21.15.170:0/1133444117 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640343f0 con 0x7f466c18c7a0 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 -- 172.21.15.170:0/1133444117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18c7a0 msgr2=0x7f466c06f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 --2- 172.21.15.170:0/1133444117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18c7a0 0x7f466c06f9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f466c0d2e60 tx=0x7f466402bf80 comp rx=0 tx=0).stop 2024-02-21T07:45:09.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 -- 172.21.15.170:0/1133444117 shutdown_connections 2024-02-21T07:45:09.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 --2- 172.21.15.170:0/1133444117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18c7a0 0x7f466c06f9c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 --2- 172.21.15.170:0/1133444117 >> v2:172.21.15.100:3300/0 conn(0x7f466c06d750 0x7f466c18c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 -- 172.21.15.170:0/1133444117 >> 172.21.15.170:0/1133444117 conn(0x7f466c06e380 msgr2=0x7f466c06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 -- 172.21.15.170:0/1133444117 shutdown_connections 2024-02-21T07:45:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.203+0000 7f4672fa0640 1 -- 172.21.15.170:0/1133444117 wait complete. 2024-02-21T07:45:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.205+0000 7f4672fa0640 1 Processor -- start 2024-02-21T07:45:09.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.205+0000 7f4672fa0640 1 -- start start 2024-02-21T07:45:09.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 0x7f466c16f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f466c18c7a0 0x7f466c16fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c16b650 con 0x7f466c18c7a0 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c16b870 con 0x7f466c18be80 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c16bb50 con 0x7f466c06d750 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4671f9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4671f9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57588/0 (socket says 172.21.15.170:57588) 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4671f9e640 1 -- 172.21.15.170:0/3564386317 learned_addr learned my addr 172.21.15.170:0/3564386317 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 0x7f466c16f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 -- 172.21.15.170:0/3564386317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 msgr2=0x7f466c16b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 -- 172.21.15.170:0/3564386317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f466c18c7a0 msgr2=0x7f466c16fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f466c18c7a0 0x7f466c16fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 -- 172.21.15.170:0/3564386317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009b30 con 0x7f466c18be80 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4671f9e640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:09.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f467179d640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 0x7f466c16f780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f466800c550 tx=0x7f466800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668004230 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4668004390 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c16be30 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668003830 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.206+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c16c3f0 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.207+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4668003d20 con 0x7f466c18be80 2024-02-21T07:45:09.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.207+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4668019a10 con 0x7f466c18be80 2024-02-21T07:45:09.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.207+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c0cb800 con 0x7f466c18be80 2024-02-21T07:45:09.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.210+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4668038dd0 con 0x7f466c18be80 2024-02-21T07:45:09.222 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.217+0000 7fa9f7441040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:45:09.241 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.235+0000 7f0d1220f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:09.263 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.257+0000 7f562a04a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:45:09.285 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.280+0000 7f0d1220f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:45:09.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.281+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7ecb7d7-d016-4fd7-9323-b9a3be4887b9", "id": 1} v 0) v1 -- 0x7f466c0751d0 con 0x7f466c18be80 2024-02-21T07:45:09.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.285+0000 7f46627fc640 1 -- 172.21.15.170:0/3564386317 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ecb7d7-d016-4fd7-9323-b9a3be4887b9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4668027030 con 0x7f466c18be80 2024-02-21T07:45:09.291 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-02-21T07:45:09.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 msgr2=0x7f466c16f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 0x7f466c16f780 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f466800c550 tx=0x7f466800ca10 comp rx=0 tx=0).stop 2024-02-21T07:45:09.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 shutdown_connections 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f466c18c7a0 0x7f466c16fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f466c18be80 0x7f466c16f780 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 --2- 172.21.15.170:0/3564386317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f466c06d750 0x7f466c16b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 >> 172.21.15.170:0/3564386317 conn(0x7f466c06e380 msgr2=0x7f466c06bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 shutdown_connections 2024-02-21T07:45:09.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.286+0000 7f4672fa0640 1 -- 172.21.15.170:0/3564386317 wait complete. 2024-02-21T07:45:09.293 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.288+0000 7fa9f7441040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:09.303 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new da0beef3-d546-4996-9432-3f9e3f014ed2 2 2024-02-21T07:45:09.312 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.307+0000 7f562a04a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:45:09.337 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.331+0000 7f0d1220f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:45:09.343 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.337+0000 7fa9f7441040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:45:09.383 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.378+0000 7f0d1220f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:45:09.397 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.392+0000 7fa9f7441040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:45:09.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.398+0000 7f1fce9ac640 1 Processor -- start 2024-02-21T07:45:09.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.398+0000 7f1fce9ac640 1 -- start start 2024-02-21T07:45:09.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fce9ac640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1fc80f8080 0x7f1fc80d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fce9ac640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80f8530 con 0x7f1fc80d2b70 2024-02-21T07:45:09.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fce9ac640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc8164d50 con 0x7f1fc8164970 2024-02-21T07:45:09.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fce9ac640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc80d37b0 con 0x7f1fc80f8080 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc7fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f1fc8164970 0x7f1fc80f7970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:35172/0 (socket says 172.21.15.170:35172) 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc7fff640 1 -- 172.21.15.170:0/17802847 learned_addr learned my addr 172.21.15.170:0/17802847 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527229977 0 0) 0x7f1fc8164d50 con 0x7f1fc8164970 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb0003520 con 0x7f1fc8164970 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1673124201 0 0) 0x7f1fb0003520 con 0x7f1fc8164970 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 >> v2:172.21.15.100:3300/0 conn(0x7f1fc80f8080 msgr2=0x7f1fc80d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.399+0000 7f1fc6ffd640 1 --2- 172.21.15.170:0/17802847 >> v2:172.21.15.100:3300/0 conn(0x7f1fc80f8080 0x7f1fc80d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 >> v1:172.21.15.100:6789/0 conn(0x7f1fc80d2b70 legacy=0x7f1fc80d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80d3a90 con 0x7f1fc8164970 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f1fbc001670 con 0x7f1fc8164970 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 >> v1:172.21.15.170:6789/0 conn(0x7f1fc8164970 legacy=0x7f1fc80f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb00039c0 0x7f1fb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 0x7f1fb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb0009970 0x7f1fb000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80d37b0 con 0x7f1fb00039c0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000c350 con 0x7f1fb0009970 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb000c510 con 0x7f1fb00047c0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 0x7f1fb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 -- 172.21.15.170:0/17802847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb0009970 msgr2=0x7f1fb000bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb0009970 0x7f1fb000bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 -- 172.21.15.170:0/17802847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb00039c0 msgr2=0x7f1fb0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fb00039c0 0x7f1fb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fc77fe640 1 -- 172.21.15.170:0/17802847 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0003520 con 0x7f1fb00047c0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.400+0000 7f1fccf49640 1 -- 172.21.15.170:0/17802847 reap_dead start 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fc77fe640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 0x7f1fb0004c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009860 tx=0x7f1fb00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb0d80c3fad99a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8032600 con 0x7f1fb00047c0 2024-02-21T07:45:09.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb802e050 con 0x7f1fb00047c0 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fc6ffd640 1 -- 172.21.15.170:0/17802847 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80329c0 con 0x7f1fb00047c0 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 -- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 msgr2=0x7f1fb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 0x7f1fb0004c40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8009860 tx=0x7f1fb00057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 -- 172.21.15.170:0/17802847 shutdown_connections 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/17802847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fb00047c0 0x7f1fb0004c40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 -- 172.21.15.170:0/17802847 >> 172.21.15.170:0/17802847 conn(0x7f1fc806ab60 msgr2=0x7f1fc806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 -- 172.21.15.170:0/17802847 shutdown_connections 2024-02-21T07:45:09.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.401+0000 7f1fce9ac640 1 -- 172.21.15.170:0/17802847 wait complete. 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.403+0000 7f1fce9ac640 1 Processor -- start 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.403+0000 7f1fce9ac640 1 -- start start 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb00047c0 0x7f1fc8182800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fc821f3b0 0x7f1fc808bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8185a70 con 0x7f1fc821f3b0 2024-02-21T07:45:09.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8184b50 con 0x7f1fb00047c0 2024-02-21T07:45:09.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fce9ac640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8184df0 con 0x7f1fc821f830 2024-02-21T07:45:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57602/0 (socket says 172.21.15.170:57602) 2024-02-21T07:45:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 -- 172.21.15.170:0/896913950 learned_addr learned my addr 172.21.15.170:0/896913950 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fc7fff640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb00047c0 0x7f1fc8182800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 -- 172.21.15.170:0/896913950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb00047c0 msgr2=0x7f1fc8182800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb00047c0 0x7f1fc8182800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 -- 172.21.15.170:0/896913950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fc821f3b0 msgr2=0x7f1fc808bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fc821f3b0 0x7f1fc808bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.404+0000 7f1fccf49640 1 -- 172.21.15.170:0/896913950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc81850d0 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fccf49640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80ce120 tx=0x7f1fc000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0007070 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc00071d0 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc81853b0 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0007580 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8185e90 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1fc00076e0 con 0x7f1fc821f830 2024-02-21T07:45:09.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.405+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f1fc00137e0 con 0x7f1fc821f830 2024-02-21T07:45:09.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.406+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8068390 con 0x7f1fc821f830 2024-02-21T07:45:09.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.408+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1fc00133c0 con 0x7f1fc821f830 2024-02-21T07:45:09.444 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.438+0000 7f562a04a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:45:09.448 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.442+0000 7fa9f7441040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:45:09.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.479+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da0beef3-d546-4996-9432-3f9e3f014ed2", "id": 2} v 0) v1 -- 0x7f1fc8072fe0 con 0x7f1fc821f830 2024-02-21T07:45:09.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.485+0000 7f1fc4ff9640 1 -- 172.21.15.170:0/896913950 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da0beef3-d546-4996-9432-3f9e3f014ed2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1fc0013620 con 0x7f1fc821f830 2024-02-21T07:45:09.491 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 msgr2=0x7f1fc808c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80ce120 tx=0x7f1fc000c960 comp rx=0 tx=0).stop 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 shutdown_connections 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1fc821f830 0x7f1fc808c520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1fc821f3b0 0x7f1fc808bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 --2- 172.21.15.170:0/896913950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1fb00047c0 0x7f1fc8182800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 >> 172.21.15.170:0/896913950 conn(0x7f1fc806ab60 msgr2=0x7f1fc806fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 shutdown_connections 2024-02-21T07:45:09.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.486+0000 7f1fce9ac640 1 -- 172.21.15.170:0/896913950 wait complete. 2024-02-21T07:45:09.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new d3b9c560-7f82-4ac2-b55d-39b34315fc55 3 2024-02-21T07:45:09.524 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.518+0000 7f562a04a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:09.576 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.571+0000 7f562a04a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:45:09.636 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.630+0000 7f562a04a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:45:09.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.636+0000 7f40a07ac640 1 Processor -- start 2024-02-21T07:45:09.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.636+0000 7f40a07ac640 1 -- start start 2024-02-21T07:45:09.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4098185f10 0x7f4098188830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4098070c20 0x7f4098071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f409808c880 0x7f409808ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409808c460 con 0x7f4098070c20 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40981897a0 con 0x7f409808c880 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f40a07ac640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4098188f00 con 0x7f4098185f10 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f409e548640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4098185f10 0x7f4098188830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f409e548640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4098185f10 0x7f4098188830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57606/0 (socket says 172.21.15.170:57606) 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.637+0000 7f409e548640 1 -- 172.21.15.170:0/66927542 learned_addr learned my addr 172.21.15.170:0/66927542 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409ed49640 1 --2- 172.21.15.170:0/66927542 >> v2:172.21.15.156:3300/0 conn(0x7f409808c880 0x7f409808ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 -- 172.21.15.170:0/66927542 >> v2:172.21.15.156:3300/0 conn(0x7f409808c880 msgr2=0x7f409808ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 --2- 172.21.15.170:0/66927542 >> v2:172.21.15.156:3300/0 conn(0x7f409808c880 0x7f409808ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 -- 172.21.15.170:0/66927542 >> v2:172.21.15.100:3300/0 conn(0x7f4098070c20 msgr2=0x7f4098071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 --2- 172.21.15.170:0/66927542 >> v2:172.21.15.100:3300/0 conn(0x7f4098070c20 0x7f4098071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 -- 172.21.15.170:0/66927542 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40981891e0 con 0x7f4098185f10 2024-02-21T07:45:09.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.638+0000 7f409e548640 1 --2- 172.21.15.170:0/66927542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098185f10 0x7f4098188830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40980edb90 tx=0x7f408802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0d34258783a629 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f409d546640 1 -- 172.21.15.170:0/66927542 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088031760 con 0x7f4098185f10 2024-02-21T07:45:09.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f409d546640 1 -- 172.21.15.170:0/66927542 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40880318c0 con 0x7f4098185f10 2024-02-21T07:45:09.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f409d546640 1 -- 172.21.15.170:0/66927542 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088031c50 con 0x7f4098185f10 2024-02-21T07:45:09.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 -- 172.21.15.170:0/66927542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098185f10 msgr2=0x7f4098188830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 --2- 172.21.15.170:0/66927542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098185f10 0x7f4098188830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40980edb90 tx=0x7f408802b800 comp rx=0 tx=0).stop 2024-02-21T07:45:09.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 -- 172.21.15.170:0/66927542 shutdown_connections 2024-02-21T07:45:09.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 --2- 172.21.15.170:0/66927542 >> v2:172.21.15.156:3300/0 conn(0x7f409808c880 0x7f409808ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 --2- 172.21.15.170:0/66927542 >> v2:172.21.15.100:3300/0 conn(0x7f4098070c20 0x7f4098071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 --2- 172.21.15.170:0/66927542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098185f10 0x7f4098188830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 -- 172.21.15.170:0/66927542 >> 172.21.15.170:0/66927542 conn(0x7f409806e3c0 msgr2=0x7f409806e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 -- 172.21.15.170:0/66927542 shutdown_connections 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.639+0000 7f40a07ac640 1 -- 172.21.15.170:0/66927542 wait complete. 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.641+0000 7f40a07ac640 1 Processor -- start 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.641+0000 7f40a07ac640 1 -- start start 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f409808c880 0x7f409821d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4098185f10 0x7f409821d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409817e170 con 0x7f4098185f10 2024-02-21T07:45:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409817d280 con 0x7f409808c880 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409817d560 con 0x7f4098070c20 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57620/0 (socket says 172.21.15.170:57620) 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 -- 172.21.15.170:0/269207893 learned_addr learned my addr 172.21.15.170:0/269207893 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409dd47640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f409808c880 0x7f409821d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 -- 172.21.15.170:0/269207893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f409808c880 msgr2=0x7f409821d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f409808c880 0x7f409821d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 -- 172.21.15.170:0/269207893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4098185f10 msgr2=0x7f409821d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4098185f10 0x7f409821d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 -- 172.21.15.170:0/269207893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880094d0 con 0x7f4098070c20 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f409e548640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f408802b840 tx=0x7f40880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408803b5f0 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408803b770 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409817d840 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.642+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408803bb20 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.643+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409817de00 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.643+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f408804e7e0 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.643+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f408802f050 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.644+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40980f82a0 con 0x7f4098070c20 2024-02-21T07:45:09.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.646+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f408803bc80 con 0x7f4098070c20 2024-02-21T07:45:09.691 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:09.685+0000 7f562a04a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:45:09.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.717+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d3b9c560-7f82-4ac2-b55d-39b34315fc55", "id": 3} v 0) v1 -- 0x7f4098068390 con 0x7f4098070c20 2024-02-21T07:45:09.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.721+0000 7f408effd640 1 -- 172.21.15.170:0/269207893 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3b9c560-7f82-4ac2-b55d-39b34315fc55", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4088045cb0 con 0x7f4098070c20 2024-02-21T07:45:09.728 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 msgr2=0x7f409817ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f408802b840 tx=0x7f40880046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 shutdown_connections 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4098185f10 0x7f409821d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f409808c880 0x7f409821d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 --2- 172.21.15.170:0/269207893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4098070c20 0x7f409817ca00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 >> 172.21.15.170:0/269207893 conn(0x7f409806e3c0 msgr2=0x7f409817b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 shutdown_connections 2024-02-21T07:45:09.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.723+0000 7f40a07ac640 1 -- 172.21.15.170:0/269207893 wait complete. 2024-02-21T07:45:09.739 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 2251e8ec-8c4e-405a-85f8-2974bbde76c6 4 2024-02-21T07:45:09.758 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.753+0000 7f0d1220f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:45:09.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.835+0000 7fecd9ec3640 1 Processor -- start 2024-02-21T07:45:09.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.835+0000 7fecd9ec3640 1 -- start start 2024-02-21T07:45:09.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd9ec3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fecd4186930 0x7fecd406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd9ec3640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd408c4f0 con 0x7fecd4180a00 2024-02-21T07:45:09.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd9ec3640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd4180de0 con 0x7fecd406d2b0 2024-02-21T07:45:09.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd9ec3640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd4187930 con 0x7fecd4186930 2024-02-21T07:45:09.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd3fff640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fecd406d2b0 0x7fecd408c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:35188/0 (socket says 172.21.15.170:35188) 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd3fff640 1 -- 172.21.15.170:0/1364656986 learned_addr learned my addr 172.21.15.170:0/1364656986 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937227445 0 0) 0x7fecd4180de0 con 0x7fecd406d2b0 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc003520 con 0x7fecd406d2b0 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/1364656986 >> v2:172.21.15.100:3300/0 conn(0x7fecd4186930 0x7fecd406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2192891666 0 0) 0x7fecbc003520 con 0x7fecd406d2b0 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 >> v2:172.21.15.100:3300/0 conn(0x7fecd4186930 msgr2=0x7fecd406cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 --2- 172.21.15.170:0/1364656986 >> v2:172.21.15.100:3300/0 conn(0x7fecd4186930 0x7fecd406cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 >> v1:172.21.15.100:6789/0 conn(0x7fecd4180a00 legacy=0x7fecd406f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4187090 con 0x7fecd406d2b0 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7feccc0019f0 con 0x7fecd406d2b0 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 >> v1:172.21.15.170:6789/0 conn(0x7fecd406d2b0 legacy=0x7fecd408c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.836+0000 7fecd27fc640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc0039c0 0x7fecbc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd27fc640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 0x7fecbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd27fc640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0053d0 0x7fecbc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4187930 con 0x7fecbc0039c0 2024-02-21T07:45:09.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00c310 con 0x7fecbc0053d0 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00c4d0 con 0x7fecbc0047c0 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 0x7fecbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 -- 172.21.15.170:0/1364656986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0053d0 msgr2=0x7fecbc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0053d0 0x7fecbc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 -- 172.21.15.170:0/1364656986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc0039c0 msgr2=0x7fecbc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc0039c0 0x7fecbc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd2ffd640 1 -- 172.21.15.170:0/1364656986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc003520 con 0x7fecbc0047c0 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.837+0000 7fecd3fff640 1 -- 172.21.15.170:0/1364656986 reap_dead start 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 0x7fecbc004c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc400a9a0 tx=0x7fecbc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4cc44502a03655b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4030620 con 0x7fecbc0047c0 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4030780 con 0x7fecbc0047c0 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd27fc640 1 -- 172.21.15.170:0/1364656986 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4030b70 con 0x7fecbc0047c0 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 -- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 msgr2=0x7fecbc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 0x7fecbc004c40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc400a9a0 tx=0x7fecbc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 -- 172.21.15.170:0/1364656986 shutdown_connections 2024-02-21T07:45:09.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/1364656986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecbc0047c0 0x7fecbc004c40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 -- 172.21.15.170:0/1364656986 >> 172.21.15.170:0/1364656986 conn(0x7fecd406e380 msgr2=0x7fecd406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 -- 172.21.15.170:0/1364656986 shutdown_connections 2024-02-21T07:45:09.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.838+0000 7fecd9ec3640 1 -- 172.21.15.170:0/1364656986 wait complete. 2024-02-21T07:45:09.851 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.839+0000 7fa9f7441040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:45:09.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.840+0000 7fecd9ec3640 1 Processor -- start 2024-02-21T07:45:09.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.840+0000 7fecd9ec3640 1 -- start start 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0047c0 0x7fecd416ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd416d8e0 0x7fecd4211b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4211150 con 0x7fecd416d8e0 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd416f1f0 con 0x7fecbc0047c0 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd9ec3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd416e670 con 0x7fecd416d460 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57640/0 (socket says 172.21.15.170:57640) 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 -- 172.21.15.170:0/2798161948 learned_addr learned my addr 172.21.15.170:0/2798161948 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd37fe640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0047c0 0x7fecd416ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 -- 172.21.15.170:0/2798161948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0047c0 msgr2=0x7fecd416ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0047c0 0x7fecd416ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 -- 172.21.15.170:0/2798161948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd416d8e0 msgr2=0x7fecd4211b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd416d8e0 0x7fecd4211b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 -- 172.21.15.170:0/2798161948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd416e950 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.841+0000 7fecd2ffd640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecc400a9a0 tx=0x7fecc40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc403e040 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4039650 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40399e0 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd416ec30 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd416e310 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fecc4039b40 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.842+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fecc4044900 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.843+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd408e6f0 con 0x7fecd416d460 2024-02-21T07:45:09.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.845+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fecc4049070 con 0x7fecd416d460 2024-02-21T07:45:09.893 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:09.887+0000 7f0d1220f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:45:09.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.917+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2251e8ec-8c4e-405a-85f8-2974bbde76c6", "id": 4} v 0) v1 -- 0x7fecd40ca130 con 0x7fecd416d460 2024-02-21T07:45:09.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.922+0000 7fecbbfff640 1 -- 172.21.15.170:0/2798161948 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2251e8ec-8c4e-405a-85f8-2974bbde76c6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fecc4034070 con 0x7fecd416d460 2024-02-21T07:45:09.928 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 msgr2=0x7fecd42115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecc400a9a0 tx=0x7fecc40046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 shutdown_connections 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecd416d8e0 0x7fecd4211b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecd416d460 0x7fecd42115e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 --2- 172.21.15.170:0/2798161948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecbc0047c0 0x7fecd416ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 >> 172.21.15.170:0/2798161948 conn(0x7fecd406e380 msgr2=0x7fecd406e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 shutdown_connections 2024-02-21T07:45:09.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:09.923+0000 7fecd9ec3640 1 -- 172.21.15.170:0/2798161948 wait complete. 2024-02-21T07:45:09.939 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new fd91e9bc-7a56-4ff3-abde-4eee4ef470b9 5 2024-02-21T07:45:09.985 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:09.979+0000 7fa9f7441040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:45:10.015 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.010+0000 7f0d1220f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:45:10.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.032+0000 7f380029d640 1 Processor -- start 2024-02-21T07:45:10.038 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.032+0000 7f380029d640 1 -- start start 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f380029d640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f37f8189f90 0x7f37f80f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f380029d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f818a3f0 con 0x7f37f818c470 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f380029d640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f806fb10 con 0x7f37f818c090 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f380029d640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f818cff0 con 0x7f37f8189f90 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fd838640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f37f8189f90 0x7f37f80f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fe039640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f37f818c090 0x7f37f80ee220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.170:36186/0 (socket says 172.21.15.170:36186) 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fe039640 1 -- 172.21.15.170:0/3133137605 learned_addr learned my addr 172.21.15.170:0/3133137605 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fd838640 1 -- 172.21.15.170:0/3133137605 >> v1:172.21.15.156:6789/0 conn(0x7f37f818c090 legacy=0x7f37f80ee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fd838640 1 -- 172.21.15.170:0/3133137605 >> v1:172.21.15.100:6789/0 conn(0x7f37f818c470 legacy=0x7f37f818c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.040 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.034+0000 7f37fd838640 1 -- 172.21.15.170:0/3133137605 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f80ccd20 con 0x7f37f8189f90 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.035+0000 7f37fd838640 1 --2- 172.21.15.170:0/3133137605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f8189f90 0x7f37f80f6c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097a0 tx=0x7f37f402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9132fe6d90f1f4a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.035+0000 7f37fd037640 1 -- 172.21.15.170:0/3133137605 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f402e070 con 0x7f37f8189f90 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.035+0000 7f37fd037640 1 -- 172.21.15.170:0/3133137605 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40315a0 con 0x7f37f8189f90 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.035+0000 7f37fd037640 1 -- 172.21.15.170:0/3133137605 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f4031930 con 0x7f37f8189f90 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 -- 172.21.15.170:0/3133137605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f8189f90 msgr2=0x7f37f80f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 --2- 172.21.15.170:0/3133137605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f8189f90 0x7f37f80f6c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37f40097a0 tx=0x7f37f402b840 comp rx=0 tx=0).stop 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 -- 172.21.15.170:0/3133137605 shutdown_connections 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 --2- 172.21.15.170:0/3133137605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f8189f90 0x7f37f80f6c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 -- 172.21.15.170:0/3133137605 >> 172.21.15.170:0/3133137605 conn(0x7f37f80cf3f0 msgr2=0x7f37f80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 -- 172.21.15.170:0/3133137605 shutdown_connections 2024-02-21T07:45:10.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.036+0000 7f380029d640 1 -- 172.21.15.170:0/3133137605 wait complete. 2024-02-21T07:45:10.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.037+0000 7f380029d640 1 Processor -- start 2024-02-21T07:45:10.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.037+0000 7f380029d640 1 -- start start 2024-02-21T07:45:10.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f8189f90 0x7f37f816bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f818c090 0x7f37f82202e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8176380 con 0x7f37f8189f90 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8176660 con 0x7f37f818c090 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f380029d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f8176940 con 0x7f37f818c470 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f37fe83a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f37fe83a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57644/0 (socket says 172.21.15.170:57644) 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f37fe83a640 1 -- 172.21.15.170:0/2567834689 learned_addr learned my addr 172.21.15.170:0/2567834689 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.038+0000 7f37fd838640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f818c090 0x7f37f82202e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 -- 172.21.15.170:0/2567834689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f818c090 msgr2=0x7f37f82202e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f818c090 0x7f37f82202e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 -- 172.21.15.170:0/2567834689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f8189f90 msgr2=0x7f37f816bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f8189f90 0x7f37f816bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 -- 172.21.15.170:0/2567834689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009400 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37fe83a640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37f000b970 tx=0x7f37f000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000cb40 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000cca0 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f8176c20 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0014680 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f81771e0 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f37f0003970 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.039+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f37f0004730 con 0x7f37f818c470 2024-02-21T07:45:10.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.040+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f8068390 con 0x7f37f818c470 2024-02-21T07:45:10.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.042+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f37f0019070 con 0x7f37f818c470 2024-02-21T07:45:10.061 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.056+0000 7f0d1220f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:45:10.105 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.100+0000 7fa9f7441040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:45:10.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.112+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd91e9bc-7a56-4ff3-abde-4eee4ef470b9", "id": 5} v 0) v1 -- 0x7f37f8220040 con 0x7f37f818c470 2024-02-21T07:45:10.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.117+0000 7f37eeffd640 1 -- 172.21.15.170:0/2567834689 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd91e9bc-7a56-4ff3-abde-4eee4ef470b9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37f00041b0 con 0x7f37f818c470 2024-02-21T07:45:10.123 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-02-21T07:45:10.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 msgr2=0x7f37f8220820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37f000b970 tx=0x7f37f000be30 comp rx=0 tx=0).stop 2024-02-21T07:45:10.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 shutdown_connections 2024-02-21T07:45:10.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37f818c470 0x7f37f8220820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37f818c090 0x7f37f82202e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 --2- 172.21.15.170:0/2567834689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f8189f90 0x7f37f816bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 >> 172.21.15.170:0/2567834689 conn(0x7f37f80cf3f0 msgr2=0x7f37f80cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 shutdown_connections 2024-02-21T07:45:10.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.118+0000 7f380029d640 1 -- 172.21.15.170:0/2567834689 wait complete. 2024-02-21T07:45:10.134 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 24754c33-0e0a-406f-9ed3-bc812d10b6e1 6 2024-02-21T07:45:10.145 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.139+0000 7f562a04a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:45:10.153 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.148+0000 7fa9f7441040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:45:10.172 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.167+0000 7f0d1220f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.228+0000 7fe8e4db6640 1 Processor -- start 2024-02-21T07:45:10.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.228+0000 7fe8e4db6640 1 -- start start 2024-02-21T07:45:10.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8e4db6640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8e0182fd0 0x7fe8e006fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8e4db6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e01833b0 con 0x7fe8e0186be0 2024-02-21T07:45:10.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8e4db6640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e006ec50 con 0x7fe8e0187040 2024-02-21T07:45:10.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8e4db6640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e006eec0 con 0x7fe8e0182fd0 2024-02-21T07:45:10.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8de59c640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8e0182fd0 0x7fe8e006fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8ded9d640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe8e0187040 0x7fe8e0185e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.170:36196/0 (socket says 172.21.15.170:36196) 2024-02-21T07:45:10.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.229+0000 7fe8ded9d640 1 -- 172.21.15.170:0/2575200991 learned_addr learned my addr 172.21.15.170:0/2575200991 (peer_addr_for_me v1:172.21.15.170:0/0) 2024-02-21T07:45:10.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.230+0000 7fe8de59c640 1 -- 172.21.15.170:0/2575200991 >> v1:172.21.15.156:6789/0 conn(0x7fe8e0187040 legacy=0x7fe8e0185e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.230+0000 7fe8de59c640 1 -- 172.21.15.170:0/2575200991 >> v1:172.21.15.100:6789/0 conn(0x7fe8e0186be0 legacy=0x7fe8e01856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.230+0000 7fe8de59c640 1 -- 172.21.15.170:0/2575200991 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e006f1a0 con 0x7fe8e0182fd0 2024-02-21T07:45:10.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.230+0000 7fe8de59c640 1 --2- 172.21.15.170:0/2575200991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e006fc80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00097a0 tx=0x7fe8d002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b905e6ff80f4c5c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.230+0000 7fe8dd59a640 1 -- 172.21.15.170:0/2575200991 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d002f050 con 0x7fe8e0182fd0 2024-02-21T07:45:10.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8dd59a640 1 -- 172.21.15.170:0/2575200991 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0031700 con 0x7fe8e0182fd0 2024-02-21T07:45:10.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8dd59a640 1 -- 172.21.15.170:0/2575200991 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0031a90 con 0x7fe8e0182fd0 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 -- 172.21.15.170:0/2575200991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 msgr2=0x7fe8e006fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/2575200991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e006fc80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00097a0 tx=0x7fe8d002b7a0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 -- 172.21.15.170:0/2575200991 shutdown_connections 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/2575200991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e006fc80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 -- 172.21.15.170:0/2575200991 >> 172.21.15.170:0/2575200991 conn(0x7fe8e00cf410 msgr2=0x7fe8e00cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 -- 172.21.15.170:0/2575200991 shutdown_connections 2024-02-21T07:45:10.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.231+0000 7fe8e4db6640 1 -- 172.21.15.170:0/2575200991 wait complete. 2024-02-21T07:45:10.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.233+0000 7fe8e4db6640 1 Processor -- start 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.233+0000 7fe8e4db6640 1 -- start start 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e0185c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0187040 0x7fe8e01883e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e01767b0 con 0x7fe8e0187040 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e020ef10 con 0x7fe8e0182fd0 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8e4db6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e020f1f0 con 0x7fe8e0186be0 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8de59c640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e0185c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57656/0 (socket says 172.21.15.170:57656) 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 -- 172.21.15.170:0/4268965413 learned_addr learned my addr 172.21.15.170:0/4268965413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 -- 172.21.15.170:0/4268965413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 msgr2=0x7fe8e0185c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e0185c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 -- 172.21.15.170:0/4268965413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0187040 msgr2=0x7fe8e01883e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0187040 0x7fe8e01883e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 -- 172.21.15.170:0/4268965413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009400 con 0x7fe8e0186be0 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8de59c640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e0185c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ddd9b640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c430 tx=0x7fe8d400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011790 con 0x7fe8e0186be0 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.234+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d40118f0 con 0x7fe8e0186be0 2024-02-21T07:45:10.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.235+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e020f4d0 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.235+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4011ce0 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.235+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e020fa90 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.235+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe8d401c460 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.235+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe8d4012dd0 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.236+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e0068390 con 0x7fe8e0186be0 2024-02-21T07:45:10.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.238+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe8d4011e40 con 0x7fe8e0186be0 2024-02-21T07:45:10.267 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.261+0000 7f0d1220f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:45:10.270 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.265+0000 7fa9f7441040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.306 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.300+0000 7f562a04a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:45:10.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.309+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24754c33-0e0a-406f-9ed3-bc812d10b6e1", "id": 6} v 0) v1 -- 0x7fe8e01892a0 con 0x7fe8e0186be0 2024-02-21T07:45:10.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.314+0000 7fe8ceffd640 1 -- 172.21.15.170:0/4268965413 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24754c33-0e0a-406f-9ed3-bc812d10b6e1", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe8d40127e0 con 0x7fe8e0186be0 2024-02-21T07:45:10.319 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-02-21T07:45:10.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 msgr2=0x7fe8e0187ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c430 tx=0x7fe8d400c8f0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 shutdown_connections 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8e0187040 0x7fe8e01883e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8e0186be0 0x7fe8e0187ea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 --2- 172.21.15.170:0/4268965413 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8e0182fd0 0x7fe8e0185c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 >> 172.21.15.170:0/4268965413 conn(0x7fe8e00cf410 msgr2=0x7fe8e00f6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 shutdown_connections 2024-02-21T07:45:10.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.315+0000 7fe8e4db6640 1 -- 172.21.15.170:0/4268965413 wait complete. 2024-02-21T07:45:10.331 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 2957fc8b-1094-46d8-bfb4-43cb3d6694c3 7 2024-02-21T07:45:10.368 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.362+0000 7fa9f7441040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:45:10.420 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.415+0000 7f0d1220f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.437 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.431+0000 7f562a04a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:45:10.462 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.456+0000 7f0d1220f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.462+0000 7f05efb6b640 1 Processor -- start 2024-02-21T07:45:10.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.462+0000 7f05efb6b640 1 -- start start 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f05e80f5890 0x7f05e808bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05e808c520 0x7f05e80f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05e80f61b0 0x7f05e8186be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e806f9f0 con 0x7f05e808c520 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e806eb00 con 0x7f05e80f5890 2024-02-21T07:45:10.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05efb6b640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e806ede0 con 0x7f05e80f61b0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05ee108640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05e80f61b0 0x7f05e8186be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05ee108640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f05e80f61b0 0x7f05e8186be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57662/0 (socket says 172.21.15.170:57662) 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05ee108640 1 -- 172.21.15.170:0/3107770183 learned_addr learned my addr 172.21.15.170:0/3107770183 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.463+0000 7f05ed907640 1 --2- 172.21.15.170:0/3107770183 >> v2:172.21.15.156:3300/0 conn(0x7f05e80f5890 0x7f05e808bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 -- 172.21.15.170:0/3107770183 >> v2:172.21.15.156:3300/0 conn(0x7f05e80f5890 msgr2=0x7f05e808bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 --2- 172.21.15.170:0/3107770183 >> v2:172.21.15.156:3300/0 conn(0x7f05e80f5890 0x7f05e808bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 -- 172.21.15.170:0/3107770183 >> v2:172.21.15.100:3300/0 conn(0x7f05e808c520 msgr2=0x7f05e80f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 --2- 172.21.15.170:0/3107770183 >> v2:172.21.15.100:3300/0 conn(0x7f05e808c520 0x7f05e80f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 -- 172.21.15.170:0/3107770183 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e806f0c0 con 0x7f05e80f61b0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ee108640 1 --2- 172.21.15.170:0/3107770183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e80f61b0 0x7f05e8186be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05e808f040 tx=0x7f05e002be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3722da3dc5c18bc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.464+0000 7f05ec905640 1 -- 172.21.15.170:0/3107770183 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e002ca10 con 0x7f05e80f61b0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05ec905640 1 -- 172.21.15.170:0/3107770183 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e002cb70 con 0x7f05e80f61b0 2024-02-21T07:45:10.471 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05ec905640 1 -- 172.21.15.170:0/3107770183 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00343f0 con 0x7f05e80f61b0 2024-02-21T07:45:10.472 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 -- 172.21.15.170:0/3107770183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e80f61b0 msgr2=0x7f05e8186be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 --2- 172.21.15.170:0/3107770183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e80f61b0 0x7f05e8186be0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f05e808f040 tx=0x7f05e002be70 comp rx=0 tx=0).stop 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 -- 172.21.15.170:0/3107770183 shutdown_connections 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 --2- 172.21.15.170:0/3107770183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e80f61b0 0x7f05e8186be0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 --2- 172.21.15.170:0/3107770183 >> v2:172.21.15.100:3300/0 conn(0x7f05e808c520 0x7f05e80f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 --2- 172.21.15.170:0/3107770183 >> v2:172.21.15.156:3300/0 conn(0x7f05e80f5890 0x7f05e808bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 -- 172.21.15.170:0/3107770183 >> 172.21.15.170:0/3107770183 conn(0x7f05e80cf3e0 msgr2=0x7f05e80cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 -- 172.21.15.170:0/3107770183 shutdown_connections 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.465+0000 7f05efb6b640 1 -- 172.21.15.170:0/3107770183 wait complete. 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 Processor -- start 2024-02-21T07:45:10.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 -- start start 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05e80f5890 0x7f05e82201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e80f61b0 0x7f05e817ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.467+0000 7f05efb6b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e821fd50 con 0x7f05e80f5890 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05efb6b640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e821f290 con 0x7f05e80f61b0 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05efb6b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8220700 con 0x7f05e808c520 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57672/0 (socket says 172.21.15.170:57672) 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 -- 172.21.15.170:0/883498587 learned_addr learned my addr 172.21.15.170:0/883498587 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ee108640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e80f61b0 0x7f05e817ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 -- 172.21.15.170:0/883498587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e80f61b0 msgr2=0x7f05e817ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e80f61b0 0x7f05e817ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 -- 172.21.15.170:0/883498587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05e80f5890 msgr2=0x7f05e82201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05e80f5890 0x7f05e82201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 -- 172.21.15.170:0/883498587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009b30 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05ed907640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05e400e8d0 tx=0x7f05e400ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40094f0 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e400c940 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e400ccf0 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8070860 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e821f4b0 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.468+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f05e4005990 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.469+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f05e40067f0 con 0x7f05e808c520 2024-02-21T07:45:10.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.470+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80f6600 con 0x7f05e808c520 2024-02-21T07:45:10.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.472+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f05e4021060 con 0x7f05e808c520 2024-02-21T07:45:10.490 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.484+0000 7f562a04a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:45:10.541 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.535+0000 7fa9f7441040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.555+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2957fc8b-1094-46d8-bfb4-43cb3d6694c3", "id": 7} v 0) v1 -- 0x7f05e8068390 con 0x7f05e808c520 2024-02-21T07:45:10.566 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.560+0000 7f05de7fc640 1 -- 172.21.15.170:0/883498587 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2957fc8b-1094-46d8-bfb4-43cb3d6694c3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05e4017070 con 0x7f05e808c520 2024-02-21T07:45:10.566 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-02-21T07:45:10.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 msgr2=0x7f05e821ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05e400e8d0 tx=0x7f05e400ed90 comp rx=0 tx=0).stop 2024-02-21T07:45:10.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 shutdown_connections 2024-02-21T07:45:10.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05e80f61b0 0x7f05e817ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05e80f5890 0x7f05e82201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 --2- 172.21.15.170:0/883498587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e808c520 0x7f05e821ed50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 >> 172.21.15.170:0/883498587 conn(0x7f05e80cf3e0 msgr2=0x7f05e817b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 shutdown_connections 2024-02-21T07:45:10.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.561+0000 7f05efb6b640 1 -- 172.21.15.170:0/883498587 wait complete. 2024-02-21T07:45:10.577 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new aea16fdd-0d2f-4db0-ba6d-05a20e15c645 8 2024-02-21T07:45:10.585 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.579+0000 7fa9f7441040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:10.614 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:10.609+0000 7f0d1220f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:45:10.616 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.610+0000 7f562a04a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.672+0000 7f65b218a640 1 Processor -- start 2024-02-21T07:45:10.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.672+0000 7f65b218a640 1 -- start start 2024-02-21T07:45:10.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65b218a640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f65ac17f7c0 0x7f65ac0f9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65b218a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac070a00 con 0x7f65ac183c50 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65b218a640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac070ce0 con 0x7f65ac0f9980 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65b218a640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac070fc0 con 0x7f65ac17f7c0 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65ab7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f65ac17f7c0 0x7f65ac0f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65ab7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f65ac17f7c0 0x7f65ac0f9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57678/0 (socket says 172.21.15.170:57678) 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.673+0000 7f65ab7fe640 1 -- 172.21.15.170:0/3059647359 learned_addr learned my addr 172.21.15.170:0/3059647359 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.674+0000 7f65ab7fe640 1 -- 172.21.15.170:0/3059647359 >> v1:172.21.15.156:6789/0 conn(0x7f65ac0f9980 legacy=0x7f65ac183540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.674+0000 7f65ab7fe640 1 -- 172.21.15.170:0/3059647359 >> v1:172.21.15.100:6789/0 conn(0x7f65ac183c50 legacy=0x7f65ac1855d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.674+0000 7f65ab7fe640 1 -- 172.21.15.170:0/3059647359 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0712a0 con 0x7f65ac17f7c0 2024-02-21T07:45:10.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.674+0000 7f65ab7fe640 1 --2- 172.21.15.170:0/3059647359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac0f9440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f659c009870 tx=0x7f659c02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4254943074d11e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65aaffd640 1 -- 172.21.15.170:0/3059647359 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0317e0 con 0x7f65ac17f7c0 2024-02-21T07:45:10.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65aaffd640 1 -- 172.21.15.170:0/3059647359 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c031940 con 0x7f65ac17f7c0 2024-02-21T07:45:10.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65aaffd640 1 -- 172.21.15.170:0/3059647359 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c031cd0 con 0x7f65ac17f7c0 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 -- 172.21.15.170:0/3059647359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 msgr2=0x7f65ac0f9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 --2- 172.21.15.170:0/3059647359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac0f9440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f659c009870 tx=0x7f659c02b880 comp rx=0 tx=0).stop 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 -- 172.21.15.170:0/3059647359 shutdown_connections 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 --2- 172.21.15.170:0/3059647359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac0f9440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 -- 172.21.15.170:0/3059647359 >> 172.21.15.170:0/3059647359 conn(0x7f65ac0cf3d0 msgr2=0x7f65ac0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 -- 172.21.15.170:0/3059647359 shutdown_connections 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.675+0000 7f65b218a640 1 -- 172.21.15.170:0/3059647359 wait complete. 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.676+0000 7f65b218a640 1 Processor -- start 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.677+0000 7f65b218a640 1 -- start start 2024-02-21T07:45:10.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 0x7f65ac21fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac167590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65ac183c50 0x7f65ac21c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac220280 con 0x7f65ac183c50 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac220550 con 0x7f65ac0f9980 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac220830 con 0x7f65ac17f7c0 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac167590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac167590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57690/0 (socket says 172.21.15.170:57690) 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a2ffd640 1 -- 172.21.15.170:0/4223553939 learned_addr learned my addr 172.21.15.170:0/4223553939 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 0x7f65ac21fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 -- 172.21.15.170:0/4223553939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 msgr2=0x7f65ac167590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac167590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 -- 172.21.15.170:0/4223553939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65ac183c50 msgr2=0x7f65ac21c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65ac183c50 0x7f65ac21c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 -- 172.21.15.170:0/4223553939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0094d0 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65ab7fe640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 0x7f65ac21fd40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f659c033000 tx=0x7f659c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c032940 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c032ae0 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac220b10 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.678+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c032e90 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.679+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac2210d0 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.679+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f659c005d20 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.679+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f659c0066f0 con 0x7f65ac0f9980 2024-02-21T07:45:10.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.679+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac068390 con 0x7f65ac0f9980 2024-02-21T07:45:10.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.682+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f659c02e070 con 0x7f65ac0f9980 2024-02-21T07:45:10.727 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.721+0000 7f562a04a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:45:10.746 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:10.741+0000 7fa9f7441040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:45:10.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.753+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aea16fdd-0d2f-4db0-ba6d-05a20e15c645", "id": 8} v 0) v1 -- 0x7f65ac183a30 con 0x7f65ac0f9980 2024-02-21T07:45:10.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.758+0000 7f65a8ff9640 1 -- 172.21.15.170:0/4223553939 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aea16fdd-0d2f-4db0-ba6d-05a20e15c645", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f659c053070 con 0x7f65ac0f9980 2024-02-21T07:45:10.763 INFO:teuthology.orchestra.run.smithi170.stdout:8 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.758+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 msgr2=0x7f65ac21fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.758+0000 7f65b218a640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 0x7f65ac21fd40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f659c033000 tx=0x7f659c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 shutdown_connections 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65ac183c50 0x7f65ac21c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65ac17f7c0 0x7f65ac167590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 --2- 172.21.15.170:0/4223553939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65ac0f9980 0x7f65ac21fd40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 >> 172.21.15.170:0/4223553939 conn(0x7f65ac0cf3d0 msgr2=0x7f65ac17e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 shutdown_connections 2024-02-21T07:45:10.765 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.759+0000 7f65b218a640 1 -- 172.21.15.170:0/4223553939 wait complete. 2024-02-21T07:45:10.774 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 9ac5d21d-b0e0-41d5-b544-49602cdcd15d 9 2024-02-21T07:45:10.903 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.896+0000 7f562a04a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:45:10.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.909+0000 7f4e82262640 1 Processor -- start 2024-02-21T07:45:10.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.909+0000 7f4e82262640 1 -- start start 2024-02-21T07:45:10.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e82262640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e7c182f60 0x7f4e7c186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e82262640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e7c188c30 0x7f4e7c189040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e82262640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7c186670 con 0x7f4e7c071d40 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e82262640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c183340 con 0x7f4e7c188c30 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e82262640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7c071010 con 0x7f4e7c182f60 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.910+0000 7f4e7b7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e7c182f60 0x7f4e7c186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e7c182f60 0x7f4e7c186130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57700/0 (socket says 172.21.15.170:57700) 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/3909547013 learned_addr learned my addr 172.21.15.170:0/3909547013 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7bfff640 1 --2- 172.21.15.170:0/3909547013 >> v2:172.21.15.100:3300/0 conn(0x7f4e7c188c30 0x7f4e7c189040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7affd640 1 -- 172.21.15.170:0/3909547013 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192359259 0 0) 0x7f4e7c186670 con 0x7f4e7c071d40 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/3909547013 >> v2:172.21.15.100:3300/0 conn(0x7f4e7c188c30 msgr2=0x7f4e7c189040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 --2- 172.21.15.170:0/3909547013 >> v2:172.21.15.100:3300/0 conn(0x7f4e7c188c30 0x7f4e7c189040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/3909547013 >> v1:172.21.15.156:6789/0 conn(0x7f4e7c071d40 legacy=0x7f4e7c0721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.911+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/3909547013 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c06eb10 con 0x7f4e7c182f60 2024-02-21T07:45:10.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e7b7fe640 1 --2- 172.21.15.170:0/3909547013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c182f60 0x7f4e7c186130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c06cc20 tx=0x7f4e6c02e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c390e8abaf16ee9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e7affd640 1 -- 172.21.15.170:0/3909547013 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c02ee90 con 0x7f4e7c182f60 2024-02-21T07:45:10.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e7affd640 1 -- 172.21.15.170:0/3909547013 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c036440 con 0x7f4e7c182f60 2024-02-21T07:45:10.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e7affd640 1 -- 172.21.15.170:0/3909547013 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0367d0 con 0x7f4e7c182f60 2024-02-21T07:45:10.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 -- 172.21.15.170:0/3909547013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c182f60 msgr2=0x7f4e7c186130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 --2- 172.21.15.170:0/3909547013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c182f60 0x7f4e7c186130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c06cc20 tx=0x7f4e6c02e0e0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 -- 172.21.15.170:0/3909547013 shutdown_connections 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 --2- 172.21.15.170:0/3909547013 >> v2:172.21.15.100:3300/0 conn(0x7f4e7c188c30 0x7f4e7c189040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 --2- 172.21.15.170:0/3909547013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c182f60 0x7f4e7c186130 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.912+0000 7f4e82262640 1 -- 172.21.15.170:0/3909547013 >> 172.21.15.170:0/3909547013 conn(0x7f4e7c0668b0 msgr2=0x7f4e7c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.913+0000 7f4e82262640 1 -- 172.21.15.170:0/3909547013 shutdown_connections 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.913+0000 7f4e82262640 1 -- 172.21.15.170:0/3909547013 wait complete. 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.914+0000 7f4e82262640 1 Processor -- start 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.914+0000 7f4e82262640 1 -- start start 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e7c182f60 0x7f4e7c1760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e7c188c30 0x7f4e7c1778b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c06ca50 con 0x7f4e7c182f60 2024-02-21T07:45:10.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c06bed0 con 0x7f4e7c188c30 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e82262640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c06c1b0 con 0x7f4e7c071d40 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57716/0 (socket says 172.21.15.170:57716) 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/2802057285 learned_addr learned my addr 172.21.15.170:0/2802057285 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7bfff640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e7c188c30 0x7f4e7c1778b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/2802057285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e7c188c30 msgr2=0x7f4e7c1778b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e7c188c30 0x7f4e7c1778b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/2802057285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e7c182f60 msgr2=0x7f4e7c1760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e7c182f60 0x7f4e7c1760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 -- 172.21.15.170:0/2802057285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c00b770 con 0x7f4e7c071d40 2024-02-21T07:45:10.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e7b7fe640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c02e120 tx=0x7f4e6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.915+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c034b80 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c036e90 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c06c490 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c041440 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c177390 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4e6c03d040 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.916+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1760+0+0 (secure 0 0 0) 0x7f4e6c03fb30 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.917+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c067c80 con 0x7f4e7c071d40 2024-02-21T07:45:10.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.919+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4e6c068dd0 con 0x7f4e7c071d40 2024-02-21T07:45:10.952 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:10.947+0000 7f562a04a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:45:10.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.990+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ac5d21d-b0e0-41d5-b544-49602cdcd15d", "id": 9} v 0) v1 -- 0x7f4e7c0d2760 con 0x7f4e7c071d40 2024-02-21T07:45:11.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.994+0000 7f4e78ff9640 1 -- 172.21.15.170:0/2802057285 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ac5d21d-b0e0-41d5-b544-49602cdcd15d", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4e6c057030 con 0x7f4e7c071d40 2024-02-21T07:45:11.000 INFO:teuthology.orchestra.run.smithi170.stdout:9 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 msgr2=0x7f4e7c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c02e120 tx=0x7f4e6c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 shutdown_connections 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e7c188c30 0x7f4e7c1778b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e7c182f60 0x7f4e7c1760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 --2- 172.21.15.170:0/2802057285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e7c071d40 0x7f4e7c06b7e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 >> 172.21.15.170:0/2802057285 conn(0x7f4e7c0668b0 msgr2=0x7f4e7c0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 shutdown_connections 2024-02-21T07:45:11.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:10.995+0000 7f4e82262640 1 -- 172.21.15.170:0/2802057285 wait complete. 2024-02-21T07:45:11.011 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c1745981-51b6-4827-b1d9-030e5f5deecc 10 2024-02-21T07:45:11.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.105+0000 7f1bc41b5640 1 Processor -- start 2024-02-21T07:45:11.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.105+0000 7f1bc41b5640 1 -- start start 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc41b5640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1bbc1861e0 0x7f1bbc06b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc41b5640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1bbc06b670 0x7f1bbc08cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc41b5640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc06bad0 con 0x7f1bbc08d160 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc41b5640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc070b70 con 0x7f1bbc06b670 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc41b5640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc071310 con 0x7f1bbc1861e0 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc1f51640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1bbc1861e0 0x7f1bbc06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.112 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc1f51640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1bbc1861e0 0x7f1bbc06b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.170:50506/0 (socket says 172.21.15.170:50506) 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc1f51640 1 -- 172.21.15.170:0/1581211453 learned_addr learned my addr 172.21.15.170:0/1581211453 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.106+0000 7f1bc1750640 1 --2- 172.21.15.170:0/1581211453 >> v2:172.21.15.100:3300/0 conn(0x7f1bbc06b670 0x7f1bbc08cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.107+0000 7f1bc1f51640 1 -- 172.21.15.170:0/1581211453 >> v2:172.21.15.100:3300/0 conn(0x7f1bbc06b670 msgr2=0x7f1bbc08cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.107+0000 7f1bc1f51640 1 --2- 172.21.15.170:0/1581211453 >> v2:172.21.15.100:3300/0 conn(0x7f1bbc06b670 0x7f1bbc08cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.107+0000 7f1bc1f51640 1 -- 172.21.15.170:0/1581211453 >> v1:172.21.15.100:6789/0 conn(0x7f1bbc08d160 legacy=0x7f1bbc18c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:11.113 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.107+0000 7f1bc1f51640 1 -- 172.21.15.170:0/1581211453 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc189aa0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc1f51640 1 --2- 172.21.15.170:0/1581211453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc06b130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc06e310 tx=0x7f1bb802b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb663fb81e2e7e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc0f4f640 1 -- 172.21.15.170:0/1581211453 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8031750 con 0x7f1bbc1861e0 2024-02-21T07:45:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc0f4f640 1 -- 172.21.15.170:0/1581211453 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb80318b0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.114 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc0f4f640 1 -- 172.21.15.170:0/1581211453 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8031c40 con 0x7f1bbc1861e0 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 -- 172.21.15.170:0/1581211453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc1861e0 msgr2=0x7f1bbc06b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/1581211453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc06b130 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc06e310 tx=0x7f1bb802b7f0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 -- 172.21.15.170:0/1581211453 shutdown_connections 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/1581211453 >> v2:172.21.15.100:3300/0 conn(0x7f1bbc06b670 0x7f1bbc08cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/1581211453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc06b130 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.108+0000 7f1bc41b5640 1 -- 172.21.15.170:0/1581211453 >> 172.21.15.170:0/1581211453 conn(0x7f1bbc06e380 msgr2=0x7f1bbc06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.109+0000 7f1bc41b5640 1 -- 172.21.15.170:0/1581211453 shutdown_connections 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.109+0000 7f1bc41b5640 1 -- 172.21.15.170:0/1581211453 wait complete. 2024-02-21T07:45:11.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.110+0000 7f1bc41b5640 1 Processor -- start 2024-02-21T07:45:11.116 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.110+0000 7f1bc41b5640 1 -- start start 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc06b670 0x7f1bbc16e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bbc08d160 0x7f1bbc17aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc17baf0 con 0x7f1bbc08d160 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc17b810 con 0x7f1bbc06b670 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc41b5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc172e00 con 0x7f1bbc1861e0 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57722/0 (socket says 172.21.15.170:57722) 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 -- 172.21.15.170:0/2247394935 learned_addr learned my addr 172.21.15.170:0/2247394935 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc1f51640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc06b670 0x7f1bbc16e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 -- 172.21.15.170:0/2247394935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc06b670 msgr2=0x7f1bbc16e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc06b670 0x7f1bbc16e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 -- 172.21.15.170:0/2247394935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bbc08d160 msgr2=0x7f1bbc17aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bbc08d160 0x7f1bbc17aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 -- 172.21.15.170:0/2247394935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80094d0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bc2752640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c780 tx=0x7f1bb400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.111+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4003d80 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb400ce90 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40052b0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc1730e0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc1736a0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1bb4006b10 con 0x7f1bbc1861e0 2024-02-21T07:45:11.119 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.112+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1875+0+0 (secure 0 0 0) 0x7f1bb40077e0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.113+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc1738c0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.120 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.115+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1bb4017070 con 0x7f1bbc1861e0 2024-02-21T07:45:11.126 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:11.120+0000 7f562a04a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:45:11.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.187+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1745981-51b6-4827-b1d9-030e5f5deecc", "id": 10} v 0) v1 -- 0x7f1bbc068390 con 0x7f1bbc1861e0 2024-02-21T07:45:11.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.191+0000 7f1bb27fc640 1 -- 172.21.15.170:0/2247394935 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1745981-51b6-4827-b1d9-030e5f5deecc", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7f1bb400a5e0 con 0x7f1bbc1861e0 2024-02-21T07:45:11.197 INFO:teuthology.orchestra.run.smithi170.stdout:10 2024-02-21T07:45:11.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 msgr2=0x7f1bbc17afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400c780 tx=0x7f1bb400cc40 comp rx=0 tx=0).stop 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 shutdown_connections 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bbc1861e0 0x7f1bbc17afc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bbc08d160 0x7f1bbc17aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 --2- 172.21.15.170:0/2247394935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bbc06b670 0x7f1bbc16e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.192+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 >> 172.21.15.170:0/2247394935 conn(0x7f1bbc06e380 msgr2=0x7f1bbc215070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.193+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 shutdown_connections 2024-02-21T07:45:11.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.193+0000 7f1bc41b5640 1 -- 172.21.15.170:0/2247394935 wait complete. 2024-02-21T07:45:11.208 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 0247d8a5-53aa-4031-b998-b413e831aa22 11 2024-02-21T07:45:11.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.303+0000 7fc1870c9640 1 Processor -- start 2024-02-21T07:45:11.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.303+0000 7fc1870c9640 1 -- start start 2024-02-21T07:45:11.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.304+0000 7fc1870c9640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc180180850 0x7fc180188f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.304+0000 7fc1870c9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc180180c30 con 0x7fc180189470 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.304+0000 7fc1870c9640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc180187e90 con 0x7fc180189920 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.304+0000 7fc1870c9640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc180187c80 con 0x7fc180180850 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc180180850 0x7fc180188f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc180180850 0x7fc180188f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57728/0 (socket says 172.21.15.170:57728) 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 -- 172.21.15.170:0/4103082355 learned_addr learned my addr 172.21.15.170:0/4103082355 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc185666640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc180189920 0x7fc18018a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.170:35194/0 (socket says 172.21.15.170:35194) 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 -- 172.21.15.170:0/4103082355 >> v1:172.21.15.170:6789/0 conn(0x7fc180189920 legacy=0x7fc18018a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 -- 172.21.15.170:0/4103082355 >> v1:172.21.15.100:6789/0 conn(0x7fc180189470 legacy=0x7fc180189d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:11.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.305+0000 7fc184e65640 1 -- 172.21.15.170:0/4103082355 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180188170 con 0x7fc180180850 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc184e65640 1 --2- 172.21.15.170:0/4103082355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180180850 0x7fc180188f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbd879dcb3179fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc17f7fe640 1 -- 172.21.15.170:0/4103082355 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170031870 con 0x7fc180180850 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc17f7fe640 1 -- 172.21.15.170:0/4103082355 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700319d0 con 0x7fc180180850 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc17f7fe640 1 -- 172.21.15.170:0/4103082355 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170031d60 con 0x7fc180180850 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 -- 172.21.15.170:0/4103082355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180180850 msgr2=0x7fc180188f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 --2- 172.21.15.170:0/4103082355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180180850 0x7fc180188f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc170009870 tx=0x7fc17002b910 comp rx=0 tx=0).stop 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 -- 172.21.15.170:0/4103082355 shutdown_connections 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 --2- 172.21.15.170:0/4103082355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180180850 0x7fc180188f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 -- 172.21.15.170:0/4103082355 >> 172.21.15.170:0/4103082355 conn(0x7fc1800cf3f0 msgr2=0x7fc1800cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 -- 172.21.15.170:0/4103082355 shutdown_connections 2024-02-21T07:45:11.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.306+0000 7fc1870c9640 1 -- 172.21.15.170:0/4103082355 wait complete. 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.308+0000 7fc1870c9640 1 Processor -- start 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.308+0000 7fc1870c9640 1 -- start start 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc180180850 0x7fc180170670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc180189470 0x7fc180184bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801711a0 con 0x7fc180189470 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180185640 con 0x7fc180180850 2024-02-21T07:45:11.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180185870 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57740/0 (socket says 172.21.15.170:57740) 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 -- 172.21.15.170:0/3287522942 learned_addr learned my addr 172.21.15.170:0/3287522942 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc184e65640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc180180850 0x7fc180170670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 -- 172.21.15.170:0/3287522942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc180180850 msgr2=0x7fc180170670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc180180850 0x7fc180170670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 -- 172.21.15.170:0/3287522942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc180189470 msgr2=0x7fc180184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc180189470 0x7fc180184bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 -- 172.21.15.170:0/3287522942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700094d0 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc185666640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c760 tx=0x7fc17800cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800ce70 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800a640 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc180185b50 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.309+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17800a9b0 con 0x7fc180170bb0 2024-02-21T07:45:11.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.310+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc180186110 con 0x7fc180170bb0 2024-02-21T07:45:11.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.310+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc17800ab10 con 0x7fc180170bb0 2024-02-21T07:45:11.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.310+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 1990+0+0 (secure 0 0 0) 0x7fc17801cc70 con 0x7fc180170bb0 2024-02-21T07:45:11.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.310+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc180171350 con 0x7fc180170bb0 2024-02-21T07:45:11.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.312+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc180171350 con 0x7fc180170bb0 2024-02-21T07:45:11.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.386+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0247d8a5-53aa-4031-b998-b413e831aa22", "id": 11} v 0) v1 -- 0x7fc180068390 con 0x7fc180170bb0 2024-02-21T07:45:11.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.390+0000 7fc17d7fa640 1 -- 172.21.15.170:0/3287522942 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0247d8a5-53aa-4031-b998-b413e831aa22", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7fc178021060 con 0x7fc180170bb0 2024-02-21T07:45:11.396 INFO:teuthology.orchestra.run.smithi170.stdout:11 2024-02-21T07:45:11.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 msgr2=0x7fc180185100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc17800c760 tx=0x7fc17800cc20 comp rx=0 tx=0).stop 2024-02-21T07:45:11.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 shutdown_connections 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc180170bb0 0x7fc180185100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc180189470 0x7fc180184bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.391+0000 7fc1870c9640 1 --2- 172.21.15.170:0/3287522942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc180180850 0x7fc180170670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.392+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 >> 172.21.15.170:0/3287522942 conn(0x7fc1800cf3f0 msgr2=0x7fc1800cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.392+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 shutdown_connections 2024-02-21T07:45:11.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-02-21T07:45:11.392+0000 7fc1870c9640 1 -- 172.21.15.170:0/3287522942 wait complete. 2024-02-21T07:45:11.400 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:11.395+0000 7f0d1220f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:45:11.407 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-21T07:45:11.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-21T07:45:11.415 INFO:tasks.ceph.osd.0:Started 2024-02-21T07:45:11.415 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-21T07:45:11.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-21T07:45:11.422 INFO:tasks.ceph.osd.3:Started 2024-02-21T07:45:11.422 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-21T07:45:11.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-21T07:45:11.423 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:11.429 INFO:tasks.ceph.osd.6:Started 2024-02-21T07:45:11.429 INFO:tasks.ceph.osd.9:Restarting daemon 2024-02-21T07:45:11.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-02-21T07:45:11.434 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:11.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:11.439 INFO:tasks.ceph.osd.9:Started 2024-02-21T07:45:11.440 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-21T07:45:11.440 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-21T07:45:11.479 INFO:tasks.ceph.osd.1:Started 2024-02-21T07:45:11.480 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-21T07:45:11.480 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-21T07:45:11.481 INFO:tasks.ceph.osd.4:Started 2024-02-21T07:45:11.482 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-21T07:45:11.482 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-21T07:45:11.484 INFO:tasks.ceph.osd.7:Started 2024-02-21T07:45:11.484 INFO:tasks.ceph.osd.10:Restarting daemon 2024-02-21T07:45:11.484 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-02-21T07:45:11.486 INFO:tasks.ceph.osd.10:Started 2024-02-21T07:45:11.486 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-21T07:45:11.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-21T07:45:11.488 INFO:tasks.ceph.osd.2:Started 2024-02-21T07:45:11.488 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-21T07:45:11.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-21T07:45:11.490 INFO:tasks.ceph.osd.5:Started 2024-02-21T07:45:11.491 INFO:tasks.ceph.osd.8:Restarting daemon 2024-02-21T07:45:11.491 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-02-21T07:45:11.493 INFO:tasks.ceph.osd.8:Started 2024-02-21T07:45:11.493 INFO:tasks.ceph.osd.11:Restarting daemon 2024-02-21T07:45:11.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-02-21T07:45:11.536 INFO:tasks.ceph.osd.11:Started 2024-02-21T07:45:11.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:11.621 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:11.615+0000 7fa9f7441040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:45:11.706 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:11.701+0000 7f0d1220f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:45:11.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.725+0000 7f6abda00640 1 Processor -- start 2024-02-21T07:45:11.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.725+0000 7f6abda00640 1 -- start start 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.726+0000 7f6abda00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6ab8186430 0x7f6ab818b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.726+0000 7f6abda00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ab80d3dc0 0x7f6ab80d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6abda00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab818b670 con 0x7f6ab8186050 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6abda00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab818a600 con 0x7f6ab80d3dc0 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6abda00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80d69b0 con 0x7f6ab8186430 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6ab8186430 0x7f6ab818b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6ab8186050 0x7f6ab818aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:37612/0 (socket says 172.21.15.100:37612) 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab7400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6ab80d3dc0 0x7f6ab80d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6a00640 1 -- 172.21.15.100:0/2209676857 learned_addr learned my addr 172.21.15.100:0/2209676857 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6000640 1 -- 172.21.15.100:0/2209676857 >> v2:172.21.15.156:3300/0 conn(0x7f6ab80d3dc0 msgr2=0x7f6ab80d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6000640 1 --2- 172.21.15.100:0/2209676857 >> v2:172.21.15.156:3300/0 conn(0x7f6ab80d3dc0 0x7f6ab80d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6000640 1 -- 172.21.15.100:0/2209676857 >> v1:172.21.15.156:6789/0 conn(0x7f6ab8186050 legacy=0x7f6ab818aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab5600640 1 -- 172.21.15.100:0/2209676857 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822209762 0 0) 0x7f6ab818b670 con 0x7f6ab8186050 2024-02-21T07:45:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.727+0000 7f6ab6000640 1 -- 172.21.15.100:0/2209676857 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80d5aa0 con 0x7f6ab8186430 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.728+0000 7f6ab6000640 1 --2- 172.21.15.100:0/2209676857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab8186430 0x7f6ab818b130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8067430 tx=0x7f6aa402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431a6bd9ead4c4cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.728+0000 7f6ab5600640 1 -- 172.21.15.100:0/2209676857 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa402e070 con 0x7f6ab8186430 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.728+0000 7f6ab5600640 1 -- 172.21.15.100:0/2209676857 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40315a0 con 0x7f6ab8186430 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.728+0000 7f6ab5600640 1 -- 172.21.15.100:0/2209676857 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4031930 con 0x7f6ab8186430 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 -- 172.21.15.100:0/2209676857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab8186430 msgr2=0x7f6ab818b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 --2- 172.21.15.100:0/2209676857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab8186430 0x7f6ab818b130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8067430 tx=0x7f6aa402b840 comp rx=0 tx=0).stop 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 -- 172.21.15.100:0/2209676857 shutdown_connections 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 --2- 172.21.15.100:0/2209676857 >> v2:172.21.15.156:3300/0 conn(0x7f6ab80d3dc0 0x7f6ab80d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 --2- 172.21.15.100:0/2209676857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab8186430 0x7f6ab818b130 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 -- 172.21.15.100:0/2209676857 >> 172.21.15.100:0/2209676857 conn(0x7f6ab80d2540 msgr2=0x7f6ab80d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 -- 172.21.15.100:0/2209676857 shutdown_connections 2024-02-21T07:45:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.729+0000 7f6abda00640 1 -- 172.21.15.100:0/2209676857 wait complete. 2024-02-21T07:45:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.731+0000 7f6abda00640 1 Processor -- start 2024-02-21T07:45:11.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.731+0000 7f6abda00640 1 -- start start 2024-02-21T07:45:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 0x7f6ab8186820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab8186050 0x7f6ab816ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab82201f0 con 0x7f6ab8186050 2024-02-21T07:45:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8186e40 con 0x7f6ab80d3dc0 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6abda00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8187120 con 0x7f6ab80d20d0 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab8186050 0x7f6ab816ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 0x7f6ab8186820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 0x7f6ab8186820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:40648/0 (socket says 172.21.15.100:40648) 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35398/0 (socket says 172.21.15.100:35398) 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.732+0000 7f6ab6a00640 1 -- 172.21.15.100:0/2557988268 learned_addr learned my addr 172.21.15.100:0/2557988268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 -- 172.21.15.100:0/2557988268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 msgr2=0x7f6ab8186820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 0x7f6ab8186820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 -- 172.21.15.100:0/2557988268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab8186050 msgr2=0x7f6ab816ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab8186050 0x7f6ab816ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 -- 172.21.15.100:0/2557988268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009400 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6ab7400640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000ebb0 tx=0x7f6ab000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000cd20 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab000f040 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8187400 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.733+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00146c0 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.734+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab81879c0 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.734+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6ab0014bb0 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.734+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7f6ab001de00 con 0x7f6ab80d20d0 2024-02-21T07:45:11.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.734+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8220330 con 0x7f6ab80d20d0 2024-02-21T07:45:11.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.737+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6ab003bdd0 con 0x7f6ab80d20d0 2024-02-21T07:45:11.758 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:11.753+0000 7f0d1220f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:45:11.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.801+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ab8067c80 con 0x7f6ab80d20d0 2024-02-21T07:45:11.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.802+0000 7f6aaea00640 1 -- 172.21.15.100:0/2557988268 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7f6ab002a030 con 0x7f6ab80d20d0 2024-02-21T07:45:11.808 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:11.808 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:11.388291+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 msgr2=0x7f6ab816f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000ebb0 tx=0x7f6ab000c490 comp rx=0 tx=0).stop 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 shutdown_connections 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6ab80d20d0 0x7f6ab816f1d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ab8186050 0x7f6ab816ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 --2- 172.21.15.100:0/2557988268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6ab80d3dc0 0x7f6ab8186820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:11.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.803+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 >> 172.21.15.100:0/2557988268 conn(0x7f6ab80d2540 msgr2=0x7f6ab80d2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.804+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 shutdown_connections 2024-02-21T07:45:11.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:11.804+0000 7f6abda00640 1 -- 172.21.15.100:0/2557988268 wait complete. 2024-02-21T07:45:11.826 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-21T07:45:11.826 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-21T07:45:11.875 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:11.869+0000 7f0d1220f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:45:11.901 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:11.895+0000 7fa9f7441040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:45:11.954 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:11.948+0000 7fa9f7441040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:45:12.068 INFO:tasks.ceph.mgr.z.smithi170.stderr:2024-02-21T07:45:12.063+0000 7fa9f7441040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:45:12.080 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-02-21T07:45:12.074+0000 7feb9821e640 -1 Falling back to public interface 2024-02-21T07:45:12.085 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-02-21T07:45:12.079+0000 7ffbd79ac640 -1 Falling back to public interface 2024-02-21T07:45:12.087 INFO:tasks.ceph.osd.8.smithi170.stderr:2024-02-21T07:45:12.081+0000 7fd03d4f9640 -1 Falling back to public interface 2024-02-21T07:45:12.089 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-02-21T07:45:12.083+0000 7f583b347640 -1 Falling back to public interface 2024-02-21T07:45:12.091 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-02-21T07:45:12.086+0000 7f1eb7938640 -1 Falling back to public interface 2024-02-21T07:45:12.100 INFO:tasks.ceph.osd.1.smithi156.stderr:2024-02-21T07:45:12.094+0000 7f709981b640 -1 Falling back to public interface 2024-02-21T07:45:12.102 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-02-21T07:45:12.097+0000 7fd5ca013640 -1 Falling back to public interface 2024-02-21T07:45:12.103 INFO:tasks.ceph.osd.10.smithi156.stderr:2024-02-21T07:45:12.097+0000 7f91d63bd640 -1 Falling back to public interface 2024-02-21T07:45:12.136 INFO:tasks.ceph.osd.11.smithi170.stderr:2024-02-21T07:45:12.130+0000 7f8bc06d7640 -1 Falling back to public interface 2024-02-21T07:45:12.138 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-02-21T07:45:12.133+0000 7f001da24640 -1 Falling back to public interface 2024-02-21T07:45:12.151 INFO:tasks.ceph.osd.9.smithi100.stderr:2024-02-21T07:45:12.146+0000 7f5e8980e640 -1 Falling back to public interface 2024-02-21T07:45:12.151 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-02-21T07:45:12.146+0000 7f53da00c640 -1 Falling back to public interface 2024-02-21T07:45:12.158 INFO:tasks.ceph.osd.9.smithi100.stderr:2024-02-21T07:45:12.153+0000 7f5e87c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6827/0: (98) Address already in use 2024-02-21T07:45:12.203 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:12.197+0000 7f562a04a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:45:12.515 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:12.510+0000 7f562a04a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:45:12.574 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:12.568+0000 7f562a04a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:45:12.704 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-02-21T07:45:12.698+0000 7f562a04a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:45:12.912 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:12.906+0000 7f0cb2a55640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-21T07:45:12.912 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:12.907+0000 7f0cb2a55640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-21T07:45:13.035 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:13.211 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.206+0000 7fb955c00640 1 Processor -- start 2024-02-21T07:45:13.212 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.206+0000 7fb955c00640 1 -- start start 2024-02-21T07:45:13.214 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb955c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb95008bfc0 0x7fb9500f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.214 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb955c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9501861b0 0x7fb95008cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.214 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb955c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9501849d0 con 0x7fb950185d50 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb955c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb950184cb0 con 0x7fb9501861b0 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb955c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb950184f90 con 0x7fb95008bfc0 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb95008bfc0 0x7fb9500f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb95008bfc0 0x7fb9500f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35410/0 (socket says 172.21.15.100:35410) 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 -- 172.21.15.100:0/4011015049 learned_addr learned my addr 172.21.15.100:0/4011015049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94f400640 1 --2- 172.21.15.100:0/4011015049 >> v2:172.21.15.156:3300/0 conn(0x7fb9501861b0 0x7fb95008cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 -- 172.21.15.100:0/4011015049 >> v2:172.21.15.156:3300/0 conn(0x7fb9501861b0 msgr2=0x7fb95008cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 --2- 172.21.15.100:0/4011015049 >> v2:172.21.15.156:3300/0 conn(0x7fb9501861b0 0x7fb95008cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 -- 172.21.15.100:0/4011015049 >> v1:172.21.15.100:6789/0 conn(0x7fb950185d50 legacy=0x7fb95008c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94ea00640 1 -- 172.21.15.100:0/4011015049 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950185270 con 0x7fb95008bfc0 2024-02-21T07:45:13.215 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.208+0000 7fb94e000640 1 -- 172.21.15.100:0/4011015049 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360291877 0 0) 0x7fb9501849d0 con 0x7fb950185d50 2024-02-21T07:45:13.217 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb94ea00640 1 --2- 172.21.15.100:0/4011015049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9500f7af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb95006da10 tx=0x7fb93802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487807f05ec3adf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:13.217 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb94e000640 1 -- 172.21.15.100:0/4011015049 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb938030860 con 0x7fb95008bfc0 2024-02-21T07:45:13.217 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb94e000640 1 -- 172.21.15.100:0/4011015049 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9380309c0 con 0x7fb95008bfc0 2024-02-21T07:45:13.217 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb94e000640 1 -- 172.21.15.100:0/4011015049 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb938030d50 con 0x7fb95008bfc0 2024-02-21T07:45:13.217 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb955c00640 1 -- 172.21.15.100:0/4011015049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 msgr2=0x7fb9500f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.210+0000 7fb955c00640 1 --2- 172.21.15.100:0/4011015049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9500f7af0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb95006da10 tx=0x7fb93802b9a0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 -- 172.21.15.100:0/4011015049 shutdown_connections 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 --2- 172.21.15.100:0/4011015049 >> v2:172.21.15.156:3300/0 conn(0x7fb9501861b0 0x7fb95008cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 --2- 172.21.15.100:0/4011015049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9500f7af0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 -- 172.21.15.100:0/4011015049 >> 172.21.15.100:0/4011015049 conn(0x7fb9500f6670 msgr2=0x7fb9500f6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 -- 172.21.15.100:0/4011015049 shutdown_connections 2024-02-21T07:45:13.218 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.211+0000 7fb955c00640 1 -- 172.21.15.100:0/4011015049 wait complete. 2024-02-21T07:45:13.219 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.213+0000 7fb955c00640 1 Processor -- start 2024-02-21T07:45:13.219 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.213+0000 7fb955c00640 1 -- start start 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9502120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9501861b0 0x7fb950164d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950211c10 con 0x7fb950185d50 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950210d60 con 0x7fb9501861b0 2024-02-21T07:45:13.221 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb955c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb950211000 con 0x7fb95008bfc0 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb946000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb946000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35272/0 (socket says 172.21.15.100:35272) 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.214+0000 7fb946000640 1 -- 172.21.15.100:0/2495281559 learned_addr learned my addr 172.21.15.100:0/2495281559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb94ea00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9502120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb94f400640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9501861b0 0x7fb950164d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 -- 172.21.15.100:0/2495281559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 msgr2=0x7fb9502120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9502120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 -- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9501861b0 msgr2=0x7fb950164d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9501861b0 0x7fb950164d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 -- 172.21.15.100:0/2495281559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380094d0 con 0x7fb950185d50 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb94ea00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9502120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb946000640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c460 tx=0x7fb94000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:13.222 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940005480 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9400035f0 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.215+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95017d550 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.216+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400039a0 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.216+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9502115c0 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.217+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95006e630 con 0x7fb950185d50 2024-02-21T07:45:13.223 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.218+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 3) v1 ==== 134206+0+0 (secure 0 0 0) 0x7fb940003b00 con 0x7fb950185d50 2024-02-21T07:45:13.225 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.219+0000 7fb947400640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 0x7fb92c0a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:13.225 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.220+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7fb9400c7a70 con 0x7fb950185d50 2024-02-21T07:45:13.225 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.220+0000 7fb94ea00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 0x7fb92c0a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:13.226 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.221+0000 7fb94ea00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 0x7fb92c0a1460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb938036000 tx=0x7fb938008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:13.229 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.224+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb940093370 con 0x7fb950185d50 2024-02-21T07:45:13.425 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.419+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb95006e350 con 0x7fb950185d50 2024-02-21T07:45:13.426 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.420+0000 7fb947400640 1 -- 172.21.15.100:0/2495281559 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7fb9400952a0 con 0x7fb950185d50 2024-02-21T07:45:13.426 INFO:teuthology.misc.health.smithi100.stdout: 2024-02-21T07:45:13.426 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":14,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:11.388291+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 msgr2=0x7fb92c0a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 0x7fb92c0a1460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb938036000 tx=0x7fb938008030 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 msgr2=0x7fb9501647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb94000c460 tx=0x7fb94000c920 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 shutdown_connections 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9501861b0 0x7fb950164d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb92c09efa0 0x7fb92c0a1460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb950185d50 0x7fb9501647d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 --2- 172.21.15.100:0/2495281559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb95008bfc0 0x7fb9502120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:13.429 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 >> 172.21.15.100:0/2495281559 conn(0x7fb9500f6670 msgr2=0x7fb9500f6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:13.430 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 shutdown_connections 2024-02-21T07:45:13.430 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:13.423+0000 7fb955c00640 1 -- 172.21.15.100:0/2495281559 wait complete. 2024-02-21T07:45:13.443 DEBUG:teuthology.misc:0 of 12 OSDs are up 2024-02-21T07:45:15.465 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-02-21T07:45:15.460+0000 7f53da00c640 -1 osd.3 0 log_to_monitors true 2024-02-21T07:45:15.506 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-02-21T07:45:15.501+0000 7ffbd79ac640 -1 osd.4 0 log_to_monitors true 2024-02-21T07:45:15.527 INFO:tasks.ceph.osd.8.smithi170.stderr:2024-02-21T07:45:15.522+0000 7fd03d4f9640 -1 osd.8 0 log_to_monitors true 2024-02-21T07:45:15.560 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-02-21T07:45:15.554+0000 7f1eb7938640 -1 osd.5 0 log_to_monitors true 2024-02-21T07:45:15.563 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-02-21T07:45:15.557+0000 7feb9821e640 -1 osd.7 0 log_to_monitors true 2024-02-21T07:45:15.590 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-02-21T07:45:15.585+0000 7f583b347640 -1 osd.2 0 log_to_monitors true 2024-02-21T07:45:15.599 INFO:tasks.ceph.osd.11.smithi170.stderr:2024-02-21T07:45:15.593+0000 7f8bc06d7640 -1 osd.11 0 log_to_monitors true 2024-02-21T07:45:15.606 INFO:tasks.ceph.osd.1.smithi156.stderr:2024-02-21T07:45:15.601+0000 7f709981b640 -1 osd.1 0 log_to_monitors true 2024-02-21T07:45:15.638 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-02-21T07:45:15.632+0000 7fd5ca013640 -1 osd.0 0 log_to_monitors true 2024-02-21T07:45:15.645 INFO:tasks.ceph.osd.10.smithi156.stderr:2024-02-21T07:45:15.639+0000 7f91d63bd640 -1 osd.10 0 log_to_monitors true 2024-02-21T07:45:15.684 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-02-21T07:45:15.679+0000 7f001da24640 -1 osd.6 0 log_to_monitors true 2024-02-21T07:45:15.702 INFO:tasks.ceph.osd.9.smithi100.stderr:2024-02-21T07:45:15.697+0000 7f5e8980e640 -1 osd.9 0 log_to_monitors true 2024-02-21T07:45:17.908 INFO:tasks.ceph.osd.10.smithi156.stderr:2024-02-21T07:45:17.903+0000 7f91d2b67640 -1 osd.10 0 waiting for initial osdmap 2024-02-21T07:45:17.913 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-02-21T07:45:17.906+0000 7f58372dd640 -1 osd.2 0 waiting for initial osdmap 2024-02-21T07:45:17.913 INFO:tasks.ceph.osd.11.smithi170.stderr:2024-02-21T07:45:17.907+0000 7f8bbce81640 -1 osd.11 0 waiting for initial osdmap 2024-02-21T07:45:17.926 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-02-21T07:45:17.920+0000 7feb94301640 -1 osd.7 0 waiting for initial osdmap 2024-02-21T07:45:17.928 INFO:tasks.ceph.osd.10.smithi156.stderr:2024-02-21T07:45:17.923+0000 7f91ca173640 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.930 INFO:tasks.ceph.osd.2.smithi170.stderr:2024-02-21T07:45:17.924+0000 7f582f0fd640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.930 INFO:tasks.ceph.osd.11.smithi170.stderr:2024-02-21T07:45:17.924+0000 7f8bb448d640 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.931 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-02-21T07:45:17.926+0000 7ffbd3942640 -1 osd.4 0 waiting for initial osdmap 2024-02-21T07:45:17.942 INFO:tasks.ceph.osd.1.smithi156.stderr:2024-02-21T07:45:17.936+0000 7f70951ec640 -1 osd.1 0 waiting for initial osdmap 2024-02-21T07:45:17.944 INFO:tasks.ceph.osd.4.smithi156.stderr:2024-02-21T07:45:17.939+0000 7ffbcb762640 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.945 INFO:tasks.ceph.osd.7.smithi156.stderr:2024-02-21T07:45:17.939+0000 7feb8b91e640 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.946 INFO:tasks.ceph.osd.8.smithi170.stderr:2024-02-21T07:45:17.939+0000 7fd03948f640 -1 osd.8 0 waiting for initial osdmap 2024-02-21T07:45:17.948 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-02-21T07:45:17.941+0000 7f1eb40e2640 -1 osd.5 0 waiting for initial osdmap 2024-02-21T07:45:17.950 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-02-21T07:45:17.944+0000 7f1eab6ee640 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.952 INFO:tasks.ceph.osd.1.smithi156.stderr:2024-02-21T07:45:17.947+0000 7f708d00c640 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:17.958 INFO:tasks.ceph.osd.8.smithi170.stderr:2024-02-21T07:45:17.952+0000 7fd0312af640 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:18.390 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-02-21T07:45:18.385+0000 7f0018800640 -1 osd.6 0 waiting for initial osdmap 2024-02-21T07:45:18.394 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-02-21T07:45:18.389+0000 7f53d4800640 -1 osd.3 0 waiting for initial osdmap 2024-02-21T07:45:18.401 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-02-21T07:45:18.396+0000 7f000e800640 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:18.402 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-02-21T07:45:18.397+0000 7f53ca800640 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:18.424 INFO:tasks.ceph.osd.9.smithi100.stderr:2024-02-21T07:45:18.418+0000 7f5e84a00640 -1 osd.9 0 waiting for initial osdmap 2024-02-21T07:45:18.430 INFO:tasks.ceph.osd.9.smithi100.stderr:2024-02-21T07:45:18.425+0000 7f5e7a000640 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:18.431 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-02-21T07:45:18.425+0000 7fd5c4e00640 -1 osd.0 0 waiting for initial osdmap 2024-02-21T07:45:18.446 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-02-21T07:45:18.441+0000 7fd5bae00640 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:45:20.654 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:20.840 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.834+0000 7f90f5c00640 1 Processor -- start 2024-02-21T07:45:20.840 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.834+0000 7f90f5c00640 1 -- start start 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.836+0000 7f90f5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90f008bfc0 0x7f90f0071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.836+0000 7f90f5c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 0x7f90f0189c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.836+0000 7f90f5c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f00f9590 con 0x7f90f00f7e90 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.836+0000 7f90f5c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00f86a0 con 0x7f90f008bfc0 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.836+0000 7f90f5c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f00f8980 con 0x7f90f008cab0 2024-02-21T07:45:20.842 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90f008bfc0 0x7f90f0071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.843 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90f008bfc0 0x7f90f0071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50274/0 (socket says 172.21.15.100:50274) 2024-02-21T07:45:20.843 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 -- 172.21.15.100:0/2392348883 learned_addr learned my addr 172.21.15.100:0/2392348883 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90ef400640 1 --2- 172.21.15.100:0/2392348883 >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 0x7f90f0189c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 -- 172.21.15.100:0/2392348883 >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 msgr2=0x7f90f0189c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 --2- 172.21.15.100:0/2392348883 >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 0x7f90f0189c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 -- 172.21.15.100:0/2392348883 >> v1:172.21.15.170:6789/0 conn(0x7f90f00f7e90 legacy=0x7f90f008c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90eea00640 1 -- 172.21.15.100:0/2392348883 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00f8c60 con 0x7f90f008bfc0 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90ef400640 1 --2- 172.21.15.100:0/2392348883 >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 0x7f90f0189c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:20.844 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.837+0000 7f90ed600640 1 -- 172.21.15.100:0/2392348883 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973222874 0 0) 0x7f90f00f9590 con 0x7f90f00f7e90 2024-02-21T07:45:20.845 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.838+0000 7f90eea00640 1 --2- 172.21.15.100:0/2392348883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008bfc0 0x7f90f0071290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90f00f41d0 tx=0x7f90d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b81b37d526e09c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:20.845 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.838+0000 7f90ed600640 1 -- 172.21.15.100:0/2392348883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031870 con 0x7f90f008bfc0 2024-02-21T07:45:20.845 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90ed600640 1 -- 172.21.15.100:0/2392348883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80319d0 con 0x7f90f008bfc0 2024-02-21T07:45:20.845 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90ed600640 1 -- 172.21.15.100:0/2392348883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031d60 con 0x7f90f008bfc0 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 -- 172.21.15.100:0/2392348883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008bfc0 msgr2=0x7f90f0071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2392348883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008bfc0 0x7f90f0071290 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f90f00f41d0 tx=0x7f90d802b910 comp rx=0 tx=0).stop 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 -- 172.21.15.100:0/2392348883 shutdown_connections 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2392348883 >> v2:172.21.15.156:3300/0 conn(0x7f90f008cab0 0x7f90f0189c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2392348883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008bfc0 0x7f90f0071290 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 -- 172.21.15.100:0/2392348883 >> 172.21.15.100:0/2392348883 conn(0x7f90f00f6670 msgr2=0x7f90f00f6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 -- 172.21.15.100:0/2392348883 shutdown_connections 2024-02-21T07:45:20.846 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.839+0000 7f90f5c00640 1 -- 172.21.15.100:0/2392348883 wait complete. 2024-02-21T07:45:20.847 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.842+0000 7f90f5c00640 1 Processor -- start 2024-02-21T07:45:20.847 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.842+0000 7f90f5c00640 1 -- start start 2024-02-21T07:45:20.850 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 0x7f90f016ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.850 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 0x7f90f016f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90f00f7e90 0x7f90f0183f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f016f770 con 0x7f90f008cab0 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00cccb0 con 0x7f90f008bfc0 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90f5c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f01725d0 con 0x7f90f00f7e90 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90eea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 0x7f90f016ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90ee000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 0x7f90f016f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90eea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 0x7f90f016ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42384/0 (socket says 172.21.15.100:42384) 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.843+0000 7f90eea00640 1 -- 172.21.15.100:0/2069462001 learned_addr learned my addr 172.21.15.100:0/2069462001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ef400640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90f00f7e90 0x7f90f0183f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 -- 172.21.15.100:0/2069462001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90f00f7e90 msgr2=0x7f90f0183f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:20.851 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90f00f7e90 0x7f90f0183f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 -- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 msgr2=0x7f90f016ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 0x7f90f016ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 -- 172.21.15.100:0/2069462001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80094d0 con 0x7f90f008cab0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90ee000640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 0x7f90f016f230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90e000c750 tx=0x7f90e000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0003ba0 con 0x7f90f008cab0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0003d00 con 0x7f90f008cab0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f00f8470 con 0x7f90f008cab0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.844+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00052b0 con 0x7f90f008cab0 2024-02-21T07:45:20.852 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.845+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f00cd1e0 con 0x7f90f008cab0 2024-02-21T07:45:20.853 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.846+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f004eee0 con 0x7f90f008cab0 2024-02-21T07:45:20.853 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.848+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f90e0005410 con 0x7f90f008cab0 2024-02-21T07:45:20.854 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.849+0000 7f90e6a00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 0x7f90cc0a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:20.854 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.849+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 6686+0+0 (secure 0 0 0) 0x7f90e00c9ad0 con 0x7f90f008cab0 2024-02-21T07:45:20.855 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.849+0000 7f90eea00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 0x7f90cc0a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:20.855 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.850+0000 7f90eea00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 0x7f90cc0a14d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90d80090b0 tx=0x7f90d803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:20.858 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:20.853+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90e0094050 con 0x7f90f008cab0 2024-02-21T07:45:21.054 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.049+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f0070650 con 0x7f90f008cab0 2024-02-21T07:45:21.055 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.050+0000 7f90e6a00640 1 -- 172.21.15.100:0/2069462001 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17921 (secure 0 0 0) 0x7f90e0097710 con 0x7f90f008cab0 2024-02-21T07:45:21.056 INFO:teuthology.misc.health.smithi100.stdout: 2024-02-21T07:45:21.056 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":19,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:20.983397+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 msgr2=0x7f90cc0a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 0x7f90cc0a14d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90d80090b0 tx=0x7f90d803c040 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 msgr2=0x7f90f016f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 0x7f90f016f230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90e000c750 tx=0x7f90e000cc10 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 shutdown_connections 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90f00f7e90 0x7f90f0183f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f90cc09f010 0x7f90cc0a14d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f008cab0 0x7f90f016f230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 --2- 172.21.15.100:0/2069462001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f008bfc0 0x7f90f016ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 >> 172.21.15.100:0/2069462001 conn(0x7f90f00f6670 msgr2=0x7f90f00f6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 shutdown_connections 2024-02-21T07:45:21.059 INFO:teuthology.misc.health.smithi100.stderr:2024-02-21T07:45:21.053+0000 7f90f5c00640 1 -- 172.21.15.100:0/2069462001 wait complete. 2024-02-21T07:45:21.073 DEBUG:teuthology.misc:12 of 12 OSDs are up 2024-02-21T07:45:21.073 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-21T07:45:21.074 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-21T07:45:21.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-21T07:45:21.079 INFO:tasks.ceph.mds.a:Started 2024-02-21T07:45:21.080 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-21T07:45:21.080 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-21T07:45:21.086 INFO:tasks.ceph.mds.d:Started 2024-02-21T07:45:21.086 INFO:tasks.ceph.mds.g:Restarting daemon 2024-02-21T07:45:21.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2024-02-21T07:45:21.090 INFO:tasks.ceph.mds.g:Started 2024-02-21T07:45:21.090 INFO:tasks.ceph.mds.j:Restarting daemon 2024-02-21T07:45:21.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2024-02-21T07:45:21.094 INFO:tasks.ceph.mds.j:Started 2024-02-21T07:45:21.094 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-21T07:45:21.094 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-21T07:45:21.100 INFO:tasks.ceph.mds.b:Started 2024-02-21T07:45:21.100 INFO:tasks.ceph.mds.e:Restarting daemon 2024-02-21T07:45:21.100 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-02-21T07:45:21.102 INFO:tasks.ceph.mds.e:Started 2024-02-21T07:45:21.102 INFO:tasks.ceph.mds.h:Restarting daemon 2024-02-21T07:45:21.102 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2024-02-21T07:45:21.104 INFO:tasks.ceph.mds.h:Started 2024-02-21T07:45:21.105 INFO:tasks.ceph.mds.k:Restarting daemon 2024-02-21T07:45:21.105 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2024-02-21T07:45:21.107 INFO:tasks.ceph.mds.k:Started 2024-02-21T07:45:21.107 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-21T07:45:21.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-21T07:45:21.110 INFO:tasks.ceph.mds.c:Started 2024-02-21T07:45:21.110 INFO:tasks.ceph.mds.f:Restarting daemon 2024-02-21T07:45:21.110 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-02-21T07:45:21.112 INFO:tasks.ceph.mds.f:Started 2024-02-21T07:45:21.113 INFO:tasks.ceph.mds.i:Restarting daemon 2024-02-21T07:45:21.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2024-02-21T07:45:21.115 INFO:tasks.ceph.mds.i:Started 2024-02-21T07:45:21.115 INFO:tasks.ceph.mds.l:Restarting daemon 2024-02-21T07:45:21.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2024-02-21T07:45:21.117 INFO:tasks.ceph.mds.l:Started 2024-02-21T07:45:21.118 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-21T07:45:21.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:21.187 INFO:tasks.ceph.mds.b.smithi156.stdout:starting mds.b at 2024-02-21T07:45:21.188 INFO:tasks.ceph.mds.e.smithi156.stdout:starting mds.e at 2024-02-21T07:45:21.190 INFO:tasks.ceph.mds.k.smithi156.stdout:starting mds.k at 2024-02-21T07:45:21.191 INFO:tasks.ceph.mds.h.smithi156.stdout:starting mds.h at 2024-02-21T07:45:21.199 INFO:tasks.ceph.mds.f.smithi170.stdout:starting mds.f at 2024-02-21T07:45:21.200 INFO:tasks.ceph.mds.c.smithi170.stdout:starting mds.c at 2024-02-21T07:45:21.201 INFO:tasks.ceph.mds.i.smithi170.stdout:starting mds.i at 2024-02-21T07:45:21.207 INFO:tasks.ceph.mds.l.smithi170.stdout:starting mds.l at 2024-02-21T07:45:21.252 INFO:tasks.ceph.mds.g.smithi100.stdout:starting mds.g at 2024-02-21T07:45:21.257 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-02-21T07:45:21.259 INFO:tasks.ceph.mds.j.smithi100.stdout:starting mds.j at 2024-02-21T07:45:21.271 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-02-21T07:45:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.320+0000 7f4e28600640 1 Processor -- start 2024-02-21T07:45:21.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.320+0000 7f4e28600640 1 -- start start 2024-02-21T07:45:21.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.322+0000 7f4e28600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e2015fb50 0x7f4e2015e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.322+0000 7f4e28600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 0x7f4e2018f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.322+0000 7f4e28600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e20186d30 con 0x7f4e2015a6a0 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.322+0000 7f4e28600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e20189690 con 0x7f4e2015fb50 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.322+0000 7f4e28600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2015e5b0 con 0x7f4e20160bd0 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e2015fb50 0x7f4e2015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4e2015a6a0 0x7f4e20186620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50666/0 (socket says 172.21.15.100:50666) 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4e2015fb50 0x7f4e2015e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42454/0 (socket says 172.21.15.100:42454) 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 -- 172.21.15.100:0/1350974232 learned_addr learned my addr 172.21.15.100:0/1350974232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e26600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 0x7f4e2018f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 -- 172.21.15.100:0/1350974232 >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 msgr2=0x7f4e2018f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 --2- 172.21.15.100:0/1350974232 >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 0x7f4e2018f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 -- 172.21.15.100:0/1350974232 >> v1:172.21.15.156:6789/0 conn(0x7f4e2015a6a0 legacy=0x7f4e20186620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e25200640 1 -- 172.21.15.100:0/1350974232 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2015e7d0 con 0x7f4e2015fb50 2024-02-21T07:45:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e1fe00640 1 -- 172.21.15.100:0/1350974232 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093958572 0 0) 0x7f4e14001110 con 0x7f4e2015a6a0 2024-02-21T07:45:21.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.323+0000 7f4e26600640 1 --2- 172.21.15.100:0/1350974232 >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 0x7f4e2018f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.324+0000 7f4e25200640 1 --2- 172.21.15.100:0/1350974232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e2015fb50 0x7f4e2015e070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006ac80 tx=0x7f4e0c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44b6351b1a1786d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.324+0000 7f4e1fe00640 1 -- 172.21.15.100:0/1350974232 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c030860 con 0x7f4e2015fb50 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e1fe00640 1 -- 172.21.15.100:0/1350974232 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0309c0 con 0x7f4e2015fb50 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e1fe00640 1 -- 172.21.15.100:0/1350974232 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c030d50 con 0x7f4e2015fb50 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 -- 172.21.15.100:0/1350974232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e2015fb50 msgr2=0x7f4e2015e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 --2- 172.21.15.100:0/1350974232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e2015fb50 0x7f4e2015e070 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006ac80 tx=0x7f4e0c02b9a0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 -- 172.21.15.100:0/1350974232 shutdown_connections 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 --2- 172.21.15.100:0/1350974232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e2015fb50 0x7f4e2015e070 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 --2- 172.21.15.100:0/1350974232 >> v2:172.21.15.170:3300/0 conn(0x7f4e20160bd0 0x7f4e2018f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 -- 172.21.15.100:0/1350974232 >> 172.21.15.100:0/1350974232 conn(0x7f4e200d26b0 msgr2=0x7f4e200d2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 -- 172.21.15.100:0/1350974232 shutdown_connections 2024-02-21T07:45:21.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.325+0000 7f4e28600640 1 -- 172.21.15.100:0/1350974232 wait complete. 2024-02-21T07:45:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.327+0000 7f4e28600640 1 Processor -- start 2024-02-21T07:45:21.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.327+0000 7f4e28600640 1 -- start start 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.328+0000 7f4e28600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.328+0000 7f4e28600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2015fb50 0x7f4e200f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e28600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e20160bd0 0x7f4e2017d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e28600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200f9430 con 0x7f4e2015a6a0 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e28600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200fa190 con 0x7f4e20160bd0 2024-02-21T07:45:21.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e28600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200d0750 con 0x7f4e2015fb50 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50354/0 (socket says 172.21.15.100:50354) 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 -- 172.21.15.100:0/3394595279 learned_addr learned my addr 172.21.15.100:0/3394595279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25200640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2015fb50 0x7f4e200f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e26600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e20160bd0 0x7f4e2017d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 -- 172.21.15.100:0/3394595279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2015fb50 msgr2=0x7f4e200f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2015fb50 0x7f4e200f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 -- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e20160bd0 msgr2=0x7f4e2017d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e20160bd0 0x7f4e2017d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 -- 172.21.15.100:0/3394595279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18009a70 con 0x7f4e2015a6a0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.329+0000 7f4e25c00640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c3f0 tx=0x7f4e1400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.330+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140074e0 con 0x7f4e2015a6a0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.330+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14007640 con 0x7f4e2015a6a0 2024-02-21T07:45:21.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.330+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004a00 con 0x7f4e2015a6a0 2024-02-21T07:45:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.330+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c0094d0 con 0x7f4e2015a6a0 2024-02-21T07:45:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.330+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e200f98f0 con 0x7f4e2015a6a0 2024-02-21T07:45:21.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.331+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e20067c80 con 0x7f4e2015a6a0 2024-02-21T07:45:21.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.333+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f4e14004b60 con 0x7f4e2015a6a0 2024-02-21T07:45:21.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.334+0000 7f4e1d600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 0x7f4e000a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.334+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f4e140c8e20 con 0x7f4e2015a6a0 2024-02-21T07:45:21.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.334+0000 7f4e25200640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 0x7f4e000a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.335+0000 7f4e25200640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 0x7f4e000a14d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c036000 tx=0x7f4e0c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.338+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4e14093420 con 0x7f4e2015a6a0 2024-02-21T07:45:21.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.538+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e20186d30 con 0x7f4e2015a6a0 2024-02-21T07:45:21.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.539+0000 7f4e1d600640 1 -- 172.21.15.100:0/3394595279 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17921 (secure 0 0 0) 0x7f4e20186d30 con 0x7f4e2015a6a0 2024-02-21T07:45:21.545 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":19,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:20.983397+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 msgr2=0x7f4e000a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 0x7f4e000a14d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c036000 tx=0x7f4e0c008030 comp rx=0 tx=0).stop 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 msgr2=0x7f4e20214740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400c3f0 tx=0x7f4e1400c7f0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 shutdown_connections 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e20160bd0 0x7f4e2017d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4e2015fb50 0x7f4e200f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4e0009f010 0x7f4e000a14d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 --2- 172.21.15.100:0/3394595279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e2015a6a0 0x7f4e20214740 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.541+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 >> 172.21.15.100:0/3394595279 conn(0x7f4e200d26b0 msgr2=0x7f4e200d5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.542+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 shutdown_connections 2024-02-21T07:45:21.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.542+0000 7f4e28600640 1 -- 172.21.15.100:0/3394595279 wait complete. 2024-02-21T07:45:21.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T07:45:21.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.742+0000 7fedda000640 1 Processor -- start 2024-02-21T07:45:21.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.742+0000 7fedda000640 1 -- start start 2024-02-21T07:45:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedda000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fedd40f9680 0x7fedd406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedda000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40cac60 con 0x7fedd417d0b0 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedda000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40f9ab0 con 0x7fedd40cb800 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedda000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd417d490 con 0x7fedd40f9680 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedd8c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fedd417d0b0 0x7fedd40cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40044/0 (socket says 172.21.15.100:40044) 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedd8c00640 1 -- 172.21.15.100:0/2185590018 learned_addr learned my addr 172.21.15.100:0/2185590018 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedd9600640 1 --2- 172.21.15.100:0/2185590018 >> v2:172.21.15.100:3300/0 conn(0x7fedd40f9680 0x7fedd406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.744+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936725092 0 0) 0x7fedd40cac60 con 0x7fedd417d0b0 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.745+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedbc003520 con 0x7fedd417d0b0 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.745+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913211802 0 0) 0x7fedd40f9ab0 con 0x7fedd40cb800 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.745+0000 7fedd9600640 1 -- 172.21.15.100:0/2185590018 >> v1:172.21.15.170:6789/0 conn(0x7fedd40cb800 legacy=0x7fedd40f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.745+0000 7fedd9600640 1 -- 172.21.15.100:0/2185590018 >> v1:172.21.15.100:6789/0 conn(0x7fedd417d0b0 legacy=0x7fedd40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.745+0000 7fedd9600640 1 -- 172.21.15.100:0/2185590018 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd406e830 con 0x7fedd40f9680 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedd9600640 1 --2- 172.21.15.100:0/2185590018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40f9680 0x7fedd406d950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d90 tx=0x7fedcc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cc6604ad4d8cc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc02cd00 con 0x7fedd40f9680 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc02ce60 con 0x7fedd40f9680 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedd3400640 1 -- 172.21.15.100:0/2185590018 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc034660 con 0x7fedd40f9680 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedda000640 1 -- 172.21.15.100:0/2185590018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40f9680 msgr2=0x7fedd406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedda000640 1 --2- 172.21.15.100:0/2185590018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40f9680 0x7fedd406d950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009d90 tx=0x7fedcc02bf50 comp rx=0 tx=0).stop 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedda000640 1 -- 172.21.15.100:0/2185590018 shutdown_connections 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.746+0000 7fedda000640 1 --2- 172.21.15.100:0/2185590018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40f9680 0x7fedd406d950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.747+0000 7fedda000640 1 -- 172.21.15.100:0/2185590018 >> 172.21.15.100:0/2185590018 conn(0x7fedd40ce150 msgr2=0x7fedd40ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.747+0000 7fedda000640 1 -- 172.21.15.100:0/2185590018 shutdown_connections 2024-02-21T07:45:21.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.747+0000 7fedda000640 1 -- 172.21.15.100:0/2185590018 wait complete. 2024-02-21T07:45:21.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.749+0000 7fedda000640 1 Processor -- start 2024-02-21T07:45:21.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.749+0000 7fedda000640 1 -- start start 2024-02-21T07:45:21.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedd40f9680 0x7fedd416dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 0x7fedd421c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4220100 con 0x7fedd40cb800 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd42203e0 con 0x7fedd40f9680 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedda000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd42206c0 con 0x7fedd417d0b0 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50384/0 (socket says 172.21.15.100:50384) 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 -- 172.21.15.100:0/865561846 learned_addr learned my addr 172.21.15.100:0/865561846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd3e00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedd40f9680 0x7fedd416dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd9600640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 0x7fedd421c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 -- 172.21.15.100:0/865561846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 msgr2=0x7fedd421c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 0x7fedd421c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 -- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedd40f9680 msgr2=0x7fedd416dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedd40f9680 0x7fedd416dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd8c00640 1 -- 172.21.15.100:0/865561846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009a70 con 0x7fedd40cb800 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.751+0000 7fedd9600640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 0x7fedd421c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedd8c00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001eb0 tx=0x7fedc800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8005ce0 con 0x7fedd40cb800 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8005e40 con 0x7fedd40cb800 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8007270 con 0x7fedd40cb800 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd42209a0 con 0x7fedd40cb800 2024-02-21T07:45:21.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.752+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd4220f60 con 0x7fedd40cb800 2024-02-21T07:45:21.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.753+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd40cef70 con 0x7fedd40cb800 2024-02-21T07:45:21.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.755+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7fedc80073d0 con 0x7fedd40cb800 2024-02-21T07:45:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.756+0000 7fedd0c00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 0x7fedb40a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.756+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fedc80c8a10 con 0x7fedd40cb800 2024-02-21T07:45:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.756+0000 7fedd3e00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 0x7fedb40a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:21.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.757+0000 7fedd3e00640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 0x7fedb40a14d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fedd40f0bd0 tx=0x7fedc0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:21.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.761+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedc8092ef0 con 0x7fedd40cb800 2024-02-21T07:45:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.945+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedd40751d0 con 0x7fedd40cb800 2024-02-21T07:45:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.946+0000 7fedd0c00640 1 -- 172.21.15.100:0/865561846 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedc80170a0 con 0x7fedd40cb800 2024-02-21T07:45:21.952 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:45:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 msgr2=0x7fedb40a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 0x7fedb40a14d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fedd40f0bd0 tx=0x7fedc0009040 comp rx=0 tx=0).stop 2024-02-21T07:45:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 msgr2=0x7fedd421f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fedc8001eb0 tx=0x7fedc800c960 comp rx=0 tx=0).stop 2024-02-21T07:45:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 shutdown_connections 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedd417d0b0 0x7fedd421c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedd40f9680 0x7fedd416dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fedb409f010 0x7fedb40a14d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 --2- 172.21.15.100:0/865561846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedd40cb800 0x7fedd421f830 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.948+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 >> 172.21.15.100:0/865561846 conn(0x7fedd40ce150 msgr2=0x7fedd40cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.949+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 shutdown_connections 2024-02-21T07:45:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:21.949+0000 7fedda000640 1 -- 172.21.15.100:0/865561846 wait complete. 2024-02-21T07:45:21.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:45:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.157+0000 7f5a79200640 1 Processor -- start 2024-02-21T07:45:22.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.158+0000 7f5a79200640 1 -- start start 2024-02-21T07:45:22.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.159+0000 7f5a79200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5a74186430 0x7f5a7418b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a79200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7418b670 con 0x7f5a740d3dc0 2024-02-21T07:45:22.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a79200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a740d5aa0 con 0x7f5a74186050 2024-02-21T07:45:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a79200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7418a600 con 0x7f5a74186430 2024-02-21T07:45:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a72800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5a740d3dc0 0x7f5a740d4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40052/0 (socket says 172.21.15.100:40052) 2024-02-21T07:45:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a72800640 1 -- 172.21.15.100:0/1121683540 learned_addr learned my addr 172.21.15.100:0/1121683540 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:22.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a6be00640 1 --2- 172.21.15.100:0/1121683540 >> v2:172.21.15.156:3300/0 conn(0x7f5a74186430 0x7f5a7418b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388366076 0 0) 0x7f5a740d5aa0 con 0x7f5a74186050 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a58003520 con 0x7f5a74186050 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007111276 0 0) 0x7f5a7418b670 con 0x7f5a740d3dc0 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a740d5aa0 con 0x7f5a740d3dc0 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a6be00640 1 -- 172.21.15.100:0/1121683540 >> v1:172.21.15.170:6789/0 conn(0x7f5a74186050 legacy=0x7f5a7418aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a6be00640 1 -- 172.21.15.100:0/1121683540 >> v1:172.21.15.100:6789/0 conn(0x7f5a740d3dc0 legacy=0x7f5a740d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.160+0000 7f5a6be00640 1 -- 172.21.15.100:0/1121683540 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740d54e0 con 0x7f5a74186430 2024-02-21T07:45:22.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.162+0000 7f5a6be00640 1 --2- 172.21.15.100:0/1121683540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a74186430 0x7f5a7418b130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0097a0 tx=0x7f5a5c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=815ce43f6da88772 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.163+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c031830 con 0x7f5a74186430 2024-02-21T07:45:22.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.163+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c031990 con 0x7f5a74186430 2024-02-21T07:45:22.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.163+0000 7f5a71400640 1 -- 172.21.15.100:0/1121683540 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c031d20 con 0x7f5a74186430 2024-02-21T07:45:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.163+0000 7f5a79200640 1 -- 172.21.15.100:0/1121683540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a74186430 msgr2=0x7f5a7418b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.163+0000 7f5a79200640 1 --2- 172.21.15.100:0/1121683540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a74186430 0x7f5a7418b130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0097a0 tx=0x7f5a5c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.164+0000 7f5a79200640 1 -- 172.21.15.100:0/1121683540 shutdown_connections 2024-02-21T07:45:22.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.164+0000 7f5a79200640 1 --2- 172.21.15.100:0/1121683540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a74186430 0x7f5a7418b130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.164+0000 7f5a79200640 1 -- 172.21.15.100:0/1121683540 >> 172.21.15.100:0/1121683540 conn(0x7f5a740d2540 msgr2=0x7f5a740d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:22.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.164+0000 7f5a79200640 1 -- 172.21.15.100:0/1121683540 shutdown_connections 2024-02-21T07:45:22.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.164+0000 7f5a79200640 1 -- 172.21.15.100:0/1121683540 wait complete. 2024-02-21T07:45:22.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.165+0000 7f5a79200640 1 Processor -- start 2024-02-21T07:45:22.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.166+0000 7f5a79200640 1 -- start start 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a74186050 0x7f5a7406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 0x7f5a7406c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7421f2a0 con 0x7f5a74186050 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7421e410 con 0x7f5a740d3dc0 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a79200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7421e620 con 0x7f5a74172280 2024-02-21T07:45:22.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a6be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a74186050 0x7f5a7406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a72800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 0x7f5a7406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42480/0 (socket says 172.21.15.100:42480) 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a72800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 0x7f5a7406c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41182/0 (socket says 172.21.15.100:41182) 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 -- 172.21.15.100:0/2858100799 learned_addr learned my addr 172.21.15.100:0/2858100799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 -- 172.21.15.100:0/2858100799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 msgr2=0x7f5a7406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 0x7f5a7406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 -- 172.21.15.100:0/2858100799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a74186050 msgr2=0x7f5a7406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a74186050 0x7f5a7406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.167+0000 7f5a71e00640 1 -- 172.21.15.100:0/2858100799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c009400 con 0x7f5a740d3dc0 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a71e00640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c480 tx=0x7f5a6400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640052d0 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64005430 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64012870 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7421e900 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.168+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7421eec0 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.169+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a74067c80 con 0x7f5a740d3dc0 2024-02-21T07:45:22.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.171+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f5a640035f0 con 0x7f5a740d3dc0 2024-02-21T07:45:22.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.172+0000 7f5a6a000640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 0x7f5a500a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.172+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f5a640c8770 con 0x7f5a740d3dc0 2024-02-21T07:45:22.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.172+0000 7f5a6be00640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 0x7f5a500a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.173+0000 7f5a6be00640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 0x7f5a500a14d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c036000 tx=0x7f5a5c03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.176+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a64092eb0 con 0x7f5a740d3dc0 2024-02-21T07:45:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.415+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a740f4e80 con 0x7f5a740d3dc0 2024-02-21T07:45:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.416+0000 7f5a6a000640 1 -- 172.21.15.100:0/2858100799 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+10044 (secure 0 0 0) 0x7f5a64096570 con 0x7f5a740d3dc0 2024-02-21T07:45:22.422 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:22.422 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4333,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-21T07:45:22.423 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 msgr2=0x7f5a500a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 0x7f5a500a14d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c036000 tx=0x7f5a5c03c040 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 msgr2=0x7f5a74171d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400c480 tx=0x7f5a6400c940 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 shutdown_connections 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a74172280 0x7f5a7406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a5009f010 0x7f5a500a14d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a74186050 0x7f5a7406c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 --2- 172.21.15.100:0/2858100799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a740d3dc0 0x7f5a74171d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 >> 172.21.15.100:0/2858100799 conn(0x7f5a740d2540 msgr2=0x7f5a740d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 shutdown_connections 2024-02-21T07:45:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.419+0000 7f5a79200640 1 -- 172.21.15.100:0/2858100799 wait complete. 2024-02-21T07:45:22.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.629+0000 7ff476e00640 1 Processor -- start 2024-02-21T07:45:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.629+0000 7ff476e00640 1 -- start start 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.630+0000 7ff476e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff470186050 0x7ff47018aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.630+0000 7ff476e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff470186430 0x7ff47018af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff476e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4700d5aa0 con 0x7ff47018b4a0 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff476e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47018a600 con 0x7ff470186050 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff476e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4700d69b0 con 0x7ff470186430 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff470186050 0x7ff47018aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff470186050 0x7ff47018aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50410/0 (socket says 172.21.15.100:50410) 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 -- 172.21.15.100:0/4061945504 learned_addr learned my addr 172.21.15.100:0/4061945504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff467400640 1 --2- 172.21.15.100:0/4061945504 >> v2:172.21.15.156:3300/0 conn(0x7ff470186430 0x7ff47018af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 -- 172.21.15.100:0/4061945504 >> v2:172.21.15.156:3300/0 conn(0x7ff470186430 msgr2=0x7ff47018af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 --2- 172.21.15.100:0/4061945504 >> v2:172.21.15.156:3300/0 conn(0x7ff470186430 0x7ff47018af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 -- 172.21.15.100:0/4061945504 >> v1:172.21.15.156:6789/0 conn(0x7ff47018b4a0 legacy=0x7ff47018bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.631+0000 7ff46fe00640 1 -- 172.21.15.100:0/4061945504 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700d54e0 con 0x7ff470186050 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.632+0000 7ff46fe00640 1 --2- 172.21.15.100:0/4061945504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff470186050 0x7ff47018aa20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff470067430 tx=0x7ff46002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abf9b2827f603 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.632+0000 7ff46f400640 1 -- 172.21.15.100:0/4061945504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46002cb20 con 0x7ff470186050 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff46f400640 1 -- 172.21.15.100:0/4061945504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46002cc80 con 0x7ff470186050 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff46f400640 1 -- 172.21.15.100:0/4061945504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600343f0 con 0x7ff470186050 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 -- 172.21.15.100:0/4061945504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff470186050 msgr2=0x7ff47018aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 --2- 172.21.15.100:0/4061945504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff470186050 0x7ff47018aa20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff470067430 tx=0x7ff46002bf80 comp rx=0 tx=0).stop 2024-02-21T07:45:22.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 -- 172.21.15.100:0/4061945504 shutdown_connections 2024-02-21T07:45:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 --2- 172.21.15.100:0/4061945504 >> v2:172.21.15.156:3300/0 conn(0x7ff470186430 0x7ff47018af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 --2- 172.21.15.100:0/4061945504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff470186050 0x7ff47018aa20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 -- 172.21.15.100:0/4061945504 >> 172.21.15.100:0/4061945504 conn(0x7ff4700d2540 msgr2=0x7ff4700d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 -- 172.21.15.100:0/4061945504 shutdown_connections 2024-02-21T07:45:22.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.633+0000 7ff476e00640 1 -- 172.21.15.100:0/4061945504 wait complete. 2024-02-21T07:45:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.635+0000 7ff476e00640 1 Processor -- start 2024-02-21T07:45:22.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.635+0000 7ff476e00640 1 -- start start 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff470186050 0x7ff470172300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 0x7ff47021cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47021e180 con 0x7ff47018b4a0 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4700f99a0 con 0x7ff470172840 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.636+0000 7ff476e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47021d220 con 0x7ff470186050 2024-02-21T07:45:22.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50424/0 (socket says 172.21.15.100:50424) 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 -- 172.21.15.100:0/2719069372 learned_addr learned my addr 172.21.15.100:0/2719069372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff46fe00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff470186050 0x7ff470172300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff474e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 0x7ff47021cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 -- 172.21.15.100:0/2719069372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff470186050 msgr2=0x7ff470172300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff470186050 0x7ff470172300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 -- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 msgr2=0x7ff47021cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 0x7ff47021cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 -- 172.21.15.100:0/2719069372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460009b30 con 0x7ff47018b4a0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff474e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 0x7ff47021cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.637+0000 7ff467400640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e9b0 tx=0x7ff45800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.638+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458009670 con 0x7ff47018b4a0 2024-02-21T07:45:22.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.638+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45800c9a0 con 0x7ff47018b4a0 2024-02-21T07:45:22.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.638+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800cd50 con 0x7ff47018b4a0 2024-02-21T07:45:22.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.638+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47021d500 con 0x7ff47018b4a0 2024-02-21T07:45:22.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.638+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47021dac0 con 0x7ff47018b4a0 2024-02-21T07:45:22.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.639+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4700cf790 con 0x7ff47018b4a0 2024-02-21T07:45:22.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.641+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7ff458013470 con 0x7ff47018b4a0 2024-02-21T07:45:22.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.642+0000 7ff46cc00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 0x7ff44c0a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:22.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.642+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7ff4580c9510 con 0x7ff47018b4a0 2024-02-21T07:45:22.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.642+0000 7ff46fe00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 0x7ff44c0a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:22.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.643+0000 7ff46fe00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 0x7ff44c0a14d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff460035000 tx=0x7ff460030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:22.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.646+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff458093b10 con 0x7ff47018b4a0 2024-02-21T07:45:22.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.840+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff470067c80 con 0x7ff47018b4a0 2024-02-21T07:45:22.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.843+0000 7ff46cc00640 1 -- 172.21.15.100:0/2719069372 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17908 (secure 0 0 0) 0x7ff4580971d0 con 0x7ff47018b4a0 2024-02-21T07:45:22.849 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":20,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:22.191040+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:22.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.845+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 msgr2=0x7ff44c0a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.845+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 0x7ff44c0a14d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff460035000 tx=0x7ff460030000 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.845+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 msgr2=0x7ff47021c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.845+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff45800e9b0 tx=0x7ff45800ee70 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 shutdown_connections 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff470172840 0x7ff47021cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff44c09f010 0x7ff44c0a14d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff47018b4a0 0x7ff47021c640 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 --2- 172.21.15.100:0/2719069372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff470186050 0x7ff470172300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:22.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 >> 172.21.15.100:0/2719069372 conn(0x7ff4700d2540 msgr2=0x7ff470188a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:22.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 shutdown_connections 2024-02-21T07:45:22.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:22.846+0000 7ff476e00640 1 -- 172.21.15.100:0/2719069372 wait complete. 2024-02-21T07:45:22.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T07:45:22.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:23.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.059+0000 7f3780e00640 1 Processor -- start 2024-02-21T07:45:23.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.060+0000 7f3780e00640 1 -- start start 2024-02-21T07:45:23.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3780e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f377c186300 0x7f377c18a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3780e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c06bd00 con 0x7f377c0d6810 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3780e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c06bfe0 con 0x7f377c185f20 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3780e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c06d080 con 0x7f377c186300 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3773e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f377c186300 0x7f377c18a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3779e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f377c185f20 0x7f377c189eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:60712/0 (socket says 172.21.15.100:60712) 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3779e00640 1 -- 172.21.15.100:0/589677221 learned_addr learned my addr 172.21.15.100:0/589677221 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:23.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f377a800640 1 --1- 172.21.15.100:0/589677221 >> v1:172.21.15.156:6789/0 conn(0x7f377c0d6810 0x7f377c1889c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50688/0 (socket says 172.21.15.100:50688) 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3773e00640 1 -- 172.21.15.100:0/589677221 >> v1:172.21.15.170:6789/0 conn(0x7f377c185f20 legacy=0x7f377c189eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3773e00640 1 -- 172.21.15.100:0/589677221 >> v1:172.21.15.156:6789/0 conn(0x7f377c0d6810 legacy=0x7f377c1889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3773e00640 1 -- 172.21.15.100:0/589677221 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c06c2c0 con 0x7f377c186300 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.062+0000 7f3779400640 1 -- 172.21.15.100:0/589677221 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203244151 0 0) 0x7f377c06bfe0 con 0x7f377c185f20 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.063+0000 7f3773e00640 1 --2- 172.21.15.100:0/589677221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c18a5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37640097a0 tx=0x7f376402b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63722444a78f378d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3779400640 1 -- 172.21.15.100:0/589677221 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764030710 con 0x7f377c186300 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3779400640 1 -- 172.21.15.100:0/589677221 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376402e050 con 0x7f377c186300 2024-02-21T07:45:23.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3779400640 1 -- 172.21.15.100:0/589677221 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3764030a90 con 0x7f377c186300 2024-02-21T07:45:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3780e00640 1 -- 172.21.15.100:0/589677221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 msgr2=0x7f377c18a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3780e00640 1 --2- 172.21.15.100:0/589677221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c18a5c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37640097a0 tx=0x7f376402b680 comp rx=0 tx=0).stop 2024-02-21T07:45:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3780e00640 1 -- 172.21.15.100:0/589677221 shutdown_connections 2024-02-21T07:45:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3780e00640 1 --2- 172.21.15.100:0/589677221 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c18a5c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.064+0000 7f3780e00640 1 -- 172.21.15.100:0/589677221 >> 172.21.15.100:0/589677221 conn(0x7f377c0fe270 msgr2=0x7f377c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.065+0000 7f3780e00640 1 -- 172.21.15.100:0/589677221 shutdown_connections 2024-02-21T07:45:23.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.065+0000 7f3780e00640 1 -- 172.21.15.100:0/589677221 wait complete. 2024-02-21T07:45:23.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.066+0000 7f3780e00640 1 Processor -- start 2024-02-21T07:45:23.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.067+0000 7f3780e00640 1 -- start start 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c1634f0 con 0x7f377c185f20 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c21f550 con 0x7f377c0d6810 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3780e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c162c00 con 0x7f377c186300 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3773e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3779e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3773e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50430/0 (socket says 172.21.15.100:50430) 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3773e00640 1 -- 172.21.15.100:0/2739200353 learned_addr learned my addr 172.21.15.100:0/2739200353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3779e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42506/0 (socket says 172.21.15.100:42506) 2024-02-21T07:45:23.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f377a800640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.068+0000 7f3779e00640 1 -- 172.21.15.100:0/2739200353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 msgr2=0x7f377c158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3779e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3779e00640 1 -- 172.21.15.100:0/2739200353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 msgr2=0x7f377c184c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3779e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3779e00640 1 -- 172.21.15.100:0/2739200353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009400 con 0x7f377c0d6810 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3773e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3779e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c3e0 tx=0x7f376c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0074e0 con 0x7f377c0d6810 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c007640 con 0x7f377c0d6810 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c163980 con 0x7f377c0d6810 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c004a20 con 0x7f377c0d6810 2024-02-21T07:45:23.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.069+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c162ea0 con 0x7f377c0d6810 2024-02-21T07:45:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.070+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c0d5440 con 0x7f377c0d6810 2024-02-21T07:45:23.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.072+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f376c004b80 con 0x7f377c0d6810 2024-02-21T07:45:23.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.073+0000 7f3772000640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 0x7f37580a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.073+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f376c0c9110 con 0x7f377c0d6810 2024-02-21T07:45:23.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.073+0000 7f3773e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 0x7f37580a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.074+0000 7f3773e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 0x7f37580a1590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f377c0f5270 tx=0x7f3764008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.077+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f376c093630 con 0x7f377c0d6810 2024-02-21T07:45:23.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.264+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f377c180440 con 0x7f377c0d6810 2024-02-21T07:45:23.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.265+0000 7f3772000640 1 -- 172.21.15.100:0/2739200353 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f376c096cf0 con 0x7f377c0d6810 2024-02-21T07:45:23.271 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 msgr2=0x7f37580a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 0x7f37580a1590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f377c0f5270 tx=0x7f3764008030 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 msgr2=0x7f377c0cf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c3e0 tx=0x7f376c00c8a0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 shutdown_connections 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f377c186300 0x7f377c158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f375809f0d0 0x7f37580a1590 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f377c185f20 0x7f377c184c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 --2- 172.21.15.100:0/2739200353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f377c0d6810 0x7f377c0cf8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 >> 172.21.15.100:0/2739200353 conn(0x7f377c0fe270 msgr2=0x7f377c164360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 shutdown_connections 2024-02-21T07:45:23.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.268+0000 7f3780e00640 1 -- 172.21.15.100:0/2739200353 wait complete. 2024-02-21T07:45:23.290 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-21T07:45:23.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.477+0000 7fc407400640 1 Processor -- start 2024-02-21T07:45:23.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.478+0000 7fc407400640 1 -- start start 2024-02-21T07:45:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.479+0000 7fc407400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc40018bf30 0x7fc400164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.479+0000 7fc407400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4000fc110 0x7fc40018c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.479+0000 7fc407400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40006bea0 con 0x7fc40018c850 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc407400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40006bb70 con 0x7fc4000fc110 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc407400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000fc6d0 con 0x7fc40018bf30 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4000fc110 0x7fc40018c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc4000fc110 0x7fc40018c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42522/0 (socket says 172.21.15.100:42522) 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 -- 172.21.15.100:0/936847653 learned_addr learned my addr 172.21.15.100:0/936847653 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:23.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc404a00640 1 --2- 172.21.15.100:0/936847653 >> v2:172.21.15.170:3300/0 conn(0x7fc40018bf30 0x7fc400164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 -- 172.21.15.100:0/936847653 >> v2:172.21.15.170:3300/0 conn(0x7fc40018bf30 msgr2=0x7fc400164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 --2- 172.21.15.100:0/936847653 >> v2:172.21.15.170:3300/0 conn(0x7fc40018bf30 0x7fc400164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 -- 172.21.15.100:0/936847653 >> v1:172.21.15.100:6789/0 conn(0x7fc40018c850 legacy=0x7fc40006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.480+0000 7fc3f7e00640 1 -- 172.21.15.100:0/936847653 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000fc9b0 con 0x7fc4000fc110 2024-02-21T07:45:23.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.481+0000 7fc3f7e00640 1 --2- 172.21.15.100:0/936847653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc40018c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc4000fd4d0 tx=0x7fc3f002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26a15b1a3c434e70 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc3ffe00640 1 -- 172.21.15.100:0/936847653 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0030860 con 0x7fc4000fc110 2024-02-21T07:45:23.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc3ffe00640 1 -- 172.21.15.100:0/936847653 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f00309c0 con 0x7fc4000fc110 2024-02-21T07:45:23.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc3ffe00640 1 -- 172.21.15.100:0/936847653 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0030d50 con 0x7fc4000fc110 2024-02-21T07:45:23.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 -- 172.21.15.100:0/936847653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 msgr2=0x7fc40018c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 --2- 172.21.15.100:0/936847653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc40018c310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc4000fd4d0 tx=0x7fc3f002b9a0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 -- 172.21.15.100:0/936847653 shutdown_connections 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 --2- 172.21.15.100:0/936847653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc40018c310 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 --2- 172.21.15.100:0/936847653 >> v2:172.21.15.170:3300/0 conn(0x7fc40018bf30 0x7fc400164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 -- 172.21.15.100:0/936847653 >> 172.21.15.100:0/936847653 conn(0x7fc4000fe210 msgr2=0x7fc4000fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 -- 172.21.15.100:0/936847653 shutdown_connections 2024-02-21T07:45:23.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.482+0000 7fc407400640 1 -- 172.21.15.100:0/936847653 wait complete. 2024-02-21T07:45:23.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.484+0000 7fc407400640 1 Processor -- start 2024-02-21T07:45:23.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.484+0000 7fc407400640 1 -- start start 2024-02-21T07:45:23.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40018bf30 0x7fc400174b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40018c850 0x7fc400175080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc400175970 con 0x7fc40018bf30 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40015e930 con 0x7fc4000fc110 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.485+0000 7fc407400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40015eb80 con 0x7fc40018c850 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc3f7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40018bf30 0x7fc400174b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc405400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40018c850 0x7fc400175080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42536/0 (socket says 172.21.15.100:42536) 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 -- 172.21.15.100:0/4159934317 learned_addr learned my addr 172.21.15.100:0/4159934317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 -- 172.21.15.100:0/4159934317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40018c850 msgr2=0x7fc400175080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40018c850 0x7fc400175080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 -- 172.21.15.100:0/4159934317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40018bf30 msgr2=0x7fc400174b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40018bf30 0x7fc400174b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 -- 172.21.15.100:0/4159934317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f00094d0 con 0x7fc4000fc110 2024-02-21T07:45:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.486+0000 7fc404a00640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800e870 tx=0x7fc3e800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.487+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80094f0 con 0x7fc4000fc110 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.487+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800c940 con 0x7fc4000fc110 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.487+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800ccf0 con 0x7fc4000fc110 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.487+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40015ee60 con 0x7fc4000fc110 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.487+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40015f420 con 0x7fc4000fc110 2024-02-21T07:45:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.488+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400067c80 con 0x7fc4000fc110 2024-02-21T07:45:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.489+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc3e8013470 con 0x7fc4000fc110 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.491+0000 7fc3fd600640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 0x7fc3dc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.491+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fc3e80c9480 con 0x7fc4000fc110 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.491+0000 7fc3f7e00640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 0x7fc3dc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.491+0000 7fc3f7e00640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 0x7fc3dc0a1560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0036000 tx=0x7fc3f0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.495+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3e8093a50 con 0x7fc4000fc110 2024-02-21T07:45:23.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.691+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4000cd350 con 0x7fc4000fc110 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.691+0000 7fc3fd600640 1 -- 172.21.15.100:0/4159934317 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc3e8097110 con 0x7fc4000fc110 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-02-21T07:45:23.697 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-02-21T07:45:23.698 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:45:23.698 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 msgr2=0x7fc3dc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 0x7fc3dc0a1560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0036000 tx=0x7fc3f0008030 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 msgr2=0x7fc4000d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800e870 tx=0x7fc3e800ed30 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 shutdown_connections 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc40018c850 0x7fc400175080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc3dc09f0a0 0x7fc3dc0a1560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc40018bf30 0x7fc400174b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 --2- 172.21.15.100:0/4159934317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4000fc110 0x7fc4000d0210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 >> 172.21.15.100:0/4159934317 conn(0x7fc4000fe210 msgr2=0x7fc4001807b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 shutdown_connections 2024-02-21T07:45:23.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.694+0000 7fc407400640 1 -- 172.21.15.100:0/4159934317 wait complete. 2024-02-21T07:45:23.717 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-21T07:45:23.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-21T07:45:23.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.922+0000 7f4801a00640 1 Processor -- start 2024-02-21T07:45:23.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.922+0000 7f4801a00640 1 -- start start 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f4801a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47fc0cbdd0 0x7f47fc0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f4801a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0cc250 con 0x7f47fc180460 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f4801a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc0cc530 con 0x7f47fc180840 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f4801a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc188250 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f47fbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f47fc180460 0x7f47fc187b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40056/0 (socket says 172.21.15.100:40056) 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.924+0000 7f47fbe00640 1 -- 172.21.15.100:0/1475805559 learned_addr learned my addr 172.21.15.100:0/1475805559 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:23.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47fb400640 1 --2- 172.21.15.100:0/1475805559 >> v2:172.21.15.156:3300/0 conn(0x7f47fc0cbdd0 0x7f47fc0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152546038 0 0) 0x7f47fc0cc250 con 0x7f47fc180460 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e0003520 con 0x7f47fc180460 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738546332 0 0) 0x7f47fc0cc530 con 0x7f47fc180840 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47fc0cc250 con 0x7f47fc180840 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47fb400640 1 -- 172.21.15.100:0/1475805559 >> v1:172.21.15.156:6789/0 conn(0x7f47fc180840 legacy=0x7f47fc06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47fb400640 1 -- 172.21.15.100:0/1475805559 >> v1:172.21.15.100:6789/0 conn(0x7f47fc180460 legacy=0x7f47fc187b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.925+0000 7f47fb400640 1 -- 172.21.15.100:0/1475805559 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0cc810 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.926+0000 7f47fb400640 1 --2- 172.21.15.100:0/1475805559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc0cd5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aaa98ec2192ade0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e802e070 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e80315a0 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f47faa00640 1 -- 172.21.15.100:0/1475805559 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8031930 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 -- 172.21.15.100:0/1475805559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc0cbdd0 msgr2=0x7f47fc0cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 --2- 172.21.15.100:0/1475805559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc0cd5d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f47e80097a0 tx=0x7f47e802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 -- 172.21.15.100:0/1475805559 shutdown_connections 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 --2- 172.21.15.100:0/1475805559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc0cd5d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 -- 172.21.15.100:0/1475805559 >> 172.21.15.100:0/1475805559 conn(0x7f47fc0f6580 msgr2=0x7f47fc0f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 -- 172.21.15.100:0/1475805559 shutdown_connections 2024-02-21T07:45:23.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.927+0000 7f4801a00640 1 -- 172.21.15.100:0/1475805559 wait complete. 2024-02-21T07:45:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.929+0000 7f4801a00640 1 Processor -- start 2024-02-21T07:45:23.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.929+0000 7f4801a00640 1 -- start start 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 0x7f47fc16bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47fc180840 0x7f47fc0f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0f5460 con 0x7f47fc0cbdd0 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc17dc80 con 0x7f47fc180460 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc0f4b50 con 0x7f47fc180840 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 0x7f47fc16bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50446/0 (socket says 172.21.15.100:50446) 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fbe00640 1 -- 172.21.15.100:0/1323234039 learned_addr learned my addr 172.21.15.100:0/1323234039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f4801000640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47fc180840 0x7f47fc0f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 -- 172.21.15.100:0/1323234039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47fc180840 msgr2=0x7f47fc0f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47fc180840 0x7f47fc0f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 -- 172.21.15.100:0/1323234039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 msgr2=0x7f47fc16cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fb400640 1 -- 172.21.15.100:0/1323234039 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e8009400 con 0x7f47fc180460 2024-02-21T07:45:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.931+0000 7f47fbe00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f47fb400640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 0x7f47fc16bfb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47e8033000 tx=0x7f47e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8032840 con 0x7f47fc180460 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e80329c0 con 0x7f47fc180460 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8032d70 con 0x7f47fc180460 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc0c9cb0 con 0x7f47fc180460 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.932+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc0f4da0 con 0x7f47fc180460 2024-02-21T07:45:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.933+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc0f55a0 con 0x7f47fc180460 2024-02-21T07:45:23.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.935+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f47e804e430 con 0x7f47fc180460 2024-02-21T07:45:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.936+0000 7f47f3e00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 0x7f47dc0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.937+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f47e80eb390 con 0x7f47fc180460 2024-02-21T07:45:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.937+0000 7f47fbe00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 0x7f47dc0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.937+0000 7f47fbe00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 0x7f47dc0a1590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47ec000f60 tx=0x7f47ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:23.938+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f47e80b5940 con 0x7f47fc180460 2024-02-21T07:45:24.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.137+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f47fc0f55a0 con 0x7f47fc180460 2024-02-21T07:45:24.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.210+0000 7f47f3e00640 1 -- 172.21.15.100:0/1323234039 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f47fc0f55a0 con 0x7f47fc180460 2024-02-21T07:45:24.218 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-02-21T07:45:24.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 msgr2=0x7f47dc0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 0x7f47dc0a1590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47ec000f60 tx=0x7f47ec009040 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 msgr2=0x7f47fc16bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 0x7f47fc16bfb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47e8033000 tx=0x7f47e80046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 shutdown_connections 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47fc180840 0x7f47fc0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47fc180460 0x7f47fc16bfb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f47dc09f0d0 0x7f47dc0a1590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 --2- 172.21.15.100:0/1323234039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47fc0cbdd0 0x7f47fc16cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.215+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 >> 172.21.15.100:0/1323234039 conn(0x7f47fc0f6580 msgr2=0x7f47fc187a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.216+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 shutdown_connections 2024-02-21T07:45:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.216+0000 7f4801a00640 1 -- 172.21.15.100:0/1323234039 wait complete. 2024-02-21T07:45:24.244 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-21T07:45:24.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.434+0000 7f1bf5a00640 1 Processor -- start 2024-02-21T07:45:24.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.434+0000 7f1bf5a00640 1 -- start start 2024-02-21T07:45:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.436+0000 7f1bf5a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1bf0189ca0 0x7f1bf006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.436+0000 7f1bf5a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00ca6a0 con 0x7f1bf018a080 2024-02-21T07:45:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.436+0000 7f1bf5a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf00f6200 con 0x7f1bf01871c0 2024-02-21T07:45:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.436+0000 7f1bf5a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf018abe0 con 0x7f1bf0189ca0 2024-02-21T07:45:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1bef400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1bf018a080 0x7f1bf018a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40068/0 (socket says 172.21.15.100:40068) 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1bef400640 1 -- 172.21.15.100:0/3093951714 learned_addr learned my addr 172.21.15.100:0/3093951714 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1beea00640 1 --2- 172.21.15.100:0/3093951714 >> v2:172.21.15.170:3300/0 conn(0x7f1bf0189ca0 0x7f1bf006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1beea00640 1 -- 172.21.15.100:0/3093951714 >> v1:172.21.15.170:6789/0 conn(0x7f1bf01871c0 legacy=0x7f1bf00cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1beea00640 1 -- 172.21.15.100:0/3093951714 >> v1:172.21.15.100:6789/0 conn(0x7f1bf018a080 legacy=0x7f1bf018a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1beea00640 1 -- 172.21.15.100:0/3093951714 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00f6450 con 0x7f1bf0189ca0 2024-02-21T07:45:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.437+0000 7f1bed600640 1 -- 172.21.15.100:0/3093951714 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663516255 0 0) 0x7f1bf00ca6a0 con 0x7f1bf018a080 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.438+0000 7f1beea00640 1 --2- 172.21.15.100:0/3093951714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf0189ca0 0x7f1bf006ab60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1be00097a0 tx=0x7f1be002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f165b02cd08fbdc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.438+0000 7f1bed600640 1 -- 172.21.15.100:0/3093951714 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0030610 con 0x7f1bf0189ca0 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bed600640 1 -- 172.21.15.100:0/3093951714 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0030770 con 0x7f1bf0189ca0 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bed600640 1 -- 172.21.15.100:0/3093951714 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0030b00 con 0x7f1bf0189ca0 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 -- 172.21.15.100:0/3093951714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf0189ca0 msgr2=0x7f1bf006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/3093951714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf0189ca0 0x7f1bf006ab60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1be00097a0 tx=0x7f1be002b960 comp rx=0 tx=0).stop 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 -- 172.21.15.100:0/3093951714 shutdown_connections 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/3093951714 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf0189ca0 0x7f1bf006ab60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 -- 172.21.15.100:0/3093951714 >> 172.21.15.100:0/3093951714 conn(0x7f1bf00668b0 msgr2=0x7f1bf0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 -- 172.21.15.100:0/3093951714 shutdown_connections 2024-02-21T07:45:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.439+0000 7f1bf5a00640 1 -- 172.21.15.100:0/3093951714 wait complete. 2024-02-21T07:45:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.441+0000 7f1bf5a00640 1 Processor -- start 2024-02-21T07:45:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.441+0000 7f1bf5a00640 1 -- start start 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.442+0000 7f1bf5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bf5a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf0189ca0 0x7f1bf0071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bf5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bf018a080 0x7f1bf0175110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bf5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0072a90 con 0x7f1bf018a080 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bf5a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0071ba0 con 0x7f1bf0189ca0 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bf5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0071e80 con 0x7f1bf01871c0 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bef400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bf018a080 0x7f1bf0175110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41262/0 (socket says 172.21.15.100:41262) 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1bee000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf0189ca0 0x7f1bf0071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 -- 172.21.15.100:0/909691340 learned_addr learned my addr 172.21.15.100:0/909691340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 -- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf0189ca0 msgr2=0x7f1bf0071550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf0189ca0 0x7f1bf0071550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 -- 172.21.15.100:0/909691340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bf018a080 msgr2=0x7f1bf0175110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bf018a080 0x7f1bf0175110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.443+0000 7f1beea00640 1 -- 172.21.15.100:0/909691340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0009400 con 0x7f1bf01871c0 2024-02-21T07:45:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1beea00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1be00098c0 tx=0x7f1be0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be003e040 con 0x7f1bf01871c0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0039cb0 con 0x7f1bf01871c0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0044630 con 0x7f1bf01871c0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf0072160 con 0x7f1bf01871c0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.444+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf0072720 con 0x7f1bf01871c0 2024-02-21T07:45:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.445+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf008e1c0 con 0x7f1bf01871c0 2024-02-21T07:45:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.447+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1be0044790 con 0x7f1bf01871c0 2024-02-21T07:45:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.448+0000 7f1be6a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 0x7f1bd00a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.448+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f1be0071e40 con 0x7f1bf01871c0 2024-02-21T07:45:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.449+0000 7f1bee000640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 0x7f1bd00a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.449+0000 7f1bee000640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 0x7f1bd00a15e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0067670 tx=0x7f1bdc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.451+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1be00b6030 con 0x7f1bf01871c0 2024-02-21T07:45:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:24.646+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f1bf00728b0 con 0x7f1bf01871c0 2024-02-21T07:45:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.216+0000 7f1be6a00640 1 -- 172.21.15.100:0/909691340 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f1be00b7f60 con 0x7f1bf01871c0 2024-02-21T07:45:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.222+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 msgr2=0x7f1bd00a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.222+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 0x7f1bd00a15e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0067670 tx=0x7f1bdc009040 comp rx=0 tx=0).stop 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.222+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 msgr2=0x7f1bf0071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.222+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1be00098c0 tx=0x7f1be0004730 comp rx=0 tx=0).stop 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 shutdown_connections 2024-02-21T07:45:25.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1bd009f120 0x7f1bd00a15e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bf018a080 0x7f1bf0175110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1bf0189ca0 0x7f1bf0071550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 --2- 172.21.15.100:0/909691340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1bf01871c0 0x7f1bf0071010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.223+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 >> 172.21.15.100:0/909691340 conn(0x7f1bf00668b0 msgr2=0x7f1bf00ed0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.225+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 shutdown_connections 2024-02-21T07:45:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.225+0000 7f1bf5a00640 1 -- 172.21.15.100:0/909691340 wait complete. 2024-02-21T07:45:25.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-21T07:45:25.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.441+0000 7f68d7200640 1 Processor -- start 2024-02-21T07:45:25.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.441+0000 7f68d7200640 1 -- start start 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f68d817d0b0 0x7f68d80cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68d80cb630 0x7f68d80f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f68d80f94b0 0x7f68d806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d817d490 con 0x7f68d80f94b0 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80cac60 con 0x7f68d80cb630 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.443+0000 7f68d7200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80cba90 con 0x7f68d817d0b0 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f68d80f94b0 0x7f68d806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d5e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f68d817d0b0 0x7f68d80cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f68d80f94b0 0x7f68d806d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50464/0 (socket says 172.21.15.100:50464) 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 -- 172.21.15.100:0/2423783435 learned_addr learned my addr 172.21.15.100:0/2423783435 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68cd400640 1 --2- 172.21.15.100:0/2423783435 >> v2:172.21.15.156:3300/0 conn(0x7f68d80cb630 0x7f68d80f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 -- 172.21.15.100:0/2423783435 >> v2:172.21.15.170:3300/0 conn(0x7f68d817d0b0 msgr2=0x7f68d80cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 --2- 172.21.15.100:0/2423783435 >> v2:172.21.15.170:3300/0 conn(0x7f68d817d0b0 0x7f68d80cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 -- 172.21.15.100:0/2423783435 >> v2:172.21.15.156:3300/0 conn(0x7f68d80cb630 msgr2=0x7f68d80f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 --2- 172.21.15.100:0/2423783435 >> v2:172.21.15.156:3300/0 conn(0x7f68d80cb630 0x7f68d80f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.444+0000 7f68d6800640 1 -- 172.21.15.100:0/2423783435 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d806e830 con 0x7f68d80f94b0 2024-02-21T07:45:25.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.445+0000 7f68d6800640 1 --2- 172.21.15.100:0/2423783435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80f94b0 0x7f68d806d950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68d80f0d00 tx=0x7f68d002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6dd7b78326a2b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.446+0000 7f68d5400640 1 -- 172.21.15.100:0/2423783435 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d002caa0 con 0x7f68d80f94b0 2024-02-21T07:45:25.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.446+0000 7f68d5400640 1 -- 172.21.15.100:0/2423783435 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d002cc00 con 0x7f68d80f94b0 2024-02-21T07:45:25.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.446+0000 7f68d5400640 1 -- 172.21.15.100:0/2423783435 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00343f0 con 0x7f68d80f94b0 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 -- 172.21.15.100:0/2423783435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80f94b0 msgr2=0x7f68d806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 --2- 172.21.15.100:0/2423783435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80f94b0 0x7f68d806d950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68d80f0d00 tx=0x7f68d002bf00 comp rx=0 tx=0).stop 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 -- 172.21.15.100:0/2423783435 shutdown_connections 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 --2- 172.21.15.100:0/2423783435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80f94b0 0x7f68d806d950 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 --2- 172.21.15.100:0/2423783435 >> v2:172.21.15.156:3300/0 conn(0x7f68d80cb630 0x7f68d80f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 --2- 172.21.15.100:0/2423783435 >> v2:172.21.15.170:3300/0 conn(0x7f68d817d0b0 0x7f68d80cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 -- 172.21.15.100:0/2423783435 >> 172.21.15.100:0/2423783435 conn(0x7f68d80ce150 msgr2=0x7f68d80ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 -- 172.21.15.100:0/2423783435 shutdown_connections 2024-02-21T07:45:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.447+0000 7f68d7200640 1 -- 172.21.15.100:0/2423783435 wait complete. 2024-02-21T07:45:25.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.449+0000 7f68d7200640 1 Processor -- start 2024-02-21T07:45:25.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.449+0000 7f68d7200640 1 -- start start 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.450+0000 7f68d7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 0x7f68d8220ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d7200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d817d0b0 0x7f68d82210e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8220710 con 0x7f68d80cb630 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d7200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d821fb00 con 0x7f68d817d0b0 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d821fde0 con 0x7f68d80f94b0 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50466/0 (socket says 172.21.15.100:50466) 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d5e00640 1 -- 172.21.15.100:0/2672488047 learned_addr learned my addr 172.21.15.100:0/2672488047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 0x7f68d8220ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d6800640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d817d0b0 0x7f68d82210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 -- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d817d0b0 msgr2=0x7f68d82210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d817d0b0 0x7f68d82210e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 -- 172.21.15.100:0/2672488047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 msgr2=0x7f68d81731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68cd400640 1 -- 172.21.15.100:0/2672488047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009b30 con 0x7f68d80f94b0 2024-02-21T07:45:25.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.451+0000 7f68d5e00640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68cd400640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 0x7f68d8220ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68c000e660 tx=0x7f68c000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000c730 con 0x7f68d80f94b0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c000c890 con 0x7f68d80f94b0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d82200c0 con 0x7f68d80f94b0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000cc00 con 0x7f68d80f94b0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.452+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d80ef550 con 0x7f68d80f94b0 2024-02-21T07:45:25.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.453+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d8220880 con 0x7f68d80f94b0 2024-02-21T07:45:25.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.455+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f68c0013470 con 0x7f68d80f94b0 2024-02-21T07:45:25.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.456+0000 7f68cea00640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 0x7f68b40a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.457+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7449+0+0 (secure 0 0 0) 0x7f68c00c9790 con 0x7f68d80f94b0 2024-02-21T07:45:25.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.457+0000 7f68d5e00640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 0x7f68b40a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.457+0000 7f68d5e00640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 0x7f68b40a14e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009f50 tx=0x7f68c8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.461+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68c0093950 con 0x7f68d80f94b0 2024-02-21T07:45:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:25.696+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f68d821ff20 con 0x7f68d80f94b0 2024-02-21T07:45:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.270+0000 7f68cea00640 1 -- 172.21.15.100:0/2672488047 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f68d821ff20 con 0x7f68d80f94b0 2024-02-21T07:45:26.276 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-02-21T07:45:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.274+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 msgr2=0x7f68b40a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.274+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 0x7f68b40a14e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009f50 tx=0x7f68c8009190 comp rx=0 tx=0).stop 2024-02-21T07:45:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.274+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 msgr2=0x7f68d8220ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.274+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 0x7f68d8220ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68c000e660 tx=0x7f68c000eb20 comp rx=0 tx=0).stop 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 shutdown_connections 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68d817d0b0 0x7f68d82210e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68d80f94b0 0x7f68d8220ba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68b409f020 0x7f68b40a14e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 --2- 172.21.15.100:0/2672488047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68d80cb630 0x7f68d81731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.277+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 >> 172.21.15.100:0/2672488047 conn(0x7f68d80ce150 msgr2=0x7f68d817bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.279+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 shutdown_connections 2024-02-21T07:45:26.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.279+0000 7f68d7200640 1 -- 172.21.15.100:0/2672488047 wait complete. 2024-02-21T07:45:26.308 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-21T07:45:26.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-21T07:45:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.486+0000 7fe884c00640 1 Processor -- start 2024-02-21T07:45:26.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.486+0000 7fe884c00640 1 -- start start 2024-02-21T07:45:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.488+0000 7fe884c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe880182950 0x7fe88006bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.488+0000 7fe884c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800d5c90 con 0x7fe88006c270 2024-02-21T07:45:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.488+0000 7fe884c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe880182e00 con 0x7fe880182570 2024-02-21T07:45:26.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.488+0000 7fe884c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88006c6e0 con 0x7fe880182950 2024-02-21T07:45:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87d400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe880182950 0x7fe88006bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe88006c270 0x7fe88018bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40076/0 (socket says 172.21.15.100:40076) 2024-02-21T07:45:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87de00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe880182570 0x7fe8801891a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:60738/0 (socket says 172.21.15.100:60738) 2024-02-21T07:45:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87e800640 1 -- 172.21.15.100:0/524141750 learned_addr learned my addr 172.21.15.100:0/524141750 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:26.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512875110 0 0) 0x7fe880182e00 con 0x7fe880182570 2024-02-21T07:45:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe864003520 con 0x7fe880182570 2024-02-21T07:45:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1768470631 0 0) 0x7fe8800d5c90 con 0x7fe88006c270 2024-02-21T07:45:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87d400640 1 -- 172.21.15.100:0/524141750 >> v1:172.21.15.170:6789/0 conn(0x7fe880182570 legacy=0x7fe8801891a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87d400640 1 -- 172.21.15.100:0/524141750 >> v1:172.21.15.100:6789/0 conn(0x7fe88006c270 legacy=0x7fe88018bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.489+0000 7fe87d400640 1 -- 172.21.15.100:0/524141750 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8801898b0 con 0x7fe880182950 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe87d400640 1 --2- 172.21.15.100:0/524141750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182950 0x7fe88006bd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8680097a0 tx=0x7fe86802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a635e4f9a11243 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86802e070 con 0x7fe880182950 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8680315a0 con 0x7fe880182950 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe87ca00640 1 -- 172.21.15.100:0/524141750 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868031930 con 0x7fe880182950 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe884c00640 1 -- 172.21.15.100:0/524141750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182950 msgr2=0x7fe88006bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe884c00640 1 --2- 172.21.15.100:0/524141750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182950 0x7fe88006bd30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8680097a0 tx=0x7fe86802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe884c00640 1 -- 172.21.15.100:0/524141750 shutdown_connections 2024-02-21T07:45:26.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe884c00640 1 --2- 172.21.15.100:0/524141750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182950 0x7fe88006bd30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.491+0000 7fe884c00640 1 -- 172.21.15.100:0/524141750 >> 172.21.15.100:0/524141750 conn(0x7fe8800d26f0 msgr2=0x7fe8800d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:26.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.492+0000 7fe884c00640 1 -- 172.21.15.100:0/524141750 shutdown_connections 2024-02-21T07:45:26.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.492+0000 7fe884c00640 1 -- 172.21.15.100:0/524141750 wait complete. 2024-02-21T07:45:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.493+0000 7fe884c00640 1 Processor -- start 2024-02-21T07:45:26.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.494+0000 7fe884c00640 1 -- start start 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe88006c270 0x7fe88021f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182570 0x7fe880167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88021ff60 con 0x7fe880182950 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880220240 con 0x7fe88006c270 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe884c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe880220520 con 0x7fe880182570 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe87e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe87de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe88006c270 0x7fe88021f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe87e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50468/0 (socket says 172.21.15.100:50468) 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe87d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182570 0x7fe880167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.495+0000 7fe87e800640 1 -- 172.21.15.100:0/2376388119 learned_addr learned my addr 172.21.15.100:0/2376388119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 -- 172.21.15.100:0/2376388119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182570 msgr2=0x7fe880167c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182570 0x7fe880167c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 -- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe88006c270 msgr2=0x7fe88021f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe88006c270 0x7fe88021f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 -- 172.21.15.100:0/2376388119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009400 con 0x7fe880182950 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe87e800640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800ce30 con 0x7fe880182950 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87800a640 con 0x7fe880182950 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800a9f0 con 0x7fe880182950 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe880220800 con 0x7fe880182950 2024-02-21T07:45:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.496+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe880220dc0 con 0x7fe880182950 2024-02-21T07:45:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.497+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880178ed0 con 0x7fe880182950 2024-02-21T07:45:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.500+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe87800ab50 con 0x7fe880182950 2024-02-21T07:45:26.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.501+0000 7fe876000640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 0x7fe85c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:26.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.501+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7549+0+0 (secure 0 0 0) 0x7fe8780c8f00 con 0x7fe880182950 2024-02-21T07:45:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.501+0000 7fe87de00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 0x7fe85c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:26.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.502+0000 7fe87de00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 0x7fe85c0a1560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe870000f60 tx=0x7fe870007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:26.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.504+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe878093060 con 0x7fe880182950 2024-02-21T07:45:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:26.703+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe880220fb0 con 0x7fe880182950 2024-02-21T07:45:27.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.246+0000 7fe876000640 1 -- 172.21.15.100:0/2376388119 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe878018020 con 0x7fe880182950 2024-02-21T07:45:27.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.251+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 msgr2=0x7fe85c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.251+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 0x7fe85c0a1560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe870000f60 tx=0x7fe870007cf0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 msgr2=0x7fe8801681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c780 tx=0x7fe87800cc40 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 shutdown_connections 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe85c09f0a0 0x7fe85c0a1560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880182950 0x7fe8801681b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe880182570 0x7fe880167c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 --2- 172.21.15.100:0/2376388119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe88006c270 0x7fe88021f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 >> 172.21.15.100:0/2376388119 conn(0x7fe8800d26f0 msgr2=0x7fe8800d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.252+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 shutdown_connections 2024-02-21T07:45:27.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.253+0000 7fe884c00640 1 -- 172.21.15.100:0/2376388119 wait complete. 2024-02-21T07:45:27.279 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-21T07:45:27.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.485+0000 7efe5a200640 1 Processor -- start 2024-02-21T07:45:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.485+0000 7efe5a200640 1 -- start start 2024-02-21T07:45:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.487+0000 7efe5a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efe5418a4f0 0x7efe54187900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.487+0000 7efe5a200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540f69b0 con 0x7efe540f5470 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.487+0000 7efe5a200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540f5ac0 con 0x7efe54189a00 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.487+0000 7efe5a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe540f5da0 con 0x7efe5418a4f0 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.487+0000 7efe53e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efe540f5470 0x7efe54189de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40082/0 (socket says 172.21.15.100:40082) 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53e00640 1 -- 172.21.15.100:0/333863935 learned_addr learned my addr 172.21.15.100:0/333863935 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe59800640 1 --2- 172.21.15.100:0/333863935 >> v2:172.21.15.100:3300/0 conn(0x7efe5418a4f0 0x7efe54187900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642198932 0 0) 0x7efe540f5ac0 con 0x7efe54189a00 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe3c003520 con 0x7efe54189a00 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897064043 0 0) 0x7efe540f69b0 con 0x7efe540f5470 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe540f5ac0 con 0x7efe540f5470 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40977031 0 0) 0x7efe3c003520 con 0x7efe54189a00 2024-02-21T07:45:27.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 >> v2:172.21.15.100:3300/0 conn(0x7efe5418a4f0 msgr2=0x7efe54187900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 --2- 172.21.15.100:0/333863935 >> v2:172.21.15.100:3300/0 conn(0x7efe5418a4f0 0x7efe54187900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 >> v1:172.21.15.100:6789/0 conn(0x7efe540f5470 legacy=0x7efe54189de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540f6080 con 0x7efe54189a00 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7efe48001670 con 0x7efe54189a00 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 >> v1:172.21.15.170:6789/0 conn(0x7efe54189a00 legacy=0x7efe540f6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c003bc0 0x7efe3c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 0x7efe3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe3c005240 0x7efe3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.488+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540f5da0 con 0x7efe3c003bc0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c00c150 con 0x7efe3c005240 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c00c310 con 0x7efe3c0047c0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 0x7efe3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe58e00640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c003bc0 0x7efe3c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe59800640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe3c005240 0x7efe3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 -- 172.21.15.100:0/333863935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe3c005240 msgr2=0x7efe3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe3c005240 0x7efe3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 -- 172.21.15.100:0/333863935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c003bc0 msgr2=0x7efe3c003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c003bc0 0x7efe3c003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe53e00640 1 -- 172.21.15.100:0/333863935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c003520 con 0x7efe3c0047c0 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.489+0000 7efe59800640 1 -- 172.21.15.100:0/333863935 reap_dead start 2024-02-21T07:45:27.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.490+0000 7efe53e00640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 0x7efe3c004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe400019c0 tx=0x7efe3c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2840536690b591 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:27.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.490+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400048a0 con 0x7efe3c0047c0 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.490+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40004a00 con 0x7efe3c0047c0 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.490+0000 7efe53400640 1 -- 172.21.15.100:0/333863935 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40004db0 con 0x7efe3c0047c0 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 -- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 msgr2=0x7efe3c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 0x7efe3c004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe400019c0 tx=0x7efe3c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 -- 172.21.15.100:0/333863935 shutdown_connections 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 --2- 172.21.15.100:0/333863935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe3c0047c0 0x7efe3c004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 -- 172.21.15.100:0/333863935 >> 172.21.15.100:0/333863935 conn(0x7efe5408bfe0 msgr2=0x7efe5408c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 -- 172.21.15.100:0/333863935 shutdown_connections 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.491+0000 7efe5a200640 1 -- 172.21.15.100:0/333863935 wait complete. 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.493+0000 7efe5a200640 1 Processor -- start 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.493+0000 7efe5a200640 1 -- start start 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.494+0000 7efe5a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe5a200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe5416bdb0 0x7efe5421b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe5a200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5421ab50 0x7efe5421afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe5a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540cbc20 con 0x7efe3c0047c0 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe5a200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540cbe90 con 0x7efe5416bdb0 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe5a200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe540cc170 con 0x7efe5421ab50 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50506/0 (socket says 172.21.15.100:50506) 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 -- 172.21.15.100:0/2618828350 learned_addr learned my addr 172.21.15.100:0/2618828350 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe53e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe5416bdb0 0x7efe5421b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe59800640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5421ab50 0x7efe5421afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 -- 172.21.15.100:0/2618828350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5421ab50 msgr2=0x7efe5421afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5421ab50 0x7efe5421afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 -- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe5416bdb0 msgr2=0x7efe5421b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe5416bdb0 0x7efe5421b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.495+0000 7efe58e00640 1 -- 172.21.15.100:0/2618828350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540cc450 con 0x7efe3c0047c0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe58e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe4800f7a0 tx=0x7efe4800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480050d0 con 0x7efe3c0047c0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48005250 con 0x7efe3c0047c0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4800d730 con 0x7efe3c0047c0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe540cc730 con 0x7efe3c0047c0 2024-02-21T07:45:27.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.496+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5421beb0 con 0x7efe3c0047c0 2024-02-21T07:45:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.497+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5421c040 con 0x7efe3c0047c0 2024-02-21T07:45:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.499+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7efe4800d890 con 0x7efe3c0047c0 2024-02-21T07:45:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.500+0000 7efe50c00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 0x7efe340a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.501+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7847+0+0 (secure 0 0 0) 0x7efe480c9920 con 0x7efe3c0047c0 2024-02-21T07:45:27.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.501+0000 7efe53e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 0x7efe340a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:27.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.501+0000 7efe53e00640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 0x7efe340a1560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe40034000 tx=0x7efe4002f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:27.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.504+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe48097460 con 0x7efe3c0047c0 2024-02-21T07:45:27.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:27.698+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe54075160 con 0x7efe3c0047c0 2024-02-21T07:45:29.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.286+0000 7efe50c00640 1 -- 172.21.15.100:0/2618828350 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7efe480957d0 con 0x7efe3c0047c0 2024-02-21T07:45:29.293 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' created 2024-02-21T07:45:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.292+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 msgr2=0x7efe340a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.292+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 0x7efe340a1560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe40034000 tx=0x7efe4002f000 comp rx=0 tx=0).stop 2024-02-21T07:45:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.292+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 msgr2=0x7efe540ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.292+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe4800f7a0 tx=0x7efe4800fc60 comp rx=0 tx=0).stop 2024-02-21T07:45:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 shutdown_connections 2024-02-21T07:45:29.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe5421ab50 0x7efe5421afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efe5416bdb0 0x7efe5421b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efe3409f0a0 0x7efe340a1560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 --2- 172.21.15.100:0/2618828350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe3c0047c0 0x7efe540ccc50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.294+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 >> 172.21.15.100:0/2618828350 conn(0x7efe5408bfe0 msgr2=0x7efe540c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.295+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 shutdown_connections 2024-02-21T07:45:29.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.295+0000 7efe5a200640 1 -- 172.21.15.100:0/2618828350 wait complete. 2024-02-21T07:45:29.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-21T07:45:29.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.504+0000 7f81cdc00640 1 Processor -- start 2024-02-21T07:45:29.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.505+0000 7f81cdc00640 1 -- start start 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81cdc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f81c818bd60 0x7f81c808c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81cdc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c806c540 con 0x7f81c808cc00 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81cdc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c806b6e0 con 0x7f81c80d5970 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81cdc00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c806b9c0 con 0x7f81c818bd60 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81be000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f81c808cc00 0x7f81c806ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40088/0 (socket says 172.21.15.100:40088) 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81be000640 1 -- 172.21.15.100:0/3435290867 learned_addr learned my addr 172.21.15.100:0/3435290867 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.507+0000 7f81c6a00640 1 --2- 172.21.15.100:0/3435290867 >> v2:172.21.15.156:3300/0 conn(0x7f81c818bd60 0x7f81c808c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187526893 0 0) 0x7f81c806c540 con 0x7f81c808cc00 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a8003520 con 0x7f81c808cc00 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18797761 0 0) 0x7f81c806b6e0 con 0x7f81c80d5970 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c806c540 con 0x7f81c80d5970 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6a00640 1 -- 172.21.15.100:0/3435290867 >> v1:172.21.15.170:6789/0 conn(0x7f81c80d5970 legacy=0x7f81c818c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6a00640 1 -- 172.21.15.100:0/3435290867 >> v1:172.21.15.100:6789/0 conn(0x7f81c808cc00 legacy=0x7f81c806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.508+0000 7f81c6a00640 1 -- 172.21.15.100:0/3435290867 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c806bca0 con 0x7f81c818bd60 2024-02-21T07:45:29.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.509+0000 7f81c6a00640 1 --2- 172.21.15.100:0/3435290867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c808c6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81b80097a0 tx=0x7f81b802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fb89067bd406f42 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.509+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b802e070 con 0x7f81c818bd60 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.509+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b80315a0 con 0x7f81c818bd60 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.509+0000 7f81c6000640 1 -- 172.21.15.100:0/3435290867 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8031930 con 0x7f81c818bd60 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 -- 172.21.15.100:0/3435290867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 msgr2=0x7f81c808c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 --2- 172.21.15.100:0/3435290867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c808c6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81b80097a0 tx=0x7f81b802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 -- 172.21.15.100:0/3435290867 shutdown_connections 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 --2- 172.21.15.100:0/3435290867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c808c6c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 -- 172.21.15.100:0/3435290867 >> 172.21.15.100:0/3435290867 conn(0x7f81c80d2860 msgr2=0x7f81c80d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 -- 172.21.15.100:0/3435290867 shutdown_connections 2024-02-21T07:45:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.510+0000 7f81cdc00640 1 -- 172.21.15.100:0/3435290867 wait complete. 2024-02-21T07:45:29.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.512+0000 7f81cdc00640 1 Processor -- start 2024-02-21T07:45:29.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.512+0000 7f81cdc00640 1 -- start start 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c808cc00 0x7f81c8174650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c8183c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8174b90 con 0x7f81c80d5970 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8174db0 con 0x7f81c818bd60 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.513+0000 7f81cdc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8175090 con 0x7f81c808cc00 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50516/0 (socket says 172.21.15.100:50516) 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 -- 172.21.15.100:0/2274421861 learned_addr learned my addr 172.21.15.100:0/2274421861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81c7400640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c8183c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81c6a00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c808cc00 0x7f81c8174650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 -- 172.21.15.100:0/2274421861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c808cc00 msgr2=0x7f81c8174650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c808cc00 0x7f81c8174650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 -- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 msgr2=0x7f81c8183c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c8183c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81be000640 1 -- 172.21.15.100:0/2274421861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8009400 con 0x7f81c80d5970 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.514+0000 7f81c7400640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c8183c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:29.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81be000640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c3c0 tx=0x7f81b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0005ce0 con 0x7f81c80d5970 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b0005e40 con 0x7f81c80d5970 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0007310 con 0x7f81c80d5970 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8175370 con 0x7f81c80d5970 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.515+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8175930 con 0x7f81c80d5970 2024-02-21T07:45:29.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.516+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c80f9160 con 0x7f81c80d5970 2024-02-21T07:45:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.518+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f81b0007470 con 0x7f81c80d5970 2024-02-21T07:45:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.519+0000 7f81bf400640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 0x7f81a40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.520+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8340+0+0 (secure 0 0 0) 0x7f81b00c9360 con 0x7f81c80d5970 2024-02-21T07:45:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.520+0000 7f81c6a00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 0x7f81a40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.521+0000 7f81c6a00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 0x7f81a40a1560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81b8036000 tx=0x7f81b803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.522+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81b00932b0 con 0x7f81c80d5970 2024-02-21T07:45:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:29.717+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f81c80fee30 con 0x7f81c80d5970 2024-02-21T07:45:30.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.290+0000 7f81bf400640 1 -- 172.21.15.100:0/2274421861 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81b0017020 con 0x7f81c80d5970 2024-02-21T07:45:30.296 INFO:teuthology.orchestra.run.smithi100.stderr:set pool 4 allow_ec_overwrites to true 2024-02-21T07:45:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.295+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 msgr2=0x7f81a40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.295+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 0x7f81a40a1560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81b8036000 tx=0x7f81b803d040 comp rx=0 tx=0).stop 2024-02-21T07:45:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.295+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 msgr2=0x7f81c816cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.295+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c3c0 tx=0x7f81b000c880 comp rx=0 tx=0).stop 2024-02-21T07:45:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 shutdown_connections 2024-02-21T07:45:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c818bd60 0x7f81c8183c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f81a409f0a0 0x7f81a40a1560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81c80d5970 0x7f81c816cde0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 --2- 172.21.15.100:0/2274421861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81c808cc00 0x7f81c8174650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.296+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 >> 172.21.15.100:0/2274421861 conn(0x7f81c80d2860 msgr2=0x7f81c818b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.298+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 shutdown_connections 2024-02-21T07:45:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.299+0000 7f81cdc00640 1 -- 172.21.15.100:0/2274421861 wait complete. 2024-02-21T07:45:30.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-21T07:45:30.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.516+0000 7f34caa00640 1 Processor -- start 2024-02-21T07:45:30.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.517+0000 7f34caa00640 1 -- start start 2024-02-21T07:45:30.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.518+0000 7f34caa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34c4190260 0x7f34c4070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.518+0000 7f34caa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 0x7f34c40f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.518+0000 7f34caa00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c418dc80 con 0x7f34c40f4b20 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34caa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c40f5b90 con 0x7f34c406edc0 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34caa00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c40f55d0 con 0x7f34c4190260 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c8a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 0x7f34c40f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34c4190260 0x7f34c4070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f34c40f4b20 0x7f34c406e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:48060/0 (socket says 172.21.15.100:48060) 2024-02-21T07:45:30.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3400640 1 -- 172.21.15.100:0/1622637024 learned_addr learned my addr 172.21.15.100:0/1622637024 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:30.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3e00640 1 -- 172.21.15.100:0/1622637024 >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 msgr2=0x7f34c40f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:30.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3e00640 1 --2- 172.21.15.100:0/1622637024 >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 0x7f34c40f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3e00640 1 -- 172.21.15.100:0/1622637024 >> v1:172.21.15.170:6789/0 conn(0x7f34c40f4b20 legacy=0x7f34c406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c3e00640 1 -- 172.21.15.100:0/1622637024 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c40f58b0 con 0x7f34c4190260 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c2a00640 1 -- 172.21.15.100:0/1622637024 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281937947 0 0) 0x7f34c418dc80 con 0x7f34c40f4b20 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.519+0000 7f34c8a00640 1 --2- 172.21.15.100:0/1622637024 >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 0x7f34c40f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34c3e00640 1 --2- 172.21.15.100:0/1622637024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c4190260 0x7f34c4070a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34c408d4e0 tx=0x7f34b402b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45df4a17f5770135 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34c2a00640 1 -- 172.21.15.100:0/1622637024 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4031520 con 0x7f34c4190260 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34c2a00640 1 -- 172.21.15.100:0/1622637024 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4031680 con 0x7f34c4190260 2024-02-21T07:45:30.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34c2a00640 1 -- 172.21.15.100:0/1622637024 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4031a10 con 0x7f34c4190260 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 -- 172.21.15.100:0/1622637024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c4190260 msgr2=0x7f34c4070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 --2- 172.21.15.100:0/1622637024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c4190260 0x7f34c4070a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34c408d4e0 tx=0x7f34b402b7c0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 -- 172.21.15.100:0/1622637024 shutdown_connections 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 --2- 172.21.15.100:0/1622637024 >> v2:172.21.15.100:3300/0 conn(0x7f34c406edc0 0x7f34c40f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 --2- 172.21.15.100:0/1622637024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c4190260 0x7f34c4070a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.521+0000 7f34caa00640 1 -- 172.21.15.100:0/1622637024 >> 172.21.15.100:0/1622637024 conn(0x7f34c40668b0 msgr2=0x7f34c4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.522+0000 7f34caa00640 1 -- 172.21.15.100:0/1622637024 shutdown_connections 2024-02-21T07:45:30.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.522+0000 7f34caa00640 1 -- 172.21.15.100:0/1622637024 wait complete. 2024-02-21T07:45:30.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.523+0000 7f34caa00640 1 Processor -- start 2024-02-21T07:45:30.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.524+0000 7f34caa00640 1 -- start start 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c40f4b20 0x7f34c40f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34c4190260 0x7f34c4067370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40f3630 con 0x7f34c4224260 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40678b0 con 0x7f34c4190260 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34caa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c40f8bf0 con 0x7f34c40f4b20 2024-02-21T07:45:30.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34c8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33810/0 (socket says 172.21.15.100:33810) 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34c3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c40f4b20 0x7f34c40f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34c8a00640 1 -- 172.21.15.100:0/3012018275 learned_addr learned my addr 172.21.15.100:0/3012018275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.525+0000 7f34c3400640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34c4190260 0x7f34c4067370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 -- 172.21.15.100:0/3012018275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c40f4b20 msgr2=0x7f34c40f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c40f4b20 0x7f34c40f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 -- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34c4190260 msgr2=0x7f34c4067370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34c4190260 0x7f34c4067370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 -- 172.21.15.100:0/3012018275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc009a70 con 0x7f34c4224260 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34c8a00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00efb0 tx=0x7f34bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc014480 con 0x7f34c4224260 2024-02-21T07:45:30.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc00f040 con 0x7f34c4224260 2024-02-21T07:45:30.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc014800 con 0x7f34c4224260 2024-02-21T07:45:30.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b4009400 con 0x7f34c4224260 2024-02-21T07:45:30.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.526+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c40f2c90 con 0x7f34c4224260 2024-02-21T07:45:30.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.528+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c40f3770 con 0x7f34c4224260 2024-02-21T07:45:30.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.529+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f34bc014960 con 0x7f34c4224260 2024-02-21T07:45:30.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.531+0000 7f34bbe00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 0x7f34a00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.531+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8340+0+0 (secure 0 0 0) 0x7f34bc0caa10 con 0x7f34c4224260 2024-02-21T07:45:30.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.531+0000 7f34c3e00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 0x7f34a00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.532+0000 7f34c3e00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 0x7f34a00a1560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34b4035000 tx=0x7f34b4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.535+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34c40f3770 con 0x7f34c4224260 2024-02-21T07:45:30.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:30.769+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f34c40f3770 con 0x7f34c4224260 2024-02-21T07:45:31.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.317+0000 7f34bbe00640 1 -- 172.21.15.100:0/3012018275 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f34c40f3770 con 0x7f34c4224260 2024-02-21T07:45:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 4 to fsmap 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 msgr2=0x7f34a00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 0x7f34a00a1560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34b4035000 tx=0x7f34b4030000 comp rx=0 tx=0).stop 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 msgr2=0x7f34c417be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00efb0 tx=0x7f34bc00c490 comp rx=0 tx=0).stop 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 shutdown_connections 2024-02-21T07:45:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34a009f0a0 0x7f34a00a1560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34c4224260 0x7f34c417be40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34c4190260 0x7f34c4067370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 --2- 172.21.15.100:0/3012018275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34c40f4b20 0x7f34c40f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 >> 172.21.15.100:0/3012018275 conn(0x7f34c40668b0 msgr2=0x7f34c40f5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 shutdown_connections 2024-02-21T07:45:31.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.321+0000 7f34caa00640 1 -- 172.21.15.100:0/3012018275 wait complete. 2024-02-21T07:45:31.347 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:45:31.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.549+0000 7fa99fe00640 1 Processor -- start 2024-02-21T07:45:31.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.549+0000 7fa99fe00640 1 -- start start 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.551+0000 7fa99fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa9a017ed80 0x7fa9a00f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.551+0000 7fa99fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9a006fd10 0x7fa9a0188300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99fe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00f59d0 con 0x7fa9a00f48e0 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a006f120 con 0x7fa9a006fd10 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99fe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00f4e50 con 0x7fa9a017ed80 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9a006fd10 0x7fa9a0188300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9a006fd10 0x7fa9a0188300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33822/0 (socket says 172.21.15.100:33822) 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 -- 172.21.15.100:0/1235555208 learned_addr learned my addr 172.21.15.100:0/1235555208 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99ea00640 1 --2- 172.21.15.100:0/1235555208 >> v2:172.21.15.156:3300/0 conn(0x7fa9a017ed80 0x7fa9a00f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 -- 172.21.15.100:0/1235555208 >> v2:172.21.15.156:3300/0 conn(0x7fa9a017ed80 msgr2=0x7fa9a00f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 --2- 172.21.15.100:0/1235555208 >> v2:172.21.15.156:3300/0 conn(0x7fa9a017ed80 0x7fa9a00f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 -- 172.21.15.100:0/1235555208 >> v1:172.21.15.156:6789/0 conn(0x7fa9a00f48e0 legacy=0x7fa9a006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.552+0000 7fa99f400640 1 -- 172.21.15.100:0/1235555208 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a00f5130 con 0x7fa9a006fd10 2024-02-21T07:45:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.553+0000 7fa99f400640 1 --2- 172.21.15.100:0/1235555208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a0188300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00cefb0 tx=0x7fa99802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543d09e595bc0c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.553+0000 7fa99e000640 1 -- 172.21.15.100:0/1235555208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99802c9f0 con 0x7fa9a006fd10 2024-02-21T07:45:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.553+0000 7fa99e000640 1 -- 172.21.15.100:0/1235555208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99802cb50 con 0x7fa9a006fd10 2024-02-21T07:45:31.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.553+0000 7fa99e000640 1 -- 172.21.15.100:0/1235555208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9980343f0 con 0x7fa9a006fd10 2024-02-21T07:45:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 -- 172.21.15.100:0/1235555208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 msgr2=0x7fa9a0188300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 --2- 172.21.15.100:0/1235555208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a0188300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00cefb0 tx=0x7fa99802be50 comp rx=0 tx=0).stop 2024-02-21T07:45:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 -- 172.21.15.100:0/1235555208 shutdown_connections 2024-02-21T07:45:31.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 --2- 172.21.15.100:0/1235555208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a0188300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 --2- 172.21.15.100:0/1235555208 >> v2:172.21.15.156:3300/0 conn(0x7fa9a017ed80 0x7fa9a00f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 -- 172.21.15.100:0/1235555208 >> 172.21.15.100:0/1235555208 conn(0x7fa9a00f64a0 msgr2=0x7fa9a00f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 -- 172.21.15.100:0/1235555208 shutdown_connections 2024-02-21T07:45:31.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.554+0000 7fa99fe00640 1 -- 172.21.15.100:0/1235555208 wait complete. 2024-02-21T07:45:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.557+0000 7fa99fe00640 1 Processor -- start 2024-02-21T07:45:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.557+0000 7fa99fe00640 1 -- start start 2024-02-21T07:45:31.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.558+0000 7fa99fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.558+0000 7fa99fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9a00f48e0 0x7fa9a00f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.558+0000 7fa99fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 0x7fa9a00f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.558+0000 7fa99fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00f1710 con 0x7fa9a006fd10 2024-02-21T07:45:31.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.558+0000 7fa99fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00f19f0 con 0x7fa9a00f48e0 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00f1cd0 con 0x7fa9a017ed80 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33832/0 (socket says 172.21.15.100:33832) 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 -- 172.21.15.100:0/970913412 learned_addr learned my addr 172.21.15.100:0/970913412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa996000640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9a00f48e0 0x7fa9a00f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99f400640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 0x7fa9a00f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 -- 172.21.15.100:0/970913412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 msgr2=0x7fa9a00f1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 0x7fa9a00f1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 -- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9a00f48e0 msgr2=0x7fa9a00f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9a00f48e0 0x7fa9a00f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 -- 172.21.15.100:0/970913412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998009b30 con 0x7fa9a006fd10 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99f400640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 0x7fa9a00f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.559+0000 7fa99ea00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e690 tx=0x7fa99000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.560+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99000ca30 con 0x7fa9a006fd10 2024-02-21T07:45:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.560+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000cb90 con 0x7fa9a006fd10 2024-02-21T07:45:31.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.560+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a00f1fb0 con 0x7fa9a006fd10 2024-02-21T07:45:31.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.560+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9900113f0 con 0x7fa9a006fd10 2024-02-21T07:45:31.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.560+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a021d350 con 0x7fa9a006fd10 2024-02-21T07:45:31.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.561+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0070bf0 con 0x7fa9a006fd10 2024-02-21T07:45:31.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.563+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa990011550 con 0x7fa9a006fd10 2024-02-21T07:45:31.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.564+0000 7fa997400640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 0x7fa97c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.564+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa9900c9b50 con 0x7fa9a006fd10 2024-02-21T07:45:31.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.564+0000 7fa996000640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 0x7fa97c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.565+0000 7fa996000640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 0x7fa97c0a1560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9a02121d0 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.568+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa990093910 con 0x7fa9a006fd10 2024-02-21T07:45:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.802+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9a00cbac0 con 0x7fa9a006fd10 2024-02-21T07:45:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.803+0000 7fa997400640 1 -- 172.21.15.100:0/970913412 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11284 (secure 0 0 0) 0x7fa990095840 con 0x7fa9a006fd10 2024-02-21T07:45:31.809 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:31.809 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4333,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:30.771396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T07:45:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 msgr2=0x7fa97c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 0x7fa97c0a1560 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9a02121d0 tx=0x7fa988009040 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 msgr2=0x7fa9a021ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa99000e690 tx=0x7fa99000eb50 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 shutdown_connections 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9a017ed80 0x7fa9a00f1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa9a00f48e0 0x7fa9a00f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa97c09f0a0 0x7fa97c0a1560 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 --2- 172.21.15.100:0/970913412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9a006fd10 0x7fa9a021ce10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 >> 172.21.15.100:0/970913412 conn(0x7fa9a00f64a0 msgr2=0x7fa9a015cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 shutdown_connections 2024-02-21T07:45:31.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:31.806+0000 7fa99fe00640 1 -- 172.21.15.100:0/970913412 wait complete. 2024-02-21T07:45:31.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.033+0000 7f0230e00640 1 Processor -- start 2024-02-21T07:45:32.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.033+0000 7f0230e00640 1 -- start start 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.035+0000 7f0230e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0cb5d0 con 0x7f022c0f9800 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.035+0000 7f0230e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c06eec0 con 0x7f022c183f70 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.035+0000 7f0230e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0cbb00 con 0x7f022c1844e0 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0221400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f022c1844e0 0x7f022c0f90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:48074/0 (socket says 172.21.15.100:48074) 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0221400640 1 -- 172.21.15.100:0/4276673359 learned_addr learned my addr 172.21.15.100:0/4276673359 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f022c183f70 0x7f022c06e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:45308/0 (socket says 172.21.15.100:45308) 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f022a800640 1 --1- 172.21.15.100:0/4276673359 >> v1:172.21.15.100:6789/0 conn(0x7f022c0f9800 0x7f022c186510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43796/0 (socket says 172.21.15.100:43796) 2024-02-21T07:45:32.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301230131 0 0) 0x7f022c06eec0 con 0x7f022c183f70 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0210003520 con 0x7f022c183f70 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111433363 0 0) 0x7f022c0cbb00 con 0x7f022c1844e0 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c06eec0 con 0x7f022c1844e0 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718543989 0 0) 0x7f022c0cb5d0 con 0x7f022c0f9800 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c0cbb00 con 0x7f022c0f9800 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841012122 0 0) 0x7f0210003520 con 0x7f022c183f70 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 >> v1:172.21.15.170:6789/0 conn(0x7f022c1844e0 legacy=0x7f022c0f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 >> v1:172.21.15.100:6789/0 conn(0x7f022c0f9800 legacy=0x7f022c186510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0cb820 con 0x7f022c183f70 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f021c001920 con 0x7f022c183f70 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 >> v1:172.21.15.156:6789/0 conn(0x7f022c183f70 legacy=0x7f022c06e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 0x7f02100051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0210003890 0x7f0210003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210009970 0x7f021000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021000c3a0 con 0x7f0210004e10 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021000c510 con 0x7f0210003890 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.036+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021000c6d0 con 0x7f0210009970 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 0x7f02100051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0221400640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0210003890 0x7f0210003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f022a800640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210009970 0x7f021000bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 -- 172.21.15.100:0/4276673359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210009970 msgr2=0x7f021000bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210009970 0x7f021000bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 -- 172.21.15.100:0/4276673359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0210003890 msgr2=0x7f0210003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0210003890 0x7f0210003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f0229e00640 1 -- 172.21.15.100:0/4276673359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210003520 con 0x7f0210004e10 2024-02-21T07:45:32.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.037+0000 7f022a800640 1 -- 172.21.15.100:0/4276673359 reap_dead start 2024-02-21T07:45:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.038+0000 7f0229e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 0x7f02100051f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c320 tx=0x7f02100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1c28ecdd15de84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.038+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c005d90 con 0x7f0210004e10 2024-02-21T07:45:32.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.038+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c02c960 con 0x7f0210004e10 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.038+0000 7f0229400640 1 -- 172.21.15.100:0/4276673359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c02cd50 con 0x7f0210004e10 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 -- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 msgr2=0x7f02100051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 0x7f02100051f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c320 tx=0x7f02100057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 -- 172.21.15.100:0/4276673359 shutdown_connections 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 --2- 172.21.15.100:0/4276673359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0210004e10 0x7f02100051f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 -- 172.21.15.100:0/4276673359 >> 172.21.15.100:0/4276673359 conn(0x7f022c0ce160 msgr2=0x7f022c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 -- 172.21.15.100:0/4276673359 shutdown_connections 2024-02-21T07:45:32.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.039+0000 7f0230e00640 1 -- 172.21.15.100:0/4276673359 wait complete. 2024-02-21T07:45:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.041+0000 7f0230e00640 1 Processor -- start 2024-02-21T07:45:32.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.042+0000 7f0230e00640 1 -- start start 2024-02-21T07:45:32.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 0x7f022c1697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c210ea0 0x7f022c1823a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c211c00 con 0x7f022c210a20 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1816a0 con 0x7f022c210ea0 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0230e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c211360 con 0x7f0210004e10 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0229e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 0x7f022c1697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0229e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 0x7f022c1697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47400/0 (socket says 172.21.15.100:47400) 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0229e00640 1 -- 172.21.15.100:0/178872591 learned_addr learned my addr 172.21.15.100:0/178872591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33846/0 (socket says 172.21.15.100:33846) 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f022a800640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c210ea0 0x7f022c1823a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 -- 172.21.15.100:0/178872591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 msgr2=0x7f022c1697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 0x7f022c1697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 -- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c210ea0 msgr2=0x7f022c1823a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c210ea0 0x7f022c1823a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.043+0000 7f0221400640 1 -- 172.21.15.100:0/178872591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c211640 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0221400640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0214001740 tx=0x7f0214001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007740 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214004e20 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c211920 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400fbe0 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.044+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c1828e0 con 0x7f022c210a20 2024-02-21T07:45:32.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.045+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c181b80 con 0x7f022c210a20 2024-02-21T07:45:32.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.047+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f021400fd40 con 0x7f022c210a20 2024-02-21T07:45:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.049+0000 7f0222a00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 0x7f02080a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.049+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f02140c9830 con 0x7f022c210a20 2024-02-21T07:45:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.050+0000 7f0229e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 0x7f02080a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.050+0000 7f0229e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 0x7f02080a1590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f021c000f80 tx=0x7f021c009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.053+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0214093710 con 0x7f022c210a20 2024-02-21T07:45:32.214 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-02-21T07:45:32.209+0000 7fd0f2000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T07:45:32.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.247+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f022c067c80 con 0x7f022c210a20 2024-02-21T07:45:32.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.251+0000 7f0222a00640 1 -- 172.21.15.100:0/178872591 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f0214096dd0 con 0x7f022c210a20 2024-02-21T07:45:32.257 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:32.257 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 msgr2=0x7f02080a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 0x7f02080a1590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f021c000f80 tx=0x7f021c009030 comp rx=0 tx=0).stop 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 msgr2=0x7f022c181e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0214001740 tx=0x7f0214001c00 comp rx=0 tx=0).stop 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 shutdown_connections 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f022c210ea0 0x7f022c1823a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f020809f0d0 0x7f02080a1590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f022c210a20 0x7f022c181e60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 --2- 172.21.15.100:0/178872591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0210004e10 0x7f022c1697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.253+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 >> 172.21.15.100:0/178872591 conn(0x7f022c0ce160 msgr2=0x7f022c17c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.254+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 shutdown_connections 2024-02-21T07:45:32.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.254+0000 7f0230e00640 1 -- 172.21.15.100:0/178872591 wait complete. 2024-02-21T07:45:32.279 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:32.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.467+0000 7faac2200640 1 Processor -- start 2024-02-21T07:45:32.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.467+0000 7faac2200640 1 -- start start 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac2200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 0x7faabc0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac2200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faabc06fd10 0x7faabc0f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac2200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc06dcf0 con 0x7faabc072f00 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac2200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0f43a0 con 0x7faabc185e10 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac2200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc189670 con 0x7faabc06fd10 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 0x7faabc0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.469+0000 7faac1800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faabc06fd10 0x7faabc0f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 0x7faabc0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33850/0 (socket says 172.21.15.100:33850) 2024-02-21T07:45:32.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac0e00640 1 -- 172.21.15.100:0/1071293936 learned_addr learned my addr 172.21.15.100:0/1071293936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faabb400640 1 -- 172.21.15.100:0/1071293936 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911128301 0 0) 0x7faabc06dcf0 con 0x7faabc072f00 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac1800640 1 -- 172.21.15.100:0/1071293936 >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 msgr2=0x7faabc0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac1800640 1 --2- 172.21.15.100:0/1071293936 >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 0x7faabc0703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac1800640 1 -- 172.21.15.100:0/1071293936 >> v1:172.21.15.170:6789/0 conn(0x7faabc072f00 legacy=0x7faabc06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.470+0000 7faac1800640 1 -- 172.21.15.100:0/1071293936 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc06dfd0 con 0x7faabc06fd10 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.471+0000 7faac1800640 1 --2- 172.21.15.100:0/1071293936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fd10 0x7faabc0f4aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faabc0f6470 tx=0x7faab402bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252ed679b74da74 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.471+0000 7faabb400640 1 -- 172.21.15.100:0/1071293936 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab402cb60 con 0x7faabc06fd10 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.471+0000 7faabb400640 1 -- 172.21.15.100:0/1071293936 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab402ccc0 con 0x7faabc06fd10 2024-02-21T07:45:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.471+0000 7faabb400640 1 -- 172.21.15.100:0/1071293936 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4034660 con 0x7faabc06fd10 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 -- 172.21.15.100:0/1071293936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fd10 msgr2=0x7faabc0f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 --2- 172.21.15.100:0/1071293936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fd10 0x7faabc0f4aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faabc0f6470 tx=0x7faab402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 -- 172.21.15.100:0/1071293936 shutdown_connections 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 --2- 172.21.15.100:0/1071293936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc06fd10 0x7faabc0f4aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 --2- 172.21.15.100:0/1071293936 >> v2:172.21.15.100:3300/0 conn(0x7faabc185e10 0x7faabc0703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 -- 172.21.15.100:0/1071293936 >> 172.21.15.100:0/1071293936 conn(0x7faabc0f64a0 msgr2=0x7faabc0f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 -- 172.21.15.100:0/1071293936 shutdown_connections 2024-02-21T07:45:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.472+0000 7faac2200640 1 -- 172.21.15.100:0/1071293936 wait complete. 2024-02-21T07:45:32.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.474+0000 7faac2200640 1 Processor -- start 2024-02-21T07:45:32.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.474+0000 7faac2200640 1 -- start start 2024-02-21T07:45:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 0x7faabc168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 0x7faabc21fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc184910 con 0x7faabc06fd10 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc183ab0 con 0x7faabc185e10 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.475+0000 7faac2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc183d90 con 0x7faabc072f00 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33858/0 (socket says 172.21.15.100:33858) 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 -- 172.21.15.100:0/736126210 learned_addr learned my addr 172.21.15.100:0/736126210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faabbe00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 0x7faabc168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac1800640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 0x7faabc21fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 -- 172.21.15.100:0/736126210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 msgr2=0x7faabc168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 0x7faabc168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 -- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 msgr2=0x7faabc21fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 0x7faabc21fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 -- 172.21.15.100:0/736126210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009a70 con 0x7faabc06fd10 2024-02-21T07:45:32.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faabbe00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 0x7faabc168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac1800640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 0x7faabc21fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.476+0000 7faac0e00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faab0009fd0 tx=0x7faab000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.477+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000c940 con 0x7faabc06fd10 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.477+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab000caa0 con 0x7faabc06fd10 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.477+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000ce30 con 0x7faabc06fd10 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.477+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc184070 con 0x7faabc06fd10 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.477+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc184630 con 0x7faabc06fd10 2024-02-21T07:45:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.478+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc075160 con 0x7faabc06fd10 2024-02-21T07:45:32.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.480+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7faab0013470 con 0x7faabc06fd10 2024-02-21T07:45:32.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.481+0000 7faab8c00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 0x7faa9c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.481+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7faab00c9d50 con 0x7faabc06fd10 2024-02-21T07:45:32.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.481+0000 7faabbe00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 0x7faa9c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.482+0000 7faabbe00640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 0x7faa9c0a1590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faabc16c850 tx=0x7faaa8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.485+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faab0093ab0 con 0x7faabc06fd10 2024-02-21T07:45:32.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.680+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faabc0ecba0 con 0x7faabc06fd10 2024-02-21T07:45:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.683+0000 7faab8c00640 1 -- 172.21.15.100:0/736126210 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7faab00959e0 con 0x7faabc06fd10 2024-02-21T07:45:32.689 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:32.690 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 msgr2=0x7faa9c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 0x7faa9c0a1590 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faabc16c850 tx=0x7faaa8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 msgr2=0x7faabc0f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faab0009fd0 tx=0x7faab000ed40 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 shutdown_connections 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faabc185e10 0x7faabc21fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faabc072f00 0x7faabc168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faa9c09f0d0 0x7faa9c0a1590 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 --2- 172.21.15.100:0/736126210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc06fd10 0x7faabc0f5010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 >> 172.21.15.100:0/736126210 conn(0x7faabc0f64a0 msgr2=0x7faabc06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 shutdown_connections 2024-02-21T07:45:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.687+0000 7faac2200640 1 -- 172.21.15.100:0/736126210 wait complete. 2024-02-21T07:45:32.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:45:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.930+0000 7f71e7e00640 1 Processor -- start 2024-02-21T07:45:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.930+0000 7f71e7e00640 1 -- start start 2024-02-21T07:45:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71e81879b0 0x7f71e80f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80cad10 con 0x7f71e80f48e0 2024-02-21T07:45:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80cb8b0 con 0x7f71e8180660 2024-02-21T07:45:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e8180a40 con 0x7f71e81879b0 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71e81879b0 0x7f71e80f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f71e80f48e0 0x7f71e8189c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43798/0 (socket says 172.21.15.100:43798) 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.932+0000 7f71e7400640 1 -- 172.21.15.100:0/2822998679 learned_addr learned my addr 172.21.15.100:0/2822998679 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237548420 0 0) 0x7f71e80cad10 con 0x7f71e80f48e0 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71cc003520 con 0x7f71e80f48e0 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162441663 0 0) 0x7f71e80cb8b0 con 0x7f71e8180660 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e6000640 1 -- 172.21.15.100:0/2822998679 >> v1:172.21.15.156:6789/0 conn(0x7f71e8180660 legacy=0x7f71e80cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e6000640 1 -- 172.21.15.100:0/2822998679 >> v1:172.21.15.100:6789/0 conn(0x7f71e80f48e0 legacy=0x7f71e8189c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.933+0000 7f71e6000640 1 -- 172.21.15.100:0/2822998679 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80ca400 con 0x7f71e81879b0 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.934+0000 7f71e6000640 1 --2- 172.21.15.100:0/2822998679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e81879b0 0x7f71e80f43a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097a0 tx=0x7f71d402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f72e7ece3ed234 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.934+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4030610 con 0x7f71e81879b0 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.934+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4030770 con 0x7f71e81879b0 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.934+0000 7f71e5600640 1 -- 172.21.15.100:0/2822998679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4030b00 con 0x7f71e81879b0 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 -- 172.21.15.100:0/2822998679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e81879b0 msgr2=0x7f71e80f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2822998679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e81879b0 0x7f71e80f43a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f71d40097a0 tx=0x7f71d402b960 comp rx=0 tx=0).stop 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 -- 172.21.15.100:0/2822998679 shutdown_connections 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2822998679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e81879b0 0x7f71e80f43a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 -- 172.21.15.100:0/2822998679 >> 172.21.15.100:0/2822998679 conn(0x7f71e80f64a0 msgr2=0x7f71e80f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 -- 172.21.15.100:0/2822998679 shutdown_connections 2024-02-21T07:45:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.935+0000 7f71e7e00640 1 -- 172.21.15.100:0/2822998679 wait complete. 2024-02-21T07:45:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.937+0000 7f71e7e00640 1 Processor -- start 2024-02-21T07:45:32.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.937+0000 7f71e7e00640 1 -- start start 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71e8180660 0x7f71e816eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 0x7f71e82201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80d0da0 con 0x7f71e80f48e0 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e821f7c0 con 0x7f71e8180660 2024-02-21T07:45:32.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80d0500 con 0x7f71e81879b0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.938+0000 7f71e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33882/0 (socket says 172.21.15.100:33882) 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 -- 172.21.15.100:0/2224419917 learned_addr learned my addr 172.21.15.100:0/2224419917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6000640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71e8180660 0x7f71e816eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e7400640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 0x7f71e82201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 -- 172.21.15.100:0/2224419917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 msgr2=0x7f71e82201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 0x7f71e82201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 -- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71e8180660 msgr2=0x7f71e816eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71e8180660 0x7f71e816eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 -- 172.21.15.100:0/2224419917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009400 con 0x7f71e80f48e0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e7400640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 0x7f71e82201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71e6a00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c460 tx=0x7f71d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.939+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80035f0 con 0x7f71e80f48e0 2024-02-21T07:45:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.940+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8003770 con 0x7f71e80f48e0 2024-02-21T07:45:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.940+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8003b20 con 0x7f71e80f48e0 2024-02-21T07:45:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.940+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e80d07e0 con 0x7f71e80f48e0 2024-02-21T07:45:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.940+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e821f9d0 con 0x7f71e80f48e0 2024-02-21T07:45:32.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.941+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e8075160 con 0x7f71e80f48e0 2024-02-21T07:45:32.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.943+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f71d8003c80 con 0x7f71e80f48e0 2024-02-21T07:45:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.945+0000 7f71dea00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 0x7f71c80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.945+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f71d80c9250 con 0x7f71e80f48e0 2024-02-21T07:45:32.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.945+0000 7f71e6000640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 0x7f71c80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:32.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.946+0000 7f71e6000640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 0x7f71c80a1560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:32.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:32.949+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71d8092fb0 con 0x7f71e80f48e0 2024-02-21T07:45:33.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.184+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71e80c9c50 con 0x7f71e80f48e0 2024-02-21T07:45:33.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.186+0000 7f71dea00640 1 -- 172.21.15.100:0/2224419917 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11284 (secure 0 0 0) 0x7f71d8017090 con 0x7f71e80f48e0 2024-02-21T07:45:33.191 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:33.192 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4333,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4349,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:30.771396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4354},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T07:45:33.192 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 7 2024-02-21T07:45:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.188+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 msgr2=0x7f71c80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 0x7f71c80a1560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f71d4036000 tx=0x7f71d4008030 comp rx=0 tx=0).stop 2024-02-21T07:45:33.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 msgr2=0x7f71e80cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f71d800c460 tx=0x7f71d800c920 comp rx=0 tx=0).stop 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 shutdown_connections 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e81879b0 0x7f71e82201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71e8180660 0x7f71e816eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71c809f0a0 0x7f71c80a1560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 --2- 172.21.15.100:0/2224419917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71e80f48e0 0x7f71e80cd8b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 >> 172.21.15.100:0/2224419917 conn(0x7f71e80f64a0 msgr2=0x7f71e80f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 shutdown_connections 2024-02-21T07:45:33.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.189+0000 7f71e7e00640 1 -- 172.21.15.100:0/2224419917 wait complete. 2024-02-21T07:45:33.213 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:33.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.410+0000 7f09d4000640 1 Processor -- start 2024-02-21T07:45:33.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.410+0000 7f09d4000640 1 -- start start 2024-02-21T07:45:33.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d4000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09cc186df0 0x7f09cc0f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d4000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09cc188770 0x7f09cc188c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d4000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0f9ac0 con 0x7f09cc185f20 2024-02-21T07:45:33.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d4000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc06dc90 con 0x7f09cc186df0 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d4000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc06df70 con 0x7f09cc188770 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09cc186df0 0x7f09cc0f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09cc186df0 0x7f09cc0f9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33894/0 (socket says 172.21.15.100:33894) 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d0c00640 1 -- 172.21.15.100:0/3180204728 learned_addr learned my addr 172.21.15.100:0/3180204728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.412+0000 7f09d2000640 1 --2- 172.21.15.100:0/3180204728 >> v2:172.21.15.156:3300/0 conn(0x7f09cc188770 0x7f09cc188c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.413+0000 7f09d0c00640 1 -- 172.21.15.100:0/3180204728 >> v2:172.21.15.156:3300/0 conn(0x7f09cc188770 msgr2=0x7f09cc188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.413+0000 7f09d0c00640 1 --2- 172.21.15.100:0/3180204728 >> v2:172.21.15.156:3300/0 conn(0x7f09cc188770 0x7f09cc188c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.413+0000 7f09d0c00640 1 -- 172.21.15.100:0/3180204728 >> v1:172.21.15.170:6789/0 conn(0x7f09cc185f20 legacy=0x7f09cc1866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.413+0000 7f09d0c00640 1 -- 172.21.15.100:0/3180204728 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc06e250 con 0x7f09cc186df0 2024-02-21T07:45:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.414+0000 7f09d0c00640 1 --2- 172.21.15.100:0/3180204728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc0f9580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0f7c20 tx=0x7f09bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65d3d7a2d6ce149 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.414+0000 7f09cbe00640 1 -- 172.21.15.100:0/3180204728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0317e0 con 0x7f09cc186df0 2024-02-21T07:45:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.414+0000 7f09cbe00640 1 -- 172.21.15.100:0/3180204728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc031940 con 0x7f09cc186df0 2024-02-21T07:45:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.414+0000 7f09cbe00640 1 -- 172.21.15.100:0/3180204728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc031cd0 con 0x7f09cc186df0 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 -- 172.21.15.100:0/3180204728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 msgr2=0x7f09cc0f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 --2- 172.21.15.100:0/3180204728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc0f9580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0f7c20 tx=0x7f09bc02b880 comp rx=0 tx=0).stop 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 -- 172.21.15.100:0/3180204728 shutdown_connections 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 --2- 172.21.15.100:0/3180204728 >> v2:172.21.15.156:3300/0 conn(0x7f09cc188770 0x7f09cc188c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 --2- 172.21.15.100:0/3180204728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc0f9580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 -- 172.21.15.100:0/3180204728 >> 172.21.15.100:0/3180204728 conn(0x7f09cc0ce160 msgr2=0x7f09cc0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 -- 172.21.15.100:0/3180204728 shutdown_connections 2024-02-21T07:45:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.415+0000 7f09d4000640 1 -- 172.21.15.100:0/3180204728 wait complete. 2024-02-21T07:45:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.418+0000 7f09d4000640 1 Processor -- start 2024-02-21T07:45:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.418+0000 7f09d4000640 1 -- start start 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09cc185f20 0x7f09cc0f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc188770 0x7f09cc18b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0f33e0 con 0x7f09cc186df0 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0f4f50 con 0x7f09cc185f20 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.419+0000 7f09d4000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0f5230 con 0x7f09cc188770 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33898/0 (socket says 172.21.15.100:33898) 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 -- 172.21.15.100:0/593015949 learned_addr learned my addr 172.21.15.100:0/593015949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d2000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc188770 0x7f09cc18b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d1600640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09cc185f20 0x7f09cc0f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 -- 172.21.15.100:0/593015949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc188770 msgr2=0x7f09cc18b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc188770 0x7f09cc18b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 -- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09cc185f20 msgr2=0x7f09cc0f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09cc185f20 0x7f09cc0f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 -- 172.21.15.100:0/593015949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0094d0 con 0x7f09cc186df0 2024-02-21T07:45:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.420+0000 7f09d0c00640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f09bc02b8c0 tx=0x7f09bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.421+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc032880 con 0x7f09cc186df0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.421+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc032a00 con 0x7f09cc186df0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.421+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc0f5510 con 0x7f09cc186df0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.421+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc032db0 con 0x7f09cc186df0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.421+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc0f0e00 con 0x7f09cc186df0 2024-02-21T07:45:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.422+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc067c80 con 0x7f09cc186df0 2024-02-21T07:45:33.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.424+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f09bc04e450 con 0x7f09cc186df0 2024-02-21T07:45:33.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.425+0000 7f09c9600640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 0x7f09b00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.425+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f09bc0ebb50 con 0x7f09cc186df0 2024-02-21T07:45:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.426+0000 7f09d1600640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 0x7f09b00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:33.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.426+0000 7f09d1600640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 0x7f09b00a1560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00016e0 tx=0x7f09c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.430+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09bc0b5940 con 0x7f09cc186df0 2024-02-21T07:45:33.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.622+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09cc06fe90 con 0x7f09cc186df0 2024-02-21T07:45:33.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.624+0000 7f09c9600640 1 -- 172.21.15.100:0/593015949 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f09bc0b9000 con 0x7f09cc186df0 2024-02-21T07:45:33.630 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:33.630 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 msgr2=0x7f09b00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 0x7f09b00a1560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09c00016e0 tx=0x7f09c0009040 comp rx=0 tx=0).stop 2024-02-21T07:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 msgr2=0x7f09cc175b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f09bc02b8c0 tx=0x7f09bc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 shutdown_connections 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09cc188770 0x7f09cc18b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f09b009f0a0 0x7f09b00a1560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09cc186df0 0x7f09cc175b70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 --2- 172.21.15.100:0/593015949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09cc185f20 0x7f09cc0f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.626+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 >> 172.21.15.100:0/593015949 conn(0x7f09cc0ce160 msgr2=0x7f09cc18bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.627+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 shutdown_connections 2024-02-21T07:45:33.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:33.627+0000 7f09d4000640 1 -- 172.21.15.100:0/593015949 wait complete. 2024-02-21T07:45:34.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-21T07:45:25.700152+0000', 'modified': '2024-02-21T07:45:30.771396+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4354}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4354': {'gid': 4354, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6839/1953723394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1953723394}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1953723394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-21T07:45:34.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-21T07:45:34.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-21T07:45:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.074+0000 7f9abea00640 1 Processor -- start 2024-02-21T07:45:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.074+0000 7f9abea00640 1 -- start start 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.076+0000 7f9abea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9ab80cc560 0x7f9ab80cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.076+0000 7f9abea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9ab80712c0 0x7f9ab8071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.076+0000 7f9abea00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8071c90 con 0x7f9ab8186350 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.076+0000 7f9abea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab80d2220 con 0x7f9ab80712c0 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.076+0000 7f9abea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab818d050 con 0x7f9ab80cc560 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9ab8186350 0x7f9ab80d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:45338/0 (socket says 172.21.15.100:45338) 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7e00640 1 -- 172.21.15.100:0/2815027340 learned_addr learned my addr 172.21.15.100:0/2815027340 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7400640 1 --2- 172.21.15.100:0/2815027340 >> v2:172.21.15.170:3300/0 conn(0x7f9ab80cc560 0x7f9ab80cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9abca00640 1 --2- 172.21.15.100:0/2815027340 >> v2:172.21.15.100:3300/0 conn(0x7f9ab80712c0 0x7f9ab8071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab6a00640 1 -- 172.21.15.100:0/2815027340 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666718369 0 0) 0x7f9ab8071c90 con 0x7f9ab8186350 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab6a00640 1 -- 172.21.15.100:0/2815027340 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a9c003520 con 0x7f9ab8186350 2024-02-21T07:45:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7400640 1 -- 172.21.15.100:0/2815027340 >> v2:172.21.15.100:3300/0 conn(0x7f9ab80712c0 msgr2=0x7f9ab8071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7400640 1 --2- 172.21.15.100:0/2815027340 >> v2:172.21.15.100:3300/0 conn(0x7f9ab80712c0 0x7f9ab8071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7400640 1 -- 172.21.15.100:0/2815027340 >> v1:172.21.15.156:6789/0 conn(0x7f9ab8186350 legacy=0x7f9ab80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.077+0000 7f9ab7400640 1 -- 172.21.15.100:0/2815027340 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8186730 con 0x7f9ab80cc560 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9ab7400640 1 --2- 172.21.15.100:0/2815027340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80cc560 0x7f9ab80cbf90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80f9b70 tx=0x7f9aa402be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4703a055e21968a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9ab6a00640 1 -- 172.21.15.100:0/2815027340 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa402cbf0 con 0x7f9ab80cc560 2024-02-21T07:45:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9ab6a00640 1 -- 172.21.15.100:0/2815027340 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa402cd50 con 0x7f9ab80cc560 2024-02-21T07:45:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9ab6a00640 1 -- 172.21.15.100:0/2815027340 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4034660 con 0x7f9ab80cc560 2024-02-21T07:45:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9abea00640 1 -- 172.21.15.100:0/2815027340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80cc560 msgr2=0x7f9ab80cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.079+0000 7f9abea00640 1 --2- 172.21.15.100:0/2815027340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80cc560 0x7f9ab80cbf90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80f9b70 tx=0x7f9aa402be40 comp rx=0 tx=0).stop 2024-02-21T07:45:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 -- 172.21.15.100:0/2815027340 shutdown_connections 2024-02-21T07:45:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 --2- 172.21.15.100:0/2815027340 >> v2:172.21.15.100:3300/0 conn(0x7f9ab80712c0 0x7f9ab8071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 --2- 172.21.15.100:0/2815027340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80cc560 0x7f9ab80cbf90 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80f9b70 tx=0x7f9aa402be40 comp rx=0 tx=0).stop 2024-02-21T07:45:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 -- 172.21.15.100:0/2815027340 >> 172.21.15.100:0/2815027340 conn(0x7f9ab80fc030 msgr2=0x7f9ab80fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 -- 172.21.15.100:0/2815027340 shutdown_connections 2024-02-21T07:45:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.080+0000 7f9abea00640 1 -- 172.21.15.100:0/2815027340 wait complete. 2024-02-21T07:45:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.082+0000 7f9abea00640 1 Processor -- start 2024-02-21T07:45:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.082+0000 7f9abea00640 1 -- start start 2024-02-21T07:45:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80712c0 0x7f9ab8175830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8186350 0x7f9ab821eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8189e40 con 0x7f9ab8186350 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab818b130 con 0x7f9ab8175d70 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab818a090 con 0x7f9ab80712c0 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80712c0 0x7f9ab8175830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9ab7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8186350 0x7f9ab821eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59528/0 (socket says 172.21.15.100:59528) 2024-02-21T07:45:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.083+0000 7f9abca00640 1 -- 172.21.15.100:0/3639760191 learned_addr learned my addr 172.21.15.100:0/3639760191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 -- 172.21.15.100:0/3639760191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80712c0 msgr2=0x7f9ab8175830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80712c0 0x7f9ab8175830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 -- 172.21.15.100:0/3639760191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8186350 msgr2=0x7f9ab821eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8186350 0x7f9ab821eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 -- 172.21.15.100:0/3639760191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa4009a70 con 0x7f9ab8175d70 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abca00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e7f0 tx=0x7f9ab000ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9aafe00640 1 -- 172.21.15.100:0/3639760191 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0009510 con 0x7f9ab8175d70 2024-02-21T07:45:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9aafe00640 1 -- 172.21.15.100:0/3639760191 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab000ee40 con 0x7f9ab8175d70 2024-02-21T07:45:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9aafe00640 1 -- 172.21.15.100:0/3639760191 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab000cb80 con 0x7f9ab8175d70 2024-02-21T07:45:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab818a370 con 0x7f9ab8175d70 2024-02-21T07:45:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.084+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab818a930 con 0x7f9ab8175d70 2024-02-21T07:45:35.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.089+0000 7f9aafe00640 1 -- 172.21.15.100:0/3639760191 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f9ab000cce0 con 0x7f9ab8175d70 2024-02-21T07:45:35.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.090+0000 7f9ac17b5740 1 Processor -- start 2024-02-21T07:45:35.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.090+0000 7f9ac17b5740 1 -- start start 2024-02-21T07:45:35.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.090+0000 7f9aafe00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 0x7f9a980a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.090+0000 7f9aafe00640 1 -- 172.21.15.100:0/3639760191 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9ab00c9ae0 con 0x7f9ab8175d70 2024-02-21T07:45:35.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ab7400640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 0x7f9a980a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b9357e0 0x55c18b935bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 0x55c18b970970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b868b30 con 0x55c18b9357e0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b866060 con 0x55c18b970eb0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b861840 con 0x55c18b936100 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59538/0 (socket says 172.21.15.100:59538) 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b9357e0 0x55c18b935bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 -- 172.21.15.100:0/1315885928 learned_addr learned my addr 172.21.15.100:0/1315885928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ab7400640 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 0x55c18b970970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 -- 172.21.15.100:0/1315885928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 msgr2=0x55c18b970970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 0x55c18b970970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 -- 172.21.15.100:0/1315885928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b9357e0 msgr2=0x55c18b935bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b9357e0 0x55c18b935bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9abca00640 1 -- 172.21.15.100:0/1315885928 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18b8294c0 con 0x55c18b970eb0 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.091+0000 7f9ab7400640 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 0x55c18b970970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.092+0000 7f9ab7400640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 0x7f9a980a1560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4036000 tx=0x7f9aa402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.092+0000 7f9abca00640 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000f010 tx=0x7f9ab009b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3e313109268b029 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.092+0000 7f9aa3e00640 1 -- 172.21.15.100:0/1315885928 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0093de0 con 0x55c18b970eb0 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.092+0000 7f9aa3e00640 1 -- 172.21.15.100:0/1315885928 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00b4e90 con 0x55c18b970eb0 2024-02-21T07:45:35.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.092+0000 7f9aa3e00640 1 -- 172.21.15.100:0/1315885928 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00822d0 con 0x55c18b970eb0 2024-02-21T07:45:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 -- 172.21.15.100:0/1315885928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 msgr2=0x55c18b971c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000f010 tx=0x7f9ab009b810 comp rx=0 tx=0).stop 2024-02-21T07:45:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 -- 172.21.15.100:0/1315885928 shutdown_connections 2024-02-21T07:45:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b970eb0 0x55c18b971c40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b936100 0x55c18b970970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/1315885928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b9357e0 0x55c18b935bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 -- 172.21.15.100:0/1315885928 >> 172.21.15.100:0/1315885928 conn(0x55c18b8f7db0 msgr2=0x55c18b8f8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 -- 172.21.15.100:0/1315885928 shutdown_connections 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.093+0000 7f9ac17b5740 1 -- 172.21.15.100:0/1315885928 wait complete. 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.094+0000 7f9ac17b5740 1 -- start start 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.094+0000 7f9ac17b5740 1 Processor -- start 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b8f5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b8f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b806ea0 con 0x55c18b97d0a0 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b806b40 con 0x55c18b936100 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b5a9f20 con 0x55c18b970eb0 2024-02-21T07:45:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ac17b5740 10 client.0 _ll_register_callbacks cb 0x55c18b81a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9abca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9abca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33924/0 (socket says 172.21.15.100:33924) 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9abca00640 1 -- 172.21.15.100:0/3860966001 learned_addr learned my addr 172.21.15.100:0/3860966001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b8f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.095+0000 7f9ab7400640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b8f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 -- 172.21.15.100:0/3860966001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 msgr2=0x55c18b8f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b8f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 -- 172.21.15.100:0/3860966001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 msgr2=0x55c18b8f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b8f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 -- 172.21.15.100:0/3860966001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab818a930 con 0x55c18b97d0a0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9abca00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ab009ff90 tx=0x7f9ab000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3411858384639b38 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9aa0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:45:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00af230 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9ab00b6070 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c18b885c40 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab00b6230 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9ac17b5740 10 client.4368 fetch_fsmap learned FSMap version 7 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.096+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c18b85fec0 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab007b080 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9ab00c7020 con 0x55c18b97d0a0 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 10 client.4368 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 10 client.4368 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 20 client.4368 populate_metadata read hostname 'smithi100' 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b92b000 0x55c18b9866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 4 client.4368 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c18b5616c0 con 0x55c18b92b000 2024-02-21T07:45:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.097+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b92b000 0x55c18b9866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.098+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b92b000 0x55c18b9866a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83a49da4ca4311a0 server_cookie=ffac1b6979cac163 in_seq=0 out_seq=0 2024-02-21T07:45:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.098+0000 7f9aa0c00640 10 client.4368 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.098+0000 7f9aa0c00640 1 -- 172.21.15.100:0/3860966001 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c18b5616c0 con 0x55c18b92b000 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.098+0000 7f9aa0c00640 10 client.4368 handle_command_reply: tid=0 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 client.4368 shutdown 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 msgr2=0x55c18b92ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ab009ff90 tx=0x7f9ab000cf90 comp rx=0 tx=0).stop 2024-02-21T07:45:35.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 shutdown_connections 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b92b000 0x55c18b9866a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b97d0a0 0x55c18b92ed70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b8f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/3860966001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b8f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9aa0c00640 0 client.4368 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 >> 172.21.15.100:0/3860966001 conn(0x55c18b9357e0 msgr2=0x55c18b8f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 shutdown_connections 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 1 -- 172.21.15.100:0/3860966001 wait complete. 2024-02-21T07:45:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.099+0000 7f9ac17b5740 20 client.4368 trim_cache size 0 max 16384 2024-02-21T07:45:35.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.116+0000 7f9ac17b5740 1 Processor -- start 2024-02-21T07:45:35.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.116+0000 7f9ac17b5740 1 -- start start 2024-02-21T07:45:35.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.117+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b970870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b97d0a0 0x55c18b9d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b8923f0 con 0x55c18b936100 2024-02-21T07:45:35.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b8ff530 con 0x55c18b97d0a0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b8f8df0 con 0x55c18b970eb0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33928/0 (socket says 172.21.15.100:33928) 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 -- 172.21.15.100:0/268073411 learned_addr learned my addr 172.21.15.100:0/268073411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9abca00640 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b97d0a0 0x55c18b9d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7400640 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b970870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 -- 172.21.15.100:0/268073411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 msgr2=0x55c18b970870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b970870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 -- 172.21.15.100:0/268073411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b97d0a0 msgr2=0x55c18b9d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b97d0a0 0x55c18b9d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.118+0000 7f9ab7e00640 1 -- 172.21.15.100:0/268073411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c18b7fc8b0 con 0x55c18b936100 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8000f60 tx=0x7f9aa8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759f4a7303261f23 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9aa3400640 1 -- 172.21.15.100:0/268073411 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa801d070 con 0x55c18b936100 2024-02-21T07:45:35.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9aa3400640 1 -- 172.21.15.100:0/268073411 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8007690 con 0x55c18b936100 2024-02-21T07:45:35.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9aa3400640 1 -- 172.21.15.100:0/268073411 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8005a50 con 0x55c18b936100 2024-02-21T07:45:35.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 -- 172.21.15.100:0/268073411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 msgr2=0x55c18b93afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8000f60 tx=0x7f9aa8001150 comp rx=0 tx=0).stop 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 -- 172.21.15.100:0/268073411 shutdown_connections 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b97d0a0 0x55c18b9d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b970eb0 0x55c18b970870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/268073411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b936100 0x55c18b93afb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.119+0000 7f9ac17b5740 1 -- 172.21.15.100:0/268073411 >> 172.21.15.100:0/268073411 conn(0x55c18b9357e0 msgr2=0x55c18b933f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.120+0000 7f9ac17b5740 1 -- 172.21.15.100:0/268073411 shutdown_connections 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.120+0000 7f9ac17b5740 1 -- 172.21.15.100:0/268073411 wait complete. 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.120+0000 7f9ac17b5740 1 -- start start 2024-02-21T07:45:35.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.121+0000 7f9ac17b5740 1 Processor -- start 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b92c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 0x55c18b9316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b9619c0 con 0x55c18b970eb0 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b96e210 con 0x55c18b936100 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c18b8f5460 con 0x55c18b97d0a0 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ac17b5740 10 client.0 _ll_register_callbacks cb 0x7f9aa8006940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ab7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 0x55c18b9316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47490/0 (socket says 172.21.15.100:47490) 2024-02-21T07:45:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 -- 172.21.15.100:0/2722380871 learned_addr learned my addr 172.21.15.100:0/2722380871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b92c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 -- 172.21.15.100:0/2722380871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 msgr2=0x55c18b92c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b92c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 -- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 msgr2=0x55c18b9316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 0x55c18b9316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9abca00640 1 -- 172.21.15.100:0/2722380871 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c003520 con 0x55c18b97d0a0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.122+0000 7f9ab7400640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 0x55c18b9316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9abca00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c520 tx=0x7f9ab009a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb3d775a13da9cea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9aa0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0093a10 con 0x55c18b97d0a0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ab00b4e90 con 0x55c18b97d0a0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9ab0096bc0 con 0x55c18b97d0a0 2024-02-21T07:45:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab00934c0 con 0x55c18b97d0a0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9ac17b5740 10 client.4499 fetch_fsmap learned FSMap version 7 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c18b822510 con 0x55c18b97d0a0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.123+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab00b4e90 con 0x55c18b97d0a0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9ab00c7050 con 0x55c18b97d0a0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 10 client.4499 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 10 client.4499 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 20 client.4499 populate_metadata read hostname 'smithi100' 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b965d40 0x55c18b8f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 4 client.4499 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c18b5b2270 con 0x55c18b965d40 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b965d40 0x55c18b8f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9ab7e00640 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b965d40 0x55c18b8f38c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef542fef430494e server_cookie=d8dacaf4a51d78c0 in_seq=0 out_seq=0 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.124+0000 7f9aa0c00640 10 client.4499 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:45:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9aa0c00640 1 -- 172.21.15.100:0/2722380871 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c18b5b2270 con 0x55c18b965d40 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9aa0c00640 10 client.4499 handle_command_reply: tid=0 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 client.4499 shutdown 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 msgr2=0x55c18b92e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c520 tx=0x7f9ab009a070 comp rx=0 tx=0).stop 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 shutdown_connections 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c18b965d40 0x55c18b8f38c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c18b97d0a0 0x55c18b92e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c18b970eb0 0x55c18b9316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 --2- 172.21.15.100:0/2722380871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c18b936100 0x55c18b92c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 >> 172.21.15.100:0/2722380871 conn(0x55c18b9357e0 msgr2=0x55c18b98ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9aa0c00640 0 client.4499 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 shutdown_connections 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 1 -- 172.21.15.100:0/2722380871 wait complete. 2024-02-21T07:45:35.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.125+0000 7f9ac17b5740 20 client.4499 trim_cache size 0 max 16384 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "b9cc1397-a437-4ace-98ff-c29f55191169", 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4354, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 8.8566288160000006, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 7, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 28, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 28, 2024-02-21T07:45:35.135 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 13.854514865000001 2024-02-21T07:45:35.136 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:45:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 msgr2=0x7f9a980a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 0x7f9a980a1560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4036000 tx=0x7f9aa402e000 comp rx=0 tx=0).stop 2024-02-21T07:45:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 msgr2=0x7f9ab821eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000e7f0 tx=0x7f9ab000ebf0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 shutdown_connections 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ab8175d70 0x7f9ab821eff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a9809f0a0 0x7f9a980a1560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ab8186350 0x7f9ab821eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 --2- 172.21.15.100:0/3639760191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ab80712c0 0x7f9ab8175830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 >> 172.21.15.100:0/3639760191 conn(0x7f9ab80fc030 msgr2=0x7f9ab8073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 shutdown_connections 2024-02-21T07:45:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.126+0000 7f9abea00640 1 -- 172.21.15.100:0/3639760191 wait complete. 2024-02-21T07:45:35.149 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T07:45:35.149 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:35.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T07:45:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.341+0000 7f34e4400640 1 Processor -- start 2024-02-21T07:45:35.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.341+0000 7f34e4400640 1 -- start start 2024-02-21T07:45:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.343+0000 7f34e4400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 0x7f34dc1877b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.343+0000 7f34e4400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34dc188180 0x7f34dc08c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.343+0000 7f34e4400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc187320 con 0x7f34dc187cf0 2024-02-21T07:45:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.343+0000 7f34e4400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc18b9f0 con 0x7f34dc182cc0 2024-02-21T07:45:35.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.343+0000 7f34e4400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc18bcd0 con 0x7f34dc188180 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e1000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f34dc187cf0 0x7f34dc08bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:48086/0 (socket says 172.21.15.100:48086) 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e2400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f34dc188180 0x7f34dc08c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e1000640 1 -- 172.21.15.100:0/4197748231 learned_addr learned my addr 172.21.15.100:0/4197748231 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e1a00640 1 --2- 172.21.15.100:0/4197748231 >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 0x7f34dc1877b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e2400640 1 -- 172.21.15.100:0/4197748231 >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 msgr2=0x7f34dc1877b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e2400640 1 --2- 172.21.15.100:0/4197748231 >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 0x7f34dc1877b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e2400640 1 -- 172.21.15.100:0/4197748231 >> v1:172.21.15.170:6789/0 conn(0x7f34dc187cf0 legacy=0x7f34dc08bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e2400640 1 -- 172.21.15.100:0/4197748231 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc1869f0 con 0x7f34dc188180 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34e1a00640 1 --2- 172.21.15.100:0/4197748231 >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 0x7f34dc1877b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.344+0000 7f34dbe00640 1 -- 172.21.15.100:0/4197748231 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462817613 0 0) 0x7f34dc187320 con 0x7f34dc187cf0 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34e2400640 1 --2- 172.21.15.100:0/4197748231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc188180 0x7f34dc08c6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0d39c0 tx=0x7f34d402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d29efb59bc971e8d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34dbe00640 1 -- 172.21.15.100:0/4197748231 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d402cc80 con 0x7f34dc188180 2024-02-21T07:45:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34dbe00640 1 -- 172.21.15.100:0/4197748231 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d402cde0 con 0x7f34dc188180 2024-02-21T07:45:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34dbe00640 1 -- 172.21.15.100:0/4197748231 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4034660 con 0x7f34dc188180 2024-02-21T07:45:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34e4400640 1 -- 172.21.15.100:0/4197748231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc188180 msgr2=0x7f34dc08c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.346+0000 7f34e4400640 1 --2- 172.21.15.100:0/4197748231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc188180 0x7f34dc08c6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0d39c0 tx=0x7f34d402bed0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 -- 172.21.15.100:0/4197748231 shutdown_connections 2024-02-21T07:45:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 --2- 172.21.15.100:0/4197748231 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc188180 0x7f34dc08c6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 --2- 172.21.15.100:0/4197748231 >> v2:172.21.15.156:3300/0 conn(0x7f34dc182cc0 0x7f34dc1877b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 -- 172.21.15.100:0/4197748231 >> 172.21.15.100:0/4197748231 conn(0x7f34dc0fe210 msgr2=0x7f34dc0fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 -- 172.21.15.100:0/4197748231 shutdown_connections 2024-02-21T07:45:35.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.347+0000 7f34e4400640 1 -- 172.21.15.100:0/4197748231 wait complete. 2024-02-21T07:45:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.349+0000 7f34e4400640 1 Processor -- start 2024-02-21T07:45:35.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.349+0000 7f34e4400640 1 -- start start 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc187cf0 0x7f34dc0d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34dc188180 0x7f34dc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc17e7d0 con 0x7f34dc182cc0 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc16ac30 con 0x7f34dc188180 2024-02-21T07:45:35.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e4400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc17d450 con 0x7f34dc187cf0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33940/0 (socket says 172.21.15.100:33940) 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e1a00640 1 -- 172.21.15.100:0/1049476586 learned_addr learned my addr 172.21.15.100:0/1049476586 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.350+0000 7f34e1000640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc187cf0 0x7f34dc0d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e2400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34dc188180 0x7f34dc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 -- 172.21.15.100:0/1049476586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc187cf0 msgr2=0x7f34dc0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc187cf0 0x7f34dc0d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 -- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34dc188180 msgr2=0x7f34dc0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34dc188180 0x7f34dc0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 -- 172.21.15.100:0/1049476586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d4009a70 con 0x7f34dc182cc0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e1a00640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34d000d7d0 tx=0x7f34d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0004030 con 0x7f34dc182cc0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0004190 con 0x7f34dc182cc0 2024-02-21T07:45:35.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0004520 con 0x7f34dc182cc0 2024-02-21T07:45:35.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.351+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc17d730 con 0x7f34dc182cc0 2024-02-21T07:45:35.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.352+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc17dcf0 con 0x7f34dc182cc0 2024-02-21T07:45:35.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.353+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc067c80 con 0x7f34dc182cc0 2024-02-21T07:45:35.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.355+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f34d00096a0 con 0x7f34dc182cc0 2024-02-21T07:45:35.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.356+0000 7f34d9600640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 0x7f34bc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.356+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f34d00c9be0 con 0x7f34dc182cc0 2024-02-21T07:45:35.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.356+0000 7f34e1000640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 0x7f34bc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.357+0000 7f34e1000640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 0x7f34bc0a1560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0d2680 tx=0x7f34c8007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.360+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f34d00939d0 con 0x7f34dc182cc0 2024-02-21T07:45:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.589+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f34dc0d26b0 con 0x7f34dc182cc0 2024-02-21T07:45:35.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.589+0000 7f34d9600640 1 -- 172.21.15.100:0/1049476586 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f34d0097090 con 0x7f34dc182cc0 2024-02-21T07:45:35.596 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T07:45:35.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.591+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 msgr2=0x7f34bc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.591+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 0x7f34bc0a1560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0d2680 tx=0x7f34c8007e40 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 msgr2=0x7f34dc16a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34d000d7d0 tx=0x7f34d000dc90 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 shutdown_connections 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f34dc188180 0x7f34dc0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f34dc187cf0 0x7f34dc0d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f34bc09f0a0 0x7f34bc0a1560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 --2- 172.21.15.100:0/1049476586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34dc182cc0 0x7f34dc16a6f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 >> 172.21.15.100:0/1049476586 conn(0x7f34dc0fe210 msgr2=0x7f34dc0f8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 shutdown_connections 2024-02-21T07:45:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:35.592+0000 7f34e4400640 1 -- 172.21.15.100:0/1049476586 wait complete. 2024-02-21T07:45:35.617 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-21T07:45:35.617 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T07:45:35.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-02-21T07:45:35.617 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-21T07:45:35.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:35.618 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-21T07:45:35.618 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T07:45:35.618 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T07:45:35.618 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T07:45:35.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:35.618 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-02-21T07:45:35.667 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T07:45:35.667 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T07:45:35.667 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T07:45:35.667 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:45:35.668 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T07:45:35.669 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42612sec preferred_lft 42612sec 2024-02-21T07:45:35.669 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link proto kernel_ll 2024-02-21T07:45:35.669 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:45:35.670 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T07:45:35.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:35.670 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:45:35.670 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:45:35.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-02-21T07:45:35.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-02-21T07:45:35.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-02-21T07:45:35.671 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T07:45:35.671 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:45:36.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:36.111 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T07:45:36.185 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-02-21T07:45:36.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:36.189 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-02-21T07:45:36.250 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-02-21T07:45:36.250 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T07:45:36.250 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T07:45:36.250 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T07:45:36.250 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T07:45:36.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T07:45:36.251 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:45:36.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:36.992 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-02-21T07:45:37.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:37.040 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-02-21T07:45:37.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:37.130 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:45:37.130 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:45:37.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:45:37.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-21T07:45:37.130 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:45:37.252 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-21T07:45:37.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:37.252 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:45:37.252 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:45:37.252 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-21T07:45:37.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T07:45:37.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-21T07:45:37.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-21T07:45:37.253 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-21T07:45:37.253 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:45:37.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:37.512 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:45:37.512 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:45:37.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-02-21T07:45:37.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T07:45:37.513 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:45:37.668 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-21T07:45:37.668 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:45:37.668 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:37.708 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T07:45:37.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:45:37.709 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:37.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-02-21T07:45:37.923 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-02-21T07:45:37.967 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T07:45:37.968 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:45:37.969 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:45:37.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:37.970 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-02-21T07:45:38.060 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-21T07:45:38.060 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-21T07:45:38.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-02-21T07:45:38.136 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T07:45:38.176 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-02-21T07:45:38.177 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-02-21T07:45:38.178 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:45:38.179 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:45:38.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:38.181 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-02-21T07:45:38.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:2024-02-21T07:45:38.236+0000 7ff4ce84c480 -1 init, newargv = 0x560aae2e1350 newargc=15 2024-02-21T07:45:38.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43009]: starting ceph client 2024-02-21T07:45:38.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43009]: starting fuse 2024-02-21T07:45:38.263 INFO:teuthology.orchestra.run.smithi100.stdout:39 2024-02-21T07:45:38.263 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2024-02-21T07:45:38.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-02-21T07:45:38.264 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-02-21T07:45:38.264 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-02-21T07:45:38.264 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-02-21T07:45:38.265 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.admin")) 2024-02-21T07:45:38.266 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-02-21T07:45:38.451 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.admin.43009.asok 2024-02-21T07:45:38.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-21T07:45:38.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43009.asok 2024-02-21T07:45:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:38.467 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43009.asok status 2024-02-21T07:45:38.694 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:45:38.694 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "admin", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "43009", 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4495, 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-02-21T07:45:38.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4495 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3863481617 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-02-21T07:45:38.696 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3863481617 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4495 192.168.0.1:0/3863481617", 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/3863481617", 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 7, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 28, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-02-21T07:45:38.697 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:45:38.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:38.708 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-02-21T07:45:38.708 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:38.759 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-02-21T07:45:38.759 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:38.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:38.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:38.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:38.850 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-21T07:45:38.935 INFO:teuthology.orchestra.run.smithi100.stdout:# file: . 2024-02-21T07:45:38.936 INFO:teuthology.orchestra.run.smithi100.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-21T07:45:38.936 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:38.937 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:38.937 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:45:38.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.186+0000 7f78d9400640 1 Processor -- start 2024-02-21T07:45:39.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.186+0000 7f78d9400640 1 -- start start 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.188+0000 7f78d9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f78d4189c60 0x7f78d40d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d9400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f78d40d5f30 0x7f78d40fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d9400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d406ce50 con 0x7f78d41828d0 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d40d6a60 con 0x7f78d4189c60 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d9400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d418cd70 con 0x7f78d40d5f30 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f78d41828d0 0x7f78d406c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:43800/0 (socket says 172.21.15.100:43800) 2024-02-21T07:45:39.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d3e00640 1 -- 172.21.15.100:0/1331232014 learned_addr learned my addr 172.21.15.100:0/1331232014 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78cbe00640 1 --2- 172.21.15.100:0/1331232014 >> v2:172.21.15.100:3300/0 conn(0x7f78d4189c60 0x7f78d40d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d8a00640 1 --2- 172.21.15.100:0/1331232014 >> v2:172.21.15.156:3300/0 conn(0x7f78d40d5f30 0x7f78d40fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d3400640 1 -- 172.21.15.100:0/1331232014 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652011466 0 0) 0x7f78d406ce50 con 0x7f78d41828d0 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d3400640 1 -- 172.21.15.100:0/1331232014 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b8003520 con 0x7f78d41828d0 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.189+0000 7f78d8a00640 1 -- 172.21.15.100:0/1331232014 >> v2:172.21.15.100:3300/0 conn(0x7f78d4189c60 msgr2=0x7f78d40d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.190+0000 7f78d8a00640 1 --2- 172.21.15.100:0/1331232014 >> v2:172.21.15.100:3300/0 conn(0x7f78d4189c60 0x7f78d40d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.190+0000 7f78d8a00640 1 -- 172.21.15.100:0/1331232014 >> v1:172.21.15.100:6789/0 conn(0x7f78d41828d0 legacy=0x7f78d406c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.190+0000 7f78d8a00640 1 -- 172.21.15.100:0/1331232014 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40d6780 con 0x7f78d40d5f30 2024-02-21T07:45:39.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.191+0000 7f78d8a00640 1 --2- 172.21.15.100:0/1331232014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d40fbe30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78d4091f50 tx=0x7f78cc02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=340e7a04f4a08d24 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.191+0000 7f78d3400640 1 -- 172.21.15.100:0/1331232014 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc02cc70 con 0x7f78d40d5f30 2024-02-21T07:45:39.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.191+0000 7f78d3400640 1 -- 172.21.15.100:0/1331232014 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc02cdd0 con 0x7f78d40d5f30 2024-02-21T07:45:39.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.191+0000 7f78d3400640 1 -- 172.21.15.100:0/1331232014 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc034660 con 0x7f78d40d5f30 2024-02-21T07:45:39.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 -- 172.21.15.100:0/1331232014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 msgr2=0x7f78d40fbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 --2- 172.21.15.100:0/1331232014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d40fbe30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f78d4091f50 tx=0x7f78cc02bec0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 -- 172.21.15.100:0/1331232014 shutdown_connections 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 --2- 172.21.15.100:0/1331232014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d40fbe30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 --2- 172.21.15.100:0/1331232014 >> v2:172.21.15.100:3300/0 conn(0x7f78d4189c60 0x7f78d40d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 -- 172.21.15.100:0/1331232014 >> 172.21.15.100:0/1331232014 conn(0x7f78d40fdf30 msgr2=0x7f78d40fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 -- 172.21.15.100:0/1331232014 shutdown_connections 2024-02-21T07:45:39.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.192+0000 7f78d9400640 1 -- 172.21.15.100:0/1331232014 wait complete. 2024-02-21T07:45:39.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.194+0000 7f78d9400640 1 Processor -- start 2024-02-21T07:45:39.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.195+0000 7f78d9400640 1 -- start start 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 0x7f78d4159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d421f390 con 0x7f78d4189c60 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4159880 con 0x7f78d40d5f30 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.196+0000 7f78d9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d421edd0 con 0x7f78d41828d0 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59632/0 (socket says 172.21.15.100:59632) 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33966/0 (socket says 172.21.15.100:33966) 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 -- 172.21.15.100:0/3702363867 learned_addr learned my addr 172.21.15.100:0/3702363867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78cbe00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 0x7f78d4159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 -- 172.21.15.100:0/3702363867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 msgr2=0x7f78d4159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 0x7f78d4159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 -- 172.21.15.100:0/3702363867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 msgr2=0x7f78d421e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 -- 172.21.15.100:0/3702363867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc009a70 con 0x7f78d40d5f30 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78cbe00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 0x7f78d4159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d8a00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.197+0000 7f78d3e00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c430 tx=0x7f78c400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.198+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4005ce0 con 0x7f78d40d5f30 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.198+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4005e40 con 0x7f78d40d5f30 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.198+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d421f0b0 con 0x7f78d40d5f30 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.198+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c40072f0 con 0x7f78d40d5f30 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.198+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d40d0550 con 0x7f78d40d5f30 2024-02-21T07:45:39.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.199+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4075160 con 0x7f78d40d5f30 2024-02-21T07:45:39.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.201+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f78c4007450 con 0x7f78d40d5f30 2024-02-21T07:45:39.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.202+0000 7f78d0c00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 0x7f78b00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.202+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f78c40c9230 con 0x7f78d40d5f30 2024-02-21T07:45:39.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.202+0000 7f78cbe00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 0x7f78b00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.203+0000 7f78cbe00640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 0x7f78b00a1560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78d40fe4a0 tx=0x7f78bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.206+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f78c4092f90 con 0x7f78d40d5f30 2024-02-21T07:45:39.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.406+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78d41780d0 con 0x7f78d40d5f30 2024-02-21T07:45:39.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.408+0000 7f78d0c00640 1 -- 172.21.15.100:0/3702363867 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f78c4017090 con 0x7f78d40d5f30 2024-02-21T07:45:39.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:39.415 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 msgr2=0x7f78b00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 0x7f78b00a1560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78d40fe4a0 tx=0x7f78bc008040 comp rx=0 tx=0).stop 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 msgr2=0x7f78d4178560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c430 tx=0x7f78c400c8f0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 shutdown_connections 2024-02-21T07:45:39.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f78b009f0a0 0x7f78b00a1560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78d4189c60 0x7f78d421e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f78d41828d0 0x7f78d4159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 --2- 172.21.15.100:0/3702363867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f78d40d5f30 0x7f78d4178560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 >> 172.21.15.100:0/3702363867 conn(0x7f78d40fdf30 msgr2=0x7f78d418a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 shutdown_connections 2024-02-21T07:45:39.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.410+0000 7f78d9400640 1 -- 172.21.15.100:0/3702363867 wait complete. 2024-02-21T07:45:39.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:45:39.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.644+0000 7fc858000640 1 Processor -- start 2024-02-21T07:45:39.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.644+0000 7fc858000640 1 -- start start 2024-02-21T07:45:39.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc858000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc850072450 0x7fc850186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc858000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc850188c30 0x7fc850189060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc858000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc850186670 con 0x7fc850182f60 2024-02-21T07:45:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc858000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc850183340 con 0x7fc850072450 2024-02-21T07:45:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc858000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc850071010 con 0x7fc850188c30 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.646+0000 7fc856000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc850188c30 0x7fc850189060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc850188c30 0x7fc850189060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47520/0 (socket says 172.21.15.100:47520) 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 -- 172.21.15.100:0/2246248120 learned_addr learned my addr 172.21.15.100:0/2246248120 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 -- 172.21.15.100:0/2246248120 >> v2:172.21.15.156:3300/0 conn(0x7fc850072450 msgr2=0x7fc850186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 --2- 172.21.15.100:0/2246248120 >> v2:172.21.15.156:3300/0 conn(0x7fc850072450 0x7fc850186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 -- 172.21.15.100:0/2246248120 >> v1:172.21.15.156:6789/0 conn(0x7fc850182f60 legacy=0x7fc850071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.647+0000 7fc856000640 1 -- 172.21.15.100:0/2246248120 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85006eb10 con 0x7fc850188c30 2024-02-21T07:45:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.648+0000 7fc856000640 1 --2- 172.21.15.100:0/2246248120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850188c30 0x7fc850189060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc85008e5c0 tx=0x7fc84802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68d9adda32e482cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.648+0000 7fc84fe00640 1 -- 172.21.15.100:0/2246248120 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84802c9f0 con 0x7fc850188c30 2024-02-21T07:45:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc84fe00640 1 -- 172.21.15.100:0/2246248120 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84802cb50 con 0x7fc850188c30 2024-02-21T07:45:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc84fe00640 1 -- 172.21.15.100:0/2246248120 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480343f0 con 0x7fc850188c30 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 -- 172.21.15.100:0/2246248120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850188c30 msgr2=0x7fc850189060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 --2- 172.21.15.100:0/2246248120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850188c30 0x7fc850189060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc85008e5c0 tx=0x7fc84802be50 comp rx=0 tx=0).stop 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 -- 172.21.15.100:0/2246248120 shutdown_connections 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 --2- 172.21.15.100:0/2246248120 >> v2:172.21.15.156:3300/0 conn(0x7fc850072450 0x7fc850186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 --2- 172.21.15.100:0/2246248120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850188c30 0x7fc850189060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 -- 172.21.15.100:0/2246248120 >> 172.21.15.100:0/2246248120 conn(0x7fc8500668b0 msgr2=0x7fc850066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.649+0000 7fc858000640 1 -- 172.21.15.100:0/2246248120 shutdown_connections 2024-02-21T07:45:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.650+0000 7fc858000640 1 -- 172.21.15.100:0/2246248120 wait complete. 2024-02-21T07:45:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.652+0000 7fc858000640 1 Processor -- start 2024-02-21T07:45:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.652+0000 7fc858000640 1 -- start start 2024-02-21T07:45:39.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850072450 0x7fc8501754f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc850188c30 0x7fc850221cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500d07a0 con 0x7fc850182f60 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8502131f0 con 0x7fc850188c30 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc858000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500cfb60 con 0x7fc850072450 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc855600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850072450 0x7fc8501754f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33982/0 (socket says 172.21.15.100:33982) 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 -- 172.21.15.100:0/4099451217 learned_addr learned my addr 172.21.15.100:0/4099451217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc856000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc850188c30 0x7fc850221cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 -- 172.21.15.100:0/4099451217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850072450 msgr2=0x7fc8501754f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850072450 0x7fc8501754f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 -- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc850188c30 msgr2=0x7fc850221cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.654+0000 7fc854c00640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc850188c30 0x7fc850221cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc854c00640 1 -- 172.21.15.100:0/4099451217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009b30 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc854c00640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b410 tx=0x7fc83c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011830 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c0119b0 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011d60 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc850181d60 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.655+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8500d00e0 con 0x7fc850182f60 2024-02-21T07:45:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.656+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8500729b0 con 0x7fc850182f60 2024-02-21T07:45:39.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.658+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc83c01a400 con 0x7fc850182f60 2024-02-21T07:45:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.660+0000 7fc84d600640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 0x7fc8300a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.660+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc83c0c9b40 con 0x7fc850182f60 2024-02-21T07:45:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.660+0000 7fc855600640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 0x7fc8300a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:39.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.661+0000 7fc855600640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 0x7fc8300a1560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc85006cb70 tx=0x7fc844009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:39.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.664+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc83c093930 con 0x7fc850182f60 2024-02-21T07:45:39.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.858+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc85008e110 con 0x7fc850182f60 2024-02-21T07:45:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.859+0000 7fc84d600640 1 -- 172.21.15.100:0/4099451217 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc83c015020 con 0x7fc850182f60 2024-02-21T07:45:39.866 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 msgr2=0x7fc8300a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 0x7fc8300a1560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc85006cb70 tx=0x7fc844009060 comp rx=0 tx=0).stop 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 msgr2=0x7fc8500d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00b410 tx=0x7fc83c00b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 shutdown_connections 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc850188c30 0x7fc850221cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc83009f0a0 0x7fc8300a1560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc850182f60 0x7fc8500d0bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 --2- 172.21.15.100:0/4099451217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc850072450 0x7fc8501754f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:39.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 >> 172.21.15.100:0/4099451217 conn(0x7fc8500668b0 msgr2=0x7fc850071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:39.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.861+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 shutdown_connections 2024-02-21T07:45:39.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:39.862+0000 7fc858000640 1 -- 172.21.15.100:0/4099451217 wait complete. 2024-02-21T07:45:39.887 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:45:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.092+0000 7f61e6000640 1 Processor -- start 2024-02-21T07:45:40.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.092+0000 7f61e6000640 1 -- start start 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 0x7f61e0186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61e0071d40 0x7f61e00721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 0x7f61e006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0183340 con 0x7f61e0182f60 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0186670 con 0x7f61e0071d40 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61e6000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e0071010 con 0x7f61e006da30 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61df400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 0x7f61e0186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61dfe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 0x7f61e006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61d7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61e0071d40 0x7f61e00721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61d7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f61e0071d40 0x7f61e00721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42516/0 (socket says 172.21.15.100:42516) 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61d7e00640 1 -- 172.21.15.100:0/1030768165 learned_addr learned my addr 172.21.15.100:0/1030768165 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61df400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 0x7f61e0186130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49810/0 (socket says 172.21.15.100:49810) 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.094+0000 7f61dfe00640 1 --2- 172.21.15.100:0/1030768165 >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 0x7f61e006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35498/0 (socket says 172.21.15.100:35498) 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.095+0000 7f61d7e00640 1 -- 172.21.15.100:0/1030768165 >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 msgr2=0x7f61e006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.095+0000 7f61d7e00640 1 --2- 172.21.15.100:0/1030768165 >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 0x7f61e006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.095+0000 7f61d7e00640 1 -- 172.21.15.100:0/1030768165 >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 msgr2=0x7f61e0186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.095+0000 7f61d7e00640 1 --2- 172.21.15.100:0/1030768165 >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 0x7f61e0186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.095+0000 7f61d7e00640 1 -- 172.21.15.100:0/1030768165 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0072710 con 0x7f61e0071d40 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.096+0000 7f61d7e00640 1 --2- 172.21.15.100:0/1030768165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0071d40 0x7f61e00721d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e008e5c0 tx=0x7f61c802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2636f4402ae004ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.096+0000 7f61dea00640 1 -- 172.21.15.100:0/1030768165 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80317e0 con 0x7f61e0071d40 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.096+0000 7f61dea00640 1 -- 172.21.15.100:0/1030768165 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8031940 con 0x7f61e0071d40 2024-02-21T07:45:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.096+0000 7f61dea00640 1 -- 172.21.15.100:0/1030768165 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8031cd0 con 0x7f61e0071d40 2024-02-21T07:45:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 -- 172.21.15.100:0/1030768165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0071d40 msgr2=0x7f61e00721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 --2- 172.21.15.100:0/1030768165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0071d40 0x7f61e00721d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f61e008e5c0 tx=0x7f61c802b880 comp rx=0 tx=0).stop 2024-02-21T07:45:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 -- 172.21.15.100:0/1030768165 shutdown_connections 2024-02-21T07:45:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 --2- 172.21.15.100:0/1030768165 >> v2:172.21.15.170:3300/0 conn(0x7f61e006da30 0x7f61e006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 --2- 172.21.15.100:0/1030768165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0071d40 0x7f61e00721d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 --2- 172.21.15.100:0/1030768165 >> v2:172.21.15.100:3300/0 conn(0x7f61e0182f60 0x7f61e0186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.097+0000 7f61e6000640 1 -- 172.21.15.100:0/1030768165 >> 172.21.15.100:0/1030768165 conn(0x7f61e00668b0 msgr2=0x7f61e0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:40.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.098+0000 7f61e6000640 1 -- 172.21.15.100:0/1030768165 shutdown_connections 2024-02-21T07:45:40.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.098+0000 7f61e6000640 1 -- 172.21.15.100:0/1030768165 wait complete. 2024-02-21T07:45:40.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.100+0000 7f61e6000640 1 Processor -- start 2024-02-21T07:45:40.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.100+0000 7f61e6000640 1 -- start start 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 0x7f61e0175560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 0x7f61e01570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 0x7f61e00f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0176ab0 con 0x7f61e0071d40 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0175f30 con 0x7f61e0182f60 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61e6000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0176210 con 0x7f61e006da30 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 0x7f61e01570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 0x7f61e0175560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 0x7f61e01570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49820/0 (socket says 172.21.15.100:49820) 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61d7e00640 1 -- 172.21.15.100:0/3581149864 learned_addr learned my addr 172.21.15.100:0/3581149864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:40.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.102+0000 7f61dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 0x7f61e00f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 -- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 msgr2=0x7f61e00f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 0x7f61e00f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 -- 172.21.15.100:0/3581149864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 msgr2=0x7f61e01570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 0x7f61e01570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 -- 172.21.15.100:0/3581149864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80094d0 con 0x7f61e006da30 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61dfe00640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 0x7f61e00f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61df400640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 0x7f61e0175560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d000e850 tx=0x7f61d000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00095b0 con 0x7f61e006da30 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d000c940 con 0x7f61e006da30 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d000ccd0 con 0x7f61e006da30 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e01764f0 con 0x7f61e006da30 2024-02-21T07:45:40.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.103+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e00f4cd0 con 0x7f61e006da30 2024-02-21T07:45:40.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.104+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e0067c80 con 0x7f61e006da30 2024-02-21T07:45:40.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.106+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f61d0013470 con 0x7f61e006da30 2024-02-21T07:45:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.107+0000 7f61d7400640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 0x7f61bc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.108+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61d00c9be0 con 0x7f61e006da30 2024-02-21T07:45:40.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.108+0000 7f61d7e00640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 0x7f61bc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.109+0000 7f61d7e00640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 0x7f61bc0a1560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61c80090b0 tx=0x7f61c803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.112+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f61d0093a80 con 0x7f61e006da30 2024-02-21T07:45:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.305+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61e00d2760 con 0x7f61e006da30 2024-02-21T07:45:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.306+0000 7f61d7400640 1 -- 172.21.15.100:0/3581149864 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61d0097140 con 0x7f61e006da30 2024-02-21T07:45:40.312 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:45:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 msgr2=0x7f61bc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 0x7f61bc0a1560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f61c80090b0 tx=0x7f61c803d040 comp rx=0 tx=0).stop 2024-02-21T07:45:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 msgr2=0x7f61e0175560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 0x7f61e0175560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f61d000e850 tx=0x7f61d000ed10 comp rx=0 tx=0).stop 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 shutdown_connections 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61e0182f60 0x7f61e00f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61bc09f0a0 0x7f61bc0a1560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e0071d40 0x7f61e01570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 --2- 172.21.15.100:0/3581149864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61e006da30 0x7f61e0175560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 >> 172.21.15.100:0/3581149864 conn(0x7f61e00668b0 msgr2=0x7f61e01834b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 shutdown_connections 2024-02-21T07:45:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.309+0000 7f61e6000640 1 -- 172.21.15.100:0/3581149864 wait complete. 2024-02-21T07:45:40.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:45:40.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.543+0000 7fbf82600640 1 Processor -- start 2024-02-21T07:45:40.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.543+0000 7fbf82600640 1 -- start start 2024-02-21T07:45:40.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.545+0000 7fbf82600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbf7c070a70 0x7fbf7c18a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.545+0000 7fbf82600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbf7c1888d0 0x7fbf7c188ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.545+0000 7fbf82600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c18aa20 con 0x7fbf7c186280 2024-02-21T07:45:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.545+0000 7fbf82600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0f5580 con 0x7fbf7c1888d0 2024-02-21T07:45:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.545+0000 7fbf82600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf7c0f5860 con 0x7fbf7c070a70 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7b400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbf7c186280 0x7fbf7c189dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:59948/0 (socket says 172.21.15.100:59948) 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7b400640 1 -- 172.21.15.100:0/3037264111 learned_addr learned my addr 172.21.15.100:0/3037264111 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbf7c070a70 0x7fbf7c18a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7be00640 1 --2- 172.21.15.100:0/3037264111 >> v2:172.21.15.156:3300/0 conn(0x7fbf7c1888d0 0x7fbf7c188ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7a000640 1 -- 172.21.15.100:0/3037264111 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360209333 0 0) 0x7fbf7c18aa20 con 0x7fbf7c186280 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7a000640 1 -- 172.21.15.100:0/3037264111 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf60003520 con 0x7fbf7c186280 2024-02-21T07:45:40.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7aa00640 1 -- 172.21.15.100:0/3037264111 >> v2:172.21.15.156:3300/0 conn(0x7fbf7c1888d0 msgr2=0x7fbf7c188ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:40.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7aa00640 1 --2- 172.21.15.100:0/3037264111 >> v2:172.21.15.156:3300/0 conn(0x7fbf7c1888d0 0x7fbf7c188ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7aa00640 1 -- 172.21.15.100:0/3037264111 >> v1:172.21.15.170:6789/0 conn(0x7fbf7c186280 legacy=0x7fbf7c189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.546+0000 7fbf7aa00640 1 -- 172.21.15.100:0/3037264111 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c0f5b40 con 0x7fbf7c070a70 2024-02-21T07:45:40.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf7aa00640 1 --2- 172.21.15.100:0/3037264111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18a4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0f7940 tx=0x7fbf6802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f2425d4ffd15d5a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf7a000640 1 -- 172.21.15.100:0/3037264111 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6802e070 con 0x7fbf7c070a70 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf7a000640 1 -- 172.21.15.100:0/3037264111 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680315a0 con 0x7fbf7c070a70 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf7a000640 1 -- 172.21.15.100:0/3037264111 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf68031930 con 0x7fbf7c070a70 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf82600640 1 -- 172.21.15.100:0/3037264111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 msgr2=0x7fbf7c18a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf82600640 1 --2- 172.21.15.100:0/3037264111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18a4e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0f7940 tx=0x7fbf6802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.548+0000 7fbf82600640 1 -- 172.21.15.100:0/3037264111 shutdown_connections 2024-02-21T07:45:40.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.549+0000 7fbf82600640 1 --2- 172.21.15.100:0/3037264111 >> v2:172.21.15.156:3300/0 conn(0x7fbf7c1888d0 0x7fbf7c188ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.549+0000 7fbf82600640 1 --2- 172.21.15.100:0/3037264111 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18a4e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.549+0000 7fbf82600640 1 -- 172.21.15.100:0/3037264111 >> 172.21.15.100:0/3037264111 conn(0x7fbf7c0668b0 msgr2=0x7fbf7c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.549+0000 7fbf82600640 1 -- 172.21.15.100:0/3037264111 shutdown_connections 2024-02-21T07:45:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.549+0000 7fbf82600640 1 -- 172.21.15.100:0/3037264111 wait complete. 2024-02-21T07:45:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.551+0000 7fbf82600640 1 Processor -- start 2024-02-21T07:45:40.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.551+0000 7fbf82600640 1 -- start start 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 0x7fbf7c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c18c320 con 0x7fbf7c186280 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1731e0 con 0x7fbf7c1888d0 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf82600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1734c0 con 0x7fbf7c070a70 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49826/0 (socket says 172.21.15.100:49826) 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf7aa00640 1 -- 172.21.15.100:0/3591356144 learned_addr learned my addr 172.21.15.100:0/3591356144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:40.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf7b400640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.552+0000 7fbf7be00640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 0x7fbf7c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 -- 172.21.15.100:0/3591356144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 msgr2=0x7fbf7c18c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 -- 172.21.15.100:0/3591356144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 msgr2=0x7fbf7c1853d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 -- 172.21.15.100:0/3591356144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68009400 con 0x7fbf7c1888d0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7aa00640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf7be00640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 0x7fbf7c0cd840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400eba0 tx=0x7fbf7400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400cd20 con 0x7fbf7c1888d0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400f040 con 0x7fbf7c1888d0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.553+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740146c0 con 0x7fbf7c1888d0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.554+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c1737a0 con 0x7fbf7c1888d0 2024-02-21T07:45:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.554+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c173d60 con 0x7fbf7c1888d0 2024-02-21T07:45:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.555+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c08e110 con 0x7fbf7c1888d0 2024-02-21T07:45:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.556+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbf74014820 con 0x7fbf7c1888d0 2024-02-21T07:45:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.558+0000 7fbf73400640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 0x7fbf5c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.558+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbf740cad70 con 0x7fbf7c1888d0 2024-02-21T07:45:40.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.558+0000 7fbf7b400640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 0x7fbf5c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:40.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.559+0000 7fbf7b400640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 0x7fbf5c0a1560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005880 tx=0x7fbf6c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:40.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.561+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbf74094b80 con 0x7fbf7c1888d0 2024-02-21T07:45:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.754+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf7c173f50 con 0x7fbf7c1888d0 2024-02-21T07:45:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.755+0000 7fbf73400640 1 -- 172.21.15.100:0/3591356144 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbf74018070 con 0x7fbf7c1888d0 2024-02-21T07:45:40.762 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 msgr2=0x7fbf5c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 0x7fbf5c0a1560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c005880 tx=0x7fbf6c009040 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 msgr2=0x7fbf7c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 0x7fbf7c0cd840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400eba0 tx=0x7fbf7400c490 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 shutdown_connections 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbf7c1888d0 0x7fbf7c0cd840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbf5c09f0a0 0x7fbf5c0a1560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf7c186280 0x7fbf7c1853d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 --2- 172.21.15.100:0/3591356144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbf7c070a70 0x7fbf7c18c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 >> 172.21.15.100:0/3591356144 conn(0x7fbf7c0668b0 msgr2=0x7fbf7c18a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 shutdown_connections 2024-02-21T07:45:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.758+0000 7fbf82600640 1 -- 172.21.15.100:0/3591356144 wait complete. 2024-02-21T07:45:40.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:45:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.989+0000 7f2ee9a00640 1 Processor -- start 2024-02-21T07:45:40.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.989+0000 7f2ee9a00640 1 -- start start 2024-02-21T07:45:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.991+0000 7f2ee9a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40ca6a0 con 0x7f2ee418a790 2024-02-21T07:45:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.991+0000 7f2ee9a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40f6200 con 0x7f2ee4189ca0 2024-02-21T07:45:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.991+0000 7f2ee9a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee406afc0 con 0x7f2ee406ab60 2024-02-21T07:45:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2ee4189ca0 0x7f2ee40cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36482/0 (socket says 172.21.15.100:36482) 2024-02-21T07:45:40.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2a00640 1 -- 172.21.15.100:0/3934294778 learned_addr learned my addr 172.21.15.100:0/3934294778 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676768128 0 0) 0x7f2ee40f6200 con 0x7f2ee4189ca0 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec8003520 con 0x7f2ee4189ca0 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927533879 0 0) 0x7f2ee406afc0 con 0x7f2ee406ab60 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee40f6200 con 0x7f2ee406ab60 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136315497 0 0) 0x7f2ec8003520 con 0x7f2ee4189ca0 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 >> v1:172.21.15.170:6789/0 conn(0x7f2ee406ab60 legacy=0x7f2ee418a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 >> v1:172.21.15.100:6789/0 conn(0x7f2ee418a790 legacy=0x7f2ee418f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40f6450 con 0x7f2ee4189ca0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f2ed4001670 con 0x7f2ee4189ca0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 >> v1:172.21.15.156:6789/0 conn(0x7f2ee4189ca0 legacy=0x7f2ee40cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.992+0000 7f2ee2000640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ec8004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2000640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec8003760 0x7f2ec8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2000640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8004240 0x7f2ec800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc001250 con 0x7f2ec8004bc0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec800c170 con 0x7f2ec8004240 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec800c330 con 0x7f2ec8003760 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ec8004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2edbe00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec8003760 0x7f2ec8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee3400640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8004240 0x7f2ec800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 -- 172.21.15.100:0/3934294778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec8003760 msgr2=0x7f2ec8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:41.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ec8003760 0x7f2ec8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 -- 172.21.15.100:0/3934294778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8004240 msgr2=0x7f2ec800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:41.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8004240 0x7f2ec800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee2a00640 1 -- 172.21.15.100:0/3934294778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8003520 con 0x7f2ec8004bc0 2024-02-21T07:45:41.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.993+0000 7f2ee3400640 1 -- 172.21.15.100:0/3934294778 reap_dead start 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.994+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ec8004fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4007fd0 tx=0x7f2ec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73013e36e15e2f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4005ad0 con 0x7f2ec8004bc0 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed4005c50 con 0x7f2ec8004bc0 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee2000640 1 -- 172.21.15.100:0/3934294778 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed402c850 con 0x7f2ec8004bc0 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 msgr2=0x7f2ec8004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ec8004fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4007fd0 tx=0x7f2ec80057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3934294778 shutdown_connections 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3934294778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ec8004fa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3934294778 >> 172.21.15.100:0/3934294778 conn(0x7f2ee40668b0 msgr2=0x7f2ee4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3934294778 shutdown_connections 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.995+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3934294778 wait complete. 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.997+0000 7f2ee9a00640 1 Processor -- start 2024-02-21T07:45:41.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.998+0000 7f2ee9a00640 1 -- start start 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 0x7f2ee40f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee40f7ef0 0x7f2ee4188930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40f2ac0 con 0x7f2ec8004bc0 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee415e4d0 con 0x7f2ee40f7ef0 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40f2d80 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 0x7f2ee40f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49856/0 (socket says 172.21.15.100:49856) 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee2a00640 1 -- 172.21.15.100:0/3929285362 learned_addr learned my addr 172.21.15.100:0/3929285362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2ee3400640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee40f7ef0 0x7f2ee4188930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 -- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee40f7ef0 msgr2=0x7f2ee4188930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee40f7ef0 0x7f2ee4188930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 -- 172.21.15.100:0/3929285362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 msgr2=0x7f2ee415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:40.999+0000 7f2edbe00640 1 -- 172.21.15.100:0/3929285362 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40f3060 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2edbe00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 0x7f2ee40f79b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4068330 tx=0x7f2ecc00fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00fec0 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0052e0 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00d870 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40f3340 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.000+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee40f3900 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.001+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee408e1c0 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.003+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2ecc00d9d0 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.005+0000 7f2edaa00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 0x7f2ec00a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.005+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f2ecc0c9a80 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.005+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 0x7f2ec00a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.006+0000 7f2ee2a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 0x7f2ec00a1590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4000f60 tx=0x7f2ed4007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.009+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ecc0937e0 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.201+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ee408de30 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.202+0000 7f2edaa00640 1 -- 172.21.15.100:0/3929285362 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ecc095710 con 0x7f2ee40f0eb0 2024-02-21T07:45:41.208 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:45:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.204+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 msgr2=0x7f2ec00a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.204+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 0x7f2ec00a1590 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ed4000f60 tx=0x7f2ed4007000 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.204+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 msgr2=0x7f2ee40f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.204+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 0x7f2ee40f79b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4068330 tx=0x7f2ecc00fc70 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 shutdown_connections 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ee40f7ef0 0x7f2ee4188930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ee40f0eb0 0x7f2ee40f79b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ec009f0d0 0x7f2ec00a1590 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 --2- 172.21.15.100:0/3929285362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec8004bc0 0x7f2ee415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 >> 172.21.15.100:0/3929285362 conn(0x7f2ee40668b0 msgr2=0x7f2ee4073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 shutdown_connections 2024-02-21T07:45:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.205+0000 7f2ee9a00640 1 -- 172.21.15.100:0/3929285362 wait complete. 2024-02-21T07:45:41.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:45:41.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.434+0000 7f31bb600640 1 Processor -- start 2024-02-21T07:45:41.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.435+0000 7f31bb600640 1 -- start start 2024-02-21T07:45:41.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31bb600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31b406ab60 0x7f31b41871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31bb600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40ca6a0 con 0x7f31b418a080 2024-02-21T07:45:41.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31bb600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40f6200 con 0x7f31b4189ca0 2024-02-21T07:45:41.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31bb600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b418abe0 con 0x7f31b406ab60 2024-02-21T07:45:41.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31abe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31b406ab60 0x7f31b41871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31b8c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f31b4189ca0 0x7f31b40cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36496/0 (socket says 172.21.15.100:36496) 2024-02-21T07:45:41.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31b8c00640 1 -- 172.21.15.100:0/1661094391 learned_addr learned my addr 172.21.15.100:0/1661094391 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:41.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31b3e00640 1 -- 172.21.15.100:0/1661094391 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621767837 0 0) 0x7f31b40f6200 con 0x7f31b4189ca0 2024-02-21T07:45:41.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31b3e00640 1 -- 172.21.15.100:0/1661094391 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3198003520 con 0x7f31b4189ca0 2024-02-21T07:45:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31abe00640 1 -- 172.21.15.100:0/1661094391 >> v1:172.21.15.156:6789/0 conn(0x7f31b4189ca0 legacy=0x7f31b40cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31abe00640 1 -- 172.21.15.100:0/1661094391 >> v1:172.21.15.100:6789/0 conn(0x7f31b418a080 legacy=0x7f31b418a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.437+0000 7f31abe00640 1 -- 172.21.15.100:0/1661094391 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b406afc0 con 0x7f31b406ab60 2024-02-21T07:45:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31abe00640 1 --2- 172.21.15.100:0/1661094391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b41871c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f319c0097a0 tx=0x7f319c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47576bed5b80c948 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31b3e00640 1 -- 172.21.15.100:0/1661094391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c030610 con 0x7f31b406ab60 2024-02-21T07:45:41.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31b3e00640 1 -- 172.21.15.100:0/1661094391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c030770 con 0x7f31b406ab60 2024-02-21T07:45:41.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31b3e00640 1 -- 172.21.15.100:0/1661094391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c030b00 con 0x7f31b406ab60 2024-02-21T07:45:41.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31bb600640 1 -- 172.21.15.100:0/1661094391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 msgr2=0x7f31b41871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.439+0000 7f31bb600640 1 --2- 172.21.15.100:0/1661094391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b41871c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f319c0097a0 tx=0x7f319c02b960 comp rx=0 tx=0).stop 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.440+0000 7f31bb600640 1 -- 172.21.15.100:0/1661094391 shutdown_connections 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.440+0000 7f31bb600640 1 --2- 172.21.15.100:0/1661094391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b41871c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.440+0000 7f31bb600640 1 -- 172.21.15.100:0/1661094391 >> 172.21.15.100:0/1661094391 conn(0x7f31b40668b0 msgr2=0x7f31b4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.440+0000 7f31bb600640 1 -- 172.21.15.100:0/1661094391 shutdown_connections 2024-02-21T07:45:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.440+0000 7f31bb600640 1 -- 172.21.15.100:0/1661094391 wait complete. 2024-02-21T07:45:41.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.442+0000 7f31bb600640 1 Processor -- start 2024-02-21T07:45:41.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.442+0000 7f31bb600640 1 -- start start 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4189ca0 0x7f31b4222320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b418a080 0x7f31b4222860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40f82c0 con 0x7f31b406ab60 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40f03f0 con 0x7f31b418a080 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31bb600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40f06d0 con 0x7f31b4189ca0 2024-02-21T07:45:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31b8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31b9600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b418a080 0x7f31b4222860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31b8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49872/0 (socket says 172.21.15.100:49872) 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31b8c00640 1 -- 172.21.15.100:0/4239745981 learned_addr learned my addr 172.21.15.100:0/4239745981 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.443+0000 7f31abe00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4189ca0 0x7f31b4222320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 -- 172.21.15.100:0/4239745981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4189ca0 msgr2=0x7f31b4222320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4189ca0 0x7f31b4222320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 -- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b418a080 msgr2=0x7f31b4222860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b418a080 0x7f31b4222860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 -- 172.21.15.100:0/4239745981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c009400 con 0x7f31b406ab60 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b8c00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c500 tx=0x7f31a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4005ce0 con 0x7f31b406ab60 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4005e40 con 0x7f31b406ab60 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4007330 con 0x7f31b406ab60 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.444+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40f7990 con 0x7f31b406ab60 2024-02-21T07:45:41.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.445+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40f7f50 con 0x7f31b406ab60 2024-02-21T07:45:41.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.446+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b408e1c0 con 0x7f31b406ab60 2024-02-21T07:45:41.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.448+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f31a4007550 con 0x7f31b406ab60 2024-02-21T07:45:41.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.449+0000 7f31b1600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 0x7f31900a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.449+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f31a40c9120 con 0x7f31b406ab60 2024-02-21T07:45:41.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.449+0000 7f31abe00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 0x7f31900a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.450+0000 7f31abe00640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 0x7f31900a14e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f319c036000 tx=0x7f319c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.453+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f31a4093020 con 0x7f31b406ab60 2024-02-21T07:45:41.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:41.586 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:41.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.662+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31b4068390 con 0x7f31b406ab60 2024-02-21T07:45:41.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.662+0000 7f31b1600640 1 -- 172.21.15.100:0/4239745981 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31a4017080 con 0x7f31b406ab60 2024-02-21T07:45:41.669 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 msgr2=0x7f31900a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 0x7f31900a14e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f319c036000 tx=0x7f319c008030 comp rx=0 tx=0).stop 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 msgr2=0x7f31b4166c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31a400c500 tx=0x7f31a400c9c0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 shutdown_connections 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b418a080 0x7f31b4222860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b4189ca0 0x7f31b4222320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f319009f020 0x7f31900a14e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 --2- 172.21.15.100:0/4239745981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31b406ab60 0x7f31b4166c10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 >> 172.21.15.100:0/4239745981 conn(0x7f31b40668b0 msgr2=0x7f31b418a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:41.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 shutdown_connections 2024-02-21T07:45:41.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.665+0000 7f31bb600640 1 -- 172.21.15.100:0/4239745981 wait complete. 2024-02-21T07:45:41.688 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:45:41.688 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:45:41.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:41.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.985+0000 7f740e600640 1 Processor -- start 2024-02-21T07:45:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.985+0000 7f740e600640 1 -- start start 2024-02-21T07:45:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f740e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74080cb5d0 con 0x7f74081844e0 2024-02-21T07:45:41.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f740e600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740806eec0 con 0x7f7408183f70 2024-02-21T07:45:41.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f740e600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74080cbb00 con 0x7f74080f9800 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f7407e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f74080f9800 0x7f7408186510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:59952/0 (socket says 172.21.15.100:59952) 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f73fea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f74081844e0 0x7f74080f90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59614/0 (socket says 172.21.15.100:59614) 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.987+0000 7f7407e00640 1 -- 172.21.15.100:0/1873880043 learned_addr learned my addr 172.21.15.100:0/1873880043 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821264698 0 0) 0x7f74080cbb00 con 0x7f74080f9800 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73ec003520 con 0x7f74080f9800 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866728375 0 0) 0x7f740806eec0 con 0x7f7408183f70 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74080cbb00 con 0x7f7408183f70 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491571330 0 0) 0x7f74080cb5d0 con 0x7f74081844e0 2024-02-21T07:45:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740806eec0 con 0x7f74081844e0 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 164397132 0 0) 0x7f73ec003520 con 0x7f74080f9800 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 >> v1:172.21.15.156:6789/0 conn(0x7f7408183f70 legacy=0x7f740806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 >> v1:172.21.15.100:6789/0 conn(0x7f74081844e0 legacy=0x7f74080f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080cb820 con 0x7f74080f9800 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f7400001670 con 0x7f74080f9800 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 >> v1:172.21.15.170:6789/0 conn(0x7f74080f9800 legacy=0x7f7408186510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 0x7f73ec0040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ec004830 0x7f73ec004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.988+0000 7f7406a00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec0053c0 0x7f73ec00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec00c2d0 con 0x7f73ec004830 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec00c440 con 0x7f73ec003ce0 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec00c600 con 0x7f73ec0053c0 2024-02-21T07:45:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f73fea00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ec004830 0x7f73ec004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 0x7f73ec0040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407e00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec0053c0 0x7f73ec00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 -- 172.21.15.100:0/1873880043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec0053c0 msgr2=0x7f73ec00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec0053c0 0x7f73ec00ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 -- 172.21.15.100:0/1873880043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ec004830 msgr2=0x7f73ec004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ec004830 0x7f73ec004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407400640 1 -- 172.21.15.100:0/1873880043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080cb820 con 0x7f73ec003ce0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f73fea00640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73ec004830 0x7f73ec004cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.989+0000 7f7407e00640 1 -- 172.21.15.100:0/1873880043 reap_dead start 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.990+0000 7f7407400640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 0x7f73ec0040c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001fa0 tx=0x7f73ec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f1cef9c0d28809 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.990+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8006d50 con 0x7f73ec003ce0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f8003970 con 0x7f73ec003ce0 2024-02-21T07:45:41.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f7406a00640 1 -- 172.21.15.100:0/1873880043 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8003d60 con 0x7f73ec003ce0 2024-02-21T07:45:42.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 -- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 msgr2=0x7f73ec0040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 0x7f73ec0040c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73f8001fa0 tx=0x7f73ec0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 -- 172.21.15.100:0/1873880043 shutdown_connections 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 --2- 172.21.15.100:0/1873880043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73ec003ce0 0x7f73ec0040c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 -- 172.21.15.100:0/1873880043 >> 172.21.15.100:0/1873880043 conn(0x7f74080ce160 msgr2=0x7f74080ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 -- 172.21.15.100:0/1873880043 shutdown_connections 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.991+0000 7f740e600640 1 -- 172.21.15.100:0/1873880043 wait complete. 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.993+0000 7f740e600640 1 Processor -- start 2024-02-21T07:45:42.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.993+0000 7f740e600640 1 -- start start 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.994+0000 7f740e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec003ce0 0x7f7408211980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f740e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f740e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f740816e5c0 0x7f74080cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f740e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408211ec0 con 0x7f740821f910 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f740e600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74080cc1b0 con 0x7f740816e5c0 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f740e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408212940 con 0x7f73ec003ce0 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49894/0 (socket says 172.21.15.100:49894) 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 -- 172.21.15.100:0/2817021572 learned_addr learned my addr 172.21.15.100:0/2817021572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f7407400640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec003ce0 0x7f7408211980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f7407e00640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f740816e5c0 0x7f74080cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 -- 172.21.15.100:0/2817021572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec003ce0 msgr2=0x7f7408211980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec003ce0 0x7f7408211980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 -- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f740816e5c0 msgr2=0x7f74080cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f740816e5c0 0x7f74080cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 -- 172.21.15.100:0/2817021572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74082120a0 con 0x7f740821f910 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.995+0000 7f73fea00640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f73f0007740 tx=0x7f73f0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.996+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0001d00 con 0x7f740821f910 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.996+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000f8e0 con 0x7f740821f910 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.996+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000fc90 con 0x7f740821f910 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.996+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408212380 con 0x7f740821f910 2024-02-21T07:45:42.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.996+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74080cbe40 con 0x7f740821f910 2024-02-21T07:45:42.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.997+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080cbfd0 con 0x7f740821f910 2024-02-21T07:45:42.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:41.999+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f73f001d460 con 0x7f740821f910 2024-02-21T07:45:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.000+0000 7f73ffe00640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 0x7f73e40a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.000+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f73f00c9890 con 0x7f740821f910 2024-02-21T07:45:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.001+0000 7f7407400640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 0x7f73e40a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.001+0000 7f7407400640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 0x7f73e40a1590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73f8033000 tx=0x7f73f8009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.004+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f73f0093710 con 0x7f740821f910 2024-02-21T07:45:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.203+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7408067c80 con 0x7f740821f910 2024-02-21T07:45:42.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.207+0000 7f73ffe00640 1 -- 172.21.15.100:0/2817021572 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f73f0096dd0 con 0x7f740821f910 2024-02-21T07:45:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:42.214 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.209+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 msgr2=0x7f73e40a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.209+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 0x7f73e40a1590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73f8033000 tx=0x7f73f8009030 comp rx=0 tx=0).stop 2024-02-21T07:45:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.209+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 msgr2=0x7f740816e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.209+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f73f0007740 tx=0x7f73f0001a50 comp rx=0 tx=0).stop 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 shutdown_connections 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f740816e5c0 0x7f74080cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f73e409f0d0 0x7f73e40a1590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f740821f910 0x7f740816e080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 --2- 172.21.15.100:0/2817021572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73ec003ce0 0x7f7408211980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 >> 172.21.15.100:0/2817021572 conn(0x7f74080ce160 msgr2=0x7f74080ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 shutdown_connections 2024-02-21T07:45:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.210+0000 7f740e600640 1 -- 172.21.15.100:0/2817021572 wait complete. 2024-02-21T07:45:42.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:45:42.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.445+0000 7f1673000640 1 Processor -- start 2024-02-21T07:45:42.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.445+0000 7f1673000640 1 -- start start 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1673000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f166c17d0b0 0x7f166c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1673000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 0x7f166c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1673000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f166c0cac60 con 0x7f166c0cb630 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1673000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c17d490 con 0x7f166c0f9680 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1673000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f166c0f9a90 con 0x7f166c17d0b0 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1671200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f166c0cb630 0x7f166c0f8f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59620/0 (socket says 172.21.15.100:59620) 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1671200640 1 -- 172.21.15.100:0/3955427995 learned_addr learned my addr 172.21.15.100:0/3955427995 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.447+0000 7f1671c00640 1 --2- 172.21.15.100:0/3955427995 >> v2:172.21.15.170:3300/0 conn(0x7f166c17d0b0 0x7f166c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1672600640 1 --2- 172.21.15.100:0/3955427995 >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 0x7f166c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f166be00640 1 -- 172.21.15.100:0/3955427995 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665125942 0 0) 0x7f166c0cac60 con 0x7f166c0cb630 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f166be00640 1 -- 172.21.15.100:0/3955427995 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1654003520 con 0x7f166c0cb630 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1671c00640 1 -- 172.21.15.100:0/3955427995 >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 msgr2=0x7f166c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1671c00640 1 --2- 172.21.15.100:0/3955427995 >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 0x7f166c06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1671c00640 1 -- 172.21.15.100:0/3955427995 >> v1:172.21.15.100:6789/0 conn(0x7f166c0cb630 legacy=0x7f166c0f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1671c00640 1 -- 172.21.15.100:0/3955427995 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f166c0cba90 con 0x7f166c17d0b0 2024-02-21T07:45:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.448+0000 7f1672600640 1 --2- 172.21.15.100:0/3955427995 >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 0x7f166c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.449+0000 7f1671c00640 1 --2- 172.21.15.100:0/3955427995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c17d0b0 0x7f166c0cb0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f166c08d5e0 tx=0x7f166002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e258dfc4eb1b96 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f166be00640 1 -- 172.21.15.100:0/3955427995 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660031830 con 0x7f166c17d0b0 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f166be00640 1 -- 172.21.15.100:0/3955427995 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660031990 con 0x7f166c17d0b0 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f166be00640 1 -- 172.21.15.100:0/3955427995 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660031d20 con 0x7f166c17d0b0 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 -- 172.21.15.100:0/3955427995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c17d0b0 msgr2=0x7f166c0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 --2- 172.21.15.100:0/3955427995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c17d0b0 0x7f166c0cb0f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f166c08d5e0 tx=0x7f166002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 -- 172.21.15.100:0/3955427995 shutdown_connections 2024-02-21T07:45:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 --2- 172.21.15.100:0/3955427995 >> v2:172.21.15.156:3300/0 conn(0x7f166c0f9680 0x7f166c06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 --2- 172.21.15.100:0/3955427995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c17d0b0 0x7f166c0cb0f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 -- 172.21.15.100:0/3955427995 >> 172.21.15.100:0/3955427995 conn(0x7f166c0ce150 msgr2=0x7f166c0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.450+0000 7f1673000640 1 -- 172.21.15.100:0/3955427995 shutdown_connections 2024-02-21T07:45:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.451+0000 7f1673000640 1 -- 172.21.15.100:0/3955427995 wait complete. 2024-02-21T07:45:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.452+0000 7f1673000640 1 Processor -- start 2024-02-21T07:45:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.453+0000 7f1673000640 1 -- start start 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0cb630 0x7f166c181390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c0f9680 0x7f166c16b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c21d470 con 0x7f166c17d0b0 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c21e5b0 con 0x7f166c0f9680 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1673000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166c21d6c0 con 0x7f166c0cb630 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49906/0 (socket says 172.21.15.100:49906) 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 -- 172.21.15.100:0/3347514678 learned_addr learned my addr 172.21.15.100:0/3347514678 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1671200640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c0f9680 0x7f166c16b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1671c00640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0cb630 0x7f166c181390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 -- 172.21.15.100:0/3347514678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0cb630 msgr2=0x7f166c181390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0cb630 0x7f166c181390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 -- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c0f9680 msgr2=0x7f166c16b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c0f9680 0x7f166c16b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.454+0000 7f1672600640 1 -- 172.21.15.100:0/3347514678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1664009a70 con 0x7f166c17d0b0 2024-02-21T07:45:42.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1672600640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1664009f00 tx=0x7f166400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664009d70 con 0x7f166c17d0b0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166400f040 con 0x7f166c17d0b0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664003bb0 con 0x7f166c17d0b0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1660009400 con 0x7f166c17d0b0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.455+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166c21dc80 con 0x7f166c17d0b0 2024-02-21T07:45:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.456+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166c0751d0 con 0x7f166c17d0b0 2024-02-21T07:45:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.458+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1664014480 con 0x7f166c17d0b0 2024-02-21T07:45:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.459+0000 7f1669600640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 0x7f164c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.460+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f16640ca710 con 0x7f166c17d0b0 2024-02-21T07:45:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.460+0000 7f1671c00640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 0x7f164c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.461+0000 7f1671c00640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 0x7f164c0a1560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1660036000 tx=0x7f166003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.464+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1664094470 con 0x7f166c17d0b0 2024-02-21T07:45:42.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.656+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f166c21e6f0 con 0x7f166c17d0b0 2024-02-21T07:45:42.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.657+0000 7f1669600640 1 -- 172.21.15.100:0/3347514678 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16640963a0 con 0x7f166c17d0b0 2024-02-21T07:45:42.664 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 msgr2=0x7f164c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 0x7f164c0a1560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1660036000 tx=0x7f166003c040 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 msgr2=0x7f166c21ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1664009f00 tx=0x7f166400c490 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 shutdown_connections 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f164c09f0a0 0x7f164c0a1560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f166c17d0b0 0x7f166c21ea40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f166c0f9680 0x7f166c16b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 --2- 172.21.15.100:0/3347514678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f166c0cb630 0x7f166c181390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 >> 172.21.15.100:0/3347514678 conn(0x7f166c0ce150 msgr2=0x7f166c06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 shutdown_connections 2024-02-21T07:45:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.660+0000 7f1673000640 1 -- 172.21.15.100:0/3347514678 wait complete. 2024-02-21T07:45:42.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:45:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.888+0000 7f7951800640 1 Processor -- start 2024-02-21T07:45:42.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.888+0000 7f7951800640 1 -- start start 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.890+0000 7f7951800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f794c188a30 0x7f794c0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.890+0000 7f7951800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0f8510 con 0x7f794c0f9890 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.890+0000 7f7951800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0f87f0 con 0x7f794c0f7fe0 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.890+0000 7f7951800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0f9470 con 0x7f794c188a30 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f7943400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f794c0f9890 0x7f794c188e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59636/0 (socket says 172.21.15.100:59636) 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f7943400640 1 -- 172.21.15.100:0/1943774941 learned_addr learned my addr 172.21.15.100:0/1943774941 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:42.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f794be00640 1 --2- 172.21.15.100:0/1943774941 >> v2:172.21.15.170:3300/0 conn(0x7f794c188a30 0x7f794c0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f794b400640 1 -- 172.21.15.100:0/1943774941 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384347273 0 0) 0x7f794c0f8510 con 0x7f794c0f9890 2024-02-21T07:45:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f794be00640 1 -- 172.21.15.100:0/1943774941 >> v1:172.21.15.156:6789/0 conn(0x7f794c0f7fe0 legacy=0x7f794c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f794be00640 1 -- 172.21.15.100:0/1943774941 >> v1:172.21.15.100:6789/0 conn(0x7f794c0f9890 legacy=0x7f794c188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.891+0000 7f794be00640 1 -- 172.21.15.100:0/1943774941 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0f8ad0 con 0x7f794c188a30 2024-02-21T07:45:42.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.892+0000 7f794be00640 1 --2- 172.21.15.100:0/1943774941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c188a30 0x7f794c0c9470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097a0 tx=0x7f793c02dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb16647289e332b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.892+0000 7f794b400640 1 -- 172.21.15.100:0/1943774941 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c02f8a0 con 0x7f794c188a30 2024-02-21T07:45:42.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f794b400640 1 -- 172.21.15.100:0/1943774941 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c02fa00 con 0x7f794c188a30 2024-02-21T07:45:42.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f794b400640 1 -- 172.21.15.100:0/1943774941 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c02fd90 con 0x7f794c188a30 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 -- 172.21.15.100:0/1943774941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c188a30 msgr2=0x7f794c0c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 --2- 172.21.15.100:0/1943774941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c188a30 0x7f794c0c9470 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097a0 tx=0x7f793c02dae0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 -- 172.21.15.100:0/1943774941 shutdown_connections 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 --2- 172.21.15.100:0/1943774941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c188a30 0x7f794c0c9470 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 -- 172.21.15.100:0/1943774941 >> 172.21.15.100:0/1943774941 conn(0x7f794c0ce150 msgr2=0x7f794c0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 -- 172.21.15.100:0/1943774941 shutdown_connections 2024-02-21T07:45:42.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.893+0000 7f7951800640 1 -- 172.21.15.100:0/1943774941 wait complete. 2024-02-21T07:45:42.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.895+0000 7f7951800640 1 Processor -- start 2024-02-21T07:45:42.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.895+0000 7f7951800640 1 -- start start 2024-02-21T07:45:42.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.896+0000 7f7951800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f794c0f7fe0 0x7f794c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.896+0000 7f7951800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.896+0000 7f7951800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 0x7f794c16b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.896+0000 7f7951800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c16d6e0 con 0x7f794c188a30 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7951800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0cc620 con 0x7f794c0f7fe0 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7951800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c16c7c0 con 0x7f794c16db00 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49918/0 (socket says 172.21.15.100:49918) 2024-02-21T07:45:42.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 -- 172.21.15.100:0/600649997 learned_addr learned my addr 172.21.15.100:0/600649997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f794be00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f794c0f7fe0 0x7f794c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7950e00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 0x7f794c16b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 -- 172.21.15.100:0/600649997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 msgr2=0x7f794c16b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 0x7f794c16b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 -- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f794c0f7fe0 msgr2=0x7f794c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f794c0f7fe0 0x7f794c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:42.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7943400640 1 -- 172.21.15.100:0/600649997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009400 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.897+0000 7f7950e00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 0x7f794c16b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7943400640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f793400c430 tx=0x7f793400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340074e0 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934007660 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934004a20 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c21e0c0 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.898+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c16cd40 con 0x7f794c188a30 2024-02-21T07:45:42.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.899+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c16d820 con 0x7f794c188a30 2024-02-21T07:45:42.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.901+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7934004b80 con 0x7f794c188a30 2024-02-21T07:45:42.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.902+0000 7f7948c00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 0x7f79280a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:42.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.902+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f79340c9900 con 0x7f794c188a30 2024-02-21T07:45:42.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.902+0000 7f794be00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 0x7f79280a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:42.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.903+0000 7f794be00640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 0x7f79280a1560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f793c038000 tx=0x7f793c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:42.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:42.906+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f794c16d820 con 0x7f794c188a30 2024-02-21T07:45:43.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.106+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f794c16d820 con 0x7f794c188a30 2024-02-21T07:45:43.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.107+0000 7f7948c00640 1 -- 172.21.15.100:0/600649997 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f794c16d820 con 0x7f794c188a30 2024-02-21T07:45:43.114 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 msgr2=0x7f79280a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 0x7f79280a1560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f793c038000 tx=0x7f793c008030 comp rx=0 tx=0).stop 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 msgr2=0x7f794c21db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f793400c430 tx=0x7f793400c8f0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 shutdown_connections 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f794c16db00 0x7f794c16b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f0a0 0x7f79280a1560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f794c188a30 0x7f794c21db80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 --2- 172.21.15.100:0/600649997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f794c0f7fe0 0x7f794c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 >> 172.21.15.100:0/600649997 conn(0x7f794c0ce150 msgr2=0x7f794c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:43.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 shutdown_connections 2024-02-21T07:45:43.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.110+0000 7f7951800640 1 -- 172.21.15.100:0/600649997 wait complete. 2024-02-21T07:45:43.136 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:45:43.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.346+0000 7f4029c00640 1 Processor -- start 2024-02-21T07:45:43.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.346+0000 7f4029c00640 1 -- start start 2024-02-21T07:45:43.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4029c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 0x7f4024186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4029c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4024071d40 0x7f40240721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4029c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4024186670 con 0x7f402406da30 2024-02-21T07:45:43.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4029c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4024183340 con 0x7f4024071d40 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4029c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4024071010 con 0x7f4024182f60 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4022000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4024071d40 0x7f40240721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4023400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f402406da30 0x7f402406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59642/0 (socket says 172.21.15.100:59642) 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.348+0000 7f4023400640 1 -- 172.21.15.100:0/1322460941 learned_addr learned my addr 172.21.15.100:0/1322460941 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022a00640 1 --2- 172.21.15.100:0/1322460941 >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 0x7f4024186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022000640 1 -- 172.21.15.100:0/1322460941 >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 msgr2=0x7f4024186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022000640 1 --2- 172.21.15.100:0/1322460941 >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 0x7f4024186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022000640 1 -- 172.21.15.100:0/1322460941 >> v1:172.21.15.100:6789/0 conn(0x7f402406da30 legacy=0x7f402406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022000640 1 -- 172.21.15.100:0/1322460941 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024072710 con 0x7f4024071d40 2024-02-21T07:45:43.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.349+0000 7f4022a00640 1 --2- 172.21.15.100:0/1322460941 >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 0x7f4024186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:43.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.350+0000 7f4022000640 1 --2- 172.21.15.100:0/1322460941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024071d40 0x7f40240721d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4024183480 tx=0x7f401002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dcc55174cb0d58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4021600640 1 -- 172.21.15.100:0/1322460941 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401002e070 con 0x7f4024071d40 2024-02-21T07:45:43.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4021600640 1 -- 172.21.15.100:0/1322460941 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40100315a0 con 0x7f4024071d40 2024-02-21T07:45:43.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4021600640 1 -- 172.21.15.100:0/1322460941 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010031930 con 0x7f4024071d40 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4029c00640 1 -- 172.21.15.100:0/1322460941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024071d40 msgr2=0x7f40240721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4029c00640 1 --2- 172.21.15.100:0/1322460941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024071d40 0x7f40240721d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4024183480 tx=0x7f401002b840 comp rx=0 tx=0).stop 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4029c00640 1 -- 172.21.15.100:0/1322460941 shutdown_connections 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4029c00640 1 --2- 172.21.15.100:0/1322460941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024071d40 0x7f40240721d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.353+0000 7f4029c00640 1 --2- 172.21.15.100:0/1322460941 >> v2:172.21.15.156:3300/0 conn(0x7f4024182f60 0x7f4024186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.354+0000 7f4029c00640 1 -- 172.21.15.100:0/1322460941 >> 172.21.15.100:0/1322460941 conn(0x7f40240668b0 msgr2=0x7f4024066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:43.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.354+0000 7f4029c00640 1 -- 172.21.15.100:0/1322460941 shutdown_connections 2024-02-21T07:45:43.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.354+0000 7f4029c00640 1 -- 172.21.15.100:0/1322460941 wait complete. 2024-02-21T07:45:43.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.356+0000 7f4029c00640 1 Processor -- start 2024-02-21T07:45:43.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.356+0000 7f4029c00640 1 -- start start 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 0x7f4024222180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402421d640 con 0x7f4024182f60 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241595a0 con 0x7f4024071d40 2024-02-21T07:45:43.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4029c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402421c750 con 0x7f402406da30 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4023400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4022a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4022000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 0x7f4024222180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4022a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35630/0 (socket says 172.21.15.100:35630) 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4022a00640 1 -- 172.21.15.100:0/3412996791 learned_addr learned my addr 172.21.15.100:0/3412996791 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.357+0000 7f4023400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49938/0 (socket says 172.21.15.100:49938) 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 -- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 msgr2=0x7f4024222180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 0x7f4024222180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 -- 172.21.15.100:0/3412996791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 msgr2=0x7f40242226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 -- 172.21.15.100:0/3412996791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4010009400 con 0x7f402406da30 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022000640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 0x7f4024222180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:43.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4023400640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:43.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4022a00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f401400e7e0 tx=0x7f401400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014004030 con 0x7f402406da30 2024-02-21T07:45:43.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4014004190 con 0x7f402406da30 2024-02-21T07:45:43.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.358+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402421ca30 con 0x7f402406da30 2024-02-21T07:45:43.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.359+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014004520 con 0x7f402406da30 2024-02-21T07:45:43.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.359+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402421cff0 con 0x7f402406da30 2024-02-21T07:45:43.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.360+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4024067c80 con 0x7f402406da30 2024-02-21T07:45:43.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.361+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f401400c6d0 con 0x7f402406da30 2024-02-21T07:45:43.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.363+0000 7f401aa00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 0x7f40040a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.363+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f40140c96d0 con 0x7f402406da30 2024-02-21T07:45:43.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.363+0000 7f4022000640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 0x7f40040a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.364+0000 7f4022000640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 0x7f40040a1590 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4010036000 tx=0x7f401003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.368+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4014093570 con 0x7f402406da30 2024-02-21T07:45:43.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.561+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4024185420 con 0x7f402406da30 2024-02-21T07:45:43.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.562+0000 7f401aa00640 1 -- 172.21.15.100:0/3412996791 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4014096c30 con 0x7f402406da30 2024-02-21T07:45:43.569 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:45:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 msgr2=0x7f40040a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 0x7f40040a1590 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4010036000 tx=0x7f401003d040 comp rx=0 tx=0).stop 2024-02-21T07:45:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 msgr2=0x7f4024159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f401400e7e0 tx=0x7f401400eca0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 shutdown_connections 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f400409f0d0 0x7f40040a1590 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4024182f60 0x7f40242226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4024071d40 0x7f4024222180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 --2- 172.21.15.100:0/3412996791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f402406da30 0x7f4024159060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.565+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 >> 172.21.15.100:0/3412996791 conn(0x7f40240668b0 msgr2=0x7f4024066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.566+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 shutdown_connections 2024-02-21T07:45:43.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.566+0000 7f4029c00640 1 -- 172.21.15.100:0/3412996791 wait complete. 2024-02-21T07:45:43.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:45:43.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.797+0000 7f1582c00640 1 Processor -- start 2024-02-21T07:45:43.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.797+0000 7f1582c00640 1 -- start start 2024-02-21T07:45:43.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1582c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f157c186300 0x7f157c18a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1582c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c06bd00 con 0x7f157c0d6810 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1582c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c06bfe0 con 0x7f157c185f20 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1582c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c06d080 con 0x7f157c186300 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1580c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f157c0d6810 0x7f157c1889c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36516/0 (socket says 172.21.15.100:36516) 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.799+0000 7f1580c00640 1 -- 172.21.15.100:0/2984427779 learned_addr learned my addr 172.21.15.100:0/2984427779 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157b400640 1 --2- 172.21.15.100:0/2984427779 >> v2:172.21.15.170:3300/0 conn(0x7f157c186300 0x7f157c18a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157b400640 1 -- 172.21.15.100:0/2984427779 >> v1:172.21.15.170:6789/0 conn(0x7f157c185f20 legacy=0x7f157c189eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157aa00640 1 -- 172.21.15.100:0/2984427779 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879606199 0 0) 0x7f157c06bd00 con 0x7f157c0d6810 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157b400640 1 -- 172.21.15.100:0/2984427779 >> v1:172.21.15.156:6789/0 conn(0x7f157c0d6810 legacy=0x7f157c1889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157b400640 1 -- 172.21.15.100:0/2984427779 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c06c2c0 con 0x7f157c186300 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157b400640 1 --2- 172.21.15.100:0/2984427779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c186300 0x7f157c18a5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1564009d90 tx=0x7f156402bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef19c5ec4dbf0342 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157aa00640 1 -- 172.21.15.100:0/2984427779 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156402c9c0 con 0x7f157c186300 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157aa00640 1 -- 172.21.15.100:0/2984427779 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156402cb20 con 0x7f157c186300 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.801+0000 7f157aa00640 1 -- 172.21.15.100:0/2984427779 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564034440 con 0x7f157c186300 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 -- 172.21.15.100:0/2984427779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c186300 msgr2=0x7f157c18a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 --2- 172.21.15.100:0/2984427779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c186300 0x7f157c18a5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1564009d90 tx=0x7f156402bc90 comp rx=0 tx=0).stop 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 -- 172.21.15.100:0/2984427779 shutdown_connections 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 --2- 172.21.15.100:0/2984427779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c186300 0x7f157c18a5c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 -- 172.21.15.100:0/2984427779 >> 172.21.15.100:0/2984427779 conn(0x7f157c0fe270 msgr2=0x7f157c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:43.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 -- 172.21.15.100:0/2984427779 shutdown_connections 2024-02-21T07:45:43.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.802+0000 7f1582c00640 1 -- 172.21.15.100:0/2984427779 wait complete. 2024-02-21T07:45:43.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.804+0000 7f1582c00640 1 Processor -- start 2024-02-21T07:45:43.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.804+0000 7f1582c00640 1 -- start start 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.805+0000 7f1582c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.805+0000 7f1582c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 0x7f157c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.805+0000 7f1582c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f157c186300 0x7f157c2200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.805+0000 7f1582c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0fd230 con 0x7f157c186300 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.805+0000 7f1582c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0fc990 con 0x7f157c185f20 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f1582c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0fcc70 con 0x7f157c0d6810 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f1580c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f157c186300 0x7f157c2200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35638/0 (socket says 172.21.15.100:35638) 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 -- 172.21.15.100:0/3214098258 learned_addr learned my addr 172.21.15.100:0/3214098258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157b400640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 0x7f157c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 -- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 msgr2=0x7f157c158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 0x7f157c158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 -- 172.21.15.100:0/3214098258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f157c186300 msgr2=0x7f157c2200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f157c186300 0x7f157c2200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157be00640 1 -- 172.21.15.100:0/3214098258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009a70 con 0x7f157c0d6810 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.806+0000 7f157b400640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 0x7f157c158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f157be00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c780 tx=0x7f156c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c005270 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c0053f0 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c00a880 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c0fcf50 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.807+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c21fbc0 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.808+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c067c80 con 0x7f157c0d6810 2024-02-21T07:45:43.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.810+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f156c00a9e0 con 0x7f157c0d6810 2024-02-21T07:45:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.811+0000 7f1573e00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 0x7f15580a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.811+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f156c0ca070 con 0x7f157c0d6810 2024-02-21T07:45:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.812+0000 7f157b400640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 0x7f15580a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.813+0000 7f157b400640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 0x7f15580a1590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1564036000 tx=0x7f1564030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:43.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:43.813+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f156c093f60 con 0x7f157c0d6810 2024-02-21T07:45:44.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.010+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f157c1809b0 con 0x7f157c0d6810 2024-02-21T07:45:44.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.011+0000 7f1573e00640 1 -- 172.21.15.100:0/3214098258 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f156c097620 con 0x7f157c0d6810 2024-02-21T07:45:44.020 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:45:44.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 msgr2=0x7f15580a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 0x7f15580a1590 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1564036000 tx=0x7f1564030000 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 msgr2=0x7f157c0fc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c780 tx=0x7f156c00cc40 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 shutdown_connections 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f155809f0d0 0x7f15580a1590 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f157c186300 0x7f157c2200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f157c185f20 0x7f157c158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 --2- 172.21.15.100:0/3214098258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f157c0d6810 0x7f157c0fc070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.013+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 >> 172.21.15.100:0/3214098258 conn(0x7f157c0fe270 msgr2=0x7f157c1643d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.014+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 shutdown_connections 2024-02-21T07:45:44.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.014+0000 7f1582c00640 1 -- 172.21.15.100:0/3214098258 wait complete. 2024-02-21T07:45:44.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:45:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.241+0000 7f5348e00640 1 Processor -- start 2024-02-21T07:45:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.241+0000 7f5348e00640 1 -- start start 2024-02-21T07:45:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5348e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f534418a790 0x7f534406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5348e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440ca6a0 con 0x7f5344189ca0 2024-02-21T07:45:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5348e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440f6200 con 0x7f534406ab60 2024-02-21T07:45:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5348e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534418abe0 con 0x7f534418a790 2024-02-21T07:45:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5341400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f534406ab60 0x7f534418a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36522/0 (socket says 172.21.15.100:36522) 2024-02-21T07:45:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5341400640 1 -- 172.21.15.100:0/724455545 learned_addr learned my addr 172.21.15.100:0/724455545 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5342800640 1 --2- 172.21.15.100:0/724455545 >> v2:172.21.15.100:3300/0 conn(0x7f534418a790 0x7f534406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390490 0 0) 0x7f53440f6200 con 0x7f534406ab60 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5328003520 con 0x7f534406ab60 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.243+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198730652 0 0) 0x7f53440ca6a0 con 0x7f5344189ca0 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.244+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53440f6200 con 0x7f5344189ca0 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.244+0000 7f5342800640 1 -- 172.21.15.100:0/724455545 >> v1:172.21.15.156:6789/0 conn(0x7f534406ab60 legacy=0x7f534418a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.244+0000 7f5342800640 1 -- 172.21.15.100:0/724455545 >> v1:172.21.15.100:6789/0 conn(0x7f5344189ca0 legacy=0x7f53440cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.244+0000 7f5342800640 1 -- 172.21.15.100:0/724455545 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534406afc0 con 0x7f534418a790 2024-02-21T07:45:44.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5342800640 1 --2- 172.21.15.100:0/724455545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f534406ea40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097a0 tx=0x7f533c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8bbbb4bf756786 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c030610 con 0x7f534418a790 2024-02-21T07:45:44.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c030770 con 0x7f534418a790 2024-02-21T07:45:44.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5340a00640 1 -- 172.21.15.100:0/724455545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c030b00 con 0x7f534418a790 2024-02-21T07:45:44.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5348e00640 1 -- 172.21.15.100:0/724455545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 msgr2=0x7f534406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.245+0000 7f5348e00640 1 --2- 172.21.15.100:0/724455545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f534406ea40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f533c0097a0 tx=0x7f533c02b960 comp rx=0 tx=0).stop 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.246+0000 7f5348e00640 1 -- 172.21.15.100:0/724455545 shutdown_connections 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.246+0000 7f5348e00640 1 --2- 172.21.15.100:0/724455545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f534406ea40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.246+0000 7f5348e00640 1 -- 172.21.15.100:0/724455545 >> 172.21.15.100:0/724455545 conn(0x7f53440668b0 msgr2=0x7f5344066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.246+0000 7f5348e00640 1 -- 172.21.15.100:0/724455545 shutdown_connections 2024-02-21T07:45:44.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.246+0000 7f5348e00640 1 -- 172.21.15.100:0/724455545 wait complete. 2024-02-21T07:45:44.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.248+0000 7f5348e00640 1 Processor -- start 2024-02-21T07:45:44.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.248+0000 7f5348e00640 1 -- start start 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f534406ab60 0x7f534406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5344189ca0 0x7f5344212bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344213110 con 0x7f534418a790 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344213310 con 0x7f5344189ca0 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5348e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53442135f0 con 0x7f534406ab60 2024-02-21T07:45:44.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5342800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5342800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49968/0 (socket says 172.21.15.100:49968) 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.249+0000 7f5342800640 1 -- 172.21.15.100:0/584207829 learned_addr learned my addr 172.21.15.100:0/584207829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5341400640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5344189ca0 0x7f5344212bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5341e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f534406ab60 0x7f534406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 -- 172.21.15.100:0/584207829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f534406ab60 msgr2=0x7f534406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f534406ab60 0x7f534406e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 -- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5344189ca0 msgr2=0x7f5344212bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5344189ca0 0x7f5344212bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 -- 172.21.15.100:0/584207829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009400 con 0x7f534418a790 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f5342800640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f533c0096f0 tx=0x7f533c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c03e070 con 0x7f534418a790 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c039720 con 0x7f534418a790 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.250+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c039ad0 con 0x7f534418a790 2024-02-21T07:45:44.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.251+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53442138d0 con 0x7f534418a790 2024-02-21T07:45:44.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.251+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5344188d90 con 0x7f534418a790 2024-02-21T07:45:44.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.252+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5344068660 con 0x7f534418a790 2024-02-21T07:45:44.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.253+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f533c039c30 con 0x7f534418a790 2024-02-21T07:45:44.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.255+0000 7f533a000640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 0x7f53200a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.255+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f533c0eba20 con 0x7f534418a790 2024-02-21T07:45:44.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.255+0000 7f5341e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 0x7f53200a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.256+0000 7f5341e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 0x7f53200a1560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5334001ea0 tx=0x7f5334009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.258+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f533c0b5810 con 0x7f534418a790 2024-02-21T07:45:44.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.472+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f534408e1c0 con 0x7f534418a790 2024-02-21T07:45:44.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.473+0000 7f533a000640 1 -- 172.21.15.100:0/584207829 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f533c0b8ed0 con 0x7f534418a790 2024-02-21T07:45:44.479 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 msgr2=0x7f53200a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 0x7f53200a1560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5334001ea0 tx=0x7f5334009040 comp rx=0 tx=0).stop 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 msgr2=0x7f53441892b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f533c0096f0 tx=0x7f533c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 shutdown_connections 2024-02-21T07:45:44.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f532009f0a0 0x7f53200a1560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f534418a790 0x7f53441892b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5344189ca0 0x7f5344212bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 --2- 172.21.15.100:0/584207829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f534406ab60 0x7f534406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.476+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 >> 172.21.15.100:0/584207829 conn(0x7f53440668b0 msgr2=0x7f53440670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.477+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 shutdown_connections 2024-02-21T07:45:44.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.477+0000 7f5348e00640 1 -- 172.21.15.100:0/584207829 wait complete. 2024-02-21T07:45:44.502 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-02-21T07:45:44.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:44.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:45:44.589 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[43009]: fuse finished with error 0 and tester_r 0 2024-02-21T07:45:44.595 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:45:44.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:45:44.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:44.631 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-21T07:45:44.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:44.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.948+0000 7fcce9400640 1 Processor -- start 2024-02-21T07:45:44.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.948+0000 7fcce9400640 1 -- start start 2024-02-21T07:45:44.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcce4183f70 0x7fcce41844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce9400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcce406e7b0 0x7fcce40f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce9400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce40cb5d0 con 0x7fcce406ec10 2024-02-21T07:45:44.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce406e390 con 0x7fcce4183f70 2024-02-21T07:45:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce9400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4187520 con 0x7fcce406e7b0 2024-02-21T07:45:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcce4183f70 0x7fcce41844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce1e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcce406e7b0 0x7fcce40f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcce4183f70 0x7fcce41844e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49972/0 (socket says 172.21.15.100:49972) 2024-02-21T07:45:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.950+0000 7fcce2800640 1 -- 172.21.15.100:0/724650240 learned_addr learned my addr 172.21.15.100:0/724650240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.951+0000 7fcce2800640 1 -- 172.21.15.100:0/724650240 >> v2:172.21.15.156:3300/0 conn(0x7fcce406e7b0 msgr2=0x7fcce40f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.951+0000 7fcce2800640 1 --2- 172.21.15.100:0/724650240 >> v2:172.21.15.156:3300/0 conn(0x7fcce406e7b0 0x7fcce40f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.951+0000 7fcce1400640 1 -- 172.21.15.100:0/724650240 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905597796 0 0) 0x7fcce40cb5d0 con 0x7fcce406ec10 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.951+0000 7fcce2800640 1 -- 172.21.15.100:0/724650240 >> v1:172.21.15.170:6789/0 conn(0x7fcce406ec10 legacy=0x7fcce4189b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.951+0000 7fcce2800640 1 -- 172.21.15.100:0/724650240 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce40cbb00 con 0x7fcce4183f70 2024-02-21T07:45:44.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.952+0000 7fcce2800640 1 --2- 172.21.15.100:0/724650240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce4183f70 0x7fcce41844e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcce40f4290 tx=0x7fccd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d00dcadb32e29f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.952+0000 7fcce1400640 1 -- 172.21.15.100:0/724650240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4031870 con 0x7fcce4183f70 2024-02-21T07:45:44.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.952+0000 7fcce1400640 1 -- 172.21.15.100:0/724650240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd40319d0 con 0x7fcce4183f70 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.952+0000 7fcce1400640 1 -- 172.21.15.100:0/724650240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4031d60 con 0x7fcce4183f70 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 -- 172.21.15.100:0/724650240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce4183f70 msgr2=0x7fcce41844e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 --2- 172.21.15.100:0/724650240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce4183f70 0x7fcce41844e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcce40f4290 tx=0x7fccd402b910 comp rx=0 tx=0).stop 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 -- 172.21.15.100:0/724650240 shutdown_connections 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 --2- 172.21.15.100:0/724650240 >> v2:172.21.15.156:3300/0 conn(0x7fcce406e7b0 0x7fcce40f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 --2- 172.21.15.100:0/724650240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce4183f70 0x7fcce41844e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 -- 172.21.15.100:0/724650240 >> 172.21.15.100:0/724650240 conn(0x7fcce40ce160 msgr2=0x7fcce40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 -- 172.21.15.100:0/724650240 shutdown_connections 2024-02-21T07:45:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.953+0000 7fcce9400640 1 -- 172.21.15.100:0/724650240 wait complete. 2024-02-21T07:45:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.955+0000 7fcce9400640 1 Processor -- start 2024-02-21T07:45:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.955+0000 7fcce9400640 1 -- start start 2024-02-21T07:45:44.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce406ec10 0x7fcce40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce4183f70 0x7fcce40cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4072330 con 0x7fcce406e7b0 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40714d0 con 0x7fcce406ec10 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.956+0000 7fcce9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40717b0 con 0x7fcce4183f70 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49978/0 (socket says 172.21.15.100:49978) 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 -- 172.21.15.100:0/3211419298 learned_addr learned my addr 172.21.15.100:0/3211419298 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce1e00640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce406ec10 0x7fcce40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce3200640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce4183f70 0x7fcce40cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 -- 172.21.15.100:0/3211419298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce4183f70 msgr2=0x7fcce40cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce4183f70 0x7fcce40cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 -- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce406ec10 msgr2=0x7fcce40ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce406ec10 0x7fcce40ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 -- 172.21.15.100:0/3211419298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40094d0 con 0x7fcce406e7b0 2024-02-21T07:45:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.957+0000 7fcce2800640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.958+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd403abe0 con 0x7fcce406e7b0 2024-02-21T07:45:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.958+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd403ad40 con 0x7fcce406e7b0 2024-02-21T07:45:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.958+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4044630 con 0x7fcce406e7b0 2024-02-21T07:45:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.958+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4071a90 con 0x7fcce406e7b0 2024-02-21T07:45:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.958+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4072050 con 0x7fcce406e7b0 2024-02-21T07:45:44.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.959+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce40f8b50 con 0x7fcce406e7b0 2024-02-21T07:45:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.961+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fccd404d450 con 0x7fcce406e7b0 2024-02-21T07:45:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.962+0000 7fccdaa00640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 0x7fccc40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:44.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.962+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fccd402d040 con 0x7fcce406e7b0 2024-02-21T07:45:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.962+0000 7fcce1e00640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 0x7fccc40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:44.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.963+0000 7fcce1e00640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 0x7fccc40a1560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcce40f5100 tx=0x7fccd0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:44.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:44.966+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fccd40b5ea0 con 0x7fcce406e7b0 2024-02-21T07:45:45.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.159+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcce4067c80 con 0x7fcce406e7b0 2024-02-21T07:45:45.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.162+0000 7fccdaa00640 1 -- 172.21.15.100:0/3211419298 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7fccd40b9560 con 0x7fcce406e7b0 2024-02-21T07:45:45.168 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:45.168 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.164+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 msgr2=0x7fccc40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.164+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 0x7fccc40a1560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcce40f5100 tx=0x7fccd0009190 comp rx=0 tx=0).stop 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.164+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 msgr2=0x7fcce4170c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.164+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd40046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.164+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 shutdown_connections 2024-02-21T07:45:45.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcce4183f70 0x7fcce40cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcce406ec10 0x7fcce40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fccc409f0a0 0x7fccc40a1560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 --2- 172.21.15.100:0/3211419298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcce406e7b0 0x7fcce4170c60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 >> 172.21.15.100:0/3211419298 conn(0x7fcce40ce160 msgr2=0x7fcce40700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 shutdown_connections 2024-02-21T07:45:45.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.165+0000 7fcce9400640 1 -- 172.21.15.100:0/3211419298 wait complete. 2024-02-21T07:45:45.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:45.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.396+0000 7f4234800640 1 Processor -- start 2024-02-21T07:45:45.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.396+0000 7f4234800640 1 -- start start 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.398+0000 7f4234800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 0x7f422c0f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.398+0000 7f4234800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f422c1866e0 0x7f422c186b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.398+0000 7f4234800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c189780 con 0x7f422c187080 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.398+0000 7f4234800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0f9ac0 con 0x7f422c1866e0 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.398+0000 7f4234800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c06dc90 con 0x7f422c185f20 2024-02-21T07:45:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f422c1866e0 0x7f422c186b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 0x7f422c0f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4232800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f422c187080 0x7f422c18bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36530/0 (socket says 172.21.15.100:36530) 2024-02-21T07:45:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4232800640 1 -- 172.21.15.100:0/679409075 learned_addr learned my addr 172.21.15.100:0/679409075 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f422c1866e0 0x7f422c186b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49984/0 (socket says 172.21.15.100:49984) 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4230a00640 1 -- 172.21.15.100:0/679409075 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316349677 0 0) 0x7f422c189780 con 0x7f422c187080 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4230a00640 1 -- 172.21.15.100:0/679409075 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4214003520 con 0x7f422c187080 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 -- 172.21.15.100:0/679409075 >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 msgr2=0x7f422c0f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 --2- 172.21.15.100:0/679409075 >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 0x7f422c0f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 -- 172.21.15.100:0/679409075 >> v1:172.21.15.156:6789/0 conn(0x7f422c187080 legacy=0x7f422c18bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231400640 1 -- 172.21.15.100:0/679409075 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c06df70 con 0x7f422c1866e0 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.399+0000 7f4231e00640 1 --2- 172.21.15.100:0/679409075 >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 0x7f422c0f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.400+0000 7f4231400640 1 --2- 172.21.15.100:0/679409075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c186b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f422c08d3f0 tx=0x7f421c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76d4224ce718b92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4230a00640 1 -- 172.21.15.100:0/679409075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c031520 con 0x7f422c1866e0 2024-02-21T07:45:45.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4230a00640 1 -- 172.21.15.100:0/679409075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c031680 con 0x7f422c1866e0 2024-02-21T07:45:45.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4230a00640 1 -- 172.21.15.100:0/679409075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c031a10 con 0x7f422c1866e0 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 -- 172.21.15.100:0/679409075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 msgr2=0x7f422c186b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 --2- 172.21.15.100:0/679409075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c186b40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f422c08d3f0 tx=0x7f421c02b7c0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 -- 172.21.15.100:0/679409075 shutdown_connections 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 --2- 172.21.15.100:0/679409075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c186b40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 --2- 172.21.15.100:0/679409075 >> v2:172.21.15.156:3300/0 conn(0x7f422c185f20 0x7f422c0f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 -- 172.21.15.100:0/679409075 >> 172.21.15.100:0/679409075 conn(0x7f422c0ce160 msgr2=0x7f422c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 -- 172.21.15.100:0/679409075 shutdown_connections 2024-02-21T07:45:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.401+0000 7f4234800640 1 -- 172.21.15.100:0/679409075 wait complete. 2024-02-21T07:45:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.403+0000 7f4234800640 1 Processor -- start 2024-02-21T07:45:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.403+0000 7f4234800640 1 -- start start 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c185f20 0x7f422c170cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f422c187080 0x7f422c181fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1824f0 con 0x7f422c1866e0 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c220fa0 con 0x7f422c187080 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4234800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c221280 con 0x7f422c185f20 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49998/0 (socket says 172.21.15.100:49998) 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 -- 172.21.15.100:0/3759789740 learned_addr learned my addr 172.21.15.100:0/3759789740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231e00640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c185f20 0x7f422c170cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4232800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f422c187080 0x7f422c181fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 -- 172.21.15.100:0/3759789740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c185f20 msgr2=0x7f422c170cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c185f20 0x7f422c170cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 -- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f422c187080 msgr2=0x7f422c181fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f422c187080 0x7f422c181fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.405+0000 7f4231400640 1 -- 172.21.15.100:0/3759789740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220009400 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4231400640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c033c50 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c033dd0 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c03c640 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c009400 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.406+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c221840 con 0x7f422c1866e0 2024-02-21T07:45:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.407+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c067c80 con 0x7f422c1866e0 2024-02-21T07:45:45.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.409+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f421c03a040 con 0x7f422c1866e0 2024-02-21T07:45:45.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.410+0000 7f4226000640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 0x7f42100a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.411+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f421c0eb2b0 con 0x7f422c1866e0 2024-02-21T07:45:45.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.411+0000 7f4231e00640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 0x7f42100a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.412+0000 7f4231e00640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 0x7f42100a1590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4220009c30 tx=0x7f4220009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.414+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f421c0b50c0 con 0x7f422c1866e0 2024-02-21T07:45:45.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.612+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f422c17bf60 con 0x7f422c1866e0 2024-02-21T07:45:45.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.616+0000 7f4226000640 1 -- 172.21.15.100:0/3759789740 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f421c006e10 con 0x7f422c1866e0 2024-02-21T07:45:45.622 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:45.622 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 msgr2=0x7f42100a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 0x7f42100a1590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4220009c30 tx=0x7f4220009190 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 msgr2=0x7f422c181a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f421c000c00 tx=0x7f421c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 shutdown_connections 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f422c187080 0x7f422c181fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f421009f0d0 0x7f42100a1590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f422c1866e0 0x7f422c181a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 --2- 172.21.15.100:0/3759789740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f422c185f20 0x7f422c170cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 >> 172.21.15.100:0/3759789740 conn(0x7f422c0ce160 msgr2=0x7f422c08bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:45.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 shutdown_connections 2024-02-21T07:45:45.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.619+0000 7f4234800640 1 -- 172.21.15.100:0/3759789740 wait complete. 2024-02-21T07:45:45.644 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-21T07:45:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.856+0000 7faee5e00640 1 Processor -- start 2024-02-21T07:45:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.856+0000 7faee5e00640 1 -- start start 2024-02-21T07:45:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.858+0000 7faee5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faee01860b0 0x7faee00fa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.858+0000 7faee5e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faee0188be0 0x7faee0189030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.858+0000 7faee5e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee00fa890 con 0x7faee0185cd0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.858+0000 7faee5e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee006bd90 con 0x7faee01860b0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.858+0000 7faee5e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00f9f30 con 0x7faee0188be0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee4a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7faee0185cd0 0x7faee00d4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36532/0 (socket says 172.21.15.100:36532) 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee4a00640 1 -- 172.21.15.100:0/1491395019 learned_addr learned my addr 172.21.15.100:0/1491395019 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee5400640 1 --2- 172.21.15.100:0/1491395019 >> v2:172.21.15.156:3300/0 conn(0x7faee0188be0 0x7faee0189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faedfe00640 1 --2- 172.21.15.100:0/1491395019 >> v2:172.21.15.100:3300/0 conn(0x7faee01860b0 0x7faee00fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faedf400640 1 -- 172.21.15.100:0/1491395019 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058721977 0 0) 0x7faee00fa890 con 0x7faee0185cd0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faedf400640 1 -- 172.21.15.100:0/1491395019 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec4003520 con 0x7faee0185cd0 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee5400640 1 -- 172.21.15.100:0/1491395019 >> v2:172.21.15.100:3300/0 conn(0x7faee01860b0 msgr2=0x7faee00fa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee5400640 1 --2- 172.21.15.100:0/1491395019 >> v2:172.21.15.100:3300/0 conn(0x7faee01860b0 0x7faee00fa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee5400640 1 -- 172.21.15.100:0/1491395019 >> v1:172.21.15.156:6789/0 conn(0x7faee0185cd0 legacy=0x7faee00d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.859+0000 7faee5400640 1 -- 172.21.15.100:0/1491395019 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee008cff0 con 0x7faee0188be0 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.860+0000 7faee5400640 1 --2- 172.21.15.100:0/1491395019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee0189030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faee00674d0 tx=0x7faed802b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77095cd93339e5b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faedf400640 1 -- 172.21.15.100:0/1491395019 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8031520 con 0x7faee0188be0 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faedf400640 1 -- 172.21.15.100:0/1491395019 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8031680 con 0x7faee0188be0 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faedf400640 1 -- 172.21.15.100:0/1491395019 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8031a10 con 0x7faee0188be0 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 -- 172.21.15.100:0/1491395019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 msgr2=0x7faee0189030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 --2- 172.21.15.100:0/1491395019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee0189030 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faee00674d0 tx=0x7faed802b7c0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 -- 172.21.15.100:0/1491395019 shutdown_connections 2024-02-21T07:45:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 --2- 172.21.15.100:0/1491395019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee0189030 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 --2- 172.21.15.100:0/1491395019 >> v2:172.21.15.100:3300/0 conn(0x7faee01860b0 0x7faee00fa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 -- 172.21.15.100:0/1491395019 >> 172.21.15.100:0/1491395019 conn(0x7faee00fe060 msgr2=0x7faee00fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 -- 172.21.15.100:0/1491395019 shutdown_connections 2024-02-21T07:45:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.861+0000 7faee5e00640 1 -- 172.21.15.100:0/1491395019 wait complete. 2024-02-21T07:45:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.863+0000 7faee5e00640 1 Processor -- start 2024-02-21T07:45:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.864+0000 7faee5e00640 1 -- start start 2024-02-21T07:45:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee01860b0 0x7faee021f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee021fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee02204c0 con 0x7faee0185cd0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee02207a0 con 0x7faee0188be0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0220a80 con 0x7faee01860b0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50014/0 (socket says 172.21.15.100:50014) 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 -- 172.21.15.100:0/2353550553 learned_addr learned my addr 172.21.15.100:0/2353550553 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee5400640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee021fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faedfe00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee01860b0 0x7faee021f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 -- 172.21.15.100:0/2353550553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee01860b0 msgr2=0x7faee021f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee01860b0 0x7faee021f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 -- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 msgr2=0x7faee021fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee021fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.865+0000 7faee4a00640 1 -- 172.21.15.100:0/2353550553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8009400 con 0x7faee0185cd0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faee4a00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faed000c410 tx=0x7faed000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0005ce0 con 0x7faee0185cd0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0005e40 con 0x7faee0185cd0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00072f0 con 0x7faee0185cd0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0220d60 con 0x7faee0185cd0 2024-02-21T07:45:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.866+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee0221320 con 0x7faee0185cd0 2024-02-21T07:45:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.867+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00cfaa0 con 0x7faee0185cd0 2024-02-21T07:45:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.869+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7faed0007510 con 0x7faee0185cd0 2024-02-21T07:45:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.870+0000 7faedcc00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 0x7faebc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.871+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7faed00c91c0 con 0x7faee0185cd0 2024-02-21T07:45:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.871+0000 7faedfe00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 0x7faebc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:45.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.872+0000 7faedfe00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 0x7faebc0a1560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faee00fc200 tx=0x7faec800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:45.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:45.874+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7faed0092fd0 con 0x7faee0185cd0 2024-02-21T07:45:46.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.104+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faee0221510 con 0x7faee0185cd0 2024-02-21T07:45:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.369+0000 7faedcc00640 1 -- 172.21.15.100:0/2353550553 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7faed0094f00 con 0x7faee0185cd0 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.372+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 msgr2=0x7faebc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.372+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 0x7faebc0a1560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faee00fc200 tx=0x7faec800b040 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 msgr2=0x7faee0175630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faed000c410 tx=0x7faed000c8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 shutdown_connections 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faee0188be0 0x7faee021fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faee01860b0 0x7faee021f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faebc09f0a0 0x7faebc0a1560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 --2- 172.21.15.100:0/2353550553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee0185cd0 0x7faee0175630 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 >> 172.21.15.100:0/2353550553 conn(0x7faee00fe060 msgr2=0x7faee00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 shutdown_connections 2024-02-21T07:45:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.373+0000 7faee5e00640 1 -- 172.21.15.100:0/2353550553 wait complete. 2024-02-21T07:45:46.400 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-02-21T07:45:46.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-02-21T07:45:46.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.603+0000 7fbd57200640 1 Processor -- start 2024-02-21T07:45:46.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.603+0000 7fbd57200640 1 -- start start 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd57200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbd580cb800 0x7fbd580f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd57200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd580f94b0 0x7fbd5806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd57200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580cac60 con 0x7fbd5817d0b0 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd57200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5817d490 con 0x7fbd580f94b0 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd57200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5806e830 con 0x7fbd580cb800 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd580f94b0 0x7fbd5806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd580f94b0 0x7fbd5806d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50024/0 (socket says 172.21.15.100:50024) 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 -- 172.21.15.100:0/3808012250 learned_addr learned my addr 172.21.15.100:0/3808012250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd4fe00640 1 --2- 172.21.15.100:0/3808012250 >> v2:172.21.15.156:3300/0 conn(0x7fbd580cb800 0x7fbd580f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 -- 172.21.15.100:0/3808012250 >> v2:172.21.15.156:3300/0 conn(0x7fbd580cb800 msgr2=0x7fbd580f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:46.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 --2- 172.21.15.100:0/3808012250 >> v2:172.21.15.156:3300/0 conn(0x7fbd580cb800 0x7fbd580f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 -- 172.21.15.100:0/3808012250 >> v1:172.21.15.156:6789/0 conn(0x7fbd5817d0b0 legacy=0x7fbd580cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.605+0000 7fbd56800640 1 -- 172.21.15.100:0/3808012250 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5806eb10 con 0x7fbd580f94b0 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.606+0000 7fbd56800640 1 --2- 172.21.15.100:0/3808012250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd5806d950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd580f0d00 tx=0x7fbd5002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a769228d3129e3e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd55400640 1 -- 172.21.15.100:0/3808012250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5002cb20 con 0x7fbd580f94b0 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd55400640 1 -- 172.21.15.100:0/3808012250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5002cc80 con 0x7fbd580f94b0 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd55400640 1 -- 172.21.15.100:0/3808012250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd500343f0 con 0x7fbd580f94b0 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 -- 172.21.15.100:0/3808012250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 msgr2=0x7fbd5806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 --2- 172.21.15.100:0/3808012250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd5806d950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd580f0d00 tx=0x7fbd5002bf80 comp rx=0 tx=0).stop 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 -- 172.21.15.100:0/3808012250 shutdown_connections 2024-02-21T07:45:46.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 --2- 172.21.15.100:0/3808012250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd5806d950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 --2- 172.21.15.100:0/3808012250 >> v2:172.21.15.156:3300/0 conn(0x7fbd580cb800 0x7fbd580f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 -- 172.21.15.100:0/3808012250 >> 172.21.15.100:0/3808012250 conn(0x7fbd580ce150 msgr2=0x7fbd580ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:46.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 -- 172.21.15.100:0/3808012250 shutdown_connections 2024-02-21T07:45:46.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.607+0000 7fbd57200640 1 -- 172.21.15.100:0/3808012250 wait complete. 2024-02-21T07:45:46.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.609+0000 7fbd57200640 1 Processor -- start 2024-02-21T07:45:46.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.609+0000 7fbd57200640 1 -- start start 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd580cb800 0x7fbd580f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd5817d0b0 0x7fbd58220190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580f6270 con 0x7fbd580f94b0 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580f5380 con 0x7fbd5817d0b0 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.610+0000 7fbd57200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580f5660 con 0x7fbd580cb800 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50026/0 (socket says 172.21.15.100:50026) 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 -- 172.21.15.100:0/1859499612 learned_addr learned my addr 172.21.15.100:0/1859499612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd55e00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd580cb800 0x7fbd580f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd56800640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd5817d0b0 0x7fbd58220190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 -- 172.21.15.100:0/1859499612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd580cb800 msgr2=0x7fbd580f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd580cb800 0x7fbd580f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 -- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd5817d0b0 msgr2=0x7fbd58220190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd5817d0b0 0x7fbd58220190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.611+0000 7fbd4fe00640 1 -- 172.21.15.100:0/1859499612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009b30 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd4fe00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000e870 tx=0x7fbd4000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd400094f0 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4000c940 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580f5940 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4000ccf0 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.612+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd580f5f00 con 0x7fbd580f94b0 2024-02-21T07:45:46.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.613+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd580f63e0 con 0x7fbd580f94b0 2024-02-21T07:45:46.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.615+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbd40013470 con 0x7fbd580f94b0 2024-02-21T07:45:46.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.616+0000 7fbd4e000640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 0x7fbd340a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:46.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.616+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbd400c9aa0 con 0x7fbd580f94b0 2024-02-21T07:45:46.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.616+0000 7fbd55e00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 0x7fbd340a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:46.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.617+0000 7fbd55e00640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 0x7fbd340a1590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd48001780 tx=0x7fbd48009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:46.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.620+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd400939a0 con 0x7fbd580f94b0 2024-02-21T07:45:46.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:46.856+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fbd580751d0 con 0x7fbd580f94b0 2024-02-21T07:45:47.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.379+0000 7fbd4e000640 1 -- 172.21.15.100:0/1859499612 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7fbd40097060 con 0x7fbd580f94b0 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 msgr2=0x7fbd340a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 0x7fbd340a1590 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbd48001780 tx=0x7fbd48009040 comp rx=0 tx=0).stop 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 msgr2=0x7fbd58169570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000e870 tx=0x7fbd4000ed30 comp rx=0 tx=0).stop 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 shutdown_connections 2024-02-21T07:45:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd5817d0b0 0x7fbd58220190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbd3409f0d0 0x7fbd340a1590 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd580f94b0 0x7fbd58169570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 --2- 172.21.15.100:0/1859499612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd580cb800 0x7fbd580f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 >> 172.21.15.100:0/1859499612 conn(0x7fbd580ce150 msgr2=0x7fbd5806f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 shutdown_connections 2024-02-21T07:45:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.383+0000 7fbd57200640 1 -- 172.21.15.100:0/1859499612 wait complete. 2024-02-21T07:45:47.414 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-02-21T07:45:47.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.597+0000 7ff09fe00640 1 Processor -- start 2024-02-21T07:45:47.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.598+0000 7ff09fe00640 1 -- start start 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0a0188a30 0x7ff0a00c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09fe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff0a00f7fe0 0x7ff0a0189520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09fe00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a00f8510 con 0x7ff0a00f9890 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00f9470 con 0x7ff0a0188a30 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09fe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a00f87f0 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0a0188a30 0x7ff0a00c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0a0188a30 0x7ff0a00c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50042/0 (socket says 172.21.15.100:50042) 2024-02-21T07:45:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09ea00640 1 -- 172.21.15.100:0/2941261255 learned_addr learned my addr 172.21.15.100:0/2941261255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.600+0000 7ff09f400640 1 --2- 172.21.15.100:0/2941261255 >> v2:172.21.15.170:3300/0 conn(0x7ff0a00f7fe0 0x7ff0a0189520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.601+0000 7ff09ea00640 1 -- 172.21.15.100:0/2941261255 >> v2:172.21.15.170:3300/0 conn(0x7ff0a00f7fe0 msgr2=0x7ff0a0189520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.601+0000 7ff09ea00640 1 --2- 172.21.15.100:0/2941261255 >> v2:172.21.15.170:3300/0 conn(0x7ff0a00f7fe0 0x7ff0a0189520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.601+0000 7ff09ea00640 1 -- 172.21.15.100:0/2941261255 >> v1:172.21.15.170:6789/0 conn(0x7ff0a00f9890 legacy=0x7ff0a0188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.601+0000 7ff09ea00640 1 -- 172.21.15.100:0/2941261255 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a00f8ad0 con 0x7ff0a0188a30 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09ea00640 1 --2- 172.21.15.100:0/2941261255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0188a30 0x7ff0a00c9470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0a006cdc0 tx=0x7ff09002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3d39f5545c111e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09e000640 1 -- 172.21.15.100:0/2941261255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090031870 con 0x7ff0a0188a30 2024-02-21T07:45:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09e000640 1 -- 172.21.15.100:0/2941261255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0900319d0 con 0x7ff0a0188a30 2024-02-21T07:45:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09e000640 1 -- 172.21.15.100:0/2941261255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090031d60 con 0x7ff0a0188a30 2024-02-21T07:45:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09fe00640 1 -- 172.21.15.100:0/2941261255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0188a30 msgr2=0x7ff0a00c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.602+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2941261255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0188a30 0x7ff0a00c9470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff0a006cdc0 tx=0x7ff09002b910 comp rx=0 tx=0).stop 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 -- 172.21.15.100:0/2941261255 shutdown_connections 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2941261255 >> v2:172.21.15.170:3300/0 conn(0x7ff0a00f7fe0 0x7ff0a0189520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2941261255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a0188a30 0x7ff0a00c9470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 -- 172.21.15.100:0/2941261255 >> 172.21.15.100:0/2941261255 conn(0x7ff0a00ce150 msgr2=0x7ff0a00ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 -- 172.21.15.100:0/2941261255 shutdown_connections 2024-02-21T07:45:47.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.603+0000 7ff09fe00640 1 -- 172.21.15.100:0/2941261255 wait complete. 2024-02-21T07:45:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.605+0000 7ff09fe00640 1 Processor -- start 2024-02-21T07:45:47.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.605+0000 7ff09fe00640 1 -- start start 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a0188a30 0x7ff0a01839e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0a0179600 0x7ff0a0183f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0183270 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00f4f40 con 0x7ff0a0179600 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a00f5220 con 0x7ff0a0188a30 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50054/0 (socket says 172.21.15.100:50054) 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09ea00640 1 -- 172.21.15.100:0/2623412200 learned_addr learned my addr 172.21.15.100:0/2623412200 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff097e00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a0188a30 0x7ff0a01839e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.606+0000 7ff09f400640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0a0179600 0x7ff0a0183f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 -- 172.21.15.100:0/2623412200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a0188a30 msgr2=0x7ff0a01839e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a0188a30 0x7ff0a01839e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 -- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0a0179600 msgr2=0x7ff0a0183f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0a0179600 0x7ff0a0183f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 -- 172.21.15.100:0/2623412200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900094d0 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09ea00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff090000c00 tx=0x7ff0900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09003abe0 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09003ad40 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a00f5500 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090044610 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.607+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a01834c0 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.609+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a00751d0 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.610+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff09004d450 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.612+0000 7ff097400640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 0x7ff07c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.612+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ff09002d040 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.612+0000 7ff097e00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 0x7ff07c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.613+0000 7ff097e00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 0x7ff07c0a1560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00680a0 tx=0x7ff088009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:47.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.615+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0900b5e10 con 0x7ff0a00f7fe0 2024-02-21T07:45:47.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:47.836+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff0a00f7dc0 con 0x7ff0a00f7fe0 2024-02-21T07:45:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.389+0000 7ff097400640 1 -- 172.21.15.100:0/2623412200 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff0900b7d40 con 0x7ff0a00f7fe0 2024-02-21T07:45:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 msgr2=0x7ff07c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 0x7ff07c0a1560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00680a0 tx=0x7ff088009040 comp rx=0 tx=0).stop 2024-02-21T07:45:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 msgr2=0x7ff0a00f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:48.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff090000c00 tx=0x7ff0900046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 shutdown_connections 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0a0179600 0x7ff0a0183f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0a0188a30 0x7ff0a01839e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff07c09f0a0 0x7ff07c0a1560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 --2- 172.21.15.100:0/2623412200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0a00f7fe0 0x7ff0a00f4500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 >> 172.21.15.100:0/2623412200 conn(0x7ff0a00ce150 msgr2=0x7ff0a0070670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 shutdown_connections 2024-02-21T07:45:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.393+0000 7ff09fe00640 1 -- 172.21.15.100:0/2623412200 wait complete. 2024-02-21T07:45:48.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-02-21T07:45:48.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.604+0000 7f362f800640 1 Processor -- start 2024-02-21T07:45:48.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.604+0000 7f362f800640 1 -- start start 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3628189ca0 0x7f362806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f36281871c0 0x7f36280cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280ca6a0 con 0x7f3628189ca0 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280f6450 con 0x7f36281871c0 2024-02-21T07:45:48.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.606+0000 7f362f800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36280ca8d0 con 0x7f362818a080 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f362d800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f36281871c0 0x7f36280cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f362d800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35706/0 (socket says 172.21.15.100:35706) 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f36281871c0 0x7f36280cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42738/0 (socket says 172.21.15.100:42738) 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 -- 172.21.15.100:0/631241401 learned_addr learned my addr 172.21.15.100:0/631241401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f362ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3628189ca0 0x7f362806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 -- 172.21.15.100:0/631241401 >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 msgr2=0x7f362818a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:48.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 --2- 172.21.15.100:0/631241401 >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 -- 172.21.15.100:0/631241401 >> v2:172.21.15.100:3300/0 conn(0x7f3628189ca0 msgr2=0x7f362806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:48.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 --2- 172.21.15.100:0/631241401 >> v2:172.21.15.100:3300/0 conn(0x7f3628189ca0 0x7f362806ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f361fe00640 1 -- 172.21.15.100:0/631241401 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280cabb0 con 0x7f36281871c0 2024-02-21T07:45:48.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.607+0000 7f362d800640 1 --2- 172.21.15.100:0/631241401 >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.608+0000 7f361fe00640 1 --2- 172.21.15.100:0/631241401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36281871c0 0x7f36280cb690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3628067a70 tx=0x7f361002b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a72c75ce134a1da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f3627e00640 1 -- 172.21.15.100:0/631241401 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610031880 con 0x7f36281871c0 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f3627e00640 1 -- 172.21.15.100:0/631241401 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36100319e0 con 0x7f36281871c0 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f3627e00640 1 -- 172.21.15.100:0/631241401 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3610031d70 con 0x7f36281871c0 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 -- 172.21.15.100:0/631241401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36281871c0 msgr2=0x7f36280cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 --2- 172.21.15.100:0/631241401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36281871c0 0x7f36280cb690 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3628067a70 tx=0x7f361002b920 comp rx=0 tx=0).stop 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 -- 172.21.15.100:0/631241401 shutdown_connections 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 --2- 172.21.15.100:0/631241401 >> v2:172.21.15.170:3300/0 conn(0x7f362818a080 0x7f362818a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 --2- 172.21.15.100:0/631241401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36281871c0 0x7f36280cb690 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 --2- 172.21.15.100:0/631241401 >> v2:172.21.15.100:3300/0 conn(0x7f3628189ca0 0x7f362806ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.609+0000 7f362f800640 1 -- 172.21.15.100:0/631241401 >> 172.21.15.100:0/631241401 conn(0x7f36280668b0 msgr2=0x7f3628066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:48.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.610+0000 7f362f800640 1 -- 172.21.15.100:0/631241401 shutdown_connections 2024-02-21T07:45:48.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.610+0000 7f362f800640 1 -- 172.21.15.100:0/631241401 wait complete. 2024-02-21T07:45:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.612+0000 7f362f800640 1 Processor -- start 2024-02-21T07:45:48.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.612+0000 7f362f800640 1 -- start start 2024-02-21T07:45:48.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3628189ca0 0x7f36280f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 0x7f3628185940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628071010 con 0x7f362818a080 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36281854b0 con 0x7f3628189ca0 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36281845c0 con 0x7f36281871c0 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35716/0 (socket says 172.21.15.100:35716) 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f361fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3628189ca0 0x7f36280f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 -- 172.21.15.100:0/912644539 learned_addr learned my addr 172.21.15.100:0/912644539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:48.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362d800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 0x7f3628185940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 -- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3628189ca0 msgr2=0x7f36280f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3628189ca0 0x7f36280f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.614+0000 7f362ce00640 1 -- 172.21.15.100:0/912644539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 msgr2=0x7f3628185940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362ce00640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 0x7f3628185940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362ce00640 1 -- 172.21.15.100:0/912644539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009400 con 0x7f36281871c0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362d800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 0x7f3628185940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362ce00640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f361800eed0 tx=0x7f361800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618010040 con 0x7f36281871c0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3618009e20 con 0x7f36281871c0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618014600 con 0x7f36281871c0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100094d0 con 0x7f36281871c0 2024-02-21T07:45:48.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.615+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3628184b80 con 0x7f36281871c0 2024-02-21T07:45:48.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.616+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362808e1c0 con 0x7f36281871c0 2024-02-21T07:45:48.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.618+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3618014760 con 0x7f36281871c0 2024-02-21T07:45:48.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.620+0000 7f3625600640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 0x7f36040a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:48.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.620+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f36180caa30 con 0x7f36281871c0 2024-02-21T07:45:48.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.620+0000 7f361fe00640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 0x7f36040a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:48.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.621+0000 7f361fe00640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 0x7f36040a15e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3610036000 tx=0x7f361003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:48.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.622+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3618094790 con 0x7f36281871c0 2024-02-21T07:45:48.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:48.855+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f3628184160 con 0x7f36281871c0 2024-02-21T07:45:49.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.404+0000 7f3625600640 1 -- 172.21.15.100:0/912644539 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f36180966c0 con 0x7f36281871c0 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 msgr2=0x7f36040a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 0x7f36040a15e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3610036000 tx=0x7f361003c040 comp rx=0 tx=0).stop 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 msgr2=0x7f362816e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f361800eed0 tx=0x7f361800b480 comp rx=0 tx=0).stop 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 shutdown_connections 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f360409f120 0x7f36040a15e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362818a080 0x7f3628185940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3628189ca0 0x7f36280f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 --2- 172.21.15.100:0/912644539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36281871c0 0x7f362816e340 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 >> 172.21.15.100:0/912644539 conn(0x7f36280668b0 msgr2=0x7f362817e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.408+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 shutdown_connections 2024-02-21T07:45:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.409+0000 7f362f800640 1 -- 172.21.15.100:0/912644539 wait complete. 2024-02-21T07:45:49.437 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-02-21T07:45:49.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-02-21T07:45:49.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.627+0000 7f6494e00640 1 Processor -- start 2024-02-21T07:45:49.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.627+0000 7f6494e00640 1 -- start start 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f6494e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f649006de10 0x7f64900f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f6494e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64900f5c00 0x7f649006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f6494e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900f5230 con 0x7f649006da30 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f6494e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900709c0 con 0x7f64900f5c00 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f6494e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900706e0 con 0x7f649006de10 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f648e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64900f5c00 0x7f649006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f648e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f64900f5c00 0x7f649006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50096/0 (socket says 172.21.15.100:50096) 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f648d400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f649006de10 0x7f64900f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.629+0000 7f648e800640 1 -- 172.21.15.100:0/639847439 learned_addr learned my addr 172.21.15.100:0/639847439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.630+0000 7f648e800640 1 -- 172.21.15.100:0/639847439 >> v2:172.21.15.170:3300/0 conn(0x7f649006de10 msgr2=0x7f64900f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.630+0000 7f648e800640 1 --2- 172.21.15.100:0/639847439 >> v2:172.21.15.170:3300/0 conn(0x7f649006de10 0x7f64900f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.630+0000 7f648ca00640 1 -- 172.21.15.100:0/639847439 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246101606 0 0) 0x7f64900f5230 con 0x7f649006da30 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.630+0000 7f648e800640 1 -- 172.21.15.100:0/639847439 >> v1:172.21.15.170:6789/0 conn(0x7f649006da30 legacy=0x7f6490188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.630+0000 7f648e800640 1 -- 172.21.15.100:0/639847439 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900f4900 con 0x7f64900f5c00 2024-02-21T07:45:49.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.631+0000 7f648e800640 1 --2- 172.21.15.100:0/639847439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f649006f280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f649008d4b0 tx=0x7f648802e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed4adb1fe5f1c63 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.631+0000 7f648ca00640 1 -- 172.21.15.100:0/639847439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648802ec00 con 0x7f64900f5c00 2024-02-21T07:45:49.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.631+0000 7f648ca00640 1 -- 172.21.15.100:0/639847439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648802ed60 con 0x7f64900f5c00 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.631+0000 7f648ca00640 1 -- 172.21.15.100:0/639847439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6488036610 con 0x7f64900f5c00 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 -- 172.21.15.100:0/639847439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 msgr2=0x7f649006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 --2- 172.21.15.100:0/639847439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f649006f280 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f649008d4b0 tx=0x7f648802e060 comp rx=0 tx=0).stop 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 -- 172.21.15.100:0/639847439 shutdown_connections 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 --2- 172.21.15.100:0/639847439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f649006f280 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 --2- 172.21.15.100:0/639847439 >> v2:172.21.15.170:3300/0 conn(0x7f649006de10 0x7f64900f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 -- 172.21.15.100:0/639847439 >> 172.21.15.100:0/639847439 conn(0x7f64900668b0 msgr2=0x7f6490066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 -- 172.21.15.100:0/639847439 shutdown_connections 2024-02-21T07:45:49.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.632+0000 7f6494e00640 1 -- 172.21.15.100:0/639847439 wait complete. 2024-02-21T07:45:49.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.634+0000 7f6494e00640 1 Processor -- start 2024-02-21T07:45:49.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.634+0000 7f6494e00640 1 -- start start 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.635+0000 7f6494e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f649006da30 0x7f6490171990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f6494e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f649006de10 0x7f64900f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f6494e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f6494e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900f7b50 con 0x7f64900f5c00 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f6494e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490175ae0 con 0x7f649006de10 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f6494e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490174f60 con 0x7f649006da30 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50110/0 (socket says 172.21.15.100:50110) 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 -- 172.21.15.100:0/243973667 learned_addr learned my addr 172.21.15.100:0/243973667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648d400640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f649006de10 0x7f64900f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648de00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f649006da30 0x7f6490171990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 -- 172.21.15.100:0/243973667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f649006da30 msgr2=0x7f6490171990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f649006da30 0x7f6490171990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 -- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f649006de10 msgr2=0x7f64900f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f649006de10 0x7f64900f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.636+0000 7f648e800640 1 -- 172.21.15.100:0/243973667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488009b30 con 0x7f64900f5c00 2024-02-21T07:45:49.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f648e800640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6488038040 tx=0x7f6488004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648802ec00 con 0x7f64900f5c00 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648803f470 con 0x7f64900f5c00 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648803f800 con 0x7f64900f5c00 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490175240 con 0x7f64900f5c00 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.637+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490175800 con 0x7f64900f5c00 2024-02-21T07:45:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.638+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490175cd0 con 0x7f64900f5c00 2024-02-21T07:45:49.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.640+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f648803f960 con 0x7f64900f5c00 2024-02-21T07:45:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.641+0000 7f6486000640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 0x7f646c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.642+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f64880ebc10 con 0x7f64900f5c00 2024-02-21T07:45:49.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.642+0000 7f648de00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 0x7f646c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:49.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.642+0000 7f648de00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 0x7f646c0a1590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6478000f60 tx=0x7f6478009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:49.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.646+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f64880b5a00 con 0x7f64900f5c00 2024-02-21T07:45:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.866+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f64900f79b0 con 0x7f646c09f0d0 2024-02-21T07:45:49.878 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:49.872+0000 7f0c90951640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:45:49.878 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:49.872+0000 7f0c90951640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:45:49.878 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:49.872+0000 7f0c90951640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:45:49.878 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:49.872+0000 7f0c90951640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:45:49.878 INFO:tasks.ceph.mgr.y.smithi156.stderr:2024-02-21T07:45:49.872+0000 7f0c90951640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:45:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.899+0000 7f6486000640 1 -- 172.21.15.100:0/243973667 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6478001d40 con 0x7f646c09f0d0 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 msgr2=0x7f646c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 0x7f646c0a1590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6478000f60 tx=0x7f6478009040 comp rx=0 tx=0).stop 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 msgr2=0x7f64900f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6488038040 tx=0x7f6488004a40 comp rx=0 tx=0).stop 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 shutdown_connections 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f646c09f0d0 0x7f646c0a1590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900f5c00 0x7f64900f8520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f649006de10 0x7f64900f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 --2- 172.21.15.100:0/243973667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f649006da30 0x7f6490171990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:49.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 >> 172.21.15.100:0/243973667 conn(0x7f64900668b0 msgr2=0x7f649015ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:49.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 shutdown_connections 2024-02-21T07:45:49.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:49.902+0000 7f6494e00640 1 -- 172.21.15.100:0/243973667 wait complete. 2024-02-21T07:45:49.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-02-21T07:45:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.119+0000 7f8e52800640 1 Processor -- start 2024-02-21T07:45:50.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.119+0000 7f8e52800640 1 -- start start 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.121+0000 7f8e52800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e4c0fd170 0x7f8e4c0d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.121+0000 7f8e52800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8e4c0d5da0 0x7f8e4c18c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.121+0000 7f8e52800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0fbd30 con 0x7f8e4c18be10 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.121+0000 7f8e52800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0d4420 con 0x7f8e4c0fd170 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.121+0000 7f8e52800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c189890 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f8e4c18be10 0x7f8e4c0fca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40746/0 (socket says 172.21.15.100:40746) 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51400640 1 -- 172.21.15.100:0/2243249054 learned_addr learned my addr 172.21.15.100:0/2243249054 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51e00640 1 --2- 172.21.15.100:0/2243249054 >> v2:172.21.15.170:3300/0 conn(0x7f8e4c0d5da0 0x7f8e4c18c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e50a00640 1 --2- 172.21.15.100:0/2243249054 >> v2:172.21.15.100:3300/0 conn(0x7f8e4c0fd170 0x7f8e4c0d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e4be00640 1 -- 172.21.15.100:0/2243249054 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141094706 0 0) 0x7f8e4c0fbd30 con 0x7f8e4c18be10 2024-02-21T07:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e4be00640 1 -- 172.21.15.100:0/2243249054 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e34003520 con 0x7f8e4c18be10 2024-02-21T07:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51e00640 1 -- 172.21.15.100:0/2243249054 >> v2:172.21.15.100:3300/0 conn(0x7f8e4c0fd170 msgr2=0x7f8e4c0d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51e00640 1 --2- 172.21.15.100:0/2243249054 >> v2:172.21.15.100:3300/0 conn(0x7f8e4c0fd170 0x7f8e4c0d5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51e00640 1 -- 172.21.15.100:0/2243249054 >> v1:172.21.15.170:6789/0 conn(0x7f8e4c18be10 legacy=0x7f8e4c0fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.122+0000 7f8e51e00640 1 -- 172.21.15.100:0/2243249054 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0fc5d0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.123+0000 7f8e51e00640 1 --2- 172.21.15.100:0/2243249054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c18c1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c06cc30 tx=0x7f8e4402bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c24bce21f46811f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e4be00640 1 -- 172.21.15.100:0/2243249054 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4402cb60 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e4be00640 1 -- 172.21.15.100:0/2243249054 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4402ccc0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e4be00640 1 -- 172.21.15.100:0/2243249054 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44034660 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 -- 172.21.15.100:0/2243249054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 msgr2=0x7f8e4c18c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 --2- 172.21.15.100:0/2243249054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c18c1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c06cc30 tx=0x7f8e4402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 -- 172.21.15.100:0/2243249054 shutdown_connections 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 --2- 172.21.15.100:0/2243249054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c18c1f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 --2- 172.21.15.100:0/2243249054 >> v2:172.21.15.100:3300/0 conn(0x7f8e4c0fd170 0x7f8e4c0d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 -- 172.21.15.100:0/2243249054 >> 172.21.15.100:0/2243249054 conn(0x7f8e4c0fdf30 msgr2=0x7f8e4c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 -- 172.21.15.100:0/2243249054 shutdown_connections 2024-02-21T07:45:50.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.124+0000 7f8e52800640 1 -- 172.21.15.100:0/2243249054 wait complete. 2024-02-21T07:45:50.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.127+0000 7f8e52800640 1 Processor -- start 2024-02-21T07:45:50.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.127+0000 7f8e52800640 1 -- start start 2024-02-21T07:45:50.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4c0fd170 0x7f8e4c17e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e4c18be10 0x7f8e4c17e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c17eeb0 con 0x7f8e4c0fd170 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c0ce060 con 0x7f8e4c18be10 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e52800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c17f0c0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:42940/0 (socket says 172.21.15.100:42940) 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 -- 172.21.15.100:0/2028421846 learned_addr learned my addr 172.21.15.100:0/2028421846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e50a00640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4c0fd170 0x7f8e4c17e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51e00640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e4c18be10 0x7f8e4c17e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 -- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e4c18be10 msgr2=0x7f8e4c17e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e4c18be10 0x7f8e4c17e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 -- 172.21.15.100:0/2028421846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4c0fd170 msgr2=0x7f8e4c17e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4c0fd170 0x7f8e4c17e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.129+0000 7f8e51400640 1 -- 172.21.15.100:0/2028421846 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44009a70 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e51400640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c460 tx=0x7f8e4000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40005ce0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e40005e40 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c17f3a0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e40007290 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.130+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c0cda10 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.131+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c067c80 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.133+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8e400073f0 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.135+0000 7f8e49600640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 0x7f8e2c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.135+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8e400c9410 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.135+0000 7f8e50a00640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 0x7f8e2c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.136+0000 7f8e50a00640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 0x7f8e2c0a1590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cff60 tx=0x7f8e38009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.137+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8e40093220 con 0x7f8e4c0d5da0 2024-02-21T07:45:50.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.367+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4c0d68d0 con 0x7f8e2c09f0d0 2024-02-21T07:45:50.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.400+0000 7f8e49600640 1 -- 172.21.15.100:0/2028421846 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8e38011b20 con 0x7f8e2c09f0d0 2024-02-21T07:45:50.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.402+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 msgr2=0x7f8e2c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 0x7f8e2c0a1590 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0cff60 tx=0x7f8e38009190 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 msgr2=0x7f8e4c0f5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000c460 tx=0x7f8e4000c920 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 shutdown_connections 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e4c18be10 0x7f8e4c17e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8e2c09f0d0 0x7f8e2c0a1590 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e4c0fd170 0x7f8e4c17e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 --2- 172.21.15.100:0/2028421846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e4c0d5da0 0x7f8e4c0f5230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 >> 172.21.15.100:0/2028421846 conn(0x7f8e4c0fdf30 msgr2=0x7f8e4c0d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 shutdown_connections 2024-02-21T07:45:50.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.403+0000 7f8e52800640 1 -- 172.21.15.100:0/2028421846 wait complete. 2024-02-21T07:45:50.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-02-21T07:45:50.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.616+0000 7f589e800640 1 Processor -- start 2024-02-21T07:45:50.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.617+0000 7f589e800640 1 -- start start 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589e800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5898180460 0x7f58980cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589e800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980cc250 con 0x7f58980cbdd0 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589e800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980cc530 con 0x7f5898180840 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589e800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5898188250 con 0x7f5898180460 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589ca00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f58980cbdd0 0x7f5898187b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40276/0 (socket says 172.21.15.100:40276) 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589ca00640 1 -- 172.21.15.100:0/554603449 learned_addr learned my addr 172.21.15.100:0/554603449 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:50.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.619+0000 7f589d400640 1 --2- 172.21.15.100:0/554603449 >> v2:172.21.15.170:3300/0 conn(0x7f5898180460 0x7f58980cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288344384 0 0) 0x7f58980cc250 con 0x7f58980cbdd0 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5880003520 con 0x7f58980cbdd0 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f589d400640 1 -- 172.21.15.100:0/554603449 >> v1:172.21.15.170:6789/0 conn(0x7f5898180840 legacy=0x7f589806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f589d400640 1 -- 172.21.15.100:0/554603449 >> v1:172.21.15.100:6789/0 conn(0x7f58980cbdd0 legacy=0x7f5898187b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468196998 0 0) 0x7f58980cc530 con 0x7f5898180840 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.620+0000 7f589d400640 1 -- 172.21.15.100:0/554603449 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980cc810 con 0x7f5898180460 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.621+0000 7f589d400640 1 --2- 172.21.15.100:0/554603449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898180460 0x7f58980cd5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f588c0097a0 tx=0x7f588c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa83e3e3e7c15f02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.621+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c02e070 con 0x7f5898180460 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.621+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c0315a0 con 0x7f5898180460 2024-02-21T07:45:50.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.621+0000 7f5897e00640 1 -- 172.21.15.100:0/554603449 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c031910 con 0x7f5898180460 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 -- 172.21.15.100:0/554603449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898180460 msgr2=0x7f58980cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 --2- 172.21.15.100:0/554603449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898180460 0x7f58980cd5d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f588c0097a0 tx=0x7f588c02b840 comp rx=0 tx=0).stop 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 -- 172.21.15.100:0/554603449 shutdown_connections 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 --2- 172.21.15.100:0/554603449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5898180460 0x7f58980cd5d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 -- 172.21.15.100:0/554603449 >> 172.21.15.100:0/554603449 conn(0x7f58980f6580 msgr2=0x7f58980f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:50.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 -- 172.21.15.100:0/554603449 shutdown_connections 2024-02-21T07:45:50.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.622+0000 7f589e800640 1 -- 172.21.15.100:0/554603449 wait complete. 2024-02-21T07:45:50.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.624+0000 7f589e800640 1 Processor -- start 2024-02-21T07:45:50.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.624+0000 7f589e800640 1 -- start start 2024-02-21T07:45:50.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58980cbdd0 0x7f5898177a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898180460 0x7f5898176fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981790e0 con 0x7f5898180840 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981781f0 con 0x7f5898180460 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.625+0000 7f589e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981784d0 con 0x7f58980cbdd0 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50892/0 (socket says 172.21.15.100:50892) 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 -- 172.21.15.100:0/2563337788 learned_addr learned my addr 172.21.15.100:0/2563337788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589ca00640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898180460 0x7f5898176fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589d400640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58980cbdd0 0x7f5898177a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 -- 172.21.15.100:0/2563337788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58980cbdd0 msgr2=0x7f5898177a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58980cbdd0 0x7f5898177a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 -- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898180460 msgr2=0x7f5898176fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898180460 0x7f5898176fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.626+0000 7f589de00640 1 -- 172.21.15.100:0/2563337788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009400 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f589de00640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f589000c780 tx=0x7f589000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890003b70 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890003cd0 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890005270 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58981787b0 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.627+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898178d70 con 0x7f5898180840 2024-02-21T07:45:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.628+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898179250 con 0x7f5898180840 2024-02-21T07:45:50.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.630+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f58900053d0 con 0x7f5898180840 2024-02-21T07:45:50.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.631+0000 7f5895600640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 0x7f587c0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:50.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.632+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f58900c98e0 con 0x7f5898180840 2024-02-21T07:45:50.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.632+0000 7f589d400640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 0x7f587c0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:50.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.633+0000 7f589d400640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 0x7f587c0a1620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f588c036000 tx=0x7f588c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:50.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.636+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f58900935f0 con 0x7f5898180840 2024-02-21T07:45:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.864+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f58980ccdd0 con 0x7f587c09f160 2024-02-21T07:45:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.870+0000 7f5895600640 1 -- 172.21.15.100:0/2563337788 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f588c031b00 con 0x7f587c09f160 2024-02-21T07:45:50.876 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_0/61f24302-0f2a-4cf1-83f4-5c8cc66bada5 2024-02-21T07:45:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 msgr2=0x7f587c0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 0x7f587c0a1620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f588c036000 tx=0x7f588c03d040 comp rx=0 tx=0).stop 2024-02-21T07:45:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 msgr2=0x7f58980f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f589000c780 tx=0x7f589000cb80 comp rx=0 tx=0).stop 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 shutdown_connections 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f587c09f160 0x7f587c0a1620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5898180840 0x7f58980f49d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5898180460 0x7f5898176fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 --2- 172.21.15.100:0/2563337788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58980cbdd0 0x7f5898177a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 >> 172.21.15.100:0/2563337788 conn(0x7f58980f6580 msgr2=0x7f589806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 shutdown_connections 2024-02-21T07:45:50.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:50.873+0000 7f589e800640 1 -- 172.21.15.100:0/2563337788 wait complete. 2024-02-21T07:45:50.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-02-21T07:45:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.108+0000 7fa5c2c00640 1 Processor -- start 2024-02-21T07:45:51.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.108+0000 7fa5c2c00640 1 -- start start 2024-02-21T07:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.110+0000 7fa5c2c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc070fa0 con 0x7fa5bc189680 2024-02-21T07:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.110+0000 7fa5c2c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc071280 con 0x7fa5bc188b90 2024-02-21T07:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.110+0000 7fa5c2c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc071560 con 0x7fa5bc072600 2024-02-21T07:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.110+0000 7fa5c0c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa5bc189680 0x7fa5bc0f90a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40286/0 (socket says 172.21.15.100:40286) 2024-02-21T07:45:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.110+0000 7fa5c0c00640 1 -- 172.21.15.100:0/132637396 learned_addr learned my addr 172.21.15.100:0/132637396 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607603585 0 0) 0x7fa5bc070fa0 con 0x7fa5bc189680 2024-02-21T07:45:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c003520 con 0x7fa5bc189680 2024-02-21T07:45:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859135788 0 0) 0x7fa5bc071560 con 0x7fa5bc072600 2024-02-21T07:45:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5bc070fa0 con 0x7fa5bc072600 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321959677 0 0) 0x7fa5bc071280 con 0x7fa5bc188b90 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5bc071560 con 0x7fa5bc188b90 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100057981 0 0) 0x7fa59c003520 con 0x7fa5bc189680 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 >> v1:172.21.15.170:6789/0 conn(0x7fa5bc072600 legacy=0x7fa5bc188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 >> v1:172.21.15.156:6789/0 conn(0x7fa5bc188b90 legacy=0x7fa5bc183510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc071840 con 0x7fa5bc189680 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fa5b40019f0 con 0x7fa5bc189680 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 >> v1:172.21.15.100:6789/0 conn(0x7fa5bc189680 legacy=0x7fa5bc0f90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 0x7fa59c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa59c003760 0x7fa59c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c0042f0 0x7fa59c005950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4001190 con 0x7fa59c0042f0 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c006230 con 0x7fa59c004d50 2024-02-21T07:45:51.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.111+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0063f0 con 0x7fa59c003760 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 0x7fa59c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bb400640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa59c003760 0x7fa59c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5c0c00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c0042f0 0x7fa59c005950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 -- 172.21.15.100:0/132637396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa59c003760 msgr2=0x7fa59c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa59c003760 0x7fa59c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 -- 172.21.15.100:0/132637396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c0042f0 msgr2=0x7fa59c005950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c0042f0 0x7fa59c005950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5bbe00640 1 -- 172.21.15.100:0/132637396 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c003520 con 0x7fa59c004d50 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.112+0000 7fa5c0c00640 1 -- 172.21.15.100:0/132637396 reap_dead start 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.113+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 0x7fa59c005130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001820 tx=0x7fa59c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8714e7693e77f574 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac02f050 con 0x7fa59c004d50 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac0052f0 con 0x7fa59c004d50 2024-02-21T07:45:51.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5baa00640 1 -- 172.21.15.100:0/132637396 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac003830 con 0x7fa59c004d50 2024-02-21T07:45:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5c2c00640 1 -- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 msgr2=0x7fa59c005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 0x7fa59c005130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac001820 tx=0x7fa59c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5c2c00640 1 -- 172.21.15.100:0/132637396 shutdown_connections 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/132637396 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa59c004d50 0x7fa59c005130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.114+0000 7fa5c2c00640 1 -- 172.21.15.100:0/132637396 >> 172.21.15.100:0/132637396 conn(0x7fa5bc0668b0 msgr2=0x7fa5bc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.115+0000 7fa5c2c00640 1 -- 172.21.15.100:0/132637396 shutdown_connections 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.115+0000 7fa5c2c00640 1 -- 172.21.15.100:0/132637396 wait complete. 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.117+0000 7fa5c2c00640 1 Processor -- start 2024-02-21T07:45:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.117+0000 7fa5c2c00640 1 -- start start 2024-02-21T07:45:51.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c004d50 0x7fa5bc21efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cd080 0x7fa5bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cbe10 con 0x7fa59c004d50 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cc6b0 con 0x7fa5bc1794f0 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c2c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cb290 con 0x7fa5bc0cd080 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5bb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5bb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34644/0 (socket says 172.21.15.100:34644) 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5bb400640 1 -- 172.21.15.100:0/1158014053 learned_addr learned my addr 172.21.15.100:0/1158014053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c004d50 0x7fa5bc21efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5c0c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cd080 0x7fa5bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.118+0000 7fa5bb400640 1 -- 172.21.15.100:0/1158014053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cd080 msgr2=0x7fa5bc06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5bb400640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cd080 0x7fa5bc06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5bb400640 1 -- 172.21.15.100:0/1158014053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c004d50 msgr2=0x7fa5bc21efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5bb400640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c004d50 0x7fa5bc21efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5bb400640 1 -- 172.21.15.100:0/1158014053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0cb570 con 0x7fa5bc1794f0 2024-02-21T07:45:51.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5bb400640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400fbb0 tx=0x7fa5a400d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400feb0 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4001540 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400de50 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0cc060 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.119+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0cd500 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.120+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc067c80 con 0x7fa5bc1794f0 2024-02-21T07:45:51.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.122+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa5a40050d0 con 0x7fa5bc1794f0 2024-02-21T07:45:51.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.124+0000 7fa5b3e00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 0x7fa5980a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.124+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa5a40c9fe0 con 0x7fa5bc1794f0 2024-02-21T07:45:51.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.124+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 0x7fa5980a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.125+0000 7fa5bbe00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 0x7fa5980a15f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac034000 tx=0x7fa5ac009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.126+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5a4093dc0 con 0x7fa5bc1794f0 2024-02-21T07:45:51.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.352+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5bc071e00 con 0x7fa59809f130 2024-02-21T07:45:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.381+0000 7fa5b3e00640 1 -- 172.21.15.100:0/1158014053 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa5ac007a70 con 0x7fa59809f130 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 msgr2=0x7fa5980a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 0x7fa5980a15f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac034000 tx=0x7fa5ac009030 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 msgr2=0x7fa5bc0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5a400fbb0 tx=0x7fa5a400d520 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 shutdown_connections 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5bc0cd080 0x7fa5bc06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5bc1794f0 0x7fa5bc0ccb40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f130 0x7fa5980a15f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 --2- 172.21.15.100:0/1158014053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c004d50 0x7fa5bc21efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 >> 172.21.15.100:0/1158014053 conn(0x7fa5bc0668b0 msgr2=0x7fa5bc188f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 shutdown_connections 2024-02-21T07:45:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.384+0000 7fa5c2c00640 1 -- 172.21.15.100:0/1158014053 wait complete. 2024-02-21T07:45:51.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-02-21T07:45:51.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.627+0000 7fc2fe400640 1 Processor -- start 2024-02-21T07:45:51.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.627+0000 7fc2fe400640 1 -- start start 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.629+0000 7fc2fe400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc2f80cbdd0 0x7fc2f80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.629+0000 7fc2fe400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2f8180840 0x7fc2f806db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.629+0000 7fc2fe400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cc250 con 0x7fc2f8180460 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fe400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f8188250 con 0x7fc2f8180840 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fe400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80cc530 con 0x7fc2f80cbdd0 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fd000640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc2f8180460 0x7fc2f8187b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50286/0 (socket says 172.21.15.100:50286) 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fd000640 1 -- 172.21.15.100:0/2847492600 learned_addr learned my addr 172.21.15.100:0/2847492600 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fda00640 1 --2- 172.21.15.100:0/2847492600 >> v2:172.21.15.100:3300/0 conn(0x7fc2f8180840 0x7fc2f806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2f7e00640 1 --2- 172.21.15.100:0/2847492600 >> v2:172.21.15.170:3300/0 conn(0x7fc2f80cbdd0 0x7fc2f80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2f7400640 1 -- 172.21.15.100:0/2847492600 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036875210 0 0) 0x7fc2f80cc250 con 0x7fc2f8180460 2024-02-21T07:45:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2f7400640 1 -- 172.21.15.100:0/2847492600 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e0003520 con 0x7fc2f8180460 2024-02-21T07:45:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fda00640 1 -- 172.21.15.100:0/2847492600 >> v2:172.21.15.170:3300/0 conn(0x7fc2f80cbdd0 msgr2=0x7fc2f80cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fda00640 1 --2- 172.21.15.100:0/2847492600 >> v2:172.21.15.170:3300/0 conn(0x7fc2f80cbdd0 0x7fc2f80cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fda00640 1 -- 172.21.15.100:0/2847492600 >> v1:172.21.15.156:6789/0 conn(0x7fc2f8180460 legacy=0x7fc2f8187b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.630+0000 7fc2fda00640 1 -- 172.21.15.100:0/2847492600 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80cc810 con 0x7fc2f8180840 2024-02-21T07:45:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fda00640 1 --2- 172.21.15.100:0/2847492600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8180840 0x7fc2f806db30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2f81629d0 tx=0x7fc2f002bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197d821f17ddd5c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2f7400640 1 -- 172.21.15.100:0/2847492600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f002cb50 con 0x7fc2f8180840 2024-02-21T07:45:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2f7400640 1 -- 172.21.15.100:0/2847492600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f002ccb0 con 0x7fc2f8180840 2024-02-21T07:45:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2f7400640 1 -- 172.21.15.100:0/2847492600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0034660 con 0x7fc2f8180840 2024-02-21T07:45:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 -- 172.21.15.100:0/2847492600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8180840 msgr2=0x7fc2f806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 --2- 172.21.15.100:0/2847492600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8180840 0x7fc2f806db30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc2f81629d0 tx=0x7fc2f002bda0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 -- 172.21.15.100:0/2847492600 shutdown_connections 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 --2- 172.21.15.100:0/2847492600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8180840 0x7fc2f806db30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 --2- 172.21.15.100:0/2847492600 >> v2:172.21.15.170:3300/0 conn(0x7fc2f80cbdd0 0x7fc2f80cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.632+0000 7fc2fe400640 1 -- 172.21.15.100:0/2847492600 >> 172.21.15.100:0/2847492600 conn(0x7fc2f80f6580 msgr2=0x7fc2f80f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.633+0000 7fc2fe400640 1 -- 172.21.15.100:0/2847492600 shutdown_connections 2024-02-21T07:45:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.633+0000 7fc2fe400640 1 -- 172.21.15.100:0/2847492600 wait complete. 2024-02-21T07:45:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.634+0000 7fc2fe400640 1 Processor -- start 2024-02-21T07:45:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.635+0000 7fc2fe400640 1 -- start start 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 0x7fc2f8169c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 0x7fc2f821e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f816ae30 con 0x7fc2f80cbdd0 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f821c2b0 con 0x7fc2f8180840 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fe400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f816a2b0 con 0x7fc2f8180460 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fda00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 0x7fc2f821e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50914/0 (socket says 172.21.15.100:50914) 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2fd000640 1 -- 172.21.15.100:0/3062591487 learned_addr learned my addr 172.21.15.100:0/3062591487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.636+0000 7fc2f7e00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 0x7fc2f8169c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 -- 172.21.15.100:0/3062591487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 msgr2=0x7fc2f8169c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 0x7fc2f8169c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 -- 172.21.15.100:0/3062591487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 msgr2=0x7fc2f8169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 -- 172.21.15.100:0/3062591487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0009a70 con 0x7fc2f8180840 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fd000640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2f7e00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 0x7fc2f8169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fda00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 0x7fc2f821e5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2f804f820 tx=0x7fc2f0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0040650 con 0x7fc2f8180840 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f00407b0 con 0x7fc2f8180840 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0040b60 con 0x7fc2f8180840 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.637+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f816a590 con 0x7fc2f8180840 2024-02-21T07:45:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.638+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f816ab50 con 0x7fc2f8180840 2024-02-21T07:45:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.639+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f821c080 con 0x7fc2f8180840 2024-02-21T07:45:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.640+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc2f0040cc0 con 0x7fc2f8180840 2024-02-21T07:45:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.642+0000 7fc2f4c00640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 0x7fc2d80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.642+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc2f00ec9a0 con 0x7fc2f8180840 2024-02-21T07:45:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.642+0000 7fc2fd000640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 0x7fc2d80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.643+0000 7fc2fd000640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 0x7fc2d80a15f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0011e0 tx=0x7fc2ec009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:51.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.644+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2f00b67d0 con 0x7fc2f8180840 2024-02-21T07:45:51.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.868+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2f80cd0b0 con 0x7fc2d809f130 2024-02-21T07:45:51.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.873+0000 7fc2f4c00640 1 -- 172.21.15.100:0/3062591487 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fc2ec00fcb0 con 0x7fc2d809f130 2024-02-21T07:45:51.878 INFO:teuthology.orchestra.run.smithi100.stdout:/volumes/qa/sv_1/440428ee-e56f-4dcf-926c-b2ae2bf1afab 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 msgr2=0x7fc2d80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 0x7fc2d80a15f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0011e0 tx=0x7fc2ec009040 comp rx=0 tx=0).stop 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 msgr2=0x7fc2f821e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 0x7fc2f821e5d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2f804f820 tx=0x7fc2f0004a40 comp rx=0 tx=0).stop 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 shutdown_connections 2024-02-21T07:45:51.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2f8180840 0x7fc2f821e5d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2f8180460 0x7fc2f8169c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc2d809f130 0x7fc2d80a15f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 --2- 172.21.15.100:0/3062591487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f80cbdd0 0x7fc2f8169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 >> 172.21.15.100:0/3062591487 conn(0x7fc2f80f6580 msgr2=0x7fc2f80cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 shutdown_connections 2024-02-21T07:45:51.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:51.875+0000 7fc2fe400640 1 -- 172.21.15.100:0/3062591487 wait complete. 2024-02-21T07:45:51.900 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:45:52.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.101+0000 7f6203800640 1 Processor -- start 2024-02-21T07:45:52.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.101+0000 7f6203800640 1 -- start start 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6203800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f61fc0706b0 0x7f61fc071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6203800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc0f50d0 con 0x7f61fc185680 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6203800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61fc0f53b0 con 0x7f61fc17c040 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6203800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61fc0f4ec0 con 0x7f61fc0706b0 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6200e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f61fc17c040 0x7f61fc070f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40782/0 (socket says 172.21.15.100:40782) 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.103+0000 7f6200e00640 1 -- 172.21.15.100:0/454778647 learned_addr learned my addr 172.21.15.100:0/454778647 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61f3e00640 1 --2- 172.21.15.100:0/454778647 >> v2:172.21.15.100:3300/0 conn(0x7f61fc0706b0 0x7f61fc071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61fbe00640 1 -- 172.21.15.100:0/454778647 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855434183 0 0) 0x7f61fc0f53b0 con 0x7f61fc17c040 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61fbe00640 1 -- 172.21.15.100:0/454778647 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e0003520 con 0x7f61fc17c040 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61f3e00640 1 -- 172.21.15.100:0/454778647 >> v1:172.21.15.170:6789/0 conn(0x7f61fc17c040 legacy=0x7f61fc070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61f3e00640 1 -- 172.21.15.100:0/454778647 >> v1:172.21.15.100:6789/0 conn(0x7f61fc185680 legacy=0x7f61fc185b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.104+0000 7f61f3e00640 1 -- 172.21.15.100:0/454778647 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc0f5690 con 0x7f61fc0706b0 2024-02-21T07:45:52.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.105+0000 7f61f3e00640 1 --2- 172.21.15.100:0/454778647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc071640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097d0 tx=0x7f61e402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc41672c633cc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.105+0000 7f61fbe00640 1 -- 172.21.15.100:0/454778647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e402d040 con 0x7f61fc0706b0 2024-02-21T07:45:52.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.105+0000 7f61fbe00640 1 -- 172.21.15.100:0/454778647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4031810 con 0x7f61fc0706b0 2024-02-21T07:45:52.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.105+0000 7f61fbe00640 1 -- 172.21.15.100:0/454778647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4031ba0 con 0x7f61fc0706b0 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 -- 172.21.15.100:0/454778647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 msgr2=0x7f61fc071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 --2- 172.21.15.100:0/454778647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc071640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f61e40097d0 tx=0x7f61e402b8b0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 -- 172.21.15.100:0/454778647 shutdown_connections 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 --2- 172.21.15.100:0/454778647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc071640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 -- 172.21.15.100:0/454778647 >> 172.21.15.100:0/454778647 conn(0x7f61fc0ce160 msgr2=0x7f61fc0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 -- 172.21.15.100:0/454778647 shutdown_connections 2024-02-21T07:45:52.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.106+0000 7f6203800640 1 -- 172.21.15.100:0/454778647 wait complete. 2024-02-21T07:45:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.108+0000 7f6203800640 1 Processor -- start 2024-02-21T07:45:52.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.108+0000 7f6203800640 1 -- start start 2024-02-21T07:45:52.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.109+0000 7f6203800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.109+0000 7f6203800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 0x7f61fc16aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6203800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61fc185680 0x7f61fc212af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6203800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0ccca0 con 0x7f61fc0706b0 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6203800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0ccf80 con 0x7f61fc17c040 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6203800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc0cd260 con 0x7f61fc185680 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50934/0 (socket says 172.21.15.100:50934) 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 -- 172.21.15.100:0/3092831941 learned_addr learned my addr 172.21.15.100:0/3092831941 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:52.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f61f3e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 0x7f61fc16aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6201800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61fc185680 0x7f61fc212af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 -- 172.21.15.100:0/3092831941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61fc185680 msgr2=0x7f61fc212af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61fc185680 0x7f61fc212af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 -- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 msgr2=0x7f61fc16aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 0x7f61fc16aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 -- 172.21.15.100:0/3092831941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009400 con 0x7f61fc0706b0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f61f3e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 0x7f61fc16aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.110+0000 7f6200e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c390 tx=0x7f61ec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.111+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec005ce0 con 0x7f61fc0706b0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.111+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec005e40 con 0x7f61fc0706b0 2024-02-21T07:45:52.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.111+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0072f0 con 0x7f61fc0706b0 2024-02-21T07:45:52.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.111+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc0cd540 con 0x7f61fc0706b0 2024-02-21T07:45:52.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.111+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc17b6c0 con 0x7f61fc0706b0 2024-02-21T07:45:52.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.112+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61fc0cde70 con 0x7f61fc0706b0 2024-02-21T07:45:52.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.114+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f61ec007450 con 0x7f61fc0706b0 2024-02-21T07:45:52.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.115+0000 7f61f9600640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 0x7f61d80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.116+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61ec0c9550 con 0x7f61fc0706b0 2024-02-21T07:45:52.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.116+0000 7f61f3e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 0x7f61d80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.117+0000 7f61f3e00640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 0x7f61d80a15f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61e4036000 tx=0x7f61e403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.118+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f61ec093260 con 0x7f61fc0706b0 2024-02-21T07:45:52.216 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-02-21T07:45:52.210+0000 7fd0f2000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-02-21T07:45:52.216 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-02-21T07:45:52.210+0000 7fd0f2000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-02-21T07:45:52.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.350+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61fc0cde70 con 0x7f61fc0706b0 2024-02-21T07:45:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.352+0000 7f61f9600640 1 -- 172.21.15.100:0/3092831941 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f61fc0cde70 con 0x7f61fc0706b0 2024-02-21T07:45:52.358 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:52.359 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:49.408446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:45:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 msgr2=0x7f61d80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 0x7f61d80a15f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61e4036000 tx=0x7f61e403c040 comp rx=0 tx=0).stop 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 msgr2=0x7f61fc17b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c390 tx=0x7f61ec00c850 comp rx=0 tx=0).stop 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 shutdown_connections 2024-02-21T07:45:52.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61fc185680 0x7f61fc212af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f61fc17c040 0x7f61fc16aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f61d809f130 0x7f61d80a15f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 --2- 172.21.15.100:0/3092831941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61fc0706b0 0x7f61fc17b180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 >> 172.21.15.100:0/3092831941 conn(0x7f61fc0ce160 msgr2=0x7f61fc08bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 shutdown_connections 2024-02-21T07:45:52.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.355+0000 7f6203800640 1 -- 172.21.15.100:0/3092831941 wait complete. 2024-02-21T07:45:52.378 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.585+0000 7f502cc00640 1 Processor -- start 2024-02-21T07:45:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.585+0000 7f502cc00640 1 -- start start 2024-02-21T07:45:52.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.587+0000 7f502cc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5028189840 con 0x7f50280fa770 2024-02-21T07:45:52.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.587+0000 7f502cc00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50281862a0 con 0x7f502818cb50 2024-02-21T07:45:52.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.587+0000 7f502cc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280f5e10 con 0x7f502806ab60 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.587+0000 7f5026800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f50280fa770 0x7f502806af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40296/0 (socket says 172.21.15.100:40296) 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.587+0000 7f5026800640 1 -- 172.21.15.100:0/901679168 learned_addr learned my addr 172.21.15.100:0/901679168 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195609068 0 0) 0x7f50280f5e10 con 0x7f502806ab60 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003520 con 0x7f502806ab60 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464863243 0 0) 0x7f50281862a0 con 0x7f502818cb50 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50280f5e10 con 0x7f502818cb50 2024-02-21T07:45:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874810679 0 0) 0x7f5028189840 con 0x7f50280fa770 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50281862a0 con 0x7f50280fa770 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113808023 0 0) 0x7f500c003520 con 0x7f502806ab60 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 >> v1:172.21.15.156:6789/0 conn(0x7f502818cb50 legacy=0x7f50280f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 >> v1:172.21.15.100:6789/0 conn(0x7f50280fa770 legacy=0x7f502806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502808dfa0 con 0x7f502806ab60 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f5010001670 con 0x7f502806ab60 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 >> v1:172.21.15.170:6789/0 conn(0x7f502806ab60 legacy=0x7f50280f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 0x7f500c005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c003760 0x7f500c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f500c0042f0 0x7f500c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c230 con 0x7f500c003760 2024-02-21T07:45:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c3a0 con 0x7f500c004d40 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00c560 con 0x7f500c0042f0 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.588+0000 7f5026800640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f500c0042f0 0x7f500c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 0x7f500c005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025400640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c003760 0x7f500c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 -- 172.21.15.100:0/901679168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f500c0042f0 msgr2=0x7f500c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f500c0042f0 0x7f500c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 -- 172.21.15.100:0/901679168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c003760 msgr2=0x7f500c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c003760 0x7f500c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5025e00640 1 -- 172.21.15.100:0/901679168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502808dfa0 con 0x7f500c004d40 2024-02-21T07:45:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.589+0000 7f5026800640 1 -- 172.21.15.100:0/901679168 reap_dead start 2024-02-21T07:45:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.590+0000 7f5025e00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 0x7f500c005120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f501000c0e0 tx=0x7f500c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea4c6d3055fae257 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501002c970 con 0x7f500c004d40 2024-02-21T07:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501002caf0 con 0x7f500c004d40 2024-02-21T07:45:52.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f5024a00640 1 -- 172.21.15.100:0/901679168 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501002cea0 con 0x7f500c004d40 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 -- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 msgr2=0x7f500c005120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 0x7f500c005120 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f501000c0e0 tx=0x7f500c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 -- 172.21.15.100:0/901679168 shutdown_connections 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 --2- 172.21.15.100:0/901679168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f500c004d40 0x7f500c005120 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 -- 172.21.15.100:0/901679168 >> 172.21.15.100:0/901679168 conn(0x7f50280cf250 msgr2=0x7f50280cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 -- 172.21.15.100:0/901679168 shutdown_connections 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.591+0000 7f502cc00640 1 -- 172.21.15.100:0/901679168 wait complete. 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.593+0000 7f502cc00640 1 Processor -- start 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.593+0000 7f502cc00640 1 -- start start 2024-02-21T07:45:52.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 0x7f502821fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5028174f30 0x7f5028220100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502818a280 con 0x7f500c004d40 2024-02-21T07:45:52.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502818a560 con 0x7f5028174f30 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f502cc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502818a840 con 0x7f5028174ab0 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f5025e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f5025400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 0x7f502821fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f5025e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50964/0 (socket says 172.21.15.100:50964) 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f5025e00640 1 -- 172.21.15.100:0/1370293334 learned_addr learned my addr 172.21.15.100:0/1370293334 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.595+0000 7f5026800640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5028174f30 0x7f5028220100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 -- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5028174f30 msgr2=0x7f5028220100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5028174f30 0x7f5028220100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 -- 172.21.15.100:0/1370293334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 msgr2=0x7f5028189c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 -- 172.21.15.100:0/1370293334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502818ab20 con 0x7f5028174ab0 2024-02-21T07:45:52.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025e00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f5025400640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 0x7f502821fbc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f501800f960 tx=0x7f501800fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018003b80 con 0x7f5028174ab0 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018003ce0 con 0x7f5028174ab0 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501800da30 con 0x7f5028174ab0 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502818ae00 con 0x7f5028174ab0 2024-02-21T07:45:52.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.596+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502818b600 con 0x7f5028174ab0 2024-02-21T07:45:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.597+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5028068390 con 0x7f5028174ab0 2024-02-21T07:45:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.599+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f501800db90 con 0x7f5028174ab0 2024-02-21T07:45:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.600+0000 7f501e000640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 0x7f50040a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.600+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f50180c9d20 con 0x7f5028174ab0 2024-02-21T07:45:52.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.601+0000 7f5025e00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 0x7f50040a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.601+0000 7f5025e00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 0x7f50040a1620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5028221c20 tx=0x7f5010009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:52.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.605+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5018093ac0 con 0x7f5028174ab0 2024-02-21T07:45:52.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.799+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f502818a980 con 0x7f5028174ab0 2024-02-21T07:45:52.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.801+0000 7f501e000640 1 -- 172.21.15.100:0/1370293334 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f502818a980 con 0x7f5028174ab0 2024-02-21T07:45:52.807 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:52.807 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:52.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 msgr2=0x7f50040a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 0x7f50040a1620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5028221c20 tx=0x7f5010009030 comp rx=0 tx=0).stop 2024-02-21T07:45:52.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 msgr2=0x7f502821fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 0x7f502821fbc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f501800f960 tx=0x7f501800fe20 comp rx=0 tx=0).stop 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 shutdown_connections 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5028174f30 0x7f5028220100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5028174ab0 0x7f502821fbc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f500409f160 0x7f50040a1620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 --2- 172.21.15.100:0/1370293334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f500c004d40 0x7f5028189c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.803+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 >> 172.21.15.100:0/1370293334 conn(0x7f50280cf250 msgr2=0x7f5028183f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.804+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 shutdown_connections 2024-02-21T07:45:52.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:52.804+0000 7f502cc00640 1 -- 172.21.15.100:0/1370293334 wait complete. 2024-02-21T07:45:52.830 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-21T07:45:52.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:45:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.035+0000 7fe566800640 1 Processor -- start 2024-02-21T07:45:53.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.035+0000 7fe566800640 1 -- start start 2024-02-21T07:45:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.037+0000 7fe566800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe560186df0 0x7fe5600f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.037+0000 7fe566800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe560188770 0x7fe560188c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.037+0000 7fe566800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5600f9ac0 con 0x7fe560185f20 2024-02-21T07:45:53.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.037+0000 7fe566800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56006dc90 con 0x7fe560188770 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.037+0000 7fe566800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56006df70 con 0x7fe560186df0 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe560186df0 0x7fe5600f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55f400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe560185f20 0x7fe5601866e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40792/0 (socket says 172.21.15.100:40792) 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe560186df0 0x7fe5600f9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43026/0 (socket says 172.21.15.100:43026) 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55f400640 1 -- 172.21.15.100:0/4290478794 learned_addr learned my addr 172.21.15.100:0/4290478794 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55fe00640 1 --2- 172.21.15.100:0/4290478794 >> v2:172.21.15.100:3300/0 conn(0x7fe560188770 0x7fe560188c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 -- 172.21.15.100:0/4290478794 >> v2:172.21.15.100:3300/0 conn(0x7fe560188770 msgr2=0x7fe560188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 --2- 172.21.15.100:0/4290478794 >> v2:172.21.15.100:3300/0 conn(0x7fe560188770 0x7fe560188c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 -- 172.21.15.100:0/4290478794 >> v1:172.21.15.170:6789/0 conn(0x7fe560185f20 legacy=0x7fe5601866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.038+0000 7fe55ea00640 1 -- 172.21.15.100:0/4290478794 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56006e250 con 0x7fe560186df0 2024-02-21T07:45:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.039+0000 7fe55ea00640 1 --2- 172.21.15.100:0/4290478794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5600f4290 tx=0x7fe54c02b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83e155a2edf73b4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.039+0000 7fe55e000640 1 -- 172.21.15.100:0/4290478794 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c031520 con 0x7fe560186df0 2024-02-21T07:45:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe55e000640 1 -- 172.21.15.100:0/4290478794 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c031680 con 0x7fe560186df0 2024-02-21T07:45:53.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe55e000640 1 -- 172.21.15.100:0/4290478794 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c031a10 con 0x7fe560186df0 2024-02-21T07:45:53.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 -- 172.21.15.100:0/4290478794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 msgr2=0x7fe5600f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 --2- 172.21.15.100:0/4290478794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9580 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe5600f4290 tx=0x7fe54c02b7c0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 -- 172.21.15.100:0/4290478794 shutdown_connections 2024-02-21T07:45:53.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 --2- 172.21.15.100:0/4290478794 >> v2:172.21.15.100:3300/0 conn(0x7fe560188770 0x7fe560188c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 --2- 172.21.15.100:0/4290478794 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9580 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.040+0000 7fe566800640 1 -- 172.21.15.100:0/4290478794 >> 172.21.15.100:0/4290478794 conn(0x7fe5600ce160 msgr2=0x7fe5600ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:53.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.041+0000 7fe566800640 1 -- 172.21.15.100:0/4290478794 shutdown_connections 2024-02-21T07:45:53.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.041+0000 7fe566800640 1 -- 172.21.15.100:0/4290478794 wait complete. 2024-02-21T07:45:53.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.042+0000 7fe566800640 1 Processor -- start 2024-02-21T07:45:53.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.043+0000 7fe566800640 1 -- start start 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe560188770 0x7fe56016eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600f8ce0 con 0x7fe560185f20 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600f5720 con 0x7fe560188770 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe566800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600f5440 con 0x7fe560186df0 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50972/0 (socket says 172.21.15.100:50972) 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 -- 172.21.15.100:0/1049918300 learned_addr learned my addr 172.21.15.100:0/1049918300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55fe00640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe560188770 0x7fe56016eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55ea00640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 -- 172.21.15.100:0/1049918300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 msgr2=0x7fe5600f9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 -- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe560188770 msgr2=0x7fe56016eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe560188770 0x7fe56016eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55f400640 1 -- 172.21.15.100:0/1049918300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009400 con 0x7fe560185f20 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.044+0000 7fe55ea00640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:53.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe55f400640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c3f0 tx=0x7fe55000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550005ce0 con 0x7fe560185f20 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550005e40 con 0x7fe560185f20 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5600f83b0 con 0x7fe560185f20 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500072f0 con 0x7fe560185f20 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.045+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5600f8970 con 0x7fe560185f20 2024-02-21T07:45:53.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.046+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe560067c80 con 0x7fe560185f20 2024-02-21T07:45:53.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.048+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe550007450 con 0x7fe560185f20 2024-02-21T07:45:53.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.050+0000 7fe557400640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 0x7fe5400a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.050+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe5500c8f60 con 0x7fe560185f20 2024-02-21T07:45:53.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.050+0000 7fe55ea00640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 0x7fe5400a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.051+0000 7fe55ea00640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 0x7fe5400a15f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe54c035000 tx=0x7fe54c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.054+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe550092d00 con 0x7fe560185f20 2024-02-21T07:45:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.248+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe56006eaf0 con 0x7fe54009f130 2024-02-21T07:45:53.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.261+0000 7fe557400640 1 -- 172.21.15.100:0/1049918300 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367757 (secure 0 0 0) 0x7fe54c031a40 con 0x7fe54009f130 2024-02-21T07:45:53.274 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:53.277 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 msgr2=0x7fe5400a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 0x7fe5400a15f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe54c035000 tx=0x7fe54c030000 comp rx=0 tx=0).stop 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 msgr2=0x7fe560183c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe55000c3f0 tx=0x7fe55000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 shutdown_connections 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe560188770 0x7fe56016eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe560186df0 0x7fe5600f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54009f130 0x7fe5400a15f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 --2- 172.21.15.100:0/1049918300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560185f20 0x7fe560183c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 >> 172.21.15.100:0/1049918300 conn(0x7fe5600ce160 msgr2=0x7fe560188c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:53.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.268+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 shutdown_connections 2024-02-21T07:45:53.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.269+0000 7fe566800640 1 -- 172.21.15.100:0/1049918300 wait complete. 2024-02-21T07:45:53.293 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-02-21T07:45:51.899053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":131,"num_read_kb":114,"num_write":310,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":344528,"kb_used_data":3688,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1132117552,"statfs":{"total":1159641169920,"available":1159288373248,"internally_reserved":0,"allocated":3776512,"data_stored":2810864,"data_compressed":168240,"data_compressed_allocated":237568,"data_compressed_original":1441792,"omap_allocated":19141,"internal_metadata":348894523},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2953,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003960"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.411092+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:45:48.411092+0000","last_peered":"2024-02-21T07:45:48.411092+0000","last_clean":"2024-02-21T07:45:48.411092+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:45:48.411092+0000","last_undegraded":"2024-02-21T07:45:48.411092+0000","last_fullsized":"2024-02-21T07:45:48.411092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313026+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:45:31.313026+0000","last_peered":"2024-02-21T07:45:31.313026+0000","last_clean":"2024-02-21T07:45:31.313026+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:45:31.313026+0000","last_undegraded":"2024-02-21T07:45:31.313026+0000","last_fullsized":"2024-02-21T07:45:31.313026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306126+0000","last_change":"2024-02-21T07:45:30.324367+0000","last_active":"2024-02-21T07:45:31.306126+0000","last_peered":"2024-02-21T07:45:31.306126+0000","last_clean":"2024-02-21T07:45:31.306126+0000","last_became_active":"2024-02-21T07:45:30.324047+0000","last_became_peered":"2024-02-21T07:45:30.324047+0000","last_unstale":"2024-02-21T07:45:31.306126+0000","last_undegraded":"2024-02-21T07:45:31.306126+0000","last_fullsized":"2024-02-21T07:45:31.306126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313438+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:45:31.313438+0000","last_peered":"2024-02-21T07:45:31.313438+0000","last_clean":"2024-02-21T07:45:31.313438+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:45:31.313438+0000","last_undegraded":"2024-02-21T07:45:31.313438+0000","last_fullsized":"2024-02-21T07:45:31.313438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264335+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:45:32.264335+0000","last_peered":"2024-02-21T07:45:32.264335+0000","last_clean":"2024-02-21T07:45:32.264335+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:45:32.264335+0000","last_undegraded":"2024-02-21T07:45:32.264335+0000","last_fullsized":"2024-02-21T07:45:32.264335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263673+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:45:32.263673+0000","last_peered":"2024-02-21T07:45:32.263673+0000","last_clean":"2024-02-21T07:45:32.263673+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:45:32.263673+0000","last_undegraded":"2024-02-21T07:45:32.263673+0000","last_fullsized":"2024-02-21T07:45:32.263673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409242+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:45:48.409242+0000","last_peered":"2024-02-21T07:45:48.409242+0000","last_clean":"2024-02-21T07:45:48.409242+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:45:48.409242+0000","last_undegraded":"2024-02-21T07:45:48.409242+0000","last_fullsized":"2024-02-21T07:45:48.409242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263471+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:45:32.263471+0000","last_peered":"2024-02-21T07:45:32.263471+0000","last_clean":"2024-02-21T07:45:32.263471+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:45:32.263471+0000","last_undegraded":"2024-02-21T07:45:32.263471+0000","last_fullsized":"2024-02-21T07:45:32.263471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264669+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:45:32.264669+0000","last_peered":"2024-02-21T07:45:32.264669+0000","last_clean":"2024-02-21T07:45:32.264669+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:45:32.264669+0000","last_undegraded":"2024-02-21T07:45:32.264669+0000","last_fullsized":"2024-02-21T07:45:32.264669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229773+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:45:32.229773+0000","last_peered":"2024-02-21T07:45:32.229773+0000","last_clean":"2024-02-21T07:45:32.229773+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:45:32.229773+0000","last_undegraded":"2024-02-21T07:45:32.229773+0000","last_fullsized":"2024-02-21T07:45:32.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762184+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:45:31.762184+0000","last_peered":"2024-02-21T07:45:31.762184+0000","last_clean":"2024-02-21T07:45:31.762184+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:45:31.762184+0000","last_undegraded":"2024-02-21T07:45:31.762184+0000","last_fullsized":"2024-02-21T07:45:31.762184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264047+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:45:32.264047+0000","last_peered":"2024-02-21T07:45:32.264047+0000","last_clean":"2024-02-21T07:45:32.264047+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:45:32.264047+0000","last_undegraded":"2024-02-21T07:45:32.264047+0000","last_fullsized":"2024-02-21T07:45:32.264047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263973+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:45:32.263973+0000","last_peered":"2024-02-21T07:45:32.263973+0000","last_clean":"2024-02-21T07:45:32.263973+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:45:32.263973+0000","last_undegraded":"2024-02-21T07:45:32.263973+0000","last_fullsized":"2024-02-21T07:45:32.263973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399251+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:45:47.399251+0000","last_peered":"2024-02-21T07:45:47.399251+0000","last_clean":"2024-02-21T07:45:47.399251+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:45:47.399251+0000","last_undegraded":"2024-02-21T07:45:47.399251+0000","last_fullsized":"2024-02-21T07:45:47.399251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264118+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:45:32.264118+0000","last_peered":"2024-02-21T07:45:32.264118+0000","last_clean":"2024-02-21T07:45:32.264118+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:45:32.264118+0000","last_undegraded":"2024-02-21T07:45:32.264118+0000","last_fullsized":"2024-02-21T07:45:32.264118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312471+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:45:31.312471+0000","last_peered":"2024-02-21T07:45:31.312471+0000","last_clean":"2024-02-21T07:45:31.312471+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:45:31.312471+0000","last_undegraded":"2024-02-21T07:45:31.312471+0000","last_fullsized":"2024-02-21T07:45:31.312471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306617+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:45:31.306617+0000","last_peered":"2024-02-21T07:45:31.306617+0000","last_clean":"2024-02-21T07:45:31.306617+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:45:31.306617+0000","last_undegraded":"2024-02-21T07:45:31.306617+0000","last_fullsized":"2024-02-21T07:45:31.306617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264450+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:45:32.264450+0000","last_peered":"2024-02-21T07:45:32.264450+0000","last_clean":"2024-02-21T07:45:32.264450+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:45:32.264450+0000","last_undegraded":"2024-02-21T07:45:32.264450+0000","last_fullsized":"2024-02-21T07:45:32.264450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306047+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:45:31.306047+0000","last_peered":"2024-02-21T07:45:31.306047+0000","last_clean":"2024-02-21T07:45:31.306047+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:45:31.306047+0000","last_undegraded":"2024-02-21T07:45:31.306047+0000","last_fullsized":"2024-02-21T07:45:31.306047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400352+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:45:47.400352+0000","last_peered":"2024-02-21T07:45:47.400352+0000","last_clean":"2024-02-21T07:45:47.400352+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:45:47.400352+0000","last_undegraded":"2024-02-21T07:45:47.400352+0000","last_fullsized":"2024-02-21T07:45:47.400352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264410+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:45:32.264410+0000","last_peered":"2024-02-21T07:45:32.264410+0000","last_clean":"2024-02-21T07:45:32.264410+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:45:32.264410+0000","last_undegraded":"2024-02-21T07:45:32.264410+0000","last_fullsized":"2024-02-21T07:45:32.264410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229409+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:45:32.229409+0000","last_peered":"2024-02-21T07:45:32.229409+0000","last_clean":"2024-02-21T07:45:32.229409+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:45:32.229409+0000","last_undegraded":"2024-02-21T07:45:32.229409+0000","last_fullsized":"2024-02-21T07:45:32.229409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398629+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:45:47.398629+0000","last_peered":"2024-02-21T07:45:47.398629+0000","last_clean":"2024-02-21T07:45:47.398629+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:45:47.398629+0000","last_undegraded":"2024-02-21T07:45:47.398629+0000","last_fullsized":"2024-02-21T07:45:47.398629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264395+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:45:32.264395+0000","last_peered":"2024-02-21T07:45:32.264395+0000","last_clean":"2024-02-21T07:45:32.264395+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:45:32.264395+0000","last_undegraded":"2024-02-21T07:45:32.264395+0000","last_fullsized":"2024-02-21T07:45:32.264395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264627+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:45:32.264627+0000","last_peered":"2024-02-21T07:45:32.264627+0000","last_clean":"2024-02-21T07:45:32.264627+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:45:32.264627+0000","last_undegraded":"2024-02-21T07:45:32.264627+0000","last_fullsized":"2024-02-21T07:45:32.264627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.396666+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:45:47.396666+0000","last_peered":"2024-02-21T07:45:47.396666+0000","last_clean":"2024-02-21T07:45:47.396666+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:45:47.396666+0000","last_undegraded":"2024-02-21T07:45:47.396666+0000","last_fullsized":"2024-02-21T07:45:47.396666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306822+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:45:31.306822+0000","last_peered":"2024-02-21T07:45:31.306822+0000","last_clean":"2024-02-21T07:45:31.306822+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:45:31.306822+0000","last_undegraded":"2024-02-21T07:45:31.306822+0000","last_fullsized":"2024-02-21T07:45:31.306822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313406+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:45:31.313406+0000","last_peered":"2024-02-21T07:45:31.313406+0000","last_clean":"2024-02-21T07:45:31.313406+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:45:31.313406+0000","last_undegraded":"2024-02-21T07:45:31.313406+0000","last_fullsized":"2024-02-21T07:45:31.313406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.413304+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:45:48.413304+0000","last_peered":"2024-02-21T07:45:48.413304+0000","last_clean":"2024-02-21T07:45:48.413304+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:45:48.413304+0000","last_undegraded":"2024-02-21T07:45:48.413304+0000","last_fullsized":"2024-02-21T07:45:48.413304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312329+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:45:31.312329+0000","last_peered":"2024-02-21T07:45:31.312329+0000","last_clean":"2024-02-21T07:45:31.312329+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:45:31.312329+0000","last_undegraded":"2024-02-21T07:45:31.312329+0000","last_fullsized":"2024-02-21T07:45:31.312329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310412+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:45:31.310412+0000","last_peered":"2024-02-21T07:45:31.310412+0000","last_clean":"2024-02-21T07:45:31.310412+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:45:31.310412+0000","last_undegraded":"2024-02-21T07:45:31.310412+0000","last_fullsized":"2024-02-21T07:45:31.310412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.401021+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:45:47.401021+0000","last_peered":"2024-02-21T07:45:47.401021+0000","last_clean":"2024-02-21T07:45:47.401021+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:45:47.401021+0000","last_undegraded":"2024-02-21T07:45:47.401021+0000","last_fullsized":"2024-02-21T07:45:47.401021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306080+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:45:31.306080+0000","last_peered":"2024-02-21T07:45:31.306080+0000","last_clean":"2024-02-21T07:45:31.306080+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:45:31.306080+0000","last_undegraded":"2024-02-21T07:45:31.306080+0000","last_fullsized":"2024-02-21T07:45:31.306080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264097+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:45:32.264097+0000","last_peered":"2024-02-21T07:45:32.264097+0000","last_clean":"2024-02-21T07:45:32.264097+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:45:32.264097+0000","last_undegraded":"2024-02-21T07:45:32.264097+0000","last_fullsized":"2024-02-21T07:45:32.264097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264234+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:45:32.264234+0000","last_peered":"2024-02-21T07:45:32.264234+0000","last_clean":"2024-02-21T07:45:32.264234+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:45:32.264234+0000","last_undegraded":"2024-02-21T07:45:32.264234+0000","last_fullsized":"2024-02-21T07:45:32.264234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229514+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:45:32.229514+0000","last_peered":"2024-02-21T07:45:32.229514+0000","last_clean":"2024-02-21T07:45:32.229514+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:45:32.229514+0000","last_undegraded":"2024-02-21T07:45:32.229514+0000","last_fullsized":"2024-02-21T07:45:32.229514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263819+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:45:32.263819+0000","last_peered":"2024-02-21T07:45:32.263819+0000","last_clean":"2024-02-21T07:45:32.263819+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:45:32.263819+0000","last_undegraded":"2024-02-21T07:45:32.263819+0000","last_fullsized":"2024-02-21T07:45:32.263819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264125+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:45:32.264125+0000","last_peered":"2024-02-21T07:45:32.264125+0000","last_clean":"2024-02-21T07:45:32.264125+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:45:32.264125+0000","last_undegraded":"2024-02-21T07:45:32.264125+0000","last_fullsized":"2024-02-21T07:45:32.264125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310149+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:45:31.310149+0000","last_peered":"2024-02-21T07:45:31.310149+0000","last_clean":"2024-02-21T07:45:31.310149+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:45:31.310149+0000","last_undegraded":"2024-02-21T07:45:31.310149+0000","last_fullsized":"2024-02-21T07:45:31.310149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762185+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:45:31.762185+0000","last_peered":"2024-02-21T07:45:31.762185+0000","last_clean":"2024-02-21T07:45:31.762185+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:45:31.762185+0000","last_undegraded":"2024-02-21T07:45:31.762185+0000","last_fullsized":"2024-02-21T07:45:31.762185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417500+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:45:48.417500+0000","last_peered":"2024-02-21T07:45:48.417500+0000","last_clean":"2024-02-21T07:45:48.417500+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:45:48.417500+0000","last_undegraded":"2024-02-21T07:45:48.417500+0000","last_fullsized":"2024-02-21T07:45:48.417500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310755+0000","last_change":"2024-02-21T07:45:30.576741+0000","last_active":"2024-02-21T07:45:31.310755+0000","last_peered":"2024-02-21T07:45:31.310755+0000","last_clean":"2024-02-21T07:45:31.310755+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:45:31.310755+0000","last_undegraded":"2024-02-21T07:45:31.310755+0000","last_fullsized":"2024-02-21T07:45:31.310755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.308988+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:45:31.308988+0000","last_peered":"2024-02-21T07:45:31.308988+0000","last_clean":"2024-02-21T07:45:31.308988+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:45:31.308988+0000","last_undegraded":"2024-02-21T07:45:31.308988+0000","last_fullsized":"2024-02-21T07:45:31.308988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.408385+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:45:48.408385+0000","last_peered":"2024-02-21T07:45:48.408385+0000","last_clean":"2024-02-21T07:45:48.408385+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:45:48.408385+0000","last_undegraded":"2024-02-21T07:45:48.408385+0000","last_fullsized":"2024-02-21T07:45:48.408385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311908+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:45:31.311908+0000","last_peered":"2024-02-21T07:45:31.311908+0000","last_clean":"2024-02-21T07:45:31.311908+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:45:31.311908+0000","last_undegraded":"2024-02-21T07:45:31.311908+0000","last_fullsized":"2024-02-21T07:45:31.311908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.397731+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:45:47.397731+0000","last_peered":"2024-02-21T07:45:47.397731+0000","last_clean":"2024-02-21T07:45:47.397731+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:45:47.397731+0000","last_undegraded":"2024-02-21T07:45:47.397731+0000","last_fullsized":"2024-02-21T07:45:47.397731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263705+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:45:32.263705+0000","last_peered":"2024-02-21T07:45:32.263705+0000","last_clean":"2024-02-21T07:45:32.263705+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:45:32.263705+0000","last_undegraded":"2024-02-21T07:45:32.263705+0000","last_fullsized":"2024-02-21T07:45:32.263705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264755+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:45:32.264755+0000","last_peered":"2024-02-21T07:45:32.264755+0000","last_clean":"2024-02-21T07:45:32.264755+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:45:32.264755+0000","last_undegraded":"2024-02-21T07:45:32.264755+0000","last_fullsized":"2024-02-21T07:45:32.264755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264905+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:45:32.264905+0000","last_peered":"2024-02-21T07:45:32.264905+0000","last_clean":"2024-02-21T07:45:32.264905+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:45:32.264905+0000","last_undegraded":"2024-02-21T07:45:32.264905+0000","last_fullsized":"2024-02-21T07:45:32.264905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410039+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:45:48.410039+0000","last_peered":"2024-02-21T07:45:48.410039+0000","last_clean":"2024-02-21T07:45:48.410039+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:45:48.410039+0000","last_undegraded":"2024-02-21T07:45:48.410039+0000","last_fullsized":"2024-02-21T07:45:48.410039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263291+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:45:32.263291+0000","last_peered":"2024-02-21T07:45:32.263291+0000","last_clean":"2024-02-21T07:45:32.263291+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:45:32.263291+0000","last_undegraded":"2024-02-21T07:45:32.263291+0000","last_fullsized":"2024-02-21T07:45:32.263291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263867+0000","last_change":"2024-02-21T07:45:30.321767+0000","last_active":"2024-02-21T07:45:32.263867+0000","last_peered":"2024-02-21T07:45:32.263867+0000","last_clean":"2024-02-21T07:45:32.263867+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:45:32.263867+0000","last_undegraded":"2024-02-21T07:45:32.263867+0000","last_fullsized":"2024-02-21T07:45:32.263867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264766+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:45:32.264766+0000","last_peered":"2024-02-21T07:45:32.264766+0000","last_clean":"2024-02-21T07:45:32.264766+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:45:32.264766+0000","last_undegraded":"2024-02-21T07:45:32.264766+0000","last_fullsized":"2024-02-21T07:45:32.264766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310577+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:45:31.310577+0000","last_peered":"2024-02-21T07:45:31.310577+0000","last_clean":"2024-02-21T07:45:31.310577+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:45:31.310577+0000","last_undegraded":"2024-02-21T07:45:31.310577+0000","last_fullsized":"2024-02-21T07:45:31.310577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761881+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:45:31.761881+0000","last_peered":"2024-02-21T07:45:31.761881+0000","last_clean":"2024-02-21T07:45:31.761881+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:45:31.761881+0000","last_undegraded":"2024-02-21T07:45:31.761881+0000","last_fullsized":"2024-02-21T07:45:31.761881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306408+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:45:31.306408+0000","last_peered":"2024-02-21T07:45:31.306408+0000","last_clean":"2024-02-21T07:45:31.306408+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:45:31.306408+0000","last_undegraded":"2024-02-21T07:45:31.306408+0000","last_fullsized":"2024-02-21T07:45:31.306408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.406939+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:45:49.406939+0000","last_peered":"2024-02-21T07:45:49.406939+0000","last_clean":"2024-02-21T07:45:49.406939+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:45:49.406939+0000","last_undegraded":"2024-02-21T07:45:49.406939+0000","last_fullsized":"2024-02-21T07:45:49.406939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762042+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:45:31.762042+0000","last_peered":"2024-02-21T07:45:31.762042+0000","last_clean":"2024-02-21T07:45:31.762042+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:45:31.762042+0000","last_undegraded":"2024-02-21T07:45:31.762042+0000","last_fullsized":"2024-02-21T07:45:31.762042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762020+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:45:31.762020+0000","last_peered":"2024-02-21T07:45:31.762020+0000","last_clean":"2024-02-21T07:45:31.762020+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:45:31.762020+0000","last_undegraded":"2024-02-21T07:45:31.762020+0000","last_fullsized":"2024-02-21T07:45:31.762020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.415737+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:45:48.415737+0000","last_peered":"2024-02-21T07:45:48.415737+0000","last_clean":"2024-02-21T07:45:48.415737+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:45:48.415737+0000","last_undegraded":"2024-02-21T07:45:48.415737+0000","last_fullsized":"2024-02-21T07:45:48.415737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310469+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:45:31.310469+0000","last_peered":"2024-02-21T07:45:31.310469+0000","last_clean":"2024-02-21T07:45:31.310469+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:45:31.310469+0000","last_undegraded":"2024-02-21T07:45:31.310469+0000","last_fullsized":"2024-02-21T07:45:31.310469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263388+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:45:32.263388+0000","last_peered":"2024-02-21T07:45:32.263388+0000","last_clean":"2024-02-21T07:45:32.263388+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:45:32.263388+0000","last_undegraded":"2024-02-21T07:45:32.263388+0000","last_fullsized":"2024-02-21T07:45:32.263388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410278+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:45:48.410278+0000","last_peered":"2024-02-21T07:45:48.410278+0000","last_clean":"2024-02-21T07:45:48.410278+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:45:48.410278+0000","last_undegraded":"2024-02-21T07:45:48.410278+0000","last_fullsized":"2024-02-21T07:45:48.410278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264171+0000","last_change":"2024-02-21T07:45:30.329832+0000","last_active":"2024-02-21T07:45:32.264171+0000","last_peered":"2024-02-21T07:45:32.264171+0000","last_clean":"2024-02-21T07:45:32.264171+0000","last_became_active":"2024-02-21T07:45:30.329423+0000","last_became_peered":"2024-02-21T07:45:30.329423+0000","last_unstale":"2024-02-21T07:45:32.264171+0000","last_undegraded":"2024-02-21T07:45:32.264171+0000","last_fullsized":"2024-02-21T07:45:32.264171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263472+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:45:32.263472+0000","last_peered":"2024-02-21T07:45:32.263472+0000","last_clean":"2024-02-21T07:45:32.263472+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:45:32.263472+0000","last_undegraded":"2024-02-21T07:45:32.263472+0000","last_fullsized":"2024-02-21T07:45:32.263472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400439+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:45:47.400439+0000","last_peered":"2024-02-21T07:45:47.400439+0000","last_clean":"2024-02-21T07:45:47.400439+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:45:47.400439+0000","last_undegraded":"2024-02-21T07:45:47.400439+0000","last_fullsized":"2024-02-21T07:45:47.400439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306127+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:45:31.306127+0000","last_peered":"2024-02-21T07:45:31.306127+0000","last_clean":"2024-02-21T07:45:31.306127+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:45:31.306127+0000","last_undegraded":"2024-02-21T07:45:31.306127+0000","last_fullsized":"2024-02-21T07:45:31.306127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309551+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:45:31.309551+0000","last_peered":"2024-02-21T07:45:31.309551+0000","last_clean":"2024-02-21T07:45:31.309551+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:45:31.309551+0000","last_undegraded":"2024-02-21T07:45:31.309551+0000","last_fullsized":"2024-02-21T07:45:31.309551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410331+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:45:48.410331+0000","last_peered":"2024-02-21T07:45:48.410331+0000","last_clean":"2024-02-21T07:45:48.410331+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:45:48.410331+0000","last_undegraded":"2024-02-21T07:45:48.410331+0000","last_fullsized":"2024-02-21T07:45:48.410331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762292+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:45:31.762292+0000","last_peered":"2024-02-21T07:45:31.762292+0000","last_clean":"2024-02-21T07:45:31.762292+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:45:31.762292+0000","last_undegraded":"2024-02-21T07:45:31.762292+0000","last_fullsized":"2024-02-21T07:45:31.762292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229733+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:45:32.229733+0000","last_peered":"2024-02-21T07:45:32.229733+0000","last_clean":"2024-02-21T07:45:32.229733+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:45:32.229733+0000","last_undegraded":"2024-02-21T07:45:32.229733+0000","last_fullsized":"2024-02-21T07:45:32.229733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398473+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:45:47.398473+0000","last_peered":"2024-02-21T07:45:47.398473+0000","last_clean":"2024-02-21T07:45:47.398473+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:45:47.398473+0000","last_undegraded":"2024-02-21T07:45:47.398473+0000","last_fullsized":"2024-02-21T07:45:47.398473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263546+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:45:32.263546+0000","last_peered":"2024-02-21T07:45:32.263546+0000","last_clean":"2024-02-21T07:45:32.263546+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:45:32.263546+0000","last_undegraded":"2024-02-21T07:45:32.263546+0000","last_fullsized":"2024-02-21T07:45:32.263546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263563+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:45:32.263563+0000","last_peered":"2024-02-21T07:45:32.263563+0000","last_clean":"2024-02-21T07:45:32.263563+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:45:32.263563+0000","last_undegraded":"2024-02-21T07:45:32.263563+0000","last_fullsized":"2024-02-21T07:45:32.263563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762450+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:45:31.762450+0000","last_peered":"2024-02-21T07:45:31.762450+0000","last_clean":"2024-02-21T07:45:31.762450+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:45:31.762450+0000","last_undegraded":"2024-02-21T07:45:31.762450+0000","last_fullsized":"2024-02-21T07:45:31.762450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264880+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:45:32.264880+0000","last_peered":"2024-02-21T07:45:32.264880+0000","last_clean":"2024-02-21T07:45:32.264880+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:45:32.264880+0000","last_undegraded":"2024-02-21T07:45:32.264880+0000","last_fullsized":"2024-02-21T07:45:32.264880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398480+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:45:47.398480+0000","last_peered":"2024-02-21T07:45:47.398480+0000","last_clean":"2024-02-21T07:45:47.398480+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:45:47.398480+0000","last_undegraded":"2024-02-21T07:45:47.398480+0000","last_fullsized":"2024-02-21T07:45:47.398480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263330+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:45:32.263330+0000","last_peered":"2024-02-21T07:45:32.263330+0000","last_clean":"2024-02-21T07:45:32.263330+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:45:32.263330+0000","last_undegraded":"2024-02-21T07:45:32.263330+0000","last_fullsized":"2024-02-21T07:45:32.263330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263656+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:45:32.263656+0000","last_peered":"2024-02-21T07:45:32.263656+0000","last_clean":"2024-02-21T07:45:32.263656+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:45:32.263656+0000","last_undegraded":"2024-02-21T07:45:32.263656+0000","last_fullsized":"2024-02-21T07:45:32.263656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398962+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:45:47.398962+0000","last_peered":"2024-02-21T07:45:47.398962+0000","last_clean":"2024-02-21T07:45:47.398962+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:45:47.398962+0000","last_undegraded":"2024-02-21T07:45:47.398962+0000","last_fullsized":"2024-02-21T07:45:47.398962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312070+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:45:31.312070+0000","last_peered":"2024-02-21T07:45:31.312070+0000","last_clean":"2024-02-21T07:45:31.312070+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:45:31.312070+0000","last_undegraded":"2024-02-21T07:45:31.312070+0000","last_fullsized":"2024-02-21T07:45:31.312070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264465+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:45:32.264465+0000","last_peered":"2024-02-21T07:45:32.264465+0000","last_clean":"2024-02-21T07:45:32.264465+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:45:32.264465+0000","last_undegraded":"2024-02-21T07:45:32.264465+0000","last_fullsized":"2024-02-21T07:45:32.264465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263376+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:45:32.263376+0000","last_peered":"2024-02-21T07:45:32.263376+0000","last_clean":"2024-02-21T07:45:32.263376+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:45:32.263376+0000","last_undegraded":"2024-02-21T07:45:32.263376+0000","last_fullsized":"2024-02-21T07:45:32.263376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762361+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:45:31.762361+0000","last_peered":"2024-02-21T07:45:31.762361+0000","last_clean":"2024-02-21T07:45:31.762361+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:45:31.762361+0000","last_undegraded":"2024-02-21T07:45:31.762361+0000","last_fullsized":"2024-02-21T07:45:31.762361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306530+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:45:31.306530+0000","last_peered":"2024-02-21T07:45:31.306530+0000","last_clean":"2024-02-21T07:45:31.306530+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:45:31.306530+0000","last_undegraded":"2024-02-21T07:45:31.306530+0000","last_fullsized":"2024-02-21T07:45:31.306530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312026+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:45:31.312026+0000","last_peered":"2024-02-21T07:45:31.312026+0000","last_clean":"2024-02-21T07:45:31.312026+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:45:31.312026+0000","last_undegraded":"2024-02-21T07:45:31.312026+0000","last_fullsized":"2024-02-21T07:45:31.312026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417019+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:45:48.417019+0000","last_peered":"2024-02-21T07:45:48.417019+0000","last_clean":"2024-02-21T07:45:48.417019+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:45:48.417019+0000","last_undegraded":"2024-02-21T07:45:48.417019+0000","last_fullsized":"2024-02-21T07:45:48.417019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409397+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:45:48.409397+0000","last_peered":"2024-02-21T07:45:48.409397+0000","last_clean":"2024-02-21T07:45:48.409397+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:45:48.409397+0000","last_undegraded":"2024-02-21T07:45:48.409397+0000","last_fullsized":"2024-02-21T07:45:48.409397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762120+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:45:31.762120+0000","last_peered":"2024-02-21T07:45:31.762120+0000","last_clean":"2024-02-21T07:45:31.762120+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:45:31.762120+0000","last_undegraded":"2024-02-21T07:45:31.762120+0000","last_fullsized":"2024-02-21T07:45:31.762120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306666+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:45:31.306666+0000","last_peered":"2024-02-21T07:45:31.306666+0000","last_clean":"2024-02-21T07:45:31.306666+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:45:31.306666+0000","last_undegraded":"2024-02-21T07:45:31.306666+0000","last_fullsized":"2024-02-21T07:45:31.306666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399479+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:45:47.399479+0000","last_peered":"2024-02-21T07:45:47.399479+0000","last_clean":"2024-02-21T07:45:47.399479+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:45:47.399479+0000","last_undegraded":"2024-02-21T07:45:47.399479+0000","last_fullsized":"2024-02-21T07:45:47.399479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229535+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:45:32.229535+0000","last_peered":"2024-02-21T07:45:32.229535+0000","last_clean":"2024-02-21T07:45:32.229535+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:45:32.229535+0000","last_undegraded":"2024-02-21T07:45:32.229535+0000","last_fullsized":"2024-02-21T07:45:32.229535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307101+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:45:31.307101+0000","last_peered":"2024-02-21T07:45:31.307101+0000","last_clean":"2024-02-21T07:45:31.307101+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:45:31.307101+0000","last_undegraded":"2024-02-21T07:45:31.307101+0000","last_fullsized":"2024-02-21T07:45:31.307101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306135+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:45:31.306135+0000","last_peered":"2024-02-21T07:45:31.306135+0000","last_clean":"2024-02-21T07:45:31.306135+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:45:31.306135+0000","last_undegraded":"2024-02-21T07:45:31.306135+0000","last_fullsized":"2024-02-21T07:45:31.306135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306468+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:45:31.306468+0000","last_peered":"2024-02-21T07:45:31.306468+0000","last_clean":"2024-02-21T07:45:31.306468+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:45:31.306468+0000","last_undegraded":"2024-02-21T07:45:31.306468+0000","last_fullsized":"2024-02-21T07:45:31.306468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263724+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:45:32.263724+0000","last_peered":"2024-02-21T07:45:32.263724+0000","last_clean":"2024-02-21T07:45:32.263724+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:45:32.263724+0000","last_undegraded":"2024-02-21T07:45:32.263724+0000","last_fullsized":"2024-02-21T07:45:32.263724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310293+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:45:31.310293+0000","last_peered":"2024-02-21T07:45:31.310293+0000","last_clean":"2024-02-21T07:45:31.310293+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:45:31.310293+0000","last_undegraded":"2024-02-21T07:45:31.310293+0000","last_fullsized":"2024-02-21T07:45:31.310293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306405+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:45:31.306405+0000","last_peered":"2024-02-21T07:45:31.306405+0000","last_clean":"2024-02-21T07:45:31.306405+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:45:31.306405+0000","last_undegraded":"2024-02-21T07:45:31.306405+0000","last_fullsized":"2024-02-21T07:45:31.306405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313391+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:45:31.313391+0000","last_peered":"2024-02-21T07:45:31.313391+0000","last_clean":"2024-02-21T07:45:31.313391+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:45:31.313391+0000","last_undegraded":"2024-02-21T07:45:31.313391+0000","last_fullsized":"2024-02-21T07:45:31.313391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761962+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:45:31.761962+0000","last_peered":"2024-02-21T07:45:31.761962+0000","last_clean":"2024-02-21T07:45:31.761962+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:45:31.761962+0000","last_undegraded":"2024-02-21T07:45:31.761962+0000","last_fullsized":"2024-02-21T07:45:31.761962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312075+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:45:31.312075+0000","last_peered":"2024-02-21T07:45:31.312075+0000","last_clean":"2024-02-21T07:45:31.312075+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:45:31.312075+0000","last_undegraded":"2024-02-21T07:45:31.312075+0000","last_fullsized":"2024-02-21T07:45:31.312075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263718+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:45:32.263718+0000","last_peered":"2024-02-21T07:45:32.263718+0000","last_clean":"2024-02-21T07:45:32.263718+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:45:32.263718+0000","last_undegraded":"2024-02-21T07:45:32.263718+0000","last_fullsized":"2024-02-21T07:45:32.263718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309927+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:45:31.309927+0000","last_peered":"2024-02-21T07:45:31.309927+0000","last_clean":"2024-02-21T07:45:31.309927+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:45:31.309927+0000","last_undegraded":"2024-02-21T07:45:31.309927+0000","last_fullsized":"2024-02-21T07:45:31.309927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306150+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:45:31.306150+0000","last_peered":"2024-02-21T07:45:31.306150+0000","last_clean":"2024-02-21T07:45:31.306150+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:45:31.306150+0000","last_undegraded":"2024-02-21T07:45:31.306150+0000","last_fullsized":"2024-02-21T07:45:31.306150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307003+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:45:31.307003+0000","last_peered":"2024-02-21T07:45:31.307003+0000","last_clean":"2024-02-21T07:45:31.307003+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:45:31.307003+0000","last_undegraded":"2024-02-21T07:45:31.307003+0000","last_fullsized":"2024-02-21T07:45:31.307003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264340+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:45:32.264340+0000","last_peered":"2024-02-21T07:45:32.264340+0000","last_clean":"2024-02-21T07:45:32.264340+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:45:32.264340+0000","last_undegraded":"2024-02-21T07:45:32.264340+0000","last_fullsized":"2024-02-21T07:45:32.264340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306653+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:45:31.306653+0000","last_peered":"2024-02-21T07:45:31.306653+0000","last_clean":"2024-02-21T07:45:31.306653+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:45:31.306653+0000","last_undegraded":"2024-02-21T07:45:31.306653+0000","last_fullsized":"2024-02-21T07:45:31.306653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263066+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:45:32.263066+0000","last_peered":"2024-02-21T07:45:32.263066+0000","last_clean":"2024-02-21T07:45:32.263066+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:45:32.263066+0000","last_undegraded":"2024-02-21T07:45:32.263066+0000","last_fullsized":"2024-02-21T07:45:32.263066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263638+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:45:32.263638+0000","last_peered":"2024-02-21T07:45:32.263638+0000","last_clean":"2024-02-21T07:45:32.263638+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:45:32.263638+0000","last_undegraded":"2024-02-21T07:45:32.263638+0000","last_fullsized":"2024-02-21T07:45:32.263638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263493+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:45:32.263493+0000","last_peered":"2024-02-21T07:45:32.263493+0000","last_clean":"2024-02-21T07:45:32.263493+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:45:32.263493+0000","last_undegraded":"2024-02-21T07:45:32.263493+0000","last_fullsized":"2024-02-21T07:45:32.263493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309714+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:45:31.309714+0000","last_peered":"2024-02-21T07:45:31.309714+0000","last_clean":"2024-02-21T07:45:31.309714+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:45:31.309714+0000","last_undegraded":"2024-02-21T07:45:31.309714+0000","last_fullsized":"2024-02-21T07:45:31.309714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264668+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:45:32.264668+0000","last_peered":"2024-02-21T07:45:32.264668+0000","last_clean":"2024-02-21T07:45:32.264668+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:45:32.264668+0000","last_undegraded":"2024-02-21T07:45:32.264668+0000","last_fullsized":"2024-02-21T07:45:32.264668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264939+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:45:32.264939+0000","last_peered":"2024-02-21T07:45:32.264939+0000","last_clean":"2024-02-21T07:45:32.264939+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:45:32.264939+0000","last_undegraded":"2024-02-21T07:45:32.264939+0000","last_fullsized":"2024-02-21T07:45:32.264939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264424+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:45:32.264424+0000","last_peered":"2024-02-21T07:45:32.264424+0000","last_clean":"2024-02-21T07:45:32.264424+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:45:32.264424+0000","last_undegraded":"2024-02-21T07:45:32.264424+0000","last_fullsized":"2024-02-21T07:45:32.264424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264005+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:45:32.264005+0000","last_peered":"2024-02-21T07:45:32.264005+0000","last_clean":"2024-02-21T07:45:32.264005+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:45:32.264005+0000","last_undegraded":"2024-02-21T07:45:32.264005+0000","last_fullsized":"2024-02-21T07:45:32.264005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311690+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:45:31.311690+0000","last_peered":"2024-02-21T07:45:31.311690+0000","last_clean":"2024-02-21T07:45:31.311690+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:45:31.311690+0000","last_undegraded":"2024-02-21T07:45:31.311690+0000","last_fullsized":"2024-02-21T07:45:31.311690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263714+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:45:32.263714+0000","last_peered":"2024-02-21T07:45:32.263714+0000","last_clean":"2024-02-21T07:45:32.263714+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:45:32.263714+0000","last_undegraded":"2024-02-21T07:45:32.263714+0000","last_fullsized":"2024-02-21T07:45:32.263714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.262967+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:45:32.262967+0000","last_peered":"2024-02-21T07:45:32.262967+0000","last_clean":"2024-02-21T07:45:32.262967+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:45:32.262967+0000","last_undegraded":"2024-02-21T07:45:32.262967+0000","last_fullsized":"2024-02-21T07:45:32.262967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229582+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:45:32.229582+0000","last_peered":"2024-02-21T07:45:32.229582+0000","last_clean":"2024-02-21T07:45:32.229582+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:45:32.229582+0000","last_undegraded":"2024-02-21T07:45:32.229582+0000","last_fullsized":"2024-02-21T07:45:32.229582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264570+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:45:32.264570+0000","last_peered":"2024-02-21T07:45:32.264570+0000","last_clean":"2024-02-21T07:45:32.264570+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:45:32.264570+0000","last_undegraded":"2024-02-21T07:45:32.264570+0000","last_fullsized":"2024-02-21T07:45:32.264570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264582+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:45:32.264582+0000","last_peered":"2024-02-21T07:45:32.264582+0000","last_clean":"2024-02-21T07:45:32.264582+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:45:32.264582+0000","last_undegraded":"2024-02-21T07:45:32.264582+0000","last_fullsized":"2024-02-21T07:45:32.264582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264526+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:45:32.264526+0000","last_peered":"2024-02-21T07:45:32.264526+0000","last_clean":"2024-02-21T07:45:32.264526+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:45:32.264526+0000","last_undegraded":"2024-02-21T07:45:32.264526+0000","last_fullsized":"2024-02-21T07:45:32.264526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306596+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:45:31.306596+0000","last_peered":"2024-02-21T07:45:31.306596+0000","last_clean":"2024-02-21T07:45:31.306596+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:45:31.306596+0000","last_undegraded":"2024-02-21T07:45:31.306596+0000","last_fullsized":"2024-02-21T07:45:31.306596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444039,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":134658,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":138728,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":135330,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.821}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.782}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0089999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":134814,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":726196,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":134658,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7269999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":385024,"data_stored":726502,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":135280,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":134838,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7370000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9830000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1269999999999998}]}]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":135896,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":138500,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":135464,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.833}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:45:53.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:45:53.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.545+0000 7f100b600640 1 Processor -- start 2024-02-21T07:45:53.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.545+0000 7f100b600640 1 -- start start 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.547+0000 7f100b600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1004186df0 0x7f10040f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.547+0000 7f100b600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10040f9ac0 con 0x7f1004185f20 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.547+0000 7f100b600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f100406dc90 con 0x7f1004188770 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.547+0000 7f100b600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100406df70 con 0x7f1004186df0 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.547+0000 7f1008c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1004185f20 0x7f10041866e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40304/0 (socket says 172.21.15.100:40304) 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.548+0000 7f1008c00640 1 -- 172.21.15.100:0/3793964772 learned_addr learned my addr 172.21.15.100:0/3793964772 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:53.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.548+0000 7f1003e00640 1 --2- 172.21.15.100:0/3793964772 >> v2:172.21.15.156:3300/0 conn(0x7f1004186df0 0x7f10040f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.548+0000 7f1003e00640 1 -- 172.21.15.100:0/3793964772 >> v1:172.21.15.156:6789/0 conn(0x7f1004188770 legacy=0x7f1004188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.548+0000 7f1003e00640 1 -- 172.21.15.100:0/3793964772 >> v1:172.21.15.100:6789/0 conn(0x7f1004185f20 legacy=0x7f10041866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.548+0000 7f1003e00640 1 -- 172.21.15.100:0/3793964772 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100406e250 con 0x7f1004186df0 2024-02-21T07:45:53.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.549+0000 7f1003e00640 1 --2- 172.21.15.100:0/3793964772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004186df0 0x7f10040f9580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36c15382c19ee855 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.549+0000 7f1003400640 1 -- 172.21.15.100:0/3793964772 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002e070 con 0x7f1004186df0 2024-02-21T07:45:53.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.549+0000 7f1003400640 1 -- 172.21.15.100:0/3793964772 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00315a0 con 0x7f1004186df0 2024-02-21T07:45:53.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.549+0000 7f1003400640 1 -- 172.21.15.100:0/3793964772 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0031930 con 0x7f1004186df0 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 -- 172.21.15.100:0/3793964772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004186df0 msgr2=0x7f10040f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 --2- 172.21.15.100:0/3793964772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004186df0 0x7f10040f9580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00097a0 tx=0x7f0ff002b840 comp rx=0 tx=0).stop 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 -- 172.21.15.100:0/3793964772 shutdown_connections 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 --2- 172.21.15.100:0/3793964772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004186df0 0x7f10040f9580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 -- 172.21.15.100:0/3793964772 >> 172.21.15.100:0/3793964772 conn(0x7f10040ce160 msgr2=0x7f10040ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 -- 172.21.15.100:0/3793964772 shutdown_connections 2024-02-21T07:45:53.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.550+0000 7f100b600640 1 -- 172.21.15.100:0/3793964772 wait complete. 2024-02-21T07:45:53.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.552+0000 7f100b600640 1 Processor -- start 2024-02-21T07:45:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.552+0000 7f100b600640 1 -- start start 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 0x7f1004175a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1004188770 0x7f10040f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040f48e0 con 0x7f1004186df0 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040f4bc0 con 0x7f1004185f20 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.553+0000 7f100b600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10040f4ea0 con 0x7f1004188770 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50986/0 (socket says 172.21.15.100:50986) 2024-02-21T07:45:53.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 -- 172.21.15.100:0/1309075854 learned_addr learned my addr 172.21.15.100:0/1309075854 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1008c00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 0x7f1004175a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1009600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1004188770 0x7f10040f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 -- 172.21.15.100:0/1309075854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1004188770 msgr2=0x7f10040f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1004188770 0x7f10040f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 -- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 msgr2=0x7f1004175a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 0x7f1004175a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1003e00640 1 -- 172.21.15.100:0/1309075854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009400 con 0x7f1004186df0 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.554+0000 7f1008c00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 0x7f1004175a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f1003e00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034040 tx=0x7f0ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032840 con 0x7f1004186df0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00329c0 con 0x7f1004186df0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0032d70 con 0x7f1004186df0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10040f5180 con 0x7f1004186df0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.555+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10040f5740 con 0x7f1004186df0 2024-02-21T07:45:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.556+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1004067c80 con 0x7f1004186df0 2024-02-21T07:45:53.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.558+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0ff004e430 con 0x7f1004186df0 2024-02-21T07:45:53.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.559+0000 7f1000c00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 0x7f0fe40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:53.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.560+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f0ff00ebd60 con 0x7f1004186df0 2024-02-21T07:45:53.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.560+0000 7f1008c00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 0x7f0fe40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:53.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.560+0000 7f1008c00640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 0x7f0fe40a15f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8007fd0 tx=0x7f0ff8007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:53.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.563+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ff00b59f0 con 0x7f1004186df0 2024-02-21T07:45:53.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.756+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f100417c520 con 0x7f0fe409f130 2024-02-21T07:45:53.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.766+0000 7f1000c00640 1 -- 172.21.15.100:0/1309075854 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367757 (secure 0 0 0) 0x7f100417c520 con 0x7f0fe409f130 2024-02-21T07:45:53.778 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:53.780 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:45:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.773+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 msgr2=0x7f0fe40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.773+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 0x7f0fe40a15f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8007fd0 tx=0x7f0ff8007e80 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.773+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 msgr2=0x7f10041844c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.773+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0034040 tx=0x7f0ff00046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 shutdown_connections 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1004188770 0x7f10040f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0fe409f130 0x7f0fe40a15f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1004186df0 0x7f10041844c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 --2- 172.21.15.100:0/1309075854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1004185f20 0x7f1004175a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 >> 172.21.15.100:0/1309075854 conn(0x7f10040ce160 msgr2=0x7f10040ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 shutdown_connections 2024-02-21T07:45:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:53.774+0000 7f100b600640 1 -- 172.21.15.100:0/1309075854 wait complete. 2024-02-21T07:45:53.800 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-02-21T07:45:51.899053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":131,"num_read_kb":114,"num_write":310,"num_write_kb":2981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":344528,"kb_used_data":3688,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1132117552,"statfs":{"total":1159641169920,"available":1159288373248,"internally_reserved":0,"allocated":3776512,"data_stored":2810864,"data_compressed":168240,"data_compressed_allocated":237568,"data_compressed_original":1441792,"omap_allocated":19141,"internal_metadata":348894523},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2953,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":82,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003960"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.411092+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:45:48.411092+0000","last_peered":"2024-02-21T07:45:48.411092+0000","last_clean":"2024-02-21T07:45:48.411092+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:45:48.411092+0000","last_undegraded":"2024-02-21T07:45:48.411092+0000","last_fullsized":"2024-02-21T07:45:48.411092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313026+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:45:31.313026+0000","last_peered":"2024-02-21T07:45:31.313026+0000","last_clean":"2024-02-21T07:45:31.313026+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:45:31.313026+0000","last_undegraded":"2024-02-21T07:45:31.313026+0000","last_fullsized":"2024-02-21T07:45:31.313026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306126+0000","last_change":"2024-02-21T07:45:30.324367+0000","last_active":"2024-02-21T07:45:31.306126+0000","last_peered":"2024-02-21T07:45:31.306126+0000","last_clean":"2024-02-21T07:45:31.306126+0000","last_became_active":"2024-02-21T07:45:30.324047+0000","last_became_peered":"2024-02-21T07:45:30.324047+0000","last_unstale":"2024-02-21T07:45:31.306126+0000","last_undegraded":"2024-02-21T07:45:31.306126+0000","last_fullsized":"2024-02-21T07:45:31.306126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313438+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:45:31.313438+0000","last_peered":"2024-02-21T07:45:31.313438+0000","last_clean":"2024-02-21T07:45:31.313438+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:45:31.313438+0000","last_undegraded":"2024-02-21T07:45:31.313438+0000","last_fullsized":"2024-02-21T07:45:31.313438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264335+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:45:32.264335+0000","last_peered":"2024-02-21T07:45:32.264335+0000","last_clean":"2024-02-21T07:45:32.264335+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:45:32.264335+0000","last_undegraded":"2024-02-21T07:45:32.264335+0000","last_fullsized":"2024-02-21T07:45:32.264335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263673+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:45:32.263673+0000","last_peered":"2024-02-21T07:45:32.263673+0000","last_clean":"2024-02-21T07:45:32.263673+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:45:32.263673+0000","last_undegraded":"2024-02-21T07:45:32.263673+0000","last_fullsized":"2024-02-21T07:45:32.263673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409242+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:45:48.409242+0000","last_peered":"2024-02-21T07:45:48.409242+0000","last_clean":"2024-02-21T07:45:48.409242+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:45:48.409242+0000","last_undegraded":"2024-02-21T07:45:48.409242+0000","last_fullsized":"2024-02-21T07:45:48.409242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263471+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:45:32.263471+0000","last_peered":"2024-02-21T07:45:32.263471+0000","last_clean":"2024-02-21T07:45:32.263471+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:45:32.263471+0000","last_undegraded":"2024-02-21T07:45:32.263471+0000","last_fullsized":"2024-02-21T07:45:32.263471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264669+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:45:32.264669+0000","last_peered":"2024-02-21T07:45:32.264669+0000","last_clean":"2024-02-21T07:45:32.264669+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:45:32.264669+0000","last_undegraded":"2024-02-21T07:45:32.264669+0000","last_fullsized":"2024-02-21T07:45:32.264669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229773+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:45:32.229773+0000","last_peered":"2024-02-21T07:45:32.229773+0000","last_clean":"2024-02-21T07:45:32.229773+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:45:32.229773+0000","last_undegraded":"2024-02-21T07:45:32.229773+0000","last_fullsized":"2024-02-21T07:45:32.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762184+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:45:31.762184+0000","last_peered":"2024-02-21T07:45:31.762184+0000","last_clean":"2024-02-21T07:45:31.762184+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:45:31.762184+0000","last_undegraded":"2024-02-21T07:45:31.762184+0000","last_fullsized":"2024-02-21T07:45:31.762184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264047+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:45:32.264047+0000","last_peered":"2024-02-21T07:45:32.264047+0000","last_clean":"2024-02-21T07:45:32.264047+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:45:32.264047+0000","last_undegraded":"2024-02-21T07:45:32.264047+0000","last_fullsized":"2024-02-21T07:45:32.264047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263973+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:45:32.263973+0000","last_peered":"2024-02-21T07:45:32.263973+0000","last_clean":"2024-02-21T07:45:32.263973+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:45:32.263973+0000","last_undegraded":"2024-02-21T07:45:32.263973+0000","last_fullsized":"2024-02-21T07:45:32.263973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399251+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:45:47.399251+0000","last_peered":"2024-02-21T07:45:47.399251+0000","last_clean":"2024-02-21T07:45:47.399251+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:45:47.399251+0000","last_undegraded":"2024-02-21T07:45:47.399251+0000","last_fullsized":"2024-02-21T07:45:47.399251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264118+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:45:32.264118+0000","last_peered":"2024-02-21T07:45:32.264118+0000","last_clean":"2024-02-21T07:45:32.264118+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:45:32.264118+0000","last_undegraded":"2024-02-21T07:45:32.264118+0000","last_fullsized":"2024-02-21T07:45:32.264118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312471+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:45:31.312471+0000","last_peered":"2024-02-21T07:45:31.312471+0000","last_clean":"2024-02-21T07:45:31.312471+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:45:31.312471+0000","last_undegraded":"2024-02-21T07:45:31.312471+0000","last_fullsized":"2024-02-21T07:45:31.312471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306617+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:45:31.306617+0000","last_peered":"2024-02-21T07:45:31.306617+0000","last_clean":"2024-02-21T07:45:31.306617+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:45:31.306617+0000","last_undegraded":"2024-02-21T07:45:31.306617+0000","last_fullsized":"2024-02-21T07:45:31.306617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264450+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:45:32.264450+0000","last_peered":"2024-02-21T07:45:32.264450+0000","last_clean":"2024-02-21T07:45:32.264450+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:45:32.264450+0000","last_undegraded":"2024-02-21T07:45:32.264450+0000","last_fullsized":"2024-02-21T07:45:32.264450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306047+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:45:31.306047+0000","last_peered":"2024-02-21T07:45:31.306047+0000","last_clean":"2024-02-21T07:45:31.306047+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:45:31.306047+0000","last_undegraded":"2024-02-21T07:45:31.306047+0000","last_fullsized":"2024-02-21T07:45:31.306047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400352+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:45:47.400352+0000","last_peered":"2024-02-21T07:45:47.400352+0000","last_clean":"2024-02-21T07:45:47.400352+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:45:47.400352+0000","last_undegraded":"2024-02-21T07:45:47.400352+0000","last_fullsized":"2024-02-21T07:45:47.400352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264410+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:45:32.264410+0000","last_peered":"2024-02-21T07:45:32.264410+0000","last_clean":"2024-02-21T07:45:32.264410+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:45:32.264410+0000","last_undegraded":"2024-02-21T07:45:32.264410+0000","last_fullsized":"2024-02-21T07:45:32.264410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229409+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:45:32.229409+0000","last_peered":"2024-02-21T07:45:32.229409+0000","last_clean":"2024-02-21T07:45:32.229409+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:45:32.229409+0000","last_undegraded":"2024-02-21T07:45:32.229409+0000","last_fullsized":"2024-02-21T07:45:32.229409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398629+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:45:47.398629+0000","last_peered":"2024-02-21T07:45:47.398629+0000","last_clean":"2024-02-21T07:45:47.398629+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:45:47.398629+0000","last_undegraded":"2024-02-21T07:45:47.398629+0000","last_fullsized":"2024-02-21T07:45:47.398629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264395+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:45:32.264395+0000","last_peered":"2024-02-21T07:45:32.264395+0000","last_clean":"2024-02-21T07:45:32.264395+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:45:32.264395+0000","last_undegraded":"2024-02-21T07:45:32.264395+0000","last_fullsized":"2024-02-21T07:45:32.264395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264627+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:45:32.264627+0000","last_peered":"2024-02-21T07:45:32.264627+0000","last_clean":"2024-02-21T07:45:32.264627+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:45:32.264627+0000","last_undegraded":"2024-02-21T07:45:32.264627+0000","last_fullsized":"2024-02-21T07:45:32.264627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.396666+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:45:47.396666+0000","last_peered":"2024-02-21T07:45:47.396666+0000","last_clean":"2024-02-21T07:45:47.396666+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:45:47.396666+0000","last_undegraded":"2024-02-21T07:45:47.396666+0000","last_fullsized":"2024-02-21T07:45:47.396666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306822+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:45:31.306822+0000","last_peered":"2024-02-21T07:45:31.306822+0000","last_clean":"2024-02-21T07:45:31.306822+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:45:31.306822+0000","last_undegraded":"2024-02-21T07:45:31.306822+0000","last_fullsized":"2024-02-21T07:45:31.306822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313406+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:45:31.313406+0000","last_peered":"2024-02-21T07:45:31.313406+0000","last_clean":"2024-02-21T07:45:31.313406+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:45:31.313406+0000","last_undegraded":"2024-02-21T07:45:31.313406+0000","last_fullsized":"2024-02-21T07:45:31.313406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.413304+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:45:48.413304+0000","last_peered":"2024-02-21T07:45:48.413304+0000","last_clean":"2024-02-21T07:45:48.413304+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:45:48.413304+0000","last_undegraded":"2024-02-21T07:45:48.413304+0000","last_fullsized":"2024-02-21T07:45:48.413304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312329+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:45:31.312329+0000","last_peered":"2024-02-21T07:45:31.312329+0000","last_clean":"2024-02-21T07:45:31.312329+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:45:31.312329+0000","last_undegraded":"2024-02-21T07:45:31.312329+0000","last_fullsized":"2024-02-21T07:45:31.312329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310412+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:45:31.310412+0000","last_peered":"2024-02-21T07:45:31.310412+0000","last_clean":"2024-02-21T07:45:31.310412+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:45:31.310412+0000","last_undegraded":"2024-02-21T07:45:31.310412+0000","last_fullsized":"2024-02-21T07:45:31.310412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.401021+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:45:47.401021+0000","last_peered":"2024-02-21T07:45:47.401021+0000","last_clean":"2024-02-21T07:45:47.401021+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:45:47.401021+0000","last_undegraded":"2024-02-21T07:45:47.401021+0000","last_fullsized":"2024-02-21T07:45:47.401021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306080+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:45:31.306080+0000","last_peered":"2024-02-21T07:45:31.306080+0000","last_clean":"2024-02-21T07:45:31.306080+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:45:31.306080+0000","last_undegraded":"2024-02-21T07:45:31.306080+0000","last_fullsized":"2024-02-21T07:45:31.306080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264097+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:45:32.264097+0000","last_peered":"2024-02-21T07:45:32.264097+0000","last_clean":"2024-02-21T07:45:32.264097+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:45:32.264097+0000","last_undegraded":"2024-02-21T07:45:32.264097+0000","last_fullsized":"2024-02-21T07:45:32.264097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264234+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:45:32.264234+0000","last_peered":"2024-02-21T07:45:32.264234+0000","last_clean":"2024-02-21T07:45:32.264234+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:45:32.264234+0000","last_undegraded":"2024-02-21T07:45:32.264234+0000","last_fullsized":"2024-02-21T07:45:32.264234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229514+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:45:32.229514+0000","last_peered":"2024-02-21T07:45:32.229514+0000","last_clean":"2024-02-21T07:45:32.229514+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:45:32.229514+0000","last_undegraded":"2024-02-21T07:45:32.229514+0000","last_fullsized":"2024-02-21T07:45:32.229514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263819+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:45:32.263819+0000","last_peered":"2024-02-21T07:45:32.263819+0000","last_clean":"2024-02-21T07:45:32.263819+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:45:32.263819+0000","last_undegraded":"2024-02-21T07:45:32.263819+0000","last_fullsized":"2024-02-21T07:45:32.263819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264125+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:45:32.264125+0000","last_peered":"2024-02-21T07:45:32.264125+0000","last_clean":"2024-02-21T07:45:32.264125+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:45:32.264125+0000","last_undegraded":"2024-02-21T07:45:32.264125+0000","last_fullsized":"2024-02-21T07:45:32.264125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310149+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:45:31.310149+0000","last_peered":"2024-02-21T07:45:31.310149+0000","last_clean":"2024-02-21T07:45:31.310149+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:45:31.310149+0000","last_undegraded":"2024-02-21T07:45:31.310149+0000","last_fullsized":"2024-02-21T07:45:31.310149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762185+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:45:31.762185+0000","last_peered":"2024-02-21T07:45:31.762185+0000","last_clean":"2024-02-21T07:45:31.762185+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:45:31.762185+0000","last_undegraded":"2024-02-21T07:45:31.762185+0000","last_fullsized":"2024-02-21T07:45:31.762185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417500+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:45:48.417500+0000","last_peered":"2024-02-21T07:45:48.417500+0000","last_clean":"2024-02-21T07:45:48.417500+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:45:48.417500+0000","last_undegraded":"2024-02-21T07:45:48.417500+0000","last_fullsized":"2024-02-21T07:45:48.417500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310755+0000","last_change":"2024-02-21T07:45:30.576741+0000","last_active":"2024-02-21T07:45:31.310755+0000","last_peered":"2024-02-21T07:45:31.310755+0000","last_clean":"2024-02-21T07:45:31.310755+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:45:31.310755+0000","last_undegraded":"2024-02-21T07:45:31.310755+0000","last_fullsized":"2024-02-21T07:45:31.310755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.308988+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:45:31.308988+0000","last_peered":"2024-02-21T07:45:31.308988+0000","last_clean":"2024-02-21T07:45:31.308988+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:45:31.308988+0000","last_undegraded":"2024-02-21T07:45:31.308988+0000","last_fullsized":"2024-02-21T07:45:31.308988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.408385+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:45:48.408385+0000","last_peered":"2024-02-21T07:45:48.408385+0000","last_clean":"2024-02-21T07:45:48.408385+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:45:48.408385+0000","last_undegraded":"2024-02-21T07:45:48.408385+0000","last_fullsized":"2024-02-21T07:45:48.408385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311908+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:45:31.311908+0000","last_peered":"2024-02-21T07:45:31.311908+0000","last_clean":"2024-02-21T07:45:31.311908+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:45:31.311908+0000","last_undegraded":"2024-02-21T07:45:31.311908+0000","last_fullsized":"2024-02-21T07:45:31.311908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.397731+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:45:47.397731+0000","last_peered":"2024-02-21T07:45:47.397731+0000","last_clean":"2024-02-21T07:45:47.397731+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:45:47.397731+0000","last_undegraded":"2024-02-21T07:45:47.397731+0000","last_fullsized":"2024-02-21T07:45:47.397731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263705+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:45:32.263705+0000","last_peered":"2024-02-21T07:45:32.263705+0000","last_clean":"2024-02-21T07:45:32.263705+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:45:32.263705+0000","last_undegraded":"2024-02-21T07:45:32.263705+0000","last_fullsized":"2024-02-21T07:45:32.263705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264755+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:45:32.264755+0000","last_peered":"2024-02-21T07:45:32.264755+0000","last_clean":"2024-02-21T07:45:32.264755+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:45:32.264755+0000","last_undegraded":"2024-02-21T07:45:32.264755+0000","last_fullsized":"2024-02-21T07:45:32.264755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264905+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:45:32.264905+0000","last_peered":"2024-02-21T07:45:32.264905+0000","last_clean":"2024-02-21T07:45:32.264905+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:45:32.264905+0000","last_undegraded":"2024-02-21T07:45:32.264905+0000","last_fullsized":"2024-02-21T07:45:32.264905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410039+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:45:48.410039+0000","last_peered":"2024-02-21T07:45:48.410039+0000","last_clean":"2024-02-21T07:45:48.410039+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:45:48.410039+0000","last_undegraded":"2024-02-21T07:45:48.410039+0000","last_fullsized":"2024-02-21T07:45:48.410039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263291+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:45:32.263291+0000","last_peered":"2024-02-21T07:45:32.263291+0000","last_clean":"2024-02-21T07:45:32.263291+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:45:32.263291+0000","last_undegraded":"2024-02-21T07:45:32.263291+0000","last_fullsized":"2024-02-21T07:45:32.263291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263867+0000","last_change":"2024-02-21T07:45:30.321767+0000","last_active":"2024-02-21T07:45:32.263867+0000","last_peered":"2024-02-21T07:45:32.263867+0000","last_clean":"2024-02-21T07:45:32.263867+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:45:32.263867+0000","last_undegraded":"2024-02-21T07:45:32.263867+0000","last_fullsized":"2024-02-21T07:45:32.263867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264766+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:45:32.264766+0000","last_peered":"2024-02-21T07:45:32.264766+0000","last_clean":"2024-02-21T07:45:32.264766+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:45:32.264766+0000","last_undegraded":"2024-02-21T07:45:32.264766+0000","last_fullsized":"2024-02-21T07:45:32.264766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310577+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:45:31.310577+0000","last_peered":"2024-02-21T07:45:31.310577+0000","last_clean":"2024-02-21T07:45:31.310577+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:45:31.310577+0000","last_undegraded":"2024-02-21T07:45:31.310577+0000","last_fullsized":"2024-02-21T07:45:31.310577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761881+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:45:31.761881+0000","last_peered":"2024-02-21T07:45:31.761881+0000","last_clean":"2024-02-21T07:45:31.761881+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:45:31.761881+0000","last_undegraded":"2024-02-21T07:45:31.761881+0000","last_fullsized":"2024-02-21T07:45:31.761881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306408+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:45:31.306408+0000","last_peered":"2024-02-21T07:45:31.306408+0000","last_clean":"2024-02-21T07:45:31.306408+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:45:31.306408+0000","last_undegraded":"2024-02-21T07:45:31.306408+0000","last_fullsized":"2024-02-21T07:45:31.306408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.406939+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:45:49.406939+0000","last_peered":"2024-02-21T07:45:49.406939+0000","last_clean":"2024-02-21T07:45:49.406939+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:45:49.406939+0000","last_undegraded":"2024-02-21T07:45:49.406939+0000","last_fullsized":"2024-02-21T07:45:49.406939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762042+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:45:31.762042+0000","last_peered":"2024-02-21T07:45:31.762042+0000","last_clean":"2024-02-21T07:45:31.762042+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:45:31.762042+0000","last_undegraded":"2024-02-21T07:45:31.762042+0000","last_fullsized":"2024-02-21T07:45:31.762042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762020+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:45:31.762020+0000","last_peered":"2024-02-21T07:45:31.762020+0000","last_clean":"2024-02-21T07:45:31.762020+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:45:31.762020+0000","last_undegraded":"2024-02-21T07:45:31.762020+0000","last_fullsized":"2024-02-21T07:45:31.762020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.415737+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:45:48.415737+0000","last_peered":"2024-02-21T07:45:48.415737+0000","last_clean":"2024-02-21T07:45:48.415737+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:45:48.415737+0000","last_undegraded":"2024-02-21T07:45:48.415737+0000","last_fullsized":"2024-02-21T07:45:48.415737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310469+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:45:31.310469+0000","last_peered":"2024-02-21T07:45:31.310469+0000","last_clean":"2024-02-21T07:45:31.310469+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:45:31.310469+0000","last_undegraded":"2024-02-21T07:45:31.310469+0000","last_fullsized":"2024-02-21T07:45:31.310469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263388+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:45:32.263388+0000","last_peered":"2024-02-21T07:45:32.263388+0000","last_clean":"2024-02-21T07:45:32.263388+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:45:32.263388+0000","last_undegraded":"2024-02-21T07:45:32.263388+0000","last_fullsized":"2024-02-21T07:45:32.263388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410278+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:45:48.410278+0000","last_peered":"2024-02-21T07:45:48.410278+0000","last_clean":"2024-02-21T07:45:48.410278+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:45:48.410278+0000","last_undegraded":"2024-02-21T07:45:48.410278+0000","last_fullsized":"2024-02-21T07:45:48.410278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264171+0000","last_change":"2024-02-21T07:45:30.329832+0000","last_active":"2024-02-21T07:45:32.264171+0000","last_peered":"2024-02-21T07:45:32.264171+0000","last_clean":"2024-02-21T07:45:32.264171+0000","last_became_active":"2024-02-21T07:45:30.329423+0000","last_became_peered":"2024-02-21T07:45:30.329423+0000","last_unstale":"2024-02-21T07:45:32.264171+0000","last_undegraded":"2024-02-21T07:45:32.264171+0000","last_fullsized":"2024-02-21T07:45:32.264171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263472+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:45:32.263472+0000","last_peered":"2024-02-21T07:45:32.263472+0000","last_clean":"2024-02-21T07:45:32.263472+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:45:32.263472+0000","last_undegraded":"2024-02-21T07:45:32.263472+0000","last_fullsized":"2024-02-21T07:45:32.263472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400439+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:45:47.400439+0000","last_peered":"2024-02-21T07:45:47.400439+0000","last_clean":"2024-02-21T07:45:47.400439+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:45:47.400439+0000","last_undegraded":"2024-02-21T07:45:47.400439+0000","last_fullsized":"2024-02-21T07:45:47.400439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306127+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:45:31.306127+0000","last_peered":"2024-02-21T07:45:31.306127+0000","last_clean":"2024-02-21T07:45:31.306127+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:45:31.306127+0000","last_undegraded":"2024-02-21T07:45:31.306127+0000","last_fullsized":"2024-02-21T07:45:31.306127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309551+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:45:31.309551+0000","last_peered":"2024-02-21T07:45:31.309551+0000","last_clean":"2024-02-21T07:45:31.309551+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:45:31.309551+0000","last_undegraded":"2024-02-21T07:45:31.309551+0000","last_fullsized":"2024-02-21T07:45:31.309551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410331+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:45:48.410331+0000","last_peered":"2024-02-21T07:45:48.410331+0000","last_clean":"2024-02-21T07:45:48.410331+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:45:48.410331+0000","last_undegraded":"2024-02-21T07:45:48.410331+0000","last_fullsized":"2024-02-21T07:45:48.410331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762292+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:45:31.762292+0000","last_peered":"2024-02-21T07:45:31.762292+0000","last_clean":"2024-02-21T07:45:31.762292+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:45:31.762292+0000","last_undegraded":"2024-02-21T07:45:31.762292+0000","last_fullsized":"2024-02-21T07:45:31.762292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229733+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:45:32.229733+0000","last_peered":"2024-02-21T07:45:32.229733+0000","last_clean":"2024-02-21T07:45:32.229733+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:45:32.229733+0000","last_undegraded":"2024-02-21T07:45:32.229733+0000","last_fullsized":"2024-02-21T07:45:32.229733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'12","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398473+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:45:47.398473+0000","last_peered":"2024-02-21T07:45:47.398473+0000","last_clean":"2024-02-21T07:45:47.398473+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:45:47.398473+0000","last_undegraded":"2024-02-21T07:45:47.398473+0000","last_fullsized":"2024-02-21T07:45:47.398473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263546+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:45:32.263546+0000","last_peered":"2024-02-21T07:45:32.263546+0000","last_clean":"2024-02-21T07:45:32.263546+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:45:32.263546+0000","last_undegraded":"2024-02-21T07:45:32.263546+0000","last_fullsized":"2024-02-21T07:45:32.263546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263563+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:45:32.263563+0000","last_peered":"2024-02-21T07:45:32.263563+0000","last_clean":"2024-02-21T07:45:32.263563+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:45:32.263563+0000","last_undegraded":"2024-02-21T07:45:32.263563+0000","last_fullsized":"2024-02-21T07:45:32.263563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762450+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:45:31.762450+0000","last_peered":"2024-02-21T07:45:31.762450+0000","last_clean":"2024-02-21T07:45:31.762450+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:45:31.762450+0000","last_undegraded":"2024-02-21T07:45:31.762450+0000","last_fullsized":"2024-02-21T07:45:31.762450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264880+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:45:32.264880+0000","last_peered":"2024-02-21T07:45:32.264880+0000","last_clean":"2024-02-21T07:45:32.264880+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:45:32.264880+0000","last_undegraded":"2024-02-21T07:45:32.264880+0000","last_fullsized":"2024-02-21T07:45:32.264880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398480+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:45:47.398480+0000","last_peered":"2024-02-21T07:45:47.398480+0000","last_clean":"2024-02-21T07:45:47.398480+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:45:47.398480+0000","last_undegraded":"2024-02-21T07:45:47.398480+0000","last_fullsized":"2024-02-21T07:45:47.398480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263330+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:45:32.263330+0000","last_peered":"2024-02-21T07:45:32.263330+0000","last_clean":"2024-02-21T07:45:32.263330+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:45:32.263330+0000","last_undegraded":"2024-02-21T07:45:32.263330+0000","last_fullsized":"2024-02-21T07:45:32.263330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263656+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:45:32.263656+0000","last_peered":"2024-02-21T07:45:32.263656+0000","last_clean":"2024-02-21T07:45:32.263656+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:45:32.263656+0000","last_undegraded":"2024-02-21T07:45:32.263656+0000","last_fullsized":"2024-02-21T07:45:32.263656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398962+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:45:47.398962+0000","last_peered":"2024-02-21T07:45:47.398962+0000","last_clean":"2024-02-21T07:45:47.398962+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:45:47.398962+0000","last_undegraded":"2024-02-21T07:45:47.398962+0000","last_fullsized":"2024-02-21T07:45:47.398962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312070+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:45:31.312070+0000","last_peered":"2024-02-21T07:45:31.312070+0000","last_clean":"2024-02-21T07:45:31.312070+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:45:31.312070+0000","last_undegraded":"2024-02-21T07:45:31.312070+0000","last_fullsized":"2024-02-21T07:45:31.312070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264465+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:45:32.264465+0000","last_peered":"2024-02-21T07:45:32.264465+0000","last_clean":"2024-02-21T07:45:32.264465+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:45:32.264465+0000","last_undegraded":"2024-02-21T07:45:32.264465+0000","last_fullsized":"2024-02-21T07:45:32.264465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263376+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:45:32.263376+0000","last_peered":"2024-02-21T07:45:32.263376+0000","last_clean":"2024-02-21T07:45:32.263376+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:45:32.263376+0000","last_undegraded":"2024-02-21T07:45:32.263376+0000","last_fullsized":"2024-02-21T07:45:32.263376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762361+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:45:31.762361+0000","last_peered":"2024-02-21T07:45:31.762361+0000","last_clean":"2024-02-21T07:45:31.762361+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:45:31.762361+0000","last_undegraded":"2024-02-21T07:45:31.762361+0000","last_fullsized":"2024-02-21T07:45:31.762361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306530+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:45:31.306530+0000","last_peered":"2024-02-21T07:45:31.306530+0000","last_clean":"2024-02-21T07:45:31.306530+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:45:31.306530+0000","last_undegraded":"2024-02-21T07:45:31.306530+0000","last_fullsized":"2024-02-21T07:45:31.306530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312026+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:45:31.312026+0000","last_peered":"2024-02-21T07:45:31.312026+0000","last_clean":"2024-02-21T07:45:31.312026+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:45:31.312026+0000","last_undegraded":"2024-02-21T07:45:31.312026+0000","last_fullsized":"2024-02-21T07:45:31.312026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417019+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:45:48.417019+0000","last_peered":"2024-02-21T07:45:48.417019+0000","last_clean":"2024-02-21T07:45:48.417019+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:45:48.417019+0000","last_undegraded":"2024-02-21T07:45:48.417019+0000","last_fullsized":"2024-02-21T07:45:48.417019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409397+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:45:48.409397+0000","last_peered":"2024-02-21T07:45:48.409397+0000","last_clean":"2024-02-21T07:45:48.409397+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:45:48.409397+0000","last_undegraded":"2024-02-21T07:45:48.409397+0000","last_fullsized":"2024-02-21T07:45:48.409397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762120+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:45:31.762120+0000","last_peered":"2024-02-21T07:45:31.762120+0000","last_clean":"2024-02-21T07:45:31.762120+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:45:31.762120+0000","last_undegraded":"2024-02-21T07:45:31.762120+0000","last_fullsized":"2024-02-21T07:45:31.762120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306666+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:45:31.306666+0000","last_peered":"2024-02-21T07:45:31.306666+0000","last_clean":"2024-02-21T07:45:31.306666+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:45:31.306666+0000","last_undegraded":"2024-02-21T07:45:31.306666+0000","last_fullsized":"2024-02-21T07:45:31.306666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'5","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399479+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:45:47.399479+0000","last_peered":"2024-02-21T07:45:47.399479+0000","last_clean":"2024-02-21T07:45:47.399479+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:45:47.399479+0000","last_undegraded":"2024-02-21T07:45:47.399479+0000","last_fullsized":"2024-02-21T07:45:47.399479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229535+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:45:32.229535+0000","last_peered":"2024-02-21T07:45:32.229535+0000","last_clean":"2024-02-21T07:45:32.229535+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:45:32.229535+0000","last_undegraded":"2024-02-21T07:45:32.229535+0000","last_fullsized":"2024-02-21T07:45:32.229535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307101+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:45:31.307101+0000","last_peered":"2024-02-21T07:45:31.307101+0000","last_clean":"2024-02-21T07:45:31.307101+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:45:31.307101+0000","last_undegraded":"2024-02-21T07:45:31.307101+0000","last_fullsized":"2024-02-21T07:45:31.307101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306135+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:45:31.306135+0000","last_peered":"2024-02-21T07:45:31.306135+0000","last_clean":"2024-02-21T07:45:31.306135+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:45:31.306135+0000","last_undegraded":"2024-02-21T07:45:31.306135+0000","last_fullsized":"2024-02-21T07:45:31.306135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306468+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:45:31.306468+0000","last_peered":"2024-02-21T07:45:31.306468+0000","last_clean":"2024-02-21T07:45:31.306468+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:45:31.306468+0000","last_undegraded":"2024-02-21T07:45:31.306468+0000","last_fullsized":"2024-02-21T07:45:31.306468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263724+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:45:32.263724+0000","last_peered":"2024-02-21T07:45:32.263724+0000","last_clean":"2024-02-21T07:45:32.263724+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:45:32.263724+0000","last_undegraded":"2024-02-21T07:45:32.263724+0000","last_fullsized":"2024-02-21T07:45:32.263724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310293+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:45:31.310293+0000","last_peered":"2024-02-21T07:45:31.310293+0000","last_clean":"2024-02-21T07:45:31.310293+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:45:31.310293+0000","last_undegraded":"2024-02-21T07:45:31.310293+0000","last_fullsized":"2024-02-21T07:45:31.310293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306405+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:45:31.306405+0000","last_peered":"2024-02-21T07:45:31.306405+0000","last_clean":"2024-02-21T07:45:31.306405+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:45:31.306405+0000","last_undegraded":"2024-02-21T07:45:31.306405+0000","last_fullsized":"2024-02-21T07:45:31.306405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313391+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:45:31.313391+0000","last_peered":"2024-02-21T07:45:31.313391+0000","last_clean":"2024-02-21T07:45:31.313391+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:45:31.313391+0000","last_undegraded":"2024-02-21T07:45:31.313391+0000","last_fullsized":"2024-02-21T07:45:31.313391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761962+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:45:31.761962+0000","last_peered":"2024-02-21T07:45:31.761962+0000","last_clean":"2024-02-21T07:45:31.761962+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:45:31.761962+0000","last_undegraded":"2024-02-21T07:45:31.761962+0000","last_fullsized":"2024-02-21T07:45:31.761962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312075+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:45:31.312075+0000","last_peered":"2024-02-21T07:45:31.312075+0000","last_clean":"2024-02-21T07:45:31.312075+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:45:31.312075+0000","last_undegraded":"2024-02-21T07:45:31.312075+0000","last_fullsized":"2024-02-21T07:45:31.312075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263718+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:45:32.263718+0000","last_peered":"2024-02-21T07:45:32.263718+0000","last_clean":"2024-02-21T07:45:32.263718+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:45:32.263718+0000","last_undegraded":"2024-02-21T07:45:32.263718+0000","last_fullsized":"2024-02-21T07:45:32.263718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309927+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:45:31.309927+0000","last_peered":"2024-02-21T07:45:31.309927+0000","last_clean":"2024-02-21T07:45:31.309927+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:45:31.309927+0000","last_undegraded":"2024-02-21T07:45:31.309927+0000","last_fullsized":"2024-02-21T07:45:31.309927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306150+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:45:31.306150+0000","last_peered":"2024-02-21T07:45:31.306150+0000","last_clean":"2024-02-21T07:45:31.306150+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:45:31.306150+0000","last_undegraded":"2024-02-21T07:45:31.306150+0000","last_fullsized":"2024-02-21T07:45:31.306150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307003+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:45:31.307003+0000","last_peered":"2024-02-21T07:45:31.307003+0000","last_clean":"2024-02-21T07:45:31.307003+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:45:31.307003+0000","last_undegraded":"2024-02-21T07:45:31.307003+0000","last_fullsized":"2024-02-21T07:45:31.307003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264340+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:45:32.264340+0000","last_peered":"2024-02-21T07:45:32.264340+0000","last_clean":"2024-02-21T07:45:32.264340+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:45:32.264340+0000","last_undegraded":"2024-02-21T07:45:32.264340+0000","last_fullsized":"2024-02-21T07:45:32.264340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306653+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:45:31.306653+0000","last_peered":"2024-02-21T07:45:31.306653+0000","last_clean":"2024-02-21T07:45:31.306653+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:45:31.306653+0000","last_undegraded":"2024-02-21T07:45:31.306653+0000","last_fullsized":"2024-02-21T07:45:31.306653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263066+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:45:32.263066+0000","last_peered":"2024-02-21T07:45:32.263066+0000","last_clean":"2024-02-21T07:45:32.263066+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:45:32.263066+0000","last_undegraded":"2024-02-21T07:45:32.263066+0000","last_fullsized":"2024-02-21T07:45:32.263066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263638+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:45:32.263638+0000","last_peered":"2024-02-21T07:45:32.263638+0000","last_clean":"2024-02-21T07:45:32.263638+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:45:32.263638+0000","last_undegraded":"2024-02-21T07:45:32.263638+0000","last_fullsized":"2024-02-21T07:45:32.263638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263493+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:45:32.263493+0000","last_peered":"2024-02-21T07:45:32.263493+0000","last_clean":"2024-02-21T07:45:32.263493+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:45:32.263493+0000","last_undegraded":"2024-02-21T07:45:32.263493+0000","last_fullsized":"2024-02-21T07:45:32.263493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309714+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:45:31.309714+0000","last_peered":"2024-02-21T07:45:31.309714+0000","last_clean":"2024-02-21T07:45:31.309714+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:45:31.309714+0000","last_undegraded":"2024-02-21T07:45:31.309714+0000","last_fullsized":"2024-02-21T07:45:31.309714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264668+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:45:32.264668+0000","last_peered":"2024-02-21T07:45:32.264668+0000","last_clean":"2024-02-21T07:45:32.264668+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:45:32.264668+0000","last_undegraded":"2024-02-21T07:45:32.264668+0000","last_fullsized":"2024-02-21T07:45:32.264668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264939+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:45:32.264939+0000","last_peered":"2024-02-21T07:45:32.264939+0000","last_clean":"2024-02-21T07:45:32.264939+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:45:32.264939+0000","last_undegraded":"2024-02-21T07:45:32.264939+0000","last_fullsized":"2024-02-21T07:45:32.264939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264424+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:45:32.264424+0000","last_peered":"2024-02-21T07:45:32.264424+0000","last_clean":"2024-02-21T07:45:32.264424+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:45:32.264424+0000","last_undegraded":"2024-02-21T07:45:32.264424+0000","last_fullsized":"2024-02-21T07:45:32.264424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264005+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:45:32.264005+0000","last_peered":"2024-02-21T07:45:32.264005+0000","last_clean":"2024-02-21T07:45:32.264005+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:45:32.264005+0000","last_undegraded":"2024-02-21T07:45:32.264005+0000","last_fullsized":"2024-02-21T07:45:32.264005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311690+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:45:31.311690+0000","last_peered":"2024-02-21T07:45:31.311690+0000","last_clean":"2024-02-21T07:45:31.311690+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:45:31.311690+0000","last_undegraded":"2024-02-21T07:45:31.311690+0000","last_fullsized":"2024-02-21T07:45:31.311690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263714+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:45:32.263714+0000","last_peered":"2024-02-21T07:45:32.263714+0000","last_clean":"2024-02-21T07:45:32.263714+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:45:32.263714+0000","last_undegraded":"2024-02-21T07:45:32.263714+0000","last_fullsized":"2024-02-21T07:45:32.263714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.262967+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:45:32.262967+0000","last_peered":"2024-02-21T07:45:32.262967+0000","last_clean":"2024-02-21T07:45:32.262967+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:45:32.262967+0000","last_undegraded":"2024-02-21T07:45:32.262967+0000","last_fullsized":"2024-02-21T07:45:32.262967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229582+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:45:32.229582+0000","last_peered":"2024-02-21T07:45:32.229582+0000","last_clean":"2024-02-21T07:45:32.229582+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:45:32.229582+0000","last_undegraded":"2024-02-21T07:45:32.229582+0000","last_fullsized":"2024-02-21T07:45:32.229582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264570+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:45:32.264570+0000","last_peered":"2024-02-21T07:45:32.264570+0000","last_clean":"2024-02-21T07:45:32.264570+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:45:32.264570+0000","last_undegraded":"2024-02-21T07:45:32.264570+0000","last_fullsized":"2024-02-21T07:45:32.264570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264582+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:45:32.264582+0000","last_peered":"2024-02-21T07:45:32.264582+0000","last_clean":"2024-02-21T07:45:32.264582+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:45:32.264582+0000","last_undegraded":"2024-02-21T07:45:32.264582+0000","last_fullsized":"2024-02-21T07:45:32.264582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264526+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:45:32.264526+0000","last_peered":"2024-02-21T07:45:32.264526+0000","last_clean":"2024-02-21T07:45:32.264526+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:45:32.264526+0000","last_undegraded":"2024-02-21T07:45:32.264526+0000","last_fullsized":"2024-02-21T07:45:32.264526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306596+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:45:31.306596+0000","last_peered":"2024-02-21T07:45:31.306596+0000","last_clean":"2024-02-21T07:45:31.306596+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:45:31.306596+0000","last_undegraded":"2024-02-21T07:45:31.306596+0000","last_fullsized":"2024-02-21T07:45:31.306596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444039,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":134658,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":319488,"data_stored":138728,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":135330,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.821}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.782}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0089999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":134814,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":7,"up_from":17,"seq":73014444039,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":726196,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":134658,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.885}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7269999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":385024,"data_stored":726502,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":135280,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444039,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":134838,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7370000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9830000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1269999999999998}]}]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":135896,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":138500,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":135464,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.833}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6679999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:45:53.806 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-21T07:45:53.806 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-21T07:45:53.806 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-21T07:45:53.806 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-21T07:45:53.807 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-21T07:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.048+0000 7f7bf9400640 1 Processor -- start 2024-02-21T07:45:54.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.048+0000 7f7bf9400640 1 -- start start 2024-02-21T07:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.050+0000 7f7bf9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7bf417b790 0x7f7bf40f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.050+0000 7f7bf9400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf406f160 con 0x7f7bf4188f00 2024-02-21T07:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.050+0000 7f7bf9400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf40f8280 con 0x7f7bf406f5f0 2024-02-21T07:45:54.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.050+0000 7f7bf9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf406e060 con 0x7f7bf417b790 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7bf417b790 0x7f7bf40f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf2800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7bf4188f00 0x7f7bf406d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50332/0 (socket says 172.21.15.100:50332) 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf2800640 1 -- 172.21.15.100:0/772093178 learned_addr learned my addr 172.21.15.100:0/772093178 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1400640 1 -- 172.21.15.100:0/772093178 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092163311 0 0) 0x7f7bf406f160 con 0x7f7bf4188f00 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1400640 1 -- 172.21.15.100:0/772093178 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd8003520 con 0x7f7bf4188f00 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1e00640 1 -- 172.21.15.100:0/772093178 >> v1:172.21.15.170:6789/0 conn(0x7f7bf406f5f0 legacy=0x7f7bf406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1e00640 1 -- 172.21.15.100:0/772093178 >> v1:172.21.15.156:6789/0 conn(0x7f7bf4188f00 legacy=0x7f7bf406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.051+0000 7f7bf1e00640 1 -- 172.21.15.100:0/772093178 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40f8560 con 0x7f7bf417b790 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.052+0000 7f7bf1e00640 1 --2- 172.21.15.100:0/772093178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf40f7b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097a0 tx=0x7f7be402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cccd16ea260b648 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.052+0000 7f7bf1400640 1 -- 172.21.15.100:0/772093178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be402e070 con 0x7f7bf417b790 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.052+0000 7f7bf1400640 1 -- 172.21.15.100:0/772093178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40315a0 con 0x7f7bf417b790 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.052+0000 7f7bf1400640 1 -- 172.21.15.100:0/772093178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4031930 con 0x7f7bf417b790 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 -- 172.21.15.100:0/772093178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 msgr2=0x7f7bf40f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 --2- 172.21.15.100:0/772093178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf40f7b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7be40097a0 tx=0x7f7be402b840 comp rx=0 tx=0).stop 2024-02-21T07:45:54.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 -- 172.21.15.100:0/772093178 shutdown_connections 2024-02-21T07:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 --2- 172.21.15.100:0/772093178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf40f7b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 -- 172.21.15.100:0/772093178 >> 172.21.15.100:0/772093178 conn(0x7f7bf40ce160 msgr2=0x7f7bf40ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 -- 172.21.15.100:0/772093178 shutdown_connections 2024-02-21T07:45:54.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.053+0000 7f7bf9400640 1 -- 172.21.15.100:0/772093178 wait complete. 2024-02-21T07:45:54.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.055+0000 7f7bf9400640 1 Processor -- start 2024-02-21T07:45:54.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.055+0000 7f7bf9400640 1 -- start start 2024-02-21T07:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf406f5f0 0x7f7bf4222570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bf4188f00 0x7f7bf4221030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf421fcb0 con 0x7f7bf417b790 2024-02-21T07:45:54.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf421ff90 con 0x7f7bf406f5f0 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.056+0000 7f7bf9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4220270 con 0x7f7bf4188f00 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf406f5f0 0x7f7bf4222570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51008/0 (socket says 172.21.15.100:51008) 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 -- 172.21.15.100:0/2037538138 learned_addr learned my addr 172.21.15.100:0/2037538138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:54.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf3200640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bf4188f00 0x7f7bf4221030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 -- 172.21.15.100:0/2037538138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bf4188f00 msgr2=0x7f7bf4221030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bf4188f00 0x7f7bf4221030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 -- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf406f5f0 msgr2=0x7f7bf4222570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf406f5f0 0x7f7bf4222570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 -- 172.21.15.100:0/2037538138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009400 con 0x7f7bf417b790 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.057+0000 7f7bf1e00640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7be4034040 tx=0x7f7be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.058+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4032840 con 0x7f7bf417b790 2024-02-21T07:45:54.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.058+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40329c0 con 0x7f7bf417b790 2024-02-21T07:45:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.058+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4032d70 con 0x7f7bf417b790 2024-02-21T07:45:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.058+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4220550 con 0x7f7bf417b790 2024-02-21T07:45:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.058+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4220b10 con 0x7f7bf417b790 2024-02-21T07:45:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.059+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf4072530 con 0x7f7bf417b790 2024-02-21T07:45:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.061+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7be404e430 con 0x7f7bf417b790 2024-02-21T07:45:54.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.062+0000 7f7beaa00640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 0x7f7bd00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.062+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7be40ebc90 con 0x7f7bf417b790 2024-02-21T07:45:54.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.063+0000 7f7bf2800640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 0x7f7bd00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.063+0000 7f7bf2800640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 0x7f7bd00a15f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005880 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.066+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7be40b5890 con 0x7f7bf417b790 2024-02-21T07:45:54.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.313+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7bf4067c80 con 0x7f7bf417b790 2024-02-21T07:45:54.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.329+0000 7f7beaa00640 1 -- 172.21.15.100:0/2037538138 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+257058 (secure 0 0 0) 0x7f7be40b77c0 con 0x7f7bf417b790 2024-02-21T07:45:54.337 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 msgr2=0x7f7bd00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 0x7f7bd00a15f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005880 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 msgr2=0x7f7bf415bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7be4034040 tx=0x7f7be40046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 shutdown_connections 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bf4188f00 0x7f7bf4221030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7bd009f130 0x7f7bd00a15f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bf417b790 0x7f7bf415bc30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 --2- 172.21.15.100:0/2037538138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf406f5f0 0x7f7bf4222570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 >> 172.21.15.100:0/2037538138 conn(0x7f7bf40ce160 msgr2=0x7f7bf406fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:54.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 shutdown_connections 2024-02-21T07:45:54.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.337+0000 7f7bf9400640 1 -- 172.21.15.100:0/2037538138 wait complete. 2024-02-21T07:45:54.362 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":6,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":1289369955},{"type":"v1","addr":"172.21.15.156:6801","nonce":1289369955}]},"active_addr":"172.21.15.156:6801/1289369955","active_change":"2024-02-21T07:45:11.884622+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4117,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3210185241}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3371307134}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":816802110}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":2296534502}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.156:0","nonce":3263592105}]}]} 2024-02-21T07:45:54.367 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-21T07:45:54.367 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-21T07:45:54.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.608+0000 7f66ce600640 1 Processor -- start 2024-02-21T07:45:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.608+0000 7f66ce600640 1 -- start start 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.610+0000 7f66ce600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f66c81844e0 0x7f66c80f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.610+0000 7f66ce600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c806eec0 con 0x7f66c80f9630 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.610+0000 7f66ce600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80f9ac0 con 0x7f66c8183f70 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.610+0000 7f66ce600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c806e390 con 0x7f66c81844e0 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c7400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f66c8183f70 0x7f66c806e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40810/0 (socket says 172.21.15.100:40810) 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c7400640 1 -- 172.21.15.100:0/2266909941 learned_addr learned my addr 172.21.15.100:0/2266909941 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6a00640 1 --2- 172.21.15.100:0/2266909941 >> v2:172.21.15.156:3300/0 conn(0x7f66c81844e0 0x7f66c80f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418451512 0 0) 0x7f66c80f9ac0 con 0x7f66c8183f70 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66ac003520 con 0x7f66c8183f70 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6a00640 1 -- 172.21.15.100:0/2266909941 >> v1:172.21.15.170:6789/0 conn(0x7f66c8183f70 legacy=0x7f66c806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407283991 0 0) 0x7f66c806eec0 con 0x7f66c80f9630 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6a00640 1 -- 172.21.15.100:0/2266909941 >> v1:172.21.15.156:6789/0 conn(0x7f66c80f9630 legacy=0x7f66c80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.611+0000 7f66c6a00640 1 -- 172.21.15.100:0/2266909941 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8187520 con 0x7f66c81844e0 2024-02-21T07:45:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.612+0000 7f66c6a00640 1 --2- 172.21.15.100:0/2266909941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c80f90f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66b40097a0 tx=0x7f66b402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e0f2ed51577f3c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.612+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b402e070 con 0x7f66c81844e0 2024-02-21T07:45:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.612+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b40315a0 con 0x7f66c81844e0 2024-02-21T07:45:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.612+0000 7f66c6000640 1 -- 172.21.15.100:0/2266909941 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4031930 con 0x7f66c81844e0 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 -- 172.21.15.100:0/2266909941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 msgr2=0x7f66c80f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 --2- 172.21.15.100:0/2266909941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c80f90f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66b40097a0 tx=0x7f66b402b840 comp rx=0 tx=0).stop 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 -- 172.21.15.100:0/2266909941 shutdown_connections 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 --2- 172.21.15.100:0/2266909941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c80f90f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 -- 172.21.15.100:0/2266909941 >> 172.21.15.100:0/2266909941 conn(0x7f66c80ce160 msgr2=0x7f66c80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 -- 172.21.15.100:0/2266909941 shutdown_connections 2024-02-21T07:45:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.613+0000 7f66ce600640 1 -- 172.21.15.100:0/2266909941 wait complete. 2024-02-21T07:45:54.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.615+0000 7f66ce600640 1 Processor -- start 2024-02-21T07:45:54.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.615+0000 7f66ce600640 1 -- start start 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66c80f9630 0x7f66c8170330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c821f490 con 0x7f66c8183f70 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8170870 con 0x7f66c81844e0 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.616+0000 7f66ce600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c821e5a0 con 0x7f66c80f9630 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51012/0 (socket says 172.21.15.100:51012) 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c6a00640 1 -- 172.21.15.100:0/2427626787 learned_addr learned my addr 172.21.15.100:0/2427626787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34736/0 (socket says 172.21.15.100:34736) 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7400640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66c80f9630 0x7f66c8170330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 -- 172.21.15.100:0/2427626787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66c80f9630 msgr2=0x7f66c8170330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66c80f9630 0x7f66c8170330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 -- 172.21.15.100:0/2427626787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 msgr2=0x7f66c821db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c7e00640 1 -- 172.21.15.100:0/2427626787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009400 con 0x7f66c81844e0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.617+0000 7f66c6a00640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66c7e00640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c750 tx=0x7f66c000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0003b70 con 0x7f66c81844e0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0003cf0 con 0x7f66c81844e0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00052b0 con 0x7f66c81844e0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c821e880 con 0x7f66c81844e0 2024-02-21T07:45:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.618+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c821ee40 con 0x7f66c81844e0 2024-02-21T07:45:54.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.619+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c821f600 con 0x7f66c81844e0 2024-02-21T07:45:54.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.621+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f66c0005410 con 0x7f66c81844e0 2024-02-21T07:45:54.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.622+0000 7f66bf400640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 0x7f66a80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:54.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.622+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f66c00c97f0 con 0x7f66c81844e0 2024-02-21T07:45:54.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.622+0000 7f66c7400640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 0x7f66a80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:54.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.623+0000 7f66c7400640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 0x7f66a80a15f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66b80011e0 tx=0x7f66b8007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.627+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f66c0093590 con 0x7f66c81844e0 2024-02-21T07:45:54.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.822+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66c8183ab0 con 0x7f66c81844e0 2024-02-21T07:45:54.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.824+0000 7f66bf400640 1 -- 172.21.15.100:0/2427626787 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f66c0003e60 con 0x7f66c81844e0 2024-02-21T07:45:54.830 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:54.831 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:54.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 msgr2=0x7f66a80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 0x7f66a80a15f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f66b80011e0 tx=0x7f66b8007d30 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 msgr2=0x7f66c821a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f66c000c750 tx=0x7f66c000cc10 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 shutdown_connections 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66c81844e0 0x7f66c821a660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f66a809f130 0x7f66a80a15f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66c8183f70 0x7f66c821db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 --2- 172.21.15.100:0/2427626787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f66c80f9630 0x7f66c8170330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:54.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 >> 172.21.15.100:0/2427626787 conn(0x7f66c80ce160 msgr2=0x7f66c806f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:54.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 shutdown_connections 2024-02-21T07:45:54.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:54.827+0000 7f66ce600640 1 -- 172.21.15.100:0/2427626787 wait complete. 2024-02-21T07:45:54.850 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-21T07:45:54.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:55.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.058+0000 7fc6f0a00640 1 Processor -- start 2024-02-21T07:45:55.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.058+0000 7fc6f0a00640 1 -- start start 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.060+0000 7fc6f0a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6ec1879b0 0x7fc6ec0f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.060+0000 7fc6f0a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc6ec0f48e0 0x7fc6ec189c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.060+0000 7fc6f0a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0cad10 con 0x7fc6ec180660 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.060+0000 7fc6f0a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec180a40 con 0x7fc6ec1879b0 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.060+0000 7fc6f0a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec0cb8b0 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6ebe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc6ec0f48e0 0x7fc6ec189c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6e2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6ec1879b0 0x7fc6ec0f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6eb400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc6ec180660 0x7fc6ec0cb1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40816/0 (socket says 172.21.15.100:40816) 2024-02-21T07:45:55.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6eb400640 1 -- 172.21.15.100:0/2507136916 learned_addr learned my addr 172.21.15.100:0/2507136916 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6ebe00640 1 -- 172.21.15.100:0/2507136916 >> v2:172.21.15.100:3300/0 conn(0x7fc6ec1879b0 msgr2=0x7fc6ec0f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6ebe00640 1 --2- 172.21.15.100:0/2507136916 >> v2:172.21.15.100:3300/0 conn(0x7fc6ec1879b0 0x7fc6ec0f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6ebe00640 1 -- 172.21.15.100:0/2507136916 >> v1:172.21.15.170:6789/0 conn(0x7fc6ec180660 legacy=0x7fc6ec0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6ebe00640 1 -- 172.21.15.100:0/2507136916 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec0ca400 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.061+0000 7fc6eaa00640 1 -- 172.21.15.100:0/2507136916 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795613611 0 0) 0x7fc6ec0cad10 con 0x7fc6ec180660 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.062+0000 7fc6ebe00640 1 --2- 172.21.15.100:0/2507136916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec189c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec08d350 tx=0x7fc6e402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37325cfcba730a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6eaa00640 1 -- 172.21.15.100:0/2507136916 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e402cc80 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6eaa00640 1 -- 172.21.15.100:0/2507136916 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e402cde0 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6eaa00640 1 -- 172.21.15.100:0/2507136916 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4034660 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 -- 172.21.15.100:0/2507136916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 msgr2=0x7fc6ec189c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/2507136916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec189c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec08d350 tx=0x7fc6e402bed0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 -- 172.21.15.100:0/2507136916 shutdown_connections 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/2507136916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec189c40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/2507136916 >> v2:172.21.15.100:3300/0 conn(0x7fc6ec1879b0 0x7fc6ec0f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 -- 172.21.15.100:0/2507136916 >> 172.21.15.100:0/2507136916 conn(0x7fc6ec0f64a0 msgr2=0x7fc6ec0f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 -- 172.21.15.100:0/2507136916 shutdown_connections 2024-02-21T07:45:55.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.063+0000 7fc6f0a00640 1 -- 172.21.15.100:0/2507136916 wait complete. 2024-02-21T07:45:55.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.065+0000 7fc6f0a00640 1 Processor -- start 2024-02-21T07:45:55.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.065+0000 7fc6f0a00640 1 -- start start 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ec180660 0x7fc6ec176990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec177850 con 0x7fc6ec1879b0 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec21d7a0 con 0x7fc6ec180660 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6f0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec21da80 con 0x7fc6ec0f48e0 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51024/0 (socket says 172.21.15.100:51024) 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 -- 172.21.15.100:0/4057849484 learned_addr learned my addr 172.21.15.100:0/4057849484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6eb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43080/0 (socket says 172.21.15.100:43080) 2024-02-21T07:45:55.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6e2a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ec180660 0x7fc6ec176990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 -- 172.21.15.100:0/4057849484 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 msgr2=0x7fc6ec158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 -- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ec180660 msgr2=0x7fc6ec176990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ec180660 0x7fc6ec176990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.067+0000 7fc6ebe00640 1 -- 172.21.15.100:0/4057849484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4009a70 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6ebe00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009e80 tx=0x7fc6e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4040650 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e40407b0 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4040b60 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec21dd60 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.068+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec21e320 con 0x7fc6ec1879b0 2024-02-21T07:45:55.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.069+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec21e540 con 0x7fc6ec1879b0 2024-02-21T07:45:55.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.071+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc6e4040cc0 con 0x7fc6ec1879b0 2024-02-21T07:45:55.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.072+0000 7fc6e3e00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 0x7fc6c80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.073+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc6e40ec800 con 0x7fc6ec1879b0 2024-02-21T07:45:55.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.073+0000 7fc6eb400640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 0x7fc6c80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.073+0000 7fc6eb400640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 0x7fc6c80a1620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007f70 tx=0x7fc6dc007f00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.082+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc6e40b6510 con 0x7fc6ec1879b0 2024-02-21T07:45:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.278+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ec075160 con 0x7fc6ec1879b0 2024-02-21T07:45:55.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.282+0000 7fc6e3e00640 1 -- 172.21.15.100:0/4057849484 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7fc6e4009450 con 0x7fc6ec1879b0 2024-02-21T07:45:55.288 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:55.288 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:55.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.284+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 msgr2=0x7fc6c80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.284+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 0x7fc6c80a1620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc007f70 tx=0x7fc6dc007f00 comp rx=0 tx=0).stop 2024-02-21T07:45:55.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.284+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 msgr2=0x7fc6ec176ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.284+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009e80 tx=0x7fc6e4004a40 comp rx=0 tx=0).stop 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 shutdown_connections 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc6c809f160 0x7fc6c80a1620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec1879b0 0x7fc6ec176ed0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc6ec180660 0x7fc6ec176990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 --2- 172.21.15.100:0/4057849484 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc6ec0f48e0 0x7fc6ec158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 >> 172.21.15.100:0/4057849484 conn(0x7fc6ec0f64a0 msgr2=0x7fc6ec0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 shutdown_connections 2024-02-21T07:45:55.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.285+0000 7fc6f0a00640 1 -- 172.21.15.100:0/4057849484 wait complete. 2024-02-21T07:45:55.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-21T07:45:55.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-21T07:45:55.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-21T07:45:55.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-21T07:45:55.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-21T07:45:55.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-21T07:45:55.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-21T07:45:55.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-21T07:45:55.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-02-21T07:45:55.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-02-21T07:45:55.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-02-21T07:45:55.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-02-21T07:45:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.720+0000 7fae0b800640 1 Processor -- start 2024-02-21T07:45:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.720+0000 7fae0b800640 1 -- start start 2024-02-21T07:45:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.722+0000 7fae0b800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae0406edc0 0x7fae04190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.723+0000 7fae0b800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0418dc80 con 0x7fae04190260 2024-02-21T07:45:55.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.723+0000 7fae0b800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae040f55d0 con 0x7fae04070a30 2024-02-21T07:45:55.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.723+0000 7fae0b800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040f5b90 con 0x7fae0406edc0 2024-02-21T07:45:55.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.724+0000 7fae03e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fae04070a30 0x7fae0406e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40826/0 (socket says 172.21.15.100:40826) 2024-02-21T07:45:55.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.724+0000 7fae03e00640 1 -- 172.21.15.100:0/3369602294 learned_addr learned my addr 172.21.15.100:0/3369602294 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.725+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623207745 0 0) 0x7fae040f55d0 con 0x7fae04070a30 2024-02-21T07:45:55.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.725+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec003520 con 0x7fae04070a30 2024-02-21T07:45:55.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059574437 0 0) 0x7fadec003520 con 0x7fae04070a30 2024-02-21T07:45:55.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 >> v2:172.21.15.170:3300/0 conn(0x7fae0406edc0 msgr2=0x7fae04190640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 --2- 172.21.15.100:0/3369602294 >> v2:172.21.15.170:3300/0 conn(0x7fae0406edc0 0x7fae04190640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 >> v1:172.21.15.156:6789/0 conn(0x7fae04190260 legacy=0x7fae040f4b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040f58b0 con 0x7fae04070a30 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fadf8001670 con 0x7fae04070a30 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 >> v1:172.21.15.170:6789/0 conn(0x7fae04070a30 legacy=0x7fae0406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0039c0 0x7fadec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadec0047c0 0x7fadec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 0x7fadec00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040f5b90 con 0x7fadec0047c0 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec00c310 con 0x7fadec0053d0 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.726+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec00c4d0 con 0x7fadec0039c0 2024-02-21T07:45:55.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.729+0000 7fae03e00640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadec0047c0 0x7fadec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.729+0000 7fae09800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 0x7fadec00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.730+0000 7fae09800640 1 -- 172.21.15.100:0/3369602294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0039c0 msgr2=0x7fadec003dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.730+0000 7fae09800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0039c0 0x7fadec003dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.730+0000 7fae09800640 1 -- 172.21.15.100:0/3369602294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadec0047c0 msgr2=0x7fadec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.730+0000 7fae09800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadec0047c0 0x7fadec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.730+0000 7fae09800640 1 -- 172.21.15.100:0/3369602294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040f58b0 con 0x7fadec0053d0 2024-02-21T07:45:55.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.731+0000 7fae03e00640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadec0047c0 0x7fadec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:55.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.731+0000 7fae09800640 1 -- 172.21.15.100:0/3369602294 reap_dead start 2024-02-21T07:45:55.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.736+0000 7f59f6c00640 1 Processor -- start 2024-02-21T07:45:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7fc0a9200640 1 Processor -- start 2024-02-21T07:45:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7fae09800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 0x7fadec00ba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e30 tx=0x7fadec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c481b739317f3f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7f59f6c00640 1 -- start start 2024-02-21T07:45:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc02cd90 con 0x7fadec0053d0 2024-02-21T07:45:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7fae03400640 1 -- 172.21.15.100:0/3369602294 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc034440 con 0x7fadec0053d0 2024-02-21T07:45:55.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.737+0000 7fc0a9200640 1 -- start start 2024-02-21T07:45:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.739+0000 7fc0a9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc0a4071010 0x7fc0a40713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.740+0000 7fc0a1e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc0a4071010 0x7fc0a40713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.741+0000 7fc0a1e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc0a4071010 0x7fc0a40713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43094/0 (socket says 172.21.15.100:43094) 2024-02-21T07:45:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.741+0000 7fc0a1e00640 1 -- 172.21.15.100:0/1073630659 learned_addr learned my addr 172.21.15.100:0/1073630659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.741+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40700c0 con 0x7fc0a4071d70 2024-02-21T07:45:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.741+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40703a0 con 0x7fc0a4071930 2024-02-21T07:45:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.738+0000 7fae0b800640 1 -- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 msgr2=0x7fadec00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.738+0000 7fae0b800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 0x7fadec00ba30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009e30 tx=0x7fadec0057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.742+0000 7fae0b800640 1 -- 172.21.15.100:0/3369602294 shutdown_connections 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.742+0000 7fae0b800640 1 --2- 172.21.15.100:0/3369602294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fadec0053d0 0x7fadec00ba30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.742+0000 7fae0b800640 1 -- 172.21.15.100:0/3369602294 >> 172.21.15.100:0/3369602294 conn(0x7fae040668b0 msgr2=0x7fae04066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.740+0000 7ffbd1600640 1 Processor -- start 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.740+0000 7ffbd1600640 1 -- start start 2024-02-21T07:45:55.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.742+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a406ea40 con 0x7fc0a4071010 2024-02-21T07:45:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.743+0000 7fae0b800640 1 -- 172.21.15.100:0/3369602294 shutdown_connections 2024-02-21T07:45:55.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.743+0000 7fae0b800640 1 -- 172.21.15.100:0/3369602294 wait complete. 2024-02-21T07:45:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.746+0000 7f59efe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f59f0188ab0 0x7f59f008cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40834/0 (socket says 172.21.15.100:40834) 2024-02-21T07:45:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.746+0000 7f59efe00640 1 -- 172.21.15.100:0/1030387553 learned_addr learned my addr 172.21.15.100:0/1030387553 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.746+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1030387553 >> v2:172.21.15.156:3300/0 conn(0x7f59f00fa0c0 0x7f59f0188e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.744+0000 7fc0a1e00640 1 -- 172.21.15.100:0/1073630659 >> v1:172.21.15.156:6789/0 conn(0x7fc0a4071930 legacy=0x7fc0a406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.744+0000 7fc0a1e00640 1 -- 172.21.15.100:0/1073630659 >> v1:172.21.15.100:6789/0 conn(0x7fc0a4071d70 legacy=0x7fc0a4186920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.744+0000 7fc0a1e00640 1 -- 172.21.15.100:0/1073630659 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4070680 con 0x7fc0a4071010 2024-02-21T07:45:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f008bfe0 con 0x7f59f006ab60 2024-02-21T07:45:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f008c880 con 0x7f59f0188ab0 2024-02-21T07:45:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1030387553 >> v2:172.21.15.156:3300/0 conn(0x7f59f00fa0c0 0x7f59f0188e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784356992 0 0) 0x7f59f008bfe0 con 0x7f59f006ab60 2024-02-21T07:45:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f008d420 con 0x7f59f00fa0c0 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbd1600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffbcc163040 0x7ffbcc1634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbd1600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc18d9a0 con 0x7ffbcc18ff80 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbd1600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc06fb70 con 0x7ffbcc190360 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbd1600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc070410 con 0x7ffbcc163040 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbcaa00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ffbcc18ff80 0x7ffbcc06eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50354/0 (socket says 172.21.15.100:50354) 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbcaa00640 1 -- 172.21.15.100:0/2011455459 learned_addr learned my addr 172.21.15.100:0/2011455459 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.748+0000 7ffbcb400640 1 --2- 172.21.15.100:0/2011455459 >> v2:172.21.15.170:3300/0 conn(0x7ffbcc163040 0x7ffbcc1634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.749+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505153364 0 0) 0x7ffbcc18d9a0 con 0x7ffbcc18ff80 2024-02-21T07:45:55.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb0003520 con 0x7ffbcc18ff80 2024-02-21T07:45:55.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813418169 0 0) 0x7ffbcc06fb70 con 0x7ffbcc190360 2024-02-21T07:45:55.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb0003840 con 0x7ffbcc190360 2024-02-21T07:45:55.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d4003520 con 0x7f59f006ab60 2024-02-21T07:45:55.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584751190 0 0) 0x7f59f008c880 con 0x7f59f0188ab0 2024-02-21T07:45:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f008bfe0 con 0x7f59f0188ab0 2024-02-21T07:45:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918350606 0 0) 0x7f59d4003520 con 0x7f59f006ab60 2024-02-21T07:45:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7fc0a1e00640 1 --2- 172.21.15.100:0/1073630659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a4071010 0x7fc0a40713f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007360 tx=0x7fc08c02cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ac95aa3e7b96d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 >> v2:172.21.15.156:3300/0 conn(0x7f59f00fa0c0 msgr2=0x7f59f0188e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899400172 0 0) 0x7ffbb0003520 con 0x7ffbcc18ff80 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 >> v2:172.21.15.170:3300/0 conn(0x7ffbcc163040 msgr2=0x7ffbcc1634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 --2- 172.21.15.100:0/2011455459 >> v2:172.21.15.170:3300/0 conn(0x7ffbcc163040 0x7ffbcc1634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 >> v1:172.21.15.170:6789/0 conn(0x7ffbcc190360 legacy=0x7ffbcc1907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc06fe50 con 0x7ffbcc18ff80 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7ffbbc001650 con 0x7ffbcc18ff80 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 >> v1:172.21.15.156:6789/0 conn(0x7ffbcc18ff80 legacy=0x7ffbcc06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 0x7ffbb00040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbb00047c0 0x7ffbb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb0005300 0x7ffbb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8001230 con 0x7ffbb0005300 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb000c240 con 0x7ffbb00047c0 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb000c400 con 0x7ffbb0003d10 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.750+0000 7f59eea00640 1 --2- 172.21.15.100:0/1030387553 >> v2:172.21.15.156:3300/0 conn(0x7f59f00fa0c0 0x7f59f0188e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 >> v1:172.21.15.170:6789/0 conn(0x7f59f0188ab0 legacy=0x7f59f008cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00fa660 con 0x7f59f006ab60 2024-02-21T07:45:55.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f59e80019f0 con 0x7f59f006ab60 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 >> v1:172.21.15.156:6789/0 conn(0x7f59f006ab60 legacy=0x7f59f00f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d4003b80 0x7f59d4003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59d40047c0 0x7f59d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 0x7f59d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8001230 con 0x7f59d40047c0 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f008d420 con 0x7f59d40051d0 2024-02-21T07:45:55.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d400c180 con 0x7f59d4003b80 2024-02-21T07:45:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.751+0000 7fc0a0a00640 1 -- 172.21.15.100:0/1073630659 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c008df0 con 0x7fc0a4071010 2024-02-21T07:45:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.752+0000 7fc0a0a00640 1 -- 172.21.15.100:0/1073630659 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00a0d0 con 0x7fc0a4071010 2024-02-21T07:45:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.753+0000 7ffbcb400640 1 --2- 172.21.15.100:0/2011455459 >> v2:172.21.15.170:3300/0 conn(0x7ffbcc163040 0x7ffbcc1634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.753+0000 7ffbca000640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbb00047c0 0x7ffbb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.753+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 0x7ffbb00040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.753+0000 7ffbcb400640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb0005300 0x7ffbb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.753+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 0x7f59d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.754+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a4071010 msgr2=0x7fc0a40713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.754+0000 7fc0a9200640 1 --2- 172.21.15.100:0/1073630659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a4071010 0x7fc0a40713f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007360 tx=0x7fc08c02cbe0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.755+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 shutdown_connections 2024-02-21T07:45:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.755+0000 7fc0a9200640 1 --2- 172.21.15.100:0/1073630659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a4071010 0x7fc0a40713f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.755+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 >> 172.21.15.100:0/1073630659 conn(0x7fc0a40668b0 msgr2=0x7fc0a4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.754+0000 7f59efe00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d4003b80 0x7f59d4003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7ffbcaa00640 1 -- 172.21.15.100:0/2011455459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbb00047c0 msgr2=0x7ffbb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbb00047c0 0x7ffbb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7ffbcaa00640 1 -- 172.21.15.100:0/2011455459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb0005300 msgr2=0x7ffbb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7f59ef400640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59d40047c0 0x7f59d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7f59f4c00640 1 -- 172.21.15.100:0/1030387553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d4003b80 msgr2=0x7f59d4003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d4003b80 0x7f59d4003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7f59f4c00640 1 -- 172.21.15.100:0/1030387553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59d40047c0 msgr2=0x7f59d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.757+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59d40047c0 0x7f59d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.757+0000 7f59f4c00640 1 -- 172.21.15.100:0/1030387553 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4003520 con 0x7f59d40051d0 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.758+0000 7f5bf3800640 1 Processor -- start 2024-02-21T07:45:55.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7fae0b800640 1 Processor -- start 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.757+0000 7fae0b800640 1 -- start start 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7fae0b800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 0x7fae04172ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7fae0b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae04224520 0x7fae040f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7f59f4c00640 1 -- 172.21.15.100:0/1030387553 reap_dead start 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7f59ef400640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59d40047c0 0x7f59d4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:55.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb0005300 0x7ffbb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.756+0000 7ffbcaa00640 1 -- 172.21.15.100:0/2011455459 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc06fe50 con 0x7ffbb0003d10 2024-02-21T07:45:55.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 0x7f59d400b980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009a70 tx=0x7f59d40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2dcd584951c40a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7fae08e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 0x7fae04172ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7fae08e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 0x7fae04172ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43136/0 (socket says 172.21.15.100:43136) 2024-02-21T07:45:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7fae08e00640 1 -- 172.21.15.100:0/2878326280 learned_addr learned my addr 172.21.15.100:0/2878326280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.758+0000 7f5bf3800640 1 -- start start 2024-02-21T07:45:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7fae0b800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae04186620 0x7fae04186aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e002c6b0 con 0x7f59d40051d0 2024-02-21T07:45:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7ffbcb400640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb0005300 0x7ffbb000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.759+0000 7ffbcb400640 1 -- 172.21.15.100:0/2011455459 reap_dead start 2024-02-21T07:45:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 0x7ffbb00040f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c190 tx=0x7ffbb00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57603b67803bd82 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e002c810 con 0x7f59d40051d0 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040f91c0 con 0x7fae04224520 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7fae09800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae04186620 0x7fae04186aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae042249a0 con 0x7fae04186620 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040f8260 con 0x7fadec0053d0 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7fae03e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae04224520 0x7fae040f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004aa0 con 0x7ffbb0003d10 2024-02-21T07:45:55.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc004c20 con 0x7ffbb0003d10 2024-02-21T07:45:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.760+0000 7ffbc9600640 1 -- 172.21.15.100:0/2011455459 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0070d0 con 0x7ffbb0003d10 2024-02-21T07:45:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7ffbd1600640 1 -- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 msgr2=0x7ffbb00040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.761+0000 7ffbd1600640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 0x7ffbb00040f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c190 tx=0x7ffbb00057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f5bf3800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5bec190260 0x7f5bec070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7ffbd1600640 1 -- 172.21.15.100:0/2011455459 shutdown_connections 2024-02-21T07:45:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7ffbd1600640 1 --2- 172.21.15.100:0/2011455459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbb0003d10 0x7ffbb00040f0 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc00c190 tx=0x7ffbb00057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7ffbd1600640 1 -- 172.21.15.100:0/2011455459 >> 172.21.15.100:0/2011455459 conn(0x7ffbcc0f64c0 msgr2=0x7ffbcc0f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f6e01c00640 1 Processor -- start 2024-02-21T07:45:55.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f59eea00640 1 -- 172.21.15.100:0/1030387553 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e002cbc0 con 0x7f59d40051d0 2024-02-21T07:45:55.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 msgr2=0x7f59d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 0x7f59d400b980 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009a70 tx=0x7f59d40057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f5bf3800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5bec06edc0 0x7f5bec0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f5bebe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5bec0f4b20 0x7f5bec06e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40848/0 (socket says 172.21.15.100:40848) 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f5bf0e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5bec190260 0x7f5bec070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 shutdown_connections 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1030387553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59d40051d0 0x7f59d400b980 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 >> 172.21.15.100:0/1030387553 conn(0x7f59f00fe290 msgr2=0x7f59f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7ffbd1600640 1 -- 172.21.15.100:0/2011455459 shutdown_connections 2024-02-21T07:45:55.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7ffbd1600640 1 -- 172.21.15.100:0/2011455459 wait complete. 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f5bebe00640 1 -- 172.21.15.100:0/3476984543 learned_addr learned my addr 172.21.15.100:0/3476984543 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.763+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec18dc80 con 0x7f5bec0f4b20 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0f5b90 con 0x7f5bec06edc0 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0f55d0 con 0x7f5bec190260 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243336556 0 0) 0x7f5bec18dc80 con 0x7f5bec0f4b20 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd0003520 con 0x7f5bec0f4b20 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7f5bf1800640 1 --2- 172.21.15.100:0/3476984543 >> v2:172.21.15.100:3300/0 conn(0x7f5bec06edc0 0x7f5bec0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 465334387 0 0) 0x7f5bd0003520 con 0x7f5bec0f4b20 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 >> v2:172.21.15.170:3300/0 conn(0x7f5bec190260 msgr2=0x7f5bec070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 --2- 172.21.15.100:0/3476984543 >> v2:172.21.15.170:3300/0 conn(0x7f5bec190260 0x7f5bec070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 >> v2:172.21.15.100:3300/0 conn(0x7f5bec06edc0 msgr2=0x7f5bec0f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 --2- 172.21.15.100:0/3476984543 >> v2:172.21.15.100:3300/0 conn(0x7f5bec06edc0 0x7f5bec0f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0f58b0 con 0x7f5bec0f4b20 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f5bd8001670 con 0x7f5bec0f4b20 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 >> v1:172.21.15.170:6789/0 conn(0x7f5bec0f4b20 legacy=0x7f5bec06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0003a10 0x7f5bd0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd0005380 0x7f5bd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0f5b90 con 0x7f5bd0003a10 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0f55d0 con 0x7f5bd00047c0 2024-02-21T07:45:55.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd000c270 con 0x7f5bd0005380 2024-02-21T07:45:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7fae08e00640 1 -- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae04186620 msgr2=0x7fae04186aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7fae08e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae04186620 0x7fae04186aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 shutdown_connections 2024-02-21T07:45:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7f59f6c00640 1 -- 172.21.15.100:0/1030387553 wait complete. 2024-02-21T07:45:55.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.762+0000 7f6e01c00640 1 -- start start 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7f5bf1800640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd0005380 0x7f5bd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7f5bebe00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7f5bf0e00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0003a10 0x7f5bd0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f5bebe00640 1 -- 172.21.15.100:0/3476984543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd0005380 msgr2=0x7f5bd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f5bebe00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bd0005380 0x7f5bd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f5bebe00640 1 -- 172.21.15.100:0/3476984543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0003a10 msgr2=0x7f5bd0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f5bebe00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0003a10 0x7f5bd0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f5bebe00640 1 -- 172.21.15.100:0/3476984543 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0003520 con 0x7f5bd00047c0 2024-02-21T07:45:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.764+0000 7fae08e00640 1 -- 172.21.15.100:0/2878326280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae04224520 msgr2=0x7fae040f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7fae08e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae04224520 0x7fae040f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7f6e01c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6dfc186340 0x7f6dfc08ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.766+0000 7fae08e00640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040f8540 con 0x7fadec0053d0 2024-02-21T07:45:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7fae09800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae04186620 0x7fae04186aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7fae03e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae04224520 0x7fae040f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7ffbd1600640 1 Processor -- start 2024-02-21T07:45:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.765+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 shutdown_connections 2024-02-21T07:45:55.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7ffbd1600640 1 -- start start 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6e01c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc0fab70 con 0x7f6dfc06ab60 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6e01c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc186720 con 0x7f6dfc189560 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6e01c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc08d3f0 con 0x7f6dfc186340 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.767+0000 7f6dfaa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6dfc186340 0x7f6dfc08ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6dfaa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6dfc186340 0x7f6dfc08ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34806/0 (socket says 172.21.15.100:34806) 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6dfaa00640 1 -- 172.21.15.100:0/2110479914 learned_addr learned my addr 172.21.15.100:0/2110479914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.768+0000 7f6df2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6dfc06ab60 0x7f6dfc188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40322/0 (socket says 172.21.15.100:40322) 2024-02-21T07:45:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7f5bf0e00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0003a10 0x7f5bd0003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7fae08e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 0x7fae04172ea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b3c0 tx=0x7fadf000b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7fc0a9200640 1 -- 172.21.15.100:0/1073630659 wait complete. 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7f5bf1800640 1 -- 172.21.15.100:0/3476984543 reap_dead start 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7f5bebe00640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bd0004c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c110 tx=0x7f5bd00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3e1218d9356964 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8005ad0 con 0x7f5bd00047c0 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8005c50 con 0x7f5bd00047c0 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7ffbd1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbcc158700 0x7ffbcc0f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7f5beb400640 1 -- 172.21.15.100:0/3476984543 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd802c850 con 0x7f5bd00047c0 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7ffbd1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbcc158ae0 0x7ffbcc06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbd1600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbcc06d7c0 0x7ffbcc06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbcc158700 0x7ffbcc0f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbcc158700 0x7ffbcc0f8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34822/0 (socket says 172.21.15.100:34822) 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbcaa00640 1 -- 172.21.15.100:0/1910006735 learned_addr learned my addr 172.21.15.100:0/1910006735 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0f8e40 con 0x7ffbcc158ae0 2024-02-21T07:45:55.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.769+0000 7f6dfaa00640 1 -- 172.21.15.100:0/2110479914 >> v1:172.21.15.170:6789/0 conn(0x7f6dfc189560 legacy=0x7f6dfc0f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.770+0000 7f6dfaa00640 1 -- 172.21.15.100:0/2110479914 >> v1:172.21.15.100:6789/0 conn(0x7f6dfc06ab60 legacy=0x7f6dfc188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0f7610 con 0x7ffbcc158700 2024-02-21T07:45:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011830 con 0x7fadec0053d0 2024-02-21T07:45:55.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 msgr2=0x7f5bd0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bd0004c40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c110 tx=0x7f5bd00057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 shutdown_connections 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 --2- 172.21.15.100:0/3476984543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bd0004c40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 >> 172.21.15.100:0/3476984543 conn(0x7f5bec0668b0 msgr2=0x7f5bec066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 shutdown_connections 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0011990 con 0x7fadec0053d0 2024-02-21T07:45:55.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0011d40 con 0x7fadec0053d0 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0f8470 con 0x7ffbcc06d7c0 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7ffbcb400640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbcc06d7c0 0x7ffbcc06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7ffbca000640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbcc158ae0 0x7ffbcc06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 -- 172.21.15.100:0/1910006735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbcc06d7c0 msgr2=0x7ffbcc06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbcc06d7c0 0x7ffbcc06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 -- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbcc158700 msgr2=0x7ffbcc0f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbcc158700 0x7ffbcc0f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0f7860 con 0x7ffbcc158ae0 2024-02-21T07:45:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.771+0000 7f6dfaa00640 1 -- 172.21.15.100:0/2110479914 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0fa890 con 0x7f6dfc186340 2024-02-21T07:45:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbcb400640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbcc06d7c0 0x7ffbcc06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7ffbca000640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbcc158ae0 0x7ffbcc06ab60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800fb60 tx=0x7ffbb800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7fb3afe00640 1 Processor -- start 2024-02-21T07:45:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7f6dfaa00640 1 --2- 172.21.15.100:0/2110479914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc186340 0x7f6dfc08ceb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc617c58d6fa0ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7fa154600640 1 Processor -- start 2024-02-21T07:45:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.774+0000 7fa154600640 1 -- start start 2024-02-21T07:45:55.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.774+0000 7f59f6c00640 1 Processor -- start 2024-02-21T07:45:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.772+0000 7fc0a9200640 1 Processor -- start 2024-02-21T07:45:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7f5bf3800640 1 -- 172.21.15.100:0/3476984543 wait complete. 2024-02-21T07:45:55.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.775+0000 7f59f6c00640 1 -- start start 2024-02-21T07:45:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae040f8820 con 0x7fadec0053d0 2024-02-21T07:45:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.773+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae040f8de0 con 0x7fadec0053d0 2024-02-21T07:45:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7f5bf3800640 1 Processor -- start 2024-02-21T07:45:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7f5bf3800640 1 -- start start 2024-02-21T07:45:55.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 0x7f59f0164e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f0220fa0 0x7f59f0221400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f008d970 0x7f59f008ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0220b80 con 0x7f59f008d970 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f021c740 con 0x7f59f0220fa0 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f59f6c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f021fc40 con 0x7f59d40051d0 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7fa154600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa14c1838e0 0x7fa14c0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7fa154600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa14c18fb60 0x7fa14c18e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7fa154600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa14c18ffc0 con 0x7fa14c18ab70 2024-02-21T07:45:55.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7fa154600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c18dbc0 con 0x7fa14c1838e0 2024-02-21T07:45:55.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7fa154600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14c18e7e0 con 0x7fa14c18fb60 2024-02-21T07:45:55.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7f6dfa000640 1 -- 172.21.15.100:0/2110479914 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec02ca80 con 0x7f6dfc186340 2024-02-21T07:45:55.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7f6dfa000640 1 -- 172.21.15.100:0/2110479914 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec02cbe0 con 0x7f6dfc186340 2024-02-21T07:45:55.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7f6dfa000640 1 -- 172.21.15.100:0/2110479914 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0343f0 con 0x7f6dfc186340 2024-02-21T07:45:55.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.774+0000 7fb3afe00640 1 -- start start 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800dcf0 con 0x7ffbcc158ae0 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7f59ef400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f0220fa0 0x7f59f0221400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.776+0000 7fc0a9200640 1 -- start start 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 0x7fc0a4182720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0a4071930 0x7fc0a40f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a40cd8b0 0x7fc0a4171850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4221e30 con 0x7fc0a4071930 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4220f40 con 0x7fc0a4071010 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fc0a9200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4221220 con 0x7fc0a40cd8b0 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fa151c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa14c1838e0 0x7fa14c0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fa151c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa14c1838e0 0x7fa14c0709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34830/0 (socket says 172.21.15.100:34830) 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fa151c00640 1 -- 172.21.15.100:0/1681593311 learned_addr learned my addr 172.21.15.100:0/1681593311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.778+0000 7fa151200640 1 --2- 172.21.15.100:0/1681593311 >> v2:172.21.15.170:3300/0 conn(0x7fa14c18fb60 0x7fa14c18e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7fa151c00640 1 -- 172.21.15.100:0/1681593311 >> v2:172.21.15.170:3300/0 conn(0x7fa14c18fb60 msgr2=0x7fa14c18e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7fa151c00640 1 --2- 172.21.15.100:0/1681593311 >> v2:172.21.15.170:3300/0 conn(0x7fa14c18fb60 0x7fa14c18e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7fa151c00640 1 -- 172.21.15.100:0/1681593311 >> v1:172.21.15.100:6789/0 conn(0x7fa14c18ab70 legacy=0x7fa14c06da30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f6e01c00640 1 -- 172.21.15.100:0/2110479914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc186340 msgr2=0x7f6dfc08ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.777+0000 7f6e01c00640 1 --2- 172.21.15.100:0/2110479914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc186340 0x7f6dfc08ceb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec02bee0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f6e01c00640 1 -- 172.21.15.100:0/2110479914 shutdown_connections 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bec0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bec0f92a0 0x7f5bec170940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f6e01c00640 1 --2- 172.21.15.100:0/2110479914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc186340 0x7f6dfc08ceb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7ffb4a600640 1 Processor -- start 2024-02-21T07:45:55.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f6e01c00640 1 -- 172.21.15.100:0/2110479914 >> 172.21.15.100:0/2110479914 conn(0x7f6dfc0fe290 msgr2=0x7f6dfc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7fc0a1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 0x7fc0a4182720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7fb3afe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb3b018a4a0 0x7fb3b0070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fc0a1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 0x7fc0a4182720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34832/0 (socket says 172.21.15.100:34832) 2024-02-21T07:45:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fc0a1e00640 1 -- 172.21.15.100:0/3223266026 learned_addr learned my addr 172.21.15.100:0/3223266026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 0x7f5bec188de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec174f90 con 0x7f5bec0f9720 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0f7cd0 con 0x7f5bd00047c0 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf3800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0f8e10 con 0x7f5bec0f92a0 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7f5bf1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 0x7f5bec188de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7f5bf1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 0x7f5bec188de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51094/0 (socket says 172.21.15.100:51094) 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7f5bf1800640 1 -- 172.21.15.100:0/1843065124 learned_addr learned my addr 172.21.15.100:0/1843065124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800de90 con 0x7ffbcc158ae0 2024-02-21T07:45:55.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fb3afe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3b018b280 0x7fb3b006f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fc0a2800640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a40cd8b0 0x7fc0a4171850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800fe90 con 0x7ffbcc158ae0 2024-02-21T07:45:55.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0f7b40 con 0x7ffbcc158ae0 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fb3afe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b006ddb0 con 0x7fb3b0071450 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fb3af400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3b018b280 0x7fb3b006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7fb3af400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3b018b280 0x7fb3b006f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34854/0 (socket says 172.21.15.100:34854) 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7fb3af400640 1 -- 172.21.15.100:0/1302289387 learned_addr learned my addr 172.21.15.100:0/1302289387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b006ed10 con 0x7fb3b018b280 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b018db30 con 0x7fb3b018a4a0 2024-02-21T07:45:55.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0f8100 con 0x7ffbcc158ae0 2024-02-21T07:45:55.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.780+0000 7f5bf0e00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bec0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7f59efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 0x7f59f0164e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7f59efe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 0x7f59f0164e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43196/0 (socket says 172.21.15.100:43196) 2024-02-21T07:45:55.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7f59efe00640 1 -- 172.21.15.100:0/1887835003 learned_addr learned my addr 172.21.15.100:0/1887835003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.781+0000 7f59ef400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f0220fa0 0x7f59f0221400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34824/0 (socket says 172.21.15.100:34824) 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fb3af400640 1 -- 172.21.15.100:0/1302289387 >> v2:172.21.15.170:3300/0 conn(0x7fb3b018a4a0 msgr2=0x7fb3b0070f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fb3af400640 1 --2- 172.21.15.100:0/1302289387 >> v2:172.21.15.170:3300/0 conn(0x7fb3b018a4a0 0x7fb3b0070f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fb3af400640 1 -- 172.21.15.100:0/1302289387 >> v1:172.21.15.100:6789/0 conn(0x7fb3b0071450 legacy=0x7fb3b018ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.779+0000 7ffb4a600640 1 -- start start 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffb4a600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffb4406ab60 0x7ffb440f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffb4a600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffb440f9ef0 0x7ffb44188e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffb4a600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4408bfe0 con 0x7ffb44188ab0 2024-02-21T07:45:55.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffb4a600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4408d420 con 0x7ffb440f9ef0 2024-02-21T07:45:55.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffb4a600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4408c880 con 0x7ffb4406ab60 2024-02-21T07:45:55.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffbcc162b20 con 0x7ffbcc158ae0 2024-02-21T07:45:55.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fb3af400640 1 -- 172.21.15.100:0/1302289387 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b006e090 con 0x7fb3b018b280 2024-02-21T07:45:55.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fade0001030 con 0x7fadec0053d0 2024-02-21T07:45:55.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fc0a1e00640 1 -- 172.21.15.100:0/3223266026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a40cd8b0 msgr2=0x7fc0a4171850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fc0a1e00640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a40cd8b0 0x7fc0a4171850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fc0a1e00640 1 -- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0a4071930 msgr2=0x7fc0a40f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7fc0a1e00640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0a4071930 0x7fc0a40f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.782+0000 7f6e01c00640 1 -- 172.21.15.100:0/2110479914 shutdown_connections 2024-02-21T07:45:55.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f6e01c00640 1 -- 172.21.15.100:0/2110479914 wait complete. 2024-02-21T07:45:55.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bebe00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bec0f92a0 0x7f5bec170940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7fc0a1e00640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c007040 con 0x7fc0a4071010 2024-02-21T07:45:55.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7fc0a2800640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc0a40cd8b0 0x7fc0a4171850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 -- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f0220fa0 msgr2=0x7f59f0221400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f59f0220fa0 0x7f59f0221400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 -- 172.21.15.100:0/1887835003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f008d970 msgr2=0x7f59f008ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f008d970 0x7f59f008ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f021ff00 con 0x7f59d40051d0 2024-02-21T07:45:55.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7ffb42a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffb4406ab60 0x7ffb440f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7ffb42a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffb4406ab60 0x7ffb440f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43210/0 (socket says 172.21.15.100:43210) 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7ffb42a00640 1 -- 172.21.15.100:0/3464201464 learned_addr learned my addr 172.21.15.100:0/3464201464 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bf1800640 1 -- 172.21.15.100:0/1843065124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bec0f92a0 msgr2=0x7f5bec170940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bf1800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5bec0f92a0 0x7f5bec170940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bf1800640 1 -- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 msgr2=0x7f5bec0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bf1800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5bd00047c0 0x7f5bec0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f5bf1800640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0f7f20 con 0x7f5bec0f9720 2024-02-21T07:45:55.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7f59efe00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 0x7f59f0164e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59d8007370 tx=0x7f59d8007830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7fc0a1e00640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 0x7fc0a4182720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007360 tx=0x7fc08c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.783+0000 7fa151c00640 1 -- 172.21.15.100:0/1681593311 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c18eac0 con 0x7fa14c1838e0 2024-02-21T07:45:55.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800f910 con 0x7f59d40051d0 2024-02-21T07:45:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0085d0 con 0x7fc0a4071010 2024-02-21T07:45:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c008750 con 0x7fc0a4071010 2024-02-21T07:45:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c02d7c0 con 0x7fc0a4071010 2024-02-21T07:45:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d800fa70 con 0x7f59d40051d0 2024-02-21T07:45:55.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800fe00 con 0x7f59d40051d0 2024-02-21T07:45:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.784+0000 7fa151c00640 1 --2- 172.21.15.100:0/1681593311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c0709f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa14002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c2694c18146b505 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.785+0000 7fa14be00640 1 -- 172.21.15.100:0/1681593311 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400317e0 con 0x7fa14c1838e0 2024-02-21T07:45:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.785+0000 7fa14be00640 1 -- 172.21.15.100:0/1681593311 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140031940 con 0x7fa14c1838e0 2024-02-21T07:45:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.786+0000 7fb3af400640 1 --2- 172.21.15.100:0/1302289387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b006f180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3b008d5e0 tx=0x7fb39c02b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c20a28234cce2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.786+0000 7fa14be00640 1 -- 172.21.15.100:0/1681593311 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140031cd0 con 0x7fa14c1838e0 2024-02-21T07:45:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.786+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396261 0 0) 0x7ffb4408bfe0 con 0x7ffb44188ab0 2024-02-21T07:45:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb28003520 con 0x7ffb44188ab0 2024-02-21T07:45:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a4221500 con 0x7fc0a4071010 2024-02-21T07:45:55.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4221ac0 con 0x7fc0a4071010 2024-02-21T07:45:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7fa154600640 1 -- 172.21.15.100:0/1681593311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 msgr2=0x7fa14c0709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f02201e0 con 0x7f59d40051d0 2024-02-21T07:45:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828110804 0 0) 0x7ffb28003520 con 0x7ffb44188ab0 2024-02-21T07:45:55.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 >> v2:172.21.15.170:3300/0 conn(0x7ffb4406ab60 msgr2=0x7ffb440f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ffbb80050d0 con 0x7ffbcc158ae0 2024-02-21T07:45:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fb3ad600640 1 -- 172.21.15.100:0/1302289387 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c031770 con 0x7fb3b018b280 2024-02-21T07:45:55.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7f1793000640 1 Processor -- start 2024-02-21T07:45:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7fa154600640 1 --2- 172.21.15.100:0/1681593311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c0709f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa140009870 tx=0x7fa14002b880 comp rx=0 tx=0).stop 2024-02-21T07:45:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 -- 172.21.15.100:0/1681593311 shutdown_connections 2024-02-21T07:45:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7ffb42000640 1 --2- 172.21.15.100:0/3464201464 >> v2:172.21.15.170:3300/0 conn(0x7ffb4406ab60 0x7ffb440f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fb3ad600640 1 -- 172.21.15.100:0/1302289387 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c0318d0 con 0x7fb3b018b280 2024-02-21T07:45:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 --2- 172.21.15.100:0/1681593311 >> v2:172.21.15.170:3300/0 conn(0x7fa14c18fb60 0x7fa14c18e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 >> v2:172.21.15.156:3300/0 conn(0x7ffb440f9ef0 msgr2=0x7ffb44188e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fb3ad600640 1 -- 172.21.15.100:0/1302289387 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c031c60 con 0x7fb3b018b280 2024-02-21T07:45:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 --2- 172.21.15.100:0/1681593311 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c0709f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 -- 172.21.15.100:0/1681593311 >> 172.21.15.100:0/1681593311 conn(0x7fa14c0668b0 msgr2=0x7fa14c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7ffb42000640 1 --2- 172.21.15.100:0/3464201464 >> v2:172.21.15.156:3300/0 conn(0x7ffb440f9ef0 0x7ffb44188e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7f1793000640 1 -- start start 2024-02-21T07:45:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 -- 172.21.15.100:0/1681593311 shutdown_connections 2024-02-21T07:45:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7fa154600640 1 -- 172.21.15.100:0/1681593311 wait complete. 2024-02-21T07:45:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.788+0000 7f5bf1800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 0x7f5bec188de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0d2730 tx=0x7f5bdc00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc004230 con 0x7f5bec0f9720 2024-02-21T07:45:55.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00c040 con 0x7f5bec0f9720 2024-02-21T07:45:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00d6c0 con 0x7f5bec0f9720 2024-02-21T07:45:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.787+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fadf001b460 con 0x7fadec0053d0 2024-02-21T07:45:55.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f02207a0 con 0x7f59d40051d0 2024-02-21T07:45:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440fa660 con 0x7ffb44188ab0 2024-02-21T07:45:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 msgr2=0x7fb3b006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7fb3afe00640 1 --2- 172.21.15.100:0/1302289387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b006f180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb3b008d5e0 tx=0x7fb39c02b810 comp rx=0 tx=0).stop 2024-02-21T07:45:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.789+0000 7f6e01c00640 1 Processor -- start 2024-02-21T07:45:55.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7f6e01c00640 1 -- start start 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7ffb2c001670 con 0x7ffb44188ab0 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 >> v1:172.21.15.100:6789/0 conn(0x7ffb44188ab0 legacy=0x7ffb4408cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 0x7ffb28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280047c0 0x7ffb28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb280052a0 0x7ffb2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4408d420 con 0x7ffb280052a0 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4408c880 con 0x7ffb280047c0 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.790+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28014a50 con 0x7ffb280039c0 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7ffb43400640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 0x7ffb28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7ffb43400640 1 -- 172.21.15.100:0/3464201464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280047c0 msgr2=0x7ffb28004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7ffb43400640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280047c0 0x7ffb28004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7ffb43400640 1 -- 172.21.15.100:0/3464201464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb280052a0 msgr2=0x7ffb2800b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7ffb43e00640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb280052a0 0x7ffb2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7ffb43400640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb280052a0 0x7ffb2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7ffb43400640 1 -- 172.21.15.100:0/3464201464 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28003520 con 0x7ffb280039c0 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7ffb43e00640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb280052a0 0x7ffb2800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7ffb43e00640 1 -- 172.21.15.100:0/3464201464 reap_dead start 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7ffbc2a00640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbac09f130 0x7ffbac0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ffbb80ca5e0 con 0x7ffbcc158ae0 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 shutdown_connections 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fb3afe00640 1 --2- 172.21.15.100:0/1302289387 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b006f180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fb3afe00640 1 --2- 172.21.15.100:0/1302289387 >> v2:172.21.15.170:3300/0 conn(0x7fb3b018a4a0 0x7fb3b0070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 >> 172.21.15.100:0/1302289387 conn(0x7fb3b00ce150 msgr2=0x7fb3b00ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 shutdown_connections 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7f1793000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1784107ca0 0x7f178407dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7f1793000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17840557d0 0x7f178410a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7f1793000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17841081a0 con 0x7f178407e4e0 2024-02-21T07:45:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7f1793000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1784050840 con 0x7f17840557d0 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.791+0000 7f1793000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1784050560 con 0x7f1784107ca0 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1784107ca0 0x7f178407dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1784107ca0 0x7f178407dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43230/0 (socket says 172.21.15.100:43230) 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 -- 172.21.15.100:0/2837657560 learned_addr learned my addr 172.21.15.100:0/2837657560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 -- 172.21.15.100:0/2837657560 >> v2:172.21.15.156:3300/0 conn(0x7f17840557d0 msgr2=0x7f178410a200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 --2- 172.21.15.100:0/2837657560 >> v2:172.21.15.156:3300/0 conn(0x7f17840557d0 0x7f178410a200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 -- 172.21.15.100:0/2837657560 >> v1:172.21.15.156:6789/0 conn(0x7f178407e4e0 legacy=0x7f17840550c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7f1791c00640 1 -- 172.21.15.100:0/2837657560 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784054300 con 0x7f1784107ca0 2024-02-21T07:45:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.792+0000 7fa154600640 1 Processor -- start 2024-02-21T07:45:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7fa154600640 1 -- start start 2024-02-21T07:45:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec0f8200 con 0x7f5bec0f9720 2024-02-21T07:45:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec0f87c0 con 0x7f5bec0f9720 2024-02-21T07:45:55.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f6e01c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc06ab60 0x7f6dfc1787f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f6e01c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc186340 0x7f6dfc182360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f6e01c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc189560 0x7f6dfc1828a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f6e01c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc224ae0 con 0x7f6dfc186340 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7f6e01c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc224500 con 0x7f6dfc189560 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7f6e01c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc182f00 con 0x7f6dfc06ab60 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7f6dfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc189560 0x7f6dfc1828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7f6dfaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc06ab60 0x7f6dfc1787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fae00c00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fade409f280 0x7fade40a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c1829f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa14c18ab70 0x7fa14c0f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa14c18fb60 0x7fa14c0f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c223e30 con 0x7fa14c18ab70 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c0f5280 con 0x7fa14c1838e0 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fa154600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c0f5560 con 0x7fa14c18fb60 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7f6df2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc186340 0x7f6dfc182360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7f6dfaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc06ab60 0x7f6dfc1787f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43234/0 (socket says 172.21.15.100:43234) 2024-02-21T07:45:55.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7f6dfaa00640 1 -- 172.21.15.100:0/1984032351 learned_addr learned my addr 172.21.15.100:0/1984032351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7ffbc2a00640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7ffbac0a9950 0x7ffbac0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.793+0000 7fb3afe00640 1 -- 172.21.15.100:0/1302289387 wait complete. 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffbac0ac460 con 0x7ffbac0a9950 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb80ca9f0 con 0x7ffbcc158ae0 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c1829f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c1829f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34906/0 (socket says 172.21.15.100:34906) 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151c00640 1 -- 172.21.15.100:0/2630856191 learned_addr learned my addr 172.21.15.100:0/2630856191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa152600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa14c18fb60 0x7fa14c0f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151200640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa14c18ab70 0x7fa14c0f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7f1791c00640 1 --2- 172.21.15.100:0/2837657560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 0x7f178407dfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f178c06a800 tx=0x7f178c0a91f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b60840a0d780918 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bec06e190 con 0x7f5bec0f9720 2024-02-21T07:45:55.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fadf00c97e0 con 0x7fadec0053d0 2024-02-21T07:45:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151c00640 1 -- 172.21.15.100:0/2630856191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa14c18fb60 msgr2=0x7fa14c0f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.796+0000 7fa151c00640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa14c18fb60 0x7fa14c0f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fa151c00640 1 -- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa14c18ab70 msgr2=0x7fa14c0f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fa151c00640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa14c18ab70 0x7fa14c0f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fa151c00640 1 -- 172.21.15.100:0/2630856191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094d0 con 0x7fa14c1838e0 2024-02-21T07:45:55.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fae03e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fade409f280 0x7fade40a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f6dfb400640 1 -- 172.21.15.100:0/1984032351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc06ab60 msgr2=0x7f6dfc1787f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbac09f130 0x7ffbac0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fae00c00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7fade40a9c10 0x7fade40ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f6dfb400640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6dfc06ab60 0x7f6dfc1787f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fa151c00640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c1829f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1400090b0 tx=0x7fa1400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fade40ac720 con 0x7fade40a9c10 2024-02-21T07:45:55.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadf00cbe00 con 0x7fadec0053d0 2024-02-21T07:45:55.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f6dfb400640 1 -- 172.21.15.100:0/1984032351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc186340 msgr2=0x7f6dfc182360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.794+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc08c00a280 con 0x7fc0a4071010 2024-02-21T07:45:55.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.795+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0a4186400 con 0x7fc0a4071010 2024-02-21T07:45:55.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.798+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59f008c510 con 0x7f59d40051d0 2024-02-21T07:45:55.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.798+0000 7ffb43400640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 0x7ffb28003de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00c0e0 tx=0x7ffb280057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=454dee8ce99a27cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.798+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140032880 con 0x7fa14c1838e0 2024-02-21T07:45:55.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c02ca10 con 0x7ffb280039c0 2024-02-21T07:45:55.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f6dfb400640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dfc186340 0x7f6dfc182360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7f6dfb400640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec009b30 con 0x7f6dfc189560 2024-02-21T07:45:55.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140032a00 con 0x7fa14c1838e0 2024-02-21T07:45:55.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c0f5840 con 0x7fa14c1838e0 2024-02-21T07:45:55.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140032db0 con 0x7fa14c1838e0 2024-02-21T07:45:55.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fc09a000640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc08009f230 0x7fc0800a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14c0f5e00 con 0x7fa14c1838e0 2024-02-21T07:45:55.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7f6dfb400640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc189560 0x7f6dfc1828a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c3c0 tx=0x7f6df400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fb3afe00640 1 Processor -- start 2024-02-21T07:45:55.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.797+0000 7fb3afe00640 1 -- start start 2024-02-21T07:45:55.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc08c0ec7c0 con 0x7fc0a4071010 2024-02-21T07:45:55.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b0071450 0x7fb3b016ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 0x7fb3b0177690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b0177bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0178110 con 0x7fb3b018a4a0 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0220d20 con 0x7fb3b018b280 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7fb3afe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b0178350 con 0x7fb3b0071450 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5bdc00d820 con 0x7f5bec0f9720 2024-02-21T07:45:55.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fae09800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7fade40a9c10 0x7fade40ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fc0a1400640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc08009f230 0x7fc0800a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40052d0 con 0x7f6dfc189560 2024-02-21T07:45:55.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7fae03e00640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fade409f280 0x7fade40a1740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001120 tx=0x7fadf8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7fae09800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7fade40a9c10 0x7fade40ac050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c02cb70 con 0x7ffb280039c0 2024-02-21T07:45:55.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 0x7fb3b0177690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 0x7fb3b0177690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51134/0 (socket says 172.21.15.100:51134) 2024-02-21T07:45:55.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fb3ae000640 1 -- 172.21.15.100:0/2741977580 learned_addr learned my addr 172.21.15.100:0/2741977580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fb3af400640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b0177bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fc09a000640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7fc0800a9b50 0x7fc0800abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0800ac660 con 0x7fc0800a9b50 2024-02-21T07:45:55.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f178be00640 1 -- 172.21.15.100:0/2837657560 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0b1640 con 0x7f1784107ca0 2024-02-21T07:45:55.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f178be00640 1 -- 172.21.15.100:0/2837657560 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0b17a0 con 0x7f1784107ca0 2024-02-21T07:45:55.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f178be00640 1 -- 172.21.15.100:0/2837657560 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0b1bd0 con 0x7f1784107ca0 2024-02-21T07:45:55.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df4005430 con 0x7f6dfc189560 2024-02-21T07:45:55.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.800+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4007260 con 0x7f6dfc189560 2024-02-21T07:45:55.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.799+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f59d801e3b0 con 0x7f59d40051d0 2024-02-21T07:45:55.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59e7e00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f59cc09f2b0 0x7f59cc0a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f59d80c9770 con 0x7f59d40051d0 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59e7e00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f59cc0a9c50 0x7f59cc0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59cc0ac760 con 0x7f59cc0a9c50 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59d80cbd90 con 0x7f59d40051d0 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7f59ef400640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f59cc09f2b0 0x7f59cc0a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7ffb4a600640 1 -- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 msgr2=0x7ffb28003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffb42000640 1 -- 172.21.15.100:0/3464201464 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c02ca10 con 0x7ffb280039c0 2024-02-21T07:45:55.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7fc0a2800640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7fc0800a9b50 0x7fc0800abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffb4a600640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 0x7ffb28003de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00c0e0 tx=0x7ffb280057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffbcb400640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7ffbac0a9950 0x7ffbac0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffb4a600640 1 -- 172.21.15.100:0/3464201464 shutdown_connections 2024-02-21T07:45:55.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 -- 172.21.15.100:0/2837657560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 msgr2=0x7f178407dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 --2- 172.21.15.100:0/2837657560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 0x7f178407dfa0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f178c06a800 tx=0x7f178c0a91f0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffb4a600640 1 --2- 172.21.15.100:0/3464201464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb280039c0 0x7ffb28003de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7ffb4a600640 1 -- 172.21.15.100:0/3464201464 >> 172.21.15.100:0/3464201464 conn(0x7ffb440fe290 msgr2=0x7ffb440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f59cc0a9c50 0x7f59cc0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f5be8c00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bcc09f280 0x7f5bcc0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== osd.1 v2:172.21.15.156:6818/499558575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fade40ac720 con 0x7fade40a9c10 2024-02-21T07:45:55.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f6e01c00640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc1831e0 con 0x7f6dfc189560 2024-02-21T07:45:55.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f59ef400640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f59cc09f2b0 0x7f59cc0a1770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f59e8001460 tx=0x7f59e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08c0b65c0 con 0x7fc0a4071010 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 -- 172.21.15.100:0/2837657560 shutdown_connections 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 --2- 172.21.15.100:0/2837657560 >> v2:172.21.15.156:3300/0 conn(0x7f17840557d0 0x7f178410a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 --2- 172.21.15.100:0/2837657560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 0x7f178407dfa0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f1793000640 1 -- 172.21.15.100:0/2837657560 >> 172.21.15.100:0/2837657560 conn(0x7f1784052de0 msgr2=0x7f17840531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5bdc0c9170 con 0x7f5bec0f9720 2024-02-21T07:45:55.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7ffb4a600640 1 -- 172.21.15.100:0/3464201464 shutdown_connections 2024-02-21T07:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7fb3af400640 1 -- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b0071450 msgr2=0x7fb3b016ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7fb3af400640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3b0071450 0x7fb3b016ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.801+0000 7fb3af400640 1 -- 172.21.15.100:0/2741977580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 msgr2=0x7fb3b0177690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f5be8c00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7f5bcc0a9b90 0x7f5bcc0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bcc0ac6a0 con 0x7f5bcc0a9b90 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.802+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bdc092e00 con 0x7f5bec0f9720 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7f5bf0e00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bcc09f280 0x7f5bcc0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.804+0000 7f5bf0e00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bcc09f280 0x7f5bcc0a1740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7ffb4a600640 1 -- 172.21.15.100:0/3464201464 wait complete. 2024-02-21T07:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7fc0a2800640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7fc0800a9b50 0x7fc0800abf90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.804+0000 7fc0a1400640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc08009f230 0x7fc0800a16f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc094000f60 tx=0x7fc0940079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7f1793000640 1 -- 172.21.15.100:0/2837657560 shutdown_connections 2024-02-21T07:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.803+0000 7f6e01c00640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc1834c0 con 0x7f6dfc189560 2024-02-21T07:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.804+0000 7f1793000640 1 -- 172.21.15.100:0/2837657560 wait complete. 2024-02-21T07:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.805+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== osd.6 v2:172.21.15.100:6808/3165398267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc0800ac660 con 0x7fc0800a9b50 2024-02-21T07:45:55.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.805+0000 7f5bebe00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7f5bcc0a9b90 0x7f5bcc0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.805+0000 7ffbcaa00640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbac09f130 0x7ffbac0a15f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc001050 tx=0x7ffbbc009070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7ffbcb400640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7ffbac0a9950 0x7ffbac0abd90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7fb3af400640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 0x7fb3b0177690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7f59f4c00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f59cc0a9c50 0x7f59cc0ac090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7fb3af400640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c0094d0 con 0x7fb3b018b280 2024-02-21T07:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7fb3ae000640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3b018a4a0 0x7fb3b0177690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.807+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== osd.4 v2:172.21.15.156:6810/3390829461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffbac0ac460 con 0x7ffbac0a9950 2024-02-21T07:45:55.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.807+0000 7fb3af400640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b0177bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb39c033000 tx=0x7fb39c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.807+0000 7ffb4a600640 1 Processor -- start 2024-02-21T07:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.807+0000 7ffb4a600640 1 -- start start 2024-02-21T07:45:55.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.808+0000 7f1793000640 1 Processor -- start 2024-02-21T07:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.809+0000 7f5bebe00640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7f5bcc0a9b90 0x7f5bcc0abfd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 0x7ffb441623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.808+0000 7f801be00640 1 Processor -- start 2024-02-21T07:45:55.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.808+0000 7f801be00640 1 -- start start 2024-02-21T07:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.807+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa14004e450 con 0x7fa14c1838e0 2024-02-21T07:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.809+0000 7fa149600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa12c09f1b0 0x7fa12c0a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.809+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa1400ebdc0 con 0x7fa14c1838e0 2024-02-21T07:45:55.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.806+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dcc001030 con 0x7f6dfc189560 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c032810 con 0x7fb3b018b280 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39c032970 con 0x7fb3b018b280 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b0178630 con 0x7fb3b018b280 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b0178bf0 con 0x7fb3b018b280 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39c032d20 con 0x7fb3b018b280 2024-02-21T07:45:55.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb44165fe0 0x7ffb440ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb440ceb40 0x7ffb44169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441628f0 con 0x7ffb44165fe0 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44166740 con 0x7ffb280039c0 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7ffb4a600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44166a20 con 0x7ffb440ceb40 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 0x7ffb441623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 0x7ffb441623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34924/0 (socket says 172.21.15.100:34924) 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 -- 172.21.15.100:0/568096709 learned_addr learned my addr 172.21.15.100:0/568096709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb42a00640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb44165fe0 0x7ffb440ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 -- 172.21.15.100:0/568096709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb440ceb40 msgr2=0x7ffb44169b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb440ceb40 0x7ffb44169b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 -- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb44165fe0 msgr2=0x7ffb440ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb44165fe0 0x7ffb440ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6df40073c0 con 0x7f6dfc189560 2024-02-21T07:45:55.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.811+0000 7ffb43400640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44166d00 con 0x7ffb280039c0 2024-02-21T07:45:55.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7fa151200640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa12c09f1b0 0x7fa12c0a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7ffb43400640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 0x7ffb441623b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c037040 tx=0x7ffb44188a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7f801aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f801c186b90 0x7f801c18e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40342/0 (socket says 172.21.15.100:40342) 2024-02-21T07:45:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== osd.2 v2:172.21.15.170:6808/2385898437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f59cc0ac760 con 0x7f59cc0a9c50 2024-02-21T07:45:55.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0054e0 con 0x7ffb280039c0 2024-02-21T07:45:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== osd.0 v2:172.21.15.100:6800/2845630909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5bcc0ac6a0 con 0x7f5bcc0a9b90 2024-02-21T07:45:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.808+0000 7f1793000640 1 -- start start 2024-02-21T07:45:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c034870 con 0x7ffb280039c0 2024-02-21T07:45:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c034c20 con 0x7ffb280039c0 2024-02-21T07:45:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb44166fe0 con 0x7ffb280039c0 2024-02-21T07:45:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.814+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb440cde00 con 0x7ffb280039c0 2024-02-21T07:45:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6df3400640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb4408c510 con 0x7ffb280039c0 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f1793000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 0x7f1784075b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f1793000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178407e4e0 0x7f1784079e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7f801be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f801c071300 0x7f801c071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7f801be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c18db90 con 0x7f801c186b90 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7f801aa00640 1 -- 172.21.15.100:0/3554864471 learned_addr learned my addr 172.21.15.100:0/3554864471 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7f801b400640 1 --2- 172.21.15.100:0/3554864471 >> v2:172.21.15.170:3300/0 conn(0x7f801c071300 0x7f801c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7f8019600640 1 -- 172.21.15.100:0/3554864471 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145101878 0 0) 0x7f801c18db90 con 0x7f801c186b90 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.812+0000 7f801be00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c0d1b40 con 0x7f801c0d1690 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c0d2970 con 0x7f801c071300 2024-02-21T07:45:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.814+0000 7f8019600640 1 -- 172.21.15.100:0/3554864471 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8000003520 con 0x7f801c186b90 2024-02-21T07:45:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6df40c8e20 con 0x7f6dfc189560 2024-02-21T07:45:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6dfaa00640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f1793000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 0x7f17840f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.814+0000 7f801b400640 1 -- 172.21.15.100:0/3554864471 >> v1:172.21.15.170:6789/0 conn(0x7f801c0d1690 legacy=0x7f801c18ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.814+0000 7f801b400640 1 -- 172.21.15.100:0/3554864471 >> v1:172.21.15.100:6789/0 conn(0x7f801c186b90 legacy=0x7f801c18e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.814+0000 7f801b400640 1 -- 172.21.15.100:0/3554864471 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c0d1df0 con 0x7f801c071300 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f1793000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784076040 con 0x7f17840557d0 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1793000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178407a390 con 0x7f178407e4e0 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1793000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1784077110 con 0x7f1784107ca0 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1791c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 0x7f1784075b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1791200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178407e4e0 0x7f1784079e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1791c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 0x7f1784075b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51150/0 (socket says 172.21.15.100:51150) 2024-02-21T07:45:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f1791c00640 1 -- 172.21.15.100:0/2086169270 learned_addr learned my addr 172.21.15.100:0/2086169270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.817+0000 7f801b400640 1 --2- 172.21.15.100:0/3554864471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c071300 0x7f801c071790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801402bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3629485e47f801ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.810+0000 7fa154600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7fa128001650 0x7fa128003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 --> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa128006bb0 con 0x7fa128001650 2024-02-21T07:45:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.813+0000 7fa151200640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa12c09f1b0 0x7fa12c0a1670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0f9770 tx=0x7fa138008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.817+0000 7fa152600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7fa128001650 0x7fa128003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6df3400640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f6dd80a9b40 0x7f6dd80abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dd80ac650 con 0x7f6dd80a9b40 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.815+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6df40cb440 con 0x7f6dfc189560 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.816+0000 7f6df2000640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f6dd80a9b40 0x7f6dd80abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb388001030 con 0x7fb3b018b280 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.817+0000 7f1791200640 1 -- 172.21.15.100:0/2086169270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 msgr2=0x7f17840f5930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:45:55.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.817+0000 7f1791200640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1784107ca0 0x7f17840f5930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.817+0000 7f1791200640 1 -- 172.21.15.100:0/2086169270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 msgr2=0x7f1784075b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7f8019600640 1 -- 172.21.15.100:0/3554864471 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801402cb40 con 0x7f801c071300 2024-02-21T07:45:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7f8019600640 1 -- 172.21.15.100:0/3554864471 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801402cca0 con 0x7f801c071300 2024-02-21T07:45:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7f6dfaa00640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ffb2c03b040 con 0x7ffb280039c0 2024-02-21T07:45:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c071300 msgr2=0x7f801c071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7f1791200640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 0x7f1784075b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.818+0000 7f1791200640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784076220 con 0x7f178407e4e0 2024-02-21T07:45:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7f801be00640 1 --2- 172.21.15.100:0/3554864471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c071300 0x7f801c071790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f801402bd90 comp rx=0 tx=0).stop 2024-02-21T07:45:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7fa152600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7fa128001650 0x7fa128003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7f1791c00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17840557d0 0x7f1784075b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 shutdown_connections 2024-02-21T07:45:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.819+0000 7f801be00640 1 --2- 172.21.15.100:0/3554864471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c071300 0x7f801c071790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.820+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 >> 172.21.15.100:0/3554864471 conn(0x7f801c0d0330 msgr2=0x7f801c0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.820+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 shutdown_connections 2024-02-21T07:45:55.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.820+0000 7f801be00640 1 -- 172.21.15.100:0/3554864471 wait complete. 2024-02-21T07:45:55.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.820+0000 7f6df2000640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f6dd80a9b40 0x7f6dd80abf80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.820+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb39c04d3f0 con 0x7fb3b018b280 2024-02-21T07:45:55.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.821+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== osd.9 v2:172.21.15.100:6816/4180078180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa128006bb0 con 0x7fa128001650 2024-02-21T07:45:55.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7ffb3b400640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffb2009f230 0x7ffb200a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb39009f280 0x7fb3900a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7f1791200640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178407e4e0 0x7f1784079e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178000c410 tx=0x7f178000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ffb2c0ebbf0 con 0x7ffb280039c0 2024-02-21T07:45:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7f801be00640 1 Processor -- start 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.823+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb39c0eb6e0 con 0x7fb3b018b280 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7fb3900a9c20 0x7fb3900ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3900ac730 con 0x7fb3900a9c20 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780005230 con 0x7f178407e4e0 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1780005390 con 0x7f178407e4e0 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780004820 con 0x7f178407e4e0 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f1793000640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784076500 con 0x7f178407e4e0 2024-02-21T07:45:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f801be00640 1 -- start start 2024-02-21T07:45:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb39c0edd00 con 0x7fb3b018b280 2024-02-21T07:45:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7ffb42a00640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffb2009f230 0x7ffb200a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7f1793000640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784076ac0 con 0x7f178407e4e0 2024-02-21T07:45:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.824+0000 7ffb3b400640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7ffb200a9a50 0x7ffb200abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.825+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== osd.10 v2:172.21.15.156:6826/196442047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6dd80ac650 con 0x7f6dd80a9b40 2024-02-21T07:45:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.825+0000 7fb3aea00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb39009f280 0x7fb3900a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.825+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb200ac560 con 0x7ffb200a9a50 2024-02-21T07:45:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.826+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb2c0ec000 con 0x7ffb280039c0 2024-02-21T07:45:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.826+0000 7ffb42a00640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffb2009f230 0x7ffb200a16f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb4416e020 tx=0x7ffb34009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.826+0000 7f801be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c071300 0x7f801c17b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.826+0000 7f801be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801c0d1690 0x7f801c1803d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.826+0000 7ffb43e00640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7ffb200a9a50 0x7ffb200abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 0x7f801c224e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c2238e0 con 0x7f801c0d1690 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c224970 con 0x7f801c071300 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c17b790 con 0x7f801c186b90 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 0x7f801c224e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 0x7f801c224e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43284/0 (socket says 172.21.15.100:43284) 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.827+0000 7f801b400640 1 -- 172.21.15.100:0/3656768210 learned_addr learned my addr 172.21.15.100:0/3656768210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801aa00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c071300 0x7f801c17b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7ffb43e00640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7ffb200a9a50 0x7ffb200abe90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 -- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c071300 msgr2=0x7f801c17b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c071300 0x7f801c17b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 -- 172.21.15.100:0/3656768210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801c0d1690 msgr2=0x7f801c1803d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f801c0d1690 0x7f801c1803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8014009a70 con 0x7f801c186b90 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.828+0000 7f801b400640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 0x7f801c224e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f8014004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7fb3ae000640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7fb3900a9c20 0x7fb3900ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014040860 con 0x7f801c186b90 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140409c0 con 0x7f801c186b90 2024-02-21T07:45:55.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014040d50 con 0x7f801c186b90 2024-02-21T07:45:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f3832e00640 1 Processor -- start 2024-02-21T07:45:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c223d80 con 0x7f801c186b90 2024-02-21T07:45:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c224040 con 0x7f801c186b90 2024-02-21T07:45:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f3832e00640 1 -- start start 2024-02-21T07:45:55.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.831+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ff4001030 con 0x7f801c186b90 2024-02-21T07:45:55.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.831+0000 7fb3ae000640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7fb3900a9c20 0x7fb3900ac060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.831+0000 7fb3aea00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb39009f280 0x7fb3900a1740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3b018db00 tx=0x7fb3a8009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.829+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1760001030 con 0x7f178407e4e0 2024-02-21T07:45:55.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1780004980 con 0x7f178407e4e0 2024-02-21T07:45:55.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== osd.5 v2:172.21.15.170:6816/106220500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb3900ac730 con 0x7fb3900a9c20 2024-02-21T07:45:55.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.833+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== osd.3 v2:172.21.15.100:6817/2187722631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffb200ac560 con 0x7ffb200a9a50 2024-02-21T07:45:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f1789600640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f176c09f1b0 0x7f176c0a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f17800c9160 con 0x7f178407e4e0 2024-02-21T07:45:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.835+0000 7f1789600640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f176c0a9ad0 0x7f176c0abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.835+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f176c0ac5e0 con 0x7f176c0a9ad0 2024-02-21T07:45:55.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7f3832e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f382407e290 0x7f382410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7f3832e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3824059420 con 0x7f382407d700 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7f3832e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382410b660 con 0x7f3824107860 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.832+0000 7f3832e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382410b940 con 0x7f382407e290 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.833+0000 7f382be00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3824107860 0x7f3824058d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40862/0 (socket says 172.21.15.100:40862) 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.833+0000 7f382be00640 1 -- 172.21.15.100:0/3558612556 learned_addr learned my addr 172.21.15.100:0/3558612556 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.833+0000 7f3830e00640 1 --2- 172.21.15.100:0/3558612556 >> v2:172.21.15.156:3300/0 conn(0x7f382407e290 0x7f382410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f382aa00640 1 -- 172.21.15.100:0/3558612556 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527645998 0 0) 0x7f382410b660 con 0x7f3824107860 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f382aa00640 1 -- 172.21.15.100:0/3558612556 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3814003520 con 0x7f3824107860 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f3830e00640 1 -- 172.21.15.100:0/3558612556 >> v1:172.21.15.170:6789/0 conn(0x7f3824107860 legacy=0x7f3824058d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f3830e00640 1 -- 172.21.15.100:0/3558612556 >> v1:172.21.15.100:6789/0 conn(0x7f382407d700 legacy=0x7f382407db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:55.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.834+0000 7f3830e00640 1 -- 172.21.15.100:0/3558612556 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382410bc20 con 0x7f382407e290 2024-02-21T07:45:55.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.835+0000 7f1791c00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f176c09f1b0 0x7f176c0a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.835+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f801402c940 con 0x7f801c186b90 2024-02-21T07:45:55.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.835+0000 7f1792600640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f176c0a9ad0 0x7f176c0abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f3830e00640 1 --2- 172.21.15.100:0/3558612556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407e290 0x7f382410d9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f382c0506c0 tx=0x7f382c0a6cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98be2b1677076039 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f382aa00640 1 -- 172.21.15.100:0/3558612556 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0a7b60 con 0x7f382407e290 2024-02-21T07:45:55.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f382aa00640 1 -- 172.21.15.100:0/3558612556 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0a7cc0 con 0x7f382407e290 2024-02-21T07:45:55.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f382aa00640 1 -- 172.21.15.100:0/3558612556 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0af640 con 0x7f382407e290 2024-02-21T07:45:55.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f1791c00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f176c09f1b0 0x7f176c0a1670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f178c04fc90 tx=0x7f178c0ad000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f1792600640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f176c0a9ad0 0x7f176c0abf10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.836+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1780092e70 con 0x7f178407e4e0 2024-02-21T07:45:55.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 -- 172.21.15.100:0/3558612556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407e290 msgr2=0x7f382410d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 --2- 172.21.15.100:0/3558612556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407e290 0x7f382410d9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f382c0506c0 tx=0x7f382c0a6cf0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 -- 172.21.15.100:0/3558612556 shutdown_connections 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 --2- 172.21.15.100:0/3558612556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407e290 0x7f382410d9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 -- 172.21.15.100:0/3558612556 >> 172.21.15.100:0/3558612556 conn(0x7f3824057250 msgr2=0x7f3824057660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 -- 172.21.15.100:0/3558612556 shutdown_connections 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.837+0000 7f3832e00640 1 -- 172.21.15.100:0/3558612556 wait complete. 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.838+0000 7f8012a00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ffc09f280 0x7f7ffc0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.838+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f80140ed090 con 0x7f801c186b90 2024-02-21T07:45:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== osd.7 v2:172.21.15.156:6802/717840990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f176c0ac5e0 con 0x7f176c0a9ad0 2024-02-21T07:45:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f8012a00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7f7ffc0a9c10 0x7f7ffc0ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ffc0ac720 con 0x7f7ffc0a9c10 2024-02-21T07:45:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80140ed440 con 0x7f801c186b90 2024-02-21T07:45:55.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 --> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fade0002d30 con 0x7fade40a9c10 2024-02-21T07:45:55.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f801aa00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ffc09f280 0x7f7ffc0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.839+0000 7f801a000640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7f7ffc0a9c10 0x7f7ffc0ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.840+0000 7fae00c00640 1 -- 172.21.15.100:0/2878326280 <== osd.1 v2:172.21.15.156:6818/499558575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fade0002d30 con 0x7fade40a9c10 2024-02-21T07:45:55.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.840+0000 7f801aa00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ffc09f280 0x7f7ffc0a1740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80080010e0 tx=0x7f8008009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7fade40a9c10 msgr2=0x7fade40ac050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7f3832e00640 1 Processor -- start 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7fade40a9c10 0x7fade40ac050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fade409f280 msgr2=0x7fade40a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fade409f280 0x7fade40a1740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001120 tx=0x7fadf8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 msgr2=0x7fae04172ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 --2- 172.21.15.100:0/2878326280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fadec0053d0 0x7fae04172ea0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fadf000b3c0 tx=0x7fadf000b880 comp rx=0 tx=0).stop 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae09800640 1 -- 172.21.15.100:0/2878326280 reap_dead start 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 shutdown_connections 2024-02-21T07:45:55.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 >> 172.21.15.100:0/2878326280 conn(0x7fae040668b0 msgr2=0x7fae040f5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 shutdown_connections 2024-02-21T07:45:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7fae0b800640 1 -- 172.21.15.100:0/2878326280 wait complete. 2024-02-21T07:45:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7f3832e00640 1 -- start start 2024-02-21T07:45:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 0x7f38241a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f382407e290 0x7f38240f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3824107860 0x7f382410e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824106520 con 0x7f3824107860 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38241056d0 con 0x7f382407d700 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.843+0000 7f3832e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824110900 con 0x7f382407e290 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 0x7f38241a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 0x7f38241a8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34958/0 (socket says 172.21.15.100:34958) 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 -- 172.21.15.100:0/832402256 learned_addr learned my addr 172.21.15.100:0/832402256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 -- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f382407e290 msgr2=0x7f38240f9530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f382407e290 0x7f38240f9530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 -- 172.21.15.100:0/832402256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3824107860 msgr2=0x7f382410e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f382be00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3824107860 0x7f382410e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.845+0000 7f382be00640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c068eb0 con 0x7f382407d700 2024-02-21T07:45:55.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.841+0000 7f801a000640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7f7ffc0a9c10 0x7f7ffc0ac050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.844+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== osd.8 v2:172.21.15.170:6800/2369868004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7ffc0ac720 con 0x7f7ffc0a9c10 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.848+0000 7f382be00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 0x7f38241a8d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f382000c400 tx=0x7f382000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.849+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200074e0 con 0x7f382407d700 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.849+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820007680 con 0x7f382407d700 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.849+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820004a20 con 0x7f382407d700 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.852+0000 7f3832e00640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240f9a70 con 0x7f382407d700 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.852+0000 7f3832e00640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824105b80 con 0x7f382407d700 2024-02-21T07:45:55.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.852+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 --> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffbcc162840 con 0x7ffbac0a9950 2024-02-21T07:45:55.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.853+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3800001030 con 0x7f382407d700 2024-02-21T07:45:55.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.857+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f3820004b80 con 0x7f382407d700 2024-02-21T07:45:55.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.859+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 --> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59f008c230 con 0x7f59cc0a9c50 2024-02-21T07:45:55.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.859+0000 7ffbc2a00640 1 -- 172.21.15.100:0/1910006735 <== osd.4 v2:172.21.15.156:6810/3390829461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffbac0ac460 con 0x7ffbac0a9950 2024-02-21T07:45:55.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.859+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 --> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0a4186120 con 0x7fc0800a9b50 2024-02-21T07:45:55.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.860+0000 7fc09a000640 1 -- 172.21.15.100:0/3223266026 <== osd.6 v2:172.21.15.100:6808/3165398267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc09c001960 con 0x7fc0800a9b50 2024-02-21T07:45:55.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7f59e7e00640 1 -- 172.21.15.100:0/1887835003 <== osd.2 v2:172.21.15.170:6808/2385898437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59e000f0c0 con 0x7f59cc0a9c50 2024-02-21T07:45:55.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7ffbac0a9950 msgr2=0x7ffbac0abd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7ffbac0a9950 0x7ffbac0abd90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbac09f130 msgr2=0x7ffbac0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbac09f130 0x7ffbac0a15f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc001050 tx=0x7ffbbc009070 comp rx=0 tx=0).stop 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbcc158ae0 msgr2=0x7ffbcc06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbd1600640 1 --2- 172.21.15.100:0/1910006735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbcc158ae0 0x7ffbcc06ab60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800fb60 tx=0x7ffbb800d520 comp rx=0 tx=0).stop 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7ffbcb400640 1 -- 172.21.15.100:0/1910006735 reap_dead start 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f59cc0a9c50 msgr2=0x7f59cc0ac090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f59cc0a9c50 0x7f59cc0ac090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.861+0000 7f381fe00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f380c09f200 0x7f380c0a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f59cc09f2b0 msgr2=0x7f59cc0a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f59cc09f2b0 0x7f59cc0a1770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f59e8001460 tx=0x7f59e8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 msgr2=0x7f59f0164e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f6c00640 1 --2- 172.21.15.100:0/1887835003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f59d40051d0 0x7f59f0164e20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59d8007370 tx=0x7f59d8007830 comp rx=0 tx=0).stop 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f59f4c00640 1 -- 172.21.15.100:0/1887835003 reap_dead start 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f38200c9e00 con 0x7f382407d700 2024-02-21T07:45:55.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.862+0000 7f382b400640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f380c09f200 0x7f380c0a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7fc0800a9b50 msgr2=0x7fc0800abf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7fc0a9200640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7fc0800a9b50 0x7fc0800abf90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f381fe00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f380c0a9ba0 0x7f380c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f380c0ac6b0 con 0x7f380c0a9ba0 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38200ca170 con 0x7f382407d700 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f3830e00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f380c0a9ba0 0x7f380c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 shutdown_connections 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 >> 172.21.15.100:0/1887835003 conn(0x7f59f00fe290 msgr2=0x7f59f008cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.863+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc08009f230 msgr2=0x7fc0800a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7fc0a9200640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc08009f230 0x7fc0800a16f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc094000f60 tx=0x7fc0940079b0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 msgr2=0x7fc0a4182720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7fc0a9200640 1 --2- 172.21.15.100:0/3223266026 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc0a4071010 0x7fc0a4182720 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc08c007360 tx=0x7fc08c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7fc0a2800640 1 -- 172.21.15.100:0/3223266026 reap_dead start 2024-02-21T07:45:55.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 shutdown_connections 2024-02-21T07:45:55.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7f59f6c00640 1 -- 172.21.15.100:0/1887835003 wait complete. 2024-02-21T07:45:55.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 shutdown_connections 2024-02-21T07:45:55.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 >> 172.21.15.100:0/1910006735 conn(0x7ffbcc0f64c0 msgr2=0x7ffbcc1907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7f382b400640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f380c09f200 0x7f380c0a16c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38180095d0 tx=0x7f3818006b30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 shutdown_connections 2024-02-21T07:45:55.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.864+0000 7ffbd1600640 1 -- 172.21.15.100:0/1910006735 wait complete. 2024-02-21T07:45:55.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.865+0000 7f3830e00640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f380c0a9ba0 0x7f380c0abfe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:55.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.866+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 shutdown_connections 2024-02-21T07:45:55.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.866+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 >> 172.21.15.100:0/3223266026 conn(0x7fc0a40668b0 msgr2=0x7fc0a408bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.866+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 shutdown_connections 2024-02-21T07:45:55.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.866+0000 7fc0a9200640 1 -- 172.21.15.100:0/3223266026 wait complete. 2024-02-21T07:45:55.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.866+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 --> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5bec06deb0 con 0x7f5bcc0a9b90 2024-02-21T07:45:55.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.868+0000 7f5be8c00640 1 -- 172.21.15.100:0/1843065124 <== osd.0 v2:172.21.15.100:6800/2845630909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5bd80058f0 con 0x7f5bcc0a9b90 2024-02-21T07:45:55.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.869+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== osd.11 v2:172.21.15.170:6824/3451886285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f380c0ac6b0 con 0x7f380c0a9ba0 2024-02-21T07:45:55.914 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T07:45:55.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.875+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7f5bcc0a9b90 msgr2=0x7f5bcc0abfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 --> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1760002d30 con 0x7f176c0a9ad0 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.875+0000 7f5bf3800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7f5bcc0a9b90 0x7f5bcc0abfd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bcc09f280 msgr2=0x7f5bcc0a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f5bf3800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bcc09f280 0x7f5bcc0a1740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009fd0 tx=0x7f5be400b040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 msgr2=0x7f5bec188de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f5bf3800640 1 --2- 172.21.15.100:0/1843065124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bec0f9720 0x7f5bec188de0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0d2730 tx=0x7f5bdc00fc70 comp rx=0 tx=0).stop 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.876+0000 7f5bf1800640 1 -- 172.21.15.100:0/1843065124 reap_dead start 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.877+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 shutdown_connections 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.877+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 >> 172.21.15.100:0/1843065124 conn(0x7f5bec0668b0 msgr2=0x7f5bec1869c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.877+0000 7f1789600640 1 -- 172.21.15.100:0/2086169270 <== osd.7 v2:172.21.15.156:6802/717840990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1760002d30 con 0x7f176c0a9ad0 2024-02-21T07:45:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.877+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 shutdown_connections 2024-02-21T07:45:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.877+0000 7f5bf3800640 1 -- 172.21.15.100:0/1843065124 wait complete. 2024-02-21T07:45:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f176c0a9ad0 msgr2=0x7f176c0abf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 --> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ff4002d30 con 0x7f7ffc0a9c10 2024-02-21T07:45:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f176c0a9ad0 0x7f176c0abf10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f176c09f1b0 msgr2=0x7f176c0a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f176c09f1b0 0x7f176c0a1670 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f178c04fc90 tx=0x7f178c0ad000 comp rx=0 tx=0).stop 2024-02-21T07:45:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f8012a00640 1 -- 172.21.15.100:0/3656768210 <== osd.8 v2:172.21.15.170:6800/2369868004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ff4002d30 con 0x7f7ffc0a9c10 2024-02-21T07:45:55.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178407e4e0 msgr2=0x7f1784079e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.880+0000 7f177ea00640 1 --2- 172.21.15.100:0/2086169270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178407e4e0 0x7f1784079e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178000c410 tx=0x7f178000c8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.881+0000 7f1792600640 1 -- 172.21.15.100:0/2086169270 reap_dead start 2024-02-21T07:45:55.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.883+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 shutdown_connections 2024-02-21T07:45:55.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.883+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 >> 172.21.15.100:0/2086169270 conn(0x7f1784052de0 msgr2=0x7f17840562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.884+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7f7ffc0a9c10 msgr2=0x7f7ffc0ac050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.884+0000 7f801be00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7f7ffc0a9c10 0x7f7ffc0ac050 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.885+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 shutdown_connections 2024-02-21T07:45:55.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.885+0000 7f177ea00640 1 -- 172.21.15.100:0/2086169270 wait complete. 2024-02-21T07:45:55.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.886+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ffc09f280 msgr2=0x7f7ffc0a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.886+0000 7f801be00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ffc09f280 0x7f7ffc0a1740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80080010e0 tx=0x7f8008009040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.886+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 msgr2=0x7f801c224e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.886+0000 7f801be00640 1 --2- 172.21.15.100:0/3656768210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f801c186b90 0x7f801c224e00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8014009d90 tx=0x7f8014004a40 comp rx=0 tx=0).stop 2024-02-21T07:45:55.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.888+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 --> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6dcc002d30 con 0x7f6dd80a9b40 2024-02-21T07:45:55.922 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.890+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 --> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb4408c230 con 0x7ffb200a9a50 2024-02-21T07:45:55.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7ffb3b400640 1 -- 172.21.15.100:0/568096709 <== osd.3 v2:172.21.15.100:6817/2187722631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffb3c00a1f0 con 0x7ffb200a9a50 2024-02-21T07:45:55.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.890+0000 7f801b400640 1 -- 172.21.15.100:0/3656768210 reap_dead start 2024-02-21T07:45:55.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T07:45:55.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 shutdown_connections 2024-02-21T07:45:55.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 >> 172.21.15.100:0/3656768210 conn(0x7f801c0d0330 msgr2=0x7f801c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 shutdown_connections 2024-02-21T07:45:55.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 --> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa128005c90 con 0x7fa128001650 2024-02-21T07:45:55.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.891+0000 7f801be00640 1 -- 172.21.15.100:0/3656768210 wait complete. 2024-02-21T07:45:55.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.892+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7ffb200a9a50 msgr2=0x7ffb200abe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.892+0000 7ffb4a600640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7ffb200a9a50 0x7ffb200abe90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.892+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffb2009f230 msgr2=0x7ffb200a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.892+0000 7fa149600640 1 -- 172.21.15.100:0/2630856191 <== osd.9 v2:172.21.15.100:6816/4180078180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa128005c90 con 0x7fa128001650 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffb2009f230 0x7ffb200a16f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb4416e020 tx=0x7ffb34009040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 msgr2=0x7ffb441623b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 --2- 172.21.15.100:0/568096709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffb280039c0 0x7ffb441623b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c037040 tx=0x7ffb44188a40 comp rx=0 tx=0).stop 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb43e00640 1 -- 172.21.15.100:0/568096709 reap_dead start 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 shutdown_connections 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 >> 172.21.15.100:0/568096709 conn(0x7ffb440fe290 msgr2=0x7ffb4408cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 shutdown_connections 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7ffb4a600640 1 -- 172.21.15.100:0/568096709 wait complete. 2024-02-21T07:45:55.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.893+0000 7f6df3400640 1 -- 172.21.15.100:0/1984032351 <== osd.10 v2:172.21.15.156:6826/196442047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6dcc002d30 con 0x7f6dd80a9b40 2024-02-21T07:45:55.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.895+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f6dd80a9b40 msgr2=0x7f6dd80abf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.895+0000 7f6debe00640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f6dd80a9b40 0x7f6dd80abf80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.928 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 msgr2=0x7f6dd80a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7f6debe00640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec030000 comp rx=0 tx=0).stop 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc189560 msgr2=0x7f6dfc1828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7fa128001650 msgr2=0x7fa128003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7fa154600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7fa128001650 0x7fa128003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.896+0000 7f6debe00640 1 --2- 172.21.15.100:0/1984032351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6dfc189560 0x7f6dfc1828a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6df400c3c0 tx=0x7f6df400c880 comp rx=0 tx=0).stop 2024-02-21T07:45:55.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7f6dfb400640 1 -- 172.21.15.100:0/1984032351 reap_dead start 2024-02-21T07:45:55.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa12c09f1b0 msgr2=0x7fa12c0a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7fa154600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa12c09f1b0 0x7fa12c0a1670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0f9770 tx=0x7fa138008040 comp rx=0 tx=0).stop 2024-02-21T07:45:55.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 shutdown_connections 2024-02-21T07:45:55.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 >> 172.21.15.100:0/1984032351 conn(0x7f6dfc0fe290 msgr2=0x7f6dfc0fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 msgr2=0x7fa14c1829f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7fa154600640 1 --2- 172.21.15.100:0/2630856191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa14c1838e0 0x7fa14c1829f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1400090b0 tx=0x7fa1400046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7fa152600640 1 -- 172.21.15.100:0/2630856191 reap_dead start 2024-02-21T07:45:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.897+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 shutdown_connections 2024-02-21T07:45:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.898+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 shutdown_connections 2024-02-21T07:45:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.898+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 >> 172.21.15.100:0/2630856191 conn(0x7fa14c0668b0 msgr2=0x7fa14c18dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.898+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 shutdown_connections 2024-02-21T07:45:55.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.898+0000 7f6debe00640 1 -- 172.21.15.100:0/1984032351 wait complete. 2024-02-21T07:45:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.898+0000 7fa154600640 1 -- 172.21.15.100:0/2630856191 wait complete. 2024-02-21T07:45:55.934 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T07:45:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.901+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 --> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb388002d30 con 0x7fb3900a9c20 2024-02-21T07:45:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.903+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 --> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3800002d30 con 0x7f380c0a9ba0 2024-02-21T07:45:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.903+0000 7fb3a6a00640 1 -- 172.21.15.100:0/2741977580 <== osd.5 v2:172.21.15.170:6816/106220500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb388002d30 con 0x7fb3900a9c20 2024-02-21T07:45:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.903+0000 7f381fe00640 1 -- 172.21.15.100:0/832402256 <== osd.11 v2:172.21.15.170:6824/3451886285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3800002d30 con 0x7f380c0a9ba0 2024-02-21T07:45:55.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7fb3900a9c20 msgr2=0x7fb3900ac060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7fb3900a9c20 0x7fb3900ac060 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f380c0a9ba0 msgr2=0x7f380c0abfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f380c0a9ba0 0x7f380c0abfe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f380c09f200 msgr2=0x7f380c0a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb39009f280 msgr2=0x7fb3900a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb39009f280 0x7fb3900a1740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3b018db00 tx=0x7fb3a8009250 comp rx=0 tx=0).stop 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 msgr2=0x7fb3b0177bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7fb3afe00640 1 --2- 172.21.15.100:0/2741977580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3b018b280 0x7fb3b0177bd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb39c033000 tx=0x7fb39c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7fb3af400640 1 -- 172.21.15.100:0/2741977580 reap_dead start 2024-02-21T07:45:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f380c09f200 0x7f380c0a16c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f38180095d0 tx=0x7f3818006b30 comp rx=0 tx=0).stop 2024-02-21T07:45:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 shutdown_connections 2024-02-21T07:45:55.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 >> 172.21.15.100:0/2741977580 conn(0x7fb3b00ce150 msgr2=0x7fb3b0071bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.939 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.939 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 msgr2=0x7f38241a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.904+0000 7f381d600640 1 --2- 172.21.15.100:0/832402256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f382407d700 0x7f38241a8d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f382000c400 tx=0x7f382000c8c0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7f3830e00640 1 -- 172.21.15.100:0/832402256 reap_dead start 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 shutdown_connections 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.905+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 >> 172.21.15.100:0/832402256 conn(0x7f3824057250 msgr2=0x7f3824080b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.906+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 shutdown_connections 2024-02-21T07:45:55.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.906+0000 7f381d600640 1 -- 172.21.15.100:0/832402256 wait complete. 2024-02-21T07:45:55.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.906+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 shutdown_connections 2024-02-21T07:45:55.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:55.906+0000 7fb3afe00640 1 -- 172.21.15.100:0/2741977580 wait complete. 2024-02-21T07:45:55.942 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:55.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T07:45:55.943 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:55.944 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T07:45:55.944 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-02-21T07:45:55.945 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-02-21T07:45:55.946 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:55.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-02-21T07:45:55.948 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:55.948 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-02-21T07:45:55.949 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:55.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T07:45:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.302+0000 7f27d2000640 1 Processor -- start 2024-02-21T07:45:56.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.303+0000 7f27d2000640 1 -- start start 2024-02-21T07:45:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.305+0000 7f27d2000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27cc0cecf0 0x7f27cc06fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.305+0000 7f27d2000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f27cc187050 0x7f27cc184b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.305+0000 7f27d2000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc185ea0 con 0x7f27cc17b4c0 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.305+0000 7f27d2000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc186520 con 0x7f27cc0cecf0 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.305+0000 7f27d2000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc071f90 con 0x7f27cc187050 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.306+0000 7f27cb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27cc0cecf0 0x7f27cc06fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.306+0000 7f27cb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27cc0cecf0 0x7f27cc06fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51168/0 (socket says 172.21.15.100:51168) 2024-02-21T07:45:56.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.306+0000 7f27cb400640 1 -- 172.21.15.100:0/574872895 learned_addr learned my addr 172.21.15.100:0/574872895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.307+0000 7f27cbe00640 1 --2- 172.21.15.100:0/574872895 >> v2:172.21.15.170:3300/0 conn(0x7f27cc187050 0x7f27cc184b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.307+0000 7f27cb400640 1 -- 172.21.15.100:0/574872895 >> v2:172.21.15.170:3300/0 conn(0x7f27cc187050 msgr2=0x7f27cc184b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.307+0000 7f27cb400640 1 --2- 172.21.15.100:0/574872895 >> v2:172.21.15.170:3300/0 conn(0x7f27cc187050 0x7f27cc184b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.308+0000 7f68bf600640 1 Processor -- start 2024-02-21T07:45:56.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.309+0000 7f68bf600640 1 -- start start 2024-02-21T07:45:56.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.310+0000 7f27cb400640 1 -- 172.21.15.100:0/574872895 >> v1:172.21.15.100:6789/0 conn(0x7f27cc17b4c0 legacy=0x7f27cc186940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.310+0000 7f27cb400640 1 -- 172.21.15.100:0/574872895 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc0700d0 con 0x7f27cc0cecf0 2024-02-21T07:45:56.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.312+0000 7f68bf600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68b8181f70 0x7f68b806b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.312+0000 7f68bf600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f68b806baa0 0x7f68b81862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.313+0000 7f68bf600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b806ca20 con 0x7f68b8186810 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.313+0000 7f68bf600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b806bf00 con 0x7f68b8181f70 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.313+0000 7f68b7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f68b806baa0 0x7f68b81862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.314+0000 7f68bf600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b806ea40 con 0x7f68b806baa0 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.313+0000 7f68bcc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68b8181f70 0x7f68b806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.314+0000 7f68bcc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68b8181f70 0x7f68b806b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34962/0 (socket says 172.21.15.100:34962) 2024-02-21T07:45:56.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.314+0000 7f68bcc00640 1 -- 172.21.15.100:0/1213739676 learned_addr learned my addr 172.21.15.100:0/1213739676 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.313+0000 7f68be000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f68b8186810 0x7f68b8187af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40878/0 (socket says 172.21.15.100:40878) 2024-02-21T07:45:56.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.315+0000 7f68b7400640 1 -- 172.21.15.100:0/1213739676 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845114447 0 0) 0x7f68b806ca20 con 0x7f68b8186810 2024-02-21T07:45:56.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.315+0000 7f68bcc00640 1 -- 172.21.15.100:0/1213739676 >> v2:172.21.15.170:3300/0 conn(0x7f68b806baa0 msgr2=0x7f68b81862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.315+0000 7f68bcc00640 1 --2- 172.21.15.100:0/1213739676 >> v2:172.21.15.170:3300/0 conn(0x7f68b806baa0 0x7f68b81862d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.315+0000 7f68bcc00640 1 -- 172.21.15.100:0/1213739676 >> v1:172.21.15.170:6789/0 conn(0x7f68b8186810 legacy=0x7f68b8187af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.315+0000 7f68bcc00640 1 -- 172.21.15.100:0/1213739676 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b806c180 con 0x7f68b8181f70 2024-02-21T07:45:56.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.319+0000 7f27cb400640 1 --2- 172.21.15.100:0/574872895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cecf0 0x7f27cc06fa80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27cc1823e0 tx=0x7f27bc02dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f64596a4cc4b052 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.321+0000 7f27ca000640 1 -- 172.21.15.100:0/574872895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc02eab0 con 0x7f27cc0cecf0 2024-02-21T07:45:56.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.321+0000 7f27ca000640 1 -- 172.21.15.100:0/574872895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc032070 con 0x7f27cc0cecf0 2024-02-21T07:45:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.321+0000 7f27ca000640 1 -- 172.21.15.100:0/574872895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc02ee30 con 0x7f27cc0cecf0 2024-02-21T07:45:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 -- 172.21.15.100:0/574872895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cecf0 msgr2=0x7f27cc06fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 --2- 172.21.15.100:0/574872895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cecf0 0x7f27cc06fa80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27cc1823e0 tx=0x7f27bc02dd80 comp rx=0 tx=0).stop 2024-02-21T07:45:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.323+0000 7f68bcc00640 1 --2- 172.21.15.100:0/1213739676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b8181f70 0x7f68b806b560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68b80f6640 tx=0x7f68ac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d965de87fb0106 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 -- 172.21.15.100:0/574872895 shutdown_connections 2024-02-21T07:45:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 --2- 172.21.15.100:0/574872895 >> v2:172.21.15.170:3300/0 conn(0x7f27cc187050 0x7f27cc184b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 --2- 172.21.15.100:0/574872895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cecf0 0x7f27cc06fa80 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27cc1823e0 tx=0x7f27bc02dd80 comp rx=0 tx=0).stop 2024-02-21T07:45:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.322+0000 7f27d2000640 1 -- 172.21.15.100:0/574872895 >> 172.21.15.100:0/574872895 conn(0x7f27cc0ce200 msgr2=0x7f27cc0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.323+0000 7f68b7400640 1 -- 172.21.15.100:0/1213739676 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac030610 con 0x7f68b8181f70 2024-02-21T07:45:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.327+0000 7f68b7400640 1 -- 172.21.15.100:0/1213739676 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac030770 con 0x7f68b8181f70 2024-02-21T07:45:56.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.327+0000 7f68b7400640 1 -- 172.21.15.100:0/1213739676 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac030610 con 0x7f68b8181f70 2024-02-21T07:45:56.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.330+0000 7f27d2000640 1 -- 172.21.15.100:0/574872895 shutdown_connections 2024-02-21T07:45:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.331+0000 7f68bf600640 1 -- 172.21.15.100:0/1213739676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b8181f70 msgr2=0x7f68b806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.331+0000 7f68bf600640 1 --2- 172.21.15.100:0/1213739676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b8181f70 0x7f68b806b560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f68b80f6640 tx=0x7f68ac02b960 comp rx=0 tx=0).stop 2024-02-21T07:45:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.330+0000 7f27d2000640 1 -- 172.21.15.100:0/574872895 wait complete. 2024-02-21T07:45:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 -- 172.21.15.100:0/1213739676 shutdown_connections 2024-02-21T07:45:56.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 --2- 172.21.15.100:0/1213739676 >> v2:172.21.15.170:3300/0 conn(0x7f68b806baa0 0x7f68b81862d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 --2- 172.21.15.100:0/1213739676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b8181f70 0x7f68b806b560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 -- 172.21.15.100:0/1213739676 >> 172.21.15.100:0/1213739676 conn(0x7f68b80ce160 msgr2=0x7f68b80ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 -- 172.21.15.100:0/1213739676 shutdown_connections 2024-02-21T07:45:56.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.332+0000 7f68bf600640 1 -- 172.21.15.100:0/1213739676 wait complete. 2024-02-21T07:45:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.336+0000 7f27d2000640 1 Processor -- start 2024-02-21T07:45:56.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.338+0000 7f27d2000640 1 -- start start 2024-02-21T07:45:56.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.343+0000 7f68bf600640 1 Processor -- start 2024-02-21T07:45:56.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.343+0000 7f68bf600640 1 -- start start 2024-02-21T07:45:56.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.343+0000 7f306ea00640 1 Processor -- start 2024-02-21T07:45:56.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.344+0000 7f306ea00640 1 -- start start 2024-02-21T07:45:56.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.344+0000 7f27d2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.344+0000 7f27d2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27cc187050 0x7f27cc1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7fedc6e00640 1 Processor -- start 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.345+0000 7f27d2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cd240 0x7f27cc0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27cb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43304/0 (socket says 172.21.15.100:43304) 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27caa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27cc187050 0x7f27cc1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27d2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0f8d10 con 0x7f27cc0cd240 2024-02-21T07:45:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0f47b0 con 0x7f27cc187050 2024-02-21T07:45:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0f8190 con 0x7f27cc17b4c0 2024-02-21T07:45:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f27cb400640 1 -- 172.21.15.100:0/579047274 learned_addr learned my addr 172.21.15.100:0/579047274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7fedc6e00640 1 -- start start 2024-02-21T07:45:56.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f306ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3068182850 0x7f3068189ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f27cb400640 1 -- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27cc187050 msgr2=0x7f27cc1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f27cb400640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27cc187050 0x7f27cc1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f27cb400640 1 -- 172.21.15.100:0/579047274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cd240 msgr2=0x7f27cc0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f27cb400640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cd240 0x7f27cc0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.350+0000 7f27cb400640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc00b760 con 0x7f27cc17b4c0 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f30680fc630 0x7f30680d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306ea00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3068182c30 con 0x7f306806c890 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306ea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f306806b8c0 con 0x7f30680fc630 2024-02-21T07:45:56.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306ea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30681897c0 con 0x7f3068182850 2024-02-21T07:45:56.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.349+0000 7f68bf600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f27cb400640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27bc02e310 tx=0x7f27bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f68bf600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 0x7f68b8221e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7fedc6e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedc0071010 0x7fedc00713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7fedbfe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedc0071010 0x7fedc00713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7fedc6e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 0x7fedc006f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7fedc6e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc00700c0 con 0x7fedc0071930 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc038e40 con 0x7f27cc17b4c0 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc006df0 con 0x7f27cc17b4c0 2024-02-21T07:45:56.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0428f0 con 0x7f27cc17b4c0 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3068182850 0x7f3068189ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3068182850 0x7f3068189ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43318/0 (socket says 172.21.15.100:43318) 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.351+0000 7f306d600640 1 -- 172.21.15.100:0/1061402963 learned_addr learned my addr 172.21.15.100:0/1061402963 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f306e000640 1 --2- 172.21.15.100:0/1061402963 >> v2:172.21.15.100:3300/0 conn(0x7f30680fc630 0x7f30680d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378229818 0 0) 0x7f3068182c30 con 0x7f306806c890 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003520 con 0x7f306806c890 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1948254411 0 0) 0x7f3050003520 con 0x7f306806c890 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 >> v2:172.21.15.170:3300/0 conn(0x7f3068182850 msgr2=0x7f3068189ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 --2- 172.21.15.100:0/1061402963 >> v2:172.21.15.170:3300/0 conn(0x7f3068182850 0x7f3068189ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 >> v2:172.21.15.100:3300/0 conn(0x7f30680fc630 msgr2=0x7f30680d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 --2- 172.21.15.100:0/1061402963 >> v2:172.21.15.100:3300/0 conn(0x7f30680fc630 0x7f30680d5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680fcd60 con 0x7f306806c890 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f305c001650 con 0x7f306806c890 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 >> v1:172.21.15.156:6789/0 conn(0x7f306806c890 legacy=0x7f30680fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 0x7f3050003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30500052a0 0x7f305000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306806b8c0 con 0x7f3050003a30 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30681897c0 con 0x7f30500052a0 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305000c270 con 0x7f30500047c0 2024-02-21T07:45:56.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7fedbfe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fedc0071010 0x7fedc00713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34984/0 (socket says 172.21.15.100:34984) 2024-02-21T07:45:56.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7fedc6e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc006fed0 con 0x7fedc0071010 2024-02-21T07:45:56.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7f306e000640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30500052a0 0x7f305000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7fedc6e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc006ea40 con 0x7fedc0071d70 2024-02-21T07:45:56.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7fedbfe00640 1 -- 172.21.15.100:0/159117128 learned_addr learned my addr 172.21.15.100:0/159117128 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f68bcc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7fedc4e00640 1 --2- 172.21.15.100:0/159117128 >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 0x7fedc006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f68bcc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34980/0 (socket says 172.21.15.100:34980) 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f68bcc00640 1 -- 172.21.15.100:0/1359822501 learned_addr learned my addr 172.21.15.100:0/1359822501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.352+0000 7f68b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 0x7f68b8221e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.355+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8186810 0x7f68b81806d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.355+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b817f9a0 con 0x7f68b8181f70 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.355+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b8180240 con 0x7f68b806baa0 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.356+0000 7fedbfe00640 1 -- 172.21.15.100:0/159117128 >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 msgr2=0x7fedc006f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.356+0000 7fedbea00640 1 -- 172.21.15.100:0/159117128 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861118584 0 0) 0x7fedc00700c0 con 0x7fedc0071930 2024-02-21T07:45:56.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.355+0000 7f68be000640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8186810 0x7f68b81806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.356+0000 7fedbfe00640 1 --2- 172.21.15.100:0/159117128 >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 0x7fedc006f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.356+0000 7fedbfe00640 1 -- 172.21.15.100:0/159117128 >> v1:172.21.15.100:6789/0 conn(0x7fedc0071930 legacy=0x7fedc006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.353+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc0f8470 con 0x7f27cc17b4c0 2024-02-21T07:45:56.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.354+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc0f8a30 con 0x7f27cc17b4c0 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.356+0000 7fedbfe00640 1 -- 172.21.15.100:0/159117128 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc00703a0 con 0x7fedc0071010 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.358+0000 7fedc4e00640 1 --2- 172.21.15.100:0/159117128 >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 0x7fedc006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.359+0000 7fedbfe00640 1 --2- 172.21.15.100:0/159117128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071010 0x7fedc00713f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fedc008e020 tx=0x7fedb002e090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f13f6b4f305b9ea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306cc00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 0x7f3050003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 -- 172.21.15.100:0/1061402963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30500047c0 msgr2=0x7f3050004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30500047c0 0x7f3050004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 -- 172.21.15.100:0/1061402963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30500052a0 msgr2=0x7f305000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30500052a0 0x7f305000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.357+0000 7f306d600640 1 -- 172.21.15.100:0/1061402963 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050003520 con 0x7f3050003a30 2024-02-21T07:45:56.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.358+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80cdb00 con 0x7f68b8186810 2024-02-21T07:45:56.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.359+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc0751d0 con 0x7f27cc17b4c0 2024-02-21T07:45:56.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.359+0000 7f306e000640 1 -- 172.21.15.100:0/1061402963 reap_dead start 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68b7e00640 1 -- 172.21.15.100:0/1359822501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8186810 msgr2=0x7f68b81806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68b7e00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8186810 0x7f68b81806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68b7e00640 1 -- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 msgr2=0x7f68b8164ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68b7e00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68b7e00640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0094d0 con 0x7f68b8181f70 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.360+0000 7f68bcc00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.361+0000 7f68b7e00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 0x7f68b8221e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d520 tx=0x7f68a400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.362+0000 7f306d600640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 0x7f3050003e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30540098a0 tx=0x7f30500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c326df0d4d76f6c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.362+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4021480 con 0x7f68b8181f70 2024-02-21T07:45:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7fedbea00640 1 -- 172.21.15.100:0/159117128 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb002ee40 con 0x7fedc0071010 2024-02-21T07:45:56.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.362+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054030660 con 0x7f3050003a30 2024-02-21T07:45:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7f1771a00640 1 Processor -- start 2024-02-21T07:45:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7fedbea00640 1 -- 172.21.15.100:0/159117128 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0032070 con 0x7fedc0071010 2024-02-21T07:45:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7fedbea00640 1 -- 172.21.15.100:0/159117128 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0038620 con 0x7fedc0071010 2024-02-21T07:45:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a401a070 con 0x7f68b8181f70 2024-02-21T07:45:56.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4021800 con 0x7f68b8181f70 2024-02-21T07:45:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7f1771a00640 1 -- start start 2024-02-21T07:45:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.365+0000 7fedc6e00640 1 -- 172.21.15.100:0/159117128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071010 msgr2=0x7fedc00713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.365+0000 7fedc6e00640 1 --2- 172.21.15.100:0/159117128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071010 0x7fedc00713f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fedc008e020 tx=0x7fedb002e090 comp rx=0 tx=0).stop 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.363+0000 7f3067e00640 1 -- 172.21.15.100:0/1061402963 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540307c0 con 0x7f3050003a30 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7f306ea00640 1 -- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 msgr2=0x7f3050003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7f306ea00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 0x7f3050003e70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30540098a0 tx=0x7f30500057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b80cdde0 con 0x7f68b8181f70 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7fedc6e00640 1 -- 172.21.15.100:0/159117128 shutdown_connections 2024-02-21T07:45:56.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7fedc6e00640 1 --2- 172.21.15.100:0/159117128 >> v2:172.21.15.170:3300/0 conn(0x7fedc0071d70 0x7fedc006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7fedc6e00640 1 --2- 172.21.15.100:0/159117128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071010 0x7fedc00713f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7fedc6e00640 1 -- 172.21.15.100:0/159117128 >> 172.21.15.100:0/159117128 conn(0x7fedc00668b0 msgr2=0x7fedc0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.364+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b817fed0 con 0x7f68b8181f70 2024-02-21T07:45:56.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7f306ea00640 1 -- 172.21.15.100:0/1061402963 shutdown_connections 2024-02-21T07:45:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7f306ea00640 1 --2- 172.21.15.100:0/1061402963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3050003a30 0x7f3050003e70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7f306ea00640 1 -- 172.21.15.100:0/1061402963 >> 172.21.15.100:0/1061402963 conn(0x7f30680fe020 msgr2=0x7f30680fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.367+0000 7fedc6e00640 1 -- 172.21.15.100:0/159117128 shutdown_connections 2024-02-21T07:45:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.366+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6894005290 con 0x7f68b8181f70 2024-02-21T07:45:56.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.367+0000 7fedc6e00640 1 -- 172.21.15.100:0/159117128 wait complete. 2024-02-21T07:45:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.367+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f27bc042a50 con 0x7f27cc17b4c0 2024-02-21T07:45:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.369+0000 7f27c3400640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 0x7f27ac0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.370+0000 7f306ea00640 1 -- 172.21.15.100:0/1061402963 shutdown_connections 2024-02-21T07:45:56.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.370+0000 7f306ea00640 1 -- 172.21.15.100:0/1061402963 wait complete. 2024-02-21T07:45:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.370+0000 7fedc6e00640 1 Processor -- start 2024-02-21T07:45:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.370+0000 7fedc6e00640 1 -- start start 2024-02-21T07:45:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.369+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f27bc0ef860 con 0x7f27cc17b4c0 2024-02-21T07:45:56.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.371+0000 7f27caa00640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 0x7f27ac0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0071010 0x7fedc022c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071930 0x7fedc0222070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc021f190 con 0x7fedc0071010 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0220fd0 con 0x7fedc0071930 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7fedc6e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc02212b0 con 0x7fedc0158ce0 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43362/0 (socket says 172.21.15.100:43362) 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 -- 172.21.15.100:0/457704200 learned_addr learned my addr 172.21.15.100:0/457704200 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.372+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27bc0b9600 con 0x7f27cc17b4c0 2024-02-21T07:45:56.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7f27caa00640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 0x7f27ac0a1740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27cc160980 tx=0x7f27b8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7f1771a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f176c18a4a0 0x7f176c070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f176c071450 0x7f176c18ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f176c18b0b0 0x7f176c06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c06ed10 con 0x7f176c18a4a0 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c18a880 con 0x7f176c071450 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c06ddb0 con 0x7f176c18b0b0 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f176c18b0b0 0x7f176c06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f176c18b0b0 0x7f176c06f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43374/0 (socket says 172.21.15.100:43374) 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.374+0000 7f1771000640 1 -- 172.21.15.100:0/1225168595 learned_addr learned my addr 172.21.15.100:0/1225168595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 -- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071930 msgr2=0x7fedc0222070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:56.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071930 0x7fedc0222070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 -- 172.21.15.100:0/457704200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0071010 msgr2=0x7fedc022c9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:56.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0071010 0x7fedc022c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7fedc4e00640 1 -- 172.21.15.100:0/457704200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0008550 con 0x7fedc0158ce0 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.379+0000 7fedc4e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007dc0 tx=0x7fedb800d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.375+0000 7f1771000640 1 -- 172.21.15.100:0/1225168595 >> v2:172.21.15.156:3300/0 conn(0x7f176c071450 msgr2=0x7f176c18ab70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.375+0000 7f1771000640 1 --2- 172.21.15.100:0/1225168595 >> v2:172.21.15.156:3300/0 conn(0x7f176c071450 0x7f176c18ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.375+0000 7f1771000640 1 -- 172.21.15.100:0/1225168595 >> v2:172.21.15.100:3300/0 conn(0x7f176c18a4a0 msgr2=0x7f176c070f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.375+0000 7f1771000640 1 --2- 172.21.15.100:0/1225168595 >> v2:172.21.15.100:3300/0 conn(0x7f176c18a4a0 0x7f176c070f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.375+0000 7f1771000640 1 -- 172.21.15.100:0/1225168595 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c06e090 con 0x7f176c18b0b0 2024-02-21T07:45:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.379+0000 7f1771000640 1 --2- 172.21.15.100:0/1225168595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c06f180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f176c0f9030 tx=0x7f175802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e0c5b15222fcc32 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.373+0000 7f306ea00640 1 Processor -- start 2024-02-21T07:45:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.380+0000 7f5543400640 1 Processor -- start 2024-02-21T07:45:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.381+0000 7f5543400640 1 -- start start 2024-02-21T07:45:56.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.381+0000 7f306ea00640 1 -- start start 2024-02-21T07:45:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.382+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8003990 con 0x7fedc0158ce0 2024-02-21T07:45:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.384+0000 7f5543400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 0x7f553410d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.381+0000 7f176aa00640 1 -- 172.21.15.100:0/1225168595 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175802e070 con 0x7f176c18b0b0 2024-02-21T07:45:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.385+0000 7f5543400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f553410a210 0x7f553410ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.385+0000 7f5543400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553410a640 con 0x7f553410d7b0 2024-02-21T07:45:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.385+0000 7f176aa00640 1 -- 172.21.15.100:0/1225168595 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17580315a0 con 0x7f176c18b0b0 2024-02-21T07:45:56.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.385+0000 7f176aa00640 1 -- 172.21.15.100:0/1225168595 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758031930 con 0x7f176c18b0b0 2024-02-21T07:45:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f553be00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f553410d7b0 0x7f5534109b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50380/0 (socket says 172.21.15.100:50380) 2024-02-21T07:45:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.385+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f68a4021960 con 0x7f68b8181f70 2024-02-21T07:45:56.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.382+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800f040 con 0x7fedc0158ce0 2024-02-21T07:45:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5543400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5534054230 con 0x7f553410a210 2024-02-21T07:45:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5540a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 0x7f553410d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5540a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 0x7f553410d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35016/0 (socket says 172.21.15.100:35016) 2024-02-21T07:45:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5540a00640 1 -- 172.21.15.100:0/3319112285 learned_addr learned my addr 172.21.15.100:0/3319112285 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8003d30 con 0x7fedc0158ce0 2024-02-21T07:45:56.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc0221590 con 0x7fedc0158ce0 2024-02-21T07:45:56.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5534054510 con 0x7f5534109720 2024-02-21T07:45:56.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.386+0000 7f5541400640 1 --2- 172.21.15.100:0/3319112285 >> v2:172.21.15.100:3300/0 conn(0x7f553410a210 0x7f553410ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.387+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc0221b50 con 0x7fedc0158ce0 2024-02-21T07:45:56.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.387+0000 7f553b400640 1 -- 172.21.15.100:0/3319112285 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777159029 0 0) 0x7f5530001110 con 0x7f553410d7b0 2024-02-21T07:45:56.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.388+0000 7f553b400640 1 -- 172.21.15.100:0/3319112285 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5524003520 con 0x7f553410d7b0 2024-02-21T07:45:56.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7f306ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.388+0000 7f5541400640 1 -- 172.21.15.100:0/3319112285 >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 msgr2=0x7f553410d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.388+0000 7f5541400640 1 --2- 172.21.15.100:0/3319112285 >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 0x7f553410d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.388+0000 7f5541400640 1 -- 172.21.15.100:0/3319112285 >> v1:172.21.15.156:6789/0 conn(0x7f553410d7b0 legacy=0x7f5534109b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.388+0000 7f5541400640 1 -- 172.21.15.100:0/3319112285 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340547f0 con 0x7f553410a210 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7f306ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30681721c0 0x7f306821fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7f306ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7f306d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7f306d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43384/0 (socket says 172.21.15.100:43384) 2024-02-21T07:45:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f68b4c00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 0x7f68980a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f5541400640 1 --2- 172.21.15.100:0/3319112285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553410ac30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f553c064670 tx=0x7f553c0a70c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5615ffac245f6cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f306e000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f306e000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35030/0 (socket says 172.21.15.100:35030) 2024-02-21T07:45:56.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f1771a00640 1 -- 172.21.15.100:0/1225168595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 msgr2=0x7f176c06f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.390+0000 7f1771a00640 1 --2- 172.21.15.100:0/1225168595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c06f180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f176c0f9030 tx=0x7f175802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:56.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f306d600640 1 -- 172.21.15.100:0/2701327031 learned_addr learned my addr 172.21.15.100:0/2701327031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f553b400640 1 -- 172.21.15.100:0/3319112285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0a7d20 con 0x7f553410a210 2024-02-21T07:45:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f553b400640 1 -- 172.21.15.100:0/3319112285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0a7e80 con 0x7f553410a210 2024-02-21T07:45:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f553b400640 1 -- 172.21.15.100:0/3319112285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0af640 con 0x7f553410a210 2024-02-21T07:45:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f68a401c070 con 0x7f68b8181f70 2024-02-21T07:45:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7fade8200640 1 Processor -- start 2024-02-21T07:45:56.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f68bcc00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 0x7f68980a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f68a40d2410 con 0x7f68b8181f70 2024-02-21T07:45:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.389+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc0067c80 con 0x7fedc0158ce0 2024-02-21T07:45:56.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7fade8200640 1 -- start start 2024-02-21T07:45:56.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680cfbd0 con 0x7f30681721c0 2024-02-21T07:45:56.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680ce9a0 con 0x7f3068172640 2024-02-21T07:45:56.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30680cec70 con 0x7f3050003a30 2024-02-21T07:45:56.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 msgr2=0x7f553410ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7f5543400640 1 --2- 172.21.15.100:0/3319112285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553410ac30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f553c064670 tx=0x7f553c0a70c0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.393+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 shutdown_connections 2024-02-21T07:45:56.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.393+0000 7f5543400640 1 --2- 172.21.15.100:0/3319112285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553410ac30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.393+0000 7f306cc00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30681721c0 0x7f306821fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.394+0000 7f5543400640 1 --2- 172.21.15.100:0/3319112285 >> v2:172.21.15.156:3300/0 conn(0x7f5534109720 0x7f553410d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.394+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 >> 172.21.15.100:0/3319112285 conn(0x7f5534052e10 msgr2=0x7f5534053220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.392+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fedb8004030 con 0x7fedc0158ce0 2024-02-21T07:45:56.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.394+0000 7fedb7e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 0x7feda00a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.395+0000 7fedbfe00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 0x7feda00a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.394+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 shutdown_connections 2024-02-21T07:45:56.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.394+0000 7f5543400640 1 -- 172.21.15.100:0/3319112285 wait complete. 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f1771a00640 1 -- 172.21.15.100:0/1225168595 shutdown_connections 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f1771a00640 1 --2- 172.21.15.100:0/1225168595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c06f180 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f1771a00640 1 --2- 172.21.15.100:0/1225168595 >> v2:172.21.15.156:3300/0 conn(0x7f176c071450 0x7f176c18ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f1771a00640 1 --2- 172.21.15.100:0/1225168595 >> v2:172.21.15.100:3300/0 conn(0x7f176c18a4a0 0x7f176c070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.391+0000 7f1771a00640 1 -- 172.21.15.100:0/1225168595 >> 172.21.15.100:0/1225168595 conn(0x7f176c0ce150 msgr2=0x7f176c0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.395+0000 7f68bcc00640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 0x7f68980a16a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0090b0 tx=0x7f68ac03b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fedb80983b0 con 0x7fedc0158ce0 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fade8200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 0x7fade0188840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fade8200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fade0189d30 0x7fade00ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fade8200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade0188d80 con 0x7fade00ed4f0 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fade8200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade0070c50 con 0x7fade017f4e0 2024-02-21T07:45:56.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fade8200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade0189010 con 0x7fade0189d30 2024-02-21T07:45:56.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.396+0000 7fedbfe00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 0x7feda00a16f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fedb0039000 tx=0x7fedb0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7fade4e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fade0189d30 0x7fade00ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7fade4e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fade0189d30 0x7fade00ecfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43392/0 (socket says 172.21.15.100:43392) 2024-02-21T07:45:56.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7fade4e00640 1 -- 172.21.15.100:0/3763667918 learned_addr learned my addr 172.21.15.100:0/3763667918 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7fade5800640 1 --2- 172.21.15.100:0/3763667918 >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 0x7fade0188840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fedb80946e0 con 0x7fedc0158ce0 2024-02-21T07:45:56.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7f306d600640 1 -- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 msgr2=0x7f306821ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7f306d600640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7f306d600640 1 -- 172.21.15.100:0/2701327031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30681721c0 msgr2=0x7f306821fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.397+0000 7f306d600640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30681721c0 0x7f306821fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.398+0000 7f306d600640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680cef50 con 0x7f3050003a30 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.398+0000 7f306e000640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.398+0000 7f306d600640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f305402bfc0 tx=0x7f3054004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.398+0000 7f5543400640 1 Processor -- start 2024-02-21T07:45:56.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.399+0000 7f5543400640 1 -- start start 2024-02-21T07:45:56.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.399+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054030660 con 0x7f3050003a30 2024-02-21T07:45:56.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.395+0000 7f1771a00640 1 -- 172.21.15.100:0/1225168595 shutdown_connections 2024-02-21T07:45:56.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.398+0000 7f1771a00640 1 -- 172.21.15.100:0/1225168595 wait complete. 2024-02-21T07:45:56.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305403f040 con 0x7f3050003a30 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054004240 con 0x7f3050003a30 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.401+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680cf230 con 0x7f3050003a30 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.401+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680cf7f0 con 0x7f3050003a30 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.402+0000 7f5543400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5534109720 0x7f553404dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.402+0000 7f5543400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553407d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7f5543400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7fade4e00640 1 -- 172.21.15.100:0/3763667918 >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 msgr2=0x7fade0188840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7fade4e00640 1 --2- 172.21.15.100:0/3763667918 >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 0x7fade0188840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7fade4e00640 1 -- 172.21.15.100:0/3763667918 >> v1:172.21.15.170:6789/0 conn(0x7fade00ed4f0 legacy=0x7fade00f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.400+0000 7fade4e00640 1 -- 172.21.15.100:0/3763667918 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade01892f0 con 0x7fade0189d30 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7fade5800640 1 --2- 172.21.15.100:0/3763667918 >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 0x7fade0188840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:56.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7f5543400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553404e120 con 0x7f553410a210 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7f5541400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7f5541400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43402/0 (socket says 172.21.15.100:43402) 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.403+0000 7f5541400640 1 -- 172.21.15.100:0/2571095006 learned_addr learned my addr 172.21.15.100:0/2571095006 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5540a00640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5534109720 0x7f553404dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534072d80 con 0x7f5534109720 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534072470 con 0x7f553410d7b0 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7fade4e00640 1 --2- 172.21.15.100:0/3763667918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0189d30 0x7fade00ecfb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fade00f5f30 tx=0x7fadcc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8830993f3c79e073 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f553be00640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553407d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7faddfe00640 1 -- 172.21.15.100:0/3763667918 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc031830 con 0x7fade0189d30 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5541400640 1 -- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5534109720 msgr2=0x7f553404dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5541400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5534109720 0x7f553404dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5541400640 1 -- 172.21.15.100:0/2571095006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 msgr2=0x7f553407d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5541400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553407d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.404+0000 7f5541400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c068eb0 con 0x7f553410d7b0 2024-02-21T07:45:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.405+0000 7faddfe00640 1 -- 172.21.15.100:0/3763667918 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc031990 con 0x7fade0189d30 2024-02-21T07:45:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.405+0000 7faddfe00640 1 -- 172.21.15.100:0/3763667918 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc031830 con 0x7fade0189d30 2024-02-21T07:45:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.405+0000 7f1771a00640 1 Processor -- start 2024-02-21T07:45:56.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.405+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306821f8d0 con 0x7f3050003a30 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.406+0000 7f1771a00640 1 -- start start 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 0x7f176c172e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c0f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0f4f80 con 0x7f176c071450 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0f5220 con 0x7f176c18a4a0 2024-02-21T07:45:56.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f1771a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0f5500 con 0x7f176c18b0b0 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.408+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f30540043a0 con 0x7f3050003a30 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.409+0000 7f1771000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c0f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.410+0000 7f176b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.410+0000 7f176b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35058/0 (socket says 172.21.15.100:35058) 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.410+0000 7f176b400640 1 -- 172.21.15.100:0/3509270337 learned_addr learned my addr 172.21.15.100:0/3509270337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.410+0000 7f176be00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 0x7f176c172e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.411+0000 7f5541400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f553c000b60 tx=0x7f553c0a9070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.409+0000 7fade8200640 1 -- 172.21.15.100:0/3763667918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0189d30 msgr2=0x7fade00ecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.409+0000 7fade8200640 1 --2- 172.21.15.100:0/3763667918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0189d30 0x7fade00ecfb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fade00f5f30 tx=0x7fadcc02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f1771000640 1 -- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 msgr2=0x7f176c0f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f3065600640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 0x7f30480a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f30540ebe40 con 0x7f3050003a30 2024-02-21T07:45:56.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.415+0000 7f306cc00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 0x7f30480a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.418+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30540ec220 con 0x7f3050003a30 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.411+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0af440 con 0x7f553410d7b0 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55340f5dc0 con 0x7f553410d7b0 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0af5a0 con 0x7f553410d7b0 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0af440 con 0x7f553410d7b0 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.415+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5534072730 con 0x7f553410d7b0 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7fade8200640 1 -- 172.21.15.100:0/3763667918 shutdown_connections 2024-02-21T07:45:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7fade8200640 1 --2- 172.21.15.100:0/3763667918 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0189d30 0x7fade00ecfb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7fade8200640 1 --2- 172.21.15.100:0/3763667918 >> v2:172.21.15.100:3300/0 conn(0x7fade017f4e0 0x7fade0188840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7fade8200640 1 -- 172.21.15.100:0/3763667918 >> 172.21.15.100:0/3763667918 conn(0x7fade00668b0 msgr2=0x7fade0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f1771000640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f1771000640 1 -- 172.21.15.100:0/3509270337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 msgr2=0x7f176c172e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f1771000640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 0x7f176c172e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.412+0000 7f1771000640 1 -- 172.21.15.100:0/3509270337 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580094d0 con 0x7f176c18b0b0 2024-02-21T07:45:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f1771000640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c0f4a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1758033000 tx=0x7f17580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f176b400640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758032840 con 0x7f176c18b0b0 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f176be00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 0x7f176c172e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0f57e0 con 0x7f176c18b0b0 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.413+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0f5da0 con 0x7f176c18b0b0 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.415+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c0f5f60 con 0x7f176c18b0b0 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.415+0000 7fade8200640 1 -- 172.21.15.100:0/3763667918 shutdown_connections 2024-02-21T07:45:56.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.416+0000 7fade8200640 1 -- 172.21.15.100:0/3763667918 wait complete. 2024-02-21T07:45:56.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.418+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5534009b20 con 0x7f553410d7b0 2024-02-21T07:45:56.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.418+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17580329a0 con 0x7f176c18b0b0 2024-02-21T07:45:56.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.419+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758032d10 con 0x7f176c18b0b0 2024-02-21T07:45:56.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.420+0000 7f306cc00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 0x7f30480a1770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f306817ae40 tx=0x7f305c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.420+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f553c0af750 con 0x7f553410d7b0 2024-02-21T07:45:56.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.422+0000 7fade8200640 1 Processor -- start 2024-02-21T07:45:56.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.422+0000 7fade8200640 1 -- start start 2024-02-21T07:45:56.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.423+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1758005990 con 0x7f176c18b0b0 2024-02-21T07:45:56.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.424+0000 7fade8200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade00ed4f0 0x7fade02265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade8200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade8200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 0x7fade0169070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade8200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0225040 con 0x7fade00ed4f0 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade8200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0226150 con 0x7fade0189d30 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade8200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0225260 con 0x7fade017f4e0 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.425+0000 7fade4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.426+0000 7fade4e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43422/0 (socket says 172.21.15.100:43422) 2024-02-21T07:45:56.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.426+0000 7fade4e00640 1 -- 172.21.15.100:0/2752790502 learned_addr learned my addr 172.21.15.100:0/2752790502 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.426+0000 7f5538c00640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 0x7f551c0a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.426+0000 7f5540a00640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 0x7f551c0a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.426+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f553c16a320 con 0x7f553410d7b0 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade4e00640 1 -- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 msgr2=0x7fade0169070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade6200640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 0x7fade0169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade4e00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 0x7fade0169070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade4e00640 1 -- 172.21.15.100:0/2752790502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade00ed4f0 msgr2=0x7fade02265e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade4e00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade00ed4f0 0x7fade02265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade4e00640 1 -- 172.21.15.100:0/2752790502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009400 con 0x7fade017f4e0 2024-02-21T07:45:56.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.427+0000 7fade6200640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 0x7fade0169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.428+0000 7f5540a00640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 0x7f551c0a16d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55340ed950 tx=0x7f5528008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.428+0000 7fade4e00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fadcc02b910 tx=0x7fadcc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.428+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc031830 con 0x7fade017f4e0 2024-02-21T07:45:56.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.428+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc03a9e0 con 0x7fade017f4e0 2024-02-21T07:45:56.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.428+0000 7f1763e00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 0x7f174c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.429+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc03adb0 con 0x7fade017f4e0 2024-02-21T07:45:56.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.429+0000 7fade8200640 1 -- 172.21.15.100:0/2752790502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc0094d0 con 0x7fade017f4e0 2024-02-21T07:45:56.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.429+0000 7fade8200640 1 -- 172.21.15.100:0/2752790502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade0225820 con 0x7fade017f4e0 2024-02-21T07:45:56.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.429+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f17580ebd80 con 0x7f176c18b0b0 2024-02-21T07:45:56.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.429+0000 7f176be00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 0x7f174c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.430+0000 7fa483e00640 1 Processor -- start 2024-02-21T07:45:56.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.430+0000 7f176be00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 0x7f174c0a15f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1764009fc0 tx=0x7f1764009550 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.430+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f17580ec260 con 0x7f176c18b0b0 2024-02-21T07:45:56.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.432+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f553c134150 con 0x7f553410d7b0 2024-02-21T07:45:56.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.430+0000 7fa483e00640 1 -- start start 2024-02-21T07:45:56.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.433+0000 7fa483e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa484185cd0 0x7fa4841860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.433+0000 7fa483e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48408cff0 con 0x7fa4840fa350 2024-02-21T07:45:56.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.433+0000 7fa483e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48406bab0 con 0x7fa484188be0 2024-02-21T07:45:56.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.433+0000 7fa483e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48406bd90 con 0x7fa484185cd0 2024-02-21T07:45:56.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.430+0000 7fade8200640 1 -- 172.21.15.100:0/2752790502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade00f4170 con 0x7fade017f4e0 2024-02-21T07:45:56.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.435+0000 7fa483400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa484188be0 0x7fa484189030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:50388/0 (socket says 172.21.15.100:50388) 2024-02-21T07:45:56.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.435+0000 7fa483400640 1 -- 172.21.15.100:0/3105078250 learned_addr learned my addr 172.21.15.100:0/3105078250 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:56.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa482a00640 1 --2- 172.21.15.100:0/3105078250 >> v2:172.21.15.156:3300/0 conn(0x7fa484185cd0 0x7fa4841860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514272022 0 0) 0x7fa48406bab0 con 0x7fa484188be0 2024-02-21T07:45:56.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa468003520 con 0x7fa484188be0 2024-02-21T07:45:56.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835836339 0 0) 0x7fa468003520 con 0x7fa484188be0 2024-02-21T07:45:56.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fda29600640 1 Processor -- start 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 >> v2:172.21.15.156:3300/0 conn(0x7fa484185cd0 msgr2=0x7fa4841860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 --2- 172.21.15.100:0/3105078250 >> v2:172.21.15.156:3300/0 conn(0x7fa484185cd0 0x7fa4841860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 >> v1:172.21.15.100:6789/0 conn(0x7fa4840fa350 legacy=0x7fa4840d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840f9590 con 0x7fa484188be0 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fa47c0019f0 con 0x7fa484188be0 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 >> v1:172.21.15.156:6789/0 conn(0x7fa484188be0 legacy=0x7fa484189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.436+0000 7fa481600640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4680039c0 0x7fa468003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa481600640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa481600640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48406bd90 con 0x7fa4680052a0 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c1a0 con 0x7fa4680039c0 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46800c360 con 0x7fa4680047c0 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa482a00640 1 --2- 172.21.15.100:0/3105078250 >> v2:172.21.15.156:3300/0 conn(0x7fa484185cd0 0x7fa4841860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa482000640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fda29600640 1 -- start start 2024-02-21T07:45:56.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa483400640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.437+0000 7fa482a00640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4680039c0 0x7fa468003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7f1dd3200640 1 Processor -- start 2024-02-21T07:45:56.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa483400640 1 -- 172.21.15.100:0/3105078250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4680047c0 msgr2=0x7fa468004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa483400640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4680047c0 0x7fa468004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa483400640 1 -- 172.21.15.100:0/3105078250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4680039c0 msgr2=0x7fa468003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa483400640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4680039c0 0x7fa468003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa483400640 1 -- 172.21.15.100:0/3105078250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840f9590 con 0x7fa4680052a0 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7f1dd3200640 1 -- start start 2024-02-21T07:45:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.438+0000 7fa482a00640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4680039c0 0x7fa468003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.439+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fadcc04d450 con 0x7fade017f4e0 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fda29600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda24071010 0x7fda240713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fa483400640 1 -- 172.21.15.100:0/3105078250 reap_dead start 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fda29600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fda24071930 0x7fda2406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fda29600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda240700c0 con 0x7fda24071d70 2024-02-21T07:45:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fda29600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2406fed0 con 0x7fda24071010 2024-02-21T07:45:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.440+0000 7fda29600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2406ea40 con 0x7fda24071930 2024-02-21T07:45:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.441+0000 7f1dd3200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1dcc106f70 0x7f1dcc054380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.442+0000 7f1dd3200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 0x7f1dcc1085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.442+0000 7f1dd3200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc108b20 con 0x7f1dcc0548c0 2024-02-21T07:45:56.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.443+0000 7f1dd3200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc07aaf0 con 0x7f1dcc106f70 2024-02-21T07:45:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.443+0000 7f1dd3200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc107ab0 con 0x7f1dcc054d50 2024-02-21T07:45:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.443+0000 7f1dd2800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 0x7f1dcc1085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7f1dd2800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 0x7f1dcc1085e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35112/0 (socket says 172.21.15.100:35112) 2024-02-21T07:45:56.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7fa483400640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a880 tx=0x7fa4680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20aa1da07e8ae8b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7f1dd1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1dcc106f70 0x7f1dcc054380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c034630 con 0x7fa4680052a0 2024-02-21T07:45:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.445+0000 7fa481600640 1 -- 172.21.15.100:0/3105078250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c02f070 con 0x7fa4680052a0 2024-02-21T07:45:56.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7f1dd1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1dcc106f70 0x7f1dcc054380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51286/0 (socket says 172.21.15.100:51286) 2024-02-21T07:45:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.444+0000 7f1dd1e00640 1 -- 172.21.15.100:0/4080947690 learned_addr learned my addr 172.21.15.100:0/4080947690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.445+0000 7fda23400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fda24071d70 0x7fda2406f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40396/0 (socket says 172.21.15.100:40396) 2024-02-21T07:45:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.445+0000 7fda23400640 1 -- 172.21.15.100:0/3847141460 learned_addr learned my addr 172.21.15.100:0/3847141460 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.445+0000 7fda22000640 1 --2- 172.21.15.100:0/3847141460 >> v2:172.21.15.156:3300/0 conn(0x7fda24071930 0x7fda2406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fda22a00640 1 --2- 172.21.15.100:0/3847141460 >> v2:172.21.15.100:3300/0 conn(0x7fda24071010 0x7fda240713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7f1dd1e00640 1 -- 172.21.15.100:0/4080947690 >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 msgr2=0x7f1dcc1085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 -- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 msgr2=0x7fa46800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00a880 tx=0x7fa4680057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7f1dd1e00640 1 --2- 172.21.15.100:0/4080947690 >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 0x7f1dcc1085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7f1dd1e00640 1 -- 172.21.15.100:0/4080947690 >> v1:172.21.15.170:6789/0 conn(0x7f1dcc0548c0 legacy=0x7f1dcc107ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 -- 172.21.15.100:0/3105078250 shutdown_connections 2024-02-21T07:45:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 --2- 172.21.15.100:0/3105078250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa46800b980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 -- 172.21.15.100:0/3105078250 >> 172.21.15.100:0/3105078250 conn(0x7fa4840fe060 msgr2=0x7fa4840fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7f1dd1e00640 1 -- 172.21.15.100:0/4080947690 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc10a590 con 0x7f1dcc106f70 2024-02-21T07:45:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 -- 172.21.15.100:0/3105078250 shutdown_connections 2024-02-21T07:45:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fa483e00640 1 -- 172.21.15.100:0/3105078250 wait complete. 2024-02-21T07:45:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.443+0000 7faddd600640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 0x7fadc00a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.443+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fadcc0ebd00 con 0x7fade017f4e0 2024-02-21T07:45:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fda22a00640 1 -- 172.21.15.100:0/3847141460 >> v2:172.21.15.156:3300/0 conn(0x7fda24071930 msgr2=0x7fda2406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fda22a00640 1 --2- 172.21.15.100:0/3847141460 >> v2:172.21.15.156:3300/0 conn(0x7fda24071930 0x7fda2406f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.446+0000 7fda22a00640 1 -- 172.21.15.100:0/3847141460 >> v1:172.21.15.100:6789/0 conn(0x7fda24071d70 legacy=0x7fda2406f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.447+0000 7fda22a00640 1 -- 172.21.15.100:0/3847141460 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240703a0 con 0x7fda24071010 2024-02-21T07:45:56.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.449+0000 7fda22a00640 1 --2- 172.21.15.100:0/3847141460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda24071010 0x7fda240713f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda24074b70 tx=0x7fda1000ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb5dead5388fafb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.448+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fadcc0b5900 con 0x7fade017f4e0 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.448+0000 7f1dd1e00640 1 --2- 172.21.15.100:0/4080947690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc054380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c500 tx=0x7f1dc402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af29e58e1296c5e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.448+0000 7f1dd0a00640 1 -- 172.21.15.100:0/4080947690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40317e0 con 0x7f1dcc106f70 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.448+0000 7f1dd0a00640 1 -- 172.21.15.100:0/4080947690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4031940 con 0x7f1dcc106f70 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.449+0000 7f1dd0a00640 1 -- 172.21.15.100:0/4080947690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40317e0 con 0x7f1dcc106f70 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 -- 172.21.15.100:0/4080947690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 msgr2=0x7f1dcc054380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 --2- 172.21.15.100:0/4080947690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc054380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00c500 tx=0x7f1dc402b880 comp rx=0 tx=0).stop 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 -- 172.21.15.100:0/4080947690 shutdown_connections 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 --2- 172.21.15.100:0/4080947690 >> v2:172.21.15.156:3300/0 conn(0x7f1dcc054d50 0x7f1dcc1085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 --2- 172.21.15.100:0/4080947690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc054380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7f1dd3200640 1 -- 172.21.15.100:0/4080947690 >> 172.21.15.100:0/4080947690 conn(0x7f1dcc052de0 msgr2=0x7f1dcc0531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7f1dd3200640 1 -- 172.21.15.100:0/4080947690 shutdown_connections 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.450+0000 7fa483e00640 1 Processor -- start 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7fa483e00640 1 -- start start 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7fda21600640 1 -- 172.21.15.100:0/3847141460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10008be0 con 0x7fda24071010 2024-02-21T07:45:56.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7fda21600640 1 -- 172.21.15.100:0/3847141460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10008d40 con 0x7fda24071010 2024-02-21T07:45:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7fda21600640 1 -- 172.21.15.100:0/3847141460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000a2f0 con 0x7fda24071010 2024-02-21T07:45:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.452+0000 7fda29600640 1 -- 172.21.15.100:0/3847141460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda24071010 msgr2=0x7fda240713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.452+0000 7fda29600640 1 --2- 172.21.15.100:0/3847141460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda24071010 0x7fda240713f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fda24074b70 tx=0x7fda1000ab30 comp rx=0 tx=0).stop 2024-02-21T07:45:56.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.451+0000 7f1dd3200640 1 -- 172.21.15.100:0/4080947690 wait complete. 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.453+0000 7fa483e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.453+0000 7fa483e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4840d4910 0x7fa48421c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa482a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa482a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51296/0 (socket says 172.21.15.100:51296) 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa482a00640 1 -- 172.21.15.100:0/2398206760 learned_addr learned my addr 172.21.15.100:0/2398206760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4840d4d90 0x7fa48421c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa482000640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4840d4910 0x7fa48421c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840f9f30 con 0x7fa4680052a0 2024-02-21T07:45:56.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4842210a0 con 0x7fa4840d4910 2024-02-21T07:45:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7f1dd3200640 1 Processor -- start 2024-02-21T07:45:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa483400640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4840d4d90 0x7fa48421c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.454+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484220520 con 0x7fa4840d4d90 2024-02-21T07:45:56.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fade5800640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 0x7fadc00a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7f1dd3200640 1 -- start start 2024-02-21T07:45:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fa482a00640 1 -- 172.21.15.100:0/2398206760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4840d4d90 msgr2=0x7fa48421c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fa482a00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4840d4d90 0x7fa48421c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fa482a00640 1 -- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4840d4910 msgr2=0x7fa48421c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fa482a00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4840d4910 0x7fa48421c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.455+0000 7fa482a00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484220800 con 0x7fa4680052a0 2024-02-21T07:45:56.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.456+0000 7fade5800640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 0x7fadc00a1770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006e80 tx=0x7fadd4006dd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.457+0000 7fa482a00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4700115d0 tx=0x7fa470011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.457+0000 7f1dd3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.457+0000 7f1dd3200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 0x7f1dcc0dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.457+0000 7f1dd1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7f1dd1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43444/0 (socket says 172.21.15.100:43444) 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7f1dd1e00640 1 -- 172.21.15.100:0/303021307 learned_addr learned my addr 172.21.15.100:0/303021307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000c070 con 0x7fa4680052a0 2024-02-21T07:45:56.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc0dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000f9b0 con 0x7fa4680052a0 2024-02-21T07:45:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fe4cbe00640 1 Processor -- start 2024-02-21T07:45:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fda29600640 1 -- 172.21.15.100:0/3847141460 shutdown_connections 2024-02-21T07:45:56.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fda29600640 1 --2- 172.21.15.100:0/3847141460 >> v2:172.21.15.156:3300/0 conn(0x7fda24071930 0x7fda2406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fda29600640 1 --2- 172.21.15.100:0/3847141460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda24071010 0x7fda240713f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fda29600640 1 -- 172.21.15.100:0/3847141460 >> 172.21.15.100:0/3847141460 conn(0x7fda240668b0 msgr2=0x7fda24066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.458+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484220ae0 con 0x7fa4680052a0 2024-02-21T07:45:56.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.459+0000 7fe4cbe00640 1 -- start start 2024-02-21T07:45:56.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.462+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48421be40 con 0x7fa4680052a0 2024-02-21T07:45:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.462+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0dd690 con 0x7f1dcc106f70 2024-02-21T07:45:56.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.462+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000fd80 con 0x7fa4680052a0 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd2800640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc0dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0dd970 con 0x7f1dcc054d50 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc0ddc50 con 0x7f1dcc0548c0 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd1400640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 0x7f1dcc0dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c005290 con 0x7fa4680052a0 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7fe4cbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe4cc0c9090 0x7fe4cc0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7fe4cbe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe4cc06d950 0x7fe4cc06f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd1e00640 1 -- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 msgr2=0x7f1dcc0dcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.463+0000 7f1dd1e00640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 0x7f1dcc0dcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7f1dd1e00640 1 -- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 msgr2=0x7f1dcc0dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7f1dd1e00640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc0dea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7f1dd1e00640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40094d0 con 0x7f1dcc0548c0 2024-02-21T07:45:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7f1dd1400640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 0x7f1dcc0dcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7f1dd2800640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc0dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7fda29600640 1 -- 172.21.15.100:0/3847141460 shutdown_connections 2024-02-21T07:45:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.464+0000 7fda29600640 1 -- 172.21.15.100:0/3847141460 wait complete. 2024-02-21T07:45:56.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.465+0000 7fe4caa00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe4cc182390 0x7fe4cc182b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40888/0 (socket says 172.21.15.100:40888) 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.465+0000 7fe4cbe00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc183280 con 0x7fe4cc182390 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.465+0000 7fe4cbe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0ca540 con 0x7fe4cc0c9090 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.465+0000 7fe4cbe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0706d0 con 0x7fe4cc06d950 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.465+0000 7fe4caa00640 1 -- 172.21.15.100:0/1978822792 learned_addr learned my addr 172.21.15.100:0/1978822792 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141818681 0 0) 0x7fe4bc001110 con 0x7fe4cc182390 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003520 con 0x7fe4cc182390 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3906176339 0 0) 0x7fe4b0003520 con 0x7fe4cc182390 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 >> v2:172.21.15.170:3300/0 conn(0x7fe4cc06d950 msgr2=0x7fe4cc06f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 --2- 172.21.15.100:0/1978822792 >> v2:172.21.15.170:3300/0 conn(0x7fe4cc06d950 0x7fe4cc06f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 >> v2:172.21.15.100:3300/0 conn(0x7fe4cc0c9090 msgr2=0x7fe4cc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 --2- 172.21.15.100:0/1978822792 >> v2:172.21.15.100:3300/0 conn(0x7fe4cc0c9090 0x7fe4cc0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0c9650 con 0x7fe4cc182390 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fe4bc0017e0 con 0x7fe4cc182390 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 >> v1:172.21.15.170:6789/0 conn(0x7fe4cc182390 legacy=0x7fe4cc182b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00039e0 0x7fe4b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 0x7fe4b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b0009970 0x7fe4b0014780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0ca540 con 0x7fe4b00039e0 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0706d0 con 0x7fe4b00047c0 2024-02-21T07:45:56.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.466+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b0014cc0 con 0x7fe4b0009970 2024-02-21T07:45:56.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.467+0000 7fe4ca000640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 0x7fe4b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.471+0000 7fda29600640 1 Processor -- start 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.468+0000 7fe4ca000640 1 -- 172.21.15.100:0/1978822792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b0009970 msgr2=0x7fe4b0014780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.468+0000 7fe4ca000640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b0009970 0x7fe4b0014780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.468+0000 7fe4ca000640 1 -- 172.21.15.100:0/1978822792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00039e0 msgr2=0x7fe4b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.468+0000 7fe4ca000640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00039e0 0x7fe4b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.468+0000 7fe4ca000640 1 -- 172.21.15.100:0/1978822792 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0c9650 con 0x7fe4b00047c0 2024-02-21T07:45:56.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.472+0000 7fe4cb400640 1 -- 172.21.15.100:0/1978822792 reap_dead start 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.471+0000 7f1dd1e00640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40090b0 tx=0x7f1dc40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.471+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4004450 con 0x7f1dcc0548c0 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.471+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc403f070 con 0x7f1dcc0548c0 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.471+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4003850 con 0x7f1dcc0548c0 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.472+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc0de240 con 0x7f1dcc0548c0 2024-02-21T07:45:56.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.472+0000 7fe4ca000640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 0x7fe4b0004c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009860 tx=0x7fe4b00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7615d2514d2491c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.473+0000 7fda29600640 1 -- start start 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.473+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8032600 con 0x7fe4b00047c0 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.473+0000 7fe4c9600640 1 -- 172.21.15.100:0/1978822792 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b802e050 con 0x7fe4b00047c0 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.474+0000 7fe4cbe00640 1 -- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 msgr2=0x7fe4b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.474+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 0x7fe4b0004c40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009860 tx=0x7fe4b00057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.474+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc052810 con 0x7f1dcc0548c0 2024-02-21T07:45:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.475+0000 7fe4cbe00640 1 -- 172.21.15.100:0/1978822792 shutdown_connections 2024-02-21T07:45:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.475+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/1978822792 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b00047c0 0x7fe4b0004c40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.475+0000 7fe4cbe00640 1 -- 172.21.15.100:0/1978822792 >> 172.21.15.100:0/1978822792 conn(0x7fe4cc0ce150 msgr2=0x7fe4cc0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.475+0000 7fda29600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda24071010 0x7fda241582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.476+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1dc40039b0 con 0x7f1dcc0548c0 2024-02-21T07:45:56.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.477+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc009af0 con 0x7f1dcc0548c0 2024-02-21T07:45:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.476+0000 7fda29600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda22000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda22000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43466/0 (socket says 172.21.15.100:43466) 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda29600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 0x7fda2421df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda22000640 1 -- 172.21.15.100:0/2413628348 learned_addr learned my addr 172.21.15.100:0/2413628348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7f1dca000640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 0x7f1db40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda22a00640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda24071010 0x7fda241582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24158820 con 0x7fda2421c360 2024-02-21T07:45:56.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24178fb0 con 0x7fda24071010 2024-02-21T07:45:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24179270 con 0x7fda24071930 2024-02-21T07:45:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.479+0000 7f1dd1400640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 0x7f1db40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7fda23400640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 0x7fda2421df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7fda22000640 1 -- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda24071010 msgr2=0x7fda241582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7fda22000640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda24071010 0x7fda241582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7f1de0a00640 1 Processor -- start 2024-02-21T07:45:56.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7f1de0a00640 1 -- start start 2024-02-21T07:45:56.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.480+0000 7fda22000640 1 -- 172.21.15.100:0/2413628348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 msgr2=0x7fda2421df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.482+0000 7fda22000640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 0x7fda2421df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.482+0000 7fda22000640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1000ae30 con 0x7fda24071930 2024-02-21T07:45:56.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.482+0000 7fda23400640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 0x7fda2421df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7fe4cbe00640 1 -- 172.21.15.100:0/1978822792 shutdown_connections 2024-02-21T07:45:56.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.485+0000 7fe4cbe00640 1 -- 172.21.15.100:0/1978822792 wait complete. 2024-02-21T07:45:56.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.482+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1dc40b9280 con 0x7f1dcc0548c0 2024-02-21T07:45:56.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.482+0000 7f1dd1400640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 0x7f1db40a15f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40507e0 tx=0x7f1dd406d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.475+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa470028480 con 0x7fa4680052a0 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.483+0000 7f1de0a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1ddc185cd0 0x7f1ddc1860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1de0a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ddc0fa350 0x7f1ddc0d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1de0a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc06bab0 con 0x7f1ddc188be0 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1de0a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc06bd90 con 0x7f1ddc185cd0 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1de0a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0f9f30 con 0x7f1ddc0fa350 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1dd9e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ddc0fa350 0x7f1ddc0d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1dd9e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1ddc0fa350 0x7f1ddc0d4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35160/0 (socket says 172.21.15.100:35160) 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.484+0000 7f1dd9e00640 1 -- 172.21.15.100:0/2074433867 learned_addr learned my addr 172.21.15.100:0/2074433867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.486+0000 7fda22000640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d990 tx=0x7fda1400dd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.486+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14007b10 con 0x7fda24071930 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.487+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda24179550 con 0x7fda24071930 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.487+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14007c70 con 0x7fda24071930 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.487+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14010470 con 0x7fda24071930 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.488+0000 7fe4cbe00640 1 Processor -- start 2024-02-21T07:45:56.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.487+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1dc40ef060 con 0x7f1dcc0548c0 2024-02-21T07:45:56.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.488+0000 7fe4cbe00640 1 -- start start 2024-02-21T07:45:56.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.489+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24179b10 con 0x7fda24071930 2024-02-21T07:45:56.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.485+0000 7f1dd9e00640 1 -- 172.21.15.100:0/2074433867 >> v2:172.21.15.100:3300/0 conn(0x7f1ddc185cd0 msgr2=0x7f1ddc1860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.485+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/2074433867 >> v2:172.21.15.100:3300/0 conn(0x7f1ddc185cd0 0x7f1ddc1860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.485+0000 7f1dd9e00640 1 -- 172.21.15.100:0/2074433867 >> v1:172.21.15.100:6789/0 conn(0x7f1ddc188be0 legacy=0x7f1ddc189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.485+0000 7f1dd9e00640 1 -- 172.21.15.100:0/2074433867 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc08cff0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.490+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/2074433867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc0d4060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc091570 tx=0x7f1dc802b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8aa8c868739332c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.491+0000 7fe4cbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.491+0000 7fe4cbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 0x7fe4cc20ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7f1dd9400640 1 -- 172.21.15.100:0/2074433867 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8031770 con 0x7f1ddc0fa350 2024-02-21T07:45:56.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7f1dd9400640 1 -- 172.21.15.100:0/2074433867 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc80318d0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7fe4caa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51348/0 (socket says 172.21.15.100:51348) 2024-02-21T07:45:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7fe4caa00640 1 -- 172.21.15.100:0/3731383223 learned_addr learned my addr 172.21.15.100:0/3731383223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.492+0000 7f1dd9400640 1 -- 172.21.15.100:0/2074433867 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8031ca0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4ca000640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 0x7fe4cc20ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc20f2a0 0x7fe4cc179570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc17a6f0 con 0x7fe4b00047c0 2024-02-21T07:45:56.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240f79b0 con 0x7fda24071930 2024-02-21T07:45:56.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc17a9d0 con 0x7fe4cc20f2a0 2024-02-21T07:45:56.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc17acb0 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.490+0000 7fa47aa00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 0x7fa4640a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.491+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa4700ca6b0 con 0x7fa4680052a0 2024-02-21T07:45:56.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.491+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa4700caa90 con 0x7fa4680052a0 2024-02-21T07:45:56.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.493+0000 7fe4cb400640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc20f2a0 0x7fe4cc179570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 -- 172.21.15.100:0/2074433867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc0fa350 msgr2=0x7f1ddc0d4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 --2- 172.21.15.100:0/2074433867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc0d4060 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc091570 tx=0x7f1dc802b810 comp rx=0 tx=0).stop 2024-02-21T07:45:56.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 -- 172.21.15.100:0/2074433867 shutdown_connections 2024-02-21T07:45:56.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 --2- 172.21.15.100:0/2074433867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc0d4060 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 --2- 172.21.15.100:0/2074433867 >> v2:172.21.15.100:3300/0 conn(0x7f1ddc185cd0 0x7f1ddc1860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 -- 172.21.15.100:0/2074433867 >> 172.21.15.100:0/2074433867 conn(0x7f1ddc0fe060 msgr2=0x7f1ddc0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7f1de0a00640 1 -- 172.21.15.100:0/2074433867 shutdown_connections 2024-02-21T07:45:56.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.495+0000 7f1de0a00640 1 -- 172.21.15.100:0/2074433867 wait complete. 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.495+0000 7fe4ca000640 1 -- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc20f2a0 msgr2=0x7fe4cc179570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.495+0000 7fe4ca000640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc20f2a0 0x7fe4cc179570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.495+0000 7fe4ca000640 1 -- 172.21.15.100:0/3731383223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 msgr2=0x7fe4cc0f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.498+0000 7fe4ca000640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.498+0000 7fe4ca000640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc17af90 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.498+0000 7fe4caa00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.499+0000 7fe4ca000640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 0x7fe4cc20ed60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8032000 tx=0x7fe4b80047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7fa482000640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 0x7fa4640a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.494+0000 7fa482000640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 0x7fa4640a1670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa484185150 tx=0x7fa474009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.498+0000 7f1de0a00640 1 Processor -- start 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.499+0000 7f1de0a00640 1 -- start start 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.501+0000 7f1de0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.501+0000 7f1de0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 0x7f1ddc170050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.501+0000 7f1de0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc188be0 0x7f1ddc170590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1de0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc18cbe0 con 0x7f1ddc185cd0 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1de0a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc18a150 con 0x7f1ddc188be0 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1dda800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1de0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc18a430 con 0x7f1ddc0fa350 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1dda800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43488/0 (socket says 172.21.15.100:43488) 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1dda800640 1 -- 172.21.15.100:0/3114492946 learned_addr learned my addr 172.21.15.100:0/3114492946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.502+0000 7f1ddb200640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc188be0 0x7f1ddc170590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7f1dda800640 1 -- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc188be0 msgr2=0x7f1ddc170590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 0x7f1ddc170050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7f1dda800640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc188be0 0x7f1ddc170590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7f1dda800640 1 -- 172.21.15.100:0/3114492946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 msgr2=0x7f1ddc170050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7f1dda800640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 0x7f1ddc170050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.504+0000 7f1dda800640 1 -- 172.21.15.100:0/3114492946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80094d0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.504+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 0x7f1ddc170050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:56.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.508+0000 7f1dda800640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b410 tx=0x7f1dcc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.508+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8031db0 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.508+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011830 con 0x7f1ddc0fa350 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.508+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0119b0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.508+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011d60 con 0x7f1ddc0fa350 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.509+0000 7f1de0a00640 1 -- 172.21.15.100:0/3114492946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc18a710 con 0x7f1ddc0fa350 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.509+0000 7f1de0a00640 1 -- 172.21.15.100:0/3114492946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc18acd0 con 0x7f1ddc0fa350 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.501+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fda140105d0 con 0x7fda24071930 2024-02-21T07:45:56.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7fda1aa00640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 0x7fda040a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.503+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fda140c9810 con 0x7fda24071930 2024-02-21T07:45:56.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.510+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b80325d0 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.510+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda14093500 con 0x7fda24071930 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.511+0000 7fda22a00640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 0x7fda040a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.512+0000 7fda22a00640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 0x7fda040a16c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda10039000 tx=0x7fda1000a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.510+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc20e560 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.511+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b803d680 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.512+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc16bc00 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.513+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc17b120 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.516+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe4b8039040 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.518+0000 7fe4c2a00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 0x7fe4ac0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.518+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe4b80eb410 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.516+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0005290 con 0x7f1ddc0fa350 2024-02-21T07:45:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.520+0000 7fe4caa00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 0x7fe4ac0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.521+0000 7fe4caa00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 0x7fe4ac0a1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc001eb0 tx=0x7fe4bc001c40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.526+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe4b80b5120 con 0x7fe4cc17a1c0 2024-02-21T07:45:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.549+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1dcc01a400 con 0x7f1ddc0fa350 2024-02-21T07:45:56.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.551+0000 7f1dd2a00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 0x7f1dbc0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.555+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 0x7f1dbc0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:56.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.555+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1dcc0ca300 con 0x7f1ddc0fa350 2024-02-21T07:45:56.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.556+0000 7f1dd9e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 0x7f1dbc0a1740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8036000 tx=0x7f1dc803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:56.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.556+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1dcc0ca780 con 0x7f1ddc0fa350 2024-02-21T07:45:56.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.835+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27cc0ed610 con 0x7f27cc17b4c0 2024-02-21T07:45:56.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.836+0000 7f27c3400640 1 -- 172.21.15.100:0/579047274 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27bc051090 con 0x7f27cc17b4c0 2024-02-21T07:45:56.846 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:56.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.842+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 msgr2=0x7f27ac0a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.842+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 0x7f27ac0a1740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27cc160980 tx=0x7f27b8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:56.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 msgr2=0x7f27cc0f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f27bc02e310 tx=0x7f27bc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 shutdown_connections 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f27ac09f280 0x7f27ac0a1740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27cc0cd240 0x7f27cc0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27cc187050 0x7f27cc1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 --2- 172.21.15.100:0/579047274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f27cc17b4c0 0x7f27cc0f7b30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.843+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 >> 172.21.15.100:0/579047274 conn(0x7f27cc0ce200 msgr2=0x7f27cc1824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.847+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 shutdown_connections 2024-02-21T07:45:56.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.851+0000 7f27d2000640 1 -- 172.21.15.100:0/579047274 wait complete. 2024-02-21T07:45:56.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.868+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedc02213f0 con 0x7fedc0158ce0 2024-02-21T07:45:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.870+0000 7fedb7e00640 1 -- 172.21.15.100:0/457704200 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fedb801a070 con 0x7fedc0158ce0 2024-02-21T07:45:56.876 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:56.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.887+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 msgr2=0x7feda00a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.1 2024-02-21T07:45:56.897 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.887+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 0x7feda00a16f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fedb0039000 tx=0x7fedb0008040 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.887+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 msgr2=0x7fedc01795d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.887+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fedb8007dc0 tx=0x7fedb800d4a0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 shutdown_connections 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fedc0158ce0 0x7fedc01795d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedc0071930 0x7fedc0222070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feda009f230 0x7feda00a16f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 --2- 172.21.15.100:0/457704200 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0071010 0x7fedc022c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 >> 172.21.15.100:0/457704200 conn(0x7fedc00668b0 msgr2=0x7fedc00f95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 shutdown_connections 2024-02-21T07:45:56.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.891+0000 7fedc6e00640 1 -- 172.21.15.100:0/457704200 wait complete. 2024-02-21T07:45:56.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.0 2024-02-21T07:45:56.948 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:56.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.968+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30680cec70 con 0x7f3050003a30 2024-02-21T07:45:56.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.968+0000 7f3065600640 1 -- 172.21.15.100:0/2701327031 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3054047090 con 0x7f3050003a30 2024-02-21T07:45:56.977 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:56.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 msgr2=0x7f30480a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 0x7f30480a1770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f306817ae40 tx=0x7f305c009040 comp rx=0 tx=0).stop 2024-02-21T07:45:56.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 msgr2=0x7f30680ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:56.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f305402bfc0 tx=0x7f3054004730 comp rx=0 tx=0).stop 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 shutdown_connections 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3068172640 0x7f306821ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f304809f2b0 0x7f30480a1770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30681721c0 0x7f306821fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 --2- 172.21.15.100:0/2701327031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3050003a30 0x7f30680ce460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:56.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.976+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 >> 172.21.15.100:0/2701327031 conn(0x7f30680fe020 msgr2=0x7f30681807b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:56.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.977+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 shutdown_connections 2024-02-21T07:45:56.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.977+0000 7f306ea00640 1 -- 172.21.15.100:0/2701327031 wait complete. 2024-02-21T07:45:56.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.991+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6894005810 con 0x7f68b8181f70 2024-02-21T07:45:57.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:56.994+0000 7f68b4c00640 1 -- 172.21.15.100:0/1359822501 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68a409bf80 con 0x7f68b8181f70 2024-02-21T07:45:57.003 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 msgr2=0x7f68980a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 0x7f68980a16a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0090b0 tx=0x7f68ac03b040 comp rx=0 tx=0).stop 2024-02-21T07:45:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 msgr2=0x7f68b8221e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 0x7f68b8221e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d520 tx=0x7f68a400d9e0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 shutdown_connections 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68b8186810 0x7f68b81806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f689809f1e0 0x7f68980a16a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68b8181f70 0x7f68b8221e30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 --2- 172.21.15.100:0/1359822501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68b806baa0 0x7f68b8164ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.001+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 >> 172.21.15.100:0/1359822501 conn(0x7f68b80ce160 msgr2=0x7f68b806da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.002+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 shutdown_connections 2024-02-21T07:45:57.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.003+0000 7f68bf600640 1 -- 172.21.15.100:0/1359822501 wait complete. 2024-02-21T07:45:57.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.2 2024-02-21T07:45:57.015 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.028+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f176c177590 con 0x7f176c18b0b0 2024-02-21T07:45:57.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.032+0000 7f1763e00640 1 -- 172.21.15.100:0/3509270337 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f176c177590 con 0x7f176c18b0b0 2024-02-21T07:45:57.041 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.040+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 msgr2=0x7f174c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.040+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 0x7f174c0a15f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1764009fc0 tx=0x7f1764009550 comp rx=0 tx=0).stop 2024-02-21T07:45:57.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.6 2024-02-21T07:45:57.047 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.040+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 msgr2=0x7f176c0f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.040+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c0f4a40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1758033000 tx=0x7f17580046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 shutdown_connections 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176c18b0b0 0x7f176c0f4a40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f176c18a4a0 0x7f176c0f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174c09f130 0x7f174c0a15f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 --2- 172.21.15.100:0/3509270337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f176c071450 0x7f176c172e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.041+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 >> 172.21.15.100:0/3509270337 conn(0x7f176c0ce150 msgr2=0x7f176c18f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.042+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 shutdown_connections 2024-02-21T07:45:57.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.043+0000 7f1771a00640 1 -- 172.21.15.100:0/3509270337 wait complete. 2024-02-21T07:45:57.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.044+0000 7fade8200640 1 -- 172.21.15.100:0/2752790502 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fade00f48d0 con 0x7fade017f4e0 2024-02-21T07:45:57.050 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:57.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.044+0000 7faddd600640 1 -- 172.21.15.100:0/2752790502 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadcc0b7830 con 0x7fade017f4e0 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 msgr2=0x7fadc00a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 0x7fadc00a1770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006e80 tx=0x7fadd4006dd0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 msgr2=0x7fade0224b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fadcc02b910 tx=0x7fadcc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 shutdown_connections 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fade0189d30 0x7fade0169070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade017f4e0 0x7fade0224b00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fadc009f2b0 0x7fadc00a1770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 --2- 172.21.15.100:0/2752790502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade00ed4f0 0x7fade02265e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 >> 172.21.15.100:0/2752790502 conn(0x7fade00668b0 msgr2=0x7fade00f5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 shutdown_connections 2024-02-21T07:45:57.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.048+0000 7fadd2a00640 1 -- 172.21.15.100:0/2752790502 wait complete. 2024-02-21T07:45:57.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.057+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1dcc0de0a0 con 0x7f1dcc0548c0 2024-02-21T07:45:57.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.058+0000 7f1dca000640 1 -- 172.21.15.100:0/303021307 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dcc0de0a0 con 0x7f1dcc0548c0 2024-02-21T07:45:57.064 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:57.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.061+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5534005480 con 0x7f553410d7b0 2024-02-21T07:45:57.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.061+0000 7f5538c00640 1 -- 172.21.15.100:0/2571095006 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f553c134150 con 0x7f553410d7b0 2024-02-21T07:45:57.067 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 msgr2=0x7f1db40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 0x7f1db40a15f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40507e0 tx=0x7f1dd406d040 comp rx=0 tx=0).stop 2024-02-21T07:45:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 msgr2=0x7f1dcc0522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40090b0 tx=0x7f1dc40046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 shutdown_connections 2024-02-21T07:45:57.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1db409f130 0x7f1db40a15f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1dcc106f70 0x7f1dcc0dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1dcc054d50 0x7f1dcc0dcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 --2- 172.21.15.100:0/303021307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1dcc0548c0 0x7f1dcc0522d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.062+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 >> 172.21.15.100:0/303021307 conn(0x7f1dcc052de0 msgr2=0x7f1dcc053cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.063+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 shutdown_connections 2024-02-21T07:45:57.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.063+0000 7f1dd3200640 1 -- 172.21.15.100:0/303021307 wait complete. 2024-02-21T07:45:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.065+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 msgr2=0x7f551c0a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.066+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 0x7f551c0a16d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f55340ed950 tx=0x7f5528008040 comp rx=0 tx=0).stop 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.066+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 msgr2=0x7f5534073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.066+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f553c000b60 tx=0x7f553c0a9070 comp rx=0 tx=0).stop 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.066+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 shutdown_connections 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.066+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f553410d7b0 0x7f5534073210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.067+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f551c09f210 0x7f551c0a16d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.067+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f553410a210 0x7f553407d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.067+0000 7f5543400640 1 --2- 172.21.15.100:0/2571095006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5534109720 0x7f553404dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.067+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 >> 172.21.15.100:0/2571095006 conn(0x7f5534052e10 msgr2=0x7f5534109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.067+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 shutdown_connections 2024-02-21T07:45:57.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.068+0000 7f5543400640 1 -- 172.21.15.100:0/2571095006 wait complete. 2024-02-21T07:45:57.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.8 2024-02-21T07:45:57.081 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.7 2024-02-21T07:45:57.083 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.082+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe4cc16bd90 con 0x7fe4cc17a1c0 2024-02-21T07:45:57.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.083+0000 7fe4c2a00640 1 -- 172.21.15.100:0/3731383223 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4b8037020 con 0x7fe4cc17a1c0 2024-02-21T07:45:57.089 INFO:teuthology.orchestra.run.smithi100.stdout:73014444040 2024-02-21T07:45:57.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 msgr2=0x7fe4ac0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 0x7fe4ac0a1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc001eb0 tx=0x7fe4bc001c40 comp rx=0 tx=0).stop 2024-02-21T07:45:57.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 msgr2=0x7fe4cc20ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 0x7fe4cc20ed60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8032000 tx=0x7fe4b80047d0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 shutdown_connections 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4cc20f2a0 0x7fe4cc179570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4cc17a1c0 0x7fe4cc20ed60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe4ac09f160 0x7fe4ac0a1620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 --2- 172.21.15.100:0/3731383223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b00047c0 0x7fe4cc0f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 >> 172.21.15.100:0/3731383223 conn(0x7fe4cc0ce150 msgr2=0x7fe4cc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 shutdown_connections 2024-02-21T07:45:57.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.088+0000 7fe4cbe00640 1 -- 172.21.15.100:0/3731383223 wait complete. 2024-02-21T07:45:57.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.3 2024-02-21T07:45:57.100 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.4 2024-02-21T07:45:57.102 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444040 for osd.5 2024-02-21T07:45:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.117+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fda24067c80 con 0x7fda24071930 2024-02-21T07:45:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.118+0000 7fda1aa00640 1 -- 172.21.15.100:0/2413628348 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fda14096bc0 con 0x7fda24071930 2024-02-21T07:45:57.124 INFO:teuthology.orchestra.run.smithi100.stdout:73014444040 2024-02-21T07:45:57.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.119+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fa45c005810 con 0x7fa4680052a0 2024-02-21T07:45:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.119+0000 7fa47aa00640 1 -- 172.21.15.100:0/2398206760 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa470023020 con 0x7fa4680052a0 2024-02-21T07:45:57.125 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.120+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 msgr2=0x7fda040a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.120+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 0x7fda040a16c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fda10039000 tx=0x7fda1000a000 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 msgr2=0x7fda2421be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fda1400d990 tx=0x7fda1400dd90 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 shutdown_connections 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fda0409f200 0x7fda040a16c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda2421c360 0x7fda2421df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda24071930 0x7fda2421be20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 --2- 172.21.15.100:0/2413628348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda24071010 0x7fda241582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 >> 172.21.15.100:0/2413628348 conn(0x7fda240668b0 msgr2=0x7fda24175370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 shutdown_connections 2024-02-21T07:45:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fda29600640 1 -- 172.21.15.100:0/2413628348 wait complete. 2024-02-21T07:45:57.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 msgr2=0x7fa4640a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 0x7fa4640a1670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa484185150 tx=0x7fa474009040 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 msgr2=0x7fa48421e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.121+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa4700115d0 tx=0x7fa470011a90 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 shutdown_connections 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa4840d4d90 0x7fa48421c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa4840d4910 0x7fa48421c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa46409f1b0 0x7fa4640a1670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 --2- 172.21.15.100:0/2398206760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4680052a0 0x7fa48421e620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 >> 172.21.15.100:0/2398206760 conn(0x7fa4840fe060 msgr2=0x7fa484186690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 shutdown_connections 2024-02-21T07:45:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.122+0000 7fa483e00640 1 -- 172.21.15.100:0/2398206760 wait complete. 2024-02-21T07:45:57.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444040 for osd.11 2024-02-21T07:45:57.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.9 2024-02-21T07:45:57.144 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.162+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f1db0005810 con 0x7f1ddc0fa350 2024-02-21T07:45:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.163+0000 7f1dd2a00640 1 -- 172.21.15.100:0/3114492946 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f1dcc015070 con 0x7f1ddc0fa350 2024-02-21T07:45:57.168 INFO:teuthology.orchestra.run.smithi100.stdout:73014444042 2024-02-21T07:45:57.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 msgr2=0x7f1dbc0a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 0x7f1dbc0a1740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8036000 tx=0x7f1dc803d040 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 msgr2=0x7f1ddc18c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b410 tx=0x7f1dcc00b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 shutdown_connections 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ddc188be0 0x7f1ddc170590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1dbc09f280 0x7f1dbc0a1740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ddc185cd0 0x7f1ddc170050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.165+0000 7f1dc7e00640 1 --2- 172.21.15.100:0/3114492946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ddc0fa350 0x7f1ddc18c6a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.166+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 >> 172.21.15.100:0/3114492946 conn(0x7f1ddc0fe060 msgr2=0x7f1ddc08d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.166+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 shutdown_connections 2024-02-21T07:45:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:57.166+0000 7f1dc7e00640 1 -- 172.21.15.100:0/3114492946 wait complete. 2024-02-21T07:45:57.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444042 for osd.10 2024-02-21T07:45:57.187 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:58.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T07:45:58.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-02-21T07:45:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.324+0000 7f18e7c00640 1 Processor -- start 2024-02-21T07:45:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.324+0000 7f18e7c00640 1 -- start start 2024-02-21T07:45:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e7c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e0188ab0 0x7f18e006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e7c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f18e008d1c0 0x7f18e0188e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e7c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e008bfe0 con 0x7f18e008cd10 2024-02-21T07:45:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e7c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e008c880 con 0x7f18e0188ab0 2024-02-21T07:45:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e7c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00fa660 con 0x7f18e008d1c0 2024-02-21T07:45:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e5200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e0188ab0 0x7f18e006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e5200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f18e0188ab0 0x7f18e006ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35192/0 (socket says 172.21.15.100:35192) 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e5200640 1 -- 172.21.15.100:0/363262385 learned_addr learned my addr 172.21.15.100:0/363262385 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.326+0000 7f18e5c00640 1 --2- 172.21.15.100:0/363262385 >> v2:172.21.15.170:3300/0 conn(0x7f18e008d1c0 0x7f18e0188e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.327+0000 7f18e5200640 1 -- 172.21.15.100:0/363262385 >> v2:172.21.15.170:3300/0 conn(0x7f18e008d1c0 msgr2=0x7f18e0188e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.327+0000 7f18e5200640 1 --2- 172.21.15.100:0/363262385 >> v2:172.21.15.170:3300/0 conn(0x7f18e008d1c0 0x7f18e0188e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.327+0000 7f18e5200640 1 -- 172.21.15.100:0/363262385 >> v1:172.21.15.170:6789/0 conn(0x7f18e008cd10 legacy=0x7f18e00f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.327+0000 7f18e5200640 1 -- 172.21.15.100:0/363262385 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00fa940 con 0x7f18e0188ab0 2024-02-21T07:45:58.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.328+0000 7f18e5200640 1 --2- 172.21.15.100:0/363262385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0188ab0 0x7f18e006ab60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18e0092910 tx=0x7f18d402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=331b1571a1cdff07 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.328+0000 7f18df400640 1 -- 172.21.15.100:0/363262385 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40317e0 con 0x7f18e0188ab0 2024-02-21T07:45:58.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.328+0000 7f18df400640 1 -- 172.21.15.100:0/363262385 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4031940 con 0x7f18e0188ab0 2024-02-21T07:45:58.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.328+0000 7f18df400640 1 -- 172.21.15.100:0/363262385 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4031cd0 con 0x7f18e0188ab0 2024-02-21T07:45:58.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 -- 172.21.15.100:0/363262385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0188ab0 msgr2=0x7f18e006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 --2- 172.21.15.100:0/363262385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0188ab0 0x7f18e006ab60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18e0092910 tx=0x7f18d402b880 comp rx=0 tx=0).stop 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 -- 172.21.15.100:0/363262385 shutdown_connections 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 --2- 172.21.15.100:0/363262385 >> v2:172.21.15.170:3300/0 conn(0x7f18e008d1c0 0x7f18e0188e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 --2- 172.21.15.100:0/363262385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e0188ab0 0x7f18e006ab60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 -- 172.21.15.100:0/363262385 >> 172.21.15.100:0/363262385 conn(0x7f18e00fe290 msgr2=0x7f18e00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 -- 172.21.15.100:0/363262385 shutdown_connections 2024-02-21T07:45:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.329+0000 7f18e7c00640 1 -- 172.21.15.100:0/363262385 wait complete. 2024-02-21T07:45:58.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.331+0000 7f18e7c00640 1 Processor -- start 2024-02-21T07:45:58.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.331+0000 7f18e7c00640 1 -- start start 2024-02-21T07:45:58.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e008cd10 0x7f18e00cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 0x7f18e0169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 0x7f18e00d0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0169bb0 con 0x7f18e0188ab0 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00ce460 con 0x7f18e008d1c0 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.332+0000 7f18e7c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00ce740 con 0x7f18e008cd10 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 0x7f18e00d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 0x7f18e0169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18e5c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 0x7f18e00d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51362/0 (socket says 172.21.15.100:51362) 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18e5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e008cd10 0x7f18e00cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18e5c00640 1 -- 172.21.15.100:0/1462940160 learned_addr learned my addr 172.21.15.100:0/1462940160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 -- 172.21.15.100:0/1462940160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e008cd10 msgr2=0x7f18e00cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e008cd10 0x7f18e00cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 -- 172.21.15.100:0/1462940160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 msgr2=0x7f18e00d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 0x7f18e00d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 -- 172.21.15.100:0/1462940160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40094d0 con 0x7f18e008d1c0 2024-02-21T07:45:58.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.333+0000 7f18dfe00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 0x7f18e0169670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c3c0 tx=0x7f18cc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.334+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0052d0 con 0x7f18e008d1c0 2024-02-21T07:45:58.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.334+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc005450 con 0x7f18e008d1c0 2024-02-21T07:45:58.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.334+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc007260 con 0x7f18e008d1c0 2024-02-21T07:45:58.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.334+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00cea20 con 0x7f18e008d1c0 2024-02-21T07:45:58.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.334+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00cefe0 con 0x7f18e008d1c0 2024-02-21T07:45:58.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.335+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0069170 con 0x7f18e008d1c0 2024-02-21T07:45:58.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.336+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f18cc0073c0 con 0x7f18e008d1c0 2024-02-21T07:45:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.338+0000 7f18dcc00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 0x7f18c00a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.338+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f18cc0c8d50 con 0x7f18e008d1c0 2024-02-21T07:45:58.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.338+0000 7f18e5200640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 0x7f18c00a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.338+0000 7f18e5200640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 0x7f18c00a1620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18d4036000 tx=0x7f18d403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.342+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f18cc04c8c0 con 0x7f18e008d1c0 2024-02-21T07:45:58.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.362+0000 7f76d2a00640 1 Processor -- start 2024-02-21T07:45:58.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.362+0000 7f76d2a00640 1 -- start start 2024-02-21T07:45:58.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76cc189ca0 0x7f76cc06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f76cc18a080 0x7f76cc18a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d2a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0ca6a0 con 0x7f76cc1871c0 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d2a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0f6200 con 0x7f76cc189ca0 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d2a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc0f6450 con 0x7f76cc18a080 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76cc189ca0 0x7f76cc06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76cc189ca0 0x7f76cc06ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51374/0 (socket says 172.21.15.100:51374) 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76d0a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f76cc18a080 0x7f76cc18a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 -- 172.21.15.100:0/1412612548 learned_addr learned my addr 172.21.15.100:0/1412612548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 -- 172.21.15.100:0/1412612548 >> v2:172.21.15.156:3300/0 conn(0x7f76cc18a080 msgr2=0x7f76cc18a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 --2- 172.21.15.100:0/1412612548 >> v2:172.21.15.156:3300/0 conn(0x7f76cc18a080 0x7f76cc18a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 -- 172.21.15.100:0/1412612548 >> v1:172.21.15.156:6789/0 conn(0x7f76cc1871c0 legacy=0x7f76cc0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76caa00640 1 -- 172.21.15.100:0/1412612548 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012640729 0 0) 0x7f76cc0ca6a0 con 0x7f76cc1871c0 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.364+0000 7f76cbe00640 1 -- 172.21.15.100:0/1412612548 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0ca8d0 con 0x7f76cc189ca0 2024-02-21T07:45:58.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76cbe00640 1 --2- 172.21.15.100:0/1412612548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc06ab60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0f7940 tx=0x7f76bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d086927323da94a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76caa00640 1 -- 172.21.15.100:0/1412612548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc030860 con 0x7f76cc189ca0 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76caa00640 1 -- 172.21.15.100:0/1412612548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc0309c0 con 0x7f76cc189ca0 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76caa00640 1 -- 172.21.15.100:0/1412612548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc030d50 con 0x7f76cc189ca0 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 -- 172.21.15.100:0/1412612548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 msgr2=0x7f76cc06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 --2- 172.21.15.100:0/1412612548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc06ab60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0f7940 tx=0x7f76bc02b9a0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 -- 172.21.15.100:0/1412612548 shutdown_connections 2024-02-21T07:45:58.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 --2- 172.21.15.100:0/1412612548 >> v2:172.21.15.156:3300/0 conn(0x7f76cc18a080 0x7f76cc18a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 --2- 172.21.15.100:0/1412612548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc06ab60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.366+0000 7f76d2a00640 1 -- 172.21.15.100:0/1412612548 >> 172.21.15.100:0/1412612548 conn(0x7f76cc0668b0 msgr2=0x7f76cc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:58.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.367+0000 7f76d2a00640 1 -- 172.21.15.100:0/1412612548 shutdown_connections 2024-02-21T07:45:58.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.367+0000 7f76d2a00640 1 -- 172.21.15.100:0/1412612548 wait complete. 2024-02-21T07:45:58.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.368+0000 7f76d2a00640 1 Processor -- start 2024-02-21T07:45:58.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.368+0000 7f76d2a00640 1 -- start start 2024-02-21T07:45:58.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76cc1871c0 0x7f76cc180ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76cc18a080 0x7f76cc17e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1880e0 con 0x7f76cc189ca0 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc2208f0 con 0x7f76cc1871c0 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc220bd0 con 0x7f76cc18a080 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51384/0 (socket says 172.21.15.100:51384) 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 -- 172.21.15.100:0/2007156135 learned_addr learned my addr 172.21.15.100:0/2007156135 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cbe00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76cc1871c0 0x7f76cc180ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76d0a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76cc18a080 0x7f76cc17e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 -- 172.21.15.100:0/2007156135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76cc18a080 msgr2=0x7f76cc17e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76cc18a080 0x7f76cc17e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 -- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76cc1871c0 msgr2=0x7f76cc180ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76cc1871c0 0x7f76cc180ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.370+0000 7f76cb400640 1 -- 172.21.15.100:0/2007156135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0094d0 con 0x7f76cc189ca0 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76cb400640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c460 tx=0x7f76b800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8005480 con 0x7f76cc189ca0 2024-02-21T07:45:58.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b80035f0 con 0x7f76cc189ca0 2024-02-21T07:45:58.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80039a0 con 0x7f76cc189ca0 2024-02-21T07:45:58.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc21cba0 con 0x7f76cc189ca0 2024-02-21T07:45:58.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.371+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc21d160 con 0x7f76cc189ca0 2024-02-21T07:45:58.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.373+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc08e1c0 con 0x7f76cc189ca0 2024-02-21T07:45:58.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.374+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f76b8003b00 con 0x7f76cc189ca0 2024-02-21T07:45:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.376+0000 7f76c3e00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 0x7f76ac0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.376+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f76b80c9630 con 0x7f76cc189ca0 2024-02-21T07:45:58.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.376+0000 7f76cbe00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 0x7f76ac0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.377+0000 7f76cbe00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 0x7f76ac0a1620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76bc036000 tx=0x7f76bc008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.380+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76b80933d0 con 0x7f76cc189ca0 2024-02-21T07:45:58.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.559+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f18e00faf80 con 0x7f18e008d1c0 2024-02-21T07:45:58.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.559+0000 7f18dcc00640 1 -- 172.21.15.100:0/1462940160 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18cc092ba0 con 0x7f18e008d1c0 2024-02-21T07:45:58.565 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 msgr2=0x7f18c00a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 0x7f18c00a1620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f18d4036000 tx=0x7f18d403d040 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 msgr2=0x7f18e0169670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 0x7f18e0169670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00c3c0 tx=0x7f18cc00c880 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 shutdown_connections 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f18c009f160 0x7f18c00a1620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18e0188ab0 0x7f18e00d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e008d1c0 0x7f18e0169670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 --2- 172.21.15.100:0/1462940160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18e008cd10 0x7f18e00cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 >> 172.21.15.100:0/1462940160 conn(0x7f18e00fe290 msgr2=0x7f18e006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 shutdown_connections 2024-02-21T07:45:58.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.562+0000 7f18e7c00640 1 -- 172.21.15.100:0/1462940160 wait complete. 2024-02-21T07:45:58.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.5 2024-02-21T07:45:58.585 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:58.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.592+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f76cc0c9c70 con 0x7f76cc189ca0 2024-02-21T07:45:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.592+0000 7f76c3e00640 1 -- 172.21.15.100:0/2007156135 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f76b8096a90 con 0x7f76cc189ca0 2024-02-21T07:45:58.598 INFO:teuthology.orchestra.run.smithi100.stdout:73014444041 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 msgr2=0x7f76ac0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 0x7f76ac0a1620 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76bc036000 tx=0x7f76bc008030 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 msgr2=0x7f76cc21fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c460 tx=0x7f76b800c920 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 shutdown_connections 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76cc18a080 0x7f76cc17e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f76ac09f160 0x7f76ac0a1620 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76cc189ca0 0x7f76cc21fe00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 --2- 172.21.15.100:0/2007156135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76cc1871c0 0x7f76cc180ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 >> 172.21.15.100:0/2007156135 conn(0x7f76cc0668b0 msgr2=0x7f76cc1701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 shutdown_connections 2024-02-21T07:45:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.595+0000 7f76d2a00640 1 -- 172.21.15.100:0/2007156135 wait complete. 2024-02-21T07:45:58.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444041 got 73014444041 for osd.11 2024-02-21T07:45:58.618 DEBUG:teuthology.parallel:result is None 2024-02-21T07:45:58.618 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T07:45:58.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:45:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.861+0000 7f8537e00640 1 Processor -- start 2024-02-21T07:45:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.861+0000 7f8537e00640 1 -- start start 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8537e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f853806c7c0 0x7f8538185ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8537e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853806e7d0 con 0x7f85381853b0 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8537e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85380f4da0 con 0x7f8538189460 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8537e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85380f5080 con 0x7f853806c7c0 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8536a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f85381853b0 0x7f8538070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40418/0 (socket says 172.21.15.100:40418) 2024-02-21T07:45:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.863+0000 7f8536a00640 1 -- 172.21.15.100:0/3220036336 learned_addr learned my addr 172.21.15.100:0/3220036336 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421905598 0 0) 0x7f853806e7d0 con 0x7f85381853b0 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f851c005730 con 0x7f85381853b0 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8537400640 1 --2- 172.21.15.100:0/3220036336 >> v2:172.21.15.170:3300/0 conn(0x7f853806c7c0 0x7f8538185ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031599617 0 0) 0x7f85380f4da0 con 0x7f8538189460 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f853806e7d0 con 0x7f8538189460 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314548455 0 0) 0x7f851c005730 con 0x7f85381853b0 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 >> v2:172.21.15.170:3300/0 conn(0x7f853806c7c0 msgr2=0x7f8538185ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 --2- 172.21.15.100:0/3220036336 >> v2:172.21.15.170:3300/0 conn(0x7f853806c7c0 0x7f8538185ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 >> v1:172.21.15.156:6789/0 conn(0x7f8538189460 legacy=0x7f8538185790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380f5360 con 0x7f85381853b0 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f8528001670 con 0x7f85381853b0 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 >> v1:172.21.15.100:6789/0 conn(0x7f85381853b0 legacy=0x7f8538070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f851c006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f851c0069d0 0x7f851c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f851c0074a0 0x7f851c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380f5080 con 0x7f851c005e20 2024-02-21T07:45:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c00e3b0 con 0x7f851c0069d0 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.864+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c00e570 con 0x7f851c0074a0 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f851c006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536000640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f851c0069d0 0x7f851c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8537400640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f851c0074a0 0x7f851c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 -- 172.21.15.100:0/3220036336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f851c0074a0 msgr2=0x7f851c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f851c0074a0 0x7f851c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 -- 172.21.15.100:0/3220036336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f851c0069d0 msgr2=0x7f851c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f851c0069d0 0x7f851c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536a00640 1 -- 172.21.15.100:0/3220036336 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c005730 con 0x7f851c005e20 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8536000640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f851c0069d0 0x7f851c006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.865+0000 7f8537400640 1 -- 172.21.15.100:0/3220036336 reap_dead start 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.866+0000 7f8536a00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f851c006220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8528007f80 tx=0x7f851c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b56d6cbb7125fa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.866+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528005b90 con 0x7f851c005e20 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.866+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528005cf0 con 0x7f851c005e20 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.866+0000 7f8535600640 1 -- 172.21.15.100:0/3220036336 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280072b0 con 0x7f851c005e20 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 -- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 msgr2=0x7f851c006220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f851c006220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8528007f80 tx=0x7f851c007a00 comp rx=0 tx=0).stop 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 -- 172.21.15.100:0/3220036336 shutdown_connections 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 --2- 172.21.15.100:0/3220036336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f851c006220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 -- 172.21.15.100:0/3220036336 >> 172.21.15.100:0/3220036336 conn(0x7f85380f64a0 msgr2=0x7f85380f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 -- 172.21.15.100:0/3220036336 shutdown_connections 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.867+0000 7f8537e00640 1 -- 172.21.15.100:0/3220036336 wait complete. 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.869+0000 7f8537e00640 1 Processor -- start 2024-02-21T07:45:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.869+0000 7f8537e00640 1 -- start start 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 0x7f85380717b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8538071cf0 0x7f853816f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8538072180 con 0x7f851c005e20 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380726b0 con 0x7f8538071cf0 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8537e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380723d0 con 0x7f8538169520 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.870+0000 7f8536a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51406/0 (socket says 172.21.15.100:51406) 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 -- 172.21.15.100:0/2358262817 learned_addr learned my addr 172.21.15.100:0/2358262817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8537400640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8538071cf0 0x7f853816f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536000640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 0x7f85380717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 -- 172.21.15.100:0/2358262817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 msgr2=0x7f85380717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 0x7f85380717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 -- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8538071cf0 msgr2=0x7f853816f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8538071cf0 0x7f853816f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 -- 172.21.15.100:0/2358262817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853821fe40 con 0x7f851c005e20 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536000640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 0x7f85380717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8536a00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f852800c1d0 tx=0x7f852802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852803c040 con 0x7f851c005e20 2024-02-21T07:45:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528004bf0 con 0x7f851c005e20 2024-02-21T07:45:58.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8538220120 con 0x7f851c005e20 2024-02-21T07:45:58.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.871+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528005050 con 0x7f851c005e20 2024-02-21T07:45:58.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.872+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85382206e0 con 0x7f851c005e20 2024-02-21T07:45:58.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.873+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8538220870 con 0x7f851c005e20 2024-02-21T07:45:58.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.876+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8528032070 con 0x7f851c005e20 2024-02-21T07:45:58.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.877+0000 7f852ea00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 0x7f85180a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:58.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.877+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f85280eb260 con 0x7f851c005e20 2024-02-21T07:45:58.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.877+0000 7f8536000640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 0x7f85180a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:58.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.878+0000 7f8536000640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 0x7f85180a15f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f8524009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:58.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:58.879+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85280b5000 con 0x7f851c005e20 2024-02-21T07:45:59.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.057+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85380f5c00 con 0x7f851809f130 2024-02-21T07:45:59.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.068+0000 7f852ea00640 1 -- 172.21.15.100:0/2358262817 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367733 (secure 0 0 0) 0x7f8524001be0 con 0x7f851809f130 2024-02-21T07:45:59.078 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:59.080 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:45:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 msgr2=0x7f85180a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 0x7f85180a15f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8524000c00 tx=0x7f8524009040 comp rx=0 tx=0).stop 2024-02-21T07:45:59.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 msgr2=0x7f8538168fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f852800c1d0 tx=0x7f852802e070 comp rx=0 tx=0).stop 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 shutdown_connections 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8538071cf0 0x7f853816f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8538169520 0x7f85380717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f851809f130 0x7f85180a15f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 --2- 172.21.15.100:0/2358262817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f851c005e20 0x7f8538168fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 >> 172.21.15.100:0/2358262817 conn(0x7f85380f64a0 msgr2=0x7f85380f42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 shutdown_connections 2024-02-21T07:45:59.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.074+0000 7f8537e00640 1 -- 172.21.15.100:0/2358262817 wait complete. 2024-02-21T07:45:59.096 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-02-21T07:45:57.900701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635082,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":331,"num_write_kb":3028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":344632,"kb_used_data":3800,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1132117448,"statfs":{"total":1159641169920,"available":1159288266752,"internally_reserved":0,"allocated":3891200,"data_stored":2918360,"data_compressed":168240,"data_compressed_allocated":237568,"data_compressed_original":1441792,"omap_allocated":19141,"internal_metadata":348894523},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40215,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":103,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003641"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.411252+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:45:48.411252+0000","last_peered":"2024-02-21T07:45:48.411252+0000","last_clean":"2024-02-21T07:45:48.411252+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:45:48.411252+0000","last_undegraded":"2024-02-21T07:45:48.411252+0000","last_fullsized":"2024-02-21T07:45:48.411252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313026+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:45:31.313026+0000","last_peered":"2024-02-21T07:45:31.313026+0000","last_clean":"2024-02-21T07:45:31.313026+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:45:31.313026+0000","last_undegraded":"2024-02-21T07:45:31.313026+0000","last_fullsized":"2024-02-21T07:45:31.313026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306126+0000","last_change":"2024-02-21T07:45:30.324367+0000","last_active":"2024-02-21T07:45:31.306126+0000","last_peered":"2024-02-21T07:45:31.306126+0000","last_clean":"2024-02-21T07:45:31.306126+0000","last_became_active":"2024-02-21T07:45:30.324047+0000","last_became_peered":"2024-02-21T07:45:30.324047+0000","last_unstale":"2024-02-21T07:45:31.306126+0000","last_undegraded":"2024-02-21T07:45:31.306126+0000","last_fullsized":"2024-02-21T07:45:31.306126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313438+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:45:31.313438+0000","last_peered":"2024-02-21T07:45:31.313438+0000","last_clean":"2024-02-21T07:45:31.313438+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:45:31.313438+0000","last_undegraded":"2024-02-21T07:45:31.313438+0000","last_fullsized":"2024-02-21T07:45:31.313438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264335+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:45:32.264335+0000","last_peered":"2024-02-21T07:45:32.264335+0000","last_clean":"2024-02-21T07:45:32.264335+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:45:32.264335+0000","last_undegraded":"2024-02-21T07:45:32.264335+0000","last_fullsized":"2024-02-21T07:45:32.264335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263673+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:45:32.263673+0000","last_peered":"2024-02-21T07:45:32.263673+0000","last_clean":"2024-02-21T07:45:32.263673+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:45:32.263673+0000","last_undegraded":"2024-02-21T07:45:32.263673+0000","last_fullsized":"2024-02-21T07:45:32.263673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409242+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:45:48.409242+0000","last_peered":"2024-02-21T07:45:48.409242+0000","last_clean":"2024-02-21T07:45:48.409242+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:45:48.409242+0000","last_undegraded":"2024-02-21T07:45:48.409242+0000","last_fullsized":"2024-02-21T07:45:48.409242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263471+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:45:32.263471+0000","last_peered":"2024-02-21T07:45:32.263471+0000","last_clean":"2024-02-21T07:45:32.263471+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:45:32.263471+0000","last_undegraded":"2024-02-21T07:45:32.263471+0000","last_fullsized":"2024-02-21T07:45:32.263471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264669+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:45:32.264669+0000","last_peered":"2024-02-21T07:45:32.264669+0000","last_clean":"2024-02-21T07:45:32.264669+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:45:32.264669+0000","last_undegraded":"2024-02-21T07:45:32.264669+0000","last_fullsized":"2024-02-21T07:45:32.264669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229773+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:45:32.229773+0000","last_peered":"2024-02-21T07:45:32.229773+0000","last_clean":"2024-02-21T07:45:32.229773+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:45:32.229773+0000","last_undegraded":"2024-02-21T07:45:32.229773+0000","last_fullsized":"2024-02-21T07:45:32.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762184+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:45:31.762184+0000","last_peered":"2024-02-21T07:45:31.762184+0000","last_clean":"2024-02-21T07:45:31.762184+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:45:31.762184+0000","last_undegraded":"2024-02-21T07:45:31.762184+0000","last_fullsized":"2024-02-21T07:45:31.762184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264047+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:45:32.264047+0000","last_peered":"2024-02-21T07:45:32.264047+0000","last_clean":"2024-02-21T07:45:32.264047+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:45:32.264047+0000","last_undegraded":"2024-02-21T07:45:32.264047+0000","last_fullsized":"2024-02-21T07:45:32.264047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263973+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:45:32.263973+0000","last_peered":"2024-02-21T07:45:32.263973+0000","last_clean":"2024-02-21T07:45:32.263973+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:45:32.263973+0000","last_undegraded":"2024-02-21T07:45:32.263973+0000","last_fullsized":"2024-02-21T07:45:32.263973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399251+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:45:47.399251+0000","last_peered":"2024-02-21T07:45:47.399251+0000","last_clean":"2024-02-21T07:45:47.399251+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:45:47.399251+0000","last_undegraded":"2024-02-21T07:45:47.399251+0000","last_fullsized":"2024-02-21T07:45:47.399251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264118+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:45:32.264118+0000","last_peered":"2024-02-21T07:45:32.264118+0000","last_clean":"2024-02-21T07:45:32.264118+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:45:32.264118+0000","last_undegraded":"2024-02-21T07:45:32.264118+0000","last_fullsized":"2024-02-21T07:45:32.264118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312471+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:45:31.312471+0000","last_peered":"2024-02-21T07:45:31.312471+0000","last_clean":"2024-02-21T07:45:31.312471+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:45:31.312471+0000","last_undegraded":"2024-02-21T07:45:31.312471+0000","last_fullsized":"2024-02-21T07:45:31.312471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306617+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:45:31.306617+0000","last_peered":"2024-02-21T07:45:31.306617+0000","last_clean":"2024-02-21T07:45:31.306617+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:45:31.306617+0000","last_undegraded":"2024-02-21T07:45:31.306617+0000","last_fullsized":"2024-02-21T07:45:31.306617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:33.949812+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:45:33.949812+0000","last_peered":"2024-02-21T07:45:33.949812+0000","last_clean":"2024-02-21T07:45:33.949812+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:45:33.949812+0000","last_undegraded":"2024-02-21T07:45:33.949812+0000","last_fullsized":"2024-02-21T07:45:33.949812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306047+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:45:31.306047+0000","last_peered":"2024-02-21T07:45:31.306047+0000","last_clean":"2024-02-21T07:45:31.306047+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:45:31.306047+0000","last_undegraded":"2024-02-21T07:45:31.306047+0000","last_fullsized":"2024-02-21T07:45:31.306047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400352+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:45:47.400352+0000","last_peered":"2024-02-21T07:45:47.400352+0000","last_clean":"2024-02-21T07:45:47.400352+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:45:47.400352+0000","last_undegraded":"2024-02-21T07:45:47.400352+0000","last_fullsized":"2024-02-21T07:45:47.400352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264410+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:45:32.264410+0000","last_peered":"2024-02-21T07:45:32.264410+0000","last_clean":"2024-02-21T07:45:32.264410+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:45:32.264410+0000","last_undegraded":"2024-02-21T07:45:32.264410+0000","last_fullsized":"2024-02-21T07:45:32.264410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229409+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:45:32.229409+0000","last_peered":"2024-02-21T07:45:32.229409+0000","last_clean":"2024-02-21T07:45:32.229409+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:45:32.229409+0000","last_undegraded":"2024-02-21T07:45:32.229409+0000","last_fullsized":"2024-02-21T07:45:32.229409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398629+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:45:47.398629+0000","last_peered":"2024-02-21T07:45:47.398629+0000","last_clean":"2024-02-21T07:45:47.398629+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:45:47.398629+0000","last_undegraded":"2024-02-21T07:45:47.398629+0000","last_fullsized":"2024-02-21T07:45:47.398629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264395+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:45:32.264395+0000","last_peered":"2024-02-21T07:45:32.264395+0000","last_clean":"2024-02-21T07:45:32.264395+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:45:32.264395+0000","last_undegraded":"2024-02-21T07:45:32.264395+0000","last_fullsized":"2024-02-21T07:45:32.264395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264627+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:45:32.264627+0000","last_peered":"2024-02-21T07:45:32.264627+0000","last_clean":"2024-02-21T07:45:32.264627+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:45:32.264627+0000","last_undegraded":"2024-02-21T07:45:32.264627+0000","last_fullsized":"2024-02-21T07:45:32.264627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.396666+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:45:47.396666+0000","last_peered":"2024-02-21T07:45:47.396666+0000","last_clean":"2024-02-21T07:45:47.396666+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:45:47.396666+0000","last_undegraded":"2024-02-21T07:45:47.396666+0000","last_fullsized":"2024-02-21T07:45:47.396666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306822+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:45:31.306822+0000","last_peered":"2024-02-21T07:45:31.306822+0000","last_clean":"2024-02-21T07:45:31.306822+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:45:31.306822+0000","last_undegraded":"2024-02-21T07:45:31.306822+0000","last_fullsized":"2024-02-21T07:45:31.306822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313406+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:45:31.313406+0000","last_peered":"2024-02-21T07:45:31.313406+0000","last_clean":"2024-02-21T07:45:31.313406+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:45:31.313406+0000","last_undegraded":"2024-02-21T07:45:31.313406+0000","last_fullsized":"2024-02-21T07:45:31.313406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:51.284870+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:45:51.284870+0000","last_peered":"2024-02-21T07:45:51.284870+0000","last_clean":"2024-02-21T07:45:51.284870+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:45:51.284870+0000","last_undegraded":"2024-02-21T07:45:51.284870+0000","last_fullsized":"2024-02-21T07:45:51.284870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312329+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:45:31.312329+0000","last_peered":"2024-02-21T07:45:31.312329+0000","last_clean":"2024-02-21T07:45:31.312329+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:45:31.312329+0000","last_undegraded":"2024-02-21T07:45:31.312329+0000","last_fullsized":"2024-02-21T07:45:31.312329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310412+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:45:31.310412+0000","last_peered":"2024-02-21T07:45:31.310412+0000","last_clean":"2024-02-21T07:45:31.310412+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:45:31.310412+0000","last_undegraded":"2024-02-21T07:45:31.310412+0000","last_fullsized":"2024-02-21T07:45:31.310412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.401021+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:45:47.401021+0000","last_peered":"2024-02-21T07:45:47.401021+0000","last_clean":"2024-02-21T07:45:47.401021+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:45:47.401021+0000","last_undegraded":"2024-02-21T07:45:47.401021+0000","last_fullsized":"2024-02-21T07:45:47.401021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306080+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:45:31.306080+0000","last_peered":"2024-02-21T07:45:31.306080+0000","last_clean":"2024-02-21T07:45:31.306080+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:45:31.306080+0000","last_undegraded":"2024-02-21T07:45:31.306080+0000","last_fullsized":"2024-02-21T07:45:31.306080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264097+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:45:32.264097+0000","last_peered":"2024-02-21T07:45:32.264097+0000","last_clean":"2024-02-21T07:45:32.264097+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:45:32.264097+0000","last_undegraded":"2024-02-21T07:45:32.264097+0000","last_fullsized":"2024-02-21T07:45:32.264097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264234+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:45:32.264234+0000","last_peered":"2024-02-21T07:45:32.264234+0000","last_clean":"2024-02-21T07:45:32.264234+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:45:32.264234+0000","last_undegraded":"2024-02-21T07:45:32.264234+0000","last_fullsized":"2024-02-21T07:45:32.264234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229514+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:45:32.229514+0000","last_peered":"2024-02-21T07:45:32.229514+0000","last_clean":"2024-02-21T07:45:32.229514+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:45:32.229514+0000","last_undegraded":"2024-02-21T07:45:32.229514+0000","last_fullsized":"2024-02-21T07:45:32.229514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263819+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:45:32.263819+0000","last_peered":"2024-02-21T07:45:32.263819+0000","last_clean":"2024-02-21T07:45:32.263819+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:45:32.263819+0000","last_undegraded":"2024-02-21T07:45:32.263819+0000","last_fullsized":"2024-02-21T07:45:32.263819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264125+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:45:32.264125+0000","last_peered":"2024-02-21T07:45:32.264125+0000","last_clean":"2024-02-21T07:45:32.264125+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:45:32.264125+0000","last_undegraded":"2024-02-21T07:45:32.264125+0000","last_fullsized":"2024-02-21T07:45:32.264125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310149+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:45:31.310149+0000","last_peered":"2024-02-21T07:45:31.310149+0000","last_clean":"2024-02-21T07:45:31.310149+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:45:31.310149+0000","last_undegraded":"2024-02-21T07:45:31.310149+0000","last_fullsized":"2024-02-21T07:45:31.310149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762185+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:45:31.762185+0000","last_peered":"2024-02-21T07:45:31.762185+0000","last_clean":"2024-02-21T07:45:31.762185+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:45:31.762185+0000","last_undegraded":"2024-02-21T07:45:31.762185+0000","last_fullsized":"2024-02-21T07:45:31.762185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.428866+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:45:54.428866+0000","last_peered":"2024-02-21T07:45:54.428866+0000","last_clean":"2024-02-21T07:45:54.428866+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:45:54.428866+0000","last_undegraded":"2024-02-21T07:45:54.428866+0000","last_fullsized":"2024-02-21T07:45:54.428866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310755+0000","last_change":"2024-02-21T07:45:30.576741+0000","last_active":"2024-02-21T07:45:31.310755+0000","last_peered":"2024-02-21T07:45:31.310755+0000","last_clean":"2024-02-21T07:45:31.310755+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:45:31.310755+0000","last_undegraded":"2024-02-21T07:45:31.310755+0000","last_fullsized":"2024-02-21T07:45:31.310755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.308988+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:45:31.308988+0000","last_peered":"2024-02-21T07:45:31.308988+0000","last_clean":"2024-02-21T07:45:31.308988+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:45:31.308988+0000","last_undegraded":"2024-02-21T07:45:31.308988+0000","last_fullsized":"2024-02-21T07:45:31.308988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.408385+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:45:48.408385+0000","last_peered":"2024-02-21T07:45:48.408385+0000","last_clean":"2024-02-21T07:45:48.408385+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:45:48.408385+0000","last_undegraded":"2024-02-21T07:45:48.408385+0000","last_fullsized":"2024-02-21T07:45:48.408385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311908+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:45:31.311908+0000","last_peered":"2024-02-21T07:45:31.311908+0000","last_clean":"2024-02-21T07:45:31.311908+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:45:31.311908+0000","last_undegraded":"2024-02-21T07:45:31.311908+0000","last_fullsized":"2024-02-21T07:45:31.311908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.416028+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:45:49.416028+0000","last_peered":"2024-02-21T07:45:49.416028+0000","last_clean":"2024-02-21T07:45:49.416028+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:45:49.416028+0000","last_undegraded":"2024-02-21T07:45:49.416028+0000","last_fullsized":"2024-02-21T07:45:49.416028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263705+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:45:32.263705+0000","last_peered":"2024-02-21T07:45:32.263705+0000","last_clean":"2024-02-21T07:45:32.263705+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:45:32.263705+0000","last_undegraded":"2024-02-21T07:45:32.263705+0000","last_fullsized":"2024-02-21T07:45:32.263705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:33.943427+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:45:33.943427+0000","last_peered":"2024-02-21T07:45:33.943427+0000","last_clean":"2024-02-21T07:45:33.943427+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:45:33.943427+0000","last_undegraded":"2024-02-21T07:45:33.943427+0000","last_fullsized":"2024-02-21T07:45:33.943427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264905+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:45:32.264905+0000","last_peered":"2024-02-21T07:45:32.264905+0000","last_clean":"2024-02-21T07:45:32.264905+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:45:32.264905+0000","last_undegraded":"2024-02-21T07:45:32.264905+0000","last_fullsized":"2024-02-21T07:45:32.264905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410349+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:45:48.410349+0000","last_peered":"2024-02-21T07:45:48.410349+0000","last_clean":"2024-02-21T07:45:48.410349+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:45:48.410349+0000","last_undegraded":"2024-02-21T07:45:48.410349+0000","last_fullsized":"2024-02-21T07:45:48.410349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263291+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:45:32.263291+0000","last_peered":"2024-02-21T07:45:32.263291+0000","last_clean":"2024-02-21T07:45:32.263291+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:45:32.263291+0000","last_undegraded":"2024-02-21T07:45:32.263291+0000","last_fullsized":"2024-02-21T07:45:32.263291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762504+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:45:31.762504+0000","last_peered":"2024-02-21T07:45:31.762504+0000","last_clean":"2024-02-21T07:45:31.762504+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:45:31.762504+0000","last_undegraded":"2024-02-21T07:45:31.762504+0000","last_fullsized":"2024-02-21T07:45:31.762504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263867+0000","last_change":"2024-02-21T07:45:30.321767+0000","last_active":"2024-02-21T07:45:32.263867+0000","last_peered":"2024-02-21T07:45:32.263867+0000","last_clean":"2024-02-21T07:45:32.263867+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:45:32.263867+0000","last_undegraded":"2024-02-21T07:45:32.263867+0000","last_fullsized":"2024-02-21T07:45:32.263867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264766+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:45:32.264766+0000","last_peered":"2024-02-21T07:45:32.264766+0000","last_clean":"2024-02-21T07:45:32.264766+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:45:32.264766+0000","last_undegraded":"2024-02-21T07:45:32.264766+0000","last_fullsized":"2024-02-21T07:45:32.264766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310577+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:45:31.310577+0000","last_peered":"2024-02-21T07:45:31.310577+0000","last_clean":"2024-02-21T07:45:31.310577+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:45:31.310577+0000","last_undegraded":"2024-02-21T07:45:31.310577+0000","last_fullsized":"2024-02-21T07:45:31.310577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761881+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:45:31.761881+0000","last_peered":"2024-02-21T07:45:31.761881+0000","last_clean":"2024-02-21T07:45:31.761881+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:45:31.761881+0000","last_undegraded":"2024-02-21T07:45:31.761881+0000","last_fullsized":"2024-02-21T07:45:31.761881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306408+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:45:31.306408+0000","last_peered":"2024-02-21T07:45:31.306408+0000","last_clean":"2024-02-21T07:45:31.306408+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:45:31.306408+0000","last_undegraded":"2024-02-21T07:45:31.306408+0000","last_fullsized":"2024-02-21T07:45:31.306408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.406939+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:45:49.406939+0000","last_peered":"2024-02-21T07:45:49.406939+0000","last_clean":"2024-02-21T07:45:49.406939+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:45:49.406939+0000","last_undegraded":"2024-02-21T07:45:49.406939+0000","last_fullsized":"2024-02-21T07:45:49.406939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762042+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:45:31.762042+0000","last_peered":"2024-02-21T07:45:31.762042+0000","last_clean":"2024-02-21T07:45:31.762042+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:45:31.762042+0000","last_undegraded":"2024-02-21T07:45:31.762042+0000","last_fullsized":"2024-02-21T07:45:31.762042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762020+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:45:31.762020+0000","last_peered":"2024-02-21T07:45:31.762020+0000","last_clean":"2024-02-21T07:45:31.762020+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:45:31.762020+0000","last_undegraded":"2024-02-21T07:45:31.762020+0000","last_fullsized":"2024-02-21T07:45:31.762020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.415737+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:45:48.415737+0000","last_peered":"2024-02-21T07:45:48.415737+0000","last_clean":"2024-02-21T07:45:48.415737+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:45:48.415737+0000","last_undegraded":"2024-02-21T07:45:48.415737+0000","last_fullsized":"2024-02-21T07:45:48.415737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310469+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:45:31.310469+0000","last_peered":"2024-02-21T07:45:31.310469+0000","last_clean":"2024-02-21T07:45:31.310469+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:45:31.310469+0000","last_undegraded":"2024-02-21T07:45:31.310469+0000","last_fullsized":"2024-02-21T07:45:31.310469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263388+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:45:32.263388+0000","last_peered":"2024-02-21T07:45:32.263388+0000","last_clean":"2024-02-21T07:45:32.263388+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:45:32.263388+0000","last_undegraded":"2024-02-21T07:45:32.263388+0000","last_fullsized":"2024-02-21T07:45:32.263388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.429492+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:45:54.429492+0000","last_peered":"2024-02-21T07:45:54.429492+0000","last_clean":"2024-02-21T07:45:54.429492+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:45:54.429492+0000","last_undegraded":"2024-02-21T07:45:54.429492+0000","last_fullsized":"2024-02-21T07:45:54.429492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264171+0000","last_change":"2024-02-21T07:45:30.329832+0000","last_active":"2024-02-21T07:45:32.264171+0000","last_peered":"2024-02-21T07:45:32.264171+0000","last_clean":"2024-02-21T07:45:32.264171+0000","last_became_active":"2024-02-21T07:45:30.329423+0000","last_became_peered":"2024-02-21T07:45:30.329423+0000","last_unstale":"2024-02-21T07:45:32.264171+0000","last_undegraded":"2024-02-21T07:45:32.264171+0000","last_fullsized":"2024-02-21T07:45:32.264171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263472+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:45:32.263472+0000","last_peered":"2024-02-21T07:45:32.263472+0000","last_clean":"2024-02-21T07:45:32.263472+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:45:32.263472+0000","last_undegraded":"2024-02-21T07:45:32.263472+0000","last_fullsized":"2024-02-21T07:45:32.263472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400439+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:45:47.400439+0000","last_peered":"2024-02-21T07:45:47.400439+0000","last_clean":"2024-02-21T07:45:47.400439+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:45:47.400439+0000","last_undegraded":"2024-02-21T07:45:47.400439+0000","last_fullsized":"2024-02-21T07:45:47.400439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306127+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:45:31.306127+0000","last_peered":"2024-02-21T07:45:31.306127+0000","last_clean":"2024-02-21T07:45:31.306127+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:45:31.306127+0000","last_undegraded":"2024-02-21T07:45:31.306127+0000","last_fullsized":"2024-02-21T07:45:31.306127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309551+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:45:31.309551+0000","last_peered":"2024-02-21T07:45:31.309551+0000","last_clean":"2024-02-21T07:45:31.309551+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:45:31.309551+0000","last_undegraded":"2024-02-21T07:45:31.309551+0000","last_fullsized":"2024-02-21T07:45:31.309551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410590+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:45:48.410590+0000","last_peered":"2024-02-21T07:45:48.410590+0000","last_clean":"2024-02-21T07:45:48.410590+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:45:48.410590+0000","last_undegraded":"2024-02-21T07:45:48.410590+0000","last_fullsized":"2024-02-21T07:45:48.410590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762292+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:45:31.762292+0000","last_peered":"2024-02-21T07:45:31.762292+0000","last_clean":"2024-02-21T07:45:31.762292+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:45:31.762292+0000","last_undegraded":"2024-02-21T07:45:31.762292+0000","last_fullsized":"2024-02-21T07:45:31.762292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229733+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:45:32.229733+0000","last_peered":"2024-02-21T07:45:32.229733+0000","last_clean":"2024-02-21T07:45:32.229733+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:45:32.229733+0000","last_undegraded":"2024-02-21T07:45:32.229733+0000","last_fullsized":"2024-02-21T07:45:32.229733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:55.437246+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:45:55.437246+0000","last_peered":"2024-02-21T07:45:55.437246+0000","last_clean":"2024-02-21T07:45:55.437246+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:45:55.437246+0000","last_undegraded":"2024-02-21T07:45:55.437246+0000","last_fullsized":"2024-02-21T07:45:55.437246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40475,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":25,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263546+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:45:32.263546+0000","last_peered":"2024-02-21T07:45:32.263546+0000","last_clean":"2024-02-21T07:45:32.263546+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:45:32.263546+0000","last_undegraded":"2024-02-21T07:45:32.263546+0000","last_fullsized":"2024-02-21T07:45:32.263546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263563+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:45:32.263563+0000","last_peered":"2024-02-21T07:45:32.263563+0000","last_clean":"2024-02-21T07:45:32.263563+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:45:32.263563+0000","last_undegraded":"2024-02-21T07:45:32.263563+0000","last_fullsized":"2024-02-21T07:45:32.263563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400938+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:45:47.400938+0000","last_peered":"2024-02-21T07:45:47.400938+0000","last_clean":"2024-02-21T07:45:47.400938+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:45:47.400938+0000","last_undegraded":"2024-02-21T07:45:47.400938+0000","last_fullsized":"2024-02-21T07:45:47.400938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264880+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:45:32.264880+0000","last_peered":"2024-02-21T07:45:32.264880+0000","last_clean":"2024-02-21T07:45:32.264880+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:45:32.264880+0000","last_undegraded":"2024-02-21T07:45:32.264880+0000","last_fullsized":"2024-02-21T07:45:32.264880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398480+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:45:47.398480+0000","last_peered":"2024-02-21T07:45:47.398480+0000","last_clean":"2024-02-21T07:45:47.398480+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:45:47.398480+0000","last_undegraded":"2024-02-21T07:45:47.398480+0000","last_fullsized":"2024-02-21T07:45:47.398480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263330+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:45:32.263330+0000","last_peered":"2024-02-21T07:45:32.263330+0000","last_clean":"2024-02-21T07:45:32.263330+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:45:32.263330+0000","last_undegraded":"2024-02-21T07:45:32.263330+0000","last_fullsized":"2024-02-21T07:45:32.263330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263656+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:45:32.263656+0000","last_peered":"2024-02-21T07:45:32.263656+0000","last_clean":"2024-02-21T07:45:32.263656+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:45:32.263656+0000","last_undegraded":"2024-02-21T07:45:32.263656+0000","last_fullsized":"2024-02-21T07:45:32.263656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.426590+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:45:54.426590+0000","last_peered":"2024-02-21T07:45:54.426590+0000","last_clean":"2024-02-21T07:45:54.426590+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:45:54.426590+0000","last_undegraded":"2024-02-21T07:45:54.426590+0000","last_fullsized":"2024-02-21T07:45:54.426590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312070+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:45:31.312070+0000","last_peered":"2024-02-21T07:45:31.312070+0000","last_clean":"2024-02-21T07:45:31.312070+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:45:31.312070+0000","last_undegraded":"2024-02-21T07:45:31.312070+0000","last_fullsized":"2024-02-21T07:45:31.312070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264465+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:45:32.264465+0000","last_peered":"2024-02-21T07:45:32.264465+0000","last_clean":"2024-02-21T07:45:32.264465+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:45:32.264465+0000","last_undegraded":"2024-02-21T07:45:32.264465+0000","last_fullsized":"2024-02-21T07:45:32.264465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263376+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:45:32.263376+0000","last_peered":"2024-02-21T07:45:32.263376+0000","last_clean":"2024-02-21T07:45:32.263376+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:45:32.263376+0000","last_undegraded":"2024-02-21T07:45:32.263376+0000","last_fullsized":"2024-02-21T07:45:32.263376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762361+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:45:31.762361+0000","last_peered":"2024-02-21T07:45:31.762361+0000","last_clean":"2024-02-21T07:45:31.762361+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:45:31.762361+0000","last_undegraded":"2024-02-21T07:45:31.762361+0000","last_fullsized":"2024-02-21T07:45:31.762361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306530+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:45:31.306530+0000","last_peered":"2024-02-21T07:45:31.306530+0000","last_clean":"2024-02-21T07:45:31.306530+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:45:31.306530+0000","last_undegraded":"2024-02-21T07:45:31.306530+0000","last_fullsized":"2024-02-21T07:45:31.306530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312026+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:45:31.312026+0000","last_peered":"2024-02-21T07:45:31.312026+0000","last_clean":"2024-02-21T07:45:31.312026+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:45:31.312026+0000","last_undegraded":"2024-02-21T07:45:31.312026+0000","last_fullsized":"2024-02-21T07:45:31.312026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417019+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:45:48.417019+0000","last_peered":"2024-02-21T07:45:48.417019+0000","last_clean":"2024-02-21T07:45:48.417019+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:45:48.417019+0000","last_undegraded":"2024-02-21T07:45:48.417019+0000","last_fullsized":"2024-02-21T07:45:48.417019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409397+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:45:48.409397+0000","last_peered":"2024-02-21T07:45:48.409397+0000","last_clean":"2024-02-21T07:45:48.409397+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:45:48.409397+0000","last_undegraded":"2024-02-21T07:45:48.409397+0000","last_fullsized":"2024-02-21T07:45:48.409397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762120+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:45:31.762120+0000","last_peered":"2024-02-21T07:45:31.762120+0000","last_clean":"2024-02-21T07:45:31.762120+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:45:31.762120+0000","last_undegraded":"2024-02-21T07:45:31.762120+0000","last_fullsized":"2024-02-21T07:45:31.762120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306666+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:45:31.306666+0000","last_peered":"2024-02-21T07:45:31.306666+0000","last_clean":"2024-02-21T07:45:31.306666+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:45:31.306666+0000","last_undegraded":"2024-02-21T07:45:31.306666+0000","last_fullsized":"2024-02-21T07:45:31.306666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.427270+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:45:54.427270+0000","last_peered":"2024-02-21T07:45:54.427270+0000","last_clean":"2024-02-21T07:45:54.427270+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:45:54.427270+0000","last_undegraded":"2024-02-21T07:45:54.427270+0000","last_fullsized":"2024-02-21T07:45:54.427270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229535+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:45:32.229535+0000","last_peered":"2024-02-21T07:45:32.229535+0000","last_clean":"2024-02-21T07:45:32.229535+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:45:32.229535+0000","last_undegraded":"2024-02-21T07:45:32.229535+0000","last_fullsized":"2024-02-21T07:45:32.229535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307101+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:45:31.307101+0000","last_peered":"2024-02-21T07:45:31.307101+0000","last_clean":"2024-02-21T07:45:31.307101+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:45:31.307101+0000","last_undegraded":"2024-02-21T07:45:31.307101+0000","last_fullsized":"2024-02-21T07:45:31.307101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306135+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:45:31.306135+0000","last_peered":"2024-02-21T07:45:31.306135+0000","last_clean":"2024-02-21T07:45:31.306135+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:45:31.306135+0000","last_undegraded":"2024-02-21T07:45:31.306135+0000","last_fullsized":"2024-02-21T07:45:31.306135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306468+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:45:31.306468+0000","last_peered":"2024-02-21T07:45:31.306468+0000","last_clean":"2024-02-21T07:45:31.306468+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:45:31.306468+0000","last_undegraded":"2024-02-21T07:45:31.306468+0000","last_fullsized":"2024-02-21T07:45:31.306468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263724+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:45:32.263724+0000","last_peered":"2024-02-21T07:45:32.263724+0000","last_clean":"2024-02-21T07:45:32.263724+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:45:32.263724+0000","last_undegraded":"2024-02-21T07:45:32.263724+0000","last_fullsized":"2024-02-21T07:45:32.263724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310293+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:45:31.310293+0000","last_peered":"2024-02-21T07:45:31.310293+0000","last_clean":"2024-02-21T07:45:31.310293+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:45:31.310293+0000","last_undegraded":"2024-02-21T07:45:31.310293+0000","last_fullsized":"2024-02-21T07:45:31.310293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306405+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:45:31.306405+0000","last_peered":"2024-02-21T07:45:31.306405+0000","last_clean":"2024-02-21T07:45:31.306405+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:45:31.306405+0000","last_undegraded":"2024-02-21T07:45:31.306405+0000","last_fullsized":"2024-02-21T07:45:31.306405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313391+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:45:31.313391+0000","last_peered":"2024-02-21T07:45:31.313391+0000","last_clean":"2024-02-21T07:45:31.313391+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:45:31.313391+0000","last_undegraded":"2024-02-21T07:45:31.313391+0000","last_fullsized":"2024-02-21T07:45:31.313391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761962+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:45:31.761962+0000","last_peered":"2024-02-21T07:45:31.761962+0000","last_clean":"2024-02-21T07:45:31.761962+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:45:31.761962+0000","last_undegraded":"2024-02-21T07:45:31.761962+0000","last_fullsized":"2024-02-21T07:45:31.761962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312075+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:45:31.312075+0000","last_peered":"2024-02-21T07:45:31.312075+0000","last_clean":"2024-02-21T07:45:31.312075+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:45:31.312075+0000","last_undegraded":"2024-02-21T07:45:31.312075+0000","last_fullsized":"2024-02-21T07:45:31.312075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263718+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:45:32.263718+0000","last_peered":"2024-02-21T07:45:32.263718+0000","last_clean":"2024-02-21T07:45:32.263718+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:45:32.263718+0000","last_undegraded":"2024-02-21T07:45:32.263718+0000","last_fullsized":"2024-02-21T07:45:32.263718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309927+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:45:31.309927+0000","last_peered":"2024-02-21T07:45:31.309927+0000","last_clean":"2024-02-21T07:45:31.309927+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:45:31.309927+0000","last_undegraded":"2024-02-21T07:45:31.309927+0000","last_fullsized":"2024-02-21T07:45:31.309927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306150+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:45:31.306150+0000","last_peered":"2024-02-21T07:45:31.306150+0000","last_clean":"2024-02-21T07:45:31.306150+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:45:31.306150+0000","last_undegraded":"2024-02-21T07:45:31.306150+0000","last_fullsized":"2024-02-21T07:45:31.306150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307003+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:45:31.307003+0000","last_peered":"2024-02-21T07:45:31.307003+0000","last_clean":"2024-02-21T07:45:31.307003+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:45:31.307003+0000","last_undegraded":"2024-02-21T07:45:31.307003+0000","last_fullsized":"2024-02-21T07:45:31.307003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264340+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:45:32.264340+0000","last_peered":"2024-02-21T07:45:32.264340+0000","last_clean":"2024-02-21T07:45:32.264340+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:45:32.264340+0000","last_undegraded":"2024-02-21T07:45:32.264340+0000","last_fullsized":"2024-02-21T07:45:32.264340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306653+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:45:31.306653+0000","last_peered":"2024-02-21T07:45:31.306653+0000","last_clean":"2024-02-21T07:45:31.306653+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:45:31.306653+0000","last_undegraded":"2024-02-21T07:45:31.306653+0000","last_fullsized":"2024-02-21T07:45:31.306653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263066+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:45:32.263066+0000","last_peered":"2024-02-21T07:45:32.263066+0000","last_clean":"2024-02-21T07:45:32.263066+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:45:32.263066+0000","last_undegraded":"2024-02-21T07:45:32.263066+0000","last_fullsized":"2024-02-21T07:45:32.263066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263638+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:45:32.263638+0000","last_peered":"2024-02-21T07:45:32.263638+0000","last_clean":"2024-02-21T07:45:32.263638+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:45:32.263638+0000","last_undegraded":"2024-02-21T07:45:32.263638+0000","last_fullsized":"2024-02-21T07:45:32.263638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263493+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:45:32.263493+0000","last_peered":"2024-02-21T07:45:32.263493+0000","last_clean":"2024-02-21T07:45:32.263493+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:45:32.263493+0000","last_undegraded":"2024-02-21T07:45:32.263493+0000","last_fullsized":"2024-02-21T07:45:32.263493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309714+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:45:31.309714+0000","last_peered":"2024-02-21T07:45:31.309714+0000","last_clean":"2024-02-21T07:45:31.309714+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:45:31.309714+0000","last_undegraded":"2024-02-21T07:45:31.309714+0000","last_fullsized":"2024-02-21T07:45:31.309714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264668+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:45:32.264668+0000","last_peered":"2024-02-21T07:45:32.264668+0000","last_clean":"2024-02-21T07:45:32.264668+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:45:32.264668+0000","last_undegraded":"2024-02-21T07:45:32.264668+0000","last_fullsized":"2024-02-21T07:45:32.264668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264939+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:45:32.264939+0000","last_peered":"2024-02-21T07:45:32.264939+0000","last_clean":"2024-02-21T07:45:32.264939+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:45:32.264939+0000","last_undegraded":"2024-02-21T07:45:32.264939+0000","last_fullsized":"2024-02-21T07:45:32.264939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264424+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:45:32.264424+0000","last_peered":"2024-02-21T07:45:32.264424+0000","last_clean":"2024-02-21T07:45:32.264424+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:45:32.264424+0000","last_undegraded":"2024-02-21T07:45:32.264424+0000","last_fullsized":"2024-02-21T07:45:32.264424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264005+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:45:32.264005+0000","last_peered":"2024-02-21T07:45:32.264005+0000","last_clean":"2024-02-21T07:45:32.264005+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:45:32.264005+0000","last_undegraded":"2024-02-21T07:45:32.264005+0000","last_fullsized":"2024-02-21T07:45:32.264005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311690+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:45:31.311690+0000","last_peered":"2024-02-21T07:45:31.311690+0000","last_clean":"2024-02-21T07:45:31.311690+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:45:31.311690+0000","last_undegraded":"2024-02-21T07:45:31.311690+0000","last_fullsized":"2024-02-21T07:45:31.311690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263714+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:45:32.263714+0000","last_peered":"2024-02-21T07:45:32.263714+0000","last_clean":"2024-02-21T07:45:32.263714+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:45:32.263714+0000","last_undegraded":"2024-02-21T07:45:32.263714+0000","last_fullsized":"2024-02-21T07:45:32.263714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.262967+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:45:32.262967+0000","last_peered":"2024-02-21T07:45:32.262967+0000","last_clean":"2024-02-21T07:45:32.262967+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:45:32.262967+0000","last_undegraded":"2024-02-21T07:45:32.262967+0000","last_fullsized":"2024-02-21T07:45:32.262967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229582+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:45:32.229582+0000","last_peered":"2024-02-21T07:45:32.229582+0000","last_clean":"2024-02-21T07:45:32.229582+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:45:32.229582+0000","last_undegraded":"2024-02-21T07:45:32.229582+0000","last_fullsized":"2024-02-21T07:45:32.229582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264570+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:45:32.264570+0000","last_peered":"2024-02-21T07:45:32.264570+0000","last_clean":"2024-02-21T07:45:32.264570+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:45:32.264570+0000","last_undegraded":"2024-02-21T07:45:32.264570+0000","last_fullsized":"2024-02-21T07:45:32.264570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264582+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:45:32.264582+0000","last_peered":"2024-02-21T07:45:32.264582+0000","last_clean":"2024-02-21T07:45:32.264582+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:45:32.264582+0000","last_undegraded":"2024-02-21T07:45:32.264582+0000","last_fullsized":"2024-02-21T07:45:32.264582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264526+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:45:32.264526+0000","last_peered":"2024-02-21T07:45:32.264526+0000","last_clean":"2024-02-21T07:45:32.264526+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:45:32.264526+0000","last_undegraded":"2024-02-21T07:45:32.264526+0000","last_fullsized":"2024-02-21T07:45:32.264526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306596+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:45:31.306596+0000","last_peered":"2024-02-21T07:45:31.306596+0000","last_clean":"2024-02-21T07:45:31.306596+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:45:31.306596+0000","last_undegraded":"2024-02-21T07:45:31.306596+0000","last_fullsized":"2024-02-21T07:45:31.306596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44480,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":148,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":88960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":139336,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":175361,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":143522,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7689999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.964}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":138910,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":372736,"data_stored":734388,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":6,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":134748,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":389120,"data_stored":730993,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":139376,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":134838,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1320000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2040000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0099999999999998}]}]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":136291,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":175133,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7679999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":0,"up_from":17,"seq":73014444042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":135464,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":40475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":40703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:45:59.102 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:45:59.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.342+0000 7f75c5000640 1 Processor -- start 2024-02-21T07:45:59.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.342+0000 7f75c5000640 1 -- start start 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75c5000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75c017c040 0x7f75c00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75c5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f75c0070f30 0x7f75c00713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75c5000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c00f50d0 con 0x7f75c0188c00 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75c5000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c00f4ec0 con 0x7f75c0070f30 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75c5000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c00f6450 con 0x7f75c017c040 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75bde00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75c017c040 0x7f75c00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75bde00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f75c017c040 0x7f75c00706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35248/0 (socket says 172.21.15.100:35248) 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75bde00640 1 -- 172.21.15.100:0/2297544906 learned_addr learned my addr 172.21.15.100:0/2297544906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.344+0000 7f75b7e00640 1 --2- 172.21.15.100:0/2297544906 >> v2:172.21.15.100:3300/0 conn(0x7f75c0070f30 0x7f75c00713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.345+0000 7f75bde00640 1 -- 172.21.15.100:0/2297544906 >> v2:172.21.15.100:3300/0 conn(0x7f75c0070f30 msgr2=0x7f75c00713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.345+0000 7f75bde00640 1 --2- 172.21.15.100:0/2297544906 >> v2:172.21.15.100:3300/0 conn(0x7f75c0070f30 0x7f75c00713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.345+0000 7f75bde00640 1 -- 172.21.15.100:0/2297544906 >> v1:172.21.15.170:6789/0 conn(0x7f75c0188c00 legacy=0x7f75c0189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.345+0000 7f75bde00640 1 -- 172.21.15.100:0/2297544906 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00f53b0 con 0x7f75c017c040 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.346+0000 7f75bde00640 1 --2- 172.21.15.100:0/2297544906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c017c040 0x7f75c00706b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009870 tx=0x7f75b002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62b581cce9e4d81b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.346+0000 7f75bd400640 1 -- 172.21.15.100:0/2297544906 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b002f850 con 0x7f75c017c040 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.346+0000 7f75bd400640 1 -- 172.21.15.100:0/2297544906 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b002f9b0 con 0x7f75c017c040 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.346+0000 7f75bd400640 1 -- 172.21.15.100:0/2297544906 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b002fd40 con 0x7f75c017c040 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 -- 172.21.15.100:0/2297544906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c017c040 msgr2=0x7f75c00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 --2- 172.21.15.100:0/2297544906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c017c040 0x7f75c00706b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009870 tx=0x7f75b002ba30 comp rx=0 tx=0).stop 2024-02-21T07:45:59.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 -- 172.21.15.100:0/2297544906 shutdown_connections 2024-02-21T07:45:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 --2- 172.21.15.100:0/2297544906 >> v2:172.21.15.100:3300/0 conn(0x7f75c0070f30 0x7f75c00713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 --2- 172.21.15.100:0/2297544906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c017c040 0x7f75c00706b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 -- 172.21.15.100:0/2297544906 >> 172.21.15.100:0/2297544906 conn(0x7f75c00ce160 msgr2=0x7f75c00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 -- 172.21.15.100:0/2297544906 shutdown_connections 2024-02-21T07:45:59.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.347+0000 7f75c5000640 1 -- 172.21.15.100:0/2297544906 wait complete. 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.349+0000 7f75c5000640 1 Processor -- start 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.349+0000 7f75c5000640 1 -- start start 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c0070f30 0x7f75c021c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c0188c00 0x7f75c0173250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c01759c0 con 0x7f75c017c040 2024-02-21T07:45:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0220120 con 0x7f75c0070f30 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75c5000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0220400 con 0x7f75c0188c00 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51418/0 (socket says 172.21.15.100:51418) 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75b7e00640 1 -- 172.21.15.100:0/1383041296 learned_addr learned my addr 172.21.15.100:0/1383041296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.350+0000 7f75bde00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c0070f30 0x7f75c021c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75be800640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c0188c00 0x7f75c0173250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 -- 172.21.15.100:0/1383041296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c0188c00 msgr2=0x7f75c0173250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c0188c00 0x7f75c0173250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 -- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c0070f30 msgr2=0x7f75c021c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c0070f30 0x7f75c021c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 -- 172.21.15.100:0/1383041296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b00094d0 con 0x7f75c017c040 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b7e00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d800 tx=0x7f75a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800b6c0 con 0x7f75c017c040 2024-02-21T07:45:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a800b820 con 0x7f75c017c040 2024-02-21T07:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.351+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800bbb0 con 0x7f75c017c040 2024-02-21T07:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.352+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c02206e0 con 0x7f75c017c040 2024-02-21T07:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.352+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c0220ca0 con 0x7f75c017c040 2024-02-21T07:45:59.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.353+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c0067c80 con 0x7f75c017c040 2024-02-21T07:45:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.354+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f75a800bd10 con 0x7f75c017c040 2024-02-21T07:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.356+0000 7f75b6000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 0x7f759c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.356+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f75a80ca070 con 0x7f75c017c040 2024-02-21T07:45:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.356+0000 7f75bde00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 0x7f759c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.357+0000 7f75bde00640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 0x7f759c0a15f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75b0036000 tx=0x7f75b0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.360+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75a80fd8c0 con 0x7f75c017c040 2024-02-21T07:45:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.553+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75c00f5c50 con 0x7f759c09f130 2024-02-21T07:45:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.565+0000 7f75b6000640 1 -- 172.21.15.100:0/1383041296 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367733 (secure 0 0 0) 0x7f75b002fb20 con 0x7f759c09f130 2024-02-21T07:45:59.576 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:45:59.578 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:45:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 msgr2=0x7f759c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 0x7f759c0a15f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f75b0036000 tx=0x7f75b0008030 comp rx=0 tx=0).stop 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 msgr2=0x7f75c02214a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d800 tx=0x7f75a800dcc0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 shutdown_connections 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75c0188c00 0x7f75c0173250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f759c09f130 0x7f759c0a15f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75c017c040 0x7f75c02214a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 --2- 172.21.15.100:0/1383041296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75c0070f30 0x7f75c021c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.572+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 >> 172.21.15.100:0/1383041296 conn(0x7f75c00ce160 msgr2=0x7f75c00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.573+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 shutdown_connections 2024-02-21T07:45:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.573+0000 7f75c5000640 1 -- 172.21.15.100:0/1383041296 wait complete. 2024-02-21T07:45:59.599 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-02-21T07:45:57.900701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635082,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":191,"num_read_kb":190,"num_write":331,"num_write_kb":3028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":344632,"kb_used_data":3800,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1132117448,"statfs":{"total":1159641169920,"available":1159288266752,"internally_reserved":0,"allocated":3891200,"data_stored":2918360,"data_compressed":168240,"data_compressed_allocated":237568,"data_compressed_original":1441792,"omap_allocated":19141,"internal_metadata":348894523},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40215,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":103,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003641"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.411252+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:45:48.411252+0000","last_peered":"2024-02-21T07:45:48.411252+0000","last_clean":"2024-02-21T07:45:48.411252+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:45:48.411252+0000","last_undegraded":"2024-02-21T07:45:48.411252+0000","last_fullsized":"2024-02-21T07:45:48.411252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313026+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:45:31.313026+0000","last_peered":"2024-02-21T07:45:31.313026+0000","last_clean":"2024-02-21T07:45:31.313026+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:45:31.313026+0000","last_undegraded":"2024-02-21T07:45:31.313026+0000","last_fullsized":"2024-02-21T07:45:31.313026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306126+0000","last_change":"2024-02-21T07:45:30.324367+0000","last_active":"2024-02-21T07:45:31.306126+0000","last_peered":"2024-02-21T07:45:31.306126+0000","last_clean":"2024-02-21T07:45:31.306126+0000","last_became_active":"2024-02-21T07:45:30.324047+0000","last_became_peered":"2024-02-21T07:45:30.324047+0000","last_unstale":"2024-02-21T07:45:31.306126+0000","last_undegraded":"2024-02-21T07:45:31.306126+0000","last_fullsized":"2024-02-21T07:45:31.306126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313438+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:45:31.313438+0000","last_peered":"2024-02-21T07:45:31.313438+0000","last_clean":"2024-02-21T07:45:31.313438+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:45:31.313438+0000","last_undegraded":"2024-02-21T07:45:31.313438+0000","last_fullsized":"2024-02-21T07:45:31.313438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264335+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:45:32.264335+0000","last_peered":"2024-02-21T07:45:32.264335+0000","last_clean":"2024-02-21T07:45:32.264335+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:45:32.264335+0000","last_undegraded":"2024-02-21T07:45:32.264335+0000","last_fullsized":"2024-02-21T07:45:32.264335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263673+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:45:32.263673+0000","last_peered":"2024-02-21T07:45:32.263673+0000","last_clean":"2024-02-21T07:45:32.263673+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:45:32.263673+0000","last_undegraded":"2024-02-21T07:45:32.263673+0000","last_fullsized":"2024-02-21T07:45:32.263673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409242+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:45:48.409242+0000","last_peered":"2024-02-21T07:45:48.409242+0000","last_clean":"2024-02-21T07:45:48.409242+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:45:48.409242+0000","last_undegraded":"2024-02-21T07:45:48.409242+0000","last_fullsized":"2024-02-21T07:45:48.409242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263471+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:45:32.263471+0000","last_peered":"2024-02-21T07:45:32.263471+0000","last_clean":"2024-02-21T07:45:32.263471+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:45:32.263471+0000","last_undegraded":"2024-02-21T07:45:32.263471+0000","last_fullsized":"2024-02-21T07:45:32.263471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264669+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:45:32.264669+0000","last_peered":"2024-02-21T07:45:32.264669+0000","last_clean":"2024-02-21T07:45:32.264669+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:45:32.264669+0000","last_undegraded":"2024-02-21T07:45:32.264669+0000","last_fullsized":"2024-02-21T07:45:32.264669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229773+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:45:32.229773+0000","last_peered":"2024-02-21T07:45:32.229773+0000","last_clean":"2024-02-21T07:45:32.229773+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:45:32.229773+0000","last_undegraded":"2024-02-21T07:45:32.229773+0000","last_fullsized":"2024-02-21T07:45:32.229773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762184+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:45:31.762184+0000","last_peered":"2024-02-21T07:45:31.762184+0000","last_clean":"2024-02-21T07:45:31.762184+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:45:31.762184+0000","last_undegraded":"2024-02-21T07:45:31.762184+0000","last_fullsized":"2024-02-21T07:45:31.762184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264047+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:45:32.264047+0000","last_peered":"2024-02-21T07:45:32.264047+0000","last_clean":"2024-02-21T07:45:32.264047+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:45:32.264047+0000","last_undegraded":"2024-02-21T07:45:32.264047+0000","last_fullsized":"2024-02-21T07:45:32.264047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263973+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:45:32.263973+0000","last_peered":"2024-02-21T07:45:32.263973+0000","last_clean":"2024-02-21T07:45:32.263973+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:45:32.263973+0000","last_undegraded":"2024-02-21T07:45:32.263973+0000","last_fullsized":"2024-02-21T07:45:32.263973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.399251+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:45:47.399251+0000","last_peered":"2024-02-21T07:45:47.399251+0000","last_clean":"2024-02-21T07:45:47.399251+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:45:47.399251+0000","last_undegraded":"2024-02-21T07:45:47.399251+0000","last_fullsized":"2024-02-21T07:45:47.399251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264118+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:45:32.264118+0000","last_peered":"2024-02-21T07:45:32.264118+0000","last_clean":"2024-02-21T07:45:32.264118+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:45:32.264118+0000","last_undegraded":"2024-02-21T07:45:32.264118+0000","last_fullsized":"2024-02-21T07:45:32.264118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312471+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:45:31.312471+0000","last_peered":"2024-02-21T07:45:31.312471+0000","last_clean":"2024-02-21T07:45:31.312471+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:45:31.312471+0000","last_undegraded":"2024-02-21T07:45:31.312471+0000","last_fullsized":"2024-02-21T07:45:31.312471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306617+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:45:31.306617+0000","last_peered":"2024-02-21T07:45:31.306617+0000","last_clean":"2024-02-21T07:45:31.306617+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:45:31.306617+0000","last_undegraded":"2024-02-21T07:45:31.306617+0000","last_fullsized":"2024-02-21T07:45:31.306617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:33.949812+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:45:33.949812+0000","last_peered":"2024-02-21T07:45:33.949812+0000","last_clean":"2024-02-21T07:45:33.949812+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:45:33.949812+0000","last_undegraded":"2024-02-21T07:45:33.949812+0000","last_fullsized":"2024-02-21T07:45:33.949812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306047+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:45:31.306047+0000","last_peered":"2024-02-21T07:45:31.306047+0000","last_clean":"2024-02-21T07:45:31.306047+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:45:31.306047+0000","last_undegraded":"2024-02-21T07:45:31.306047+0000","last_fullsized":"2024-02-21T07:45:31.306047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400352+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:45:47.400352+0000","last_peered":"2024-02-21T07:45:47.400352+0000","last_clean":"2024-02-21T07:45:47.400352+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:45:47.400352+0000","last_undegraded":"2024-02-21T07:45:47.400352+0000","last_fullsized":"2024-02-21T07:45:47.400352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264410+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:45:32.264410+0000","last_peered":"2024-02-21T07:45:32.264410+0000","last_clean":"2024-02-21T07:45:32.264410+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:45:32.264410+0000","last_undegraded":"2024-02-21T07:45:32.264410+0000","last_fullsized":"2024-02-21T07:45:32.264410+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229409+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:45:32.229409+0000","last_peered":"2024-02-21T07:45:32.229409+0000","last_clean":"2024-02-21T07:45:32.229409+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:45:32.229409+0000","last_undegraded":"2024-02-21T07:45:32.229409+0000","last_fullsized":"2024-02-21T07:45:32.229409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398629+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:45:47.398629+0000","last_peered":"2024-02-21T07:45:47.398629+0000","last_clean":"2024-02-21T07:45:47.398629+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:45:47.398629+0000","last_undegraded":"2024-02-21T07:45:47.398629+0000","last_fullsized":"2024-02-21T07:45:47.398629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264395+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:45:32.264395+0000","last_peered":"2024-02-21T07:45:32.264395+0000","last_clean":"2024-02-21T07:45:32.264395+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:45:32.264395+0000","last_undegraded":"2024-02-21T07:45:32.264395+0000","last_fullsized":"2024-02-21T07:45:32.264395+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264627+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:45:32.264627+0000","last_peered":"2024-02-21T07:45:32.264627+0000","last_clean":"2024-02-21T07:45:32.264627+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:45:32.264627+0000","last_undegraded":"2024-02-21T07:45:32.264627+0000","last_fullsized":"2024-02-21T07:45:32.264627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.396666+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:45:47.396666+0000","last_peered":"2024-02-21T07:45:47.396666+0000","last_clean":"2024-02-21T07:45:47.396666+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:45:47.396666+0000","last_undegraded":"2024-02-21T07:45:47.396666+0000","last_fullsized":"2024-02-21T07:45:47.396666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306822+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:45:31.306822+0000","last_peered":"2024-02-21T07:45:31.306822+0000","last_clean":"2024-02-21T07:45:31.306822+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:45:31.306822+0000","last_undegraded":"2024-02-21T07:45:31.306822+0000","last_fullsized":"2024-02-21T07:45:31.306822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313406+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:45:31.313406+0000","last_peered":"2024-02-21T07:45:31.313406+0000","last_clean":"2024-02-21T07:45:31.313406+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:45:31.313406+0000","last_undegraded":"2024-02-21T07:45:31.313406+0000","last_fullsized":"2024-02-21T07:45:31.313406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:51.284870+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:45:51.284870+0000","last_peered":"2024-02-21T07:45:51.284870+0000","last_clean":"2024-02-21T07:45:51.284870+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:45:51.284870+0000","last_undegraded":"2024-02-21T07:45:51.284870+0000","last_fullsized":"2024-02-21T07:45:51.284870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312329+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:45:31.312329+0000","last_peered":"2024-02-21T07:45:31.312329+0000","last_clean":"2024-02-21T07:45:31.312329+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:45:31.312329+0000","last_undegraded":"2024-02-21T07:45:31.312329+0000","last_fullsized":"2024-02-21T07:45:31.312329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310412+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:45:31.310412+0000","last_peered":"2024-02-21T07:45:31.310412+0000","last_clean":"2024-02-21T07:45:31.310412+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:45:31.310412+0000","last_undegraded":"2024-02-21T07:45:31.310412+0000","last_fullsized":"2024-02-21T07:45:31.310412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.401021+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:45:47.401021+0000","last_peered":"2024-02-21T07:45:47.401021+0000","last_clean":"2024-02-21T07:45:47.401021+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:45:47.401021+0000","last_undegraded":"2024-02-21T07:45:47.401021+0000","last_fullsized":"2024-02-21T07:45:47.401021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306080+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:45:31.306080+0000","last_peered":"2024-02-21T07:45:31.306080+0000","last_clean":"2024-02-21T07:45:31.306080+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:45:31.306080+0000","last_undegraded":"2024-02-21T07:45:31.306080+0000","last_fullsized":"2024-02-21T07:45:31.306080+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264097+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:45:32.264097+0000","last_peered":"2024-02-21T07:45:32.264097+0000","last_clean":"2024-02-21T07:45:32.264097+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:45:32.264097+0000","last_undegraded":"2024-02-21T07:45:32.264097+0000","last_fullsized":"2024-02-21T07:45:32.264097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264234+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:45:32.264234+0000","last_peered":"2024-02-21T07:45:32.264234+0000","last_clean":"2024-02-21T07:45:32.264234+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:45:32.264234+0000","last_undegraded":"2024-02-21T07:45:32.264234+0000","last_fullsized":"2024-02-21T07:45:32.264234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229514+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:45:32.229514+0000","last_peered":"2024-02-21T07:45:32.229514+0000","last_clean":"2024-02-21T07:45:32.229514+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:45:32.229514+0000","last_undegraded":"2024-02-21T07:45:32.229514+0000","last_fullsized":"2024-02-21T07:45:32.229514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263819+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:45:32.263819+0000","last_peered":"2024-02-21T07:45:32.263819+0000","last_clean":"2024-02-21T07:45:32.263819+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:45:32.263819+0000","last_undegraded":"2024-02-21T07:45:32.263819+0000","last_fullsized":"2024-02-21T07:45:32.263819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264125+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:45:32.264125+0000","last_peered":"2024-02-21T07:45:32.264125+0000","last_clean":"2024-02-21T07:45:32.264125+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:45:32.264125+0000","last_undegraded":"2024-02-21T07:45:32.264125+0000","last_fullsized":"2024-02-21T07:45:32.264125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310149+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:45:31.310149+0000","last_peered":"2024-02-21T07:45:31.310149+0000","last_clean":"2024-02-21T07:45:31.310149+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:45:31.310149+0000","last_undegraded":"2024-02-21T07:45:31.310149+0000","last_fullsized":"2024-02-21T07:45:31.310149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762185+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:45:31.762185+0000","last_peered":"2024-02-21T07:45:31.762185+0000","last_clean":"2024-02-21T07:45:31.762185+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:45:31.762185+0000","last_undegraded":"2024-02-21T07:45:31.762185+0000","last_fullsized":"2024-02-21T07:45:31.762185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.428866+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:45:54.428866+0000","last_peered":"2024-02-21T07:45:54.428866+0000","last_clean":"2024-02-21T07:45:54.428866+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:45:54.428866+0000","last_undegraded":"2024-02-21T07:45:54.428866+0000","last_fullsized":"2024-02-21T07:45:54.428866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310755+0000","last_change":"2024-02-21T07:45:30.576741+0000","last_active":"2024-02-21T07:45:31.310755+0000","last_peered":"2024-02-21T07:45:31.310755+0000","last_clean":"2024-02-21T07:45:31.310755+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:45:31.310755+0000","last_undegraded":"2024-02-21T07:45:31.310755+0000","last_fullsized":"2024-02-21T07:45:31.310755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.308988+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:45:31.308988+0000","last_peered":"2024-02-21T07:45:31.308988+0000","last_clean":"2024-02-21T07:45:31.308988+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:45:31.308988+0000","last_undegraded":"2024-02-21T07:45:31.308988+0000","last_fullsized":"2024-02-21T07:45:31.308988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.408385+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:45:48.408385+0000","last_peered":"2024-02-21T07:45:48.408385+0000","last_clean":"2024-02-21T07:45:48.408385+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:45:48.408385+0000","last_undegraded":"2024-02-21T07:45:48.408385+0000","last_fullsized":"2024-02-21T07:45:48.408385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762444+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:45:31.762444+0000","last_peered":"2024-02-21T07:45:31.762444+0000","last_clean":"2024-02-21T07:45:31.762444+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:45:31.762444+0000","last_undegraded":"2024-02-21T07:45:31.762444+0000","last_fullsized":"2024-02-21T07:45:31.762444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311908+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:45:31.311908+0000","last_peered":"2024-02-21T07:45:31.311908+0000","last_clean":"2024-02-21T07:45:31.311908+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:45:31.311908+0000","last_undegraded":"2024-02-21T07:45:31.311908+0000","last_fullsized":"2024-02-21T07:45:31.311908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.416028+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:45:49.416028+0000","last_peered":"2024-02-21T07:45:49.416028+0000","last_clean":"2024-02-21T07:45:49.416028+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:45:49.416028+0000","last_undegraded":"2024-02-21T07:45:49.416028+0000","last_fullsized":"2024-02-21T07:45:49.416028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263705+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:45:32.263705+0000","last_peered":"2024-02-21T07:45:32.263705+0000","last_clean":"2024-02-21T07:45:32.263705+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:45:32.263705+0000","last_undegraded":"2024-02-21T07:45:32.263705+0000","last_fullsized":"2024-02-21T07:45:32.263705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":15,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:33.943427+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:45:33.943427+0000","last_peered":"2024-02-21T07:45:33.943427+0000","last_clean":"2024-02-21T07:45:33.943427+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:45:33.943427+0000","last_undegraded":"2024-02-21T07:45:33.943427+0000","last_fullsized":"2024-02-21T07:45:33.943427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264905+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:45:32.264905+0000","last_peered":"2024-02-21T07:45:32.264905+0000","last_clean":"2024-02-21T07:45:32.264905+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:45:32.264905+0000","last_undegraded":"2024-02-21T07:45:32.264905+0000","last_fullsized":"2024-02-21T07:45:32.264905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410349+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:45:48.410349+0000","last_peered":"2024-02-21T07:45:48.410349+0000","last_clean":"2024-02-21T07:45:48.410349+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:45:48.410349+0000","last_undegraded":"2024-02-21T07:45:48.410349+0000","last_fullsized":"2024-02-21T07:45:48.410349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263291+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:45:32.263291+0000","last_peered":"2024-02-21T07:45:32.263291+0000","last_clean":"2024-02-21T07:45:32.263291+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:45:32.263291+0000","last_undegraded":"2024-02-21T07:45:32.263291+0000","last_fullsized":"2024-02-21T07:45:32.263291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762504+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:45:31.762504+0000","last_peered":"2024-02-21T07:45:31.762504+0000","last_clean":"2024-02-21T07:45:31.762504+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:45:31.762504+0000","last_undegraded":"2024-02-21T07:45:31.762504+0000","last_fullsized":"2024-02-21T07:45:31.762504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263867+0000","last_change":"2024-02-21T07:45:30.321767+0000","last_active":"2024-02-21T07:45:32.263867+0000","last_peered":"2024-02-21T07:45:32.263867+0000","last_clean":"2024-02-21T07:45:32.263867+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:45:32.263867+0000","last_undegraded":"2024-02-21T07:45:32.263867+0000","last_fullsized":"2024-02-21T07:45:32.263867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264766+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:45:32.264766+0000","last_peered":"2024-02-21T07:45:32.264766+0000","last_clean":"2024-02-21T07:45:32.264766+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:45:32.264766+0000","last_undegraded":"2024-02-21T07:45:32.264766+0000","last_fullsized":"2024-02-21T07:45:32.264766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310577+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:45:31.310577+0000","last_peered":"2024-02-21T07:45:31.310577+0000","last_clean":"2024-02-21T07:45:31.310577+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:45:31.310577+0000","last_undegraded":"2024-02-21T07:45:31.310577+0000","last_fullsized":"2024-02-21T07:45:31.310577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761881+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:45:31.761881+0000","last_peered":"2024-02-21T07:45:31.761881+0000","last_clean":"2024-02-21T07:45:31.761881+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:45:31.761881+0000","last_undegraded":"2024-02-21T07:45:31.761881+0000","last_fullsized":"2024-02-21T07:45:31.761881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306408+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:45:31.306408+0000","last_peered":"2024-02-21T07:45:31.306408+0000","last_clean":"2024-02-21T07:45:31.306408+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:45:31.306408+0000","last_undegraded":"2024-02-21T07:45:31.306408+0000","last_fullsized":"2024-02-21T07:45:31.306408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:49.406939+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:45:49.406939+0000","last_peered":"2024-02-21T07:45:49.406939+0000","last_clean":"2024-02-21T07:45:49.406939+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:45:49.406939+0000","last_undegraded":"2024-02-21T07:45:49.406939+0000","last_fullsized":"2024-02-21T07:45:49.406939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762042+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:45:31.762042+0000","last_peered":"2024-02-21T07:45:31.762042+0000","last_clean":"2024-02-21T07:45:31.762042+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:45:31.762042+0000","last_undegraded":"2024-02-21T07:45:31.762042+0000","last_fullsized":"2024-02-21T07:45:31.762042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762020+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:45:31.762020+0000","last_peered":"2024-02-21T07:45:31.762020+0000","last_clean":"2024-02-21T07:45:31.762020+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:45:31.762020+0000","last_undegraded":"2024-02-21T07:45:31.762020+0000","last_fullsized":"2024-02-21T07:45:31.762020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.415737+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:45:48.415737+0000","last_peered":"2024-02-21T07:45:48.415737+0000","last_clean":"2024-02-21T07:45:48.415737+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:45:48.415737+0000","last_undegraded":"2024-02-21T07:45:48.415737+0000","last_fullsized":"2024-02-21T07:45:48.415737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310469+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:45:31.310469+0000","last_peered":"2024-02-21T07:45:31.310469+0000","last_clean":"2024-02-21T07:45:31.310469+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:45:31.310469+0000","last_undegraded":"2024-02-21T07:45:31.310469+0000","last_fullsized":"2024-02-21T07:45:31.310469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263388+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:45:32.263388+0000","last_peered":"2024-02-21T07:45:32.263388+0000","last_clean":"2024-02-21T07:45:32.263388+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:45:32.263388+0000","last_undegraded":"2024-02-21T07:45:32.263388+0000","last_fullsized":"2024-02-21T07:45:32.263388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.429492+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:45:54.429492+0000","last_peered":"2024-02-21T07:45:54.429492+0000","last_clean":"2024-02-21T07:45:54.429492+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:45:54.429492+0000","last_undegraded":"2024-02-21T07:45:54.429492+0000","last_fullsized":"2024-02-21T07:45:54.429492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264171+0000","last_change":"2024-02-21T07:45:30.329832+0000","last_active":"2024-02-21T07:45:32.264171+0000","last_peered":"2024-02-21T07:45:32.264171+0000","last_clean":"2024-02-21T07:45:32.264171+0000","last_became_active":"2024-02-21T07:45:30.329423+0000","last_became_peered":"2024-02-21T07:45:30.329423+0000","last_unstale":"2024-02-21T07:45:32.264171+0000","last_undegraded":"2024-02-21T07:45:32.264171+0000","last_fullsized":"2024-02-21T07:45:32.264171+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263472+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:45:32.263472+0000","last_peered":"2024-02-21T07:45:32.263472+0000","last_clean":"2024-02-21T07:45:32.263472+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:45:32.263472+0000","last_undegraded":"2024-02-21T07:45:32.263472+0000","last_fullsized":"2024-02-21T07:45:32.263472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400439+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:45:47.400439+0000","last_peered":"2024-02-21T07:45:47.400439+0000","last_clean":"2024-02-21T07:45:47.400439+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:45:47.400439+0000","last_undegraded":"2024-02-21T07:45:47.400439+0000","last_fullsized":"2024-02-21T07:45:47.400439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306127+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:45:31.306127+0000","last_peered":"2024-02-21T07:45:31.306127+0000","last_clean":"2024-02-21T07:45:31.306127+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:45:31.306127+0000","last_undegraded":"2024-02-21T07:45:31.306127+0000","last_fullsized":"2024-02-21T07:45:31.306127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309551+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:45:31.309551+0000","last_peered":"2024-02-21T07:45:31.309551+0000","last_clean":"2024-02-21T07:45:31.309551+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:45:31.309551+0000","last_undegraded":"2024-02-21T07:45:31.309551+0000","last_fullsized":"2024-02-21T07:45:31.309551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.410590+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:45:48.410590+0000","last_peered":"2024-02-21T07:45:48.410590+0000","last_clean":"2024-02-21T07:45:48.410590+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:45:48.410590+0000","last_undegraded":"2024-02-21T07:45:48.410590+0000","last_fullsized":"2024-02-21T07:45:48.410590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762292+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:45:31.762292+0000","last_peered":"2024-02-21T07:45:31.762292+0000","last_clean":"2024-02-21T07:45:31.762292+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:45:31.762292+0000","last_undegraded":"2024-02-21T07:45:31.762292+0000","last_fullsized":"2024-02-21T07:45:31.762292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229733+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:45:32.229733+0000","last_peered":"2024-02-21T07:45:32.229733+0000","last_clean":"2024-02-21T07:45:32.229733+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:45:32.229733+0000","last_undegraded":"2024-02-21T07:45:32.229733+0000","last_fullsized":"2024-02-21T07:45:32.229733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:55.437246+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:45:55.437246+0000","last_peered":"2024-02-21T07:45:55.437246+0000","last_clean":"2024-02-21T07:45:55.437246+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:45:55.437246+0000","last_undegraded":"2024-02-21T07:45:55.437246+0000","last_fullsized":"2024-02-21T07:45:55.437246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40475,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":48,"num_write":25,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263546+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:45:32.263546+0000","last_peered":"2024-02-21T07:45:32.263546+0000","last_clean":"2024-02-21T07:45:32.263546+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:45:32.263546+0000","last_undegraded":"2024-02-21T07:45:32.263546+0000","last_fullsized":"2024-02-21T07:45:32.263546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263563+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:45:32.263563+0000","last_peered":"2024-02-21T07:45:32.263563+0000","last_clean":"2024-02-21T07:45:32.263563+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:45:32.263563+0000","last_undegraded":"2024-02-21T07:45:32.263563+0000","last_fullsized":"2024-02-21T07:45:32.263563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.400938+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:45:47.400938+0000","last_peered":"2024-02-21T07:45:47.400938+0000","last_clean":"2024-02-21T07:45:47.400938+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:45:47.400938+0000","last_undegraded":"2024-02-21T07:45:47.400938+0000","last_fullsized":"2024-02-21T07:45:47.400938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264880+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:45:32.264880+0000","last_peered":"2024-02-21T07:45:32.264880+0000","last_clean":"2024-02-21T07:45:32.264880+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:45:32.264880+0000","last_undegraded":"2024-02-21T07:45:32.264880+0000","last_fullsized":"2024-02-21T07:45:32.264880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264461+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:45:32.264461+0000","last_peered":"2024-02-21T07:45:32.264461+0000","last_clean":"2024-02-21T07:45:32.264461+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:45:32.264461+0000","last_undegraded":"2024-02-21T07:45:32.264461+0000","last_fullsized":"2024-02-21T07:45:32.264461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:47.398480+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:45:47.398480+0000","last_peered":"2024-02-21T07:45:47.398480+0000","last_clean":"2024-02-21T07:45:47.398480+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:45:47.398480+0000","last_undegraded":"2024-02-21T07:45:47.398480+0000","last_fullsized":"2024-02-21T07:45:47.398480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263330+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:45:32.263330+0000","last_peered":"2024-02-21T07:45:32.263330+0000","last_clean":"2024-02-21T07:45:32.263330+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:45:32.263330+0000","last_undegraded":"2024-02-21T07:45:32.263330+0000","last_fullsized":"2024-02-21T07:45:32.263330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263656+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:45:32.263656+0000","last_peered":"2024-02-21T07:45:32.263656+0000","last_clean":"2024-02-21T07:45:32.263656+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:45:32.263656+0000","last_undegraded":"2024-02-21T07:45:32.263656+0000","last_fullsized":"2024-02-21T07:45:32.263656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'3","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.426590+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:45:54.426590+0000","last_peered":"2024-02-21T07:45:54.426590+0000","last_clean":"2024-02-21T07:45:54.426590+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:45:54.426590+0000","last_undegraded":"2024-02-21T07:45:54.426590+0000","last_fullsized":"2024-02-21T07:45:54.426590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312070+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:45:31.312070+0000","last_peered":"2024-02-21T07:45:31.312070+0000","last_clean":"2024-02-21T07:45:31.312070+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:45:31.312070+0000","last_undegraded":"2024-02-21T07:45:31.312070+0000","last_fullsized":"2024-02-21T07:45:31.312070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264465+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:45:32.264465+0000","last_peered":"2024-02-21T07:45:32.264465+0000","last_clean":"2024-02-21T07:45:32.264465+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:45:32.264465+0000","last_undegraded":"2024-02-21T07:45:32.264465+0000","last_fullsized":"2024-02-21T07:45:32.264465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263376+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:45:32.263376+0000","last_peered":"2024-02-21T07:45:32.263376+0000","last_clean":"2024-02-21T07:45:32.263376+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:45:32.263376+0000","last_undegraded":"2024-02-21T07:45:32.263376+0000","last_fullsized":"2024-02-21T07:45:32.263376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762361+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:45:31.762361+0000","last_peered":"2024-02-21T07:45:31.762361+0000","last_clean":"2024-02-21T07:45:31.762361+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:45:31.762361+0000","last_undegraded":"2024-02-21T07:45:31.762361+0000","last_fullsized":"2024-02-21T07:45:31.762361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306530+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:45:31.306530+0000","last_peered":"2024-02-21T07:45:31.306530+0000","last_clean":"2024-02-21T07:45:31.306530+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:45:31.306530+0000","last_undegraded":"2024-02-21T07:45:31.306530+0000","last_fullsized":"2024-02-21T07:45:31.306530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312026+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:45:31.312026+0000","last_peered":"2024-02-21T07:45:31.312026+0000","last_clean":"2024-02-21T07:45:31.312026+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:45:31.312026+0000","last_undegraded":"2024-02-21T07:45:31.312026+0000","last_fullsized":"2024-02-21T07:45:31.312026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.417019+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:45:48.417019+0000","last_peered":"2024-02-21T07:45:48.417019+0000","last_clean":"2024-02-21T07:45:48.417019+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:45:48.417019+0000","last_undegraded":"2024-02-21T07:45:48.417019+0000","last_fullsized":"2024-02-21T07:45:48.417019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:48.409397+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:45:48.409397+0000","last_peered":"2024-02-21T07:45:48.409397+0000","last_clean":"2024-02-21T07:45:48.409397+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:45:48.409397+0000","last_undegraded":"2024-02-21T07:45:48.409397+0000","last_fullsized":"2024-02-21T07:45:48.409397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.762120+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:45:31.762120+0000","last_peered":"2024-02-21T07:45:31.762120+0000","last_clean":"2024-02-21T07:45:31.762120+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:45:31.762120+0000","last_undegraded":"2024-02-21T07:45:31.762120+0000","last_fullsized":"2024-02-21T07:45:31.762120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306666+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:45:31.306666+0000","last_peered":"2024-02-21T07:45:31.306666+0000","last_clean":"2024-02-21T07:45:31.306666+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:45:31.306666+0000","last_undegraded":"2024-02-21T07:45:31.306666+0000","last_fullsized":"2024-02-21T07:45:31.306666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:54.427270+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:45:54.427270+0000","last_peered":"2024-02-21T07:45:54.427270+0000","last_clean":"2024-02-21T07:45:54.427270+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:45:54.427270+0000","last_undegraded":"2024-02-21T07:45:54.427270+0000","last_fullsized":"2024-02-21T07:45:54.427270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229535+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:45:32.229535+0000","last_peered":"2024-02-21T07:45:32.229535+0000","last_clean":"2024-02-21T07:45:32.229535+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:45:32.229535+0000","last_undegraded":"2024-02-21T07:45:32.229535+0000","last_fullsized":"2024-02-21T07:45:32.229535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307101+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:45:31.307101+0000","last_peered":"2024-02-21T07:45:31.307101+0000","last_clean":"2024-02-21T07:45:31.307101+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:45:31.307101+0000","last_undegraded":"2024-02-21T07:45:31.307101+0000","last_fullsized":"2024-02-21T07:45:31.307101+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306135+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:45:31.306135+0000","last_peered":"2024-02-21T07:45:31.306135+0000","last_clean":"2024-02-21T07:45:31.306135+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:45:31.306135+0000","last_undegraded":"2024-02-21T07:45:31.306135+0000","last_fullsized":"2024-02-21T07:45:31.306135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306468+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:45:31.306468+0000","last_peered":"2024-02-21T07:45:31.306468+0000","last_clean":"2024-02-21T07:45:31.306468+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:45:31.306468+0000","last_undegraded":"2024-02-21T07:45:31.306468+0000","last_fullsized":"2024-02-21T07:45:31.306468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263724+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:45:32.263724+0000","last_peered":"2024-02-21T07:45:32.263724+0000","last_clean":"2024-02-21T07:45:32.263724+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:45:32.263724+0000","last_undegraded":"2024-02-21T07:45:32.263724+0000","last_fullsized":"2024-02-21T07:45:32.263724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.310293+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:45:31.310293+0000","last_peered":"2024-02-21T07:45:31.310293+0000","last_clean":"2024-02-21T07:45:31.310293+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:45:31.310293+0000","last_undegraded":"2024-02-21T07:45:31.310293+0000","last_fullsized":"2024-02-21T07:45:31.310293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306405+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:45:31.306405+0000","last_peered":"2024-02-21T07:45:31.306405+0000","last_clean":"2024-02-21T07:45:31.306405+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:45:31.306405+0000","last_undegraded":"2024-02-21T07:45:31.306405+0000","last_fullsized":"2024-02-21T07:45:31.306405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306886+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:45:31.306886+0000","last_peered":"2024-02-21T07:45:31.306886+0000","last_clean":"2024-02-21T07:45:31.306886+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:45:31.306886+0000","last_undegraded":"2024-02-21T07:45:31.306886+0000","last_fullsized":"2024-02-21T07:45:31.306886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.313391+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:45:31.313391+0000","last_peered":"2024-02-21T07:45:31.313391+0000","last_clean":"2024-02-21T07:45:31.313391+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:45:31.313391+0000","last_undegraded":"2024-02-21T07:45:31.313391+0000","last_fullsized":"2024-02-21T07:45:31.313391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.761962+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:45:31.761962+0000","last_peered":"2024-02-21T07:45:31.761962+0000","last_clean":"2024-02-21T07:45:31.761962+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:45:31.761962+0000","last_undegraded":"2024-02-21T07:45:31.761962+0000","last_fullsized":"2024-02-21T07:45:31.761962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.312075+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:45:31.312075+0000","last_peered":"2024-02-21T07:45:31.312075+0000","last_clean":"2024-02-21T07:45:31.312075+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:45:31.312075+0000","last_undegraded":"2024-02-21T07:45:31.312075+0000","last_fullsized":"2024-02-21T07:45:31.312075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263718+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:45:32.263718+0000","last_peered":"2024-02-21T07:45:32.263718+0000","last_clean":"2024-02-21T07:45:32.263718+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:45:32.263718+0000","last_undegraded":"2024-02-21T07:45:32.263718+0000","last_fullsized":"2024-02-21T07:45:32.263718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309927+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:45:31.309927+0000","last_peered":"2024-02-21T07:45:31.309927+0000","last_clean":"2024-02-21T07:45:31.309927+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:45:31.309927+0000","last_undegraded":"2024-02-21T07:45:31.309927+0000","last_fullsized":"2024-02-21T07:45:31.309927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306150+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:45:31.306150+0000","last_peered":"2024-02-21T07:45:31.306150+0000","last_clean":"2024-02-21T07:45:31.306150+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:45:31.306150+0000","last_undegraded":"2024-02-21T07:45:31.306150+0000","last_fullsized":"2024-02-21T07:45:31.306150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.307003+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:45:31.307003+0000","last_peered":"2024-02-21T07:45:31.307003+0000","last_clean":"2024-02-21T07:45:31.307003+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:45:31.307003+0000","last_undegraded":"2024-02-21T07:45:31.307003+0000","last_fullsized":"2024-02-21T07:45:31.307003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264340+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:45:32.264340+0000","last_peered":"2024-02-21T07:45:32.264340+0000","last_clean":"2024-02-21T07:45:32.264340+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:45:32.264340+0000","last_undegraded":"2024-02-21T07:45:32.264340+0000","last_fullsized":"2024-02-21T07:45:32.264340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306653+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:45:31.306653+0000","last_peered":"2024-02-21T07:45:31.306653+0000","last_clean":"2024-02-21T07:45:31.306653+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:45:31.306653+0000","last_undegraded":"2024-02-21T07:45:31.306653+0000","last_fullsized":"2024-02-21T07:45:31.306653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263066+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:45:32.263066+0000","last_peered":"2024-02-21T07:45:32.263066+0000","last_clean":"2024-02-21T07:45:32.263066+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:45:32.263066+0000","last_undegraded":"2024-02-21T07:45:32.263066+0000","last_fullsized":"2024-02-21T07:45:32.263066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263638+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:45:32.263638+0000","last_peered":"2024-02-21T07:45:32.263638+0000","last_clean":"2024-02-21T07:45:32.263638+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:45:32.263638+0000","last_undegraded":"2024-02-21T07:45:32.263638+0000","last_fullsized":"2024-02-21T07:45:32.263638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263493+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:45:32.263493+0000","last_peered":"2024-02-21T07:45:32.263493+0000","last_clean":"2024-02-21T07:45:32.263493+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:45:32.263493+0000","last_undegraded":"2024-02-21T07:45:32.263493+0000","last_fullsized":"2024-02-21T07:45:32.263493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.309714+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:45:31.309714+0000","last_peered":"2024-02-21T07:45:31.309714+0000","last_clean":"2024-02-21T07:45:31.309714+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:45:31.309714+0000","last_undegraded":"2024-02-21T07:45:31.309714+0000","last_fullsized":"2024-02-21T07:45:31.309714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264668+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:45:32.264668+0000","last_peered":"2024-02-21T07:45:32.264668+0000","last_clean":"2024-02-21T07:45:32.264668+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:45:32.264668+0000","last_undegraded":"2024-02-21T07:45:32.264668+0000","last_fullsized":"2024-02-21T07:45:32.264668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264939+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:45:32.264939+0000","last_peered":"2024-02-21T07:45:32.264939+0000","last_clean":"2024-02-21T07:45:32.264939+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:45:32.264939+0000","last_undegraded":"2024-02-21T07:45:32.264939+0000","last_fullsized":"2024-02-21T07:45:32.264939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264424+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:45:32.264424+0000","last_peered":"2024-02-21T07:45:32.264424+0000","last_clean":"2024-02-21T07:45:32.264424+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:45:32.264424+0000","last_undegraded":"2024-02-21T07:45:32.264424+0000","last_fullsized":"2024-02-21T07:45:32.264424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264005+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:45:32.264005+0000","last_peered":"2024-02-21T07:45:32.264005+0000","last_clean":"2024-02-21T07:45:32.264005+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:45:32.264005+0000","last_undegraded":"2024-02-21T07:45:32.264005+0000","last_fullsized":"2024-02-21T07:45:32.264005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.311690+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:45:31.311690+0000","last_peered":"2024-02-21T07:45:31.311690+0000","last_clean":"2024-02-21T07:45:31.311690+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:45:31.311690+0000","last_undegraded":"2024-02-21T07:45:31.311690+0000","last_fullsized":"2024-02-21T07:45:31.311690+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.263714+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:45:32.263714+0000","last_peered":"2024-02-21T07:45:32.263714+0000","last_clean":"2024-02-21T07:45:32.263714+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:45:32.263714+0000","last_undegraded":"2024-02-21T07:45:32.263714+0000","last_fullsized":"2024-02-21T07:45:32.263714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.262967+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:45:32.262967+0000","last_peered":"2024-02-21T07:45:32.262967+0000","last_clean":"2024-02-21T07:45:32.262967+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:45:32.262967+0000","last_undegraded":"2024-02-21T07:45:32.262967+0000","last_fullsized":"2024-02-21T07:45:32.262967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.229582+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:45:32.229582+0000","last_peered":"2024-02-21T07:45:32.229582+0000","last_clean":"2024-02-21T07:45:32.229582+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:45:32.229582+0000","last_undegraded":"2024-02-21T07:45:32.229582+0000","last_fullsized":"2024-02-21T07:45:32.229582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264570+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:45:32.264570+0000","last_peered":"2024-02-21T07:45:32.264570+0000","last_clean":"2024-02-21T07:45:32.264570+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:45:32.264570+0000","last_undegraded":"2024-02-21T07:45:32.264570+0000","last_fullsized":"2024-02-21T07:45:32.264570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264582+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:45:32.264582+0000","last_peered":"2024-02-21T07:45:32.264582+0000","last_clean":"2024-02-21T07:45:32.264582+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:45:32.264582+0000","last_undegraded":"2024-02-21T07:45:32.264582+0000","last_fullsized":"2024-02-21T07:45:32.264582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:32.264526+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:45:32.264526+0000","last_peered":"2024-02-21T07:45:32.264526+0000","last_clean":"2024-02-21T07:45:32.264526+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:45:32.264526+0000","last_undegraded":"2024-02-21T07:45:32.264526+0000","last_fullsized":"2024-02-21T07:45:32.264526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-02-21T07:45:31.306596+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:45:31.306596+0000","last_peered":"2024-02-21T07:45:31.306596+0000","last_clean":"2024-02-21T07:45:31.306596+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:45:31.306596+0000","last_undegraded":"2024-02-21T07:45:31.306596+0000","last_fullsized":"2024-02-21T07:45:31.306596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44480,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":148,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":88960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":139336,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":175361,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":143522,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.865}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7689999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.964}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":138910,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":372736,"data_stored":734388,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]}]},{"osd":6,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":134748,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":389120,"data_stored":730993,"data_compressed":41955,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":303104,"data_stored":139376,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444041,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":134838,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0830000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1320000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3180000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2040000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0099999999999998}]}]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":136291,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":175133,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7679999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]}]},{"osd":0,"up_from":17,"seq":73014444042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":135464,"data_compressed":8433,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.268}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":40475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":40703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:45:59.607 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T07:45:59.607 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-21T07:45:59.607 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-21T07:45:59.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-21T07:45:59.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.846+0000 7fb4cfe00640 1 Processor -- start 2024-02-21T07:45:59.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.847+0000 7fb4cfe00640 1 -- start start 2024-02-21T07:45:59.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.848+0000 7fb4cfe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4c818a420 0x7fb4c8070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.848+0000 7fb4cfe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c818a800 con 0x7fb4c8071470 2024-02-21T07:45:59.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cfe00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c806de80 con 0x7fb4c806d950 2024-02-21T07:45:59.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cfe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80f9b50 con 0x7fb4c818a420 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cd400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4c818a420 0x7fb4c8070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cde00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb4c806d950 0x7fb4c818ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32770/0 (socket says 172.21.15.100:32770) 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cde00640 1 -- 172.21.15.100:0/3015486979 learned_addr learned my addr 172.21.15.100:0/3015486979 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638163848 0 0) 0x7fb4c806de80 con 0x7fb4c806d950 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ac003520 con 0x7fb4c806d950 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568208909 0 0) 0x7fb4c818a800 con 0x7fb4c8071470 2024-02-21T07:45:59.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cd400640 1 -- 172.21.15.100:0/3015486979 >> v1:172.21.15.170:6789/0 conn(0x7fb4c806d950 legacy=0x7fb4c818ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cd400640 1 -- 172.21.15.100:0/3015486979 >> v1:172.21.15.156:6789/0 conn(0x7fb4c8071470 legacy=0x7fb4c80f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.849+0000 7fb4cd400640 1 -- 172.21.15.100:0/3015486979 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c806e160 con 0x7fb4c818a420 2024-02-21T07:45:59.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.851+0000 7fb4cd400640 1 --2- 172.21.15.100:0/3015486979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c818a420 0x7fb4c8070f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14e0c29c8c8eadce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.851+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802e070 con 0x7fb4c818a420 2024-02-21T07:45:59.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b80315a0 con 0x7fb4c818a420 2024-02-21T07:45:59.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3015486979 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8031910 con 0x7fb4c818a420 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3015486979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c818a420 msgr2=0x7fb4c8070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3015486979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c818a420 0x7fb4c8070f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802b840 comp rx=0 tx=0).stop 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3015486979 shutdown_connections 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3015486979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c818a420 0x7fb4c8070f30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3015486979 >> 172.21.15.100:0/3015486979 conn(0x7fb4c80ce160 msgr2=0x7fb4c80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3015486979 shutdown_connections 2024-02-21T07:45:59.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.852+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3015486979 wait complete. 2024-02-21T07:45:59.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.854+0000 7fb4cfe00640 1 Processor -- start 2024-02-21T07:45:59.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.855+0000 7fb4cfe00640 1 -- start start 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c8071470 0x7fb4c815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 0x7fb4c815f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c8189bf0 con 0x7fb4c806d950 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80f4510 con 0x7fb4c818a420 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.856+0000 7fb4cfe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c80f47f0 con 0x7fb4c8071470 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54222/0 (socket says 172.21.15.100:54222) 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 -- 172.21.15.100:0/3787619743 learned_addr learned my addr 172.21.15.100:0/3787619743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cca00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c8071470 0x7fb4c815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cde00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 0x7fb4c815f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 -- 172.21.15.100:0/3787619743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c8071470 msgr2=0x7fb4c815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c8071470 0x7fb4c815ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 -- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 msgr2=0x7fb4c815f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 0x7fb4c815f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cd400640 1 -- 172.21.15.100:0/3787619743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009400 con 0x7fb4c806d950 2024-02-21T07:45:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.857+0000 7fb4cde00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 0x7fb4c815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4cd400640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8034040 tx=0x7fb4b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8003810 con 0x7fb4c806d950 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b8040070 con 0x7fb4c806d950 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c80f4ad0 con 0x7fb4c806d950 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8003bb0 con 0x7fb4c806d950 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.858+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c80f5090 con 0x7fb4c806d950 2024-02-21T07:45:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.859+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c808e3e0 con 0x7fb4c806d950 2024-02-21T07:45:59.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.861+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb4b8003d10 con 0x7fb4c806d950 2024-02-21T07:45:59.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.863+0000 7fb4c5600640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 0x7fb4a80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:59.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.864+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb4b8042070 con 0x7fb4c806d950 2024-02-21T07:45:59.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.864+0000 7fb4cca00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 0x7fb4a80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:59.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.864+0000 7fb4cca00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 0x7fb4a80a15f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80f66c0 tx=0x7fb4b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:59.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:45:59.867+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb4b80b6520 con 0x7fb4c806d950 2024-02-21T07:46:00.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.103+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb4c8189f80 con 0x7fb4c806d950 2024-02-21T07:46:00.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.103+0000 7fb4c5600640 1 -- 172.21.15.100:0/3787619743 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb4b8006e10 con 0x7fb4c806d950 2024-02-21T07:46:00.109 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:00.109 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 msgr2=0x7fb4a80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 0x7fb4a80a15f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80f66c0 tx=0x7fb4b4009040 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 msgr2=0x7fb4c80f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8034040 tx=0x7fb4b80046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 shutdown_connections 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4c818a420 0x7fb4c815f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4c8071470 0x7fb4c815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4a809f130 0x7fb4a80a15f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 --2- 172.21.15.100:0/3787619743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4c806d950 0x7fb4c80f5890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 >> 172.21.15.100:0/3787619743 conn(0x7fb4c80ce160 msgr2=0x7fb4c81831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:00.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 shutdown_connections 2024-02-21T07:46:00.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.106+0000 7fb4cfe00640 1 -- 172.21.15.100:0/3787619743 wait complete. 2024-02-21T07:46:00.130 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-21T07:46:00.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.326+0000 7f4453200640 1 Processor -- start 2024-02-21T07:46:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.327+0000 7f4453200640 1 -- start start 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4453200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f444c06ab60 0x7f444c0f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4453200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 0x7f444c08c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4453200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444c0fa780 con 0x7f444c06af40 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4453200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c18aae0 con 0x7f444c06ab60 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4453200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444c06bab0 con 0x7f444c08c150 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f444be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f444c06ab60 0x7f444c0f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4443e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f444c06af40 0x7f444c06b3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55916/0 (socket says 172.21.15.100:55916) 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4443e00640 1 -- 172.21.15.100:0/3602657408 learned_addr learned my addr 172.21.15.100:0/3602657408 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.329+0000 7f4451200640 1 --2- 172.21.15.100:0/3602657408 >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 0x7f444c08c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f444be00640 1 -- 172.21.15.100:0/3602657408 >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 msgr2=0x7f444c08c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f444be00640 1 --2- 172.21.15.100:0/3602657408 >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 0x7f444c08c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f444be00640 1 -- 172.21.15.100:0/3602657408 >> v1:172.21.15.156:6789/0 conn(0x7f444c06af40 legacy=0x7f444c06b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f444be00640 1 -- 172.21.15.100:0/3602657408 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c184150 con 0x7f444c06ab60 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f444b400640 1 -- 172.21.15.100:0/3602657408 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339545311 0 0) 0x7f444c0fa780 con 0x7f444c06af40 2024-02-21T07:46:00.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.330+0000 7f4451200640 1 --2- 172.21.15.100:0/3602657408 >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 0x7f444c08c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.331+0000 7f444be00640 1 --2- 172.21.15.100:0/3602657408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c0f92a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f444c070270 tx=0x7f443c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51cbe7077c2af92b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.331+0000 7f444b400640 1 -- 172.21.15.100:0/3602657408 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c02e070 con 0x7f444c06ab60 2024-02-21T07:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.331+0000 7f444b400640 1 -- 172.21.15.100:0/3602657408 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c0315a0 con 0x7f444c06ab60 2024-02-21T07:46:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.331+0000 7f444b400640 1 -- 172.21.15.100:0/3602657408 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c031930 con 0x7f444c06ab60 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 -- 172.21.15.100:0/3602657408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 msgr2=0x7f444c0f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 --2- 172.21.15.100:0/3602657408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c0f92a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f444c070270 tx=0x7f443c02b840 comp rx=0 tx=0).stop 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 -- 172.21.15.100:0/3602657408 shutdown_connections 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 --2- 172.21.15.100:0/3602657408 >> v2:172.21.15.170:3300/0 conn(0x7f444c08c150 0x7f444c08c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 --2- 172.21.15.100:0/3602657408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c0f92a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 -- 172.21.15.100:0/3602657408 >> 172.21.15.100:0/3602657408 conn(0x7f444c0cf200 msgr2=0x7f444c0cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 -- 172.21.15.100:0/3602657408 shutdown_connections 2024-02-21T07:46:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.332+0000 7f4453200640 1 -- 172.21.15.100:0/3602657408 wait complete. 2024-02-21T07:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.334+0000 7f4453200640 1 Processor -- start 2024-02-21T07:46:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.335+0000 7f4453200640 1 -- start start 2024-02-21T07:46:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c16bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c08c150 0x7f444c1879d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1854c0 con 0x7f444c06af40 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c182120 con 0x7f444c06ab60 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4453200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1829c0 con 0x7f444c08c150 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.336+0000 7f4443e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54238/0 (socket says 172.21.15.100:54238) 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 -- 172.21.15.100:0/168299151 learned_addr learned my addr 172.21.15.100:0/168299151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f444be00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c16bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4451200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c08c150 0x7f444c1879d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 -- 172.21.15.100:0/168299151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c08c150 msgr2=0x7f444c1879d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c08c150 0x7f444c1879d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 -- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 msgr2=0x7f444c16bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c16bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 -- 172.21.15.100:0/168299151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4444009a70 con 0x7f444c06af40 2024-02-21T07:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.337+0000 7f4443e00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f443400c4d0 tx=0x7f443400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.338+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340074e0 con 0x7f444c06af40 2024-02-21T07:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.338+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4434007660 con 0x7f444c06af40 2024-02-21T07:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.338+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434004a20 con 0x7f444c06af40 2024-02-21T07:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.338+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c009400 con 0x7f444c06af40 2024-02-21T07:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.338+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c187f10 con 0x7f444c06af40 2024-02-21T07:46:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.339+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c08df70 con 0x7f444c06af40 2024-02-21T07:46:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.341+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4434004b80 con 0x7f444c06af40 2024-02-21T07:46:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.342+0000 7f4448c00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 0x7f44280a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.342+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f44340c9a00 con 0x7f444c06af40 2024-02-21T07:46:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.343+0000 7f444be00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 0x7f44280a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.343+0000 7f444be00640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 0x7f44280a15f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.346+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4434093710 con 0x7f444c06af40 2024-02-21T07:46:00.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.541+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f444c0fa370 con 0x7f444c06af40 2024-02-21T07:46:00.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.544+0000 7f4448c00640 1 -- 172.21.15.100:0/168299151 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f4434095640 con 0x7f444c06af40 2024-02-21T07:46:00.550 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:00.550 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 msgr2=0x7f44280a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 0x7f44280a15f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f443c036000 tx=0x7f443c03d040 comp rx=0 tx=0).stop 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 msgr2=0x7f444c187490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f443400c4d0 tx=0x7f443400c8d0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 shutdown_connections 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c08c150 0x7f444c1879d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f442809f130 0x7f44280a15f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f444c06af40 0x7f444c187490 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 --2- 172.21.15.100:0/168299151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f444c06ab60 0x7f444c16bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.546+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 >> 172.21.15.100:0/168299151 conn(0x7f444c0cf200 msgr2=0x7f444c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.547+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 shutdown_connections 2024-02-21T07:46:00.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.547+0000 7f4453200640 1 -- 172.21.15.100:0/168299151 wait complete. 2024-02-21T07:46:00.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:46:00.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:46:00.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.772+0000 7f1b8ea00640 1 Processor -- start 2024-02-21T07:46:00.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.772+0000 7f1b8ea00640 1 -- start start 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.774+0000 7f1b8ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 0x7f1b880d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.774+0000 7f1b8ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b8806bcc0 0x7f1b8818a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.774+0000 7f1b8ea00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8806d050 con 0x7f1b8818a7d0 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.774+0000 7f1b8ea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880d4b20 con 0x7f1b8806bcc0 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.774+0000 7f1b8ea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8806c1f0 con 0x7f1b881645b0 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b8806bcc0 0x7f1b8818a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 0x7f1b880d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b8806bcc0 0x7f1b8818a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54252/0 (socket says 172.21.15.100:54252) 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 -- 172.21.15.100:0/612951763 learned_addr learned my addr 172.21.15.100:0/612951763 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b8ca00640 1 --1- 172.21.15.100:0/612951763 >> v1:172.21.15.170:6789/0 conn(0x7f1b8818a7d0 0x7f1b8818c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32772/0 (socket says 172.21.15.100:32772) 2024-02-21T07:46:00.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 -- 172.21.15.100:0/612951763 >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 msgr2=0x7f1b880d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 --2- 172.21.15.100:0/612951763 >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 0x7f1b880d45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 -- 172.21.15.100:0/612951763 >> v1:172.21.15.170:6789/0 conn(0x7f1b8818a7d0 legacy=0x7f1b8818c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87400640 1 -- 172.21.15.100:0/612951763 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8806c4d0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b87e00640 1 --2- 172.21.15.100:0/612951763 >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 0x7f1b880d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.775+0000 7f1b86a00640 1 -- 172.21.15.100:0/612951763 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530712407 0 0) 0x7f1b8806d050 con 0x7f1b8818a7d0 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.776+0000 7f1b87400640 1 --2- 172.21.15.100:0/612951763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b8818a290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b880d6ea0 tx=0x7f1b7002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f585f95c875c52a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b86a00640 1 -- 172.21.15.100:0/612951763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7002ca80 con 0x7f1b8806bcc0 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b86a00640 1 -- 172.21.15.100:0/612951763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7002cbe0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b86a00640 1 -- 172.21.15.100:0/612951763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700343f0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 -- 172.21.15.100:0/612951763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 msgr2=0x7f1b8818a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/612951763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b8818a290 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b880d6ea0 tx=0x7f1b7002bee0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 -- 172.21.15.100:0/612951763 shutdown_connections 2024-02-21T07:46:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/612951763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b8818a290 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/612951763 >> v2:172.21.15.170:3300/0 conn(0x7f1b881645b0 0x7f1b880d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.777+0000 7f1b8ea00640 1 -- 172.21.15.100:0/612951763 >> 172.21.15.100:0/612951763 conn(0x7f1b880fe210 msgr2=0x7f1b880fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.778+0000 7f1b8ea00640 1 -- 172.21.15.100:0/612951763 shutdown_connections 2024-02-21T07:46:00.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.778+0000 7f1b8ea00640 1 -- 172.21.15.100:0/612951763 wait complete. 2024-02-21T07:46:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.779+0000 7f1b8ea00640 1 Processor -- start 2024-02-21T07:46:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.780+0000 7f1b8ea00640 1 -- start start 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b881645b0 0x7f1b880d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 0x7f1b88161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881634d0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88162310 con 0x7f1b8818a7d0 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881625e0 con 0x7f1b881645b0 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54258/0 (socket says 172.21.15.100:54258) 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b87e00640 1 -- 172.21.15.100:0/3374084975 learned_addr learned my addr 172.21.15.100:0/3374084975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b87400640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b881645b0 0x7f1b880d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.781+0000 7f1b8ca00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 0x7f1b88161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 -- 172.21.15.100:0/3374084975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b881645b0 msgr2=0x7f1b880d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b881645b0 0x7f1b880d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 -- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 msgr2=0x7f1b88161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 0x7f1b88161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 -- 172.21.15.100:0/3374084975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78009400 con 0x7f1b8806bcc0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b8ca00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 0x7f1b88161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b87e00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ebe0 tx=0x7f1b7800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78009760 con 0x7f1b8806bcc0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800cc30 con 0x7f1b8806bcc0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800eee0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b70009b30 con 0x7f1b8806bcc0 2024-02-21T07:46:00.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.782+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88162ba0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.783+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b880fbde0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.785+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1b78013470 con 0x7f1b8806bcc0 2024-02-21T07:46:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.786+0000 7f1b7fe00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 0x7f1b640a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.787+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1b780c9e50 con 0x7f1b8806bcc0 2024-02-21T07:46:00.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.787+0000 7f1b87400640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 0x7f1b640a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:00.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.787+0000 7f1b87400640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 0x7f1b640a1620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b70035000 tx=0x7f1b70030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:00.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.790+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b78093bf0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.985+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b88067c80 con 0x7f1b8806bcc0 2024-02-21T07:46:00.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.986+0000 7f1b7fe00640 1 -- 172.21.15.100:0/3374084975 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b780170a0 con 0x7f1b8806bcc0 2024-02-21T07:46:00.992 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 msgr2=0x7f1b640a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 0x7f1b640a1620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b70035000 tx=0x7f1b70030000 comp rx=0 tx=0).stop 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 msgr2=0x7f1b88163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800ebe0 tx=0x7f1b7800c520 comp rx=0 tx=0).stop 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 shutdown_connections 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b8818a7d0 0x7f1b88161dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b881645b0 0x7f1b880d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b6409f160 0x7f1b640a1620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 --2- 172.21.15.100:0/3374084975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b8806bcc0 0x7f1b88163960 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 >> 172.21.15.100:0/3374084975 conn(0x7f1b880fe210 msgr2=0x7f1b8806b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 shutdown_connections 2024-02-21T07:46:00.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:00.989+0000 7f1b8ea00640 1 -- 172.21.15.100:0/3374084975 wait complete. 2024-02-21T07:46:01.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:46:01.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.219+0000 7f8d70600640 1 Processor -- start 2024-02-21T07:46:01.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.219+0000 7f8d70600640 1 -- start start 2024-02-21T07:46:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d6815c950 0x7f8d68188a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d68188fd0 0x7f8d6815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 0x7f8d680f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680709c0 con 0x7f8d6815c950 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680f5230 con 0x7f8d68188fd0 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d70600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680706e0 con 0x7f8d6815d270 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d6dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d6815c950 0x7f8d68188a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d6d200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8d68188fd0 0x7f8d6815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d6dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d6815c950 0x7f8d68188a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54262/0 (socket says 172.21.15.100:54262) 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.221+0000 7f8d6dc00640 1 -- 172.21.15.100:0/3891744379 learned_addr learned my addr 172.21.15.100:0/3891744379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6e600640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 0x7f8d680f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6dc00640 1 -- 172.21.15.100:0/3891744379 >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 msgr2=0x7f8d680f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 0x7f8d680f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6dc00640 1 -- 172.21.15.100:0/3891744379 >> v2:172.21.15.156:3300/0 conn(0x7f8d68188fd0 msgr2=0x7f8d6815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.156:3300/0 conn(0x7f8d68188fd0 0x7f8d6815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6dc00640 1 -- 172.21.15.100:0/3891744379 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680f4900 con 0x7f8d6815c950 2024-02-21T07:46:01.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.222+0000 7f8d6e600640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 0x7f8d680f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.223+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/3891744379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68188a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d6808d4b0 tx=0x7f8d5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86075ea283ce632 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.223+0000 7f8d67e00640 1 -- 172.21.15.100:0/3891744379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0317e0 con 0x7f8d6815c950 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.223+0000 7f8d67e00640 1 -- 172.21.15.100:0/3891744379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c031940 con 0x7f8d6815c950 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.223+0000 7f8d67e00640 1 -- 172.21.15.100:0/3891744379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c031cd0 con 0x7f8d6815c950 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 -- 172.21.15.100:0/3891744379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 msgr2=0x7f8d68188a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 --2- 172.21.15.100:0/3891744379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68188a90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d6808d4b0 tx=0x7f8d5c02b880 comp rx=0 tx=0).stop 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 -- 172.21.15.100:0/3891744379 shutdown_connections 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.170:3300/0 conn(0x7f8d6815d270 0x7f8d680f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 --2- 172.21.15.100:0/3891744379 >> v2:172.21.15.156:3300/0 conn(0x7f8d68188fd0 0x7f8d6815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 --2- 172.21.15.100:0/3891744379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68188a90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 -- 172.21.15.100:0/3891744379 >> 172.21.15.100:0/3891744379 conn(0x7f8d680668b0 msgr2=0x7f8d68066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 -- 172.21.15.100:0/3891744379 shutdown_connections 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.224+0000 7f8d70600640 1 -- 172.21.15.100:0/3891744379 wait complete. 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.226+0000 7f8d70600640 1 Processor -- start 2024-02-21T07:46:01.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.226+0000 7f8d70600640 1 -- start start 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d6815d270 0x7f8d6821cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d68188fd0 0x7f8d682227c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680f09e0 con 0x7f8d6815c950 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68174c60 con 0x7f8d6815d270 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.227+0000 7f8d70600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681762b0 con 0x7f8d68188fd0 2024-02-21T07:46:01.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54272/0 (socket says 172.21.15.100:54272) 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 -- 172.21.15.100:0/1966808030 learned_addr learned my addr 172.21.15.100:0/1966808030 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6d200640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d6815d270 0x7f8d6821cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6e600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d68188fd0 0x7f8d682227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 -- 172.21.15.100:0/1966808030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d68188fd0 msgr2=0x7f8d682227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d68188fd0 0x7f8d682227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 -- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d6815d270 msgr2=0x7f8d6821cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d6815d270 0x7f8d6821cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 -- 172.21.15.100:0/1966808030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0094d0 con 0x7f8d6815c950 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.228+0000 7f8d6dc00640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c02b8c0 tx=0x7f8d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.229+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c032880 con 0x7f8d6815c950 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.229+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c032a20 con 0x7f8d6815c950 2024-02-21T07:46:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.229+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c032dd0 con 0x7f8d6815c950 2024-02-21T07:46:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.229+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68176590 con 0x7f8d6815c950 2024-02-21T07:46:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.229+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68176b50 con 0x7f8d6815c950 2024-02-21T07:46:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.230+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680f6630 con 0x7f8d6815c950 2024-02-21T07:46:01.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.232+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8d5c04e450 con 0x7f8d6815c950 2024-02-21T07:46:01.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.233+0000 7f8d65600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 0x7f8d480a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.233+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8d5c0ebdc0 con 0x7f8d6815c950 2024-02-21T07:46:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.233+0000 7f8d6d200640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 0x7f8d480a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.234+0000 7f8d6d200640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 0x7f8d480a15f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d68188af0 tx=0x7f8d54009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.237+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d5c0b59c0 con 0x7f8d6815c950 2024-02-21T07:46:01.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.433+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d68067c80 con 0x7f8d6815c950 2024-02-21T07:46:01.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.434+0000 7f8d65600640 1 -- 172.21.15.100:0/1966808030 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d5c0b78f0 con 0x7f8d6815c950 2024-02-21T07:46:01.439 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 msgr2=0x7f8d480a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 0x7f8d480a15f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d68188af0 tx=0x7f8d54009190 comp rx=0 tx=0).stop 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 msgr2=0x7f8d68174720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c02b8c0 tx=0x7f8d5c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 shutdown_connections 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d68188fd0 0x7f8d682227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d6815d270 0x7f8d6821cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8d4809f130 0x7f8d480a15f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 --2- 172.21.15.100:0/1966808030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d6815c950 0x7f8d68174720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 >> 172.21.15.100:0/1966808030 conn(0x7f8d680668b0 msgr2=0x7f8d68178200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 shutdown_connections 2024-02-21T07:46:01.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.436+0000 7f8d70600640 1 -- 172.21.15.100:0/1966808030 wait complete. 2024-02-21T07:46:01.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:46:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.636+0000 7f11b8e00640 1 Processor -- start 2024-02-21T07:46:01.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.636+0000 7f11b8e00640 1 -- start start 2024-02-21T07:46:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b8e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f11b408d330 0x7f11b4188a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b8e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b408c180 con 0x7f11b41861e0 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b8e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b4070d50 con 0x7f11b406b840 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b8e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b4070b70 con 0x7f11b408d330 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b1e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f11b41861e0 0x7f11b406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38600/0 (socket says 172.21.15.100:38600) 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b1e00640 1 -- 172.21.15.100:0/4058003983 learned_addr learned my addr 172.21.15.100:0/4058003983 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.638+0000 7f11b2800640 1 --2- 172.21.15.100:0/4058003983 >> v2:172.21.15.100:3300/0 conn(0x7f11b408d330 0x7f11b4188a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196511744 0 0) 0x7f11b4070d50 con 0x7f11b406b840 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1198003520 con 0x7f11b406b840 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b2800640 1 -- 172.21.15.100:0/4058003983 >> v1:172.21.15.156:6789/0 conn(0x7f11b406b840 legacy=0x7f11b408cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b2800640 1 -- 172.21.15.100:0/4058003983 >> v1:172.21.15.100:6789/0 conn(0x7f11b41861e0 legacy=0x7f11b406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023185975 0 0) 0x7f11b408c180 con 0x7f11b41861e0 2024-02-21T07:46:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.639+0000 7f11b2800640 1 -- 172.21.15.100:0/4058003983 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b4071030 con 0x7f11b408d330 2024-02-21T07:46:01.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.640+0000 7f11b2800640 1 --2- 172.21.15.100:0/4058003983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b408d330 0x7f11b4188a90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f11b418d0f0 tx=0x7f11ac02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62697a006becf130 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.640+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac02cbc0 con 0x7f11b408d330 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.640+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac02cd20 con 0x7f11b408d330 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.640+0000 7f11b0a00640 1 -- 172.21.15.100:0/4058003983 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac034660 con 0x7f11b408d330 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 -- 172.21.15.100:0/4058003983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b408d330 msgr2=0x7f11b4188a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 --2- 172.21.15.100:0/4058003983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b408d330 0x7f11b4188a90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f11b418d0f0 tx=0x7f11ac02be10 comp rx=0 tx=0).stop 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 -- 172.21.15.100:0/4058003983 shutdown_connections 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 --2- 172.21.15.100:0/4058003983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b408d330 0x7f11b4188a90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 -- 172.21.15.100:0/4058003983 >> 172.21.15.100:0/4058003983 conn(0x7f11b406e380 msgr2=0x7f11b406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 -- 172.21.15.100:0/4058003983 shutdown_connections 2024-02-21T07:46:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.641+0000 7f11b8e00640 1 -- 172.21.15.100:0/4058003983 wait complete. 2024-02-21T07:46:01.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.643+0000 7f11b8e00640 1 Processor -- start 2024-02-21T07:46:01.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.643+0000 7f11b8e00640 1 -- start start 2024-02-21T07:46:01.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 0x7f11b40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b41861e0 0x7f11b417ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40d0690 con 0x7f11b41861e0 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40d0970 con 0x7f11b406b840 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.644+0000 7f11b8e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40d0c50 con 0x7f11b408d330 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b41861e0 0x7f11b417ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 0x7f11b40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54208/0 (socket says 172.21.15.100:54208) 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 -- 172.21.15.100:0/3670829757 learned_addr learned my addr 172.21.15.100:0/3670829757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 0x7f11b40cfc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34602/0 (socket says 172.21.15.100:34602) 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 -- 172.21.15.100:0/3670829757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 msgr2=0x7f11b40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 0x7f11b40cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 -- 172.21.15.100:0/3670829757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b41861e0 msgr2=0x7f11b417ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b41861e0 0x7f11b417ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.645+0000 7f11b1e00640 1 -- 172.21.15.100:0/3670829757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac009a70 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11b1e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c4a0 tx=0x7f11a400c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40074e0 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4007640 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4004a00 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40d0f30 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.646+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40d14f0 con 0x7f11b406b840 2024-02-21T07:46:01.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.647+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b417ab10 con 0x7f11b406b840 2024-02-21T07:46:01.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.650+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f11a4004b60 con 0x7f11b406b840 2024-02-21T07:46:01.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.652+0000 7f11aa000640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 0x7f11940a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:01.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.652+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f11a40c8cb0 con 0x7f11b406b840 2024-02-21T07:46:01.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.652+0000 7f11b1400640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 0x7f11940a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:01.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.652+0000 7f11b1400640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 0x7f11940a15f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11b40f49a0 tx=0x7f11a0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:01.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.656+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11a4092b00 con 0x7f11b406b840 2024-02-21T07:46:01.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.845+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11b4068390 con 0x7f11b406b840 2024-02-21T07:46:01.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.846+0000 7f11aa000640 1 -- 172.21.15.100:0/3670829757 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11a40180a0 con 0x7f11b406b840 2024-02-21T07:46:01.852 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:46:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.848+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 msgr2=0x7f11940a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.848+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 0x7f11940a15f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f11b40f49a0 tx=0x7f11a0009040 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.848+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 msgr2=0x7f11b4168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.848+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c4a0 tx=0x7f11a400c960 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 shutdown_connections 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f119409f130 0x7f11940a15f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11b41861e0 0x7f11b417ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f11b408d330 0x7f11b40cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 --2- 172.21.15.100:0/3670829757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f11b406b840 0x7f11b4168220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 >> 172.21.15.100:0/3670829757 conn(0x7f11b406e380 msgr2=0x7f11b4184b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 shutdown_connections 2024-02-21T07:46:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:01.849+0000 7f11b8e00640 1 -- 172.21.15.100:0/3670829757 wait complete. 2024-02-21T07:46:01.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:46:02.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.064+0000 7fd5cf800640 1 Processor -- start 2024-02-21T07:46:02.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.065+0000 7fd5cf800640 1 -- start start 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5cf800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd5c8185f20 0x7fd5c80d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5cf800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd5c818a5c0 0x7fd5c81889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5cf800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c818a9f0 con 0x7fd5c8186300 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5cf800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80d6d50 con 0x7fd5c8185f20 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5cf800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c806d080 con 0x7fd5c818a5c0 2024-02-21T07:46:02.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5c7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd5c8186300 0x7fd5c8189eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38616/0 (socket says 172.21.15.100:38616) 2024-02-21T07:46:02.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.066+0000 7fd5c7e00640 1 -- 172.21.15.100:0/3446993645 learned_addr learned my addr 172.21.15.100:0/3446993645 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:02.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5cce00640 1 --2- 172.21.15.100:0/3446993645 >> v2:172.21.15.156:3300/0 conn(0x7fd5c8185f20 0x7fd5c80d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5cd800640 1 --2- 172.21.15.100:0/3446993645 >> v2:172.21.15.170:3300/0 conn(0x7fd5c818a5c0 0x7fd5c81889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293645710 0 0) 0x7fd5b4001110 con 0x7fd5c8186300 2024-02-21T07:46:02.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b0003520 con 0x7fd5c8186300 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633534324 0 0) 0x7fd5b0003520 con 0x7fd5c8186300 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 >> v2:172.21.15.170:3300/0 conn(0x7fd5c818a5c0 msgr2=0x7fd5c81889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 --2- 172.21.15.100:0/3446993645 >> v2:172.21.15.170:3300/0 conn(0x7fd5c818a5c0 0x7fd5c81889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 >> v2:172.21.15.156:3300/0 conn(0x7fd5c8185f20 msgr2=0x7fd5c80d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 --2- 172.21.15.100:0/3446993645 >> v2:172.21.15.156:3300/0 conn(0x7fd5c8185f20 0x7fd5c80d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c806bd00 con 0x7fd5c8186300 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fd5b4001800 con 0x7fd5c8186300 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 >> v1:172.21.15.100:6789/0 conn(0x7fd5c8186300 legacy=0x7fd5c8189eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b0003a10 0x7fd5b0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 0x7fd5b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b0005180 0x7fd5b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80d6d50 con 0x7fd5b0005180 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c806d080 con 0x7fd5b00047c0 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.067+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b000c100 con 0x7fd5b0003a10 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5cce00640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b0003a10 0x7fd5b0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 0x7fd5b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5cd800640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b0005180 0x7fd5b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 -- 172.21.15.100:0/3446993645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b0003a10 msgr2=0x7fd5b0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5b0003a10 0x7fd5b0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 -- 172.21.15.100:0/3446993645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b0005180 msgr2=0x7fd5b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b0005180 0x7fd5b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5c7e00640 1 -- 172.21.15.100:0/3446993645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b0003520 con 0x7fd5b00047c0 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.068+0000 7fd5cd800640 1 -- 172.21.15.100:0/3446993645 reap_dead start 2024-02-21T07:46:02.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.069+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 0x7fd5b0004c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c110 tx=0x7fd5b00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816ab3d582e08c82 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.069+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4005ad0 con 0x7fd5b00047c0 2024-02-21T07:46:02.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.069+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4005c50 con 0x7fd5b00047c0 2024-02-21T07:46:02.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.069+0000 7fd5c7400640 1 -- 172.21.15.100:0/3446993645 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b402c790 con 0x7fd5b00047c0 2024-02-21T07:46:02.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 -- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 msgr2=0x7fd5b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 0x7fd5b0004c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c110 tx=0x7fd5b00057f0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 -- 172.21.15.100:0/3446993645 shutdown_connections 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 --2- 172.21.15.100:0/3446993645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5b00047c0 0x7fd5b0004c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 -- 172.21.15.100:0/3446993645 >> 172.21.15.100:0/3446993645 conn(0x7fd5c80fe270 msgr2=0x7fd5c80fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 -- 172.21.15.100:0/3446993645 shutdown_connections 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.070+0000 7fd5cf800640 1 -- 172.21.15.100:0/3446993645 wait complete. 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.072+0000 7fd5cf800640 1 Processor -- start 2024-02-21T07:46:02.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.072+0000 7fd5cf800640 1 -- start start 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.073+0000 7fd5cf800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.073+0000 7fd5cf800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5c81785e0 0x7fd5c821f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.073+0000 7fd5cf800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 0x7fd5c821fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cf800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8181c10 con 0x7fd5b00047c0 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cf800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8180cb0 con 0x7fd5c8178a60 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cf800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8180f90 con 0x7fd5c81785e0 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54312/0 (socket says 172.21.15.100:54312) 2024-02-21T07:46:02.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 -- 172.21.15.100:0/2202570558 learned_addr learned my addr 172.21.15.100:0/2202570558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cd800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 0x7fd5c821fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5c81785e0 0x7fd5c821f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 -- 172.21.15.100:0/2202570558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5c81785e0 msgr2=0x7fd5c821f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5c81785e0 0x7fd5c821f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 -- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 msgr2=0x7fd5c821fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 0x7fd5c821fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cce00640 1 -- 172.21.15.100:0/2202570558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8181270 con 0x7fd5b00047c0 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.074+0000 7fd5cd800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 0x7fd5c821fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:02.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5cce00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0118e0 tx=0x7fd5bc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00faf0 con 0x7fd5b00047c0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00fc50 con 0x7fd5b00047c0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc014440 con 0x7fd5b00047c0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c8181550 con 0x7fd5b00047c0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.075+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c81808f0 con 0x7fd5b00047c0 2024-02-21T07:46:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.077+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8181e80 con 0x7fd5b00047c0 2024-02-21T07:46:02.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.078+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd5bc0145a0 con 0x7fd5b00047c0 2024-02-21T07:46:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.079+0000 7fd5c4c00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 0x7fd5a80a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.079+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fd5bc0ca3b0 con 0x7fd5b00047c0 2024-02-21T07:46:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.080+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 0x7fd5a80a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.081+0000 7fd5c7e00640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 0x7fd5a80a1570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4034000 tx=0x7fd5b4007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.083+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd5bc0941e0 con 0x7fd5b00047c0 2024-02-21T07:46:02.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.278+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd5c8067c80 con 0x7fd5b00047c0 2024-02-21T07:46:02.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.279+0000 7fd5c4c00640 1 -- 172.21.15.100:0/2202570558 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5bc0978a0 con 0x7fd5b00047c0 2024-02-21T07:46:02.285 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 msgr2=0x7fd5a80a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 0x7fd5a80a1570 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4034000 tx=0x7fd5b4007000 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 msgr2=0x7fd5c81803b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0118e0 tx=0x7fd5bc011da0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 shutdown_connections 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5c8178a60 0x7fd5c821fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5c81785e0 0x7fd5c821f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd5a809f0b0 0x7fd5a80a1570 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 --2- 172.21.15.100:0/2202570558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5b00047c0 0x7fd5c81803b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 >> 172.21.15.100:0/2202570558 conn(0x7fd5c80fe270 msgr2=0x7fd5c80d4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 shutdown_connections 2024-02-21T07:46:02.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.283+0000 7fd5cf800640 1 -- 172.21.15.100:0/2202570558 wait complete. 2024-02-21T07:46:02.314 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.511+0000 7f1204c00640 1 Processor -- start 2024-02-21T07:46:02.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.512+0000 7f1204c00640 1 -- start start 2024-02-21T07:46:02.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.513+0000 7f1204c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f120018a420 0x7f1200070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.513+0000 7f1204c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f120006d950 0x7f12000f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.513+0000 7f1204c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120018a800 con 0x7f1200071470 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.513+0000 7f1204c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000f9b50 con 0x7f120006d950 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.513+0000 7f1204c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120018dba0 con 0x7f120018a420 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fe800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f120006d950 0x7f12000f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11f5400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1200071470 0x7f12000f7b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55928/0 (socket says 172.21.15.100:55928) 2024-02-21T07:46:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11f5400640 1 -- 172.21.15.100:0/4138355521 learned_addr learned my addr 172.21.15.100:0/4138355521 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fde00640 1 --2- 172.21.15.100:0/4138355521 >> v2:172.21.15.170:3300/0 conn(0x7f120018a420 0x7f1200070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fe800640 1 -- 172.21.15.100:0/4138355521 >> v2:172.21.15.170:3300/0 conn(0x7f120018a420 msgr2=0x7f1200070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fe800640 1 --2- 172.21.15.100:0/4138355521 >> v2:172.21.15.170:3300/0 conn(0x7f120018a420 0x7f1200070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fe800640 1 -- 172.21.15.100:0/4138355521 >> v1:172.21.15.156:6789/0 conn(0x7f1200071470 legacy=0x7f12000f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fe800640 1 -- 172.21.15.100:0/4138355521 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120006de80 con 0x7f120006d950 2024-02-21T07:46:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.514+0000 7f11fd400640 1 -- 172.21.15.100:0/4138355521 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126671371 0 0) 0x7f120018a800 con 0x7f1200071470 2024-02-21T07:46:02.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.515+0000 7f11fe800640 1 --2- 172.21.15.100:0/4138355521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f120006d950 0x7f12000f82a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f120006f130 tx=0x7f11f802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36046d9ae15eba83 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.515+0000 7f11fd400640 1 -- 172.21.15.100:0/4138355521 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f802cb60 con 0x7f120006d950 2024-02-21T07:46:02.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.515+0000 7f11fd400640 1 -- 172.21.15.100:0/4138355521 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f802ccc0 con 0x7f120006d950 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.515+0000 7f11fd400640 1 -- 172.21.15.100:0/4138355521 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8034660 con 0x7f120006d950 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 -- 172.21.15.100:0/4138355521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f120006d950 msgr2=0x7f12000f82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 --2- 172.21.15.100:0/4138355521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f120006d950 0x7f12000f82a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f120006f130 tx=0x7f11f802bdb0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 -- 172.21.15.100:0/4138355521 shutdown_connections 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 --2- 172.21.15.100:0/4138355521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f120006d950 0x7f12000f82a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 --2- 172.21.15.100:0/4138355521 >> v2:172.21.15.170:3300/0 conn(0x7f120018a420 0x7f1200070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 -- 172.21.15.100:0/4138355521 >> 172.21.15.100:0/4138355521 conn(0x7f12000ce160 msgr2=0x7f12000ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 -- 172.21.15.100:0/4138355521 shutdown_connections 2024-02-21T07:46:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.516+0000 7f1204c00640 1 -- 172.21.15.100:0/4138355521 wait complete. 2024-02-21T07:46:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.518+0000 7f1204c00640 1 Processor -- start 2024-02-21T07:46:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.518+0000 7f1204c00640 1 -- start start 2024-02-21T07:46:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f120006d950 0x7f12001765a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f120018a420 0x7f12000f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200183b90 con 0x7f1200071470 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1200183e70 con 0x7f120018a420 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.519+0000 7f1204c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000f0d60 con 0x7f120006d950 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54328/0 (socket says 172.21.15.100:54328) 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 -- 172.21.15.100:0/3678885255 learned_addr learned my addr 172.21.15.100:0/3678885255 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11fe800640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f120018a420 0x7f12000f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11fde00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f120006d950 0x7f12001765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 -- 172.21.15.100:0/3678885255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f120006d950 msgr2=0x7f12001765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f120006d950 0x7f12001765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 -- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f120018a420 msgr2=0x7f12000f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f120018a420 0x7f12000f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 -- 172.21.15.100:0/3678885255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f8009a70 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.520+0000 7f11f5400640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3f0 tx=0x7f11e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.521+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80074e0 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.521+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8007640 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.521+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000f1040 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.521+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004a00 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.521+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12000f1600 con 0x7f1200071470 2024-02-21T07:46:02.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.522+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200067c80 con 0x7f1200071470 2024-02-21T07:46:02.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.524+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f11e8004b60 con 0x7f1200071470 2024-02-21T07:46:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.526+0000 7f11f6a00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 0x7f11dc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.526+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f11e80c9ee0 con 0x7f1200071470 2024-02-21T07:46:02.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.526+0000 7f11fde00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 0x7f11dc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.527+0000 7f11fde00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 0x7f11dc0a15f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009aa0 tx=0x7f11f0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.528+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11e8093c80 con 0x7f1200071470 2024-02-21T07:46:02.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.762+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12000f8780 con 0x7f1200071470 2024-02-21T07:46:02.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.763+0000 7f11f6a00640 1 -- 172.21.15.100:0/3678885255 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f11e8097340 con 0x7f1200071470 2024-02-21T07:46:02.768 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:02.768 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:49.408446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:02.769 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-02-21T07:46:02.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 msgr2=0x7f11dc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 0x7f11dc0a15f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009aa0 tx=0x7f11f0009190 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 msgr2=0x7f12002233f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3f0 tx=0x7f11e800c8b0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 shutdown_connections 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f120018a420 0x7f12000f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f11dc09f130 0x7f11dc0a15f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1200071470 0x7f12002233f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 --2- 172.21.15.100:0/3678885255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f120006d950 0x7f12001765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 >> 172.21.15.100:0/3678885255 conn(0x7f12000ce160 msgr2=0x7f120008c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:02.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.766+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 shutdown_connections 2024-02-21T07:46:02.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.767+0000 7f1204c00640 1 -- 172.21.15.100:0/3678885255 wait complete. 2024-02-21T07:46:02.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:02.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.981+0000 7fe5ece00640 1 Processor -- start 2024-02-21T07:46:02.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.981+0000 7fe5ece00640 1 -- start start 2024-02-21T07:46:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.983+0000 7fe5ece00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 0x7fe5e818b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.983+0000 7fe5ece00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5e80d3dc0 0x7fe5e80d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.983+0000 7fe5ece00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e818b670 con 0x7fe5e8186050 2024-02-21T07:46:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.983+0000 7fe5ece00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e818a600 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.983+0000 7fe5ece00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80d69b0 con 0x7fe5e8186430 2024-02-21T07:46:02.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5e80d3dc0 0x7fe5e80d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe5e80d3dc0 0x7fe5e80d4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54338/0 (socket says 172.21.15.100:54338) 2024-02-21T07:46:02.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 -- 172.21.15.100:0/3471400892 learned_addr learned my addr 172.21.15.100:0/3471400892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5dfe00640 1 --2- 172.21.15.100:0/3471400892 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 0x7fe5e818b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 -- 172.21.15.100:0/3471400892 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 msgr2=0x7fe5e818b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 --2- 172.21.15.100:0/3471400892 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 0x7fe5e818b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 -- 172.21.15.100:0/3471400892 >> v1:172.21.15.156:6789/0 conn(0x7fe5e8186050 legacy=0x7fe5e818aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e6800640 1 -- 172.21.15.100:0/3471400892 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80d5aa0 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.984+0000 7fe5e5400640 1 -- 172.21.15.100:0/3471400892 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268631848 0 0) 0x7fe5e818b670 con 0x7fe5e8186050 2024-02-21T07:46:02.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.985+0000 7fe5dfe00640 1 --2- 172.21.15.100:0/3471400892 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 0x7fe5e818b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:02.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5e6800640 1 --2- 172.21.15.100:0/3471400892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e80d4250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8067430 tx=0x7fe5e002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a61c50128141a3e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5e5400640 1 -- 172.21.15.100:0/3471400892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e002ca80 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5e5400640 1 -- 172.21.15.100:0/3471400892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e002cbe0 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5e5400640 1 -- 172.21.15.100:0/3471400892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00343f0 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5ece00640 1 -- 172.21.15.100:0/3471400892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 msgr2=0x7fe5e80d4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.986+0000 7fe5ece00640 1 --2- 172.21.15.100:0/3471400892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e80d4250 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8067430 tx=0x7fe5e002bee0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 -- 172.21.15.100:0/3471400892 shutdown_connections 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 --2- 172.21.15.100:0/3471400892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e80d4250 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 --2- 172.21.15.100:0/3471400892 >> v2:172.21.15.156:3300/0 conn(0x7fe5e8186430 0x7fe5e818b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 -- 172.21.15.100:0/3471400892 >> 172.21.15.100:0/3471400892 conn(0x7fe5e80d2540 msgr2=0x7fe5e80d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:02.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 -- 172.21.15.100:0/3471400892 shutdown_connections 2024-02-21T07:46:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.987+0000 7fe5ece00640 1 -- 172.21.15.100:0/3471400892 wait complete. 2024-02-21T07:46:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.989+0000 7fe5ece00640 1 Processor -- start 2024-02-21T07:46:02.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.989+0000 7fe5ece00640 1 -- start start 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e8178890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e8186050 0x7fe5e8178dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 0x7fe5e8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e82202d0 con 0x7fe5e80d3dc0 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e821f6e0 con 0x7fe5e8159740 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5ece00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e815a4f0 con 0x7fe5e8186050 2024-02-21T07:46:02.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5e5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e8178890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5e6800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 0x7fe5e8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5e5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e8178890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54348/0 (socket says 172.21.15.100:54348) 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5e5e00640 1 -- 172.21.15.100:0/2482764264 learned_addr learned my addr 172.21.15.100:0/2482764264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.990+0000 7fe5dfe00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e8186050 0x7fe5e8178dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 -- 172.21.15.100:0/2482764264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e8186050 msgr2=0x7fe5e8178dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e8186050 0x7fe5e8178dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 -- 172.21.15.100:0/2482764264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 msgr2=0x7fe5e8178890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e8178890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 -- 172.21.15.100:0/2482764264 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0009400 con 0x7fe5e8159740 2024-02-21T07:46:02.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5e6800640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 0x7fe5e8159bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8067460 tx=0x7fe5e0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0009510 con 0x7fe5e8159740 2024-02-21T07:46:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e003e450 con 0x7fe5e8159740 2024-02-21T07:46:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e003e600 con 0x7fe5e8159740 2024-02-21T07:46:02.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e0009b30 con 0x7fe5e8159740 2024-02-21T07:46:02.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.991+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e821fc10 con 0x7fe5e8159740 2024-02-21T07:46:02.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.993+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e8220410 con 0x7fe5e8159740 2024-02-21T07:46:03.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.994+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe5e002cd50 con 0x7fe5e8159740 2024-02-21T07:46:03.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.996+0000 7fe5de000640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 0x7fe5c40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.996+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe5e00ebff0 con 0x7fe5e8159740 2024-02-21T07:46:03.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.996+0000 7fe5e5e00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 0x7fe5c40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.997+0000 7fe5e5e00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 0x7fe5c40a15f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cecb0 tx=0x7fe5d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:02.998+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5e00b5e20 con 0x7fe5e8159740 2024-02-21T07:46:03.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.177+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5e8220410 con 0x7fe5e8159740 2024-02-21T07:46:03.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.179+0000 7fe5de000640 1 -- 172.21.15.100:0/2482764264 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7fe5e8220410 con 0x7fe5e8159740 2024-02-21T07:46:03.185 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:03.186 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 msgr2=0x7fe5c40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 0x7fe5c40a15f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80cecb0 tx=0x7fe5d8009040 comp rx=0 tx=0).stop 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 msgr2=0x7fe5e8159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 0x7fe5e8159bd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8067460 tx=0x7fe5e0004a40 comp rx=0 tx=0).stop 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 shutdown_connections 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5e8159740 0x7fe5e8159bd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5e8186050 0x7fe5e8178dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5c409f130 0x7fe5c40a15f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 --2- 172.21.15.100:0/2482764264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5e80d3dc0 0x7fe5e8178890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.182+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 >> 172.21.15.100:0/2482764264 conn(0x7fe5e80d2540 msgr2=0x7fe5e81850c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:03.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.183+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 shutdown_connections 2024-02-21T07:46:03.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.183+0000 7fe5ece00640 1 -- 172.21.15.100:0/2482764264 wait complete. 2024-02-21T07:46:03.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:46:03.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:46:03.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.411+0000 7fa825200640 1 Processor -- start 2024-02-21T07:46:03.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.411+0000 7fa825200640 1 -- start start 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa8201645b0 0x7fa8200d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa82006bcc0 0x7fa82018a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa82018a7d0 0x7fa82018c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200d4b20 con 0x7fa82006bcc0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82006d050 con 0x7fa82018a7d0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.413+0000 7fa825200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82006c1f0 con 0x7fa8201645b0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa8201645b0 0x7fa8200d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa82006bcc0 0x7fa82018a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa8201645b0 0x7fa8200d45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34682/0 (socket says 172.21.15.100:34682) 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 -- 172.21.15.100:0/2210260464 learned_addr learned my addr 172.21.15.100:0/2210260464 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81e800640 1 --2- 172.21.15.100:0/2210260464 >> v2:172.21.15.156:3300/0 conn(0x7fa82018a7d0 0x7fa82018c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 -- 172.21.15.100:0/2210260464 >> v2:172.21.15.156:3300/0 conn(0x7fa82018a7d0 msgr2=0x7fa82018c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:03.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 --2- 172.21.15.100:0/2210260464 >> v2:172.21.15.156:3300/0 conn(0x7fa82018a7d0 0x7fa82018c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 -- 172.21.15.100:0/2210260464 >> v2:172.21.15.100:3300/0 conn(0x7fa82006bcc0 msgr2=0x7fa82018a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:03.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 --2- 172.21.15.100:0/2210260464 >> v2:172.21.15.100:3300/0 conn(0x7fa82006bcc0 0x7fa82018a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.414+0000 7fa81de00640 1 -- 172.21.15.100:0/2210260464 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82006c4d0 con 0x7fa8201645b0 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.415+0000 7fa81de00640 1 --2- 172.21.15.100:0/2210260464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8201645b0 0x7fa8200d45e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa82017fab0 tx=0x7fa80802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fd75ce569039b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa81ca00640 1 -- 172.21.15.100:0/2210260464 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031800 con 0x7fa8201645b0 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa81ca00640 1 -- 172.21.15.100:0/2210260464 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa808031960 con 0x7fa8201645b0 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa81ca00640 1 -- 172.21.15.100:0/2210260464 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808031cf0 con 0x7fa8201645b0 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 -- 172.21.15.100:0/2210260464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8201645b0 msgr2=0x7fa8200d45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 --2- 172.21.15.100:0/2210260464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8201645b0 0x7fa8200d45e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa82017fab0 tx=0x7fa80802b8a0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 -- 172.21.15.100:0/2210260464 shutdown_connections 2024-02-21T07:46:03.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 --2- 172.21.15.100:0/2210260464 >> v2:172.21.15.156:3300/0 conn(0x7fa82018a7d0 0x7fa82018c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 --2- 172.21.15.100:0/2210260464 >> v2:172.21.15.100:3300/0 conn(0x7fa82006bcc0 0x7fa82018a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 --2- 172.21.15.100:0/2210260464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa8201645b0 0x7fa8200d45e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 -- 172.21.15.100:0/2210260464 >> 172.21.15.100:0/2210260464 conn(0x7fa8200fe210 msgr2=0x7fa8200fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 -- 172.21.15.100:0/2210260464 shutdown_connections 2024-02-21T07:46:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.416+0000 7fa825200640 1 -- 172.21.15.100:0/2210260464 wait complete. 2024-02-21T07:46:03.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.418+0000 7fa825200640 1 Processor -- start 2024-02-21T07:46:03.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.419+0000 7fa825200640 1 -- start start 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 0x7fa82017c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa82018a7d0 0x7fa82017f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82017e880 con 0x7fa8201645b0 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82021e5f0 con 0x7fa82018a7d0 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa825200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82017dc00 con 0x7fa82006bcc0 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 0x7fa82017c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54364/0 (socket says 172.21.15.100:54364) 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 -- 172.21.15.100:0/805544194 learned_addr learned my addr 172.21.15.100:0/805544194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 0x7fa82017c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34692/0 (socket says 172.21.15.100:34692) 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81e800640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa82018a7d0 0x7fa82017f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 -- 172.21.15.100:0/805544194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 msgr2=0x7fa82017c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 0x7fa82017c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 -- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa82018a7d0 msgr2=0x7fa82017f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa82018a7d0 0x7fa82017f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.420+0000 7fa81d400640 1 -- 172.21.15.100:0/805544194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080094d0 con 0x7fa8201645b0 2024-02-21T07:46:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa81d400640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa81000eed0 tx=0x7fa81000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810010040 con 0x7fa8201645b0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000bd90 con 0x7fa8201645b0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82017dee0 con 0x7fa8201645b0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810014620 con 0x7fa8201645b0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.421+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82017e4a0 con 0x7fa8201645b0 2024-02-21T07:46:03.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.422+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa820067c80 con 0x7fa8201645b0 2024-02-21T07:46:03.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.424+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa810014990 con 0x7fa8201645b0 2024-02-21T07:46:03.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.425+0000 7fa816000640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 0x7fa7fc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.426+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa8100ca600 con 0x7fa8201645b0 2024-02-21T07:46:03.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.426+0000 7fa81de00640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 0x7fa7fc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.427+0000 7fa81de00640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 0x7fa7fc0a15f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.430+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa810094200 con 0x7fa8201645b0 2024-02-21T07:46:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.627+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8200fdf00 con 0x7fa8201645b0 2024-02-21T07:46:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.628+0000 7fa816000640 1 -- 172.21.15.100:0/805544194 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa810096130 con 0x7fa8201645b0 2024-02-21T07:46:03.634 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 msgr2=0x7fa7fc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 0x7fa7fc0a15f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa808036000 tx=0x7fa80803c040 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 msgr2=0x7fa82017eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa81000eed0 tx=0x7fa81000b480 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 shutdown_connections 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa82018a7d0 0x7fa82017f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7fc09f130 0x7fa7fc0a15f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8201645b0 0x7fa82017eca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 --2- 172.21.15.100:0/805544194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa82006bcc0 0x7fa82017c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 >> 172.21.15.100:0/805544194 conn(0x7fa8200fe210 msgr2=0x7fa8200d4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:03.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 shutdown_connections 2024-02-21T07:46:03.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.631+0000 7fa825200640 1 -- 172.21.15.100:0/805544194 wait complete. 2024-02-21T07:46:03.657 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:46:03.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.867+0000 7fe1b7e00640 1 Processor -- start 2024-02-21T07:46:03.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.868+0000 7fe1b7e00640 1 -- start start 2024-02-21T07:46:03.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.869+0000 7fe1b7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe1b0190260 0x7fe1b0070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe1b00f4b20 0x7fe1b00f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b7e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b018dc80 con 0x7fe1b006e6b0 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b7e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00f5b90 con 0x7fe1b00f4b20 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b7e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00f55d0 con 0x7fe1b0190260 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe1b0190260 0x7fe1b0070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b4a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe1b00f4b20 0x7fe1b00f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe1b006e6b0 0x7fe1b0190640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55938/0 (socket says 172.21.15.100:55938) 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe1b0190260 0x7fe1b0070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34708/0 (socket says 172.21.15.100:34708) 2024-02-21T07:46:03.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5e00640 1 -- 172.21.15.100:0/1774006749 learned_addr learned my addr 172.21.15.100:0/1774006749 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5400640 1 -- 172.21.15.100:0/1774006749 >> v2:172.21.15.100:3300/0 conn(0x7fe1b00f4b20 msgr2=0x7fe1b00f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5400640 1 --2- 172.21.15.100:0/1774006749 >> v2:172.21.15.100:3300/0 conn(0x7fe1b00f4b20 0x7fe1b00f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1b5400640 1 -- 172.21.15.100:0/1774006749 >> v1:172.21.15.156:6789/0 conn(0x7fe1b006e6b0 legacy=0x7fe1b0190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.871+0000 7fe1b5400640 1 -- 172.21.15.100:0/1774006749 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00f58b0 con 0x7fe1b0190260 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.870+0000 7fe1afe00640 1 -- 172.21.15.100:0/1774006749 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140888109 0 0) 0x7fe1b018dc80 con 0x7fe1b006e6b0 2024-02-21T07:46:03.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.872+0000 7fe1b5400640 1 --2- 172.21.15.100:0/1774006749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0190260 0x7fe1b0070a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1b008d4e0 tx=0x7fe1a402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e01082c33b4f41 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.872+0000 7fe1afe00640 1 -- 172.21.15.100:0/1774006749 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4031710 con 0x7fe1b0190260 2024-02-21T07:46:03.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.872+0000 7fe1afe00640 1 -- 172.21.15.100:0/1774006749 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a402f050 con 0x7fe1b0190260 2024-02-21T07:46:03.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.872+0000 7fe1afe00640 1 -- 172.21.15.100:0/1774006749 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4031a90 con 0x7fe1b0190260 2024-02-21T07:46:03.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 -- 172.21.15.100:0/1774006749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0190260 msgr2=0x7fe1b0070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/1774006749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0190260 0x7fe1b0070a30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1b008d4e0 tx=0x7fe1a402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 -- 172.21.15.100:0/1774006749 shutdown_connections 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/1774006749 >> v2:172.21.15.100:3300/0 conn(0x7fe1b00f4b20 0x7fe1b00f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/1774006749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b0190260 0x7fe1b0070a30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 -- 172.21.15.100:0/1774006749 >> 172.21.15.100:0/1774006749 conn(0x7fe1b00668b0 msgr2=0x7fe1b0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 -- 172.21.15.100:0/1774006749 shutdown_connections 2024-02-21T07:46:03.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.873+0000 7fe1b7e00640 1 -- 172.21.15.100:0/1774006749 wait complete. 2024-02-21T07:46:03.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.876+0000 7fe1b7e00640 1 Processor -- start 2024-02-21T07:46:03.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.876+0000 7fe1b7e00640 1 -- start start 2024-02-21T07:46:03.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.877+0000 7fe1b7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.877+0000 7fe1b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 0x7fe1b0224800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b0190260 0x7fe1b0221300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0226000 con 0x7fe1b0190260 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b7e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0175610 con 0x7fe1b006e6b0 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b02250a0 con 0x7fe1b00f4b20 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b0190260 0x7fe1b0221300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 0x7fe1b0224800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54298/0 (socket says 172.21.15.100:54298) 2024-02-21T07:46:03.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 -- 172.21.15.100:0/3480376305 learned_addr learned my addr 172.21.15.100:0/3480376305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 -- 172.21.15.100:0/3480376305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 msgr2=0x7fe1b0224800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 0x7fe1b0224800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 -- 172.21.15.100:0/3480376305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b0190260 msgr2=0x7fe1b0221300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b0190260 0x7fe1b0221300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b5400640 1 -- 172.21.15.100:0/3480376305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009400 con 0x7fe1b006e6b0 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.878+0000 7fe1b4a00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 0x7fe1b0224800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:03.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1b5400640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4000c00 tx=0x7fe1a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a403c8d0 con 0x7fe1b006e6b0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a403ca30 con 0x7fe1b006e6b0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a403cde0 con 0x7fe1b006e6b0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b0225380 con 0x7fe1b006e6b0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.879+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0225940 con 0x7fe1b006e6b0 2024-02-21T07:46:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.880+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b01862b0 con 0x7fe1b006e6b0 2024-02-21T07:46:03.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.882+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe1a403a040 con 0x7fe1b006e6b0 2024-02-21T07:46:03.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.883+0000 7fe1ad600640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 0x7fe1900a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:03.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.883+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe1a40eb590 con 0x7fe1b006e6b0 2024-02-21T07:46:03.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.884+0000 7fe1b4a00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 0x7fe1900a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:03.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.884+0000 7fe1b4a00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 0x7fe1900a15f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1b017e1a0 tx=0x7fe19c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:03.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:03.886+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1a40b52d0 con 0x7fe1b006e6b0 2024-02-21T07:46:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.065+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b0067c80 con 0x7fe1b006e6b0 2024-02-21T07:46:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.066+0000 7fe1ad600640 1 -- 172.21.15.100:0/3480376305 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1a40380a0 con 0x7fe1b006e6b0 2024-02-21T07:46:04.072 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:04.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.069+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 msgr2=0x7fe1900a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 0x7fe1900a15f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe1b017e1a0 tx=0x7fe19c009190 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 msgr2=0x7fe1b01750d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4000c00 tx=0x7fe1a40046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 shutdown_connections 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe19009f130 0x7fe1900a15f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b0190260 0x7fe1b0221300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1b00f4b20 0x7fe1b0224800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 --2- 172.21.15.100:0/3480376305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe1b006e6b0 0x7fe1b01750d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 >> 172.21.15.100:0/3480376305 conn(0x7fe1b00668b0 msgr2=0x7fe1b00f79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 shutdown_connections 2024-02-21T07:46:04.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.070+0000 7fe1b7e00640 1 -- 172.21.15.100:0/3480376305 wait complete. 2024-02-21T07:46:04.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:46:04.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.295+0000 7f4876c00640 1 Processor -- start 2024-02-21T07:46:04.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.296+0000 7f4876c00640 1 -- start start 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4870188a30 0x7f48700c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 0x7f48700c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f48700f7fe0 0x7f4870188e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700f9470 con 0x7f48700f9890 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700f8510 con 0x7f48700f7fe0 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700f87f0 con 0x7f4870188a30 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4874e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 0x7f48700c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4874e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 0x7f48700c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54396/0 (socket says 172.21.15.100:54396) 2024-02-21T07:46:04.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4874e00640 1 -- 172.21.15.100:0/568128932 learned_addr learned my addr 172.21.15.100:0/568128932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.170:3300/0 conn(0x7f4870188a30 0x7f48700c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4876200640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.156:3300/0 conn(0x7f48700f7fe0 0x7f4870188e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 -- 172.21.15.100:0/568128932 >> v2:172.21.15.156:3300/0 conn(0x7f48700f7fe0 msgr2=0x7f4870188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.156:3300/0 conn(0x7f48700f7fe0 0x7f4870188e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 -- 172.21.15.100:0/568128932 >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 msgr2=0x7f48700c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 0x7f48700c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.298+0000 7f4875800640 1 -- 172.21.15.100:0/568128932 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700f8ad0 con 0x7f4870188a30 2024-02-21T07:46:04.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.300+0000 7f4875800640 1 --2- 172.21.15.100:0/568128932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870188a30 0x7f48700c9470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487006cdc0 tx=0x7f486002d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6ca5d5e646cc6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.300+0000 7f486fe00640 1 -- 172.21.15.100:0/568128932 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860031800 con 0x7f4870188a30 2024-02-21T07:46:04.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.300+0000 7f486fe00640 1 -- 172.21.15.100:0/568128932 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860031960 con 0x7f4870188a30 2024-02-21T07:46:04.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.300+0000 7f486fe00640 1 -- 172.21.15.100:0/568128932 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860031cf0 con 0x7f4870188a30 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 -- 172.21.15.100:0/568128932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870188a30 msgr2=0x7f48700c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 --2- 172.21.15.100:0/568128932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870188a30 0x7f48700c9470 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f487006cdc0 tx=0x7f486002d9e0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 -- 172.21.15.100:0/568128932 shutdown_connections 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.156:3300/0 conn(0x7f48700f7fe0 0x7f4870188e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 --2- 172.21.15.100:0/568128932 >> v2:172.21.15.100:3300/0 conn(0x7f48700f9890 0x7f48700c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 --2- 172.21.15.100:0/568128932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870188a30 0x7f48700c9470 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 -- 172.21.15.100:0/568128932 >> 172.21.15.100:0/568128932 conn(0x7f48700ce150 msgr2=0x7f48700ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 -- 172.21.15.100:0/568128932 shutdown_connections 2024-02-21T07:46:04.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.301+0000 7f4876c00640 1 -- 172.21.15.100:0/568128932 wait complete. 2024-02-21T07:46:04.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.303+0000 7f4876c00640 1 Processor -- start 2024-02-21T07:46:04.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.303+0000 7f4876c00640 1 -- start start 2024-02-21T07:46:04.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4870188a30 0x7f4870220ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870221420 0x7f487021e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48702218b0 con 0x7f48700f7fe0 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487021fb60 con 0x7f4870188a30 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4876c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487021fe40 con 0x7f4870221420 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.304+0000 7f4875800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54400/0 (socket says 172.21.15.100:54400) 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 -- 172.21.15.100:0/431578680 learned_addr learned my addr 172.21.15.100:0/431578680 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4876200640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870221420 0x7f487021e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4874e00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4870188a30 0x7f4870220ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 -- 172.21.15.100:0/431578680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870221420 msgr2=0x7f487021e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870221420 0x7f487021e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 -- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4870188a30 msgr2=0x7f4870220ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4870188a30 0x7f4870220ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 -- 172.21.15.100:0/431578680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009400 con 0x7f48700f7fe0 2024-02-21T07:46:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f4875800640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4860009860 tx=0x7f48600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.305+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486003ac50 con 0x7f48700f7fe0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.306+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486003adb0 con 0x7f48700f7fe0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.306+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860044630 con 0x7f48700f7fe0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.306+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4870220120 con 0x7f48700f7fe0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.306+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48702206e0 con 0x7f48700f7fe0 2024-02-21T07:46:04.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.307+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48700751d0 con 0x7f48700f7fe0 2024-02-21T07:46:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.308+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4860044790 con 0x7f48700f7fe0 2024-02-21T07:46:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.310+0000 7f486d600640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 0x7f48500a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.310+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f48600ebe70 con 0x7f48700f7fe0 2024-02-21T07:46:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.310+0000 7f4874e00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 0x7f48500a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.311+0000 7f4874e00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 0x7f48500a15f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48700f7d40 tx=0x7f485c009240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.314+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f486007e8c0 con 0x7f48700f7fe0 2024-02-21T07:46:04.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.509+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4870180570 con 0x7f48700f7fe0 2024-02-21T07:46:04.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.510+0000 7f486d600640 1 -- 172.21.15.100:0/431578680 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48600b5bb0 con 0x7f48700f7fe0 2024-02-21T07:46:04.515 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:46:04.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.512+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 msgr2=0x7f48500a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.512+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 0x7f48500a15f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48700f7d40 tx=0x7f485c009240 comp rx=0 tx=0).stop 2024-02-21T07:46:04.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.512+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 msgr2=0x7f4870160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.512+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4860009860 tx=0x7f48600046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 shutdown_connections 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4870221420 0x7f487021e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4870188a30 0x7f4870220ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f485009f130 0x7f48500a15f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 --2- 172.21.15.100:0/431578680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48700f7fe0 0x7f4870160020 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 >> 172.21.15.100:0/431578680 conn(0x7f48700ce150 msgr2=0x7f487006e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 shutdown_connections 2024-02-21T07:46:04.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.513+0000 7f4876c00640 1 -- 172.21.15.100:0/431578680 wait complete. 2024-02-21T07:46:04.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:46:04.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.729+0000 7ff7c3400640 1 Processor -- start 2024-02-21T07:46:04.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.730+0000 7ff7c3400640 1 -- start start 2024-02-21T07:46:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.731+0000 7ff7c3400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff7bc072450 0x7ff7bc186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7c3400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc186670 con 0x7ff7bc188c30 2024-02-21T07:46:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7c3400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc071010 con 0x7ff7bc182f60 2024-02-21T07:46:04.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7c3400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc183340 con 0x7ff7bc072450 2024-02-21T07:46:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7c1400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff7bc188c30 0x7ff7bc189060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38620/0 (socket says 172.21.15.100:38620) 2024-02-21T07:46:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7c1400640 1 -- 172.21.15.100:0/1985971065 learned_addr learned my addr 172.21.15.100:0/1985971065 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:04.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7bbe00640 1 --2- 172.21.15.100:0/1985971065 >> v2:172.21.15.170:3300/0 conn(0x7ff7bc072450 0x7ff7bc186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954498099 0 0) 0x7ff7bc186670 con 0x7ff7bc188c30 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a4003520 con 0x7ff7bc188c30 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882629753 0 0) 0x7ff7bc071010 con 0x7ff7bc182f60 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.732+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7bc186670 con 0x7ff7bc182f60 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.733+0000 7ff7bbe00640 1 -- 172.21.15.100:0/1985971065 >> v1:172.21.15.170:6789/0 conn(0x7ff7bc182f60 legacy=0x7ff7bc071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.733+0000 7ff7bbe00640 1 -- 172.21.15.100:0/1985971065 >> v1:172.21.15.100:6789/0 conn(0x7ff7bc188c30 legacy=0x7ff7bc189060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.733+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189923028 0 0) 0x7ff7a4003520 con 0x7ff7bc188c30 2024-02-21T07:46:04.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.733+0000 7ff7bbe00640 1 -- 172.21.15.100:0/1985971065 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc06eb10 con 0x7ff7bc072450 2024-02-21T07:46:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7bbe00640 1 --2- 172.21.15.100:0/1985971065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc072450 0x7ff7bc186130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80097a0 tx=0x7ff7a802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e393a93e584fb06 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40019f0 con 0x7ff7bc072450 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a802e050 con 0x7ff7bc072450 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7bb400640 1 -- 172.21.15.100:0/1985971065 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8030730 con 0x7ff7bc072450 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7c3400640 1 -- 172.21.15.100:0/1985971065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc072450 msgr2=0x7ff7bc186130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.734+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1985971065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc072450 0x7ff7bc186130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80097a0 tx=0x7ff7a802b790 comp rx=0 tx=0).stop 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.735+0000 7ff7c3400640 1 -- 172.21.15.100:0/1985971065 shutdown_connections 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.735+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1985971065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc072450 0x7ff7bc186130 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.735+0000 7ff7c3400640 1 -- 172.21.15.100:0/1985971065 >> 172.21.15.100:0/1985971065 conn(0x7ff7bc0668b0 msgr2=0x7ff7bc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.735+0000 7ff7c3400640 1 -- 172.21.15.100:0/1985971065 shutdown_connections 2024-02-21T07:46:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.735+0000 7ff7c3400640 1 -- 172.21.15.100:0/1985971065 wait complete. 2024-02-21T07:46:04.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.736+0000 7ff7c3400640 1 Processor -- start 2024-02-21T07:46:04.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.737+0000 7ff7c3400640 1 -- start start 2024-02-21T07:46:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7bc182f60 0x7ff7bc180780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc188c30 0x7ff7bc2222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0ca6b0 con 0x7ff7bc072450 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c9750 con 0x7ff7bc182f60 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c3400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0c9a30 con 0x7ff7bc188c30 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54414/0 (socket says 172.21.15.100:54414) 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 -- 172.21.15.100:0/1187303291 learned_addr learned my addr 172.21.15.100:0/1187303291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c1400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc188c30 0x7ff7bc2222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7bbe00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7bc182f60 0x7ff7bc180780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 -- 172.21.15.100:0/1187303291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc188c30 msgr2=0x7ff7bc2222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc188c30 0x7ff7bc2222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 -- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7bc182f60 msgr2=0x7ff7bc180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7bc182f60 0x7ff7bc180780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.738+0000 7ff7c0a00640 1 -- 172.21.15.100:0/1187303291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009400 con 0x7ff7bc072450 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7c0a00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c430 tx=0x7ff7b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00052d0 con 0x7ff7bc072450 2024-02-21T07:46:04.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0005450 con 0x7ff7bc072450 2024-02-21T07:46:04.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0003830 con 0x7ff7bc072450 2024-02-21T07:46:04.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0c9d10 con 0x7ff7bc072450 2024-02-21T07:46:04.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.739+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc0ca2d0 con 0x7ff7bc072450 2024-02-21T07:46:04.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.740+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc0ca460 con 0x7ff7bc072450 2024-02-21T07:46:04.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.742+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ff7b0003990 con 0x7ff7bc072450 2024-02-21T07:46:04.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.743+0000 7ff7b8c00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 0x7ff79c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:04.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.743+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ff7b00c9210 con 0x7ff7bc072450 2024-02-21T07:46:04.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.743+0000 7ff7bbe00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 0x7ff79c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:04.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.744+0000 7ff7bbe00640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 0x7ff79c0a15f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:04.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.747+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7b0092fd0 con 0x7ff7bc072450 2024-02-21T07:46:04.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.941+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7bc17cdd0 con 0x7ff7bc072450 2024-02-21T07:46:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.941+0000 7ff7b8c00640 1 -- 172.21.15.100:0/1187303291 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7b0017020 con 0x7ff7bc072450 2024-02-21T07:46:04.947 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:04.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 msgr2=0x7ff79c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 0x7ff79c0a15f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8034000 tx=0x7ff7a802f000 comp rx=0 tx=0).stop 2024-02-21T07:46:04.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 msgr2=0x7ff7bc173070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:04.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000c430 tx=0x7ff7b000c8f0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 shutdown_connections 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7bc188c30 0x7ff7bc2222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff7bc182f60 0x7ff7bc180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff79c09f130 0x7ff79c0a15f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 --2- 172.21.15.100:0/1187303291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7bc072450 0x7ff7bc173070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 >> 172.21.15.100:0/1187303291 conn(0x7ff7bc0668b0 msgr2=0x7ff7bc071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 shutdown_connections 2024-02-21T07:46:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:04.944+0000 7ff7c3400640 1 -- 172.21.15.100:0/1187303291 wait complete. 2024-02-21T07:46:04.968 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:05.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.171+0000 7f07bee00640 1 Processor -- start 2024-02-21T07:46:05.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.172+0000 7f07bee00640 1 -- start start 2024-02-21T07:46:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.173+0000 7f07bee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07b817c040 0x7f07b80706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bee00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07b8070f30 0x7f07b80713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b80f50d0 con 0x7f07b8188c00 2024-02-21T07:46:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bee00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80f4ec0 con 0x7f07b8070f30 2024-02-21T07:46:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bee00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b80f6450 con 0x7f07b817c040 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07b7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f07b817c040 0x7f07b80706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f07b8188c00 0x7f07b8189090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38624/0 (socket says 172.21.15.100:38624) 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07bce00640 1 -- 172.21.15.100:0/1543913933 learned_addr learned my addr 172.21.15.100:0/1543913933 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07af400640 1 --2- 172.21.15.100:0/1543913933 >> v2:172.21.15.100:3300/0 conn(0x7f07b8070f30 0x7f07b80713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07b7e00640 1 -- 172.21.15.100:0/1543913933 >> v2:172.21.15.100:3300/0 conn(0x7f07b8070f30 msgr2=0x7f07b80713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07b7e00640 1 --2- 172.21.15.100:0/1543913933 >> v2:172.21.15.100:3300/0 conn(0x7f07b8070f30 0x7f07b80713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07b7e00640 1 -- 172.21.15.100:0/1543913933 >> v1:172.21.15.100:6789/0 conn(0x7f07b8188c00 legacy=0x7f07b8189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.174+0000 7f07b7e00640 1 -- 172.21.15.100:0/1543913933 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b80f53b0 con 0x7f07b817c040 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.176+0000 7f07b7e00640 1 --2- 172.21.15.100:0/1543913933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b817c040 0x7f07b80706b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07a800bfa0 tx=0x7f07a802e140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e0de17b8a6664cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.176+0000 7f07b7400640 1 -- 172.21.15.100:0/1543913933 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a802eae0 con 0x7f07b817c040 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.176+0000 7f07b7400640 1 -- 172.21.15.100:0/1543913933 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a802ec40 con 0x7f07b817c040 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.176+0000 7f07b7400640 1 -- 172.21.15.100:0/1543913933 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8009540 con 0x7f07b817c040 2024-02-21T07:46:05.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 -- 172.21.15.100:0/1543913933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b817c040 msgr2=0x7f07b80706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 --2- 172.21.15.100:0/1543913933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b817c040 0x7f07b80706b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07a800bfa0 tx=0x7f07a802e140 comp rx=0 tx=0).stop 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 -- 172.21.15.100:0/1543913933 shutdown_connections 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 --2- 172.21.15.100:0/1543913933 >> v2:172.21.15.100:3300/0 conn(0x7f07b8070f30 0x7f07b80713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 --2- 172.21.15.100:0/1543913933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b817c040 0x7f07b80706b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 -- 172.21.15.100:0/1543913933 >> 172.21.15.100:0/1543913933 conn(0x7f07b80ce160 msgr2=0x7f07b80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 -- 172.21.15.100:0/1543913933 shutdown_connections 2024-02-21T07:46:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.177+0000 7f07bee00640 1 -- 172.21.15.100:0/1543913933 wait complete. 2024-02-21T07:46:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.179+0000 7f07bee00640 1 Processor -- start 2024-02-21T07:46:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.179+0000 7f07bee00640 1 -- start start 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b8070f30 0x7f07b806d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b8188c00 0x7f07b821caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b806e990 con 0x7f07b817c040 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b806e3d0 con 0x7f07b8188c00 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07bee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b806e6b0 con 0x7f07b8070f30 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.180+0000 7f07af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54444/0 (socket says 172.21.15.100:54444) 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 -- 172.21.15.100:0/2499488756 learned_addr learned my addr 172.21.15.100:0/2499488756 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07bce00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b8188c00 0x7f07b821caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07b7e00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b8070f30 0x7f07b806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 -- 172.21.15.100:0/2499488756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b8070f30 msgr2=0x7f07b806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b8070f30 0x7f07b806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 -- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b8188c00 msgr2=0x7f07b821caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b8188c00 0x7f07b821caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 -- 172.21.15.100:0/2499488756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a800bc80 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07af400640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e870 tx=0x7f07a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.181+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00094f0 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.182+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000c940 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.182+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000ccf0 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.182+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b821c010 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.182+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b821c5d0 con 0x7f07b817c040 2024-02-21T07:46:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.183+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b8067c80 con 0x7f07b817c040 2024-02-21T07:46:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.185+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f07a0013470 con 0x7f07b817c040 2024-02-21T07:46:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.186+0000 7f07b4c00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 0x7f07940a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.186+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f07a00c9c80 con 0x7f07b817c040 2024-02-21T07:46:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.186+0000 7f07b7e00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 0x7f07940a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.187+0000 7f07b7e00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 0x7f07940a1620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07a8037000 tx=0x7f07a8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.190+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f07a0093a40 con 0x7f07b817c040 2024-02-21T07:46:05.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.428+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07b80f7e30 con 0x7f07b817c040 2024-02-21T07:46:05.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.430+0000 7f07b4c00640 1 -- 172.21.15.100:0/2499488756 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f07a0095970 con 0x7f07b817c040 2024-02-21T07:46:05.436 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:05.436 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:49.408446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:05.436 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-02-21T07:46:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 msgr2=0x7f07940a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 0x7f07940a1620 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07a8037000 tx=0x7f07a8032000 comp rx=0 tx=0).stop 2024-02-21T07:46:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 msgr2=0x7f07b816d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f07a000e870 tx=0x7f07a000ed30 comp rx=0 tx=0).stop 2024-02-21T07:46:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 shutdown_connections 2024-02-21T07:46:05.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07b8188c00 0x7f07b821caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f079409f160 0x7f07940a1620 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07b817c040 0x7f07b816d430 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 --2- 172.21.15.100:0/2499488756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07b8070f30 0x7f07b806d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.433+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 >> 172.21.15.100:0/2499488756 conn(0x7f07b80ce160 msgr2=0x7f07b81723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.434+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 shutdown_connections 2024-02-21T07:46:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.434+0000 7f07bee00640 1 -- 172.21.15.100:0/2499488756 wait complete. 2024-02-21T07:46:05.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:05.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.653+0000 7f08e7000640 1 Processor -- start 2024-02-21T07:46:05.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.653+0000 7f08e7000640 1 -- start start 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08e7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08e0183f70 0x7f08e01844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08e7000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f08e006e7b0 0x7f08e00f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08e7000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00cb5d0 con 0x7f08e006ec10 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08e7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e006e390 con 0x7f08e0183f70 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08e7000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e0187520 con 0x7f08e006e7b0 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08dfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08e0183f70 0x7f08e01844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08dfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08e0183f70 0x7f08e01844e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54446/0 (socket says 172.21.15.100:54446) 2024-02-21T07:46:05.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08dfe00640 1 -- 172.21.15.100:0/3887854693 learned_addr learned my addr 172.21.15.100:0/3887854693 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.655+0000 7f08d7e00640 1 --2- 172.21.15.100:0/3887854693 >> v2:172.21.15.170:3300/0 conn(0x7f08e006e7b0 0x7f08e00f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.656+0000 7f08dfe00640 1 -- 172.21.15.100:0/3887854693 >> v2:172.21.15.170:3300/0 conn(0x7f08e006e7b0 msgr2=0x7f08e00f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.656+0000 7f08dfe00640 1 --2- 172.21.15.100:0/3887854693 >> v2:172.21.15.170:3300/0 conn(0x7f08e006e7b0 0x7f08e00f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.656+0000 7f08dfe00640 1 -- 172.21.15.100:0/3887854693 >> v1:172.21.15.156:6789/0 conn(0x7f08e006ec10 legacy=0x7f08e0189b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.656+0000 7f08dfe00640 1 -- 172.21.15.100:0/3887854693 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00cbb00 con 0x7f08e0183f70 2024-02-21T07:46:05.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.657+0000 7f08dfe00640 1 --2- 172.21.15.100:0/3887854693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e01844e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08e00f4290 tx=0x7f08d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb94aed32e79252 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.657+0000 7f08df400640 1 -- 172.21.15.100:0/3887854693 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0031870 con 0x7f08e0183f70 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.657+0000 7f08df400640 1 -- 172.21.15.100:0/3887854693 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00319d0 con 0x7f08e0183f70 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.657+0000 7f08df400640 1 -- 172.21.15.100:0/3887854693 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0031d60 con 0x7f08e0183f70 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 -- 172.21.15.100:0/3887854693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 msgr2=0x7f08e01844e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 --2- 172.21.15.100:0/3887854693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e01844e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08e00f4290 tx=0x7f08d002b910 comp rx=0 tx=0).stop 2024-02-21T07:46:05.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 -- 172.21.15.100:0/3887854693 shutdown_connections 2024-02-21T07:46:05.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 --2- 172.21.15.100:0/3887854693 >> v2:172.21.15.170:3300/0 conn(0x7f08e006e7b0 0x7f08e00f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 --2- 172.21.15.100:0/3887854693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e01844e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 -- 172.21.15.100:0/3887854693 >> 172.21.15.100:0/3887854693 conn(0x7f08e00ce160 msgr2=0x7f08e00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:05.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 -- 172.21.15.100:0/3887854693 shutdown_connections 2024-02-21T07:46:05.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.658+0000 7f08e7000640 1 -- 172.21.15.100:0/3887854693 wait complete. 2024-02-21T07:46:05.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.660+0000 7f08e7000640 1 Processor -- start 2024-02-21T07:46:05.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.660+0000 7f08e7000640 1 -- start start 2024-02-21T07:46:05.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08e006e7b0 0x7f08e0070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08e006ec10 0x7f08e0071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00f3910 con 0x7f08e0183f70 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00719b0 con 0x7f08e006e7b0 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.661+0000 7f08e7000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e017b6e0 con 0x7f08e006ec10 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08d7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08e006ec10 0x7f08e0071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54452/0 (socket says 172.21.15.100:54452) 2024-02-21T07:46:05.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 -- 172.21.15.100:0/1374558010 learned_addr learned my addr 172.21.15.100:0/1374558010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08dfe00640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08e006e7b0 0x7f08e0070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 -- 172.21.15.100:0/1374558010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08e006ec10 msgr2=0x7f08e0071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08e006ec10 0x7f08e0071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 -- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08e006e7b0 msgr2=0x7f08e0070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08e006e7b0 0x7f08e0070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 -- 172.21.15.100:0/1374558010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d00094d0 con 0x7f08e0183f70 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.662+0000 7f08e5000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c680 tx=0x7f08d800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.663+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8003b70 con 0x7f08e0183f70 2024-02-21T07:46:05.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.663+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8003cd0 con 0x7f08e0183f70 2024-02-21T07:46:05.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.663+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8005310 con 0x7f08e0183f70 2024-02-21T07:46:05.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.663+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e00f3da0 con 0x7f08e0183f70 2024-02-21T07:46:05.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.663+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e00f2fe0 con 0x7f08e0183f70 2024-02-21T07:46:05.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.664+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e00f3a80 con 0x7f08e0183f70 2024-02-21T07:46:05.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.666+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f08d8005470 con 0x7f08e0183f70 2024-02-21T07:46:05.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.667+0000 7f08dcc00640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 0x7f08bc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:05.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.667+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f08d80c9980 con 0x7f08e0183f70 2024-02-21T07:46:05.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.667+0000 7f08dfe00640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 0x7f08bc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:05.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.668+0000 7f08dfe00640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 0x7f08bc0a15f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08d0036000 tx=0x7f08d003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:05.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.671+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f08d8093690 con 0x7f08e0183f70 2024-02-21T07:46:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.855+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e0067c80 con 0x7f08e0183f70 2024-02-21T07:46:05.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.859+0000 7f08dcc00640 1 -- 172.21.15.100:0/1374558010 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+23582 (secure 0 0 0) 0x7f08d80955c0 con 0x7f08e0183f70 2024-02-21T07:46:05.865 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:05.865 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:45:30.771123+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 msgr2=0x7f08bc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 0x7f08bc0a15f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f08d0036000 tx=0x7f08d003c040 comp rx=0 tx=0).stop 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 msgr2=0x7f08e0170a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08d800c680 tx=0x7f08d800cb40 comp rx=0 tx=0).stop 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 shutdown_connections 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08bc09f130 0x7f08bc0a15f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08e0183f70 0x7f08e0170a10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08e006ec10 0x7f08e0071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 --2- 172.21.15.100:0/1374558010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08e006e7b0 0x7f08e0070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:05.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.861+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 >> 172.21.15.100:0/1374558010 conn(0x7f08e00ce160 msgr2=0x7f08e00cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:05.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.862+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 shutdown_connections 2024-02-21T07:46:05.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:05.862+0000 7f08e7000640 1 -- 172.21.15.100:0/1374558010 wait complete. 2024-02-21T07:46:05.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:06.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.081+0000 7fbcc3c00640 1 Processor -- start 2024-02-21T07:46:06.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.081+0000 7fbcc3c00640 1 -- start start 2024-02-21T07:46:06.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.083+0000 7fbcc3c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbcbc071640 0x7fbcbc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:06.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.083+0000 7fbcc3c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0f50d0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.083+0000 7fbcc3c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0f53b0 con 0x7fbcbc17c040 2024-02-21T07:46:06.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.083+0000 7fbcc3c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc071ad0 con 0x7fbcbc071640 2024-02-21T07:46:06.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcb3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbcbc0706b0 0x7fbcbc185680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38626/0 (socket says 172.21.15.100:38626) 2024-02-21T07:46:06.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcb3e00640 1 -- 172.21.15.100:0/101050887 learned_addr learned my addr 172.21.15.100:0/101050887 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:06.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcc1c00640 1 --2- 172.21.15.100:0/101050887 >> v2:172.21.15.170:3300/0 conn(0x7fbcbc071640 0x7fbcbc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:06.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3463092701 0 0) 0x7fbcbc0f50d0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca0005730 con 0x7fbcbc0706b0 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699846034 0 0) 0x7fbcbc0f53b0 con 0x7fbcbc17c040 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcbc0f50d0 con 0x7fbcbc17c040 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcc1c00640 1 -- 172.21.15.100:0/101050887 >> v1:172.21.15.170:6789/0 conn(0x7fbcbc17c040 legacy=0x7fbcbc070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcc1c00640 1 -- 172.21.15.100:0/101050887 >> v1:172.21.15.100:6789/0 conn(0x7fbcbc0706b0 legacy=0x7fbcbc185680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.084+0000 7fbcc1c00640 1 -- 172.21.15.100:0/101050887 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0f5690 con 0x7fbcbc071640 2024-02-21T07:46:06.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.085+0000 7fbcc1c00640 1 --2- 172.21.15.100:0/101050887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc06e960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009dc0 tx=0x7fbcb402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e87a77b7df24c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb402ccd0 con 0x7fbcbc071640 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb402ce30 con 0x7fbcbc071640 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcbbe00640 1 -- 172.21.15.100:0/101050887 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4034660 con 0x7fbcbc071640 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 -- 172.21.15.100:0/101050887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 msgr2=0x7fbcbc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/101050887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc06e960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009dc0 tx=0x7fbcb402bf20 comp rx=0 tx=0).stop 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 -- 172.21.15.100:0/101050887 shutdown_connections 2024-02-21T07:46:06.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/101050887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc06e960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 -- 172.21.15.100:0/101050887 >> 172.21.15.100:0/101050887 conn(0x7fbcbc0ce160 msgr2=0x7fbcbc0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:06.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 -- 172.21.15.100:0/101050887 shutdown_connections 2024-02-21T07:46:06.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.086+0000 7fbcc3c00640 1 -- 172.21.15.100:0/101050887 wait complete. 2024-02-21T07:46:06.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.088+0000 7fbcc3c00640 1 Processor -- start 2024-02-21T07:46:06.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.088+0000 7fbcc3c00640 1 -- start start 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc17b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 0x7fbcbc167630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc220fb0 con 0x7fbcbc17c040 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc220050 con 0x7fbcbc0706b0 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc3c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc220330 con 0x7fbcbc071640 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 0x7fbcbc167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54358/0 (socket says 172.21.15.100:54358) 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcb3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc17b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 -- 172.21.15.100:0/588675895 learned_addr learned my addr 172.21.15.100:0/588675895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 -- 172.21.15.100:0/588675895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 msgr2=0x7fbcbc17b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc17b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 -- 172.21.15.100:0/588675895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 msgr2=0x7fbcbc167630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 0x7fbcbc167630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.090+0000 7fbcc1200640 1 -- 172.21.15.100:0/588675895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009a70 con 0x7fbcbc0706b0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcc1c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 0x7fbcbc167630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcc1200640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c490 tx=0x7fbcac00c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0052d0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac005430 con 0x7fbcbc0706b0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac012870 con 0x7fbcbc0706b0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc220610 con 0x7fbcbc0706b0 2024-02-21T07:46:06.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.091+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc220bd0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.092+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc2210f0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.094+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fbcac0129d0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.095+0000 7fbcb9600640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 0x7fbc980a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.095+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbcac0ca0f0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.096+0000 7fbcb3e00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 0x7fbc980a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:06.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.096+0000 7fbcb3e00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 0x7fbc980a15f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc189be0 tx=0x7fbca4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.098+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbcac093ef0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.317+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcbc067c80 con 0x7fbcbc0706b0 2024-02-21T07:46:06.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.319+0000 7fbcb9600640 1 -- 172.21.15.100:0/588675895 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11339 (secure 0 0 0) 0x7fbcac0975b0 con 0x7fbcbc0706b0 2024-02-21T07:46:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:06.325 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:45:49.408446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:06.325 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-02-21T07:46:06.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 msgr2=0x7fbc980a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 0x7fbc980a15f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc189be0 tx=0x7fbca4009040 comp rx=0 tx=0).stop 2024-02-21T07:46:06.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 msgr2=0x7fbcbc2213d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:06.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00c490 tx=0x7fbcac00c950 comp rx=0 tx=0).stop 2024-02-21T07:46:06.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 shutdown_connections 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbc9809f130 0x7fbc980a15f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcbc17c040 0x7fbcbc167630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbcbc071640 0x7fbcbc17b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 --2- 172.21.15.100:0/588675895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbcbc0706b0 0x7fbcbc2213d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 >> 172.21.15.100:0/588675895 conn(0x7fbcbc0ce160 msgr2=0x7fbcbc070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 shutdown_connections 2024-02-21T07:46:06.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:06.321+0000 7fbcc3c00640 1 -- 172.21.15.100:0/588675895 wait complete. 2024-02-21T07:46:07.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-02-21T07:45:25.700152+0000', 'modified': '2024-02-21T07:45:49.408446+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4354, 'mds_1': 4352, 'mds_2': 4349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4333': {'gid': 4333, 'name': 'i', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6837/2184142898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6836', 'nonce': 2184142898}, {'type': 'v1', 'addr': '172.21.15.170:6837', 'nonce': 2184142898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4334': {'gid': 4334, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6839/541693286', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 541693286}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 541693286}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4345': {'gid': 4345, 'name': 'g', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6833/2969717403', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 2969717403}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 2969717403}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4349': {'gid': 4349, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.100:6835/224612086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 224612086}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 224612086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4352': {'gid': 4352, 'name': 'j', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.100:6837/1627545450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 1627545450}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 1627545450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4354': {'gid': 4354, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6839/1953723394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1953723394}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1953723394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-21T07:46:07.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-02-21T07:46:07.556 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-21T07:46:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.768+0000 7f7998800640 1 Processor -- start 2024-02-21T07:46:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.769+0000 7f7998800640 1 -- start start 2024-02-21T07:46:07.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.770+0000 7f7998800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7990070a70 0x7f799018a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.770+0000 7f7998800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799018aa20 con 0x7f79901888d0 2024-02-21T07:46:07.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7998800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79900f5580 con 0x7f7990186280 2024-02-21T07:46:07.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7998800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900f5860 con 0x7f7990070a70 2024-02-21T07:46:07.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7996800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f79901888d0 0x7f7990188ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38628/0 (socket says 172.21.15.100:38628) 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7996800640 1 -- 172.21.15.100:0/1803525257 learned_addr learned my addr 172.21.15.100:0/1803525257 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7995400640 1 --2- 172.21.15.100:0/1803525257 >> v2:172.21.15.156:3300/0 conn(0x7f7990070a70 0x7f799018a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880793854 0 0) 0x7f799018aa20 con 0x7f79901888d0 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7978003520 con 0x7f79901888d0 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441612590 0 0) 0x7f79900f5580 con 0x7f7990186280 2024-02-21T07:46:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7995400640 1 -- 172.21.15.100:0/1803525257 >> v1:172.21.15.170:6789/0 conn(0x7f7990186280 legacy=0x7f7990189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7995400640 1 -- 172.21.15.100:0/1803525257 >> v1:172.21.15.100:6789/0 conn(0x7f79901888d0 legacy=0x7f7990188ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.771+0000 7f7995400640 1 -- 172.21.15.100:0/1803525257 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900f5b40 con 0x7f7990070a70 2024-02-21T07:46:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.773+0000 7f7995400640 1 --2- 172.21.15.100:0/1803525257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990070a70 0x7f799018a4e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f797c0097a0 tx=0x7f797c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5976af059817703 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.773+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c031830 con 0x7f7990070a70 2024-02-21T07:46:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.773+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c031990 con 0x7f7990070a70 2024-02-21T07:46:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.773+0000 7f7994a00640 1 -- 172.21.15.100:0/1803525257 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c031d00 con 0x7f7990070a70 2024-02-21T07:46:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.773+0000 7f7998800640 1 -- 172.21.15.100:0/1803525257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990070a70 msgr2=0x7f799018a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 --2- 172.21.15.100:0/1803525257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990070a70 0x7f799018a4e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f797c0097a0 tx=0x7f797c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 -- 172.21.15.100:0/1803525257 shutdown_connections 2024-02-21T07:46:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 --2- 172.21.15.100:0/1803525257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990070a70 0x7f799018a4e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 -- 172.21.15.100:0/1803525257 >> 172.21.15.100:0/1803525257 conn(0x7f79900668b0 msgr2=0x7f7990066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 -- 172.21.15.100:0/1803525257 shutdown_connections 2024-02-21T07:46:07.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.774+0000 7f7998800640 1 -- 172.21.15.100:0/1803525257 wait complete. 2024-02-21T07:46:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.776+0000 7f7998800640 1 Processor -- start 2024-02-21T07:46:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.776+0000 7f7998800640 1 -- start start 2024-02-21T07:46:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 0x7f799018c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79901888d0 0x7f7990187f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799021f7b0 con 0x7f7990070a70 2024-02-21T07:46:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7990189b00 con 0x7f7990186280 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7998800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7990188e80 con 0x7f79901888d0 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7995400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 0x7f799018c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54472/0 (socket says 172.21.15.100:54472) 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7995e00640 1 -- 172.21.15.100:0/1220383339 learned_addr learned my addr 172.21.15.100:0/1220383339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.777+0000 7f7996800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79901888d0 0x7f7990187f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 -- 172.21.15.100:0/1220383339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79901888d0 msgr2=0x7f7990187f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79901888d0 0x7f7990187f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 -- 172.21.15.100:0/1220383339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 msgr2=0x7f7990174530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 -- 172.21.15.100:0/1220383339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c009400 con 0x7f7990186280 2024-02-21T07:46:07.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995e00640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.778+0000 7f7995400640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 0x7f799018c560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f797c033000 tx=0x7f797c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.779+0000 7f798a000640 1 -- 172.21.15.100:0/1220383339 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c03a830 con 0x7f7990186280 2024-02-21T07:46:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.779+0000 7f798a000640 1 -- 172.21.15.100:0/1220383339 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c03a9b0 con 0x7f7990186280 2024-02-21T07:46:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.779+0000 7f798a000640 1 -- 172.21.15.100:0/1220383339 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c03ad60 con 0x7f7990186280 2024-02-21T07:46:07.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.779+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7990189160 con 0x7f7990186280 2024-02-21T07:46:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.779+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990189720 con 0x7f7990186280 2024-02-21T07:46:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.782+0000 7f798a000640 1 -- 172.21.15.100:0/1220383339 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f797c0433a0 con 0x7f7990186280 2024-02-21T07:46:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.783+0000 7f799b5ab740 1 Processor -- start 2024-02-21T07:46:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.783+0000 7f799b5ab740 1 -- start start 2024-02-21T07:46:07.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.783+0000 7f798a000640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 0x7f79700a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.783+0000 7f798a000640 1 -- 172.21.15.100:0/1220383339 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f797c0ebd50 con 0x7f7990186280 2024-02-21T07:46:07.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.783+0000 7f7996800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 0x7f79700a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a7c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a6bfb30 con 0x55e62a78c7e0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a6bd060 con 0x55e62a7c7eb0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f799b5ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a6b8840 con 0x55e62a78d100 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7996800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 0x7f79700a1570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f798c001560 tx=0x7f798c001970 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54480/0 (socket says 172.21.15.100:54480) 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7995e00640 1 -- 172.21.15.100:0/3579200589 learned_addr learned my addr 172.21.15.100:0/3579200589 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7996800640 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.784+0000 7f7995400640 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a7c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 -- 172.21.15.100:0/3579200589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 msgr2=0x55e62a7c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a7c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 -- 172.21.15.100:0/3579200589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 msgr2=0x55e62a7c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 -- 172.21.15.100:0/3579200589 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e62a6804c0 con 0x55e62a78c7e0 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7995e00640 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c70 tx=0x7f798400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63866a970d67c2fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7982600640 1 -- 172.21.15.100:0/3579200589 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840017c0 con 0x55e62a78c7e0 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7982600640 1 -- 172.21.15.100:0/3579200589 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400fec0 con 0x55e62a78c7e0 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.785+0000 7f7982600640 1 -- 172.21.15.100:0/3579200589 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79840052d0 con 0x55e62a78c7e0 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 -- 172.21.15.100:0/3579200589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 msgr2=0x55e62a78cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c70 tx=0x7f798400f5a0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 -- 172.21.15.100:0/3579200589 shutdown_connections 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a7c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3579200589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78c7e0 0x55e62a78cbc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 -- 172.21.15.100:0/3579200589 >> 172.21.15.100:0/3579200589 conn(0x55e62a74edb0 msgr2=0x55e62a74fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 -- 172.21.15.100:0/3579200589 shutdown_connections 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.786+0000 7f799b5ab740 1 -- 172.21.15.100:0/3579200589 wait complete. 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.787+0000 7f799b5ab740 1 -- start start 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.787+0000 7f799b5ab740 1 Processor -- start 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a78a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a783200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a65dea0 con 0x55e62a782640 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a65db40 con 0x55e62a7c7eb0 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a400f20 con 0x55e62a78d100 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f799b5ab740 10 client.0 _ll_register_callbacks cb 0x55e62a671950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f7996800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f7996800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54488/0 (socket says 172.21.15.100:54488) 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.788+0000 7f7996800640 1 -- 172.21.15.100:0/2640495242 learned_addr learned my addr 172.21.15.100:0/2640495242 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:07.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7995e00640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a78a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7995400640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a783200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 -- 172.21.15.100:0/2640495242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 msgr2=0x55e62a78a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a78a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 -- 172.21.15.100:0/2640495242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 msgr2=0x55e62a783200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a783200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 -- 172.21.15.100:0/2640495242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7984001920 con 0x55e62a782640 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7995400640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a783200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7996800640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f798c014eb0 tx=0x7f798c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3d484e0fbae817 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7976a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.789+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c013e80 con 0x55e62a782640 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e62a3b86c0 con 0x55e62a782640 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f798c01c040 con 0x55e62a782640 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f798c007ae0 con 0x55e62a782640 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 10 client.4761 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:07.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55e62a6b6ec0 con 0x55e62a782640 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e62a3b86c0 con 0x55e62a782640 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f798c012070 con 0x55e62a782640 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 10 client.4761 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 10 client.4761 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 20 client.4761 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a782aa0 0x55e62a78aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 4 client.4761 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.790+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e62a409270 con 0x55e62a782aa0 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.791+0000 7f7995e00640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a782aa0 0x55e62a78aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.791+0000 7f7976a00640 10 client.4761 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:07.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.791+0000 7f7995e00640 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a782aa0 0x55e62a78aa20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=172dbaa699bb810e server_cookie=7c5a79213e24effc in_seq=0 out_seq=0 2024-02-21T07:46:07.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f7976a00640 1 -- 172.21.15.100:0/2640495242 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e62a409270 con 0x55e62a782aa0 2024-02-21T07:46:07.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f7976a00640 10 client.4761 handle_command_reply: tid=0 2024-02-21T07:46:07.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 client.4761 shutdown 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 msgr2=0x55e62a74ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f798c014eb0 tx=0x7f798c0014d0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 shutdown_connections 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a782aa0 0x55e62a78aa20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74ba70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a783200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2640495242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a78d100 0x55e62a78a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f7976a00640 0 client.4761 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 >> 172.21.15.100:0/2640495242 conn(0x55e62a78c7e0 msgr2=0x55e62a788fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 shutdown_connections 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.792+0000 7f799b5ab740 1 -- 172.21.15.100:0/2640495242 wait complete. 2024-02-21T07:46:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.793+0000 7f799b5ab740 20 client.4761 trim_cache size 0 max 16384 2024-02-21T07:46:07.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.813+0000 7f799b5ab740 1 Processor -- start 2024-02-21T07:46:07.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.813+0000 7f799b5ab740 1 -- start start 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 0x55e62a78a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a74a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a7c64c0 con 0x55e62a78d100 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a7c6220 con 0x55e62a7c7eb0 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.814+0000 7f799b5ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a7c6ff0 con 0x55e62a782640 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54496/0 (socket says 172.21.15.100:54496) 2024-02-21T07:46:07.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 -- 172.21.15.100:0/3858222770 learned_addr learned my addr 172.21.15.100:0/3858222770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7996800640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a74a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995e00640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 0x55e62a78a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 -- 172.21.15.100:0/3858222770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 msgr2=0x55e62a78a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 0x55e62a78a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 -- 172.21.15.100:0/3858222770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 msgr2=0x55e62a74a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a74a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 -- 172.21.15.100:0/3858222770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990222c70 con 0x55e62a78d100 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7996800640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a74a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995e00640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 0x55e62a78a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7995400640 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f797c0b5d50 tx=0x7f797c04f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ae4238f043adf6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.815+0000 7f7981c00640 1 -- 172.21.15.100:0/3858222770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c0bda40 con 0x55e62a78d100 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f7981c00640 1 -- 172.21.15.100:0/3858222770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0c2000 con 0x55e62a78d100 2024-02-21T07:46:07.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f7981c00640 1 -- 172.21.15.100:0/3858222770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c0b5f60 con 0x55e62a78d100 2024-02-21T07:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 -- 172.21.15.100:0/3858222770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 msgr2=0x55e62a770620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f797c0b5d50 tx=0x7f797c04f040 comp rx=0 tx=0).stop 2024-02-21T07:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 -- 172.21.15.100:0/3858222770 shutdown_connections 2024-02-21T07:46:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a7c7eb0 0x55e62a74a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a78d100 0x55e62a770620 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 --2- 172.21.15.100:0/3858222770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a782640 0x55e62a78a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 -- 172.21.15.100:0/3858222770 >> 172.21.15.100:0/3858222770 conn(0x55e62a78c7e0 msgr2=0x55e62a784f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 -- 172.21.15.100:0/3858222770 shutdown_connections 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.816+0000 7f799b5ab740 1 -- 172.21.15.100:0/3858222770 wait complete. 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.817+0000 7f799b5ab740 1 -- start start 2024-02-21T07:46:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.817+0000 7f799b5ab740 1 Processor -- start 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.818+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.818+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 0x55e62a74c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f799b5ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f799b5ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a777230 con 0x55e62a782640 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f799b5ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a78a430 con 0x55e62a78d100 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f799b5ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62a7c42a0 con 0x55e62a7c7eb0 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f799b5ab740 10 client.0 _ll_register_callbacks cb 0x55e62a750ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54510/0 (socket says 172.21.15.100:54510) 2024-02-21T07:46:07.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 -- 172.21.15.100:0/2363134637 learned_addr learned my addr 172.21.15.100:0/2363134637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995400640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 0x55e62a74c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7996800640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 -- 172.21.15.100:0/2363134637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 msgr2=0x55e62a7c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 -- 172.21.15.100:0/2363134637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 msgr2=0x55e62a74c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 0x55e62a74c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995e00640 1 -- 172.21.15.100:0/2363134637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990189720 con 0x55e62a782640 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7995400640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 0x55e62a74c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.819+0000 7f7996800640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f7995e00640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c10 tx=0x7f7984012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a9470c224b6e67 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f7976a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984024040 con 0x55e62a782640 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7984005440 con 0x55e62a782640 2024-02-21T07:46:07.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e62a7c56a0 con 0x55e62a782640 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79840017c0 con 0x55e62a782640 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f799b5ab740 10 client.4767 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.820+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55e62a6538b0 con 0x55e62a782640 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7984034020 con 0x55e62a782640 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7984012070 con 0x55e62a782640 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 10 client.4767 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 10 client.4767 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 20 client.4767 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a7d15b0 0x55e62a836ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 4 client.4767 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e62a7d43d0 con 0x55e62a7d15b0 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.821+0000 7f7995400640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a7d15b0 0x55e62a836ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f7995400640 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a7d15b0 0x55e62a836ba0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ac6a9ae6642bba7 server_cookie=a8c72ba034e83690 in_seq=0 out_seq=0 2024-02-21T07:46:07.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f7976a00640 10 client.4767 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:07.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f7976a00640 1 -- 172.21.15.100:0/2363134637 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e62a7d43d0 con 0x55e62a7d15b0 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f7976a00640 10 client.4767 handle_command_reply: tid=0 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 client.4767 shutdown 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 msgr2=0x55e62a74cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7984001c10 tx=0x7f7984012000 comp rx=0 tx=0).stop 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 shutdown_connections 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e62a7d15b0 0x55e62a836ba0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e62a7c7eb0 0x55e62a7c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e62a78d100 0x55e62a74c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 --2- 172.21.15.100:0/2363134637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e62a782640 0x55e62a74cfb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f7976a00640 0 client.4767 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 >> 172.21.15.100:0/2363134637 conn(0x55e62a78c7e0 msgr2=0x55e62a781820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 shutdown_connections 2024-02-21T07:46:07.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.822+0000 7f799b5ab740 1 -- 172.21.15.100:0/2363134637 wait complete. 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f799b5ab740 20 client.4767 trim_cache size 0 max 16384 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "b9cc1397-a437-4ace-98ff-c29f55191169", 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4349, 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-02-21T07:46:07.832 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 19.422655654, 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 28, 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 28, 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 46.566196421999997 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 msgr2=0x7f79700a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 0x7f79700a1570 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f798c001560 tx=0x7f798c001970 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 msgr2=0x7f799018c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 0x7f799018c560 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f797c033000 tx=0x7f797c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 shutdown_connections 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79901888d0 0x7f7990187f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7990186280 0x7f799018c560 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f797009f0b0 0x7f79700a1570 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 --2- 172.21.15.100:0/1220383339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7990070a70 0x7f7990174530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 >> 172.21.15.100:0/1220383339 conn(0x7f79900668b0 msgr2=0x7f7990066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 shutdown_connections 2024-02-21T07:46:07.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:07.823+0000 7f7998800640 1 -- 172.21.15.100:0/1220383339 wait complete. 2024-02-21T07:46:07.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-02-21T07:46:08.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.030+0000 7fe569200640 1 Processor -- start 2024-02-21T07:46:08.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.030+0000 7fe569200640 1 -- start start 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe569200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe56406ab60 0x7fe5641871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe569200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640ca6a0 con 0x7fe564189ca0 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe569200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640f6200 con 0x7fe56418a080 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe569200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56418abe0 con 0x7fe56406ab60 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe561400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe56406ab60 0x7fe5641871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe562800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe56418a080 0x7fe56418a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32818/0 (socket says 172.21.15.100:32818) 2024-02-21T07:46:08.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.032+0000 7fe562800640 1 -- 172.21.15.100:0/3152154115 learned_addr learned my addr 172.21.15.100:0/3152154115 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:08.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.033+0000 7fe561400640 1 -- 172.21.15.100:0/3152154115 >> v1:172.21.15.170:6789/0 conn(0x7fe56418a080 legacy=0x7fe56418a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.033+0000 7fe561400640 1 -- 172.21.15.100:0/3152154115 >> v1:172.21.15.156:6789/0 conn(0x7fe564189ca0 legacy=0x7fe5640cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.033+0000 7fe561400640 1 -- 172.21.15.100:0/3152154115 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56406afc0 con 0x7fe56406ab60 2024-02-21T07:46:08.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.033+0000 7fe560a00640 1 -- 172.21.15.100:0/3152154115 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405568085 0 0) 0x7fe5640ca6a0 con 0x7fe564189ca0 2024-02-21T07:46:08.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.034+0000 7fe561400640 1 --2- 172.21.15.100:0/3152154115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56406ab60 0x7fe5641871c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe550009720 tx=0x7fe55002b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf7fbf9fba33663 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.034+0000 7fe560a00640 1 -- 172.21.15.100:0/3152154115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550030710 con 0x7fe56406ab60 2024-02-21T07:46:08.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.034+0000 7fe560a00640 1 -- 172.21.15.100:0/3152154115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55002e050 con 0x7fe56406ab60 2024-02-21T07:46:08.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.034+0000 7fe560a00640 1 -- 172.21.15.100:0/3152154115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550030a90 con 0x7fe56406ab60 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 -- 172.21.15.100:0/3152154115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56406ab60 msgr2=0x7fe5641871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 --2- 172.21.15.100:0/3152154115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56406ab60 0x7fe5641871c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe550009720 tx=0x7fe55002b730 comp rx=0 tx=0).stop 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 -- 172.21.15.100:0/3152154115 shutdown_connections 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 --2- 172.21.15.100:0/3152154115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56406ab60 0x7fe5641871c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 -- 172.21.15.100:0/3152154115 >> 172.21.15.100:0/3152154115 conn(0x7fe5640668b0 msgr2=0x7fe564066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 -- 172.21.15.100:0/3152154115 shutdown_connections 2024-02-21T07:46:08.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.035+0000 7fe569200640 1 -- 172.21.15.100:0/3152154115 wait complete. 2024-02-21T07:46:08.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.037+0000 7fe569200640 1 Processor -- start 2024-02-21T07:46:08.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.037+0000 7fe569200640 1 -- start start 2024-02-21T07:46:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 0x7fe56421fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe56418a080 0x7fe564183130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564180ff0 con 0x7fe564189ca0 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5641812d0 con 0x7fe56406ab60 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.038+0000 7fe569200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564213580 con 0x7fe56418a080 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe562800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe56418a080 0x7fe564183130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 0x7fe56421fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54520/0 (socket says 172.21.15.100:54520) 2024-02-21T07:46:08.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 -- 172.21.15.100:0/961974578 learned_addr learned my addr 172.21.15.100:0/961974578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 -- 172.21.15.100:0/961974578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe56418a080 msgr2=0x7fe564183130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe56418a080 0x7fe564183130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 -- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 msgr2=0x7fe56421fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 0x7fe56421fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561400640 1 -- 172.21.15.100:0/961974578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550009400 con 0x7fe564189ca0 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.039+0000 7fe561e00640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 0x7fe56421fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe561400640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe550000c00 tx=0x7fe5500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe55a000640 1 -- 172.21.15.100:0/961974578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550032950 con 0x7fe564189ca0 2024-02-21T07:46:08.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe55a000640 1 -- 172.21.15.100:0/961974578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550032ad0 con 0x7fe564189ca0 2024-02-21T07:46:08.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe55a000640 1 -- 172.21.15.100:0/961974578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550032e80 con 0x7fe564189ca0 2024-02-21T07:46:08.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe564213860 con 0x7fe564189ca0 2024-02-21T07:46:08.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.040+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe564213e20 con 0x7fe564189ca0 2024-02-21T07:46:08.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.043+0000 7fe55a000640 1 -- 172.21.15.100:0/961974578 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe550039040 con 0x7fe564189ca0 2024-02-21T07:46:08.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.044+0000 7fe56c01c740 1 Processor -- start 2024-02-21T07:46:08.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.044+0000 7fe56c01c740 1 -- start start 2024-02-21T07:46:08.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.044+0000 7fe55a000640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 0x7fe5440a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.045+0000 7fe55a000640 1 -- 172.21.15.100:0/961974578 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe5500eb920 con 0x7fe564189ca0 2024-02-21T07:46:08.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.045+0000 7fe562800640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 0x7fe5440a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.045+0000 7fe562800640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 0x7fe5440a15f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0012e0 tx=0x7fe55c001710 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 0x56134d973970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d974c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d86bb30 con 0x56134d9387e0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d869060 con 0x56134d973eb0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe56c01c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d864840 con 0x56134d939100 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe562800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d974c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54534/0 (socket says 172.21.15.100:54534) 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 -- 172.21.15.100:0/2759193266 learned_addr learned my addr 172.21.15.100:0/2759193266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561400640 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 0x56134d973970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 -- 172.21.15.100:0/2759193266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 msgr2=0x56134d973970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 0x56134d973970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 -- 172.21.15.100:0/2759193266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 msgr2=0x56134d974c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d974c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561e00640 1 -- 172.21.15.100:0/2759193266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134d82c4c0 con 0x56134d9387e0 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.046+0000 7fe561400640 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 0x56134d973970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe561e00640 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe554001d40 tx=0x7fe554007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db32456896103caf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe54ea00640 1 -- 172.21.15.100:0/2759193266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540050d0 con 0x56134d9387e0 2024-02-21T07:46:08.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe54ea00640 1 -- 172.21.15.100:0/2759193266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe554005230 con 0x56134d9387e0 2024-02-21T07:46:08.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe54ea00640 1 -- 172.21.15.100:0/2759193266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540035f0 con 0x56134d9387e0 2024-02-21T07:46:08.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 -- 172.21.15.100:0/2759193266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 msgr2=0x56134d938bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe554001d40 tx=0x7fe554007d70 comp rx=0 tx=0).stop 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 -- 172.21.15.100:0/2759193266 shutdown_connections 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d974c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d939100 0x56134d973970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2759193266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d9387e0 0x56134d938bc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.047+0000 7fe56c01c740 1 -- 172.21.15.100:0/2759193266 >> 172.21.15.100:0/2759193266 conn(0x56134d8fadb0 msgr2=0x56134d8fbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.048+0000 7fe56c01c740 1 -- 172.21.15.100:0/2759193266 shutdown_connections 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.048+0000 7fe56c01c740 1 -- 172.21.15.100:0/2759193266 wait complete. 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.048+0000 7fe56c01c740 1 -- start start 2024-02-21T07:46:08.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.049+0000 7fe56c01c740 1 Processor -- start 2024-02-21T07:46:08.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 0x56134d8f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 0x56134d926050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d809ea0 con 0x56134d939100 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d809b40 con 0x56134d925bd0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d5acf20 con 0x56134d973eb0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe56c01c740 10 client.0 _ll_register_callbacks cb 0x56134d81d950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe561e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe562800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 0x56134d926050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe561e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54544/0 (socket says 172.21.15.100:54544) 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe561e00640 1 -- 172.21.15.100:0/3049891043 learned_addr learned my addr 172.21.15.100:0/3049891043 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe561400640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 0x56134d8f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe562800640 1 -- 172.21.15.100:0/3049891043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 msgr2=0x56134d8f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.050+0000 7fe562800640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 0x56134d8f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe562800640 1 -- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 msgr2=0x56134d93d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe562800640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe562800640 1 -- 172.21.15.100:0/3049891043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5540019f0 con 0x56134d925bd0 2024-02-21T07:46:08.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe561e00640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe561400640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 0x56134d8f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe562800640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 0x56134d926050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe55c013920 tx=0x7fe55c001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9404010855b20954 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe543400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0128d0 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe55c01b070 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.051+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56134d888c40 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe55c012a30 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 10 client.4918 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56134d862ec0 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56134d888c40 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe55c012070 con 0x56134d925bd0 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 10 client.4918 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 10 client.4918 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 20 client.4918 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:08.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d980a80 0x56134d980330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 4 client.4918 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56134d5646c0 con 0x56134d980a80 2024-02-21T07:46:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.052+0000 7fe561e00640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d980a80 0x56134d980330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.053+0000 7fe561e00640 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d980a80 0x56134d980330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6485c0d480582a48 server_cookie=370c30d4a683d856 in_seq=0 out_seq=0 2024-02-21T07:46:08.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.053+0000 7fe543400640 10 client.4918 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe543400640 1 -- 172.21.15.100:0/3049891043 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56134d5646c0 con 0x56134d980a80 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe543400640 10 client.4918 handle_command_reply: tid=0 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 client.4918 shutdown 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 msgr2=0x56134d926050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 0x56134d926050 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe55c013920 tx=0x7fe55c001250 comp rx=0 tx=0).stop 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 shutdown_connections 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d980a80 0x56134d980330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d925bd0 0x56134d926050 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d973eb0 0x56134d8f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe543400640 0 client.4918 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3049891043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d93d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 >> 172.21.15.100:0/3049891043 conn(0x56134d9387e0 msgr2=0x56134d934fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 shutdown_connections 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 1 -- 172.21.15.100:0/3049891043 wait complete. 2024-02-21T07:46:08.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.054+0000 7fe56c01c740 20 client.4918 trim_cache size 0 max 16384 2024-02-21T07:46:08.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.071+0000 7fe56c01c740 1 Processor -- start 2024-02-21T07:46:08.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.071+0000 7fe56c01c740 1 -- start start 2024-02-21T07:46:08.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d8f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d96be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d938d60 con 0x56134d939100 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d98dea0 con 0x56134d973eb0 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe56c01c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d92b440 con 0x56134d925bd0 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54552/0 (socket says 172.21.15.100:54552) 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 -- 172.21.15.100:0/2493053198 learned_addr learned my addr 172.21.15.100:0/2493053198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe562800640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d96be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561e00640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d8f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 -- 172.21.15.100:0/2493053198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 msgr2=0x56134d8f9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d8f9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 -- 172.21.15.100:0/2493053198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 msgr2=0x56134d96be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d96be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561400640 1 -- 172.21.15.100:0/2493053198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56134d7ff8b0 con 0x56134d939100 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.072+0000 7fe561e00640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d8f9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:08.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe561400640 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5500b7390 tx=0x7fe5500b8d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181d2bd565dd469a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe54e000640 1 -- 172.21.15.100:0/2493053198 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500d2070 con 0x56134d939100 2024-02-21T07:46:08.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe54e000640 1 -- 172.21.15.100:0/2493053198 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5500bd460 con 0x56134d939100 2024-02-21T07:46:08.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe54e000640 1 -- 172.21.15.100:0/2493053198 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500c1ab0 con 0x56134d939100 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe56c01c740 1 -- 172.21.15.100:0/2493053198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 msgr2=0x56134d9738f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.073+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5500b7390 tx=0x7fe5500b8d30 comp rx=0 tx=0).stop 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 -- 172.21.15.100:0/2493053198 shutdown_connections 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d973eb0 0x56134d96be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d939100 0x56134d9738f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 --2- 172.21.15.100:0/2493053198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d8f9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 -- 172.21.15.100:0/2493053198 >> 172.21.15.100:0/2493053198 conn(0x56134d9387e0 msgr2=0x56134d93d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 -- 172.21.15.100:0/2493053198 shutdown_connections 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 -- 172.21.15.100:0/2493053198 wait complete. 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.074+0000 7fe56c01c740 1 -- start start 2024-02-21T07:46:08.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.075+0000 7fe56c01c740 1 Processor -- start 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d92dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 0x56134d9d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d96fd50 con 0x56134d973eb0 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d8f9090 con 0x56134d939100 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56134d9441d0 con 0x56134d925bd0 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe56c01c740 10 client.0 _ll_register_callbacks cb 0x56134d8fcee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:08.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe561400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 0x56134d9d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54554/0 (socket says 172.21.15.100:54554) 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 -- 172.21.15.100:0/3034259797 learned_addr learned my addr 172.21.15.100:0/3034259797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe561e00640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d92dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 -- 172.21.15.100:0/3034259797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 msgr2=0x56134d92dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d92dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 -- 172.21.15.100:0/3034259797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 msgr2=0x56134d9d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 0x56134d9d4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.076+0000 7fe562800640 1 -- 172.21.15.100:0/3034259797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe564213860 con 0x56134d973eb0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe561400640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 0x56134d9d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe562800640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe55c012320 tx=0x7fe55c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecb68a6fd5c23b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe543400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c02b610 con 0x56134d973eb0 2024-02-21T07:46:08.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe55c02b770 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56134d92e8d0 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe55c02b930 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe56c01c740 10 client.4785 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x56134d825510 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.077+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56134d92e8d0 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe55c012040 con 0x56134d973eb0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 10 client.4785 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 10 client.4785 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 20 client.4785 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d9dffe0 0x56134d9e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 4 client.4785 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56134d92ef30 con 0x56134d9dffe0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe561e00640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d9dffe0 0x56134d9e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe561e00640 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d9dffe0 0x56134d9e23d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8dc262387275aac9 server_cookie=6cb74fc73ad19c48 in_seq=0 out_seq=0 2024-02-21T07:46:08.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.078+0000 7fe543400640 10 client.4785 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe543400640 1 -- 172.21.15.100:0/3034259797 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x56134d92ef30 con 0x56134d9dffe0 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe543400640 10 client.4785 handle_command_reply: tid=0 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 client.4785 shutdown 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 msgr2=0x56134d97cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe55c012320 tx=0x7fe55c00a000 comp rx=0 tx=0).stop 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 shutdown_connections 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56134d973eb0 0x56134d97cc10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56134d9dffe0 0x56134d9e23d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56134d939100 0x56134d9d4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 --2- 172.21.15.100:0/3034259797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56134d925bd0 0x56134d92dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe543400640 0 client.4785 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 >> 172.21.15.100:0/3034259797 conn(0x56134d9387e0 msgr2=0x56134d93d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 shutdown_connections 2024-02-21T07:46:08.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 1 -- 172.21.15.100:0/3034259797 wait complete. 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.079+0000 7fe56c01c740 20 client.4785 trim_cache size 0 max 16384 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "b9cc1397-a437-4ace-98ff-c29f55191169", 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4352, 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 20.691603561000001, 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-02-21T07:46:08.089 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 28, 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 28, 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 46.819289097000002 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 msgr2=0x7fe5440a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 0x7fe5440a15f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0012e0 tx=0x7fe55c001710 comp rx=0 tx=0).stop 2024-02-21T07:46:08.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 msgr2=0x7fe564214340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe550000c00 tx=0x7fe5500046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 shutdown_connections 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe56418a080 0x7fe564183130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe54409f130 0x7fe5440a15f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe564189ca0 0x7fe564214340 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 --2- 172.21.15.100:0/961974578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe56406ab60 0x7fe56421fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 >> 172.21.15.100:0/961974578 conn(0x7fe5640668b0 msgr2=0x7fe564066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 shutdown_connections 2024-02-21T07:46:08.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.080+0000 7fe569200640 1 -- 172.21.15.100:0/961974578 wait complete. 2024-02-21T07:46:08.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-21T07:46:08.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.295+0000 7f3395600640 1 Processor -- start 2024-02-21T07:46:08.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.295+0000 7f3395600640 1 -- start start 2024-02-21T07:46:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.296+0000 7f3395600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f339015cd30 0x7f339015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.296+0000 7f3395600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900f5230 con 0x7f33900f56c0 2024-02-21T07:46:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.296+0000 7f3395600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900706e0 con 0x7f339015c950 2024-02-21T07:46:08.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.296+0000 7f3395600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900709c0 con 0x7f339015cd30 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338ea00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f339015c950 0x7f3390188a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55974/0 (socket says 172.21.15.100:55974) 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338ea00640 1 -- 172.21.15.100:0/1691395284 learned_addr learned my addr 172.21.15.100:0/1691395284 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338e000640 1 --2- 172.21.15.100:0/1691395284 >> v2:172.21.15.170:3300/0 conn(0x7f339015cd30 0x7f339015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925485024 0 0) 0x7f33900706e0 con 0x7f339015c950 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003520 con 0x7f339015c950 2024-02-21T07:46:08.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485683077 0 0) 0x7f33900f5230 con 0x7f33900f56c0 2024-02-21T07:46:08.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33900706e0 con 0x7f33900f56c0 2024-02-21T07:46:08.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338e000640 1 -- 172.21.15.100:0/1691395284 >> v1:172.21.15.156:6789/0 conn(0x7f339015c950 legacy=0x7f3390188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338e000640 1 -- 172.21.15.100:0/1691395284 >> v1:172.21.15.100:6789/0 conn(0x7f33900f56c0 legacy=0x7f33900f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.297+0000 7f338e000640 1 -- 172.21.15.100:0/1691395284 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900f4900 con 0x7f339015cd30 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.298+0000 7f338e000640 1 --2- 172.21.15.100:0/1691395284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f339015d1b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33780097a0 tx=0x7f337802c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3784db6488ac94cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378030800 con 0x7f339015cd30 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378030960 con 0x7f339015cd30 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f338d600640 1 -- 172.21.15.100:0/1691395284 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378030cf0 con 0x7f339015cd30 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 -- 172.21.15.100:0/1691395284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 msgr2=0x7f339015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 --2- 172.21.15.100:0/1691395284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f339015d1b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f33780097a0 tx=0x7f337802c9e0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 -- 172.21.15.100:0/1691395284 shutdown_connections 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 --2- 172.21.15.100:0/1691395284 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f339015d1b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 -- 172.21.15.100:0/1691395284 >> 172.21.15.100:0/1691395284 conn(0x7f33900668b0 msgr2=0x7f3390066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 -- 172.21.15.100:0/1691395284 shutdown_connections 2024-02-21T07:46:08.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.299+0000 7f3395600640 1 -- 172.21.15.100:0/1691395284 wait complete. 2024-02-21T07:46:08.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.301+0000 7f3395600640 1 Processor -- start 2024-02-21T07:46:08.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.302+0000 7f3395600640 1 -- start start 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 0x7f3390153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f3390220250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390185d60 con 0x7f339015c950 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3390155450 con 0x7f33900f56c0 2024-02-21T07:46:08.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f3395600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901545f0 con 0x7f339015cd30 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f338ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f338ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54464/0 (socket says 172.21.15.100:54464) 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f338ea00640 1 -- 172.21.15.100:0/2941859458 learned_addr learned my addr 172.21.15.100:0/2941859458 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f338e000640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 0x7f3390153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.303+0000 7f338f400640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f3390220250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 -- 172.21.15.100:0/2941859458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 msgr2=0x7f3390220250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f3390220250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 -- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 msgr2=0x7f33901749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 -- 172.21.15.100:0/2941859458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009400 con 0x7f339015c950 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338ea00640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f338e000640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 0x7f3390153c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3378034000 tx=0x7f33780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f3386a00640 1 -- 172.21.15.100:0/2941859458 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337803d070 con 0x7f339015c950 2024-02-21T07:46:08.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f3386a00640 1 -- 172.21.15.100:0/2941859458 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378006e10 con 0x7f339015c950 2024-02-21T07:46:08.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33901548d0 con 0x7f339015c950 2024-02-21T07:46:08.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f3386a00640 1 -- 172.21.15.100:0/2941859458 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378038be0 con 0x7f339015c950 2024-02-21T07:46:08.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.304+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3390154e90 con 0x7f339015c950 2024-02-21T07:46:08.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.307+0000 7f3386a00640 1 -- 172.21.15.100:0/2941859458 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f33780493f0 con 0x7f339015c950 2024-02-21T07:46:08.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.308+0000 7f33981f9740 1 Processor -- start 2024-02-21T07:46:08.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.308+0000 7f33981f9740 1 -- start start 2024-02-21T07:46:08.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.309+0000 7f3386a00640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 0x7f336c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.309+0000 7f3386a00640 1 -- 172.21.15.100:0/2941859458 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f33780eb380 con 0x7f339015c950 2024-02-21T07:46:08.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.309+0000 7f338f400640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 0x7f336c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de167e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de167fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1576b30 con 0x562de16437e0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1574060 con 0x562de1644100 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f33981f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de156f840 con 0x562de167eeb0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338f400640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 0x7f336c0a15f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3388001e20 tx=0x7f3388009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338e000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de167e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54562/0 (socket says 172.21.15.100:54562) 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 -- 172.21.15.100:0/2342785648 learned_addr learned my addr 172.21.15.100:0/2342785648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de167fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 -- 172.21.15.100:0/2342785648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 msgr2=0x562de167fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de167fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 -- 172.21.15.100:0/2342785648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 msgr2=0x562de167e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.310+0000 7f338ea00640 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de167e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.311+0000 7f338ea00640 1 -- 172.21.15.100:0/2342785648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de15374c0 con 0x562de16437e0 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.311+0000 7f338ea00640 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3380001bc0 tx=0x7f3380007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b90d48b14c4110 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.311+0000 7f337f000640 1 -- 172.21.15.100:0/2342785648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380001870 con 0x562de16437e0 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.311+0000 7f337f000640 1 -- 172.21.15.100:0/2342785648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000fe50 con 0x562de16437e0 2024-02-21T07:46:08.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.311+0000 7f337f000640 1 -- 172.21.15.100:0/2342785648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380005ad0 con 0x562de16437e0 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 -- 172.21.15.100:0/2342785648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 msgr2=0x562de1643bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3380001bc0 tx=0x7f3380007db0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 -- 172.21.15.100:0/2342785648 shutdown_connections 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de167fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de167e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 --2- 172.21.15.100:0/2342785648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de16437e0 0x562de1643bc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 -- 172.21.15.100:0/2342785648 >> 172.21.15.100:0/2342785648 conn(0x562de1605db0 msgr2=0x562de1606e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 -- 172.21.15.100:0/2342785648 shutdown_connections 2024-02-21T07:46:08.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.312+0000 7f33981f9740 1 -- 172.21.15.100:0/2342785648 wait complete. 2024-02-21T07:46:08.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.313+0000 7f33981f9740 1 -- start start 2024-02-21T07:46:08.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.313+0000 7f33981f9740 1 Processor -- start 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de1647ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1514ea0 con 0x562de1604970 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1514b40 con 0x562de1644100 2024-02-21T07:46:08.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de12b7f20 con 0x562de167eeb0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.314+0000 7f33981f9740 10 client.0 _ll_register_callbacks cb 0x562de1528950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54578/0 (socket says 172.21.15.100:54578) 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 -- 172.21.15.100:0/3988538063 learned_addr learned my addr 172.21.15.100:0/3988538063 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338ea00640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338e000640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de1647ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 -- 172.21.15.100:0/3988538063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 msgr2=0x562de1647ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de1647ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 -- 172.21.15.100:0/3988538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 msgr2=0x562de16863d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16863d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 -- 172.21.15.100:0/3988538063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374003520 con 0x562de1604970 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f338f400640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3388014a30 tx=0x7f3388001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43a2171b7ee7b8c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.315+0000 7f3373400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388013b40 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562de1593c40 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f338801c040 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3388013ca0 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f33981f9740 10 client.4797 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x562de156dec0 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562de1593c40 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.316+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3388012070 con 0x562de1604970 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 10 client.4797 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 10 client.4797 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 20 client.4797 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de16907d0 0x562de168be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 4 client.4797 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:08.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562de126f6c0 con 0x562de16907d0 2024-02-21T07:46:08.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f338ea00640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de16907d0 0x562de168be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f338ea00640 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de16907d0 0x562de168be80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1f518267c72bf9 server_cookie=c912fe3e579a96a9 in_seq=0 out_seq=0 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.317+0000 7f3373400640 10 client.4797 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f3373400640 1 -- 172.21.15.100:0/3988538063 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562de126f6c0 con 0x562de16907d0 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f3373400640 10 client.4797 handle_command_reply: tid=0 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 client.4797 shutdown 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 msgr2=0x562de1630f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3388014a30 tx=0x7f3388001250 comp rx=0 tx=0).stop 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 shutdown_connections 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de16907d0 0x562de168be80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de1604970 0x562de1630f90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de167eeb0 0x562de1647ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 --2- 172.21.15.100:0/3988538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f3373400640 0 client.4797 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.318+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 >> 172.21.15.100:0/3988538063 conn(0x562de16437e0 msgr2=0x562de1607820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.319+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 shutdown_connections 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.319+0000 7f33981f9740 1 -- 172.21.15.100:0/3988538063 wait complete. 2024-02-21T07:46:08.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.319+0000 7f33981f9740 20 client.4797 trim_cache size 0 max 16384 2024-02-21T07:46:08.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.336+0000 7f33981f9740 1 Processor -- start 2024-02-21T07:46:08.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.336+0000 7f33981f9740 1 -- start start 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 0x562de16876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1687c00 con 0x562de167eeb0 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de16078b0 con 0x562de1644100 2024-02-21T07:46:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f33981f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1686f40 con 0x562de1604970 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54590/0 (socket says 172.21.15.100:54590) 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f338f400640 1 -- 172.21.15.100:0/1961624900 learned_addr learned my addr 172.21.15.100:0/1961624900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f338ea00640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 0x562de16876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.337+0000 7f338e000640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 -- 172.21.15.100:0/1961624900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 msgr2=0x562de16876c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 0x562de16876c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 -- 172.21.15.100:0/1961624900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 msgr2=0x562de16709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 -- 172.21.15.100:0/1961624900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562de150a8b0 con 0x562de167eeb0 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338ea00640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 0x562de16876c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f338f400640 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3388014f40 tx=0x7f3388021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccac6b14e4a61581 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f337e600640 1 -- 172.21.15.100:0/1961624900 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388013e50 con 0x562de167eeb0 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f337e600640 1 -- 172.21.15.100:0/1961624900 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388013780 con 0x562de167eeb0 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.338+0000 7f337e600640 1 -- 172.21.15.100:0/1961624900 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388021520 con 0x562de167eeb0 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 -- 172.21.15.100:0/1961624900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 msgr2=0x562de1670ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3388014f40 tx=0x7f3388021000 comp rx=0 tx=0).stop 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 -- 172.21.15.100:0/1961624900 shutdown_connections 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670ee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1644100 0x562de16709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 --2- 172.21.15.100:0/1961624900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1604970 0x562de16876c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 -- 172.21.15.100:0/1961624900 >> 172.21.15.100:0/1961624900 conn(0x562de16437e0 msgr2=0x562de167f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 -- 172.21.15.100:0/1961624900 shutdown_connections 2024-02-21T07:46:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.339+0000 7f33981f9740 1 -- 172.21.15.100:0/1961624900 wait complete. 2024-02-21T07:46:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.340+0000 7f33981f9740 1 -- start start 2024-02-21T07:46:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.340+0000 7f33981f9740 1 Processor -- start 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1604970 0x562de1647da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1644100 0x562de167e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de167e680 con 0x562de167eeb0 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de16e67e0 con 0x562de1604970 2024-02-21T07:46:08.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562de1670a70 con 0x562de1644100 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f33981f9740 10 client.0 _ll_register_callbacks cb 0x7f3388001b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f338f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54592/0 (socket says 172.21.15.100:54592) 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f338f400640 1 -- 172.21.15.100:0/1761825975 learned_addr learned my addr 172.21.15.100:0/1761825975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f338ea00640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1604970 0x562de1647da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.341+0000 7f338e000640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1644100 0x562de167e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 -- 172.21.15.100:0/1761825975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1644100 msgr2=0x562de167e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1644100 0x562de167e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 -- 172.21.15.100:0/1761825975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1604970 msgr2=0x562de1647da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1604970 0x562de1647da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 -- 172.21.15.100:0/1761825975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562de15374c0 con 0x562de167eeb0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f338f400640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f338800f660 tx=0x7f3388014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1547da81eb98d94 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f3373400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.342+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388013d50 con 0x562de167eeb0 2024-02-21T07:46:08.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f3388021520 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f338000fe50 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33880216e0 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 10 client.4803 fetch_fsmap learned FSMap version 14 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x562de156dec0 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338000fe50 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f338803b040 con 0x562de167eeb0 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 10 client.4803 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 10 client.4803 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 20 client.4803 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de1602790 0x562de16ed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.343+0000 7f33981f9740 4 client.4803 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562de12c0270 con 0x562de1602790 2024-02-21T07:46:08.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f338ea00640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de1602790 0x562de16ed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f338ea00640 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de1602790 0x562de16ed590 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546dd092197a5d67 server_cookie=edc252252a3873b6 in_seq=0 out_seq=0 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f3373400640 10 client.4803 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f3373400640 1 -- 172.21.15.100:0/1761825975 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562de12c0270 con 0x562de1602790 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f3373400640 10 client.4803 handle_command_reply: tid=0 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.344+0000 7f33981f9740 1 client.4803 shutdown 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 msgr2=0x562de1670f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f338800f660 tx=0x7f3388014000 comp rx=0 tx=0).stop 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 shutdown_connections 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562de1602790 0x562de16ed590 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562de167eeb0 0x562de1670f00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562de1644100 0x562de167e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 --2- 172.21.15.100:0/1761825975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562de1604970 0x562de1647da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 >> 172.21.15.100:0/1761825975 conn(0x562de16437e0 msgr2=0x562de1630b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f3373400640 0 client.4803 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 shutdown_connections 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 1 -- 172.21.15.100:0/1761825975 wait complete. 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.345+0000 7f33981f9740 20 client.4803 trim_cache size 0 max 16384 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "b9cc1397-a437-4ace-98ff-c29f55191169", 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4354, 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-02-21T07:46:08.354 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 42.076358704999997, 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 28, 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 28, 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 47.074244958999998 2024-02-21T07:46:08.355 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 msgr2=0x7f336c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 0x7f336c0a15f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3388001e20 tx=0x7f3388009040 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 msgr2=0x7f3390153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 0x7f3390153c20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3378034000 tx=0x7f33780046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 shutdown_connections 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339015cd30 0x7f3390220250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f336c09f130 0x7f336c0a15f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339015c950 0x7f3390153c20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 --2- 172.21.15.100:0/2941859458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33900f56c0 0x7f33901749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 >> 172.21.15.100:0/2941859458 conn(0x7f33900668b0 msgr2=0x7f3390188450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 shutdown_connections 2024-02-21T07:46:08.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.346+0000 7f3395600640 1 -- 172.21.15.100:0/2941859458 wait complete. 2024-02-21T07:46:08.370 INFO:teuthology.run_tasks:Running task kclient... 2024-02-21T07:46:08.384 INFO:tasks.kclient:Mounting kernel clients... 2024-02-21T07:46:08.385 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-21T07:46:08.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:08.385 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-02-21T07:46:08.431 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-21T07:46:08.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:08.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:46:08.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:08.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-02-21T07:46:08.700 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-02-21T07:46:08.700 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T07:46:08.701 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:08.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T07:46:08.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.881+0000 7f7513000640 1 Processor -- start 2024-02-21T07:46:08.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.881+0000 7f7513000640 1 -- start start 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.883+0000 7f7513000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f750c06da90 0x7f750c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.883+0000 7f7513000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c18be30 con 0x7f750c186a60 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.883+0000 7f7513000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c18a3a0 con 0x7f750c186300 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.883+0000 7f7513000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c18b300 con 0x7f750c06da90 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f750b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f750c186a60 0x7f750c18b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38658/0 (socket says 172.21.15.100:38658) 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f750b400640 1 -- 172.21.15.100:0/3564864291 learned_addr learned my addr 172.21.15.100:0/3564864291 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:08.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f7511000640 1 --2- 172.21.15.100:0/3564864291 >> v2:172.21.15.100:3300/0 conn(0x7f750c06da90 0x7f750c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f750aa00640 1 -- 172.21.15.100:0/3564864291 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492552078 0 0) 0x7f750c18a3a0 con 0x7f750c186300 2024-02-21T07:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f7511000640 1 -- 172.21.15.100:0/3564864291 >> v1:172.21.15.156:6789/0 conn(0x7f750c186300 legacy=0x7f750c0f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f7511000640 1 -- 172.21.15.100:0/3564864291 >> v1:172.21.15.100:6789/0 conn(0x7f750c186a60 legacy=0x7f750c18b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.884+0000 7f7511000640 1 -- 172.21.15.100:0/3564864291 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c18a680 con 0x7f750c06da90 2024-02-21T07:46:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.885+0000 7f7511000640 1 --2- 172.21.15.100:0/3564864291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c06da90 0x7f750c06dea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75040097a0 tx=0x7f750402b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fc66542552e568 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f750aa00640 1 -- 172.21.15.100:0/3564864291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504030710 con 0x7f750c06da90 2024-02-21T07:46:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f750aa00640 1 -- 172.21.15.100:0/3564864291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750402e050 con 0x7f750c06da90 2024-02-21T07:46:08.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f750aa00640 1 -- 172.21.15.100:0/3564864291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504030a90 con 0x7f750c06da90 2024-02-21T07:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f7513000640 1 -- 172.21.15.100:0/3564864291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c06da90 msgr2=0x7f750c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f7513000640 1 --2- 172.21.15.100:0/3564864291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c06da90 0x7f750c06dea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75040097a0 tx=0x7f750402b680 comp rx=0 tx=0).stop 2024-02-21T07:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f7513000640 1 -- 172.21.15.100:0/3564864291 shutdown_connections 2024-02-21T07:46:08.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f7513000640 1 --2- 172.21.15.100:0/3564864291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c06da90 0x7f750c06dea0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.886+0000 7f7513000640 1 -- 172.21.15.100:0/3564864291 >> 172.21.15.100:0/3564864291 conn(0x7f750c0ce2a0 msgr2=0x7f750c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.887+0000 7f7513000640 1 -- 172.21.15.100:0/3564864291 shutdown_connections 2024-02-21T07:46:08.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.887+0000 7f7513000640 1 -- 172.21.15.100:0/3564864291 wait complete. 2024-02-21T07:46:08.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.889+0000 7f7513000640 1 Processor -- start 2024-02-21T07:46:08.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.889+0000 7f7513000640 1 -- start start 2024-02-21T07:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 0x7f750c17a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 0x7f750c16ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c16f130 con 0x7f750c186a60 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c17ad90 con 0x7f750c06da90 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.890+0000 7f7513000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c17b070 con 0x7f750c186300 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f7511000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 0x7f750c17a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 0x7f750c16ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f7511000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54614/0 (socket says 172.21.15.100:54614) 2024-02-21T07:46:08.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f7511000640 1 -- 172.21.15.100:0/3309455928 learned_addr learned my addr 172.21.15.100:0/3309455928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 -- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 msgr2=0x7f750c17a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 0x7f750c17a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 -- 172.21.15.100:0/3309455928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 msgr2=0x7f750c220090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750b400640 1 -- 172.21.15.100:0/3309455928 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009400 con 0x7f750c186300 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f750be00640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 0x7f750c17a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.891+0000 7f7511000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f750b400640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 0x7f750c16ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f750c18bfc0 tx=0x7f74f800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8005ce0 con 0x7f750c186300 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8005e40 con 0x7f750c186300 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c17b350 con 0x7f750c186300 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f80072d0 con 0x7f750c186300 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.892+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c17b910 con 0x7f750c186300 2024-02-21T07:46:08.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.893+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c0f58f0 con 0x7f750c186300 2024-02-21T07:46:08.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.895+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f74f80074f0 con 0x7f750c186300 2024-02-21T07:46:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.896+0000 7f7503e00640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 0x7f74ec0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.896+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f74f80c90f0 con 0x7f750c186300 2024-02-21T07:46:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.897+0000 7f750be00640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 0x7f74ec0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:08.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.897+0000 7f750be00640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 0x7f74ec0a15f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0012e0 tx=0x7f74fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:08.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:08.900+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74f8092f10 con 0x7f750c186300 2024-02-21T07:46:09.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.135+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f750c067c80 con 0x7f750c186300 2024-02-21T07:46:09.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.136+0000 7f7503e00640 1 -- 172.21.15.100:0/3309455928 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+88 (secure 0 0 0) 0x7f74f8017070 con 0x7f750c186300 2024-02-21T07:46:09.142 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 msgr2=0x7f74ec0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 0x7f74ec0a15f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0012e0 tx=0x7f74fc009040 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 msgr2=0x7f750c16ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 0x7f750c16ebf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f750c18bfc0 tx=0x7f74f800c8e0 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 shutdown_connections 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f74ec09f130 0x7f74ec0a15f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f750c186a60 0x7f750c220090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f750c186300 0x7f750c16ebf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 --2- 172.21.15.100:0/3309455928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f750c06da90 0x7f750c17a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 >> 172.21.15.100:0/3309455928 conn(0x7f750c0ce2a0 msgr2=0x7f750c18b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 shutdown_connections 2024-02-21T07:46:09.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:09.139+0000 7f7513000640 1 -- 172.21.15.100:0/3309455928 wait complete. 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T07:46:09.163 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T07:46:09.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.163 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-02-21T07:46:09.212 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T07:46:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T07:46:09.212 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T07:46:09.213 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42578sec preferred_lft 42578sec 2024-02-21T07:46:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link proto kernel_ll 2024-02-21T07:46:09.214 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:46:09.215 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T07:46:09.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T07:46:09.215 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:46:09.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.428 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T07:46:09.512 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-02-21T07:46:09.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.517 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-02-21T07:46:09.565 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-02-21T07:46:09.565 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T07:46:09.565 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T07:46:09.565 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T07:46:09.565 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T07:46:09.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.566 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:46:09.566 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:46:09.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T07:46:09.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T07:46:09.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T07:46:09.567 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:46:09.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.746 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-02-21T07:46:09.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.797 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-02-21T07:46:09.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:09.844 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:46:09.845 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:46:09.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T07:46:09.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-21T07:46:09.845 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:46:10.028 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-21T07:46:10.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-21T07:46:10.029 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:46:10.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:10.286 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-02-21T07:46:10.287 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-02-21T07:46:10.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-02-21T07:46:10.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T07:46:10.287 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-02-21T07:46:10.449 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:46:10.450 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:10.494 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-21T07:46:10.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:46:10.494 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:10.587 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-02-21T07:46:10.588 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-02-21T07:46:10.588 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/440428ee-e56f-4dcf-926c-b2ae2bf1afab 2024-02-21T07:46:10.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:10.588 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/440428ee-e56f-4dcf-926c-b2ae2bf1afab /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-02-21T07:46:10.725 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-02-21T07:46:10.725 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-02-21T07:46:10.725 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:invalid new device string format 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.156:3300,172.21.15.170:3300" 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.100:3300,172.21.15.156:3300,172.21.15.170:3300:/volumes/qa/sv_1/440428ee-e56f-4dcf-926c-b2ae2bf1afab 2024-02-21T07:46:11.359 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=b9cc1397-a437-4ace-98ff-c29f55191169" will pass to kernel 2024-02-21T07:46:11.368 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-21T07:46:11.368 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-02-21T07:46:11.368 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T07:46:11.368 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T07:46:11.368 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T07:46:11.374 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T07:46:11.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:11.374 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:11.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:11.475 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:46:11.544 INFO:teuthology.orchestra.run.smithi100.stdout:client4951 2024-02-21T07:46:11.544 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:46:11.544 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:46:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:11.594 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:46:11.700 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:11.705 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:11.708 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:11.714 INFO:teuthology.orchestra.run.smithi100.stdout:client4951 2024-02-21T07:46:11.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:11.714 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:46:11.811 INFO:teuthology.orchestra.run.smithi100.stdout:client4951 2024-02-21T07:46:11.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:11.811 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/b9cc1397-a437-4ace-98ff-c29f55191169.client4951/status') 2024-02-21T07:46:11.904 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4951 (3)172.21.15.100:0/3034732350 2024-02-21T07:46:11.904 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-02-21T07:46:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-02-21T07:46:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-02-21T07:46:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:71 bytes copied, 6.1834e-05 s, 1.1 MB/s 2024-02-21T07:46:11.908 INFO:teuthology.run_tasks:Running task exec... 2024-02-21T07:46:11.918 INFO:teuthology.task.exec:Executing custom commands... 2024-02-21T07:46:11.918 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:46:11.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-02-21T07:46:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.115+0000 7f7470200640 1 Processor -- start 2024-02-21T07:46:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.115+0000 7f7470200640 1 -- start start 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f7470200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f746806f7e0 0x7f746806fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f7470200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746806eab0 con 0x7f746818a050 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f7470200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7468184070 con 0x7f7468189c70 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f7470200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74681876b0 con 0x7f746806f7e0 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f746ce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f746818a050 0x7f746818a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49250/0 (socket says 172.21.15.100:49250) 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f746ce00640 1 -- 172.21.15.100:0/491037651 learned_addr learned my addr 172.21.15.100:0/491037651 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f746d800640 1 --1- 172.21.15.100:0/491037651 >> v1:172.21.15.156:6789/0 conn(0x7f7468189c70 0x7f7468186fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:47166/0 (socket says 172.21.15.100:47166) 2024-02-21T07:46:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.117+0000 7f746e200640 1 --2- 172.21.15.100:0/491037651 >> v2:172.21.15.156:3300/0 conn(0x7f746806f7e0 0x7f746806fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156404361 0 0) 0x7f7468184070 con 0x7f7468189c70 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7450003520 con 0x7f7468189c70 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218937319 0 0) 0x7f746806eab0 con 0x7f746818a050 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7468184070 con 0x7f746818a050 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f746e200640 1 -- 172.21.15.100:0/491037651 >> v1:172.21.15.156:6789/0 conn(0x7f7468189c70 legacy=0x7f7468186fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f746e200640 1 -- 172.21.15.100:0/491037651 >> v1:172.21.15.100:6789/0 conn(0x7f746818a050 legacy=0x7f746818a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.118+0000 7f746e200640 1 -- 172.21.15.100:0/491037651 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680f95b0 con 0x7f746806f7e0 2024-02-21T07:46:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.119+0000 7f746e200640 1 --2- 172.21.15.100:0/491037651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f746806fc50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7460009d90 tx=0x7f746002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36e977ef5808cf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.119+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746002cd00 con 0x7f746806f7e0 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.119+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746002ce60 con 0x7f746806f7e0 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.119+0000 7f7467e00640 1 -- 172.21.15.100:0/491037651 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460034660 con 0x7f746806f7e0 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 -- 172.21.15.100:0/491037651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 msgr2=0x7f746806fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 --2- 172.21.15.100:0/491037651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f746806fc50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7460009d90 tx=0x7f746002bf50 comp rx=0 tx=0).stop 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 -- 172.21.15.100:0/491037651 shutdown_connections 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 --2- 172.21.15.100:0/491037651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f746806fc50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 -- 172.21.15.100:0/491037651 >> 172.21.15.100:0/491037651 conn(0x7f74680ce130 msgr2=0x7f74680ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 -- 172.21.15.100:0/491037651 shutdown_connections 2024-02-21T07:46:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.120+0000 7f7470200640 1 -- 172.21.15.100:0/491037651 wait complete. 2024-02-21T07:46:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.122+0000 7f7470200640 1 Processor -- start 2024-02-21T07:46:12.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.122+0000 7f7470200640 1 -- start start 2024-02-21T07:46:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f74681844f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f746818a050 0x7f746816e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468184ec0 con 0x7f7468189c70 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74681851a0 con 0x7f746806f7e0 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.123+0000 7f7470200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468185480 con 0x7f746818a050 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f74681844f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53990/0 (socket says 172.21.15.100:53990) 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746ce00640 1 -- 172.21.15.100:0/2013682657 learned_addr learned my addr 172.21.15.100:0/2013682657 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746e200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f746818a050 0x7f746816e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 -- 172.21.15.100:0/2013682657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f746818a050 msgr2=0x7f746816e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f746818a050 0x7f746816e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 -- 172.21.15.100:0/2013682657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 msgr2=0x7f746816e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 -- 172.21.15.100:0/2013682657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460009a70 con 0x7f746806f7e0 2024-02-21T07:46:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746ce00640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.124+0000 7f746d800640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f74681844f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c390 tx=0x7f745c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.125+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c0074e0 con 0x7f746806f7e0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.125+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c007640 con 0x7f746806f7e0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.125+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c004a20 con 0x7f746806f7e0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.125+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7468185760 con 0x7f746806f7e0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.125+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746816eed0 con 0x7f746806f7e0 2024-02-21T07:46:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.126+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746816f060 con 0x7f746806f7e0 2024-02-21T07:46:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.128+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f745c004b80 con 0x7f746806f7e0 2024-02-21T07:46:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.129+0000 7f7465600640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 0x7f74480a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.130+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f745c0c9c10 con 0x7f746806f7e0 2024-02-21T07:46:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.130+0000 7f746ce00640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 0x7f74480a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.130+0000 7f746ce00640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 0x7f74480a15f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7468214750 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.132+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f745c0939b0 con 0x7f746806f7e0 2024-02-21T07:46:12.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.371+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7f7468185db0 con 0x7f746806f7e0 2024-02-21T07:46:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.537+0000 7f7465600640 1 -- 172.21.15.100:0/2013682657 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v15) v1 ==== 117+0+0 (secure 0 0 0) 0x7f745c097070 con 0x7f746806f7e0 2024-02-21T07:46:12.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 msgr2=0x7f74480a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 0x7f74480a15f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7468214750 tx=0x7f7454009040 comp rx=0 tx=0).stop 2024-02-21T07:46:12.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 msgr2=0x7f74681844f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f74681844f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f745c00c390 tx=0x7f745c00c850 comp rx=0 tx=0).stop 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 shutdown_connections 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f746818a050 0x7f746816e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f744809f130 0x7f74480a15f0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7468214750 tx=0x7f7454009040 comp rx=0 tx=0).stop 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7468189c70 0x7f746816e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 --2- 172.21.15.100:0/2013682657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f746806f7e0 0x7f74681844f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 >> 172.21.15.100:0/2013682657 conn(0x7f74680ce130 msgr2=0x7f74680f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 shutdown_connections 2024-02-21T07:46:12.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.544+0000 7f7470200640 1 -- 172.21.15.100:0/2013682657 wait complete. 2024-02-21T07:46:12.569 INFO:teuthology.run_tasks:Running task check-counter... 2024-02-21T07:46:12.591 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-02-21T07:46:12.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.818+0000 7f1b55200640 1 Processor -- start 2024-02-21T07:46:12.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.819+0000 7f1b55200640 1 -- start start 2024-02-21T07:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b55200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b50186df0 0x7f1b500f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b55200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b50188770 0x7f1b50188c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b55200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b500f9ac0 con 0x7f1b50185f20 2024-02-21T07:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b55200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5006dc90 con 0x7f1b50188770 2024-02-21T07:46:12.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b55200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5006df70 con 0x7f1b50186df0 2024-02-21T07:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b4de00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1b50185f20 0x7f1b501866e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:47168/0 (socket says 172.21.15.100:47168) 2024-02-21T07:46:12.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b45400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1b50186df0 0x7f1b500f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b4de00640 1 -- 172.21.15.100:0/889041449 learned_addr learned my addr 172.21.15.100:0/889041449 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.821+0000 7f1b4e800640 1 --2- 172.21.15.100:0/889041449 >> v2:172.21.15.100:3300/0 conn(0x7f1b50188770 0x7f1b50188c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b4d400640 1 -- 172.21.15.100:0/889041449 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137897981 0 0) 0x7f1b40001110 con 0x7f1b50185f20 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b4d400640 1 -- 172.21.15.100:0/889041449 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b34003520 con 0x7f1b50185f20 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b45400640 1 -- 172.21.15.100:0/889041449 >> v2:172.21.15.100:3300/0 conn(0x7f1b50188770 msgr2=0x7f1b50188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b45400640 1 --2- 172.21.15.100:0/889041449 >> v2:172.21.15.100:3300/0 conn(0x7f1b50188770 0x7f1b50188c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b45400640 1 -- 172.21.15.100:0/889041449 >> v1:172.21.15.156:6789/0 conn(0x7f1b50185f20 legacy=0x7f1b501866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.822+0000 7f1b45400640 1 -- 172.21.15.100:0/889041449 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5006e250 con 0x7f1b50186df0 2024-02-21T07:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.823+0000 7f1b45400640 1 --2- 172.21.15.100:0/889041449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50186df0 0x7f1b500f9580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b500f4290 tx=0x7f1b3802b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ca07b3045a8f8f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.823+0000 7f1b4d400640 1 -- 172.21.15.100:0/889041449 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38031710 con 0x7f1b50186df0 2024-02-21T07:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.823+0000 7f1b4d400640 1 -- 172.21.15.100:0/889041449 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3802f050 con 0x7f1b50186df0 2024-02-21T07:46:12.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.823+0000 7f1b4d400640 1 -- 172.21.15.100:0/889041449 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38031a90 con 0x7f1b50186df0 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 -- 172.21.15.100:0/889041449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50186df0 msgr2=0x7f1b500f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 --2- 172.21.15.100:0/889041449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50186df0 0x7f1b500f9580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b500f4290 tx=0x7f1b3802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 -- 172.21.15.100:0/889041449 shutdown_connections 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 --2- 172.21.15.100:0/889041449 >> v2:172.21.15.100:3300/0 conn(0x7f1b50188770 0x7f1b50188c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 --2- 172.21.15.100:0/889041449 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50186df0 0x7f1b500f9580 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 -- 172.21.15.100:0/889041449 >> 172.21.15.100:0/889041449 conn(0x7f1b500ce160 msgr2=0x7f1b500ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 -- 172.21.15.100:0/889041449 shutdown_connections 2024-02-21T07:46:12.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.824+0000 7f1b55200640 1 -- 172.21.15.100:0/889041449 wait complete. 2024-02-21T07:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.826+0000 7f1b55200640 1 Processor -- start 2024-02-21T07:46:12.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.827+0000 7f1b55200640 1 -- start start 2024-02-21T07:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b50185f20 0x7f1b5017f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50188770 0x7f1b500f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50178cc0 con 0x7f1b50186df0 2024-02-21T07:46:12.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50178fa0 con 0x7f1b50188770 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b55200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50179280 con 0x7f1b50185f20 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b45400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b45400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54006/0 (socket says 172.21.15.100:54006) 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.828+0000 7f1b45400640 1 -- 172.21.15.100:0/4209778736 learned_addr learned my addr 172.21.15.100:0/4209778736 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b4e800640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50188770 0x7f1b500f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b4de00640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b50185f20 0x7f1b5017f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 -- 172.21.15.100:0/4209778736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b50185f20 msgr2=0x7f1b5017f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b50185f20 0x7f1b5017f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 -- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50188770 msgr2=0x7f1b500f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50188770 0x7f1b500f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:12.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 -- 172.21.15.100:0/4209778736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009400 con 0x7f1b50186df0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b45400640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.829+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3803c810 con 0x7f1b50186df0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.830+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3803c970 con 0x7f1b50186df0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.830+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3803cd20 con 0x7f1b50186df0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.830+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50179560 con 0x7f1b50186df0 2024-02-21T07:46:12.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.830+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50179b20 con 0x7f1b50186df0 2024-02-21T07:46:12.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.831+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50067c80 con 0x7f1b50186df0 2024-02-21T07:46:12.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.833+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1b3803a040 con 0x7f1b50186df0 2024-02-21T07:46:12.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.835+0000 7f1b46a00640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 0x7f1b2c0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:12.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.835+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1b380eac50 con 0x7f1b50186df0 2024-02-21T07:46:12.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.835+0000 7f1b4de00640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 0x7f1b2c0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:12.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.836+0000 7f1b4de00640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 0x7f1b2c0a1620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001270 tx=0x7f1b40007bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:12.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:12.839+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b380b4900 con 0x7f1b50186df0 2024-02-21T07:46:13.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.036+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b500f4510 con 0x7f1b50186df0 2024-02-21T07:46:13.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.038+0000 7f1b46a00640 1 -- 172.21.15.100:0/4209778736 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23771 (secure 0 0 0) 0x7f1b380b7fc0 con 0x7f1b50186df0 2024-02-21T07:46:13.044 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:13.044 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":29,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:12.515992+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.040+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 msgr2=0x7f1b2c0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.040+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 0x7f1b2c0a1620 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b40001270 tx=0x7f1b40007bb0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 msgr2=0x7f1b501720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1b38000c00 tx=0x7f1b380046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 shutdown_connections 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b50188770 0x7f1b500f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1b2c09f160 0x7f1b2c0a1620 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b50186df0 0x7f1b501720c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 --2- 172.21.15.100:0/4209778736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b50185f20 0x7f1b5017f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 >> 172.21.15.100:0/4209778736 conn(0x7f1b500ce160 msgr2=0x7f1b500ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 shutdown_connections 2024-02-21T07:46:13.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.041+0000 7f1b55200640 1 -- 172.21.15.100:0/4209778736 wait complete. 2024-02-21T07:46:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:46:13.065 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:46:13.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.260+0000 7fac11e00640 1 Processor -- start 2024-02-21T07:46:13.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.260+0000 7fac11e00640 1 -- start start 2024-02-21T07:46:13.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.262+0000 7fac11e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0f85c0 con 0x7fac0c1866e0 2024-02-21T07:46:13.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.262+0000 7fac11e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0f8860 con 0x7fac0c06e960 2024-02-21T07:46:13.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.262+0000 7fac11e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0f8b40 con 0x7fac0c1860b0 2024-02-21T07:46:13.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.262+0000 7fac0be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac0c1866e0 0x7fac0c186b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49258/0 (socket says 172.21.15.100:49258) 2024-02-21T07:46:13.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.262+0000 7fac0be00640 1 -- 172.21.15.100:0/3901610157 learned_addr learned my addr 172.21.15.100:0/3901610157 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697195219 0 0) 0x7fac0c0f8860 con 0x7fac0c06e960 2024-02-21T07:46:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf4003520 con 0x7fac0c06e960 2024-02-21T07:46:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019387488 0 0) 0x7fac0c0f85c0 con 0x7fac0c1866e0 2024-02-21T07:46:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c0f8860 con 0x7fac0c1866e0 2024-02-21T07:46:13.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678967091 0 0) 0x7fac0c0f8b40 con 0x7fac0c1860b0 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac0c0f85c0 con 0x7fac0c1860b0 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3840913344 0 0) 0x7fabf4003520 con 0x7fac0c06e960 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 >> v1:172.21.15.170:6789/0 conn(0x7fac0c1860b0 legacy=0x7fac0c0f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 >> v1:172.21.15.100:6789/0 conn(0x7fac0c1866e0 legacy=0x7fac0c186b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0f8e20 con 0x7fac0c06e960 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fac04001670 con 0x7fac0c06e960 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 >> v1:172.21.15.156:6789/0 conn(0x7fac0c06e960 legacy=0x7fac0c18c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4003d60 0x7fabf4004140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 0x7fabf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf40053a0 0x7fabf400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400c2b0 con 0x7fabf4004810 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400c420 con 0x7fabf4003d60 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf400c5e0 con 0x7fabf40053a0 2024-02-21T07:46:13.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac0be00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 0x7fabf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.263+0000 7fac10a00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4003d60 0x7fabf4004140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac11400640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf40053a0 0x7fabf400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac0be00640 1 -- 172.21.15.100:0/3901610157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf40053a0 msgr2=0x7fabf400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac0be00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabf40053a0 0x7fabf400ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac0be00640 1 -- 172.21.15.100:0/3901610157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4003d60 msgr2=0x7fabf4004140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac0be00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4003d60 0x7fabf4004140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac0be00640 1 -- 172.21.15.100:0/3901610157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf4003520 con 0x7fabf4004810 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac10a00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4003d60 0x7fabf4004140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.264+0000 7fac11400640 1 -- 172.21.15.100:0/3901610157 reap_dead start 2024-02-21T07:46:13.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.265+0000 7fac0be00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 0x7fabf4004c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fabf8007fd0 tx=0x7fabf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f91492238aba58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.265+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8004aa0 con 0x7fabf4004810 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.265+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf802d040 con 0x7fabf4004810 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.265+0000 7fac0b400640 1 -- 172.21.15.100:0/3901610157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8004e60 con 0x7fabf4004810 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 -- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 msgr2=0x7fabf4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 0x7fabf4004c90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fabf8007fd0 tx=0x7fabf40057f0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 -- 172.21.15.100:0/3901610157 shutdown_connections 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 --2- 172.21.15.100:0/3901610157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabf4004810 0x7fabf4004c90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 -- 172.21.15.100:0/3901610157 >> 172.21.15.100:0/3901610157 conn(0x7fac0c0ce150 msgr2=0x7fac0c0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 -- 172.21.15.100:0/3901610157 shutdown_connections 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.266+0000 7fac11e00640 1 -- 172.21.15.100:0/3901610157 wait complete. 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.268+0000 7fac11e00640 1 Processor -- start 2024-02-21T07:46:13.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.268+0000 7fac11e00640 1 -- start start 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4004810 0x7fac0c21f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac0c0f2200 0x7fac0c16d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0f1d70 con 0x7fac0c0f2680 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1528c0 con 0x7fabf4004810 2024-02-21T07:46:13.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.269+0000 7fac11e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c0f0e80 con 0x7fac0c0f2200 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54024/0 (socket says 172.21.15.100:54024) 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 -- 172.21.15.100:0/1009665039 learned_addr learned my addr 172.21.15.100:0/1009665039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac10a00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4004810 0x7fac0c21f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac0be00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac0c0f2200 0x7fac0c16d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 -- 172.21.15.100:0/1009665039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac0c0f2200 msgr2=0x7fac0c16d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac0c0f2200 0x7fac0c16d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 -- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4004810 msgr2=0x7fac0c21f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4004810 0x7fac0c21f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 -- 172.21.15.100:0/1009665039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c0f1160 con 0x7fac0c0f2680 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.270+0000 7fac11400640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac0c08d660 tx=0x7fac0400fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.271+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040050d0 con 0x7fac0c0f2680 2024-02-21T07:46:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.271+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04005230 con 0x7fac0c0f2680 2024-02-21T07:46:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.271+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040035f0 con 0x7fac0c0f2680 2024-02-21T07:46:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.271+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c0f1440 con 0x7fac0c0f2680 2024-02-21T07:46:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.271+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c0f1a00 con 0x7fac0c0f2680 2024-02-21T07:46:13.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.272+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c0f1b90 con 0x7fac0c0f2680 2024-02-21T07:46:13.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.274+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fac04003750 con 0x7fac0c0f2680 2024-02-21T07:46:13.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.275+0000 7fac08c00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 0x7fabec0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.275+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fac040c9900 con 0x7fac0c0f2680 2024-02-21T07:46:13.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.276+0000 7fac10a00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 0x7fabec0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.276+0000 7fac10a00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 0x7fabec0a15f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac00000f80 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.279+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fac04093630 con 0x7fac0c0f2680 2024-02-21T07:46:13.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.472+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac0c0751d0 con 0x7fac0c0f2680 2024-02-21T07:46:13.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.473+0000 7fac08c00640 1 -- 172.21.15.100:0/1009665039 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac04096cf0 con 0x7fac0c0f2680 2024-02-21T07:46:13.479 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:46:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.475+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 msgr2=0x7fabec0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.475+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 0x7fabec0a15f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fac00000f80 tx=0x7fac00009040 comp rx=0 tx=0).stop 2024-02-21T07:46:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.475+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 msgr2=0x7fac0c221770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.475+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac0c08d660 tx=0x7fac0400fb40 comp rx=0 tx=0).stop 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 shutdown_connections 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fabec09f130 0x7fabec0a15f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac0c0f2680 0x7fac0c221770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac0c0f2200 0x7fac0c16d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 --2- 172.21.15.100:0/1009665039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabf4004810 0x7fac0c21f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 >> 172.21.15.100:0/1009665039 conn(0x7fac0c0ce150 msgr2=0x7fac0c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 shutdown_connections 2024-02-21T07:46:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.476+0000 7fac11e00640 1 -- 172.21.15.100:0/1009665039 wait complete. 2024-02-21T07:46:13.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:46:13.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.707+0000 7fe42fc00640 1 Processor -- start 2024-02-21T07:46:13.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.708+0000 7fe42fc00640 1 -- start start 2024-02-21T07:46:13.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.709+0000 7fe42fc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe42806edc0 0x7fe428190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42fc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42818dc80 con 0x7fe428070a30 2024-02-21T07:46:13.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42fc00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280f55d0 con 0x7fe428190260 2024-02-21T07:46:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42fc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280f5b90 con 0x7fe42806edc0 2024-02-21T07:46:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe428070a30 0x7fe42806e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49266/0 (socket says 172.21.15.100:49266) 2024-02-21T07:46:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427e00640 1 -- 172.21.15.100:0/967787688 learned_addr learned my addr 172.21.15.100:0/967787688 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:13.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42dc00640 1 --2- 172.21.15.100:0/967787688 >> v2:172.21.15.100:3300/0 conn(0x7fe42806edc0 0x7fe428190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466707878 0 0) 0x7fe42818dc80 con 0x7fe428070a30 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe410003520 con 0x7fe428070a30 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333116244 0 0) 0x7fe4280f55d0 con 0x7fe428190260 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe42818dc80 con 0x7fe428190260 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42dc00640 1 -- 172.21.15.100:0/967787688 >> v1:172.21.15.156:6789/0 conn(0x7fe428190260 legacy=0x7fe4280f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.710+0000 7fe42dc00640 1 -- 172.21.15.100:0/967787688 >> v1:172.21.15.100:6789/0 conn(0x7fe428070a30 legacy=0x7fe42806e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.711+0000 7fe42dc00640 1 -- 172.21.15.100:0/967787688 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280f58b0 con 0x7fe42806edc0 2024-02-21T07:46:13.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.712+0000 7fe42dc00640 1 --2- 172.21.15.100:0/967787688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42806edc0 0x7fe428190640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe420009d90 tx=0x7fe42002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28c0192414a36c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.712+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42002cbd0 con 0x7fe42806edc0 2024-02-21T07:46:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.712+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42002cd30 con 0x7fe42806edc0 2024-02-21T07:46:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.712+0000 7fe427400640 1 -- 172.21.15.100:0/967787688 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42002cea0 con 0x7fe42806edc0 2024-02-21T07:46:13.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 -- 172.21.15.100:0/967787688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42806edc0 msgr2=0x7fe428190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 --2- 172.21.15.100:0/967787688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42806edc0 0x7fe428190640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe420009d90 tx=0x7fe42002be20 comp rx=0 tx=0).stop 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 -- 172.21.15.100:0/967787688 shutdown_connections 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 --2- 172.21.15.100:0/967787688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe42806edc0 0x7fe428190640 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 -- 172.21.15.100:0/967787688 >> 172.21.15.100:0/967787688 conn(0x7fe4280668b0 msgr2=0x7fe428066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 -- 172.21.15.100:0/967787688 shutdown_connections 2024-02-21T07:46:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.713+0000 7fe42fc00640 1 -- 172.21.15.100:0/967787688 wait complete. 2024-02-21T07:46:13.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.715+0000 7fe42fc00640 1 Processor -- start 2024-02-21T07:46:13.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.715+0000 7fe42fc00640 1 -- start start 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 0x7fe4281673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe428167930 0x7fe4280ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280f7760 con 0x7fe428190260 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280f7a40 con 0x7fe428070a30 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42fc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280efec0 con 0x7fe428167930 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe427e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe42d200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 0x7fe4281673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe427e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54042/0 (socket says 172.21.15.100:54042) 2024-02-21T07:46:13.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.716+0000 7fe427e00640 1 -- 172.21.15.100:0/1161381335 learned_addr learned my addr 172.21.15.100:0/1161381335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:13.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe42dc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe428167930 0x7fe4280ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 -- 172.21.15.100:0/1161381335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe428167930 msgr2=0x7fe4280ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe428167930 0x7fe4280ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 -- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 msgr2=0x7fe4281673f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 0x7fe4281673f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 -- 172.21.15.100:0/1161381335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009a70 con 0x7fe428190260 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe42d200640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 0x7fe4281673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe427e00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c3c0 tx=0x7fe41400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.717+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414005ce0 con 0x7fe428190260 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.718+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414005e40 con 0x7fe428190260 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.718+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414007310 con 0x7fe428190260 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.718+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280f01a0 con 0x7fe428190260 2024-02-21T07:46:13.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.718+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4280f0760 con 0x7fe428190260 2024-02-21T07:46:13.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.719+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42806b6b0 con 0x7fe428190260 2024-02-21T07:46:13.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.721+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe414007470 con 0x7fe428190260 2024-02-21T07:46:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.722+0000 7fe424c00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 0x7fe4080a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.722+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe4140c90b0 con 0x7fe428190260 2024-02-21T07:46:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.722+0000 7fe42d200640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 0x7fe4080a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:13.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.723+0000 7fe42d200640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 0x7fe4080a15f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007fd0 tx=0x7fe41c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:13.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.726+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe414092ef0 con 0x7fe428190260 2024-02-21T07:46:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.922+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe428067c80 con 0x7fe428190260 2024-02-21T07:46:13.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.923+0000 7fe424c00640 1 -- 172.21.15.100:0/1161381335 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4140170a0 con 0x7fe428190260 2024-02-21T07:46:13.928 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:13.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.925+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 msgr2=0x7fe4080a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.925+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 0x7fe4080a15f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe41c007fd0 tx=0x7fe41c009040 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 msgr2=0x7fe4280ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c3c0 tx=0x7fe41400c880 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 shutdown_connections 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe428167930 0x7fe4280ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe40809f130 0x7fe4080a15f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe428190260 0x7fe4280ef340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 --2- 172.21.15.100:0/1161381335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe428070a30 0x7fe4281673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 >> 172.21.15.100:0/1161381335 conn(0x7fe4280668b0 msgr2=0x7fe4280f47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 shutdown_connections 2024-02-21T07:46:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:13.926+0000 7fe42fc00640 1 -- 172.21.15.100:0/1161381335 wait complete. 2024-02-21T07:46:13.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:46:14.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.157+0000 7f5c1dc00640 1 Processor -- start 2024-02-21T07:46:14.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.158+0000 7f5c1dc00640 1 -- start start 2024-02-21T07:46:14.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.159+0000 7f5c1dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c18182850 0x7f5c18189ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c1dc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c181897c0 con 0x7f5c180fc630 2024-02-21T07:46:14.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c1dc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c18182c30 con 0x7f5c1806c890 2024-02-21T07:46:14.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c1dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1806b8c0 con 0x7f5c18182850 2024-02-21T07:46:14.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c1d200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5c180fc630 0x7f5c180d5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49282/0 (socket says 172.21.15.100:49282) 2024-02-21T07:46:14.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c1d200640 1 -- 172.21.15.100:0/523336286 learned_addr learned my addr 172.21.15.100:0/523336286 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:14.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c17e00640 1 --2- 172.21.15.100:0/523336286 >> v2:172.21.15.170:3300/0 conn(0x7f5c18182850 0x7f5c18189ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193879650 0 0) 0x7f5c181897c0 con 0x7f5c180fc630 2024-02-21T07:46:14.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bf8003520 con 0x7f5c180fc630 2024-02-21T07:46:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16988500 0 0) 0x7f5c18182c30 con 0x7f5c1806c890 2024-02-21T07:46:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c181897c0 con 0x7f5c1806c890 2024-02-21T07:46:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.160+0000 7f5c17e00640 1 -- 172.21.15.100:0/523336286 >> v1:172.21.15.170:6789/0 conn(0x7f5c1806c890 legacy=0x7f5c180fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.161+0000 7f5c17e00640 1 -- 172.21.15.100:0/523336286 >> v1:172.21.15.100:6789/0 conn(0x7f5c180fc630 legacy=0x7f5c180d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.161+0000 7f5c17e00640 1 -- 172.21.15.100:0/523336286 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180fcd60 con 0x7f5c18182850 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c17e00640 1 --2- 172.21.15.100:0/523336286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c18189ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097a0 tx=0x7f5c0802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2eb30f3f222899 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0802e070 con 0x7f5c18182850 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c080315a0 con 0x7f5c18182850 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c16a00640 1 -- 172.21.15.100:0/523336286 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031930 con 0x7f5c18182850 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c1dc00640 1 -- 172.21.15.100:0/523336286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 msgr2=0x7f5c18189ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.162+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/523336286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c18189ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c080097a0 tx=0x7f5c0802b840 comp rx=0 tx=0).stop 2024-02-21T07:46:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.163+0000 7f5c1dc00640 1 -- 172.21.15.100:0/523336286 shutdown_connections 2024-02-21T07:46:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.163+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/523336286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c18189ca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.163+0000 7f5c1dc00640 1 -- 172.21.15.100:0/523336286 >> 172.21.15.100:0/523336286 conn(0x7f5c180fe020 msgr2=0x7f5c180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.163+0000 7f5c1dc00640 1 -- 172.21.15.100:0/523336286 shutdown_connections 2024-02-21T07:46:14.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.163+0000 7f5c1dc00640 1 -- 172.21.15.100:0/523336286 wait complete. 2024-02-21T07:46:14.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.165+0000 7f5c1dc00640 1 Processor -- start 2024-02-21T07:46:14.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.165+0000 7f5c1dc00640 1 -- start start 2024-02-21T07:46:14.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1806c890 0x7f5c18167820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c1821ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18178500 con 0x7f5c180fc630 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1821fc30 con 0x7f5c1806c890 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1821f550 con 0x7f5c18182850 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c17400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c17400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54056/0 (socket says 172.21.15.100:54056) 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c17400640 1 -- 172.21.15.100:0/1711539443 learned_addr learned my addr 172.21.15.100:0/1711539443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c17e00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1806c890 0x7f5c18167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.166+0000 7f5c1d200640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c1821ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 -- 172.21.15.100:0/1711539443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 msgr2=0x7f5c1821ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c1821ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 -- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1806c890 msgr2=0x7f5c18167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1806c890 0x7f5c18167820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 -- 172.21.15.100:0/1711539443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009400 con 0x7f5c180fc630 2024-02-21T07:46:14.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c17400640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c7a0 tx=0x7f5c0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c00003b70 con 0x7f5c180fc630 2024-02-21T07:46:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c00003cf0 con 0x7f5c180fc630 2024-02-21T07:46:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0000aa30 con 0x7f5c180fc630 2024-02-21T07:46:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.167+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1821fe80 con 0x7f5c180fc630 2024-02-21T07:46:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.168+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c18220440 con 0x7f5c180fc630 2024-02-21T07:46:14.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.169+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c180751d0 con 0x7f5c180fc630 2024-02-21T07:46:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.170+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5c0000ab90 con 0x7f5c180fc630 2024-02-21T07:46:14.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.172+0000 7f5c0fe00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 0x7f5bf40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.172+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c000c9940 con 0x7f5c180fc630 2024-02-21T07:46:14.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.172+0000 7f5c17e00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 0x7f5bf40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.173+0000 7f5c17e00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 0x7f5bf40a15f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5c08036000 tx=0x7f5c0803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.176+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c00093700 con 0x7f5c180fc630 2024-02-21T07:46:14.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.378+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c180d45f0 con 0x7f5c180fc630 2024-02-21T07:46:14.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.379+0000 7f5c0fe00640 1 -- 172.21.15.100:0/1711539443 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c00096dc0 con 0x7f5c180fc630 2024-02-21T07:46:14.386 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:46:14.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 msgr2=0x7f5bf40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 0x7f5bf40a15f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5c08036000 tx=0x7f5c0803d040 comp rx=0 tx=0).stop 2024-02-21T07:46:14.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 msgr2=0x7f5c1821e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000c7a0 tx=0x7f5c0000cc60 comp rx=0 tx=0).stop 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 shutdown_connections 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c18182850 0x7f5c1821ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bf409f130 0x7f5bf40a15f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c180fc630 0x7f5c1821e7c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 --2- 172.21.15.100:0/1711539443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1806c890 0x7f5c18167820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 >> 172.21.15.100:0/1711539443 conn(0x7f5c180fe020 msgr2=0x7f5c180d4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 shutdown_connections 2024-02-21T07:46:14.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.382+0000 7f5c1dc00640 1 -- 172.21.15.100:0/1711539443 wait complete. 2024-02-21T07:46:14.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:46:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.617+0000 7f0c49c00640 1 Processor -- start 2024-02-21T07:46:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.617+0000 7f0c49c00640 1 -- start start 2024-02-21T07:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c49c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c44189ca0 0x7f0c4406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c49c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c441871c0 0x7f0c440cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c49c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c440ca6a0 con 0x7f0c4418a080 2024-02-21T07:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c49c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4418abe0 con 0x7f0c44189ca0 2024-02-21T07:46:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c49c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440f6200 con 0x7f0c441871c0 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.619+0000 7f0c42a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c44189ca0 0x7f0c4406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c44189ca0 0x7f0c4406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54062/0 (socket says 172.21.15.100:54062) 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 -- 172.21.15.100:0/3264986971 learned_addr learned my addr 172.21.15.100:0/3264986971 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42000640 1 --2- 172.21.15.100:0/3264986971 >> v2:172.21.15.156:3300/0 conn(0x7f0c441871c0 0x7f0c440cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 -- 172.21.15.100:0/3264986971 >> v2:172.21.15.156:3300/0 conn(0x7f0c441871c0 msgr2=0x7f0c440cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 --2- 172.21.15.100:0/3264986971 >> v2:172.21.15.156:3300/0 conn(0x7f0c441871c0 0x7f0c440cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 -- 172.21.15.100:0/3264986971 >> v1:172.21.15.170:6789/0 conn(0x7f0c4418a080 legacy=0x7f0c4418a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c42a00640 1 -- 172.21.15.100:0/3264986971 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440f6450 con 0x7f0c44189ca0 2024-02-21T07:46:14.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.620+0000 7f0c41600640 1 -- 172.21.15.100:0/3264986971 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924142983 0 0) 0x7f0c440ca6a0 con 0x7f0c4418a080 2024-02-21T07:46:14.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.621+0000 7f0c42a00640 1 --2- 172.21.15.100:0/3264986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c4406ab60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c44067a70 tx=0x7f0c3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e442bc2321940764 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c41600640 1 -- 172.21.15.100:0/3264986971 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34030860 con 0x7f0c44189ca0 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c41600640 1 -- 172.21.15.100:0/3264986971 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c340309c0 con 0x7f0c44189ca0 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c41600640 1 -- 172.21.15.100:0/3264986971 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34030d50 con 0x7f0c44189ca0 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 -- 172.21.15.100:0/3264986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 msgr2=0x7f0c4406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 --2- 172.21.15.100:0/3264986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c4406ab60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c44067a70 tx=0x7f0c3402b9a0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 -- 172.21.15.100:0/3264986971 shutdown_connections 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 --2- 172.21.15.100:0/3264986971 >> v2:172.21.15.156:3300/0 conn(0x7f0c441871c0 0x7f0c440cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 --2- 172.21.15.100:0/3264986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c4406ab60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 -- 172.21.15.100:0/3264986971 >> 172.21.15.100:0/3264986971 conn(0x7f0c440668b0 msgr2=0x7f0c44066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 -- 172.21.15.100:0/3264986971 shutdown_connections 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.622+0000 7f0c49c00640 1 -- 172.21.15.100:0/3264986971 wait complete. 2024-02-21T07:46:14.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.624+0000 7f0c49c00640 1 Processor -- start 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.625+0000 7f0c49c00640 1 -- start start 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c44071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 0x7f0c44172fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c441753a0 con 0x7f0c44189ca0 2024-02-21T07:46:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44175680 con 0x7f0c4418a080 2024-02-21T07:46:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c49c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44175960 con 0x7f0c441871c0 2024-02-21T07:46:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c42a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c42a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34054/0 (socket says 172.21.15.100:34054) 2024-02-21T07:46:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c42a00640 1 -- 172.21.15.100:0/4119356059 learned_addr learned my addr 172.21.15.100:0/4119356059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c42000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c44071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.626+0000 7f0c43400640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 0x7f0c44172fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 -- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 msgr2=0x7f0c44172fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 0x7f0c44172fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 -- 172.21.15.100:0/4119356059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 msgr2=0x7f0c44071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c44071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 -- 172.21.15.100:0/4119356059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340094d0 con 0x7f0c441871c0 2024-02-21T07:46:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42000640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c44071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c43400640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 0x7f0c44172fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c42a00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c3402b9e0 tx=0x7f0c34004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34039c90 con 0x7f0c441871c0 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c34039e10 con 0x7f0c441871c0 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c34043640 con 0x7f0c441871c0 2024-02-21T07:46:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.627+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c44175c40 con 0x7f0c441871c0 2024-02-21T07:46:14.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.628+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4421d270 con 0x7f0c441871c0 2024-02-21T07:46:14.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.628+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4408e1c0 con 0x7f0c441871c0 2024-02-21T07:46:14.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.630+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0c340437a0 con 0x7f0c441871c0 2024-02-21T07:46:14.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.631+0000 7f0c3aa00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 0x7f0c240a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.632+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c3403e070 con 0x7f0c441871c0 2024-02-21T07:46:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.632+0000 7f0c42000640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 0x7f0c240a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.632+0000 7f0c42000640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 0x7f0c240a1570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c44189c70 tx=0x7f0c30009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.636+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c340b6a50 con 0x7f0c441871c0 2024-02-21T07:46:14.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.829+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0c44175aa0 con 0x7f0c441871c0 2024-02-21T07:46:14.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.830+0000 7f0c3aa00640 1 -- 172.21.15.100:0/4119356059 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0c44175aa0 con 0x7f0c441871c0 2024-02-21T07:46:14.837 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 msgr2=0x7f0c240a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 0x7f0c240a1570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c44189c70 tx=0x7f0c30009190 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 msgr2=0x7f0c44178890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0c3402b9e0 tx=0x7f0c34004730 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 shutdown_connections 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c4418a080 0x7f0c44172fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c2409f0b0 0x7f0c240a1570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c44189ca0 0x7f0c44071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 --2- 172.21.15.100:0/4119356059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c441871c0 0x7f0c44178890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 >> 172.21.15.100:0/4119356059 conn(0x7f0c440668b0 msgr2=0x7f0c4418a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 shutdown_connections 2024-02-21T07:46:14.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:14.833+0000 7f0c49c00640 1 -- 172.21.15.100:0/4119356059 wait complete. 2024-02-21T07:46:14.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.068+0000 7fe5d6e00640 1 Processor -- start 2024-02-21T07:46:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.068+0000 7fe5d6e00640 1 -- start start 2024-02-21T07:46:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.070+0000 7fe5d6e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.070+0000 7fe5d6e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5d0072f00 0x7fe5d006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.070+0000 7fe5d6e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d006dcf0 con 0x7fe5d006d7c0 2024-02-21T07:46:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.070+0000 7fe5d6e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d00f43a0 con 0x7fe5d0185e10 2024-02-21T07:46:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.070+0000 7fe5d6e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d0189670 con 0x7fe5d0072f00 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5d0072f00 0x7fe5d006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe5d0072f00 0x7fe5d006f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34060/0 (socket says 172.21.15.100:34060) 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55774/0 (socket says 172.21.15.100:55774) 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 -- 172.21.15.100:0/642033953 learned_addr learned my addr 172.21.15.100:0/642033953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5cfe00640 1 -- 172.21.15.100:0/642033953 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062995282 0 0) 0x7fe5d006dcf0 con 0x7fe5d006d7c0 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5cfe00640 1 -- 172.21.15.100:0/642033953 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b8003520 con 0x7fe5d006d7c0 2024-02-21T07:46:15.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 -- 172.21.15.100:0/642033953 >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 msgr2=0x7fe5d00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 --2- 172.21.15.100:0/642033953 >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 -- 172.21.15.100:0/642033953 >> v1:172.21.15.170:6789/0 conn(0x7fe5d006d7c0 legacy=0x7fe5d00f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5000640 1 -- 172.21.15.100:0/642033953 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d006dfd0 con 0x7fe5d0072f00 2024-02-21T07:46:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.071+0000 7fe5d5a00640 1 --2- 172.21.15.100:0/642033953 >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.073+0000 7fe5d5000640 1 --2- 172.21.15.100:0/642033953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d006f600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00cef30 tx=0x7fe5bc02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200f7c99b13d350e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.073+0000 7fe5cfe00640 1 -- 172.21.15.100:0/642033953 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0317e0 con 0x7fe5d0072f00 2024-02-21T07:46:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.073+0000 7fe5cfe00640 1 -- 172.21.15.100:0/642033953 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc031940 con 0x7fe5d0072f00 2024-02-21T07:46:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.073+0000 7fe5cfe00640 1 -- 172.21.15.100:0/642033953 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc031cb0 con 0x7fe5d0072f00 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 -- 172.21.15.100:0/642033953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 msgr2=0x7fe5d006f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/642033953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d006f600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00cef30 tx=0x7fe5bc02b880 comp rx=0 tx=0).stop 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 -- 172.21.15.100:0/642033953 shutdown_connections 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/642033953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d006f600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/642033953 >> v2:172.21.15.156:3300/0 conn(0x7fe5d0185e10 0x7fe5d00703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 -- 172.21.15.100:0/642033953 >> 172.21.15.100:0/642033953 conn(0x7fe5d00f64a0 msgr2=0x7fe5d00f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 -- 172.21.15.100:0/642033953 shutdown_connections 2024-02-21T07:46:15.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.074+0000 7fe5d6e00640 1 -- 172.21.15.100:0/642033953 wait complete. 2024-02-21T07:46:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.076+0000 7fe5d6e00640 1 Processor -- start 2024-02-21T07:46:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.076+0000 7fe5d6e00640 1 -- start start 2024-02-21T07:46:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d006d7c0 0x7fe5d01682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d021faf0 con 0x7fe5d0185e10 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0184580 con 0x7fe5d006d7c0 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.077+0000 7fe5d6e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0184860 con 0x7fe5d0072f00 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d006d7c0 0x7fe5d01682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34064/0 (socket says 172.21.15.100:34064) 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 -- 172.21.15.100:0/2493465821 learned_addr learned my addr 172.21.15.100:0/2493465821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54082/0 (socket says 172.21.15.100:54082) 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 -- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d006d7c0 msgr2=0x7fe5d01682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d006d7c0 0x7fe5d01682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 -- 172.21.15.100:0/2493465821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 msgr2=0x7fe5d021ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d5000640 1 -- 172.21.15.100:0/2493465821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4009400 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.078+0000 7fe5d6400640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5d5000640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc034040 tx=0x7fe5bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc004240 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc03f070 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc003610 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc0094d0 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.079+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d0184e20 con 0x7fe5d0072f00 2024-02-21T07:46:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.080+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d021fc60 con 0x7fe5d0072f00 2024-02-21T07:46:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.082+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe5bc003770 con 0x7fe5d0072f00 2024-02-21T07:46:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.083+0000 7fe5cd600640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 0x7fe5b00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.083+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe5bc0eb8f0 con 0x7fe5d0072f00 2024-02-21T07:46:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.084+0000 7fe5d5a00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 0x7fe5b00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.084+0000 7fe5d5a00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 0x7fe5b00a15f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009cd0 tx=0x7fe5c4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.085+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe5bc0b5620 con 0x7fe5d0072f00 2024-02-21T07:46:15.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.285+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5d021fc60 con 0x7fe5d0072f00 2024-02-21T07:46:15.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.288+0000 7fe5cd600640 1 -- 172.21.15.100:0/2493465821 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7fe5d021fc60 con 0x7fe5d0072f00 2024-02-21T07:46:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:15.296 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 msgr2=0x7fe5b00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 0x7fe5b00a15f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009cd0 tx=0x7fe5c4009190 comp rx=0 tx=0).stop 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 msgr2=0x7fe5d021e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc034040 tx=0x7fe5bc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 shutdown_connections 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe5b009f130 0x7fe5b00a15f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5d0185e10 0x7fe5d021ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5d0072f00 0x7fe5d021e910 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 --2- 172.21.15.100:0/2493465821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5d006d7c0 0x7fe5d01682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 >> 172.21.15.100:0/2493465821 conn(0x7fe5d00f64a0 msgr2=0x7fe5d0179030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 shutdown_connections 2024-02-21T07:46:15.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.290+0000 7fe5d6e00640 1 -- 172.21.15.100:0/2493465821 wait complete. 2024-02-21T07:46:15.317 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:46:15.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:46:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.527+0000 7ff791600640 1 Processor -- start 2024-02-21T07:46:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.528+0000 7ff791600640 1 -- start start 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.529+0000 7ff791600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff78c186300 0x7ff78c18a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff791600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c06bd00 con 0x7ff78c185f20 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff791600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c06bfe0 con 0x7ff78c0d6810 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff791600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c06d080 con 0x7ff78c186300 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff78c185f20 0x7ff78c189eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49290/0 (socket says 172.21.15.100:49290) 2024-02-21T07:46:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78aa00640 1 -- 172.21.15.100:0/1217284712 learned_addr learned my addr 172.21.15.100:0/1217284712 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff782000640 1 --2- 172.21.15.100:0/1217284712 >> v2:172.21.15.156:3300/0 conn(0x7ff78c186300 0x7ff78c18a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797078430 0 0) 0x7ff78c06bfe0 con 0x7ff78c0d6810 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff770003520 con 0x7ff78c0d6810 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317253265 0 0) 0x7ff78c06bd00 con 0x7ff78c185f20 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff78c06bfe0 con 0x7ff78c185f20 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff782000640 1 -- 172.21.15.100:0/1217284712 >> v1:172.21.15.170:6789/0 conn(0x7ff78c0d6810 legacy=0x7ff78c1889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff782000640 1 -- 172.21.15.100:0/1217284712 >> v1:172.21.15.100:6789/0 conn(0x7ff78c185f20 legacy=0x7ff78c189eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.530+0000 7ff782000640 1 -- 172.21.15.100:0/1217284712 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c06c2c0 con 0x7ff78c186300 2024-02-21T07:46:15.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.532+0000 7ff782000640 1 --2- 172.21.15.100:0/1217284712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c18a5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7740097a0 tx=0x7ff77402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac811b12ee2f4aa1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.532+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77402e070 con 0x7ff78c186300 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.532+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7740315a0 con 0x7ff78c186300 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.532+0000 7ff78a000640 1 -- 172.21.15.100:0/1217284712 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774031930 con 0x7ff78c186300 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 -- 172.21.15.100:0/1217284712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 msgr2=0x7ff78c18a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 --2- 172.21.15.100:0/1217284712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c18a5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7740097a0 tx=0x7ff77402b840 comp rx=0 tx=0).stop 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 -- 172.21.15.100:0/1217284712 shutdown_connections 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 --2- 172.21.15.100:0/1217284712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c18a5c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 -- 172.21.15.100:0/1217284712 >> 172.21.15.100:0/1217284712 conn(0x7ff78c0fe270 msgr2=0x7ff78c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 -- 172.21.15.100:0/1217284712 shutdown_connections 2024-02-21T07:46:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.533+0000 7ff791600640 1 -- 172.21.15.100:0/1217284712 wait complete. 2024-02-21T07:46:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.535+0000 7ff791600640 1 Processor -- start 2024-02-21T07:46:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.535+0000 7ff791600640 1 -- start start 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff78c0d6810 0x7ff78c183740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c184e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1849a0 con 0x7ff78c185f20 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c183c80 con 0x7ff78c186300 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff791600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0fde90 con 0x7ff78c0d6810 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff782000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff782000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54094/0 (socket says 172.21.15.100:54094) 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff782000640 1 -- 172.21.15.100:0/3178740303 learned_addr learned my addr 172.21.15.100:0/3178740303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff78aa00640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff78c0d6810 0x7ff78c183740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.536+0000 7ff78b400640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c184e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 -- 172.21.15.100:0/3178740303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff78c0d6810 msgr2=0x7ff78c183740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff78c0d6810 0x7ff78c183740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 -- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 msgr2=0x7ff78c184e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c184e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 -- 172.21.15.100:0/3178740303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774009400 con 0x7ff78c185f20 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff78b400640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c184e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff782000640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff774034040 tx=0x7ff7740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774032630 con 0x7ff78c185f20 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774032790 con 0x7ff78c185f20 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774032b40 con 0x7ff78c185f20 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c184070 con 0x7ff78c185f20 2024-02-21T07:46:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.537+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c184630 con 0x7ff78c185f20 2024-02-21T07:46:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.538+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c1847f0 con 0x7ff78c185f20 2024-02-21T07:46:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.540+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ff77404e430 con 0x7ff78c185f20 2024-02-21T07:46:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.542+0000 7ff783400640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 0x7ff7680a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.542+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff7740ebd30 con 0x7ff78c185f20 2024-02-21T07:46:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.542+0000 7ff78aa00640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 0x7ff7680a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.543+0000 7ff78aa00640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 0x7ff7680a15f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff77c005880 tx=0x7ff77c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.546+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7740f0070 con 0x7ff78c185f20 2024-02-21T07:46:15.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.744+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff78c18bb90 con 0x7ff78c185f20 2024-02-21T07:46:15.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.745+0000 7ff783400640 1 -- 172.21.15.100:0/3178740303 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7740b5a40 con 0x7ff78c185f20 2024-02-21T07:46:15.751 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:46:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 msgr2=0x7ff7680a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 0x7ff7680a15f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff77c005880 tx=0x7ff77c009040 comp rx=0 tx=0).stop 2024-02-21T07:46:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 msgr2=0x7ff78c179350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff774034040 tx=0x7ff7740046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 shutdown_connections 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff78c186300 0x7ff78c184e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff76809f130 0x7ff7680a15f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff78c185f20 0x7ff78c179350 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 --2- 172.21.15.100:0/3178740303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff78c0d6810 0x7ff78c183740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.747+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 >> 172.21.15.100:0/3178740303 conn(0x7ff78c0fe270 msgr2=0x7ff78c0f8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.748+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 shutdown_connections 2024-02-21T07:46:15.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.748+0000 7ff791600640 1 -- 172.21.15.100:0/3178740303 wait complete. 2024-02-21T07:46:15.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:46:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.980+0000 7f7cc8c00640 1 Processor -- start 2024-02-21T07:46:15.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.981+0000 7f7cc8c00640 1 -- start start 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc8c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 0x7f7cc406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc8c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cc41871c0 0x7f7cc40cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc8c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40ca6a0 con 0x7f7cc418a080 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc8c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc418abe0 con 0x7f7cc41871c0 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc8c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc40f6200 con 0x7f7cc4189ca0 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cc41871c0 0x7f7cc40cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7cc41871c0 0x7f7cc40cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54104/0 (socket says 172.21.15.100:54104) 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc1400640 1 -- 172.21.15.100:0/450165284 learned_addr learned my addr 172.21.15.100:0/450165284 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.983+0000 7f7cc1e00640 1 --2- 172.21.15.100:0/450165284 >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 0x7f7cc406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc1400640 1 -- 172.21.15.100:0/450165284 >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 msgr2=0x7f7cc406ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc1400640 1 --2- 172.21.15.100:0/450165284 >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 0x7f7cc406ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc1400640 1 -- 172.21.15.100:0/450165284 >> v1:172.21.15.156:6789/0 conn(0x7f7cc418a080 legacy=0x7f7cc418a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc1400640 1 -- 172.21.15.100:0/450165284 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc40f6450 con 0x7f7cc41871c0 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc1e00640 1 --2- 172.21.15.100:0/450165284 >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 0x7f7cc406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.984+0000 7f7cc0a00640 1 -- 172.21.15.100:0/450165284 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639328966 0 0) 0x7f7cc40ca6a0 con 0x7f7cc418a080 2024-02-21T07:46:15.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.985+0000 7f7cc1400640 1 --2- 172.21.15.100:0/450165284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc40cb690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4073250 tx=0x7f7cac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3eabbdd0035361 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.985+0000 7f7cc0a00640 1 -- 172.21.15.100:0/450165284 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac030860 con 0x7f7cc41871c0 2024-02-21T07:46:15.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.985+0000 7f7cc0a00640 1 -- 172.21.15.100:0/450165284 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0309c0 con 0x7f7cc41871c0 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.985+0000 7f7cc0a00640 1 -- 172.21.15.100:0/450165284 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac030d50 con 0x7f7cc41871c0 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 -- 172.21.15.100:0/450165284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 msgr2=0x7f7cc40cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/450165284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc40cb690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4073250 tx=0x7f7cac02b9a0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 -- 172.21.15.100:0/450165284 shutdown_connections 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/450165284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc40cb690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/450165284 >> v2:172.21.15.156:3300/0 conn(0x7f7cc4189ca0 0x7f7cc406ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 -- 172.21.15.100:0/450165284 >> 172.21.15.100:0/450165284 conn(0x7f7cc40668b0 msgr2=0x7f7cc4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 -- 172.21.15.100:0/450165284 shutdown_connections 2024-02-21T07:46:15.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.986+0000 7f7cc8c00640 1 -- 172.21.15.100:0/450165284 wait complete. 2024-02-21T07:46:15.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.988+0000 7f7cc8c00640 1 Processor -- start 2024-02-21T07:46:15.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.988+0000 7f7cc8c00640 1 -- start start 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc4189ca0 0x7f7cc4184520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 0x7f7cc4184a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc41861a0 con 0x7f7cc41871c0 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4184fa0 con 0x7f7cc4189ca0 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.989+0000 7f7cc8c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4185240 con 0x7f7cc418a080 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54106/0 (socket says 172.21.15.100:54106) 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 -- 172.21.15.100:0/3607368869 learned_addr learned my addr 172.21.15.100:0/3607368869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:15.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1400640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc4189ca0 0x7f7cc4184520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc2800640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 0x7f7cc4184a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 -- 172.21.15.100:0/3607368869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 msgr2=0x7f7cc4184a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 0x7f7cc4184a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 -- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc4189ca0 msgr2=0x7f7cc4184520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc4189ca0 0x7f7cc4184520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 -- 172.21.15.100:0/3607368869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009400 con 0x7f7cc41871c0 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc2800640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 0x7f7cc4184a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:15.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.990+0000 7f7cc1e00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400ebe0 tx=0x7f7cb400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.991+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4009760 con 0x7f7cc41871c0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.991+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb400cc30 con 0x7f7cc41871c0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.991+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400eee0 con 0x7f7cc41871c0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.991+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac0094d0 con 0x7f7cc41871c0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.991+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4185800 con 0x7f7cc41871c0 2024-02-21T07:46:15.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.992+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc408e1c0 con 0x7f7cc41871c0 2024-02-21T07:46:16.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.994+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7cb4013470 con 0x7f7cc41871c0 2024-02-21T07:46:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.995+0000 7f7cba000640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 0x7f7ca00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.996+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7cb40ca770 con 0x7f7cc41871c0 2024-02-21T07:46:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.996+0000 7f7cc1400640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 0x7f7ca00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.997+0000 7f7cc1400640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 0x7f7ca00a15f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7cac036000 tx=0x7f7cac008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:15.998+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7cb4094410 con 0x7f7cc41871c0 2024-02-21T07:46:16.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.192+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cc4074360 con 0x7f7cc41871c0 2024-02-21T07:46:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.193+0000 7f7cba000640 1 -- 172.21.15.100:0/3607368869 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cb4096340 con 0x7f7cc41871c0 2024-02-21T07:46:16.199 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.195+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 msgr2=0x7f7ca00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.195+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 0x7f7ca00a15f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7cac036000 tx=0x7f7cac008030 comp rx=0 tx=0).stop 2024-02-21T07:46:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.195+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 msgr2=0x7f7cc4176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.195+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400ebe0 tx=0x7f7cb400c520 comp rx=0 tx=0).stop 2024-02-21T07:46:16.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.195+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 shutdown_connections 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cc418a080 0x7f7cc4184a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc4189ca0 0x7f7cc4184520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7ca009f130 0x7f7ca00a15f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 --2- 172.21.15.100:0/3607368869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cc41871c0 0x7f7cc4176210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 >> 172.21.15.100:0/3607368869 conn(0x7f7cc40668b0 msgr2=0x7f7cc406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 shutdown_connections 2024-02-21T07:46:16.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.196+0000 7f7cc8c00640 1 -- 172.21.15.100:0/3607368869 wait complete. 2024-02-21T07:46:16.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:46:16.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.438+0000 7fef0aa00640 1 Processor -- start 2024-02-21T07:46:16.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.438+0000 7fef0aa00640 1 -- start start 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0aa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef0417d0b0 0x7fef040cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 0x7fef040f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0aa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef040cac60 con 0x7fef040f94b0 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0aa00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0417d490 con 0x7fef0417d0b0 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0aa00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef040cba90 con 0x7fef040cb630 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fef040f94b0 0x7fef0406d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49296/0 (socket says 172.21.15.100:49296) 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef0a000640 1 -- 172.21.15.100:0/1387316568 learned_addr learned my addr 172.21.15.100:0/1387316568 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.440+0000 7fef09600640 1 --2- 172.21.15.100:0/1387316568 >> v2:172.21.15.156:3300/0 conn(0x7fef0417d0b0 0x7fef040cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef08c00640 1 --2- 172.21.15.100:0/1387316568 >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 0x7fef040f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef03e00640 1 -- 172.21.15.100:0/1387316568 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281557189 0 0) 0x7fef040cac60 con 0x7fef040f94b0 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef03e00640 1 -- 172.21.15.100:0/1387316568 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee8003520 con 0x7fef040f94b0 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef09600640 1 -- 172.21.15.100:0/1387316568 >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 msgr2=0x7fef040f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef09600640 1 --2- 172.21.15.100:0/1387316568 >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 0x7fef040f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef09600640 1 -- 172.21.15.100:0/1387316568 >> v1:172.21.15.100:6789/0 conn(0x7fef040f94b0 legacy=0x7fef0406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef09600640 1 -- 172.21.15.100:0/1387316568 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0406e830 con 0x7fef0417d0b0 2024-02-21T07:46:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.441+0000 7fef08c00640 1 --2- 172.21.15.100:0/1387316568 >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 0x7fef040f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.442+0000 7fef09600640 1 --2- 172.21.15.100:0/1387316568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef040cb0f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef040f0d00 tx=0x7feef402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e446f93c50f449 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef03e00640 1 -- 172.21.15.100:0/1387316568 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef402cc80 con 0x7fef0417d0b0 2024-02-21T07:46:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef03e00640 1 -- 172.21.15.100:0/1387316568 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef402cde0 con 0x7fef0417d0b0 2024-02-21T07:46:16.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef03e00640 1 -- 172.21.15.100:0/1387316568 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4034660 con 0x7fef0417d0b0 2024-02-21T07:46:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 -- 172.21.15.100:0/1387316568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 msgr2=0x7fef040cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 --2- 172.21.15.100:0/1387316568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef040cb0f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef040f0d00 tx=0x7feef402bed0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 -- 172.21.15.100:0/1387316568 shutdown_connections 2024-02-21T07:46:16.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 --2- 172.21.15.100:0/1387316568 >> v2:172.21.15.170:3300/0 conn(0x7fef040cb630 0x7fef040f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 --2- 172.21.15.100:0/1387316568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef040cb0f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.443+0000 7fef0aa00640 1 -- 172.21.15.100:0/1387316568 >> 172.21.15.100:0/1387316568 conn(0x7fef040ce150 msgr2=0x7fef040ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.444+0000 7fef0aa00640 1 -- 172.21.15.100:0/1387316568 shutdown_connections 2024-02-21T07:46:16.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.444+0000 7fef0aa00640 1 -- 172.21.15.100:0/1387316568 wait complete. 2024-02-21T07:46:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.446+0000 7fef0aa00640 1 Processor -- start 2024-02-21T07:46:16.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.446+0000 7fef0aa00640 1 -- start start 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 0x7fef040727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef042204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04175dd0 con 0x7fef040cb630 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef041760b0 con 0x7fef0417d0b0 2024-02-21T07:46:16.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0aa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef04176390 con 0x7fef040f94b0 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef09600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef09600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54108/0 (socket says 172.21.15.100:54108) 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef09600640 1 -- 172.21.15.100:0/178953599 learned_addr learned my addr 172.21.15.100:0/178953599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef08c00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 0x7fef040727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.448+0000 7fef0a000640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef042204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 -- 172.21.15.100:0/178953599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 msgr2=0x7fef040727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 0x7fef040727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 -- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 msgr2=0x7fef042204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef042204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 -- 172.21.15.100:0/178953599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4009a70 con 0x7fef040cb630 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef08c00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 0x7fef040727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef0a000640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef042204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:16.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef09600640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feef4037040 tx=0x7feef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4040650 con 0x7fef040cb630 2024-02-21T07:46:16.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef40407b0 con 0x7fef040cb630 2024-02-21T07:46:16.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4040b60 con 0x7fef040cb630 2024-02-21T07:46:16.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.449+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef04176670 con 0x7fef040cb630 2024-02-21T07:46:16.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.450+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0421ffc0 con 0x7fef040cb630 2024-02-21T07:46:16.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.451+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef040f8f70 con 0x7fef040cb630 2024-02-21T07:46:16.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.452+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7feef4040cc0 con 0x7fef040cb630 2024-02-21T07:46:16.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.454+0000 7fef01600640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 0x7feee40a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.454+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feef40ec920 con 0x7fef040cb630 2024-02-21T07:46:16.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.454+0000 7fef08c00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 0x7feee40a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.455+0000 7fef08c00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 0x7feee40a1670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fef0417c040 tx=0x7feef0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.458+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feef40b65c0 con 0x7fef040cb630 2024-02-21T07:46:16.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.655+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef040c9550 con 0x7fef040cb630 2024-02-21T07:46:16.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.656+0000 7fef01600640 1 -- 172.21.15.100:0/178953599 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7feef4009450 con 0x7fef040cb630 2024-02-21T07:46:16.662 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 msgr2=0x7feee40a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 0x7feee40a1670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fef0417c040 tx=0x7feef0008040 comp rx=0 tx=0).stop 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 msgr2=0x7fef0416dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7feef4037040 tx=0x7feef4004a40 comp rx=0 tx=0).stop 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 shutdown_connections 2024-02-21T07:46:16.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef0417d0b0 0x7fef042204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef040f94b0 0x7fef040727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feee409f1b0 0x7feee40a1670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 --2- 172.21.15.100:0/178953599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef040cb630 0x7fef0416dcb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 >> 172.21.15.100:0/178953599 conn(0x7fef040ce150 msgr2=0x7fef0408c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 shutdown_connections 2024-02-21T07:46:16.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.658+0000 7fef0aa00640 1 -- 172.21.15.100:0/178953599 wait complete. 2024-02-21T07:46:16.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:46:16.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.879+0000 7fb494a00640 1 Processor -- start 2024-02-21T07:46:16.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.879+0000 7fb494a00640 1 -- start start 2024-02-21T07:46:16.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.881+0000 7fb494a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb490189ca0 0x7fb49006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.881+0000 7fb494a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4901871c0 0x7fb4900cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.881+0000 7fb494a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4900ca6a0 con 0x7fb49018a080 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.881+0000 7fb494a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb49018abe0 con 0x7fb4901871c0 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.881+0000 7fb494a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900f6200 con 0x7fb490189ca0 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4901871c0 0x7fb4900cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48de00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb490189ca0 0x7fb49006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4901871c0 0x7fb4900cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54122/0 (socket says 172.21.15.100:54122) 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 -- 172.21.15.100:0/236568650 learned_addr learned my addr 172.21.15.100:0/236568650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48e800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb49018a080 0x7fb49018a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:45698/0 (socket says 172.21.15.100:45698) 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 -- 172.21.15.100:0/236568650 >> v2:172.21.15.170:3300/0 conn(0x7fb490189ca0 msgr2=0x7fb49006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:16.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 --2- 172.21.15.100:0/236568650 >> v2:172.21.15.170:3300/0 conn(0x7fb490189ca0 0x7fb49006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 -- 172.21.15.100:0/236568650 >> v1:172.21.15.170:6789/0 conn(0x7fb49018a080 legacy=0x7fb49018a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48ca00640 1 -- 172.21.15.100:0/236568650 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712304656 0 0) 0x7fb4900ca6a0 con 0x7fb49018a080 2024-02-21T07:46:16.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.882+0000 7fb48d400640 1 -- 172.21.15.100:0/236568650 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4900f6450 con 0x7fb4901871c0 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.883+0000 7fb48d400640 1 --2- 172.21.15.100:0/236568650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb4900cb690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb490073250 tx=0x7fb47c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3042785bf6f717e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb48ca00640 1 -- 172.21.15.100:0/236568650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c030860 con 0x7fb4901871c0 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb48ca00640 1 -- 172.21.15.100:0/236568650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c0309c0 con 0x7fb4901871c0 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb48ca00640 1 -- 172.21.15.100:0/236568650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c030d50 con 0x7fb4901871c0 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 -- 172.21.15.100:0/236568650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 msgr2=0x7fb4900cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 --2- 172.21.15.100:0/236568650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb4900cb690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb490073250 tx=0x7fb47c02b9a0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 -- 172.21.15.100:0/236568650 shutdown_connections 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 --2- 172.21.15.100:0/236568650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb4900cb690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 --2- 172.21.15.100:0/236568650 >> v2:172.21.15.170:3300/0 conn(0x7fb490189ca0 0x7fb49006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 -- 172.21.15.100:0/236568650 >> 172.21.15.100:0/236568650 conn(0x7fb4900668b0 msgr2=0x7fb490066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.884+0000 7fb494a00640 1 -- 172.21.15.100:0/236568650 shutdown_connections 2024-02-21T07:46:16.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.885+0000 7fb494a00640 1 -- 172.21.15.100:0/236568650 wait complete. 2024-02-21T07:46:16.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.886+0000 7fb494a00640 1 Processor -- start 2024-02-21T07:46:16.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.887+0000 7fb494a00640 1 -- start start 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb490189ca0 0x7fb490184520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49018a080 0x7fb490184a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901861a0 con 0x7fb4901871c0 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490184fa0 con 0x7fb49018a080 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb494a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490185240 con 0x7fb490189ca0 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54126/0 (socket says 172.21.15.100:54126) 2024-02-21T07:46:16.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48de00640 1 -- 172.21.15.100:0/1536002274 learned_addr learned my addr 172.21.15.100:0/1536002274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48d400640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb490189ca0 0x7fb490184520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48e800640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49018a080 0x7fb490184a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.888+0000 7fb48de00640 1 -- 172.21.15.100:0/1536002274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb490189ca0 msgr2=0x7fb490184520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb48de00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb490189ca0 0x7fb490184520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb48de00640 1 -- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49018a080 msgr2=0x7fb490184a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb48de00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49018a080 0x7fb490184a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb48de00640 1 -- 172.21.15.100:0/1536002274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c0094d0 con 0x7fb4901871c0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb48de00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb48000e9b0 tx=0x7fb48000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480009670 con 0x7fb4901871c0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000c9a0 con 0x7fb4901871c0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000cd50 con 0x7fb4901871c0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490185520 con 0x7fb4901871c0 2024-02-21T07:46:16.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.889+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb490185ae0 con 0x7fb4901871c0 2024-02-21T07:46:16.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.890+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49008e1c0 con 0x7fb4901871c0 2024-02-21T07:46:16.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.892+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb480013470 con 0x7fb4901871c0 2024-02-21T07:46:16.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.894+0000 7fb486000640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 0x7fb4700a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:16.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.894+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb4800ca640 con 0x7fb4901871c0 2024-02-21T07:46:16.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.894+0000 7fb48d400640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 0x7fb4700a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:16.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.895+0000 7fb48d400640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 0x7fb4700a15f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb47c036000 tx=0x7fb47c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:16.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:16.896+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb480094390 con 0x7fb4901871c0 2024-02-21T07:46:17.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.090+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb490074360 con 0x7fb4901871c0 2024-02-21T07:46:17.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.091+0000 7fb486000640 1 -- 172.21.15.100:0/1536002274 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb4800170a0 con 0x7fb4901871c0 2024-02-21T07:46:17.098 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 msgr2=0x7fb4700a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 0x7fb4700a15f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb47c036000 tx=0x7fb47c008030 comp rx=0 tx=0).stop 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 msgr2=0x7fb490176210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb48000e9b0 tx=0x7fb48000ee70 comp rx=0 tx=0).stop 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 shutdown_connections 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb49018a080 0x7fb490184a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb490189ca0 0x7fb490184520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb47009f130 0x7fb4700a15f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 --2- 172.21.15.100:0/1536002274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4901871c0 0x7fb490176210 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 >> 172.21.15.100:0/1536002274 conn(0x7fb4900668b0 msgr2=0x7fb49006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 shutdown_connections 2024-02-21T07:46:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.094+0000 7fb494a00640 1 -- 172.21.15.100:0/1536002274 wait complete. 2024-02-21T07:46:17.119 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-02-21T07:46:17.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:17.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.325+0000 7ff93e200640 1 Processor -- start 2024-02-21T07:46:17.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.326+0000 7ff93e200640 1 -- start start 2024-02-21T07:46:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.327+0000 7ff93e200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff938183f70 0x7ff9381844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.327+0000 7ff93e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff93806e7b0 0x7ff9380f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.327+0000 7ff93e200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9380cb5d0 con 0x7ff93806ec10 2024-02-21T07:46:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.327+0000 7ff93e200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93806e390 con 0x7ff93806e7b0 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.327+0000 7ff93e200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff938187520 con 0x7ff938183f70 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff92ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff93806e7b0 0x7ff9380f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff937e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff93806ec10 0x7ff938189b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49306/0 (socket says 172.21.15.100:49306) 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff937e00640 1 -- 172.21.15.100:0/1599481781 learned_addr learned my addr 172.21.15.100:0/1599481781 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff937400640 1 --2- 172.21.15.100:0/1599481781 >> v2:172.21.15.170:3300/0 conn(0x7ff938183f70 0x7ff9381844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff92ea00640 1 -- 172.21.15.100:0/1599481781 >> v2:172.21.15.170:3300/0 conn(0x7ff938183f70 msgr2=0x7ff9381844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff92ea00640 1 --2- 172.21.15.100:0/1599481781 >> v2:172.21.15.170:3300/0 conn(0x7ff938183f70 0x7ff9381844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff92ea00640 1 -- 172.21.15.100:0/1599481781 >> v1:172.21.15.100:6789/0 conn(0x7ff93806ec10 legacy=0x7ff938189b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff92ea00640 1 -- 172.21.15.100:0/1599481781 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380cbb00 con 0x7ff93806e7b0 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.328+0000 7ff936a00640 1 -- 172.21.15.100:0/1599481781 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262796256 0 0) 0x7ff9380cb5d0 con 0x7ff93806ec10 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.329+0000 7ff92ea00640 1 --2- 172.21.15.100:0/1599481781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806e7b0 0x7ff9380f90f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff938068900 tx=0x7ff92002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6cbc88f9e95ef5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff936a00640 1 -- 172.21.15.100:0/1599481781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92002e070 con 0x7ff93806e7b0 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff936a00640 1 -- 172.21.15.100:0/1599481781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9200315a0 con 0x7ff93806e7b0 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff936a00640 1 -- 172.21.15.100:0/1599481781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920031930 con 0x7ff93806e7b0 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 -- 172.21.15.100:0/1599481781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806e7b0 msgr2=0x7ff9380f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 --2- 172.21.15.100:0/1599481781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806e7b0 0x7ff9380f90f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff938068900 tx=0x7ff92002b840 comp rx=0 tx=0).stop 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 -- 172.21.15.100:0/1599481781 shutdown_connections 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 --2- 172.21.15.100:0/1599481781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806e7b0 0x7ff9380f90f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 --2- 172.21.15.100:0/1599481781 >> v2:172.21.15.170:3300/0 conn(0x7ff938183f70 0x7ff9381844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 -- 172.21.15.100:0/1599481781 >> 172.21.15.100:0/1599481781 conn(0x7ff9380ce160 msgr2=0x7ff9380ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 -- 172.21.15.100:0/1599481781 shutdown_connections 2024-02-21T07:46:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.330+0000 7ff93e200640 1 -- 172.21.15.100:0/1599481781 wait complete. 2024-02-21T07:46:17.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.332+0000 7ff93e200640 1 Processor -- start 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.333+0000 7ff93e200640 1 -- start start 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93806e7b0 0x7ff938177b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff938183f70 0x7ff9380f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380f3860 con 0x7ff93806ec10 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380f2d20 con 0x7ff938183f70 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff93e200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380f2fc0 con 0x7ff93806e7b0 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54154/0 (socket says 172.21.15.100:54154) 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 -- 172.21.15.100:0/356336333 learned_addr learned my addr 172.21.15.100:0/356336333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff937400640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93806e7b0 0x7ff938177b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff937e00640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff938183f70 0x7ff9380f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 -- 172.21.15.100:0/356336333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93806e7b0 msgr2=0x7ff938177b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93806e7b0 0x7ff938177b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 -- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff938183f70 msgr2=0x7ff9380f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff938183f70 0x7ff9380f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.334+0000 7ff92ea00640 1 -- 172.21.15.100:0/356336333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009400 con 0x7ff93806ec10 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff92ea00640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff920034040 tx=0x7ff9200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920004230 con 0x7ff93806ec10 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920004390 con 0x7ff93806ec10 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920003810 con 0x7ff93806ec10 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380f32a0 con 0x7ff93806ec10 2024-02-21T07:46:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.335+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93821fda0 con 0x7ff93806ec10 2024-02-21T07:46:17.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.336+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938068430 con 0x7ff93806ec10 2024-02-21T07:46:17.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.338+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ff920003970 con 0x7ff93806ec10 2024-02-21T07:46:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.340+0000 7ff92fe00640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 0x7ff9140a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.340+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff9200ebdc0 con 0x7ff93806ec10 2024-02-21T07:46:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.340+0000 7ff937400640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 0x7ff9140a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.341+0000 7ff937400640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 0x7ff9140a1670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff938221cf0 tx=0x7ff92800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.343+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9200b5950 con 0x7ff93806ec10 2024-02-21T07:46:17.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.577+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff938068430 con 0x7ff93806ec10 2024-02-21T07:46:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.579+0000 7ff92fe00640 1 -- 172.21.15.100:0/356336333 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11339 (secure 0 0 0) 0x7ff9200b7880 con 0x7ff93806ec10 2024-02-21T07:46:17.586 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:17.586 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:12.374340+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:17.586 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 15 2024-02-21T07:46:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 msgr2=0x7ff9140a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 0x7ff9140a1670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff938221cf0 tx=0x7ff92800b040 comp rx=0 tx=0).stop 2024-02-21T07:46:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 msgr2=0x7ff9380f22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff920034040 tx=0x7ff9200046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 shutdown_connections 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff938183f70 0x7ff9380f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91409f1b0 0x7ff9140a1670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff93806ec10 0x7ff9380f22a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 --2- 172.21.15.100:0/356336333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93806e7b0 0x7ff938177b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.581+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 >> 172.21.15.100:0/356336333 conn(0x7ff9380ce160 msgr2=0x7ff9380ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.582+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 shutdown_connections 2024-02-21T07:46:17.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.582+0000 7ff93e200640 1 -- 172.21.15.100:0/356336333 wait complete. 2024-02-21T07:46:17.607 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-02-21T07:46:17.607 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-02-21T07:46:17.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.809+0000 7f09b7e00640 1 Processor -- start 2024-02-21T07:46:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.809+0000 7f09b7e00640 1 -- start start 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.811+0000 7f09b7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f09b8189460 0x7f09b8185790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.811+0000 7f09b7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f09b8185cd0 0x7f09b806b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.811+0000 7f09b7e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b806e7d0 con 0x7f09b81853b0 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.811+0000 7f09b7e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80f4da0 con 0x7f09b8185cd0 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.811+0000 7f09b7e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80f5080 con 0x7f09b8189460 2024-02-21T07:46:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09b6a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f09b81853b0 0x7f09b8070d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49314/0 (socket says 172.21.15.100:49314) 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09b6a00640 1 -- 172.21.15.100:0/1252459946 learned_addr learned my addr 172.21.15.100:0/1252459946 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09ae000640 1 --2- 172.21.15.100:0/1252459946 >> v2:172.21.15.170:3300/0 conn(0x7f09b8189460 0x7f09b8185790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09b7400640 1 --2- 172.21.15.100:0/1252459946 >> v2:172.21.15.156:3300/0 conn(0x7f09b8185cd0 0x7f09b806b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09ae000640 1 -- 172.21.15.100:0/1252459946 >> v2:172.21.15.156:3300/0 conn(0x7f09b8185cd0 msgr2=0x7f09b806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09ae000640 1 --2- 172.21.15.100:0/1252459946 >> v2:172.21.15.156:3300/0 conn(0x7f09b8185cd0 0x7f09b806b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09ae000640 1 -- 172.21.15.100:0/1252459946 >> v1:172.21.15.100:6789/0 conn(0x7f09b81853b0 legacy=0x7f09b8070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09ae000640 1 -- 172.21.15.100:0/1252459946 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80f5360 con 0x7f09b8189460 2024-02-21T07:46:17.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.812+0000 7f09b6000640 1 -- 172.21.15.100:0/1252459946 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100854755 0 0) 0x7f09b806e7d0 con 0x7f09b81853b0 2024-02-21T07:46:17.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.813+0000 7f09ae000640 1 --2- 172.21.15.100:0/1252459946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b8189460 0x7f09b8185790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f09b8183180 tx=0x7f09a002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4fbf93b4167a73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.814+0000 7f09b6000640 1 -- 172.21.15.100:0/1252459946 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031830 con 0x7f09b8189460 2024-02-21T07:46:17.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.814+0000 7f09b6000640 1 -- 172.21.15.100:0/1252459946 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0031990 con 0x7f09b8189460 2024-02-21T07:46:17.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.814+0000 7f09b6000640 1 -- 172.21.15.100:0/1252459946 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0031d20 con 0x7f09b8189460 2024-02-21T07:46:17.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.814+0000 7f09b7e00640 1 -- 172.21.15.100:0/1252459946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b8189460 msgr2=0x7f09b8185790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.814+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1252459946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b8189460 0x7f09b8185790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f09b8183180 tx=0x7f09a002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 -- 172.21.15.100:0/1252459946 shutdown_connections 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1252459946 >> v2:172.21.15.156:3300/0 conn(0x7f09b8185cd0 0x7f09b806b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1252459946 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b8189460 0x7f09b8185790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 -- 172.21.15.100:0/1252459946 >> 172.21.15.100:0/1252459946 conn(0x7f09b80f64a0 msgr2=0x7f09b80f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 -- 172.21.15.100:0/1252459946 shutdown_connections 2024-02-21T07:46:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.815+0000 7f09b7e00640 1 -- 172.21.15.100:0/1252459946 wait complete. 2024-02-21T07:46:17.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.817+0000 7f09b7e00640 1 Processor -- start 2024-02-21T07:46:17.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.817+0000 7f09b7e00640 1 -- start start 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 0x7f09b821a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09b8189460 0x7f09b821c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8070160 con 0x7f09b8185cd0 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8070aa0 con 0x7f09b8189460 2024-02-21T07:46:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8172960 con 0x7f09b81853b0 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34146/0 (socket says 172.21.15.100:34146) 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09ae000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 0x7f09b821a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b6a00640 1 -- 172.21.15.100:0/1646879339 learned_addr learned my addr 172.21.15.100:0/1646879339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.819+0000 7f09b7400640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09b8189460 0x7f09b821c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 -- 172.21.15.100:0/1646879339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 msgr2=0x7f09b8070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 -- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09b8189460 msgr2=0x7f09b821c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09b8189460 0x7f09b821c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 -- 172.21.15.100:0/1646879339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009400 con 0x7f09b8185cd0 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09b6a00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09ae000640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 0x7f09b821a390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09a0033000 tx=0x7f09a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a003a6f0 con 0x7f09b8185cd0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a003a870 con 0x7f09b8185cd0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a003ac20 con 0x7f09b8185cd0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.820+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b806f850 con 0x7f09b8185cd0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.821+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b821d220 con 0x7f09b8185cd0 2024-02-21T07:46:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.822+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b8075160 con 0x7f09b8185cd0 2024-02-21T07:46:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.824+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f09a004c3b0 con 0x7f09b8185cd0 2024-02-21T07:46:17.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.825+0000 7f09af400640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 0x7f09940a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:17.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.826+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f09a00ebb20 con 0x7f09b8185cd0 2024-02-21T07:46:17.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.826+0000 7f09b6a00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 0x7f09940a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:17.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.826+0000 7f09b6a00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 0x7f09940a15f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09a8007c40 tx=0x7f09a8007b90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:17.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:17.828+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09a00b5880 con 0x7f09b8185cd0 2024-02-21T07:46:18.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.021+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b80f5920 con 0x7f099409f130 2024-02-21T07:46:18.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.033+0000 7f09af400640 1 -- 172.21.15.100:0/1646879339 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367895 (secure 0 0 0) 0x7f09a8004b40 con 0x7f099409f130 2024-02-21T07:46:18.045 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 msgr2=0x7f09940a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 0x7f09940a15f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09a8007c40 tx=0x7f09a8007b90 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 msgr2=0x7f09b821a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 0x7f09b821a390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f09a0033000 tx=0x7f09a00046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 shutdown_connections 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f09b8189460 0x7f09b821c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f099409f130 0x7f09940a15f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09b8185cd0 0x7f09b821a390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 --2- 172.21.15.100:0/1646879339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b81853b0 0x7f09b8070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 >> 172.21.15.100:0/1646879339 conn(0x7f09b80f64a0 msgr2=0x7f09b806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 shutdown_connections 2024-02-21T07:46:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.041+0000 7f09b7e00640 1 -- 172.21.15.100:0/1646879339 wait complete. 2024-02-21T07:46:18.069 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-02-21T07:46:17.906727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655500,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":304,"num_read_kb":266,"num_write":348,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353240,"kb_used_data":4024,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108840,"statfs":{"total":1159641169920,"available":1159279452160,"internally_reserved":0,"allocated":4120576,"data_stored":3099724,"data_compressed":217238,"data_compressed_allocated":311296,"data_compressed_original":1589248,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002403"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539198+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:12.539198+0000","last_peered":"2024-02-21T07:46:12.539198+0000","last_clean":"2024-02-21T07:46:12.539198+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:12.539198+0000","last_undegraded":"2024-02-21T07:46:12.539198+0000","last_fullsized":"2024-02-21T07:46:12.539198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528533+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:12.528533+0000","last_peered":"2024-02-21T07:46:12.528533+0000","last_clean":"2024-02-21T07:46:12.528533+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:12.528533+0000","last_undegraded":"2024-02-21T07:46:12.528533+0000","last_fullsized":"2024-02-21T07:46:12.528533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539089+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:12.539089+0000","last_peered":"2024-02-21T07:46:12.539089+0000","last_clean":"2024-02-21T07:46:12.539089+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:12.539089+0000","last_undegraded":"2024-02-21T07:46:12.539089+0000","last_fullsized":"2024-02-21T07:46:12.539089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528969+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:12.528969+0000","last_peered":"2024-02-21T07:46:12.528969+0000","last_clean":"2024-02-21T07:46:12.528969+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:12.528969+0000","last_undegraded":"2024-02-21T07:46:12.528969+0000","last_fullsized":"2024-02-21T07:46:12.528969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528826+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:12.528826+0000","last_peered":"2024-02-21T07:46:12.528826+0000","last_clean":"2024-02-21T07:46:12.528826+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:12.528826+0000","last_undegraded":"2024-02-21T07:46:12.528826+0000","last_fullsized":"2024-02-21T07:46:12.528826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528139+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:12.528139+0000","last_peered":"2024-02-21T07:46:12.528139+0000","last_clean":"2024-02-21T07:46:12.528139+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:12.528139+0000","last_undegraded":"2024-02-21T07:46:12.528139+0000","last_fullsized":"2024-02-21T07:46:12.528139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525355+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:13.525355+0000","last_peered":"2024-02-21T07:46:13.525355+0000","last_clean":"2024-02-21T07:46:13.525355+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:13.525355+0000","last_undegraded":"2024-02-21T07:46:13.525355+0000","last_fullsized":"2024-02-21T07:46:13.525355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.528725+0000","last_change":"2024-02-21T07:46:13.526735+0000","last_active":"2024-02-21T07:46:12.525591+0000","last_peered":"2024-02-21T07:45:33.959775+0000","last_clean":"2024-02-21T07:45:33.959775+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:46:13.528725+0000","last_undegraded":"2024-02-21T07:46:13.528725+0000","last_fullsized":"2024-02-21T07:46:13.528725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":["6(0)","0(3)","5(1)","8(1)","10(2)"],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528620+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:12.528620+0000","last_peered":"2024-02-21T07:46:12.528620+0000","last_clean":"2024-02-21T07:46:12.528620+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:12.528620+0000","last_undegraded":"2024-02-21T07:46:12.528620+0000","last_fullsized":"2024-02-21T07:46:12.528620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539176+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:12.539176+0000","last_peered":"2024-02-21T07:46:12.539176+0000","last_clean":"2024-02-21T07:46:12.539176+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:12.539176+0000","last_undegraded":"2024-02-21T07:46:12.539176+0000","last_fullsized":"2024-02-21T07:46:12.539176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528694+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:12.528694+0000","last_peered":"2024-02-21T07:46:12.528694+0000","last_clean":"2024-02-21T07:46:12.528694+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:12.528694+0000","last_undegraded":"2024-02-21T07:46:12.528694+0000","last_fullsized":"2024-02-21T07:46:12.528694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.530284+0000","last_change":"2024-02-21T07:46:13.530284+0000","last_active":"2024-02-21T07:46:12.537102+0000","last_peered":"2024-02-21T07:45:33.960843+0000","last_clean":"2024-02-21T07:45:33.960843+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:46:13.530284+0000","last_undegraded":"2024-02-21T07:46:13.530284+0000","last_fullsized":"2024-02-21T07:46:13.530284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":["0(0)","1(2)","4(3)","9(1)","10(1)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527902+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:12.527902+0000","last_peered":"2024-02-21T07:46:12.527902+0000","last_clean":"2024-02-21T07:46:12.527902+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:12.527902+0000","last_undegraded":"2024-02-21T07:46:12.527902+0000","last_fullsized":"2024-02-21T07:46:12.527902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527995+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:12.527995+0000","last_peered":"2024-02-21T07:46:12.527995+0000","last_clean":"2024-02-21T07:46:12.527995+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:12.527995+0000","last_undegraded":"2024-02-21T07:46:12.527995+0000","last_fullsized":"2024-02-21T07:46:12.527995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528163+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:12.528163+0000","last_peered":"2024-02-21T07:46:12.528163+0000","last_clean":"2024-02-21T07:46:12.528163+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:12.528163+0000","last_undegraded":"2024-02-21T07:46:12.528163+0000","last_fullsized":"2024-02-21T07:46:12.528163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672731+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:13.672731+0000","last_peered":"2024-02-21T07:46:13.672731+0000","last_clean":"2024-02-21T07:46:13.672731+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:13.672731+0000","last_undegraded":"2024-02-21T07:46:13.672731+0000","last_fullsized":"2024-02-21T07:46:13.672731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528276+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:12.528276+0000","last_peered":"2024-02-21T07:46:12.528276+0000","last_clean":"2024-02-21T07:46:12.528276+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:12.528276+0000","last_undegraded":"2024-02-21T07:46:12.528276+0000","last_fullsized":"2024-02-21T07:46:12.528276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528398+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:12.528398+0000","last_peered":"2024-02-21T07:46:12.528398+0000","last_clean":"2024-02-21T07:46:12.528398+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:12.528398+0000","last_undegraded":"2024-02-21T07:46:12.528398+0000","last_fullsized":"2024-02-21T07:46:12.528398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.479397+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:13.479397+0000","last_peered":"2024-02-21T07:46:13.479397+0000","last_clean":"2024-02-21T07:46:13.479397+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:13.479397+0000","last_undegraded":"2024-02-21T07:46:13.479397+0000","last_fullsized":"2024-02-21T07:46:13.479397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":87,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539251+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:12.539251+0000","last_peered":"2024-02-21T07:46:12.539251+0000","last_clean":"2024-02-21T07:46:12.539251+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:12.539251+0000","last_undegraded":"2024-02-21T07:46:12.539251+0000","last_fullsized":"2024-02-21T07:46:12.539251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528689+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:12.528689+0000","last_peered":"2024-02-21T07:46:12.528689+0000","last_clean":"2024-02-21T07:46:12.528689+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:12.528689+0000","last_undegraded":"2024-02-21T07:46:12.528689+0000","last_fullsized":"2024-02-21T07:46:12.528689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539440+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:12.539440+0000","last_peered":"2024-02-21T07:46:12.539440+0000","last_clean":"2024-02-21T07:46:12.539440+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:12.539440+0000","last_undegraded":"2024-02-21T07:46:12.539440+0000","last_fullsized":"2024-02-21T07:46:12.539440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529427+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:12.529427+0000","last_peered":"2024-02-21T07:46:12.529427+0000","last_clean":"2024-02-21T07:46:12.529427+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:12.529427+0000","last_undegraded":"2024-02-21T07:46:12.529427+0000","last_fullsized":"2024-02-21T07:46:12.529427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528215+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:12.528215+0000","last_peered":"2024-02-21T07:46:12.528215+0000","last_clean":"2024-02-21T07:46:12.528215+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:12.528215+0000","last_undegraded":"2024-02-21T07:46:12.528215+0000","last_fullsized":"2024-02-21T07:46:12.528215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528712+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:12.528712+0000","last_peered":"2024-02-21T07:46:12.528712+0000","last_clean":"2024-02-21T07:46:12.528712+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:12.528712+0000","last_undegraded":"2024-02-21T07:46:12.528712+0000","last_fullsized":"2024-02-21T07:46:12.528712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528301+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:12.528301+0000","last_peered":"2024-02-21T07:46:12.528301+0000","last_clean":"2024-02-21T07:46:12.528301+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:12.528301+0000","last_undegraded":"2024-02-21T07:46:12.528301+0000","last_fullsized":"2024-02-21T07:46:12.528301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528354+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:12.528354+0000","last_peered":"2024-02-21T07:46:12.528354+0000","last_clean":"2024-02-21T07:46:12.528354+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:12.528354+0000","last_undegraded":"2024-02-21T07:46:12.528354+0000","last_fullsized":"2024-02-21T07:46:12.528354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528073+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:12.528073+0000","last_peered":"2024-02-21T07:46:12.528073+0000","last_clean":"2024-02-21T07:46:12.528073+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:12.528073+0000","last_undegraded":"2024-02-21T07:46:12.528073+0000","last_fullsized":"2024-02-21T07:46:12.528073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539184+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:12.539184+0000","last_peered":"2024-02-21T07:46:12.539184+0000","last_clean":"2024-02-21T07:46:12.539184+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:12.539184+0000","last_undegraded":"2024-02-21T07:46:12.539184+0000","last_fullsized":"2024-02-21T07:46:12.539184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.538943+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:12.538943+0000","last_peered":"2024-02-21T07:46:12.538943+0000","last_clean":"2024-02-21T07:46:12.538943+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:12.538943+0000","last_undegraded":"2024-02-21T07:46:12.538943+0000","last_fullsized":"2024-02-21T07:46:12.538943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529060+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:12.529060+0000","last_peered":"2024-02-21T07:46:12.529060+0000","last_clean":"2024-02-21T07:46:12.529060+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:12.529060+0000","last_undegraded":"2024-02-21T07:46:12.529060+0000","last_fullsized":"2024-02-21T07:46:12.529060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539524+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:12.539524+0000","last_peered":"2024-02-21T07:46:12.539524+0000","last_clean":"2024-02-21T07:46:12.539524+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:12.539524+0000","last_undegraded":"2024-02-21T07:46:12.539524+0000","last_fullsized":"2024-02-21T07:46:12.539524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528614+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:12.528614+0000","last_peered":"2024-02-21T07:46:12.528614+0000","last_clean":"2024-02-21T07:46:12.528614+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:12.528614+0000","last_undegraded":"2024-02-21T07:46:12.528614+0000","last_fullsized":"2024-02-21T07:46:12.528614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64898,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":178,"num_read_kb":157,"num_write":165,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":129796,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444045,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":148140,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":10,"up_from":17,"seq":73014444046,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":204273,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":9,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":152326,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]}]},{"osd":8,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":743192,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":143552,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444045,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":740107,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":148180,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":1,"up_from":17,"seq":73014444046,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":204045,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":0,"up_from":17,"seq":73014444046,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":60583,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60811,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:18.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:18.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.321+0000 7fb5b2200640 1 Processor -- start 2024-02-21T07:46:18.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.321+0000 7fb5b2200640 1 -- start start 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5b2200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb5ac186430 0x7fb5ac18b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5b2200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5ac0d3dc0 0x7fb5ac0d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5b2200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac18b670 con 0x7fb5ac186050 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5b2200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac18a600 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5b2200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac0d69b0 con 0x7fb5ac186430 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5aaa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb5ac186430 0x7fb5ac18b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5ab400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb5ac186050 0x7fb5ac18aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49322/0 (socket says 172.21.15.100:49322) 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5ab400640 1 -- 172.21.15.100:0/2316805175 learned_addr learned my addr 172.21.15.100:0/2316805175 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.323+0000 7fb5abe00640 1 --2- 172.21.15.100:0/2316805175 >> v2:172.21.15.100:3300/0 conn(0x7fb5ac0d3dc0 0x7fb5ac0d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.324+0000 7fb5aaa00640 1 -- 172.21.15.100:0/2316805175 >> v2:172.21.15.100:3300/0 conn(0x7fb5ac0d3dc0 msgr2=0x7fb5ac0d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.324+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2316805175 >> v2:172.21.15.100:3300/0 conn(0x7fb5ac0d3dc0 0x7fb5ac0d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.324+0000 7fb5aaa00640 1 -- 172.21.15.100:0/2316805175 >> v1:172.21.15.100:6789/0 conn(0x7fb5ac186050 legacy=0x7fb5ac18aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.324+0000 7fb5aaa00640 1 -- 172.21.15.100:0/2316805175 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0d5aa0 con 0x7fb5ac186430 2024-02-21T07:46:18.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.325+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2316805175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac186430 0x7fb5ac18b130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac067430 tx=0x7fb59802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3192da047b662e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.325+0000 7fb5aa000640 1 -- 172.21.15.100:0/2316805175 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59802e070 con 0x7fb5ac186430 2024-02-21T07:46:18.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.325+0000 7fb5aa000640 1 -- 172.21.15.100:0/2316805175 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980315a0 con 0x7fb5ac186430 2024-02-21T07:46:18.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.325+0000 7fb5aa000640 1 -- 172.21.15.100:0/2316805175 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb598031930 con 0x7fb5ac186430 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 -- 172.21.15.100:0/2316805175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac186430 msgr2=0x7fb5ac18b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2316805175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac186430 0x7fb5ac18b130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac067430 tx=0x7fb59802b840 comp rx=0 tx=0).stop 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 -- 172.21.15.100:0/2316805175 shutdown_connections 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2316805175 >> v2:172.21.15.100:3300/0 conn(0x7fb5ac0d3dc0 0x7fb5ac0d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2316805175 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac186430 0x7fb5ac18b130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 -- 172.21.15.100:0/2316805175 >> 172.21.15.100:0/2316805175 conn(0x7fb5ac0d2540 msgr2=0x7fb5ac0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 -- 172.21.15.100:0/2316805175 shutdown_connections 2024-02-21T07:46:18.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.326+0000 7fb5b2200640 1 -- 172.21.15.100:0/2316805175 wait complete. 2024-02-21T07:46:18.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.328+0000 7fb5b2200640 1 Processor -- start 2024-02-21T07:46:18.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.328+0000 7fb5b2200640 1 -- start start 2024-02-21T07:46:18.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.329+0000 7fb5b2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5b2200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5ac186050 0x7fb5ac17a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5b2200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac0f62f0 0x7fb5ac1790f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5b2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0d1610 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5b2200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac21fd20 con 0x7fb5ac186050 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5b2200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac179fe0 con 0x7fb5ac0f62f0 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54174/0 (socket says 172.21.15.100:54174) 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 -- 172.21.15.100:0/2545548543 learned_addr learned my addr 172.21.15.100:0/2545548543 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5ac186050 0x7fb5ac17a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5abe00640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac0f62f0 0x7fb5ac1790f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 -- 172.21.15.100:0/2545548543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac0f62f0 msgr2=0x7fb5ac1790f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac0f62f0 0x7fb5ac1790f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 -- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5ac186050 msgr2=0x7fb5ac17a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5ac186050 0x7fb5ac17a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.330+0000 7fb5ab400640 1 -- 172.21.15.100:0/2545548543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009400 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5ab400640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c3c0 tx=0x7fb59c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c005ce0 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c005e40 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c0072f0 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac21f480 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.331+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac21fa40 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.332+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac067c80 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.335+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb59c007510 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.336+0000 7fb5a3400640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 0x7fb58c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.336+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb59c0c94d0 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.336+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 0x7fb58c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.337+0000 7fb5aaa00640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 0x7fb58c0a15f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb598036000 tx=0x7fb59803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.338+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb59c0932b0 con 0x7fb5ac0d3dc0 2024-02-21T07:46:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.529+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5ac189f10 con 0x7fb58c09f130 2024-02-21T07:46:18.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.540+0000 7fb5a3400640 1 -- 172.21.15.100:0/2545548543 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367895 (secure 0 0 0) 0x7fb5ac189f10 con 0x7fb58c09f130 2024-02-21T07:46:18.549 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:18.554 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 msgr2=0x7fb58c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 0x7fb58c0a15f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb598036000 tx=0x7fb59803d040 comp rx=0 tx=0).stop 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 msgr2=0x7fb5ac21edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c3c0 tx=0x7fb59c00c880 comp rx=0 tx=0).stop 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 shutdown_connections 2024-02-21T07:46:18.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb5ac0f62f0 0x7fb5ac1790f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb5ac186050 0x7fb5ac17a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb58c09f130 0x7fb58c0a15f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 --2- 172.21.15.100:0/2545548543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac0d3dc0 0x7fb5ac21edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 >> 172.21.15.100:0/2545548543 conn(0x7fb5ac0d2540 msgr2=0x7fb5ac0d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 shutdown_connections 2024-02-21T07:46:18.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.548+0000 7fb5b2200640 1 -- 172.21.15.100:0/2545548543 wait complete. 2024-02-21T07:46:18.576 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-02-21T07:46:17.906727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655500,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":304,"num_read_kb":266,"num_write":348,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353240,"kb_used_data":4024,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108840,"statfs":{"total":1159641169920,"available":1159279452160,"internally_reserved":0,"allocated":4120576,"data_stored":3099724,"data_compressed":217238,"data_compressed_allocated":311296,"data_compressed_original":1589248,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002403"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539198+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:12.539198+0000","last_peered":"2024-02-21T07:46:12.539198+0000","last_clean":"2024-02-21T07:46:12.539198+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:12.539198+0000","last_undegraded":"2024-02-21T07:46:12.539198+0000","last_fullsized":"2024-02-21T07:46:12.539198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528533+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:12.528533+0000","last_peered":"2024-02-21T07:46:12.528533+0000","last_clean":"2024-02-21T07:46:12.528533+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:12.528533+0000","last_undegraded":"2024-02-21T07:46:12.528533+0000","last_fullsized":"2024-02-21T07:46:12.528533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539089+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:12.539089+0000","last_peered":"2024-02-21T07:46:12.539089+0000","last_clean":"2024-02-21T07:46:12.539089+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:12.539089+0000","last_undegraded":"2024-02-21T07:46:12.539089+0000","last_fullsized":"2024-02-21T07:46:12.539089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528969+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:12.528969+0000","last_peered":"2024-02-21T07:46:12.528969+0000","last_clean":"2024-02-21T07:46:12.528969+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:12.528969+0000","last_undegraded":"2024-02-21T07:46:12.528969+0000","last_fullsized":"2024-02-21T07:46:12.528969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528826+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:12.528826+0000","last_peered":"2024-02-21T07:46:12.528826+0000","last_clean":"2024-02-21T07:46:12.528826+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:12.528826+0000","last_undegraded":"2024-02-21T07:46:12.528826+0000","last_fullsized":"2024-02-21T07:46:12.528826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528139+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:12.528139+0000","last_peered":"2024-02-21T07:46:12.528139+0000","last_clean":"2024-02-21T07:46:12.528139+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:12.528139+0000","last_undegraded":"2024-02-21T07:46:12.528139+0000","last_fullsized":"2024-02-21T07:46:12.528139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525355+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:13.525355+0000","last_peered":"2024-02-21T07:46:13.525355+0000","last_clean":"2024-02-21T07:46:13.525355+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:13.525355+0000","last_undegraded":"2024-02-21T07:46:13.525355+0000","last_fullsized":"2024-02-21T07:46:13.525355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.528725+0000","last_change":"2024-02-21T07:46:13.526735+0000","last_active":"2024-02-21T07:46:12.525591+0000","last_peered":"2024-02-21T07:45:33.959775+0000","last_clean":"2024-02-21T07:45:33.959775+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:46:13.528725+0000","last_undegraded":"2024-02-21T07:46:13.528725+0000","last_fullsized":"2024-02-21T07:46:13.528725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":["6(0)","0(3)","5(1)","8(1)","10(2)"],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528620+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:12.528620+0000","last_peered":"2024-02-21T07:46:12.528620+0000","last_clean":"2024-02-21T07:46:12.528620+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:12.528620+0000","last_undegraded":"2024-02-21T07:46:12.528620+0000","last_fullsized":"2024-02-21T07:46:12.528620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539176+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:12.539176+0000","last_peered":"2024-02-21T07:46:12.539176+0000","last_clean":"2024-02-21T07:46:12.539176+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:12.539176+0000","last_undegraded":"2024-02-21T07:46:12.539176+0000","last_fullsized":"2024-02-21T07:46:12.539176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528694+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:12.528694+0000","last_peered":"2024-02-21T07:46:12.528694+0000","last_clean":"2024-02-21T07:46:12.528694+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:12.528694+0000","last_undegraded":"2024-02-21T07:46:12.528694+0000","last_fullsized":"2024-02-21T07:46:12.528694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.530284+0000","last_change":"2024-02-21T07:46:13.530284+0000","last_active":"2024-02-21T07:46:12.537102+0000","last_peered":"2024-02-21T07:45:33.960843+0000","last_clean":"2024-02-21T07:45:33.960843+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:46:13.530284+0000","last_undegraded":"2024-02-21T07:46:13.530284+0000","last_fullsized":"2024-02-21T07:46:13.530284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":["0(0)","1(2)","4(3)","9(1)","10(1)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527902+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:12.527902+0000","last_peered":"2024-02-21T07:46:12.527902+0000","last_clean":"2024-02-21T07:46:12.527902+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:12.527902+0000","last_undegraded":"2024-02-21T07:46:12.527902+0000","last_fullsized":"2024-02-21T07:46:12.527902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527995+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:12.527995+0000","last_peered":"2024-02-21T07:46:12.527995+0000","last_clean":"2024-02-21T07:46:12.527995+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:12.527995+0000","last_undegraded":"2024-02-21T07:46:12.527995+0000","last_fullsized":"2024-02-21T07:46:12.527995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528163+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:12.528163+0000","last_peered":"2024-02-21T07:46:12.528163+0000","last_clean":"2024-02-21T07:46:12.528163+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:12.528163+0000","last_undegraded":"2024-02-21T07:46:12.528163+0000","last_fullsized":"2024-02-21T07:46:12.528163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672731+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:13.672731+0000","last_peered":"2024-02-21T07:46:13.672731+0000","last_clean":"2024-02-21T07:46:13.672731+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:13.672731+0000","last_undegraded":"2024-02-21T07:46:13.672731+0000","last_fullsized":"2024-02-21T07:46:13.672731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528276+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:12.528276+0000","last_peered":"2024-02-21T07:46:12.528276+0000","last_clean":"2024-02-21T07:46:12.528276+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:12.528276+0000","last_undegraded":"2024-02-21T07:46:12.528276+0000","last_fullsized":"2024-02-21T07:46:12.528276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528398+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:12.528398+0000","last_peered":"2024-02-21T07:46:12.528398+0000","last_clean":"2024-02-21T07:46:12.528398+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:12.528398+0000","last_undegraded":"2024-02-21T07:46:12.528398+0000","last_fullsized":"2024-02-21T07:46:12.528398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.479397+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:13.479397+0000","last_peered":"2024-02-21T07:46:13.479397+0000","last_clean":"2024-02-21T07:46:13.479397+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:13.479397+0000","last_undegraded":"2024-02-21T07:46:13.479397+0000","last_fullsized":"2024-02-21T07:46:13.479397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":87,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539251+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:12.539251+0000","last_peered":"2024-02-21T07:46:12.539251+0000","last_clean":"2024-02-21T07:46:12.539251+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:12.539251+0000","last_undegraded":"2024-02-21T07:46:12.539251+0000","last_fullsized":"2024-02-21T07:46:12.539251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528689+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:12.528689+0000","last_peered":"2024-02-21T07:46:12.528689+0000","last_clean":"2024-02-21T07:46:12.528689+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:12.528689+0000","last_undegraded":"2024-02-21T07:46:12.528689+0000","last_fullsized":"2024-02-21T07:46:12.528689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539440+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:12.539440+0000","last_peered":"2024-02-21T07:46:12.539440+0000","last_clean":"2024-02-21T07:46:12.539440+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:12.539440+0000","last_undegraded":"2024-02-21T07:46:12.539440+0000","last_fullsized":"2024-02-21T07:46:12.539440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529427+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:12.529427+0000","last_peered":"2024-02-21T07:46:12.529427+0000","last_clean":"2024-02-21T07:46:12.529427+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:12.529427+0000","last_undegraded":"2024-02-21T07:46:12.529427+0000","last_fullsized":"2024-02-21T07:46:12.529427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528215+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:12.528215+0000","last_peered":"2024-02-21T07:46:12.528215+0000","last_clean":"2024-02-21T07:46:12.528215+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:12.528215+0000","last_undegraded":"2024-02-21T07:46:12.528215+0000","last_fullsized":"2024-02-21T07:46:12.528215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528712+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:12.528712+0000","last_peered":"2024-02-21T07:46:12.528712+0000","last_clean":"2024-02-21T07:46:12.528712+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:12.528712+0000","last_undegraded":"2024-02-21T07:46:12.528712+0000","last_fullsized":"2024-02-21T07:46:12.528712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528301+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:12.528301+0000","last_peered":"2024-02-21T07:46:12.528301+0000","last_clean":"2024-02-21T07:46:12.528301+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:12.528301+0000","last_undegraded":"2024-02-21T07:46:12.528301+0000","last_fullsized":"2024-02-21T07:46:12.528301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528354+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:12.528354+0000","last_peered":"2024-02-21T07:46:12.528354+0000","last_clean":"2024-02-21T07:46:12.528354+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:12.528354+0000","last_undegraded":"2024-02-21T07:46:12.528354+0000","last_fullsized":"2024-02-21T07:46:12.528354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528073+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:12.528073+0000","last_peered":"2024-02-21T07:46:12.528073+0000","last_clean":"2024-02-21T07:46:12.528073+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:12.528073+0000","last_undegraded":"2024-02-21T07:46:12.528073+0000","last_fullsized":"2024-02-21T07:46:12.528073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539184+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:12.539184+0000","last_peered":"2024-02-21T07:46:12.539184+0000","last_clean":"2024-02-21T07:46:12.539184+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:12.539184+0000","last_undegraded":"2024-02-21T07:46:12.539184+0000","last_fullsized":"2024-02-21T07:46:12.539184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.538943+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:12.538943+0000","last_peered":"2024-02-21T07:46:12.538943+0000","last_clean":"2024-02-21T07:46:12.538943+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:12.538943+0000","last_undegraded":"2024-02-21T07:46:12.538943+0000","last_fullsized":"2024-02-21T07:46:12.538943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529060+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:12.529060+0000","last_peered":"2024-02-21T07:46:12.529060+0000","last_clean":"2024-02-21T07:46:12.529060+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:12.529060+0000","last_undegraded":"2024-02-21T07:46:12.529060+0000","last_fullsized":"2024-02-21T07:46:12.529060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539524+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:12.539524+0000","last_peered":"2024-02-21T07:46:12.539524+0000","last_clean":"2024-02-21T07:46:12.539524+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:12.539524+0000","last_undegraded":"2024-02-21T07:46:12.539524+0000","last_fullsized":"2024-02-21T07:46:12.539524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528614+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:12.528614+0000","last_peered":"2024-02-21T07:46:12.528614+0000","last_clean":"2024-02-21T07:46:12.528614+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:12.528614+0000","last_undegraded":"2024-02-21T07:46:12.528614+0000","last_fullsized":"2024-02-21T07:46:12.528614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64898,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":178,"num_read_kb":157,"num_write":165,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":129796,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444045,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":148140,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":10,"up_from":17,"seq":73014444046,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":204273,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":9,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":152326,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]}]},{"osd":8,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":743192,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":143552,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444045,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":740107,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":148180,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":1,"up_from":17,"seq":73014444046,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":204045,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":0,"up_from":17,"seq":73014444046,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":60583,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60811,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:18.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:18.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.825+0000 7f2414200640 1 Processor -- start 2024-02-21T07:46:18.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.825+0000 7f2414200640 1 -- start start 2024-02-21T07:46:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f240c185f20 0x7f240c0f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f240c1866e0 0x7f240c186b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 0x7f240c18bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c0f9ac0 con 0x7f240c187080 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c06dc90 con 0x7f240c185f20 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.827+0000 7f2414200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c06df70 con 0x7f240c1866e0 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f240c1866e0 0x7f240c186b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f240c1866e0 0x7f240c186b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34162/0 (socket says 172.21.15.100:34162) 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 -- 172.21.15.100:0/3657149418 learned_addr learned my addr 172.21.15.100:0/3657149418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2412200640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 0x7f240c18bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2411800640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.156:3300/0 conn(0x7f240c185f20 0x7f240c0f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 -- 172.21.15.100:0/3657149418 >> v2:172.21.15.156:3300/0 conn(0x7f240c185f20 msgr2=0x7f240c0f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.156:3300/0 conn(0x7f240c185f20 0x7f240c0f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 -- 172.21.15.100:0/3657149418 >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 msgr2=0x7f240c18bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:18.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 0x7f240c18bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2410e00640 1 -- 172.21.15.100:0/3657149418 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c06e250 con 0x7f240c1866e0 2024-02-21T07:46:18.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.828+0000 7f2412200640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 0x7f240c18bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:18.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.829+0000 7f2410e00640 1 --2- 172.21.15.100:0/3657149418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c1866e0 0x7f240c186b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f240c08d3f0 tx=0x7f23f802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb20e11eeab7c3b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f240be00640 1 -- 172.21.15.100:0/3657149418 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8031760 con 0x7f240c1866e0 2024-02-21T07:46:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f240be00640 1 -- 172.21.15.100:0/3657149418 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f80318c0 con 0x7f240c1866e0 2024-02-21T07:46:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f240be00640 1 -- 172.21.15.100:0/3657149418 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8031c50 con 0x7f240c1866e0 2024-02-21T07:46:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 -- 172.21.15.100:0/3657149418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c1866e0 msgr2=0x7f240c186b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 --2- 172.21.15.100:0/3657149418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c1866e0 0x7f240c186b40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f240c08d3f0 tx=0x7f23f802b800 comp rx=0 tx=0).stop 2024-02-21T07:46:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 -- 172.21.15.100:0/3657149418 shutdown_connections 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.100:3300/0 conn(0x7f240c187080 0x7f240c18bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 --2- 172.21.15.100:0/3657149418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c1866e0 0x7f240c186b40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 --2- 172.21.15.100:0/3657149418 >> v2:172.21.15.156:3300/0 conn(0x7f240c185f20 0x7f240c0f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.830+0000 7f2414200640 1 -- 172.21.15.100:0/3657149418 >> 172.21.15.100:0/3657149418 conn(0x7f240c0ce160 msgr2=0x7f240c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.831+0000 7f2414200640 1 -- 172.21.15.100:0/3657149418 shutdown_connections 2024-02-21T07:46:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.831+0000 7f2414200640 1 -- 172.21.15.100:0/3657149418 wait complete. 2024-02-21T07:46:18.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.832+0000 7f2414200640 1 Processor -- start 2024-02-21T07:46:18.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.833+0000 7f2414200640 1 -- start start 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f240c185f20 0x7f240c179410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c187080 0x7f240c21daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0d0e00 con 0x7f240c1866e0 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c21c870 con 0x7f240c185f20 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2414200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0d0840 con 0x7f240c187080 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2410e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2410e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54204/0 (socket says 172.21.15.100:54204) 2024-02-21T07:46:18.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2410e00640 1 -- 172.21.15.100:0/458666216 learned_addr learned my addr 172.21.15.100:0/458666216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2412200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c187080 0x7f240c21daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.834+0000 7f2411800640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f240c185f20 0x7f240c179410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 -- 172.21.15.100:0/458666216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c187080 msgr2=0x7f240c21daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c187080 0x7f240c21daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 -- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f240c185f20 msgr2=0x7f240c179410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f240c185f20 0x7f240c179410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:18.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 -- 172.21.15.100:0/458666216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80094d0 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2410e00640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23f802b840 tx=0x7f23f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f803b800 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f803b960 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f803bd10 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c0d0b20 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.835+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c21cd60 con 0x7f240c1866e0 2024-02-21T07:46:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.837+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c0f7860 con 0x7f240c1866e0 2024-02-21T07:46:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.839+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f23f804e450 con 0x7f240c1866e0 2024-02-21T07:46:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.840+0000 7f2409600640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 0x7f23ec0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.840+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f23f802f050 con 0x7f240c1866e0 2024-02-21T07:46:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.840+0000 7f2411800640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 0x7f23ec0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.841+0000 7f2411800640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 0x7f23ec0a15f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2400003610 tx=0x7f2400008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:18.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:18.844+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23f80b5690 con 0x7f240c1866e0 2024-02-21T07:46:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.038+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f240c071050 con 0x7f23ec09f130 2024-02-21T07:46:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.049+0000 7f2409600640 1 -- 172.21.15.100:0/458666216 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367895 (secure 0 0 0) 0x7f240c071050 con 0x7f23ec09f130 2024-02-21T07:46:19.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:19.063 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:19.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 msgr2=0x7f23ec0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 0x7f23ec0a15f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2400003610 tx=0x7f2400008040 comp rx=0 tx=0).stop 2024-02-21T07:46:19.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 msgr2=0x7f240c21d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23f802b840 tx=0x7f23f80046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 shutdown_connections 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f240c187080 0x7f240c21daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f23ec09f130 0x7f23ec0a15f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f240c1866e0 0x7f240c21d560 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 --2- 172.21.15.100:0/458666216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f240c185f20 0x7f240c179410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 >> 172.21.15.100:0/458666216 conn(0x7f240c0ce160 msgr2=0x7f240c0f5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 shutdown_connections 2024-02-21T07:46:19.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.057+0000 7f2414200640 1 -- 172.21.15.100:0/458666216 wait complete. 2024-02-21T07:46:19.084 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2024-02-21T07:46:17.906727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655500,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":304,"num_read_kb":266,"num_write":348,"num_write_kb":3056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353240,"kb_used_data":4024,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108840,"statfs":{"total":1159641169920,"available":1159279452160,"internally_reserved":0,"allocated":4120576,"data_stored":3099724,"data_compressed":217238,"data_compressed_allocated":311296,"data_compressed_original":1589248,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":620,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002403"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539198+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:12.539198+0000","last_peered":"2024-02-21T07:46:12.539198+0000","last_clean":"2024-02-21T07:46:12.539198+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:12.539198+0000","last_undegraded":"2024-02-21T07:46:12.539198+0000","last_fullsized":"2024-02-21T07:46:12.539198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528533+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:12.528533+0000","last_peered":"2024-02-21T07:46:12.528533+0000","last_clean":"2024-02-21T07:46:12.528533+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:12.528533+0000","last_undegraded":"2024-02-21T07:46:12.528533+0000","last_fullsized":"2024-02-21T07:46:12.528533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539089+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:12.539089+0000","last_peered":"2024-02-21T07:46:12.539089+0000","last_clean":"2024-02-21T07:46:12.539089+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:12.539089+0000","last_undegraded":"2024-02-21T07:46:12.539089+0000","last_fullsized":"2024-02-21T07:46:12.539089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528969+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:12.528969+0000","last_peered":"2024-02-21T07:46:12.528969+0000","last_clean":"2024-02-21T07:46:12.528969+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:12.528969+0000","last_undegraded":"2024-02-21T07:46:12.528969+0000","last_fullsized":"2024-02-21T07:46:12.528969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528826+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:12.528826+0000","last_peered":"2024-02-21T07:46:12.528826+0000","last_clean":"2024-02-21T07:46:12.528826+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:12.528826+0000","last_undegraded":"2024-02-21T07:46:12.528826+0000","last_fullsized":"2024-02-21T07:46:12.528826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528139+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:12.528139+0000","last_peered":"2024-02-21T07:46:12.528139+0000","last_clean":"2024-02-21T07:46:12.528139+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:12.528139+0000","last_undegraded":"2024-02-21T07:46:12.528139+0000","last_fullsized":"2024-02-21T07:46:12.528139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525355+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:13.525355+0000","last_peered":"2024-02-21T07:46:13.525355+0000","last_clean":"2024-02-21T07:46:13.525355+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:13.525355+0000","last_undegraded":"2024-02-21T07:46:13.525355+0000","last_fullsized":"2024-02-21T07:46:13.525355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.528725+0000","last_change":"2024-02-21T07:46:13.526735+0000","last_active":"2024-02-21T07:46:12.525591+0000","last_peered":"2024-02-21T07:45:33.959775+0000","last_clean":"2024-02-21T07:45:33.959775+0000","last_became_active":"2024-02-21T07:45:30.575903+0000","last_became_peered":"2024-02-21T07:45:30.575903+0000","last_unstale":"2024-02-21T07:46:13.528725+0000","last_undegraded":"2024-02-21T07:46:13.528725+0000","last_fullsized":"2024-02-21T07:46:13.528725+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":["6(0)","0(3)","5(1)","8(1)","10(2)"],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528620+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:12.528620+0000","last_peered":"2024-02-21T07:46:12.528620+0000","last_clean":"2024-02-21T07:46:12.528620+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:12.528620+0000","last_undegraded":"2024-02-21T07:46:12.528620+0000","last_fullsized":"2024-02-21T07:46:12.528620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539176+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:12.539176+0000","last_peered":"2024-02-21T07:46:12.539176+0000","last_clean":"2024-02-21T07:46:12.539176+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:12.539176+0000","last_undegraded":"2024-02-21T07:46:12.539176+0000","last_fullsized":"2024-02-21T07:46:12.539176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528694+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:12.528694+0000","last_peered":"2024-02-21T07:46:12.528694+0000","last_clean":"2024-02-21T07:46:12.528694+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:12.528694+0000","last_undegraded":"2024-02-21T07:46:12.528694+0000","last_fullsized":"2024-02-21T07:46:12.528694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"activating","last_fresh":"2024-02-21T07:46:13.530284+0000","last_change":"2024-02-21T07:46:13.530284+0000","last_active":"2024-02-21T07:46:12.537102+0000","last_peered":"2024-02-21T07:45:33.960843+0000","last_clean":"2024-02-21T07:45:33.960843+0000","last_became_active":"2024-02-21T07:45:30.321402+0000","last_became_peered":"2024-02-21T07:45:30.321402+0000","last_unstale":"2024-02-21T07:46:13.530284+0000","last_undegraded":"2024-02-21T07:46:13.530284+0000","last_fullsized":"2024-02-21T07:46:13.530284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":["0(0)","1(2)","4(3)","9(1)","10(1)"],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527902+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:12.527902+0000","last_peered":"2024-02-21T07:46:12.527902+0000","last_clean":"2024-02-21T07:46:12.527902+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:12.527902+0000","last_undegraded":"2024-02-21T07:46:12.527902+0000","last_fullsized":"2024-02-21T07:46:12.527902+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.527995+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:12.527995+0000","last_peered":"2024-02-21T07:46:12.527995+0000","last_clean":"2024-02-21T07:46:12.527995+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:12.527995+0000","last_undegraded":"2024-02-21T07:46:12.527995+0000","last_fullsized":"2024-02-21T07:46:12.527995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528163+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:12.528163+0000","last_peered":"2024-02-21T07:46:12.528163+0000","last_clean":"2024-02-21T07:46:12.528163+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:12.528163+0000","last_undegraded":"2024-02-21T07:46:12.528163+0000","last_fullsized":"2024-02-21T07:46:12.528163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672731+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:13.672731+0000","last_peered":"2024-02-21T07:46:13.672731+0000","last_clean":"2024-02-21T07:46:13.672731+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:13.672731+0000","last_undegraded":"2024-02-21T07:46:13.672731+0000","last_fullsized":"2024-02-21T07:46:13.672731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528276+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:12.528276+0000","last_peered":"2024-02-21T07:46:12.528276+0000","last_clean":"2024-02-21T07:46:12.528276+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:12.528276+0000","last_undegraded":"2024-02-21T07:46:12.528276+0000","last_fullsized":"2024-02-21T07:46:12.528276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528398+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:12.528398+0000","last_peered":"2024-02-21T07:46:12.528398+0000","last_clean":"2024-02-21T07:46:12.528398+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:12.528398+0000","last_undegraded":"2024-02-21T07:46:12.528398+0000","last_fullsized":"2024-02-21T07:46:12.528398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"28'33","reported_seq":115,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.479397+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:13.479397+0000","last_peered":"2024-02-21T07:46:13.479397+0000","last_clean":"2024-02-21T07:46:13.479397+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:13.479397+0000","last_undegraded":"2024-02-21T07:46:13.479397+0000","last_fullsized":"2024-02-21T07:46:13.479397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":58,"num_read_kb":87,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539251+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:12.539251+0000","last_peered":"2024-02-21T07:46:12.539251+0000","last_clean":"2024-02-21T07:46:12.539251+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:12.539251+0000","last_undegraded":"2024-02-21T07:46:12.539251+0000","last_fullsized":"2024-02-21T07:46:12.539251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528689+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:12.528689+0000","last_peered":"2024-02-21T07:46:12.528689+0000","last_clean":"2024-02-21T07:46:12.528689+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:12.528689+0000","last_undegraded":"2024-02-21T07:46:12.528689+0000","last_fullsized":"2024-02-21T07:46:12.528689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539440+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:12.539440+0000","last_peered":"2024-02-21T07:46:12.539440+0000","last_clean":"2024-02-21T07:46:12.539440+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:12.539440+0000","last_undegraded":"2024-02-21T07:46:12.539440+0000","last_fullsized":"2024-02-21T07:46:12.539440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529427+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:12.529427+0000","last_peered":"2024-02-21T07:46:12.529427+0000","last_clean":"2024-02-21T07:46:12.529427+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:12.529427+0000","last_undegraded":"2024-02-21T07:46:12.529427+0000","last_fullsized":"2024-02-21T07:46:12.529427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528215+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:12.528215+0000","last_peered":"2024-02-21T07:46:12.528215+0000","last_clean":"2024-02-21T07:46:12.528215+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:12.528215+0000","last_undegraded":"2024-02-21T07:46:12.528215+0000","last_fullsized":"2024-02-21T07:46:12.528215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528712+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:12.528712+0000","last_peered":"2024-02-21T07:46:12.528712+0000","last_clean":"2024-02-21T07:46:12.528712+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:12.528712+0000","last_undegraded":"2024-02-21T07:46:12.528712+0000","last_fullsized":"2024-02-21T07:46:12.528712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528301+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:12.528301+0000","last_peered":"2024-02-21T07:46:12.528301+0000","last_clean":"2024-02-21T07:46:12.528301+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:12.528301+0000","last_undegraded":"2024-02-21T07:46:12.528301+0000","last_fullsized":"2024-02-21T07:46:12.528301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528354+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:12.528354+0000","last_peered":"2024-02-21T07:46:12.528354+0000","last_clean":"2024-02-21T07:46:12.528354+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:12.528354+0000","last_undegraded":"2024-02-21T07:46:12.528354+0000","last_fullsized":"2024-02-21T07:46:12.528354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528073+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:12.528073+0000","last_peered":"2024-02-21T07:46:12.528073+0000","last_clean":"2024-02-21T07:46:12.528073+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:12.528073+0000","last_undegraded":"2024-02-21T07:46:12.528073+0000","last_fullsized":"2024-02-21T07:46:12.528073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539184+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:12.539184+0000","last_peered":"2024-02-21T07:46:12.539184+0000","last_clean":"2024-02-21T07:46:12.539184+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:12.539184+0000","last_undegraded":"2024-02-21T07:46:12.539184+0000","last_fullsized":"2024-02-21T07:46:12.539184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.538943+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:12.538943+0000","last_peered":"2024-02-21T07:46:12.538943+0000","last_clean":"2024-02-21T07:46:12.538943+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:12.538943+0000","last_undegraded":"2024-02-21T07:46:12.538943+0000","last_fullsized":"2024-02-21T07:46:12.538943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.529060+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:12.529060+0000","last_peered":"2024-02-21T07:46:12.529060+0000","last_clean":"2024-02-21T07:46:12.529060+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:12.529060+0000","last_undegraded":"2024-02-21T07:46:12.529060+0000","last_fullsized":"2024-02-21T07:46:12.529060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.539524+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:12.539524+0000","last_peered":"2024-02-21T07:46:12.539524+0000","last_clean":"2024-02-21T07:46:12.539524+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:12.539524+0000","last_undegraded":"2024-02-21T07:46:12.539524+0000","last_fullsized":"2024-02-21T07:46:12.539524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:46:12.528614+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:12.528614+0000","last_peered":"2024-02-21T07:46:12.528614+0000","last_clean":"2024-02-21T07:46:12.528614+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:12.528614+0000","last_undegraded":"2024-02-21T07:46:12.528614+0000","last_fullsized":"2024-02-21T07:46:12.528614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64898,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":178,"num_read_kb":157,"num_write":165,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":129796,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444045,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":148140,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":10,"up_from":17,"seq":73014444046,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":204273,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":9,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":152326,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.704}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.637}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.839}]}]},{"osd":8,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":385024,"data_stored":743192,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":6,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":143552,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6839999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444045,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":401408,"data_stored":740107,"data_compressed":44777,"data_compressed_allocated":61440,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":315392,"data_stored":148180,"data_compressed":11255,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":17,"seq":73014444046,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]}]},{"osd":1,"up_from":17,"seq":73014444046,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":368640,"data_stored":204045,"data_compressed":13148,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]},{"osd":0,"up_from":17,"seq":73014444046,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":60583,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60811,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:19.090 INFO:tasks.fwd_scrub.ceph_manager:PG 4.7 is not active+clean 2024-02-21T07:46:19.091 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 19, 'reported_epoch': 30, 'state': 'activating', 'last_fresh': '2024-02-21T07:46:13.528725+0000', 'last_change': '2024-02-21T07:46:13.526735+0000', 'last_active': '2024-02-21T07:46:12.525591+0000', 'last_peered': '2024-02-21T07:45:33.959775+0000', 'last_clean': '2024-02-21T07:45:33.959775+0000', 'last_became_active': '2024-02-21T07:45:30.575903+0000', 'last_became_peered': '2024-02-21T07:45:30.575903+0000', 'last_unstale': '2024-02-21T07:46:13.528725+0000', 'last_undegraded': '2024-02-21T07:46:13.528725+0000', 'last_fullsized': '2024-02-21T07:46:13.528725+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 27, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'last_clean_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 8, 10, 0], 'acting': [6, 8, 10, 0], 'avail_no_missing': ['6(0)', '0(3)', '5(1)', '8(1)', '10(2)'], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-02-21T07:46:19.091 INFO:tasks.fwd_scrub.ceph_manager:PG 4.b is not active+clean 2024-02-21T07:46:19.091 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 18, 'reported_epoch': 30, 'state': 'activating', 'last_fresh': '2024-02-21T07:46:13.530284+0000', 'last_change': '2024-02-21T07:46:13.530284+0000', 'last_active': '2024-02-21T07:46:12.537102+0000', 'last_peered': '2024-02-21T07:45:33.960843+0000', 'last_clean': '2024-02-21T07:45:33.960843+0000', 'last_became_active': '2024-02-21T07:45:30.321402+0000', 'last_became_peered': '2024-02-21T07:45:30.321402+0000', 'last_unstale': '2024-02-21T07:46:13.530284+0000', 'last_undegraded': '2024-02-21T07:46:13.530284+0000', 'last_fullsized': '2024-02-21T07:46:13.530284+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 26, 'last_epoch_clean': 27, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'last_clean_scrub_stamp': '2024-02-21T07:45:29.283349+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 10, 1, 4], 'acting': [0, 10, 1, 4], 'avail_no_missing': ['0(0)', '1(2)', '4(3)', '9(1)', '10(1)'], 'object_location_counts': [], 'blocked_by': [1, 2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-02-21T07:46:19.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-02-21T07:46:19.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.331+0000 7f9a4a000640 1 Processor -- start 2024-02-21T07:46:19.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.331+0000 7f9a4a000640 1 -- start start 2024-02-21T07:46:19.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a4a000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9a44185f20 0x7f9a440f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a4a000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a440f9ac0 con 0x7f9a44188770 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a4a000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4406dc90 con 0x7f9a441866e0 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a4a000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4406df70 con 0x7f9a44185f20 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a43e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9a44188770 0x7f9a44188c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49334/0 (socket says 172.21.15.100:49334) 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a43e00640 1 -- 172.21.15.100:0/3373256472 learned_addr learned my addr 172.21.15.100:0/3373256472 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.333+0000 7f9a43400640 1 --2- 172.21.15.100:0/3373256472 >> v2:172.21.15.156:3300/0 conn(0x7f9a44185f20 0x7f9a440f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.334+0000 7f9a42a00640 1 -- 172.21.15.100:0/3373256472 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900081903 0 0) 0x7f9a3c001490 con 0x7f9a44188770 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.334+0000 7f9a43400640 1 -- 172.21.15.100:0/3373256472 >> v1:172.21.15.170:6789/0 conn(0x7f9a441866e0 legacy=0x7f9a44186b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.334+0000 7f9a43400640 1 -- 172.21.15.100:0/3373256472 >> v1:172.21.15.100:6789/0 conn(0x7f9a44188770 legacy=0x7f9a44188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.334+0000 7f9a43400640 1 -- 172.21.15.100:0/3373256472 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4406e250 con 0x7f9a44185f20 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.335+0000 7f9a43400640 1 --2- 172.21.15.100:0/3373256472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a440f9580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009720 tx=0x7f9a3402b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe185c976a702111 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.335+0000 7f9a42a00640 1 -- 172.21.15.100:0/3373256472 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3402bea0 con 0x7f9a44185f20 2024-02-21T07:46:19.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.335+0000 7f9a42a00640 1 -- 172.21.15.100:0/3373256472 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3402e050 con 0x7f9a44185f20 2024-02-21T07:46:19.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.335+0000 7f9a42a00640 1 -- 172.21.15.100:0/3373256472 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a34030930 con 0x7f9a44185f20 2024-02-21T07:46:19.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 -- 172.21.15.100:0/3373256472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 msgr2=0x7f9a440f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 --2- 172.21.15.100:0/3373256472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a440f9580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009720 tx=0x7f9a3402b620 comp rx=0 tx=0).stop 2024-02-21T07:46:19.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 -- 172.21.15.100:0/3373256472 shutdown_connections 2024-02-21T07:46:19.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 --2- 172.21.15.100:0/3373256472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a440f9580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 -- 172.21.15.100:0/3373256472 >> 172.21.15.100:0/3373256472 conn(0x7f9a440ce160 msgr2=0x7f9a440ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:19.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 -- 172.21.15.100:0/3373256472 shutdown_connections 2024-02-21T07:46:19.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.336+0000 7f9a4a000640 1 -- 172.21.15.100:0/3373256472 wait complete. 2024-02-21T07:46:19.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.338+0000 7f9a4a000640 1 Processor -- start 2024-02-21T07:46:19.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.338+0000 7f9a4a000640 1 -- start start 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a4421fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a44188770 0x7f9a4417a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44178f60 con 0x7f9a441866e0 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44179240 con 0x7f9a44185f20 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a4a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a44179520 con 0x7f9a44188770 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a3aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a3aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54220/0 (socket says 172.21.15.100:54220) 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a3aa00640 1 -- 172.21.15.100:0/2020330492 learned_addr learned my addr 172.21.15.100:0/2020330492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a43400640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a4421fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.339+0000 7f9a43e00640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a44188770 0x7f9a4417a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 -- 172.21.15.100:0/2020330492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a44188770 msgr2=0x7f9a4417a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a44188770 0x7f9a4417a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 -- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 msgr2=0x7f9a4421fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a4421fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 -- 172.21.15.100:0/2020330492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009400 con 0x7f9a441866e0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a43400640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a4421fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3aa00640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c750 tx=0x7f9a2c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c005270 con 0x7f9a441866e0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0053f0 con 0x7f9a441866e0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00a880 con 0x7f9a441866e0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a44179800 con 0x7f9a441866e0 2024-02-21T07:46:19.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.340+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a44179dc0 con 0x7f9a441866e0 2024-02-21T07:46:19.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.341+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a44067c80 con 0x7f9a441866e0 2024-02-21T07:46:19.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.343+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9a2c00a9e0 con 0x7f9a441866e0 2024-02-21T07:46:19.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.345+0000 7f9a3be00640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 0x7f9a200a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.346+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9a2c0c9730 con 0x7f9a441866e0 2024-02-21T07:46:19.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.346+0000 7f9a43400640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 0x7f9a200a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.346+0000 7f9a43400640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 0x7f9a200a15f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a34034000 tx=0x7f9a34008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.350+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a2c0934f0 con 0x7f9a441866e0 2024-02-21T07:46:19.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.615+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9a4406fe90 con 0x7f9a441866e0 2024-02-21T07:46:19.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.616+0000 7f9a3be00640 1 -- 172.21.15.100:0/2020330492 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+4667 (secure 0 0 0) 0x7f9a2c096bb0 con 0x7f9a441866e0 2024-02-21T07:46:19.623 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:19.623 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":30,"num_osds":12,"num_up_osds":12,"osd_up_since":1708501518,"num_in_osds":12,"osd_in_since":1708501511,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":127},{"state_name":"activating","count":2}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":655500,"bytes_used":361717760,"bytes_avail":1159279452160,"bytes_total":1159641169920,"inactive_pgs_ratio":0.015503875911235809,"read_bytes_sec":2175,"write_bytes_sec":511,"read_op_per_sec":3,"write_op_per_sec":0},"fsmap":{"epoch":15,"id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"i","status":"up:standby-replay","gid":4333},{"filesystem_id":1,"rank":1,"name":"l","status":"up:standby-replay","gid":4334},{"filesystem_id":1,"rank":0,"name":"g","status":"up:standby-replay","gid":4345},{"filesystem_id":1,"rank":2,"name":"d","status":"up:active","gid":4349},{"filesystem_id":1,"rank":1,"name":"j","status":"up:active","gid":4352},{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4354}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-02-21T07:46:15.906339+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"j":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"k":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"l":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"10":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"11":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"8":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"9":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-02-21T07:46:19.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.618+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 msgr2=0x7f9a200a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.618+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 0x7f9a200a15f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a34034000 tx=0x7f9a34008030 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 msgr2=0x7f9a4416f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c750 tx=0x7f9a2c00cc10 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 shutdown_connections 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9a44188770 0x7f9a4417a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9a2009f130 0x7f9a200a15f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a441866e0 0x7f9a4416f220 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 --2- 172.21.15.100:0/2020330492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a44185f20 0x7f9a4421fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 >> 172.21.15.100:0/2020330492 conn(0x7f9a440ce160 msgr2=0x7f9a44189d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 shutdown_connections 2024-02-21T07:46:19.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.619+0000 7f9a4a000640 1 -- 172.21.15.100:0/2020330492 wait complete. 2024-02-21T07:46:19.644 INFO:tasks.fwd_scrub.ceph_manager:no progress seen, keeping timeout for now 2024-02-21T07:46:19.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:19.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.836+0000 7f9db9a00640 1 Processor -- start 2024-02-21T07:46:19.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.836+0000 7f9db9a00640 1 -- start start 2024-02-21T07:46:19.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.838+0000 7f9db9a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 0x7f9db418c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.838+0000 7f9db9a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9db418b630 0x7f9db4188610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.838+0000 7f9db9a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db4186580 con 0x7f9db418c820 2024-02-21T07:46:19.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.838+0000 7f9db9a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db4189ba0 con 0x7f9db418b630 2024-02-21T07:46:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.838+0000 7f9db9a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db4189e80 con 0x7f9db4185e40 2024-02-21T07:46:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db3e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 0x7f9db418c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db9000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9db418b630 0x7f9db4188610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db3400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9db418c820 0x7f9db418af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:51568/0 (socket says 172.21.15.100:51568) 2024-02-21T07:46:19.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db3400640 1 -- 172.21.15.100:0/3329011130 learned_addr learned my addr 172.21.15.100:0/3329011130 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db2a00640 1 -- 172.21.15.100:0/3329011130 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551987529 0 0) 0x7f9db4186580 con 0x7f9db418c820 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db2a00640 1 -- 172.21.15.100:0/3329011130 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d98003520 con 0x7f9db418c820 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db9000640 1 -- 172.21.15.100:0/3329011130 >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 msgr2=0x7f9db418c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db9000640 1 --2- 172.21.15.100:0/3329011130 >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 0x7f9db418c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db9000640 1 -- 172.21.15.100:0/3329011130 >> v1:172.21.15.156:6789/0 conn(0x7f9db418c820 legacy=0x7f9db418af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db9000640 1 -- 172.21.15.100:0/3329011130 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db418a160 con 0x7f9db418b630 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.839+0000 7f9db3e00640 1 --2- 172.21.15.100:0/3329011130 >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 0x7f9db418c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:19.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.840+0000 7f9db9000640 1 --2- 172.21.15.100:0/3329011130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418b630 0x7f9db4188610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9db408f8a0 tx=0x7f9dac02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce8967f803f70b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db2a00640 1 -- 172.21.15.100:0/3329011130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac02cb50 con 0x7f9db418b630 2024-02-21T07:46:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db2a00640 1 -- 172.21.15.100:0/3329011130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac02ccb0 con 0x7f9db418b630 2024-02-21T07:46:19.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db2a00640 1 -- 172.21.15.100:0/3329011130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac034640 con 0x7f9db418b630 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 -- 172.21.15.100:0/3329011130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418b630 msgr2=0x7f9db4188610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 --2- 172.21.15.100:0/3329011130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418b630 0x7f9db4188610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9db408f8a0 tx=0x7f9dac02bda0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 -- 172.21.15.100:0/3329011130 shutdown_connections 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 --2- 172.21.15.100:0/3329011130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418b630 0x7f9db4188610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 --2- 172.21.15.100:0/3329011130 >> v2:172.21.15.156:3300/0 conn(0x7f9db4185e40 0x7f9db418c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 -- 172.21.15.100:0/3329011130 >> 172.21.15.100:0/3329011130 conn(0x7f9db40d0130 msgr2=0x7f9db40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 -- 172.21.15.100:0/3329011130 shutdown_connections 2024-02-21T07:46:19.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.841+0000 7f9db9a00640 1 -- 172.21.15.100:0/3329011130 wait complete. 2024-02-21T07:46:19.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.843+0000 7f9db9a00640 1 Processor -- start 2024-02-21T07:46:19.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.843+0000 7f9db9a00640 1 -- start start 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9db418b630 0x7f9db4179a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 0x7f9db4171d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db40cbb20 con 0x7f9db418c820 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db4179f60 con 0x7f9db4185e40 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db421fc80 con 0x7f9db418b630 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9db418b630 0x7f9db4179a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 0x7f9db4171d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36616/0 (socket says 172.21.15.100:36616) 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 -- 172.21.15.100:0/2545335906 learned_addr learned my addr 172.21.15.100:0/2545335906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 -- 172.21.15.100:0/2545335906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9db418b630 msgr2=0x7f9db4179a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9db418b630 0x7f9db4179a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 -- 172.21.15.100:0/2545335906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 msgr2=0x7f9db4171d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 0x7f9db4171d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db3e00640 1 -- 172.21.15.100:0/2545335906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da4009400 con 0x7f9db4185e40 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.845+0000 7f9db9000640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 0x7f9db4171d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:19.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9db3e00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9da400e960 tx=0x7f9da400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400ca00 con 0x7f9db4185e40 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac009a70 con 0x7f9db4185e40 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400cb60 con 0x7f9db4185e40 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4013470 con 0x7f9db4185e40 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.846+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db417a180 con 0x7f9db4185e40 2024-02-21T07:46:19.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.847+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db4075160 con 0x7f9db4185e40 2024-02-21T07:46:19.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.849+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9da40135d0 con 0x7f9db4185e40 2024-02-21T07:46:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.850+0000 7f9dabe00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 0x7f9d940a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.851+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9da40c9dc0 con 0x7f9db4185e40 2024-02-21T07:46:19.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.851+0000 7f9db3400640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 0x7f9d940a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:19.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.851+0000 7f9db3400640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 0x7f9d940a1570 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db41824c0 tx=0x7f9da0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:19.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:19.855+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9da4093ba0 con 0x7f9db4185e40 2024-02-21T07:46:20.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.045+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9db40ef3a0 con 0x7f9d9409f0b0 2024-02-21T07:46:20.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.055+0000 7f9dabe00640 1 -- 172.21.15.100:0/2545335906 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368027 (secure 0 0 0) 0x7f9db40ef3a0 con 0x7f9d9409f0b0 2024-02-21T07:46:20.067 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:20.069 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 msgr2=0x7f9d940a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 0x7f9d940a1570 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9db41824c0 tx=0x7f9da0009040 comp rx=0 tx=0).stop 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 msgr2=0x7f9db40cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9da400e960 tx=0x7f9da400ee20 comp rx=0 tx=0).stop 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 shutdown_connections 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9d9409f0b0 0x7f9d940a1570 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9db418c820 0x7f9db4171d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:20.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9db418b630 0x7f9db4179a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 --2- 172.21.15.100:0/2545335906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9db4185e40 0x7f9db40cb5e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 >> 172.21.15.100:0/2545335906 conn(0x7f9db40d0130 msgr2=0x7f9db4185000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 shutdown_connections 2024-02-21T07:46:20.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:20.061+0000 7f9db9a00640 1 -- 172.21.15.100:0/2545335906 wait complete. 2024-02-21T07:46:20.087 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-02-21T07:46:19.907329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659814,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":335,"num_read_kb":286,"num_write":350,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353352,"kb_used_data":4128,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108728,"statfs":{"total":1159641169920,"available":1159279337472,"internally_reserved":0,"allocated":4227072,"data_stored":3178112,"data_compressed":239934,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4934,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":37,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002278"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408490+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:14.408490+0000","last_peered":"2024-02-21T07:46:14.408490+0000","last_clean":"2024-02-21T07:46:14.408490+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:14.408490+0000","last_undegraded":"2024-02-21T07:46:14.408490+0000","last_fullsized":"2024-02-21T07:46:14.408490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408204+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:14.408204+0000","last_peered":"2024-02-21T07:46:14.408204+0000","last_clean":"2024-02-21T07:46:14.408204+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:14.408204+0000","last_undegraded":"2024-02-21T07:46:14.408204+0000","last_fullsized":"2024-02-21T07:46:14.408204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408432+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:14.408432+0000","last_peered":"2024-02-21T07:46:14.408432+0000","last_clean":"2024-02-21T07:46:14.408432+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:14.408432+0000","last_undegraded":"2024-02-21T07:46:14.408432+0000","last_fullsized":"2024-02-21T07:46:14.408432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305340+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:14.305340+0000","last_peered":"2024-02-21T07:46:14.305340+0000","last_clean":"2024-02-21T07:46:14.305340+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:14.305340+0000","last_undegraded":"2024-02-21T07:46:14.305340+0000","last_fullsized":"2024-02-21T07:46:14.305340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305355+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:14.305355+0000","last_peered":"2024-02-21T07:46:14.305355+0000","last_clean":"2024-02-21T07:46:14.305355+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:14.305355+0000","last_undegraded":"2024-02-21T07:46:14.305355+0000","last_fullsized":"2024-02-21T07:46:14.305355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408124+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:14.408124+0000","last_peered":"2024-02-21T07:46:14.408124+0000","last_clean":"2024-02-21T07:46:14.408124+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:14.408124+0000","last_undegraded":"2024-02-21T07:46:14.408124+0000","last_fullsized":"2024-02-21T07:46:14.408124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477095+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:17.477095+0000","last_peered":"2024-02-21T07:46:17.477095+0000","last_clean":"2024-02-21T07:46:17.477095+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:17.477095+0000","last_undegraded":"2024-02-21T07:46:17.477095+0000","last_fullsized":"2024-02-21T07:46:17.477095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.308347+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:46:14.308347+0000","last_peered":"2024-02-21T07:46:14.308347+0000","last_clean":"2024-02-21T07:46:14.308347+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:46:14.308347+0000","last_undegraded":"2024-02-21T07:46:14.308347+0000","last_fullsized":"2024-02-21T07:46:14.308347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409068+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:14.409068+0000","last_peered":"2024-02-21T07:46:14.409068+0000","last_clean":"2024-02-21T07:46:14.409068+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:14.409068+0000","last_undegraded":"2024-02-21T07:46:14.409068+0000","last_fullsized":"2024-02-21T07:46:14.409068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408331+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:14.408331+0000","last_peered":"2024-02-21T07:46:14.408331+0000","last_clean":"2024-02-21T07:46:14.408331+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:14.408331+0000","last_undegraded":"2024-02-21T07:46:14.408331+0000","last_fullsized":"2024-02-21T07:46:14.408331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409044+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:14.409044+0000","last_peered":"2024-02-21T07:46:14.409044+0000","last_clean":"2024-02-21T07:46:14.409044+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:14.409044+0000","last_undegraded":"2024-02-21T07:46:14.409044+0000","last_fullsized":"2024-02-21T07:46:14.409044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.410441+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:46:14.410441+0000","last_peered":"2024-02-21T07:46:14.410441+0000","last_clean":"2024-02-21T07:46:14.410441+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:46:14.410441+0000","last_undegraded":"2024-02-21T07:46:14.410441+0000","last_fullsized":"2024-02-21T07:46:14.410441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408897+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:14.408897+0000","last_peered":"2024-02-21T07:46:14.408897+0000","last_clean":"2024-02-21T07:46:14.408897+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:14.408897+0000","last_undegraded":"2024-02-21T07:46:14.408897+0000","last_fullsized":"2024-02-21T07:46:14.408897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408478+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:14.408478+0000","last_peered":"2024-02-21T07:46:14.408478+0000","last_clean":"2024-02-21T07:46:14.408478+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:14.408478+0000","last_undegraded":"2024-02-21T07:46:14.408478+0000","last_fullsized":"2024-02-21T07:46:14.408478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408128+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:14.408128+0000","last_peered":"2024-02-21T07:46:14.408128+0000","last_clean":"2024-02-21T07:46:14.408128+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:14.408128+0000","last_undegraded":"2024-02-21T07:46:14.408128+0000","last_fullsized":"2024-02-21T07:46:14.408128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477990+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:17.477990+0000","last_peered":"2024-02-21T07:46:17.477990+0000","last_clean":"2024-02-21T07:46:17.477990+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:17.477990+0000","last_undegraded":"2024-02-21T07:46:17.477990+0000","last_fullsized":"2024-02-21T07:46:17.477990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408640+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:14.408640+0000","last_peered":"2024-02-21T07:46:14.408640+0000","last_clean":"2024-02-21T07:46:14.408640+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:14.408640+0000","last_undegraded":"2024-02-21T07:46:14.408640+0000","last_fullsized":"2024-02-21T07:46:14.408640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408785+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:14.408785+0000","last_peered":"2024-02-21T07:46:14.408785+0000","last_clean":"2024-02-21T07:46:14.408785+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:14.408785+0000","last_undegraded":"2024-02-21T07:46:14.408785+0000","last_fullsized":"2024-02-21T07:46:14.408785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'35","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:18.490230+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:18.490230+0000","last_peered":"2024-02-21T07:46:18.490230+0000","last_clean":"2024-02-21T07:46:18.490230+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:18.490230+0000","last_undegraded":"2024-02-21T07:46:18.490230+0000","last_fullsized":"2024-02-21T07:46:18.490230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64897,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":97,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408088+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:14.408088+0000","last_peered":"2024-02-21T07:46:14.408088+0000","last_clean":"2024-02-21T07:46:14.408088+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:14.408088+0000","last_undegraded":"2024-02-21T07:46:14.408088+0000","last_fullsized":"2024-02-21T07:46:14.408088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408974+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:14.408974+0000","last_peered":"2024-02-21T07:46:14.408974+0000","last_clean":"2024-02-21T07:46:14.408974+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:14.408974+0000","last_undegraded":"2024-02-21T07:46:14.408974+0000","last_fullsized":"2024-02-21T07:46:14.408974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408721+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:14.408721+0000","last_peered":"2024-02-21T07:46:14.408721+0000","last_clean":"2024-02-21T07:46:14.408721+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:14.408721+0000","last_undegraded":"2024-02-21T07:46:14.408721+0000","last_fullsized":"2024-02-21T07:46:14.408721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.462711+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:17.462711+0000","last_peered":"2024-02-21T07:46:17.462711+0000","last_clean":"2024-02-21T07:46:17.462711+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:17.462711+0000","last_undegraded":"2024-02-21T07:46:17.462711+0000","last_fullsized":"2024-02-21T07:46:17.462711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408747+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:14.408747+0000","last_peered":"2024-02-21T07:46:14.408747+0000","last_clean":"2024-02-21T07:46:14.408747+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:14.408747+0000","last_undegraded":"2024-02-21T07:46:14.408747+0000","last_fullsized":"2024-02-21T07:46:14.408747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305583+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:14.305583+0000","last_peered":"2024-02-21T07:46:14.305583+0000","last_clean":"2024-02-21T07:46:14.305583+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:14.305583+0000","last_undegraded":"2024-02-21T07:46:14.305583+0000","last_fullsized":"2024-02-21T07:46:14.305583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408139+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:14.408139+0000","last_peered":"2024-02-21T07:46:14.408139+0000","last_clean":"2024-02-21T07:46:14.408139+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:14.408139+0000","last_undegraded":"2024-02-21T07:46:14.408139+0000","last_fullsized":"2024-02-21T07:46:14.408139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.463510+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:17.463510+0000","last_peered":"2024-02-21T07:46:17.463510+0000","last_clean":"2024-02-21T07:46:17.463510+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:17.463510+0000","last_undegraded":"2024-02-21T07:46:17.463510+0000","last_fullsized":"2024-02-21T07:46:17.463510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408126+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:14.408126+0000","last_peered":"2024-02-21T07:46:14.408126+0000","last_clean":"2024-02-21T07:46:14.408126+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:14.408126+0000","last_undegraded":"2024-02-21T07:46:14.408126+0000","last_fullsized":"2024-02-21T07:46:14.408126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408052+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:14.408052+0000","last_peered":"2024-02-21T07:46:14.408052+0000","last_clean":"2024-02-21T07:46:14.408052+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:14.408052+0000","last_undegraded":"2024-02-21T07:46:14.408052+0000","last_fullsized":"2024-02-21T07:46:14.408052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408045+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:14.408045+0000","last_peered":"2024-02-21T07:46:14.408045+0000","last_clean":"2024-02-21T07:46:14.408045+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:14.408045+0000","last_undegraded":"2024-02-21T07:46:14.408045+0000","last_fullsized":"2024-02-21T07:46:14.408045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305359+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:14.305359+0000","last_peered":"2024-02-21T07:46:14.305359+0000","last_clean":"2024-02-21T07:46:14.305359+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:14.305359+0000","last_undegraded":"2024-02-21T07:46:14.305359+0000","last_fullsized":"2024-02-21T07:46:14.305359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408716+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:14.408716+0000","last_peered":"2024-02-21T07:46:14.408716+0000","last_clean":"2024-02-21T07:46:14.408716+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:14.408716+0000","last_undegraded":"2024-02-21T07:46:14.408716+0000","last_fullsized":"2024-02-21T07:46:14.408716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305318+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:14.305318+0000","last_peered":"2024-02-21T07:46:14.305318+0000","last_clean":"2024-02-21T07:46:14.305318+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:14.305318+0000","last_undegraded":"2024-02-21T07:46:14.305318+0000","last_fullsized":"2024-02-21T07:46:14.305318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69212,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":209,"num_read_kb":177,"num_write":167,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":138424,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":217307,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444047,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]},{"osd":8,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444046,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":319488,"data_stored":152272,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9179999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2189999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9690000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444046,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":748827,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":156900,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444046,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":385024,"data_stored":217079,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444047,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64897,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65125,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:23.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.308+0000 7f71a8000640 1 Processor -- start 2024-02-21T07:46:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.308+0000 7f71a8000640 1 -- start start 2024-02-21T07:46:23.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71a017c040 0x7f71a00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f71a0070f30 0x7f71a00713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71a0188c00 0x7f71a0189090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00f4ec0 con 0x7f71a017c040 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00f6450 con 0x7f71a0188c00 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.310+0000 7f71a8000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00f50d0 con 0x7f71a0070f30 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71a017c040 0x7f71a00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71a017c040 0x7f71a00706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49194/0 (socket says 172.21.15.100:49194) 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 -- 172.21.15.100:0/2487849696 learned_addr learned my addr 172.21.15.100:0/2487849696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a4c00640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.170:3300/0 conn(0x7f71a0070f30 0x7f71a00713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a6000640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.156:3300/0 conn(0x7f71a0188c00 0x7f71a0189090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 -- 172.21.15.100:0/2487849696 >> v2:172.21.15.170:3300/0 conn(0x7f71a0070f30 msgr2=0x7f71a00713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.170:3300/0 conn(0x7f71a0070f30 0x7f71a00713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 -- 172.21.15.100:0/2487849696 >> v2:172.21.15.156:3300/0 conn(0x7f71a0188c00 msgr2=0x7f71a0189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.156:3300/0 conn(0x7f71a0188c00 0x7f71a0189090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.311+0000 7f71a5600640 1 -- 172.21.15.100:0/2487849696 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a00f53b0 con 0x7f71a017c040 2024-02-21T07:46:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.312+0000 7f71a5600640 1 --2- 172.21.15.100:0/2487849696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a00706b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f71a008e620 tx=0x7f719402e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2b13fb59aecef4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.312+0000 7f719fe00640 1 -- 172.21.15.100:0/2487849696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194036440 con 0x7f71a017c040 2024-02-21T07:46:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f719fe00640 1 -- 172.21.15.100:0/2487849696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940365a0 con 0x7f71a017c040 2024-02-21T07:46:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f719fe00640 1 -- 172.21.15.100:0/2487849696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194036930 con 0x7f71a017c040 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 -- 172.21.15.100:0/2487849696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 msgr2=0x7f71a00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 --2- 172.21.15.100:0/2487849696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a00706b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f71a008e620 tx=0x7f719402e180 comp rx=0 tx=0).stop 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 -- 172.21.15.100:0/2487849696 shutdown_connections 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.156:3300/0 conn(0x7f71a0188c00 0x7f71a0189090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 --2- 172.21.15.100:0/2487849696 >> v2:172.21.15.170:3300/0 conn(0x7f71a0070f30 0x7f71a00713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 --2- 172.21.15.100:0/2487849696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a00706b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 -- 172.21.15.100:0/2487849696 >> 172.21.15.100:0/2487849696 conn(0x7f71a00ce160 msgr2=0x7f71a00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 -- 172.21.15.100:0/2487849696 shutdown_connections 2024-02-21T07:46:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.313+0000 7f71a8000640 1 -- 172.21.15.100:0/2487849696 wait complete. 2024-02-21T07:46:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.315+0000 7f71a8000640 1 Processor -- start 2024-02-21T07:46:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.316+0000 7f71a8000640 1 -- start start 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 0x7f71a016d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a0188c00 0x7f71a0163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a016e750 con 0x7f71a017c040 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a016dbd0 con 0x7f71a0070f30 2024-02-21T07:46:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a8000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a016deb0 con 0x7f71a0188c00 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a5600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 0x7f71a016d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49206/0 (socket says 172.21.15.100:49206) 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a4c00640 1 -- 172.21.15.100:0/3832862390 learned_addr learned my addr 172.21.15.100:0/3832862390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a6000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a0188c00 0x7f71a0163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a5600640 1 -- 172.21.15.100:0/3832862390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a0188c00 msgr2=0x7f71a0163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a5600640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a0188c00 0x7f71a0163a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a5600640 1 -- 172.21.15.100:0/3832862390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 msgr2=0x7f71a0222c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.317+0000 7f71a5600640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f71a5600640 1 -- 172.21.15.100:0/3832862390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719400b770 con 0x7f71a0070f30 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f71a4c00640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:23.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f71a5600640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 0x7f71a016d570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7194035000 tx=0x7f71940046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940347d0 con 0x7f71a0070f30 2024-02-21T07:46:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194034930 con 0x7f71a0070f30 2024-02-21T07:46:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a016e190 con 0x7f71a0070f30 2024-02-21T07:46:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194034ce0 con 0x7f71a0070f30 2024-02-21T07:46:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.318+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a0164a10 con 0x7f71a0070f30 2024-02-21T07:46:23.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.319+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0182f90 con 0x7f71a0070f30 2024-02-21T07:46:23.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.321+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f71940403e0 con 0x7f71a0070f30 2024-02-21T07:46:23.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.323+0000 7f719d600640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 0x7f71840a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.323+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f71940ebc60 con 0x7f71a0070f30 2024-02-21T07:46:23.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.324+0000 7f71a4c00640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 0x7f71840a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.324+0000 7f71a4c00640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 0x7f71840a1570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f71a0179770 tx=0x7f719000d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.327+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f71940b5ad0 con 0x7f71a0070f30 2024-02-21T07:46:23.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.523+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71a00cdf00 con 0x7f718409f0b0 2024-02-21T07:46:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.533+0000 7f719d600640 1 -- 172.21.15.100:0/3832862390 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367998 (secure 0 0 0) 0x7f71a00cdf00 con 0x7f718409f0b0 2024-02-21T07:46:23.545 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:23.547 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 msgr2=0x7f71840a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 0x7f71840a1570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f71a0179770 tx=0x7f719000d040 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 msgr2=0x7f71a016d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 0x7f71a016d570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7194035000 tx=0x7f71940046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 shutdown_connections 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71a0188c00 0x7f71a0163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718409f0b0 0x7f71840a1570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71a017c040 0x7f71a0222c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 --2- 172.21.15.100:0/3832862390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a0070f30 0x7f71a016d570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 >> 172.21.15.100:0/3832862390 conn(0x7f71a00ce160 msgr2=0x7f71a0171f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:23.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 shutdown_connections 2024-02-21T07:46:23.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.541+0000 7f71a8000640 1 -- 172.21.15.100:0/3832862390 wait complete. 2024-02-21T07:46:23.567 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-02-21T07:46:21.908093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659814,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":335,"num_read_kb":286,"num_write":350,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353352,"kb_used_data":4128,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108728,"statfs":{"total":1159641169920,"available":1159279337472,"internally_reserved":0,"allocated":4227072,"data_stored":3178112,"data_compressed":239934,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4934,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":37,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.388216"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408490+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:14.408490+0000","last_peered":"2024-02-21T07:46:14.408490+0000","last_clean":"2024-02-21T07:46:14.408490+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:14.408490+0000","last_undegraded":"2024-02-21T07:46:14.408490+0000","last_fullsized":"2024-02-21T07:46:14.408490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408204+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:14.408204+0000","last_peered":"2024-02-21T07:46:14.408204+0000","last_clean":"2024-02-21T07:46:14.408204+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:14.408204+0000","last_undegraded":"2024-02-21T07:46:14.408204+0000","last_fullsized":"2024-02-21T07:46:14.408204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408432+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:14.408432+0000","last_peered":"2024-02-21T07:46:14.408432+0000","last_clean":"2024-02-21T07:46:14.408432+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:14.408432+0000","last_undegraded":"2024-02-21T07:46:14.408432+0000","last_fullsized":"2024-02-21T07:46:14.408432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305340+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:14.305340+0000","last_peered":"2024-02-21T07:46:14.305340+0000","last_clean":"2024-02-21T07:46:14.305340+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:14.305340+0000","last_undegraded":"2024-02-21T07:46:14.305340+0000","last_fullsized":"2024-02-21T07:46:14.305340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305355+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:14.305355+0000","last_peered":"2024-02-21T07:46:14.305355+0000","last_clean":"2024-02-21T07:46:14.305355+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:14.305355+0000","last_undegraded":"2024-02-21T07:46:14.305355+0000","last_fullsized":"2024-02-21T07:46:14.305355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408124+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:14.408124+0000","last_peered":"2024-02-21T07:46:14.408124+0000","last_clean":"2024-02-21T07:46:14.408124+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:14.408124+0000","last_undegraded":"2024-02-21T07:46:14.408124+0000","last_fullsized":"2024-02-21T07:46:14.408124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477095+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:17.477095+0000","last_peered":"2024-02-21T07:46:17.477095+0000","last_clean":"2024-02-21T07:46:17.477095+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:17.477095+0000","last_undegraded":"2024-02-21T07:46:17.477095+0000","last_fullsized":"2024-02-21T07:46:17.477095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.308347+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:46:14.308347+0000","last_peered":"2024-02-21T07:46:14.308347+0000","last_clean":"2024-02-21T07:46:14.308347+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:46:14.308347+0000","last_undegraded":"2024-02-21T07:46:14.308347+0000","last_fullsized":"2024-02-21T07:46:14.308347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409068+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:14.409068+0000","last_peered":"2024-02-21T07:46:14.409068+0000","last_clean":"2024-02-21T07:46:14.409068+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:14.409068+0000","last_undegraded":"2024-02-21T07:46:14.409068+0000","last_fullsized":"2024-02-21T07:46:14.409068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408331+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:14.408331+0000","last_peered":"2024-02-21T07:46:14.408331+0000","last_clean":"2024-02-21T07:46:14.408331+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:14.408331+0000","last_undegraded":"2024-02-21T07:46:14.408331+0000","last_fullsized":"2024-02-21T07:46:14.408331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409044+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:14.409044+0000","last_peered":"2024-02-21T07:46:14.409044+0000","last_clean":"2024-02-21T07:46:14.409044+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:14.409044+0000","last_undegraded":"2024-02-21T07:46:14.409044+0000","last_fullsized":"2024-02-21T07:46:14.409044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.410441+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:46:14.410441+0000","last_peered":"2024-02-21T07:46:14.410441+0000","last_clean":"2024-02-21T07:46:14.410441+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:46:14.410441+0000","last_undegraded":"2024-02-21T07:46:14.410441+0000","last_fullsized":"2024-02-21T07:46:14.410441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408897+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:14.408897+0000","last_peered":"2024-02-21T07:46:14.408897+0000","last_clean":"2024-02-21T07:46:14.408897+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:14.408897+0000","last_undegraded":"2024-02-21T07:46:14.408897+0000","last_fullsized":"2024-02-21T07:46:14.408897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408478+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:14.408478+0000","last_peered":"2024-02-21T07:46:14.408478+0000","last_clean":"2024-02-21T07:46:14.408478+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:14.408478+0000","last_undegraded":"2024-02-21T07:46:14.408478+0000","last_fullsized":"2024-02-21T07:46:14.408478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408128+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:14.408128+0000","last_peered":"2024-02-21T07:46:14.408128+0000","last_clean":"2024-02-21T07:46:14.408128+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:14.408128+0000","last_undegraded":"2024-02-21T07:46:14.408128+0000","last_fullsized":"2024-02-21T07:46:14.408128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477990+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:17.477990+0000","last_peered":"2024-02-21T07:46:17.477990+0000","last_clean":"2024-02-21T07:46:17.477990+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:17.477990+0000","last_undegraded":"2024-02-21T07:46:17.477990+0000","last_fullsized":"2024-02-21T07:46:17.477990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408640+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:14.408640+0000","last_peered":"2024-02-21T07:46:14.408640+0000","last_clean":"2024-02-21T07:46:14.408640+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:14.408640+0000","last_undegraded":"2024-02-21T07:46:14.408640+0000","last_fullsized":"2024-02-21T07:46:14.408640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408785+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:14.408785+0000","last_peered":"2024-02-21T07:46:14.408785+0000","last_clean":"2024-02-21T07:46:14.408785+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:14.408785+0000","last_undegraded":"2024-02-21T07:46:14.408785+0000","last_fullsized":"2024-02-21T07:46:14.408785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'35","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:18.490230+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:18.490230+0000","last_peered":"2024-02-21T07:46:18.490230+0000","last_clean":"2024-02-21T07:46:18.490230+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:18.490230+0000","last_undegraded":"2024-02-21T07:46:18.490230+0000","last_fullsized":"2024-02-21T07:46:18.490230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64897,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":97,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408088+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:14.408088+0000","last_peered":"2024-02-21T07:46:14.408088+0000","last_clean":"2024-02-21T07:46:14.408088+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:14.408088+0000","last_undegraded":"2024-02-21T07:46:14.408088+0000","last_fullsized":"2024-02-21T07:46:14.408088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408974+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:14.408974+0000","last_peered":"2024-02-21T07:46:14.408974+0000","last_clean":"2024-02-21T07:46:14.408974+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:14.408974+0000","last_undegraded":"2024-02-21T07:46:14.408974+0000","last_fullsized":"2024-02-21T07:46:14.408974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408721+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:14.408721+0000","last_peered":"2024-02-21T07:46:14.408721+0000","last_clean":"2024-02-21T07:46:14.408721+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:14.408721+0000","last_undegraded":"2024-02-21T07:46:14.408721+0000","last_fullsized":"2024-02-21T07:46:14.408721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.462711+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:17.462711+0000","last_peered":"2024-02-21T07:46:17.462711+0000","last_clean":"2024-02-21T07:46:17.462711+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:17.462711+0000","last_undegraded":"2024-02-21T07:46:17.462711+0000","last_fullsized":"2024-02-21T07:46:17.462711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408747+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:14.408747+0000","last_peered":"2024-02-21T07:46:14.408747+0000","last_clean":"2024-02-21T07:46:14.408747+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:14.408747+0000","last_undegraded":"2024-02-21T07:46:14.408747+0000","last_fullsized":"2024-02-21T07:46:14.408747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305583+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:14.305583+0000","last_peered":"2024-02-21T07:46:14.305583+0000","last_clean":"2024-02-21T07:46:14.305583+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:14.305583+0000","last_undegraded":"2024-02-21T07:46:14.305583+0000","last_fullsized":"2024-02-21T07:46:14.305583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408139+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:14.408139+0000","last_peered":"2024-02-21T07:46:14.408139+0000","last_clean":"2024-02-21T07:46:14.408139+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:14.408139+0000","last_undegraded":"2024-02-21T07:46:14.408139+0000","last_fullsized":"2024-02-21T07:46:14.408139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.463510+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:17.463510+0000","last_peered":"2024-02-21T07:46:17.463510+0000","last_clean":"2024-02-21T07:46:17.463510+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:17.463510+0000","last_undegraded":"2024-02-21T07:46:17.463510+0000","last_fullsized":"2024-02-21T07:46:17.463510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408126+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:14.408126+0000","last_peered":"2024-02-21T07:46:14.408126+0000","last_clean":"2024-02-21T07:46:14.408126+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:14.408126+0000","last_undegraded":"2024-02-21T07:46:14.408126+0000","last_fullsized":"2024-02-21T07:46:14.408126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408052+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:14.408052+0000","last_peered":"2024-02-21T07:46:14.408052+0000","last_clean":"2024-02-21T07:46:14.408052+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:14.408052+0000","last_undegraded":"2024-02-21T07:46:14.408052+0000","last_fullsized":"2024-02-21T07:46:14.408052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408045+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:14.408045+0000","last_peered":"2024-02-21T07:46:14.408045+0000","last_clean":"2024-02-21T07:46:14.408045+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:14.408045+0000","last_undegraded":"2024-02-21T07:46:14.408045+0000","last_fullsized":"2024-02-21T07:46:14.408045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305359+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:14.305359+0000","last_peered":"2024-02-21T07:46:14.305359+0000","last_clean":"2024-02-21T07:46:14.305359+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:14.305359+0000","last_undegraded":"2024-02-21T07:46:14.305359+0000","last_fullsized":"2024-02-21T07:46:14.305359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408716+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:14.408716+0000","last_peered":"2024-02-21T07:46:14.408716+0000","last_clean":"2024-02-21T07:46:14.408716+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:14.408716+0000","last_undegraded":"2024-02-21T07:46:14.408716+0000","last_fullsized":"2024-02-21T07:46:14.408716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305318+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:14.305318+0000","last_peered":"2024-02-21T07:46:14.305318+0000","last_clean":"2024-02-21T07:46:14.305318+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:14.305318+0000","last_undegraded":"2024-02-21T07:46:14.305318+0000","last_fullsized":"2024-02-21T07:46:14.305318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69212,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":209,"num_read_kb":177,"num_write":167,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":138424,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":217307,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444047,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]},{"osd":8,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":7,"up_from":17,"seq":73014444046,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":319488,"data_stored":152272,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9179999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2189999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9690000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444046,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":748827,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":156900,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444046,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":385024,"data_stored":217079,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444047,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64897,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65125,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:23.616 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-02-21T07:46:23.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:46:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.830+0000 7fcf70a00640 1 Processor -- start 2024-02-21T07:46:23.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.830+0000 7fcf70a00640 1 -- start start 2024-02-21T07:46:23.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf70a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fcf6c06fd10 0x7fcf6c0f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf70a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c189670 con 0x7fcf6c185e10 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf70a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c06dcf0 con 0x7fcf6c072f00 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf70a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c0f43a0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf6b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcf6c185e10 0x7fcf6c0703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49812/0 (socket says 172.21.15.100:49812) 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.832+0000 7fcf6b400640 1 -- 172.21.15.100:0/92100859 learned_addr learned my addr 172.21.15.100:0/92100859 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6be00640 1 --2- 172.21.15.100:0/92100859 >> v2:172.21.15.156:3300/0 conn(0x7fcf6c06fd10 0x7fcf6c0f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438936505 0 0) 0x7fcf6c189670 con 0x7fcf6c185e10 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf50003520 con 0x7fcf6c185e10 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561125983 0 0) 0x7fcf6c06dcf0 con 0x7fcf6c072f00 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c189670 con 0x7fcf6c072f00 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6be00640 1 -- 172.21.15.100:0/92100859 >> v1:172.21.15.170:6789/0 conn(0x7fcf6c072f00 legacy=0x7fcf6c06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6be00640 1 -- 172.21.15.100:0/92100859 >> v1:172.21.15.100:6789/0 conn(0x7fcf6c185e10 legacy=0x7fcf6c0703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.833+0000 7fcf6be00640 1 -- 172.21.15.100:0/92100859 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c06dfd0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.834+0000 7fcf6be00640 1 --2- 172.21.15.100:0/92100859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c0f4aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009d90 tx=0x7fcf6402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9aa9dea3a24150c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.835+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402cbd0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.835+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6402cd30 con 0x7fcf6c06fd10 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.835+0000 7fcf6aa00640 1 -- 172.21.15.100:0/92100859 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6402cea0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.835+0000 7fcf70a00640 1 -- 172.21.15.100:0/92100859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c06fd10 msgr2=0x7fcf6c0f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.835+0000 7fcf70a00640 1 --2- 172.21.15.100:0/92100859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c0f4aa0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009d90 tx=0x7fcf6402be20 comp rx=0 tx=0).stop 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.836+0000 7fcf70a00640 1 -- 172.21.15.100:0/92100859 shutdown_connections 2024-02-21T07:46:23.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.836+0000 7fcf70a00640 1 --2- 172.21.15.100:0/92100859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c0f4aa0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.836+0000 7fcf70a00640 1 -- 172.21.15.100:0/92100859 >> 172.21.15.100:0/92100859 conn(0x7fcf6c0f64a0 msgr2=0x7fcf6c0f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.836+0000 7fcf70a00640 1 -- 172.21.15.100:0/92100859 shutdown_connections 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.836+0000 7fcf70a00640 1 -- 172.21.15.100:0/92100859 wait complete. 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.838+0000 7fcf70a00640 1 Processor -- start 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.838+0000 7fcf70a00640 1 -- start start 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c072f00 0x7fcf6c18bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf6c185e10 0x7fcf6c18c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c1873c0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c18c7c0 con 0x7fcf6c072f00 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf70a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c16ff90 con 0x7fcf6c185e10 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf6b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf6b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49210/0 (socket says 172.21.15.100:49210) 2024-02-21T07:46:23.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf6b400640 1 -- 172.21.15.100:0/990221282 learned_addr learned my addr 172.21.15.100:0/990221282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf62a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c072f00 0x7fcf6c18bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.839+0000 7fcf6be00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf6c185e10 0x7fcf6c18c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 -- 172.21.15.100:0/990221282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf6c185e10 msgr2=0x7fcf6c18c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf6c185e10 0x7fcf6c18c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 -- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c072f00 msgr2=0x7fcf6c18bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c072f00 0x7fcf6c18bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 -- 172.21.15.100:0/990221282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009a70 con 0x7fcf6c06fd10 2024-02-21T07:46:23.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf6b400640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c480 tx=0x7fcf5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c005da0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c007070 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c1864d0 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.840+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c007400 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.841+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c186a90 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.842+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c075160 con 0x7fcf6c06fd10 2024-02-21T07:46:23.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.843+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fcf5c007560 con 0x7fcf6c06fd10 2024-02-21T07:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.845+0000 7fcf63e00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 0x7fcf480a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.846+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcf5c0c9160 con 0x7fcf6c06fd10 2024-02-21T07:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.846+0000 7fcf62a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 0x7fcf480a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:23.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.846+0000 7fcf62a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 0x7fcf480a1570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c183890 tx=0x7fcf54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:23.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:23.850+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf5c093030 con 0x7fcf6c06fd10 2024-02-21T07:46:24.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.042+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf6c0f4580 con 0x7fcf4809f0b0 2024-02-21T07:46:24.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.053+0000 7fcf63e00640 1 -- 172.21.15.100:0/990221282 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367999 (secure 0 0 0) 0x7fcf54001ce0 con 0x7fcf4809f0b0 2024-02-21T07:46:24.063 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:24.066 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 msgr2=0x7fcf480a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 0x7fcf480a1570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c183890 tx=0x7fcf54009040 comp rx=0 tx=0).stop 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 msgr2=0x7fcf6c16fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c00c480 tx=0x7fcf5c00c940 comp rx=0 tx=0).stop 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 shutdown_connections 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcf6c185e10 0x7fcf6c18c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf6c072f00 0x7fcf6c18bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcf4809f0b0 0x7fcf480a1570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 --2- 172.21.15.100:0/990221282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf6c06fd10 0x7fcf6c16fa50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.061+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 >> 172.21.15.100:0/990221282 conn(0x7fcf6c0f64a0 msgr2=0x7fcf6c0714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:24.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.062+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 shutdown_connections 2024-02-21T07:46:24.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.062+0000 7fcf70a00640 1 -- 172.21.15.100:0/990221282 wait complete. 2024-02-21T07:46:24.087 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-02-21T07:46:23.908567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659814,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":335,"num_read_kb":286,"num_write":350,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":353352,"kb_used_data":4128,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1132108728,"statfs":{"total":1159641169920,"available":1159279337472,"internally_reserved":0,"allocated":4227072,"data_stored":3178112,"data_compressed":239934,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4934,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":37,"num_write":7,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.385898"},"pg_stats":[{"pgid":"2.1f","version":"28'9","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761707+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:46:13.761707+0000","last_peered":"2024-02-21T07:46:13.761707+0000","last_clean":"2024-02-21T07:46:13.761707+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:46:13.761707+0000","last_undegraded":"2024-02-21T07:46:13.761707+0000","last_fullsized":"2024-02-21T07:46:13.761707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527732+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:46:13.527732+0000","last_peered":"2024-02-21T07:46:13.527732+0000","last_clean":"2024-02-21T07:46:13.527732+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:46:13.527732+0000","last_undegraded":"2024-02-21T07:46:13.527732+0000","last_fullsized":"2024-02-21T07:46:13.527732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.532283+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:46:13.532283+0000","last_peered":"2024-02-21T07:46:13.532283+0000","last_clean":"2024-02-21T07:46:13.532283+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:46:13.532283+0000","last_undegraded":"2024-02-21T07:46:13.532283+0000","last_fullsized":"2024-02-21T07:46:13.532283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528116+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:46:13.528116+0000","last_peered":"2024-02-21T07:46:13.528116+0000","last_clean":"2024-02-21T07:46:13.528116+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:46:13.528116+0000","last_undegraded":"2024-02-21T07:46:13.528116+0000","last_fullsized":"2024-02-21T07:46:13.528116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672544+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:46:13.672544+0000","last_peered":"2024-02-21T07:46:13.672544+0000","last_clean":"2024-02-21T07:46:13.672544+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:46:13.672544+0000","last_undegraded":"2024-02-21T07:46:13.672544+0000","last_fullsized":"2024-02-21T07:46:13.672544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527292+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:46:13.527292+0000","last_peered":"2024-02-21T07:46:13.527292+0000","last_clean":"2024-02-21T07:46:13.527292+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:46:13.527292+0000","last_undegraded":"2024-02-21T07:46:13.527292+0000","last_fullsized":"2024-02-21T07:46:13.527292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408490+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:46:14.408490+0000","last_peered":"2024-02-21T07:46:14.408490+0000","last_clean":"2024-02-21T07:46:14.408490+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:46:14.408490+0000","last_undegraded":"2024-02-21T07:46:14.408490+0000","last_fullsized":"2024-02-21T07:46:14.408490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672888+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:46:13.672888+0000","last_peered":"2024-02-21T07:46:13.672888+0000","last_clean":"2024-02-21T07:46:13.672888+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:46:13.672888+0000","last_undegraded":"2024-02-21T07:46:13.672888+0000","last_fullsized":"2024-02-21T07:46:13.672888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527106+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:46:13.527106+0000","last_peered":"2024-02-21T07:46:13.527106+0000","last_clean":"2024-02-21T07:46:13.527106+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:46:13.527106+0000","last_undegraded":"2024-02-21T07:46:13.527106+0000","last_fullsized":"2024-02-21T07:46:13.527106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408204+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:46:14.408204+0000","last_peered":"2024-02-21T07:46:14.408204+0000","last_clean":"2024-02-21T07:46:14.408204+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:46:14.408204+0000","last_undegraded":"2024-02-21T07:46:14.408204+0000","last_fullsized":"2024-02-21T07:46:14.408204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672622+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:46:13.672622+0000","last_peered":"2024-02-21T07:46:13.672622+0000","last_clean":"2024-02-21T07:46:13.672622+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:46:13.672622+0000","last_undegraded":"2024-02-21T07:46:13.672622+0000","last_fullsized":"2024-02-21T07:46:13.672622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653034+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:46:13.653034+0000","last_peered":"2024-02-21T07:46:13.653034+0000","last_clean":"2024-02-21T07:46:13.653034+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:46:13.653034+0000","last_undegraded":"2024-02-21T07:46:13.653034+0000","last_fullsized":"2024-02-21T07:46:13.653034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526765+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:46:13.526765+0000","last_peered":"2024-02-21T07:46:13.526765+0000","last_clean":"2024-02-21T07:46:13.526765+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:46:13.526765+0000","last_undegraded":"2024-02-21T07:46:13.526765+0000","last_fullsized":"2024-02-21T07:46:13.526765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672916+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:46:13.672916+0000","last_peered":"2024-02-21T07:46:13.672916+0000","last_clean":"2024-02-21T07:46:13.672916+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:46:13.672916+0000","last_undegraded":"2024-02-21T07:46:13.672916+0000","last_fullsized":"2024-02-21T07:46:13.672916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527570+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:46:13.527570+0000","last_peered":"2024-02-21T07:46:13.527570+0000","last_clean":"2024-02-21T07:46:13.527570+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:46:13.527570+0000","last_undegraded":"2024-02-21T07:46:13.527570+0000","last_fullsized":"2024-02-21T07:46:13.527570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527030+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:46:13.527030+0000","last_peered":"2024-02-21T07:46:13.527030+0000","last_clean":"2024-02-21T07:46:13.527030+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:46:13.527030+0000","last_undegraded":"2024-02-21T07:46:13.527030+0000","last_fullsized":"2024-02-21T07:46:13.527030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.672877+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:46:13.672877+0000","last_peered":"2024-02-21T07:46:13.672877+0000","last_clean":"2024-02-21T07:46:13.672877+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:46:13.672877+0000","last_undegraded":"2024-02-21T07:46:13.672877+0000","last_fullsized":"2024-02-21T07:46:13.672877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524110+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:46:13.524110+0000","last_peered":"2024-02-21T07:46:13.524110+0000","last_clean":"2024-02-21T07:46:13.524110+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:46:13.524110+0000","last_undegraded":"2024-02-21T07:46:13.524110+0000","last_fullsized":"2024-02-21T07:46:13.524110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527066+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:46:13.527066+0000","last_peered":"2024-02-21T07:46:13.527066+0000","last_clean":"2024-02-21T07:46:13.527066+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:46:13.527066+0000","last_undegraded":"2024-02-21T07:46:13.527066+0000","last_fullsized":"2024-02-21T07:46:13.527066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761442+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:46:13.761442+0000","last_peered":"2024-02-21T07:46:13.761442+0000","last_clean":"2024-02-21T07:46:13.761442+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:46:13.761442+0000","last_undegraded":"2024-02-21T07:46:13.761442+0000","last_fullsized":"2024-02-21T07:46:13.761442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526562+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:46:13.526562+0000","last_peered":"2024-02-21T07:46:13.526562+0000","last_clean":"2024-02-21T07:46:13.526562+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:46:13.526562+0000","last_undegraded":"2024-02-21T07:46:13.526562+0000","last_fullsized":"2024-02-21T07:46:13.526562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408432+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:46:14.408432+0000","last_peered":"2024-02-21T07:46:14.408432+0000","last_clean":"2024-02-21T07:46:14.408432+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:46:14.408432+0000","last_undegraded":"2024-02-21T07:46:14.408432+0000","last_fullsized":"2024-02-21T07:46:14.408432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530416+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:46:13.530416+0000","last_peered":"2024-02-21T07:46:13.530416+0000","last_clean":"2024-02-21T07:46:13.530416+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:46:13.530416+0000","last_undegraded":"2024-02-21T07:46:13.530416+0000","last_fullsized":"2024-02-21T07:46:13.530416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'4","reported_seq":30,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673180+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:46:13.673180+0000","last_peered":"2024-02-21T07:46:13.673180+0000","last_clean":"2024-02-21T07:46:13.673180+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:46:13.673180+0000","last_undegraded":"2024-02-21T07:46:13.673180+0000","last_fullsized":"2024-02-21T07:46:13.673180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528097+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:46:13.528097+0000","last_peered":"2024-02-21T07:46:13.528097+0000","last_clean":"2024-02-21T07:46:13.528097+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:46:13.528097+0000","last_undegraded":"2024-02-21T07:46:13.528097+0000","last_fullsized":"2024-02-21T07:46:13.528097+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528024+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:46:13.528024+0000","last_peered":"2024-02-21T07:46:13.528024+0000","last_clean":"2024-02-21T07:46:13.528024+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:46:13.528024+0000","last_undegraded":"2024-02-21T07:46:13.528024+0000","last_fullsized":"2024-02-21T07:46:13.528024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'8","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762046+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:46:13.762046+0000","last_peered":"2024-02-21T07:46:13.762046+0000","last_clean":"2024-02-21T07:46:13.762046+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:46:13.762046+0000","last_undegraded":"2024-02-21T07:46:13.762046+0000","last_fullsized":"2024-02-21T07:46:13.762046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526443+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:46:13.526443+0000","last_peered":"2024-02-21T07:46:13.526443+0000","last_clean":"2024-02-21T07:46:13.526443+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:46:13.526443+0000","last_undegraded":"2024-02-21T07:46:13.526443+0000","last_fullsized":"2024-02-21T07:46:13.526443+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526257+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:46:13.526257+0000","last_peered":"2024-02-21T07:46:13.526257+0000","last_clean":"2024-02-21T07:46:13.526257+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:46:13.526257+0000","last_undegraded":"2024-02-21T07:46:13.526257+0000","last_fullsized":"2024-02-21T07:46:13.526257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527399+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:46:13.527399+0000","last_peered":"2024-02-21T07:46:13.527399+0000","last_clean":"2024-02-21T07:46:13.527399+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:46:13.527399+0000","last_undegraded":"2024-02-21T07:46:13.527399+0000","last_fullsized":"2024-02-21T07:46:13.527399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524040+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:46:13.524040+0000","last_peered":"2024-02-21T07:46:13.524040+0000","last_clean":"2024-02-21T07:46:13.524040+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:46:13.524040+0000","last_undegraded":"2024-02-21T07:46:13.524040+0000","last_fullsized":"2024-02-21T07:46:13.524040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305340+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:46:14.305340+0000","last_peered":"2024-02-21T07:46:14.305340+0000","last_clean":"2024-02-21T07:46:14.305340+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:46:14.305340+0000","last_undegraded":"2024-02-21T07:46:14.305340+0000","last_fullsized":"2024-02-21T07:46:14.305340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761425+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:46:13.761425+0000","last_peered":"2024-02-21T07:46:13.761425+0000","last_clean":"2024-02-21T07:46:13.761425+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:46:13.761425+0000","last_undegraded":"2024-02-21T07:46:13.761425+0000","last_fullsized":"2024-02-21T07:46:13.761425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526565+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:46:13.526565+0000","last_peered":"2024-02-21T07:46:13.526565+0000","last_clean":"2024-02-21T07:46:13.526565+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:46:13.526565+0000","last_undegraded":"2024-02-21T07:46:13.526565+0000","last_fullsized":"2024-02-21T07:46:13.526565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305355+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:46:14.305355+0000","last_peered":"2024-02-21T07:46:14.305355+0000","last_clean":"2024-02-21T07:46:14.305355+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:46:14.305355+0000","last_undegraded":"2024-02-21T07:46:14.305355+0000","last_fullsized":"2024-02-21T07:46:14.305355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652991+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:46:13.652991+0000","last_peered":"2024-02-21T07:46:13.652991+0000","last_clean":"2024-02-21T07:46:13.652991+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:46:13.652991+0000","last_undegraded":"2024-02-21T07:46:13.652991+0000","last_fullsized":"2024-02-21T07:46:13.652991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408124+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:46:14.408124+0000","last_peered":"2024-02-21T07:46:14.408124+0000","last_clean":"2024-02-21T07:46:14.408124+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:46:14.408124+0000","last_undegraded":"2024-02-21T07:46:14.408124+0000","last_fullsized":"2024-02-21T07:46:14.408124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"28'4","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477095+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:46:17.477095+0000","last_peered":"2024-02-21T07:46:17.477095+0000","last_clean":"2024-02-21T07:46:17.477095+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:46:17.477095+0000","last_undegraded":"2024-02-21T07:46:17.477095+0000","last_fullsized":"2024-02-21T07:46:17.477095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.308347+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:46:14.308347+0000","last_peered":"2024-02-21T07:46:14.308347+0000","last_clean":"2024-02-21T07:46:14.308347+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:46:14.308347+0000","last_undegraded":"2024-02-21T07:46:14.308347+0000","last_fullsized":"2024-02-21T07:46:14.308347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525200+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:46:13.525200+0000","last_peered":"2024-02-21T07:46:13.525200+0000","last_clean":"2024-02-21T07:46:13.525200+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:46:13.525200+0000","last_undegraded":"2024-02-21T07:46:13.525200+0000","last_fullsized":"2024-02-21T07:46:13.525200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652743+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:46:13.652743+0000","last_peered":"2024-02-21T07:46:13.652743+0000","last_clean":"2024-02-21T07:46:13.652743+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:46:13.652743+0000","last_undegraded":"2024-02-21T07:46:13.652743+0000","last_fullsized":"2024-02-21T07:46:13.652743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409068+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:46:14.409068+0000","last_peered":"2024-02-21T07:46:14.409068+0000","last_clean":"2024-02-21T07:46:14.409068+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:46:14.409068+0000","last_undegraded":"2024-02-21T07:46:14.409068+0000","last_fullsized":"2024-02-21T07:46:14.409068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527329+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:46:13.527329+0000","last_peered":"2024-02-21T07:46:13.527329+0000","last_clean":"2024-02-21T07:46:13.527329+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:46:13.527329+0000","last_undegraded":"2024-02-21T07:46:13.527329+0000","last_fullsized":"2024-02-21T07:46:13.527329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673137+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:46:13.673137+0000","last_peered":"2024-02-21T07:46:13.673137+0000","last_clean":"2024-02-21T07:46:13.673137+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:46:13.673137+0000","last_undegraded":"2024-02-21T07:46:13.673137+0000","last_fullsized":"2024-02-21T07:46:13.673137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":205,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652947+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:46:13.652947+0000","last_peered":"2024-02-21T07:46:13.652947+0000","last_clean":"2024-02-21T07:46:13.652947+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:46:13.652947+0000","last_undegraded":"2024-02-21T07:46:13.652947+0000","last_fullsized":"2024-02-21T07:46:13.652947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'1","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653307+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:46:13.653307+0000","last_peered":"2024-02-21T07:46:13.653307+0000","last_clean":"2024-02-21T07:46:13.653307+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:46:13.653307+0000","last_undegraded":"2024-02-21T07:46:13.653307+0000","last_fullsized":"2024-02-21T07:46:13.653307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653433+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:46:13.653433+0000","last_peered":"2024-02-21T07:46:13.653433+0000","last_clean":"2024-02-21T07:46:13.653433+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:46:13.653433+0000","last_undegraded":"2024-02-21T07:46:13.653433+0000","last_fullsized":"2024-02-21T07:46:13.653433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527271+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:46:13.527271+0000","last_peered":"2024-02-21T07:46:13.527271+0000","last_clean":"2024-02-21T07:46:13.527271+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:46:13.527271+0000","last_undegraded":"2024-02-21T07:46:13.527271+0000","last_fullsized":"2024-02-21T07:46:13.527271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408331+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:46:14.408331+0000","last_peered":"2024-02-21T07:46:14.408331+0000","last_clean":"2024-02-21T07:46:14.408331+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:46:14.408331+0000","last_undegraded":"2024-02-21T07:46:14.408331+0000","last_fullsized":"2024-02-21T07:46:14.408331+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653170+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:46:13.653170+0000","last_peered":"2024-02-21T07:46:13.653170+0000","last_clean":"2024-02-21T07:46:13.653170+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:46:13.653170+0000","last_undegraded":"2024-02-21T07:46:13.653170+0000","last_fullsized":"2024-02-21T07:46:13.653170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.409044+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:46:14.409044+0000","last_peered":"2024-02-21T07:46:14.409044+0000","last_clean":"2024-02-21T07:46:14.409044+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:46:14.409044+0000","last_undegraded":"2024-02-21T07:46:14.409044+0000","last_fullsized":"2024-02-21T07:46:14.409044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.410441+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:46:14.410441+0000","last_peered":"2024-02-21T07:46:14.410441+0000","last_clean":"2024-02-21T07:46:14.410441+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:46:14.410441+0000","last_undegraded":"2024-02-21T07:46:14.410441+0000","last_fullsized":"2024-02-21T07:46:14.410441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653447+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:46:13.653447+0000","last_peered":"2024-02-21T07:46:13.653447+0000","last_clean":"2024-02-21T07:46:13.653447+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:46:13.653447+0000","last_undegraded":"2024-02-21T07:46:13.653447+0000","last_fullsized":"2024-02-21T07:46:13.653447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526115+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:46:13.526115+0000","last_peered":"2024-02-21T07:46:13.526115+0000","last_clean":"2024-02-21T07:46:13.526115+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:46:13.526115+0000","last_undegraded":"2024-02-21T07:46:13.526115+0000","last_fullsized":"2024-02-21T07:46:13.526115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408897+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:46:14.408897+0000","last_peered":"2024-02-21T07:46:14.408897+0000","last_clean":"2024-02-21T07:46:14.408897+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:46:14.408897+0000","last_undegraded":"2024-02-21T07:46:14.408897+0000","last_fullsized":"2024-02-21T07:46:14.408897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524321+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:46:13.524321+0000","last_peered":"2024-02-21T07:46:13.524321+0000","last_clean":"2024-02-21T07:46:13.524321+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:46:13.524321+0000","last_undegraded":"2024-02-21T07:46:13.524321+0000","last_fullsized":"2024-02-21T07:46:13.524321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527735+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:46:13.527735+0000","last_peered":"2024-02-21T07:46:13.527735+0000","last_clean":"2024-02-21T07:46:13.527735+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:46:13.527735+0000","last_undegraded":"2024-02-21T07:46:13.527735+0000","last_fullsized":"2024-02-21T07:46:13.527735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408478+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:46:14.408478+0000","last_peered":"2024-02-21T07:46:14.408478+0000","last_clean":"2024-02-21T07:46:14.408478+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:46:14.408478+0000","last_undegraded":"2024-02-21T07:46:14.408478+0000","last_fullsized":"2024-02-21T07:46:14.408478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408128+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:46:14.408128+0000","last_peered":"2024-02-21T07:46:14.408128+0000","last_clean":"2024-02-21T07:46:14.408128+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:46:14.408128+0000","last_undegraded":"2024-02-21T07:46:14.408128+0000","last_fullsized":"2024-02-21T07:46:14.408128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"28'15","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526560+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:46:13.526560+0000","last_peered":"2024-02-21T07:46:13.526560+0000","last_clean":"2024-02-21T07:46:13.526560+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:46:13.526560+0000","last_undegraded":"2024-02-21T07:46:13.526560+0000","last_fullsized":"2024-02-21T07:46:13.526560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526002+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:46:13.526002+0000","last_peered":"2024-02-21T07:46:13.526002+0000","last_clean":"2024-02-21T07:46:13.526002+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:46:13.526002+0000","last_undegraded":"2024-02-21T07:46:13.526002+0000","last_fullsized":"2024-02-21T07:46:13.526002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652740+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:46:13.652740+0000","last_peered":"2024-02-21T07:46:13.652740+0000","last_clean":"2024-02-21T07:46:13.652740+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:46:13.652740+0000","last_undegraded":"2024-02-21T07:46:13.652740+0000","last_fullsized":"2024-02-21T07:46:13.652740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.477990+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:46:17.477990+0000","last_peered":"2024-02-21T07:46:17.477990+0000","last_clean":"2024-02-21T07:46:17.477990+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:46:17.477990+0000","last_undegraded":"2024-02-21T07:46:17.477990+0000","last_fullsized":"2024-02-21T07:46:17.477990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.655371+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:46:13.655371+0000","last_peered":"2024-02-21T07:46:13.655371+0000","last_clean":"2024-02-21T07:46:13.655371+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:46:13.655371+0000","last_undegraded":"2024-02-21T07:46:13.655371+0000","last_fullsized":"2024-02-21T07:46:13.655371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653064+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:46:13.653064+0000","last_peered":"2024-02-21T07:46:13.653064+0000","last_clean":"2024-02-21T07:46:13.653064+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:46:13.653064+0000","last_undegraded":"2024-02-21T07:46:13.653064+0000","last_fullsized":"2024-02-21T07:46:13.653064+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408640+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:46:14.408640+0000","last_peered":"2024-02-21T07:46:14.408640+0000","last_clean":"2024-02-21T07:46:14.408640+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:46:14.408640+0000","last_undegraded":"2024-02-21T07:46:14.408640+0000","last_fullsized":"2024-02-21T07:46:14.408640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524177+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:46:13.524177+0000","last_peered":"2024-02-21T07:46:13.524177+0000","last_clean":"2024-02-21T07:46:13.524177+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:46:13.524177+0000","last_undegraded":"2024-02-21T07:46:13.524177+0000","last_fullsized":"2024-02-21T07:46:13.524177+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525511+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:46:13.525511+0000","last_peered":"2024-02-21T07:46:13.525511+0000","last_clean":"2024-02-21T07:46:13.525511+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:46:13.525511+0000","last_undegraded":"2024-02-21T07:46:13.525511+0000","last_fullsized":"2024-02-21T07:46:13.525511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"28'6","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527361+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:46:13.527361+0000","last_peered":"2024-02-21T07:46:13.527361+0000","last_clean":"2024-02-21T07:46:13.527361+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:46:13.527361+0000","last_undegraded":"2024-02-21T07:46:13.527361+0000","last_fullsized":"2024-02-21T07:46:13.527361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408785+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:46:14.408785+0000","last_peered":"2024-02-21T07:46:14.408785+0000","last_clean":"2024-02-21T07:46:14.408785+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:46:14.408785+0000","last_undegraded":"2024-02-21T07:46:14.408785+0000","last_fullsized":"2024-02-21T07:46:14.408785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527089+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:46:13.527089+0000","last_peered":"2024-02-21T07:46:13.527089+0000","last_clean":"2024-02-21T07:46:13.527089+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:46:13.527089+0000","last_undegraded":"2024-02-21T07:46:13.527089+0000","last_fullsized":"2024-02-21T07:46:13.527089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'35","reported_seq":130,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:18.490230+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:46:18.490230+0000","last_peered":"2024-02-21T07:46:18.490230+0000","last_clean":"2024-02-21T07:46:18.490230+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:46:18.490230+0000","last_undegraded":"2024-02-21T07:46:18.490230+0000","last_fullsized":"2024-02-21T07:46:18.490230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64897,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":69,"num_read_kb":97,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761287+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:46:13.761287+0000","last_peered":"2024-02-21T07:46:13.761287+0000","last_clean":"2024-02-21T07:46:13.761287+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:46:13.761287+0000","last_undegraded":"2024-02-21T07:46:13.761287+0000","last_fullsized":"2024-02-21T07:46:13.761287+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408088+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:46:14.408088+0000","last_peered":"2024-02-21T07:46:14.408088+0000","last_clean":"2024-02-21T07:46:14.408088+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:46:14.408088+0000","last_undegraded":"2024-02-21T07:46:14.408088+0000","last_fullsized":"2024-02-21T07:46:14.408088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"28'4","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408974+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:46:14.408974+0000","last_peered":"2024-02-21T07:46:14.408974+0000","last_clean":"2024-02-21T07:46:14.408974+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:46:14.408974+0000","last_undegraded":"2024-02-21T07:46:14.408974+0000","last_fullsized":"2024-02-21T07:46:14.408974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673024+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:46:13.673024+0000","last_peered":"2024-02-21T07:46:13.673024+0000","last_clean":"2024-02-21T07:46:13.673024+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:46:13.673024+0000","last_undegraded":"2024-02-21T07:46:13.673024+0000","last_fullsized":"2024-02-21T07:46:13.673024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530274+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:46:13.530274+0000","last_peered":"2024-02-21T07:46:13.530274+0000","last_clean":"2024-02-21T07:46:13.530274+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:46:13.530274+0000","last_undegraded":"2024-02-21T07:46:13.530274+0000","last_fullsized":"2024-02-21T07:46:13.530274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":28,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653378+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:46:13.653378+0000","last_peered":"2024-02-21T07:46:13.653378+0000","last_clean":"2024-02-21T07:46:13.653378+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:46:13.653378+0000","last_undegraded":"2024-02-21T07:46:13.653378+0000","last_fullsized":"2024-02-21T07:46:13.653378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.760901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:46:13.760901+0000","last_peered":"2024-02-21T07:46:13.760901+0000","last_clean":"2024-02-21T07:46:13.760901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:46:13.760901+0000","last_undegraded":"2024-02-21T07:46:13.760901+0000","last_fullsized":"2024-02-21T07:46:13.760901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408721+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:46:14.408721+0000","last_peered":"2024-02-21T07:46:14.408721+0000","last_clean":"2024-02-21T07:46:14.408721+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:46:14.408721+0000","last_undegraded":"2024-02-21T07:46:14.408721+0000","last_fullsized":"2024-02-21T07:46:14.408721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'4","reported_seq":60,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.462711+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:46:17.462711+0000","last_peered":"2024-02-21T07:46:17.462711+0000","last_clean":"2024-02-21T07:46:17.462711+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:46:17.462711+0000","last_undegraded":"2024-02-21T07:46:17.462711+0000","last_fullsized":"2024-02-21T07:46:17.462711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527015+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:46:13.527015+0000","last_peered":"2024-02-21T07:46:13.527015+0000","last_clean":"2024-02-21T07:46:13.527015+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:46:13.527015+0000","last_undegraded":"2024-02-21T07:46:13.527015+0000","last_fullsized":"2024-02-21T07:46:13.527015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530163+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:46:13.530163+0000","last_peered":"2024-02-21T07:46:13.530163+0000","last_clean":"2024-02-21T07:46:13.530163+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:46:13.530163+0000","last_undegraded":"2024-02-21T07:46:13.530163+0000","last_fullsized":"2024-02-21T07:46:13.530163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.762457+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:46:13.762457+0000","last_peered":"2024-02-21T07:46:13.762457+0000","last_clean":"2024-02-21T07:46:13.762457+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:46:13.762457+0000","last_undegraded":"2024-02-21T07:46:13.762457+0000","last_fullsized":"2024-02-21T07:46:13.762457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408747+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:46:14.408747+0000","last_peered":"2024-02-21T07:46:14.408747+0000","last_clean":"2024-02-21T07:46:14.408747+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:46:14.408747+0000","last_undegraded":"2024-02-21T07:46:14.408747+0000","last_fullsized":"2024-02-21T07:46:14.408747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524194+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:46:13.524194+0000","last_peered":"2024-02-21T07:46:13.524194+0000","last_clean":"2024-02-21T07:46:13.524194+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:46:13.524194+0000","last_undegraded":"2024-02-21T07:46:13.524194+0000","last_fullsized":"2024-02-21T07:46:13.524194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526595+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:46:13.526595+0000","last_peered":"2024-02-21T07:46:13.526595+0000","last_clean":"2024-02-21T07:46:13.526595+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:46:13.526595+0000","last_undegraded":"2024-02-21T07:46:13.526595+0000","last_fullsized":"2024-02-21T07:46:13.526595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'2","reported_seq":27,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525217+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:46:13.525217+0000","last_peered":"2024-02-21T07:46:13.525217+0000","last_clean":"2024-02-21T07:46:13.525217+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:46:13.525217+0000","last_undegraded":"2024-02-21T07:46:13.525217+0000","last_fullsized":"2024-02-21T07:46:13.525217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":29,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305583+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:46:14.305583+0000","last_peered":"2024-02-21T07:46:14.305583+0000","last_clean":"2024-02-21T07:46:14.305583+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:46:14.305583+0000","last_undegraded":"2024-02-21T07:46:14.305583+0000","last_fullsized":"2024-02-21T07:46:14.305583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408139+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:46:14.408139+0000","last_peered":"2024-02-21T07:46:14.408139+0000","last_clean":"2024-02-21T07:46:14.408139+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:46:14.408139+0000","last_undegraded":"2024-02-21T07:46:14.408139+0000","last_fullsized":"2024-02-21T07:46:14.408139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527129+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:46:13.527129+0000","last_peered":"2024-02-21T07:46:13.527129+0000","last_clean":"2024-02-21T07:46:13.527129+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:46:13.527129+0000","last_undegraded":"2024-02-21T07:46:13.527129+0000","last_fullsized":"2024-02-21T07:46:13.527129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'7","reported_seq":67,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:17.463510+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:46:17.463510+0000","last_peered":"2024-02-21T07:46:17.463510+0000","last_clean":"2024-02-21T07:46:17.463510+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:46:17.463510+0000","last_undegraded":"2024-02-21T07:46:17.463510+0000","last_fullsized":"2024-02-21T07:46:17.463510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526680+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:46:13.526680+0000","last_peered":"2024-02-21T07:46:13.526680+0000","last_clean":"2024-02-21T07:46:13.526680+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:46:13.526680+0000","last_undegraded":"2024-02-21T07:46:13.526680+0000","last_fullsized":"2024-02-21T07:46:13.526680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527254+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:46:13.527254+0000","last_peered":"2024-02-21T07:46:13.527254+0000","last_clean":"2024-02-21T07:46:13.527254+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:46:13.527254+0000","last_undegraded":"2024-02-21T07:46:13.527254+0000","last_fullsized":"2024-02-21T07:46:13.527254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524025+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:46:13.524025+0000","last_peered":"2024-02-21T07:46:13.524025+0000","last_clean":"2024-02-21T07:46:13.524025+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:46:13.524025+0000","last_undegraded":"2024-02-21T07:46:13.524025+0000","last_fullsized":"2024-02-21T07:46:13.524025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.528187+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:46:13.528187+0000","last_peered":"2024-02-21T07:46:13.528187+0000","last_clean":"2024-02-21T07:46:13.528187+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:46:13.528187+0000","last_undegraded":"2024-02-21T07:46:13.528187+0000","last_fullsized":"2024-02-21T07:46:13.528187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526971+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:46:13.526971+0000","last_peered":"2024-02-21T07:46:13.526971+0000","last_clean":"2024-02-21T07:46:13.526971+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:46:13.526971+0000","last_undegraded":"2024-02-21T07:46:13.526971+0000","last_fullsized":"2024-02-21T07:46:13.526971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529807+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:46:13.529807+0000","last_peered":"2024-02-21T07:46:13.529807+0000","last_clean":"2024-02-21T07:46:13.529807+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:46:13.529807+0000","last_undegraded":"2024-02-21T07:46:13.529807+0000","last_fullsized":"2024-02-21T07:46:13.529807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526090+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:46:13.526090+0000","last_peered":"2024-02-21T07:46:13.526090+0000","last_clean":"2024-02-21T07:46:13.526090+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:46:13.526090+0000","last_undegraded":"2024-02-21T07:46:13.526090+0000","last_fullsized":"2024-02-21T07:46:13.526090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524314+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:46:13.524314+0000","last_peered":"2024-02-21T07:46:13.524314+0000","last_clean":"2024-02-21T07:46:13.524314+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:46:13.524314+0000","last_undegraded":"2024-02-21T07:46:13.524314+0000","last_fullsized":"2024-02-21T07:46:13.524314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527453+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:46:13.527453+0000","last_peered":"2024-02-21T07:46:13.527453+0000","last_clean":"2024-02-21T07:46:13.527453+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:46:13.527453+0000","last_undegraded":"2024-02-21T07:46:13.527453+0000","last_fullsized":"2024-02-21T07:46:13.527453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527920+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:46:13.527920+0000","last_peered":"2024-02-21T07:46:13.527920+0000","last_clean":"2024-02-21T07:46:13.527920+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:46:13.527920+0000","last_undegraded":"2024-02-21T07:46:13.527920+0000","last_fullsized":"2024-02-21T07:46:13.527920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408126+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:46:14.408126+0000","last_peered":"2024-02-21T07:46:14.408126+0000","last_clean":"2024-02-21T07:46:14.408126+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:46:14.408126+0000","last_undegraded":"2024-02-21T07:46:14.408126+0000","last_fullsized":"2024-02-21T07:46:14.408126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526942+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:46:13.526942+0000","last_peered":"2024-02-21T07:46:13.526942+0000","last_clean":"2024-02-21T07:46:13.526942+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:46:13.526942+0000","last_undegraded":"2024-02-21T07:46:13.526942+0000","last_fullsized":"2024-02-21T07:46:13.526942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408052+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:46:14.408052+0000","last_peered":"2024-02-21T07:46:14.408052+0000","last_clean":"2024-02-21T07:46:14.408052+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:46:14.408052+0000","last_undegraded":"2024-02-21T07:46:14.408052+0000","last_fullsized":"2024-02-21T07:46:14.408052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525801+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:46:13.525801+0000","last_peered":"2024-02-21T07:46:13.525801+0000","last_clean":"2024-02-21T07:46:13.525801+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:46:13.525801+0000","last_undegraded":"2024-02-21T07:46:13.525801+0000","last_fullsized":"2024-02-21T07:46:13.525801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524202+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:46:13.524202+0000","last_peered":"2024-02-21T07:46:13.524202+0000","last_clean":"2024-02-21T07:46:13.524202+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:46:13.524202+0000","last_undegraded":"2024-02-21T07:46:13.524202+0000","last_fullsized":"2024-02-21T07:46:13.524202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.527371+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:46:13.527371+0000","last_peered":"2024-02-21T07:46:13.527371+0000","last_clean":"2024-02-21T07:46:13.527371+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:46:13.527371+0000","last_undegraded":"2024-02-21T07:46:13.527371+0000","last_fullsized":"2024-02-21T07:46:13.527371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.761948+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:46:13.761948+0000","last_peered":"2024-02-21T07:46:13.761948+0000","last_clean":"2024-02-21T07:46:13.761948+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:46:13.761948+0000","last_undegraded":"2024-02-21T07:46:13.761948+0000","last_fullsized":"2024-02-21T07:46:13.761948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524487+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:46:13.524487+0000","last_peered":"2024-02-21T07:46:13.524487+0000","last_clean":"2024-02-21T07:46:13.524487+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:46:13.524487+0000","last_undegraded":"2024-02-21T07:46:13.524487+0000","last_fullsized":"2024-02-21T07:46:13.524487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408045+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:46:14.408045+0000","last_peered":"2024-02-21T07:46:14.408045+0000","last_clean":"2024-02-21T07:46:14.408045+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:46:14.408045+0000","last_undegraded":"2024-02-21T07:46:14.408045+0000","last_fullsized":"2024-02-21T07:46:14.408045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529849+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:46:13.529849+0000","last_peered":"2024-02-21T07:46:13.529849+0000","last_clean":"2024-02-21T07:46:13.529849+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:46:13.529849+0000","last_undegraded":"2024-02-21T07:46:13.529849+0000","last_fullsized":"2024-02-21T07:46:13.529849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529515+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:46:13.529515+0000","last_peered":"2024-02-21T07:46:13.529515+0000","last_clean":"2024-02-21T07:46:13.529515+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:46:13.529515+0000","last_undegraded":"2024-02-21T07:46:13.529515+0000","last_fullsized":"2024-02-21T07:46:13.529515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.525738+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:46:13.525738+0000","last_peered":"2024-02-21T07:46:13.525738+0000","last_clean":"2024-02-21T07:46:13.525738+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:46:13.525738+0000","last_undegraded":"2024-02-21T07:46:13.525738+0000","last_fullsized":"2024-02-21T07:46:13.525738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673027+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:46:13.673027+0000","last_peered":"2024-02-21T07:46:13.673027+0000","last_clean":"2024-02-21T07:46:13.673027+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:46:13.673027+0000","last_undegraded":"2024-02-21T07:46:13.673027+0000","last_fullsized":"2024-02-21T07:46:13.673027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.653328+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:46:13.653328+0000","last_peered":"2024-02-21T07:46:13.653328+0000","last_clean":"2024-02-21T07:46:13.653328+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:46:13.653328+0000","last_undegraded":"2024-02-21T07:46:13.653328+0000","last_fullsized":"2024-02-21T07:46:13.653328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305359+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:46:14.305359+0000","last_peered":"2024-02-21T07:46:14.305359+0000","last_clean":"2024-02-21T07:46:14.305359+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:46:14.305359+0000","last_undegraded":"2024-02-21T07:46:14.305359+0000","last_fullsized":"2024-02-21T07:46:14.305359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.408716+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:46:14.408716+0000","last_peered":"2024-02-21T07:46:14.408716+0000","last_clean":"2024-02-21T07:46:14.408716+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:46:14.408716+0000","last_undegraded":"2024-02-21T07:46:14.408716+0000","last_fullsized":"2024-02-21T07:46:14.408716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526476+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:46:13.526476+0000","last_peered":"2024-02-21T07:46:13.526476+0000","last_clean":"2024-02-21T07:46:13.526476+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:46:13.526476+0000","last_undegraded":"2024-02-21T07:46:13.526476+0000","last_fullsized":"2024-02-21T07:46:13.526476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.652818+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:46:13.652818+0000","last_peered":"2024-02-21T07:46:13.652818+0000","last_clean":"2024-02-21T07:46:13.652818+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:46:13.652818+0000","last_undegraded":"2024-02-21T07:46:13.652818+0000","last_fullsized":"2024-02-21T07:46:13.652818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:14.305318+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:46:14.305318+0000","last_peered":"2024-02-21T07:46:14.305318+0000","last_clean":"2024-02-21T07:46:14.305318+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:46:14.305318+0000","last_undegraded":"2024-02-21T07:46:14.305318+0000","last_fullsized":"2024-02-21T07:46:14.305318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.526661+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:46:13.526661+0000","last_peered":"2024-02-21T07:46:13.526661+0000","last_clean":"2024-02-21T07:46:13.526661+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:46:13.526661+0000","last_undegraded":"2024-02-21T07:46:13.526661+0000","last_fullsized":"2024-02-21T07:46:13.526661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.673033+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:46:13.673033+0000","last_peered":"2024-02-21T07:46:13.673033+0000","last_clean":"2024-02-21T07:46:13.673033+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:46:13.673033+0000","last_undegraded":"2024-02-21T07:46:13.673033+0000","last_fullsized":"2024-02-21T07:46:13.673033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.529834+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:46:13.529834+0000","last_peered":"2024-02-21T07:46:13.529834+0000","last_clean":"2024-02-21T07:46:13.529834+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:46:13.529834+0000","last_undegraded":"2024-02-21T07:46:13.529834+0000","last_fullsized":"2024-02-21T07:46:13.529834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.530300+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:46:13.530300+0000","last_peered":"2024-02-21T07:46:13.530300+0000","last_clean":"2024-02-21T07:46:13.530300+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:46:13.530300+0000","last_undegraded":"2024-02-21T07:46:13.530300+0000","last_fullsized":"2024-02-21T07:46:13.530300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:46:13.524462+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:46:13.524462+0000","last_peered":"2024-02-21T07:46:13.524462+0000","last_clean":"2024-02-21T07:46:13.524462+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:46:13.524462+0000","last_undegraded":"2024-02-21T07:46:13.524462+0000","last_fullsized":"2024-02-21T07:46:13.524462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69212,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":209,"num_read_kb":177,"num_write":167,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":138424,"data_compressed":3786,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":401408,"data_stored":217307,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444047,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]}]},{"osd":8,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":7,"up_from":17,"seq":73014444046,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":319488,"data_stored":152272,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9179999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2189999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9690000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444046,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":748827,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":156900,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444046,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":152362,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444047,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":331776,"data_stored":154125,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":385024,"data_stored":217079,"data_compressed":15985,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444047,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64897,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65125,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:46:24.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:24.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.338+0000 7fc335000640 1 Processor -- start 2024-02-21T07:46:24.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.339+0000 7fc335000640 1 -- start start 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.340+0000 7fc335000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc330186430 0x7fc33018b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc335000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33018b670 con 0x7fc330186050 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc335000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300d5aa0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc335000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33018a600 con 0x7fc330186430 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc32de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc330186050 0x7fc33018aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49826/0 (socket says 172.21.15.100:49826) 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc32de00640 1 -- 172.21.15.100:0/1214937011 learned_addr learned my addr 172.21.15.100:0/1214937011 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:24.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc32d400640 1 --2- 172.21.15.100:0/1214937011 >> v2:172.21.15.100:3300/0 conn(0x7fc330186430 0x7fc33018b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc32ca00640 1 -- 172.21.15.100:0/1214937011 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203363720 0 0) 0x7fc33018b670 con 0x7fc330186050 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.341+0000 7fc32ca00640 1 -- 172.21.15.100:0/1214937011 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003520 con 0x7fc330186050 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.342+0000 7fc32d400640 1 -- 172.21.15.100:0/1214937011 >> v1:172.21.15.156:6789/0 conn(0x7fc3300d3dc0 legacy=0x7fc3300d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.342+0000 7fc32d400640 1 -- 172.21.15.100:0/1214937011 >> v1:172.21.15.100:6789/0 conn(0x7fc330186050 legacy=0x7fc33018aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.342+0000 7fc32d400640 1 -- 172.21.15.100:0/1214937011 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300d54e0 con 0x7fc330186430 2024-02-21T07:46:24.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.343+0000 7fc32d400640 1 --2- 172.21.15.100:0/1214937011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc330186430 0x7fc33018b130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d1322ab3259a4e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.343+0000 7fc32ca00640 1 -- 172.21.15.100:0/1214937011 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31802cc60 con 0x7fc330186430 2024-02-21T07:46:24.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.343+0000 7fc32ca00640 1 -- 172.21.15.100:0/1214937011 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31802cdc0 con 0x7fc330186430 2024-02-21T07:46:24.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.343+0000 7fc32ca00640 1 -- 172.21.15.100:0/1214937011 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318034660 con 0x7fc330186430 2024-02-21T07:46:24.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 -- 172.21.15.100:0/1214937011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc330186430 msgr2=0x7fc33018b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 --2- 172.21.15.100:0/1214937011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc330186430 0x7fc33018b130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc318009d90 tx=0x7fc31802beb0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 -- 172.21.15.100:0/1214937011 shutdown_connections 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 --2- 172.21.15.100:0/1214937011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc330186430 0x7fc33018b130 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 -- 172.21.15.100:0/1214937011 >> 172.21.15.100:0/1214937011 conn(0x7fc3300d2540 msgr2=0x7fc3300d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 -- 172.21.15.100:0/1214937011 shutdown_connections 2024-02-21T07:46:24.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.344+0000 7fc335000640 1 -- 172.21.15.100:0/1214937011 wait complete. 2024-02-21T07:46:24.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.346+0000 7fc335000640 1 Processor -- start 2024-02-21T07:46:24.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.346+0000 7fc335000640 1 -- start start 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc330186050 0x7fc33021f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 0x7fc33021fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33021f9d0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330220c70 con 0x7fc33021f540 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc335000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc330220f50 con 0x7fc330186050 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc32de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.347+0000 7fc32de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49228/0 (socket says 172.21.15.100:49228) 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 -- 172.21.15.100:0/2383049066 learned_addr learned my addr 172.21.15.100:0/2383049066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32e800640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 0x7fc33021fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32d400640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc330186050 0x7fc33021f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 -- 172.21.15.100:0/2383049066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc330186050 msgr2=0x7fc33021f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc330186050 0x7fc33021f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 -- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 msgr2=0x7fc33021fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 0x7fc33021fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 -- 172.21.15.100:0/2383049066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009a70 con 0x7fc3300d3dc0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32e800640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 0x7fc33021fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc32de00640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c430 tx=0x7fc32000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.348+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320005ce0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.349+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320005e40 con 0x7fc3300d3dc0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.349+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3200072f0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.349+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc330221230 con 0x7fc3300d3dc0 2024-02-21T07:46:24.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.349+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3302217f0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.350+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3300d6a80 con 0x7fc3300d3dc0 2024-02-21T07:46:24.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.352+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc320007450 con 0x7fc3300d3dc0 2024-02-21T07:46:24.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.353+0000 7fc326000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 0x7fc30c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.353+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3200c9270 con 0x7fc3300d3dc0 2024-02-21T07:46:24.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.354+0000 7fc32d400640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 0x7fc30c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.354+0000 7fc32d400640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 0x7fc30c0a15f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc318036000 tx=0x7fc318030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.357+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc320096b60 con 0x7fc3300d3dc0 2024-02-21T07:46:24.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.560+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3300cfa30 con 0x7fc3300d3dc0 2024-02-21T07:46:24.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.562+0000 7fc326000640 1 -- 172.21.15.100:0/2383049066 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7fc3200966f0 con 0x7fc3300d3dc0 2024-02-21T07:46:24.568 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:24.568 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:24.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 msgr2=0x7fc30c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 0x7fc30c0a15f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc318036000 tx=0x7fc318030000 comp rx=0 tx=0).stop 2024-02-21T07:46:24.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 msgr2=0x7fc330179260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c430 tx=0x7fc32000c8f0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 shutdown_connections 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33021f540 0x7fc33021fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc330186050 0x7fc33021f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30c09f130 0x7fc30c0a15f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 --2- 172.21.15.100:0/2383049066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3300d3dc0 0x7fc330179260 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.564+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 >> 172.21.15.100:0/2383049066 conn(0x7fc3300d2540 msgr2=0x7fc3300fa220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.565+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 shutdown_connections 2024-02-21T07:46:24.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.565+0000 7fc335000640 1 -- 172.21.15.100:0/2383049066 wait complete. 2024-02-21T07:46:24.590 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:46:24.590 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:46:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.797+0000 7f4f4de00640 1 Processor -- start 2024-02-21T07:46:24.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.797+0000 7f4f4de00640 1 -- start start 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.799+0000 7f4f4de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f480c9b80 0x7f4f48188e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.799+0000 7f4f4de00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480f8510 con 0x7f4f48188a30 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4de00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480f87f0 con 0x7f4f480f9890 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f480f9470 con 0x7f4f480c9b80 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4ca00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4f48188a30 0x7f4f480c9470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49840/0 (socket says 172.21.15.100:49840) 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4ca00640 1 -- 172.21.15.100:0/2736672338 learned_addr learned my addr 172.21.15.100:0/2736672338 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f47e00640 1 --1- 172.21.15.100:0/2736672338 >> v1:172.21.15.170:6789/0 conn(0x7f4f480f9890 0x7f4f48071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:47580/0 (socket says 172.21.15.100:47580) 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4d400640 1 --2- 172.21.15.100:0/2736672338 >> v2:172.21.15.100:3300/0 conn(0x7f4f480c9b80 0x7f4f48188e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841060442 0 0) 0x7f4f480f87f0 con 0x7f4f480f9890 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f30003520 con 0x7f4f480f9890 2024-02-21T07:46:24.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766873504 0 0) 0x7f4f480f8510 con 0x7f4f48188a30 2024-02-21T07:46:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f480f87f0 con 0x7f4f48188a30 2024-02-21T07:46:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4d400640 1 -- 172.21.15.100:0/2736672338 >> v1:172.21.15.170:6789/0 conn(0x7f4f480f9890 legacy=0x7f4f48071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4d400640 1 -- 172.21.15.100:0/2736672338 >> v1:172.21.15.100:6789/0 conn(0x7f4f48188a30 legacy=0x7f4f480c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.800+0000 7f4f4d400640 1 -- 172.21.15.100:0/2736672338 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480f8ad0 con 0x7f4f480c9b80 2024-02-21T07:46:24.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.801+0000 7f4f4d400640 1 --2- 172.21.15.100:0/2736672338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f480c9b80 0x7f4f48188e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009d90 tx=0x7f4f4002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a04e8efc8da210 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4002cc60 con 0x7f4f480c9b80 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4002cdc0 con 0x7f4f480c9b80 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f47400640 1 -- 172.21.15.100:0/2736672338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40034660 con 0x7f4f480c9b80 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f4de00640 1 -- 172.21.15.100:0/2736672338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f480c9b80 msgr2=0x7f4f48188e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f4de00640 1 --2- 172.21.15.100:0/2736672338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f480c9b80 0x7f4f48188e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009d90 tx=0x7f4f4002beb0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f4de00640 1 -- 172.21.15.100:0/2736672338 shutdown_connections 2024-02-21T07:46:24.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f4de00640 1 --2- 172.21.15.100:0/2736672338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f480c9b80 0x7f4f48188e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.802+0000 7f4f4de00640 1 -- 172.21.15.100:0/2736672338 >> 172.21.15.100:0/2736672338 conn(0x7f4f480ce150 msgr2=0x7f4f480ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:24.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.803+0000 7f4f4de00640 1 -- 172.21.15.100:0/2736672338 shutdown_connections 2024-02-21T07:46:24.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.803+0000 7f4f4de00640 1 -- 172.21.15.100:0/2736672338 wait complete. 2024-02-21T07:46:24.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.805+0000 7f4f4de00640 1 Processor -- start 2024-02-21T07:46:24.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.805+0000 7f4f4de00640 1 -- start start 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48071e50 0x7f4f481663d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 0x7f4f48222490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48181cd0 con 0x7f4f48188a30 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f481837f0 con 0x7f4f48222010 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f482229d0 con 0x7f4f48071e50 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49250/0 (socket says 172.21.15.100:49250) 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4ca00640 1 -- 172.21.15.100:0/1631702944 learned_addr learned my addr 172.21.15.100:0/1631702944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f47e00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48071e50 0x7f4f481663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.806+0000 7f4f4d400640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 0x7f4f48222490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 -- 172.21.15.100:0/1631702944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48071e50 msgr2=0x7f4f481663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48071e50 0x7f4f481663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 -- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 msgr2=0x7f4f48222490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 0x7f4f48222490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 -- 172.21.15.100:0/1631702944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009a70 con 0x7f4f48188a30 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4d400640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 0x7f4f48222490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4ca00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c430 tx=0x7f4f3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c005ce0 con 0x7f4f48188a30 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c005e40 con 0x7f4f48188a30 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f481819f0 con 0x7f4f48188a30 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0072f0 con 0x7f4f48188a30 2024-02-21T07:46:24.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.807+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f48071370 con 0x7f4f48188a30 2024-02-21T07:46:24.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.808+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480751d0 con 0x7f4f48188a30 2024-02-21T07:46:24.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.810+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4f3c007450 con 0x7f4f48188a30 2024-02-21T07:46:24.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.812+0000 7f4f44c00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 0x7f4f280a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:24.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.812+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4f3c0c9240 con 0x7f4f48188a30 2024-02-21T07:46:24.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.812+0000 7f4f47e00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 0x7f4f280a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:24.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.813+0000 7f4f47e00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 0x7f4f280a15f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f48067da0 tx=0x7f4f34007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:24.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:24.815+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f3c093000 con 0x7f4f48188a30 2024-02-21T07:46:25.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.009+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f480f7dc0 con 0x7f4f48188a30 2024-02-21T07:46:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.010+0000 7f4f44c00640 1 -- 172.21.15.100:0/1631702944 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f3c0966c0 con 0x7f4f48188a30 2024-02-21T07:46:25.015 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 msgr2=0x7f4f280a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 0x7f4f280a15f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f48067da0 tx=0x7f4f34007cf0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 msgr2=0x7f4f481832b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c430 tx=0x7f4f3c00c8f0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 shutdown_connections 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f48222010 0x7f4f48222490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f48071e50 0x7f4f481663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4f2809f130 0x7f4f280a15f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 --2- 172.21.15.100:0/1631702944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f48188a30 0x7f4f481832b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 >> 172.21.15.100:0/1631702944 conn(0x7f4f480ce150 msgr2=0x7f4f481881e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:25.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 shutdown_connections 2024-02-21T07:46:25.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.012+0000 7f4f4de00640 1 -- 172.21.15.100:0/1631702944 wait complete. 2024-02-21T07:46:25.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:46:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.244+0000 7f9352600640 1 Processor -- start 2024-02-21T07:46:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.245+0000 7f9352600640 1 -- start start 2024-02-21T07:46:25.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f9352600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f934c1862c0 0x7f934c0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f9352600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f934c1894d0 0x7f934c18a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f9352600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0d2610 con 0x7f934c0d1e70 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f9352600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0d28f0 con 0x7f934c1894d0 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f9352600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0d2bd0 con 0x7f934c1862c0 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f934aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f934c0d1e70 0x7f934c188dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49844/0 (socket says 172.21.15.100:49844) 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f934aa00640 1 -- 172.21.15.100:0/2335282487 learned_addr learned my addr 172.21.15.100:0/2335282487 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f934b400640 1 --2- 172.21.15.100:0/2335282487 >> v2:172.21.15.170:3300/0 conn(0x7f934c1862c0 0x7f934c0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.247+0000 7f934be00640 1 --2- 172.21.15.100:0/2335282487 >> v2:172.21.15.100:3300/0 conn(0x7f934c1894d0 0x7f934c18a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.248+0000 7f934b400640 1 -- 172.21.15.100:0/2335282487 >> v2:172.21.15.100:3300/0 conn(0x7f934c1894d0 msgr2=0x7f934c18a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.248+0000 7f934b400640 1 --2- 172.21.15.100:0/2335282487 >> v2:172.21.15.100:3300/0 conn(0x7f934c1894d0 0x7f934c18a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.248+0000 7f934b400640 1 -- 172.21.15.100:0/2335282487 >> v1:172.21.15.100:6789/0 conn(0x7f934c0d1e70 legacy=0x7f934c188dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.248+0000 7f934b400640 1 -- 172.21.15.100:0/2335282487 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0d2eb0 con 0x7f934c1862c0 2024-02-21T07:46:25.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.248+0000 7f934a000640 1 -- 172.21.15.100:0/2335282487 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240155063 0 0) 0x7f934c0d2610 con 0x7f934c0d1e70 2024-02-21T07:46:25.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.249+0000 7f934b400640 1 --2- 172.21.15.100:0/2335282487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c0d1930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f934c08f9c0 tx=0x7f933c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a282d07fea96efa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.249+0000 7f934a000640 1 -- 172.21.15.100:0/2335282487 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c02e070 con 0x7f934c1862c0 2024-02-21T07:46:25.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.249+0000 7f934a000640 1 -- 172.21.15.100:0/2335282487 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0315a0 con 0x7f934c1862c0 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.249+0000 7f934a000640 1 -- 172.21.15.100:0/2335282487 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c031930 con 0x7f934c1862c0 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 -- 172.21.15.100:0/2335282487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 msgr2=0x7f934c0d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 --2- 172.21.15.100:0/2335282487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c0d1930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f934c08f9c0 tx=0x7f933c02b840 comp rx=0 tx=0).stop 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 -- 172.21.15.100:0/2335282487 shutdown_connections 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 --2- 172.21.15.100:0/2335282487 >> v2:172.21.15.100:3300/0 conn(0x7f934c1894d0 0x7f934c18a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 --2- 172.21.15.100:0/2335282487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c0d1930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 -- 172.21.15.100:0/2335282487 >> 172.21.15.100:0/2335282487 conn(0x7f934c06ab60 msgr2=0x7f934c06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 -- 172.21.15.100:0/2335282487 shutdown_connections 2024-02-21T07:46:25.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.250+0000 7f9352600640 1 -- 172.21.15.100:0/2335282487 wait complete. 2024-02-21T07:46:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.252+0000 7f9352600640 1 Processor -- start 2024-02-21T07:46:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.252+0000 7f9352600640 1 -- start start 2024-02-21T07:46:25.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f934c0d1e70 0x7f934c17dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c174660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c21cf30 con 0x7f934c1894d0 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c221550 con 0x7f934c0d1e70 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f9352600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c221830 con 0x7f934c1862c0 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f934be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f934be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49258/0 (socket says 172.21.15.100:49258) 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.253+0000 7f934be00640 1 -- 172.21.15.100:0/1443052455 learned_addr learned my addr 172.21.15.100:0/1443052455 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934aa00640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c174660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934b400640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f934c0d1e70 0x7f934c17dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 -- 172.21.15.100:0/1443052455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 msgr2=0x7f934c174660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c174660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 -- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f934c0d1e70 msgr2=0x7f934c17dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f934c0d1e70 0x7f934c17dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 -- 172.21.15.100:0/1443052455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c009400 con 0x7f934c1894d0 2024-02-21T07:46:25.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f934be00640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f934400efc0 tx=0x7f934400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.254+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344009ba0 con 0x7f934c1894d0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.255+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400f040 con 0x7f934c1894d0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.255+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440146c0 con 0x7f934c1894d0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.255+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c221b10 con 0x7f934c1894d0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.255+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c21cbc0 con 0x7f934c1894d0 2024-02-21T07:46:25.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.256+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c0d4a70 con 0x7f934c1894d0 2024-02-21T07:46:25.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.258+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9344014820 con 0x7f934c1894d0 2024-02-21T07:46:25.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.259+0000 7f9343400640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 0x7f93280a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.259+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f93440cab60 con 0x7f934c1894d0 2024-02-21T07:46:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.259+0000 7f934b400640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 0x7f93280a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.260+0000 7f934b400640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 0x7f93280a1620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f933c036000 tx=0x7f933c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.263+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f93440946f0 con 0x7f934c1894d0 2024-02-21T07:46:25.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.457+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f934c067c80 con 0x7f934c1894d0 2024-02-21T07:46:25.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.458+0000 7f9343400640 1 -- 172.21.15.100:0/1443052455 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9344096620 con 0x7f934c1894d0 2024-02-21T07:46:25.463 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 msgr2=0x7f93280a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 0x7f93280a1620 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f933c036000 tx=0x7f933c03d040 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 msgr2=0x7f934c174ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f934400efc0 tx=0x7f934400c490 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 shutdown_connections 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f932809f160 0x7f93280a1620 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f934c1894d0 0x7f934c174ba0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f934c1862c0 0x7f934c174660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 --2- 172.21.15.100:0/1443052455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f934c0d1e70 0x7f934c17dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 >> 172.21.15.100:0/1443052455 conn(0x7f934c06ab60 msgr2=0x7f934c0f80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:25.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 shutdown_connections 2024-02-21T07:46:25.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.461+0000 7f9352600640 1 -- 172.21.15.100:0/1443052455 wait complete. 2024-02-21T07:46:25.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:46:25.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.687+0000 7fd2bbe00640 1 Processor -- start 2024-02-21T07:46:25.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.687+0000 7fd2bbe00640 1 -- start start 2024-02-21T07:46:25.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2bbe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd2b415cd30 0x7fd2b415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2bbe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2b40f56c0 0x7fd2b40f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2bbe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b40f5230 con 0x7fd2b415c950 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2bbe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b40709c0 con 0x7fd2b40f56c0 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2bbe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b4185d60 con 0x7fd2b415cd30 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.689+0000 7fd2b9400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd2b415c950 0x7fd2b4188a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49848/0 (socket says 172.21.15.100:49848) 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b9400640 1 -- 172.21.15.100:0/1982542323 learned_addr learned my addr 172.21.15.100:0/1982542323 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1982542323 >> v2:172.21.15.170:3300/0 conn(0x7fd2b415cd30 0x7fd2b415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b9e00640 1 --2- 172.21.15.100:0/1982542323 >> v2:172.21.15.156:3300/0 conn(0x7fd2b40f56c0 0x7fd2b40f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b3e00640 1 -- 172.21.15.100:0/1982542323 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398848585 0 0) 0x7fd2b40f5230 con 0x7fd2b415c950 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b3e00640 1 -- 172.21.15.100:0/1982542323 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd29c003520 con 0x7fd2b415c950 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1982542323 >> v2:172.21.15.156:3300/0 conn(0x7fd2b40f56c0 msgr2=0x7fd2b40f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1982542323 >> v2:172.21.15.156:3300/0 conn(0x7fd2b40f56c0 0x7fd2b40f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1982542323 >> v1:172.21.15.100:6789/0 conn(0x7fd2b415c950 legacy=0x7fd2b4188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.690+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1982542323 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b40706e0 con 0x7fd2b415cd30 2024-02-21T07:46:25.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.691+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1982542323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b415d1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2b408d4b0 tx=0x7fd2a002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b90ff7f2aa97de1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2b3e00640 1 -- 172.21.15.100:0/1982542323 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a002e070 con 0x7fd2b415cd30 2024-02-21T07:46:25.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2b3e00640 1 -- 172.21.15.100:0/1982542323 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00315a0 con 0x7fd2b415cd30 2024-02-21T07:46:25.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2b3e00640 1 -- 172.21.15.100:0/1982542323 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0031930 con 0x7fd2b415cd30 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1982542323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 msgr2=0x7fd2b415d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1982542323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b415d1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2b408d4b0 tx=0x7fd2a002b840 comp rx=0 tx=0).stop 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1982542323 shutdown_connections 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1982542323 >> v2:172.21.15.156:3300/0 conn(0x7fd2b40f56c0 0x7fd2b40f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1982542323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b415d1b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1982542323 >> 172.21.15.100:0/1982542323 conn(0x7fd2b40668b0 msgr2=0x7fd2b4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1982542323 shutdown_connections 2024-02-21T07:46:25.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.692+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1982542323 wait complete. 2024-02-21T07:46:25.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.694+0000 7fd2bbe00640 1 Processor -- start 2024-02-21T07:46:25.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.695+0000 7fd2bbe00640 1 -- start start 2024-02-21T07:46:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4170d80 con 0x7fd2b40f56c0 2024-02-21T07:46:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4171060 con 0x7fd2b415c950 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2bbe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b4171340 con 0x7fd2b415cd30 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b8a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b8a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36704/0 (socket says 172.21.15.100:36704) 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1006930754 learned_addr learned my addr 172.21.15.100:0/1006930754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49264/0 (socket says 172.21.15.100:49264) 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.696+0000 7fd2b9e00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1006930754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 msgr2=0x7fd2b406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1006930754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 msgr2=0x7fd2b416fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 -- 172.21.15.100:0/1006930754 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009400 con 0x7fd2b415c950 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b9400640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b8a00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009890 tx=0x7fd2a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0032630 con 0x7fd2b415c950 2024-02-21T07:46:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a0032790 con 0x7fd2b415c950 2024-02-21T07:46:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0032b40 con 0x7fd2b415c950 2024-02-21T07:46:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b4171620 con 0x7fd2b415c950 2024-02-21T07:46:25.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.697+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b4171be0 con 0x7fd2b415c950 2024-02-21T07:46:25.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.698+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b4067c80 con 0x7fd2b415c950 2024-02-21T07:46:25.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.700+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd2a003b3f0 con 0x7fd2b415c950 2024-02-21T07:46:25.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.701+0000 7fd2b1600640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 0x7fd2940a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:25.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.702+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd2a00ebe40 con 0x7fd2b415c950 2024-02-21T07:46:25.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.702+0000 7fd2b9400640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 0x7fd2940a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:25.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.702+0000 7fd2b9400640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 0x7fd2940a15f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005880 tx=0x7fd2a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:25.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.706+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2a00b59d0 con 0x7fd2b415c950 2024-02-21T07:46:25.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.904+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2b4174fe0 con 0x7fd2b415c950 2024-02-21T07:46:25.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.905+0000 7fd2b1600640 1 -- 172.21.15.100:0/1006930754 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2a00b7900 con 0x7fd2b415c950 2024-02-21T07:46:25.911 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 msgr2=0x7fd2940a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 0x7fd2940a15f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8005880 tx=0x7fd2a8009040 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 msgr2=0x7fd2b4170440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0009890 tx=0x7fd2a00046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 shutdown_connections 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2b415cd30 0x7fd2b406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2b415c950 0x7fd2b4170440 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd29409f130 0x7fd2940a15f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 --2- 172.21.15.100:0/1006930754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2b40f56c0 0x7fd2b416fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 >> 172.21.15.100:0/1006930754 conn(0x7fd2b40668b0 msgr2=0x7fd2b406fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 shutdown_connections 2024-02-21T07:46:25.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:25.908+0000 7fd2bbe00640 1 -- 172.21.15.100:0/1006930754 wait complete. 2024-02-21T07:46:25.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:46:26.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.136+0000 7f79d5400640 1 Processor -- start 2024-02-21T07:46:26.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.136+0000 7f79d5400640 1 -- start start 2024-02-21T07:46:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79d5400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79d00d41c0 0x7f79d008bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79d5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79d00d4a90 0x7f79d00d4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79d5400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d00d5ef0 con 0x7f79d0186110 2024-02-21T07:46:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79d5400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d006ac00 con 0x7f79d00d4a90 2024-02-21T07:46:26.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79d5400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d006aee0 con 0x7f79d00d41c0 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79cf200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79d00d4a90 0x7f79d00d4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.138+0000 7f79ce800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f79d0186110 0x7f79d006bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:47590/0 (socket says 172.21.15.100:47590) 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79ce800640 1 -- 172.21.15.100:0/2662188153 learned_addr learned my addr 172.21.15.100:0/2662188153 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cde00640 1 --2- 172.21.15.100:0/2662188153 >> v2:172.21.15.156:3300/0 conn(0x7f79d00d41c0 0x7f79d008bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cd400640 1 -- 172.21.15.100:0/2662188153 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428697822 0 0) 0x7f79d00d5ef0 con 0x7f79d0186110 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cd400640 1 -- 172.21.15.100:0/2662188153 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b4003520 con 0x7f79d0186110 2024-02-21T07:46:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cf200640 1 -- 172.21.15.100:0/2662188153 >> v2:172.21.15.156:3300/0 conn(0x7f79d00d41c0 msgr2=0x7f79d008bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:26.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cf200640 1 --2- 172.21.15.100:0/2662188153 >> v2:172.21.15.156:3300/0 conn(0x7f79d00d41c0 0x7f79d008bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cf200640 1 -- 172.21.15.100:0/2662188153 >> v1:172.21.15.170:6789/0 conn(0x7f79d0186110 legacy=0x7f79d006bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.139+0000 7f79cf200640 1 -- 172.21.15.100:0/2662188153 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d006b1c0 con 0x7f79d00d4a90 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.140+0000 7f79cf200640 1 --2- 172.21.15.100:0/2662188153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00d4f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79d0066a40 tx=0x7f79c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f735a047e6a2e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.140+0000 7f79cd400640 1 -- 172.21.15.100:0/2662188153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c802e070 con 0x7f79d00d4a90 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.140+0000 7f79cd400640 1 -- 172.21.15.100:0/2662188153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c80315a0 con 0x7f79d00d4a90 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.140+0000 7f79cd400640 1 -- 172.21.15.100:0/2662188153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8031930 con 0x7f79d00d4a90 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 -- 172.21.15.100:0/2662188153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 msgr2=0x7f79d00d4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 --2- 172.21.15.100:0/2662188153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00d4f20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f79d0066a40 tx=0x7f79c802b840 comp rx=0 tx=0).stop 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 -- 172.21.15.100:0/2662188153 shutdown_connections 2024-02-21T07:46:26.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 --2- 172.21.15.100:0/2662188153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00d4f20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 --2- 172.21.15.100:0/2662188153 >> v2:172.21.15.156:3300/0 conn(0x7f79d00d41c0 0x7f79d008bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 -- 172.21.15.100:0/2662188153 >> 172.21.15.100:0/2662188153 conn(0x7f79d00fe210 msgr2=0x7f79d00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 -- 172.21.15.100:0/2662188153 shutdown_connections 2024-02-21T07:46:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.141+0000 7f79d5400640 1 -- 172.21.15.100:0/2662188153 wait complete. 2024-02-21T07:46:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.143+0000 7f79d5400640 1 Processor -- start 2024-02-21T07:46:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.143+0000 7f79d5400640 1 -- start start 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00fa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d0186110 0x7f79d00fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0182820 con 0x7f79d00d4a90 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d00f9e90 con 0x7f79d00d41c0 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79d5400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0182260 con 0x7f79d0186110 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36718/0 (socket says 172.21.15.100:36718) 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 -- 172.21.15.100:0/1026906302 learned_addr learned my addr 172.21.15.100:0/1026906302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79cde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79cf200640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d0186110 0x7f79d00fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 -- 172.21.15.100:0/1026906302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d0186110 msgr2=0x7f79d00fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d0186110 0x7f79d00fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 -- 172.21.15.100:0/1026906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 msgr2=0x7f79d00fa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00fa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.145+0000 7f79ce800640 1 -- 172.21.15.100:0/1026906302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8009400 con 0x7f79d00d41c0 2024-02-21T07:46:26.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79ce800640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79c0001460 tx=0x7f79c000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c000ace0 con 0x7f79d00d41c0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c000ae60 con 0x7f79d00d41c0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d0182540 con 0x7f79d00d41c0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c0012600 con 0x7f79d00d41c0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.146+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d00f9ab0 con 0x7f79d00d41c0 2024-02-21T07:46:26.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.147+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00d3860 con 0x7f79d00d41c0 2024-02-21T07:46:26.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.149+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f79c0007070 con 0x7f79d00d41c0 2024-02-21T07:46:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.150+0000 7f79c6a00640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 0x7f79ac0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.151+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f79c00c9fe0 con 0x7f79d00d41c0 2024-02-21T07:46:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.151+0000 7f79cde00640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 0x7f79ac0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.151+0000 7f79cde00640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 0x7f79ac0a1620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79d0184c20 tx=0x7f79b8009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.153+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f79c0093d90 con 0x7f79d00d41c0 2024-02-21T07:46:26.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.352+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f79d0067c80 con 0x7f79d00d41c0 2024-02-21T07:46:26.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.352+0000 7f79c6a00640 1 -- 172.21.15.100:0/1026906302 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f79c00170a0 con 0x7f79d00d41c0 2024-02-21T07:46:26.358 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:46:26.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 msgr2=0x7f79ac0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 0x7f79ac0a1620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79d0184c20 tx=0x7f79b8009190 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 msgr2=0x7f79d016e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79c0001460 tx=0x7f79c000a430 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 shutdown_connections 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f79d0186110 0x7f79d00fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f79ac09f160 0x7f79ac0a1620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d00d4a90 0x7f79d00fa2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 --2- 172.21.15.100:0/1026906302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79d00d41c0 0x7f79d016e280 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 >> 172.21.15.100:0/1026906302 conn(0x7f79d00fe210 msgr2=0x7f79d008c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 shutdown_connections 2024-02-21T07:46:26.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.355+0000 7f79d5400640 1 -- 172.21.15.100:0/1026906302 wait complete. 2024-02-21T07:46:26.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:26.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.579+0000 7f0c58400640 1 Processor -- start 2024-02-21T07:46:26.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.580+0000 7f0c58400640 1 -- start start 2024-02-21T07:46:26.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.581+0000 7f0c58400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 0x7f0c5018aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.581+0000 7f0c58400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c50186430 0x7f0c5018af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.581+0000 7f0c58400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500d5aa0 con 0x7f0c5018b4a0 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.581+0000 7f0c58400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5018a600 con 0x7f0c50186430 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.581+0000 7f0c58400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500d69b0 con 0x7f0c50186050 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 0x7f0c5018aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c56400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0c5018b4a0 0x7f0c5018bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:47604/0 (socket says 172.21.15.100:47604) 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c50186430 0x7f0c5018af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c56400640 1 -- 172.21.15.100:0/3368614127 learned_addr learned my addr 172.21.15.100:0/3368614127 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c4fe00640 1 -- 172.21.15.100:0/3368614127 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574715226 0 0) 0x7f0c500d5aa0 con 0x7f0c5018b4a0 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55000640 1 -- 172.21.15.100:0/3368614127 >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 msgr2=0x7f0c5018aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:26.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55000640 1 --2- 172.21.15.100:0/3368614127 >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 0x7f0c5018aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55000640 1 -- 172.21.15.100:0/3368614127 >> v1:172.21.15.170:6789/0 conn(0x7f0c5018b4a0 legacy=0x7f0c5018bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55000640 1 -- 172.21.15.100:0/3368614127 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500d54e0 con 0x7f0c50186430 2024-02-21T07:46:26.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.582+0000 7f0c55a00640 1 --2- 172.21.15.100:0/3368614127 >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 0x7f0c5018aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.583+0000 7f0c55000640 1 --2- 172.21.15.100:0/3368614127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c50186430 0x7f0c5018af60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c50067490 tx=0x7f0c3c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b53f1e9bb32dfc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c4fe00640 1 -- 172.21.15.100:0/3368614127 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c031830 con 0x7f0c50186430 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c4fe00640 1 -- 172.21.15.100:0/3368614127 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c031990 con 0x7f0c50186430 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c4fe00640 1 -- 172.21.15.100:0/3368614127 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c031d20 con 0x7f0c50186430 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 -- 172.21.15.100:0/3368614127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c50186430 msgr2=0x7f0c5018af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 --2- 172.21.15.100:0/3368614127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c50186430 0x7f0c5018af60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0c50067490 tx=0x7f0c3c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 -- 172.21.15.100:0/3368614127 shutdown_connections 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 --2- 172.21.15.100:0/3368614127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c50186430 0x7f0c5018af60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 --2- 172.21.15.100:0/3368614127 >> v2:172.21.15.170:3300/0 conn(0x7f0c50186050 0x7f0c5018aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 -- 172.21.15.100:0/3368614127 >> 172.21.15.100:0/3368614127 conn(0x7f0c500d2540 msgr2=0x7f0c500d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:26.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 -- 172.21.15.100:0/3368614127 shutdown_connections 2024-02-21T07:46:26.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.584+0000 7f0c58400640 1 -- 172.21.15.100:0/3368614127 wait complete. 2024-02-21T07:46:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.586+0000 7f0c58400640 1 Processor -- start 2024-02-21T07:46:26.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.586+0000 7f0c58400640 1 -- start start 2024-02-21T07:46:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c5018b4a0 0x7f0c5016e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 0x7f0c500d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5006b0a0 con 0x7f0c50186050 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5006b2a0 con 0x7f0c5018b4a0 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c58400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5006b580 con 0x7f0c5016e840 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 0x7f0c500d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49302/0 (socket says 172.21.15.100:49302) 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c55a00640 1 -- 172.21.15.100:0/3760446695 learned_addr learned my addr 172.21.15.100:0/3760446695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c55000640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c5018b4a0 0x7f0c5016e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 -- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c5018b4a0 msgr2=0x7f0c5016e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c5018b4a0 0x7f0c5016e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 -- 172.21.15.100:0/3760446695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 msgr2=0x7f0c5006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c56400640 1 -- 172.21.15.100:0/3760446695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44009400 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.588+0000 7f0c55a00640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c56400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 0x7f0c500d0e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c780 tx=0x7f0c4800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48004d60 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800a640 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800a9f0 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c009400 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.589+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5006bb40 con 0x7f0c5016e840 2024-02-21T07:46:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.590+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c50067c80 con 0x7f0c5016e840 2024-02-21T07:46:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.592+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0c4800ab50 con 0x7f0c5016e840 2024-02-21T07:46:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.593+0000 7f0c4d600640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 0x7f0c300a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.594+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c480c9060 con 0x7f0c5016e840 2024-02-21T07:46:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.594+0000 7f0c55a00640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 0x7f0c300a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.594+0000 7f0c55a00640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 0x7f0c300a1620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009fd0 tx=0x7f0c44009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.596+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c48092e40 con 0x7f0c5016e840 2024-02-21T07:46:26.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.834+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c500f4e80 con 0x7f0c5016e840 2024-02-21T07:46:26.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.835+0000 7f0c4d600640 1 -- 172.21.15.100:0/3760446695 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7f0c48018070 con 0x7f0c5016e840 2024-02-21T07:46:26.841 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:26.841 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:26.841 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 msgr2=0x7f0c300a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 0x7f0c300a1620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009fd0 tx=0x7f0c44009190 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 msgr2=0x7f0c500d0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 0x7f0c500d0e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c780 tx=0x7f0c4800cc40 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 shutdown_connections 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c5016e840 0x7f0c500d0e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c5018b4a0 0x7f0c5016e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c3009f160 0x7f0c300a1620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 --2- 172.21.15.100:0/3760446695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c50186050 0x7f0c5006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 >> 172.21.15.100:0/3760446695 conn(0x7f0c500d2540 msgr2=0x7f0c501852b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 shutdown_connections 2024-02-21T07:46:26.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:26.838+0000 7f0c58400640 1 -- 172.21.15.100:0/3760446695 wait complete. 2024-02-21T07:46:26.861 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:46:27.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.066+0000 7fb805800640 1 Processor -- start 2024-02-21T07:46:27.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.066+0000 7fb805800640 1 -- start start 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.068+0000 7fb805800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb8000d6100 0x7fb80018bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.068+0000 7fb805800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000d6550 con 0x7fb800189c60 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.068+0000 7fb805800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80006ce50 con 0x7fb8001828d0 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.068+0000 7fb805800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000d6a60 con 0x7fb8000d6100 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7ffe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb8001828d0 0x7fb80006c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:47608/0 (socket says 172.21.15.100:47608) 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7ffe00640 1 -- 172.21.15.100:0/4177924542 learned_addr learned my addr 172.21.15.100:0/4177924542 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb804e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb8000d6100 0x7fb80018bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7ff400640 1 --1- 172.21.15.100:0/4177924542 >> v1:172.21.15.100:6789/0 conn(0x7fb800189c60 0x7fb8000d59f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49858/0 (socket says 172.21.15.100:49858) 2024-02-21T07:46:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557139660 0 0) 0x7fb80006ce50 con 0x7fb8001828d0 2024-02-21T07:46:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e4003520 con 0x7fb8001828d0 2024-02-21T07:46:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb804e00640 1 -- 172.21.15.100:0/4177924542 >> v1:172.21.15.170:6789/0 conn(0x7fb8001828d0 legacy=0x7fb80006c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb804e00640 1 -- 172.21.15.100:0/4177924542 >> v1:172.21.15.100:6789/0 conn(0x7fb800189c60 legacy=0x7fb8000d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635841783 0 0) 0x7fb8000d6550 con 0x7fb800189c60 2024-02-21T07:46:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.069+0000 7fb804e00640 1 -- 172.21.15.100:0/4177924542 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000d6780 con 0x7fb8000d6100 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.070+0000 7fb804e00640 1 --2- 172.21.15.100:0/4177924542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb80018bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009d90 tx=0x7fb7f802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473fb0912fc48c98 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f802cc60 con 0x7fb8000d6100 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f802cdc0 con 0x7fb8000d6100 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb7fea00640 1 -- 172.21.15.100:0/4177924542 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8034660 con 0x7fb8000d6100 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 -- 172.21.15.100:0/4177924542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 msgr2=0x7fb80018bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 --2- 172.21.15.100:0/4177924542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb80018bd60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009d90 tx=0x7fb7f802beb0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 -- 172.21.15.100:0/4177924542 shutdown_connections 2024-02-21T07:46:27.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 --2- 172.21.15.100:0/4177924542 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb80018bd60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 -- 172.21.15.100:0/4177924542 >> 172.21.15.100:0/4177924542 conn(0x7fb8000fdf30 msgr2=0x7fb8000fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 -- 172.21.15.100:0/4177924542 shutdown_connections 2024-02-21T07:46:27.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.071+0000 7fb805800640 1 -- 172.21.15.100:0/4177924542 wait complete. 2024-02-21T07:46:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.073+0000 7fb805800640 1 Processor -- start 2024-02-21T07:46:27.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.074+0000 7fb805800640 1 -- start start 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8001828d0 0x7fb8000d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb800189c60 0x7fb8000f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000f87b0 con 0x7fb8001828d0 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000f72f0 con 0x7fb800189c60 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb805800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000f75d0 con 0x7fb8000d6100 2024-02-21T07:46:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34042/0 (socket says 172.21.15.100:34042) 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3381774519 learned_addr learned my addr 172.21.15.100:0/3381774519 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ff400640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8001828d0 0x7fb8000d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb804e00640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb800189c60 0x7fb8000f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb800189c60 msgr2=0x7fb8000f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb800189c60 0x7fb8000f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3381774519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8001828d0 msgr2=0x7fb8000d3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8001828d0 0x7fb8000d3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.075+0000 7fb7ffe00640 1 -- 172.21.15.100:0/3381774519 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f8009a70 con 0x7fb8000d6100 2024-02-21T07:46:27.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb7ffe00640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c500 tx=0x7fb7f000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0005ce0 con 0x7fb8000d6100 2024-02-21T07:46:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0005e40 con 0x7fb8000d6100 2024-02-21T07:46:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000f78b0 con 0x7fb8000d6100 2024-02-21T07:46:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0007330 con 0x7fb8000d6100 2024-02-21T07:46:27.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.076+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000f7e70 con 0x7fb8000d6100 2024-02-21T07:46:27.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.077+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8000f8060 con 0x7fb8000d6100 2024-02-21T07:46:27.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.079+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb7f0007550 con 0x7fb8000d6100 2024-02-21T07:46:27.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.080+0000 7fb7f7e00640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 0x7fb7e00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.081+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb7f00c91a0 con 0x7fb8000d6100 2024-02-21T07:46:27.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.081+0000 7fb7ff400640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 0x7fb7e00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.081+0000 7fb7ff400640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 0x7fb7e00a15f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007f70 tx=0x7fb7ec007f00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.084+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb7f0092fe0 con 0x7fb8000d6100 2024-02-21T07:46:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.280+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb800075160 con 0x7fb8000d6100 2024-02-21T07:46:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.282+0000 7fb7f7e00640 1 -- 172.21.15.100:0/3381774519 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7fb7f0017090 con 0x7fb8000d6100 2024-02-21T07:46:27.289 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:27.289 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 msgr2=0x7fb7e00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 0x7fb7e00a15f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007f70 tx=0x7fb7ec007f00 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 msgr2=0x7fb800159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000c500 tx=0x7fb7f000c9c0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 shutdown_connections 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb800189c60 0x7fb8000f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb7e009f130 0x7fb7e00a15f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8001828d0 0x7fb8000d3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 --2- 172.21.15.100:0/3381774519 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8000d6100 0x7fb800159f50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 >> 172.21.15.100:0/3381774519 conn(0x7fb8000fdf30 msgr2=0x7fb80006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 shutdown_connections 2024-02-21T07:46:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.285+0000 7fb805800640 1 -- 172.21.15.100:0/3381774519 wait complete. 2024-02-21T07:46:27.310 DEBUG:tasks.fwd_scrub:Yielding 2024-02-21T07:46:27.310 INFO:teuthology.run_tasks:Running task background_exec... 2024-02-21T07:46:27.320 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:46:27.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-02-21T07:46:27.321 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-02-21T07:46:27.321 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:46:27.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:46:27.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:46:27.326 INFO:teuthology.run_tasks:Running task workunit... 2024-02-21T07:46:27.373 INFO:tasks.workunit:Pulling workunits from ref e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb 2024-02-21T07:46:27.373 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-21T07:46:27.373 INFO:tasks.workunit:timeout=3h 2024-02-21T07:46:27.373 INFO:tasks.workunit:cleanup=True 2024-02-21T07:46:27.373 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:27.413 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:27.413 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-21T07:46:27.413 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 27h/39d Inode: 1099511628283 Links: 2 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-02-21 07:45:51.358264232 +0000 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-02-21 07:45:51.358264232 +0000 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-02-21 07:46:11.459068983 +0000 2024-02-21T07:46:27.414 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-02-21 07:45:51.358264232 +0000 2024-02-21T07:46:27.414 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-21T07:46:27.414 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-21T07:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.505+0000 7f3c1fa00640 1 Processor -- start 2024-02-21T07:46:27.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.505+0000 7f3c1fa00640 1 -- start start 2024-02-21T07:46:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1fa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c18188b90 0x7f3c18183510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1fa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18070fa0 con 0x7f3c18183a50 2024-02-21T07:46:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1fa00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c18071280 con 0x7f3c18072600 2024-02-21T07:46:27.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1fa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c18071560 con 0x7f3c18188b90 2024-02-21T07:46:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c18188b90 0x7f3c18183510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1da00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3c18183a50 0x7f3c180f8090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49874/0 (socket says 172.21.15.100:49874) 2024-02-21T07:46:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c1da00640 1 -- 172.21.15.100:0/2044395816 learned_addr learned my addr 172.21.15.100:0/2044395816 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:27.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544977350 0 0) 0x7f3c18070fa0 con 0x7f3c18183a50 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bfc003520 con 0x7f3c18183a50 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363610973 0 0) 0x7f3c18071280 con 0x7f3c18072600 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.507+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c18070fa0 con 0x7f3c18072600 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.508+0000 7f3c1d000640 1 -- 172.21.15.100:0/2044395816 >> v1:172.21.15.156:6789/0 conn(0x7f3c18072600 legacy=0x7f3c18188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.508+0000 7f3c1d000640 1 -- 172.21.15.100:0/2044395816 >> v1:172.21.15.100:6789/0 conn(0x7f3c18183a50 legacy=0x7f3c180f8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.508+0000 7f3c1d000640 1 -- 172.21.15.100:0/2044395816 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18071840 con 0x7f3c18188b90 2024-02-21T07:46:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.509+0000 7f3c1d000640 1 --2- 172.21.15.100:0/2044395816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c18183510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097a0 tx=0x7f3c0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d15f2f923f96c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.509+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08031830 con 0x7f3c18188b90 2024-02-21T07:46:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.509+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08031990 con 0x7f3c18188b90 2024-02-21T07:46:27.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.509+0000 7f3c17e00640 1 -- 172.21.15.100:0/2044395816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08031d00 con 0x7f3c18188b90 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 -- 172.21.15.100:0/2044395816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 msgr2=0x7f3c18183510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/2044395816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c18183510 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3c080097a0 tx=0x7f3c0802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 -- 172.21.15.100:0/2044395816 shutdown_connections 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/2044395816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c18183510 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 -- 172.21.15.100:0/2044395816 >> 172.21.15.100:0/2044395816 conn(0x7f3c180668b0 msgr2=0x7f3c18066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 -- 172.21.15.100:0/2044395816 shutdown_connections 2024-02-21T07:46:27.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.510+0000 7f3c1fa00640 1 -- 172.21.15.100:0/2044395816 wait complete. 2024-02-21T07:46:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.512+0000 7f3c1fa00640 1 Processor -- start 2024-02-21T07:46:27.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.512+0000 7f3c1fa00640 1 -- start start 2024-02-21T07:46:27.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c18183a50 0x7f3c180f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18187e40 con 0x7f3c18188b90 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18186ac0 con 0x7f3c18183a50 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.513+0000 7f3c1fa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18186da0 con 0x7f3c18072600 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34050/0 (socket says 172.21.15.100:34050) 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1d000640 1 -- 172.21.15.100:0/162798302 learned_addr learned my addr 172.21.15.100:0/162798302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49328/0 (socket says 172.21.15.100:49328) 2024-02-21T07:46:27.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c18183a50 0x7f3c180f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 -- 172.21.15.100:0/162798302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 msgr2=0x7f3c18159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 -- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c18183a50 msgr2=0x7f3c180f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c18183a50 0x7f3c180f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1da00640 1 -- 172.21.15.100:0/162798302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009400 con 0x7f3c18188b90 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.514+0000 7f3c1d000640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c1da00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000ca70 tx=0x7f3c1000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c15600640 1 -- 172.21.15.100:0/162798302 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000abd0 con 0x7f3c18188b90 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c15600640 1 -- 172.21.15.100:0/162798302 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1000ad30 con 0x7f3c18188b90 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c15600640 1 -- 172.21.15.100:0/162798302 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10012640 con 0x7f3c18188b90 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18187080 con 0x7f3c18188b90 2024-02-21T07:46:27.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.515+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18187640 con 0x7f3c18188b90 2024-02-21T07:46:27.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.520+0000 7f3c15600640 1 -- 172.21.15.100:0/162798302 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f3c10007070 con 0x7f3c18188b90 2024-02-21T07:46:27.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.520+0000 7f3c227e6740 1 Processor -- start 2024-02-21T07:46:27.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.521+0000 7f3c227e6740 1 -- start start 2024-02-21T07:46:27.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.521+0000 7f3c15600640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 0x7f3bf40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c15600640 1 -- 172.21.15.100:0/162798302 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3c100c9a60 con 0x7f3c18188b90 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73b51c0 0x5562b73b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 0x7f3bf40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b7335300 con 0x5562b73f0890 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b72e7e50 con 0x5562b73b5ae0 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c227e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b72e5380 con 0x5562b73b51c0 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c0fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c0fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36770/0 (socket says 172.21.15.100:36770) 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c0fe00640 1 -- 172.21.15.100:0/3739845419 learned_addr learned my addr 172.21.15.100:0/3739845419 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c1d000640 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73b51c0 0x5562b73b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.522+0000 7f3c1da00640 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 -- 172.21.15.100:0/3739845419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73b51c0 msgr2=0x5562b73b55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73b51c0 0x5562b73b55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 -- 172.21.15.100:0/3739845419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 msgr2=0x5562b73f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 -- 172.21.15.100:0/3739845419 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b72a9c80 con 0x5562b73b5ae0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 0x7f3bf40a15f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001b70 tx=0x7f3c000166d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001280 tx=0x7f3c0001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf1a9a047a8437ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0d600640 1 -- 172.21.15.100:0/3739845419 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00001d20 con 0x5562b73b5ae0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0d600640 1 -- 172.21.15.100:0/3739845419 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0001d070 con 0x5562b73b5ae0 2024-02-21T07:46:27.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.523+0000 7f3c0d600640 1 -- 172.21.15.100:0/3739845419 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00021630 con 0x5562b73b5ae0 2024-02-21T07:46:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 -- 172.21.15.100:0/3739845419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 msgr2=0x5562b73f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001280 tx=0x7f3c0001c000 comp rx=0 tx=0).stop 2024-02-21T07:46:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 -- 172.21.15.100:0/3739845419 shutdown_connections 2024-02-21T07:46:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b73f0350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 --2- 172.21.15.100:0/3739845419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73b51c0 0x5562b73b55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 -- 172.21.15.100:0/3739845419 >> 172.21.15.100:0/3739845419 conn(0x5562b7377790 msgr2=0x5562b7378810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 -- 172.21.15.100:0/3739845419 shutdown_connections 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.524+0000 7f3c227e6740 1 -- 172.21.15.100:0/3739845419 wait complete. 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.525+0000 7f3c227e6740 1 -- start start 2024-02-21T07:46:27.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.525+0000 7f3c227e6740 1 Processor -- start 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b7374330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b72e0b60 con 0x5562b73b5ae0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b7285fd0 con 0x5562b7373ec0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b7285c70 con 0x5562b73f0890 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c227e6740 10 client.0 _ll_register_callbacks cb 0x5562b6ff1c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c0fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b7374330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49360/0 (socket says 172.21.15.100:49360) 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c1d000640 1 -- 172.21.15.100:0/583908095 learned_addr learned my addr 172.21.15.100:0/583908095 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.527+0000 7f3c1da00640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 -- 172.21.15.100:0/583908095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 msgr2=0x5562b73fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73fce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 -- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 msgr2=0x5562b73abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 -- 172.21.15.100:0/583908095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18070fa0 con 0x5562b73f0890 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c1d000640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b7374330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c00023000 tx=0x7f3c00000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e7202d46474e31 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c06000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:46:27.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00001d20 con 0x5562b73f0890 2024-02-21T07:46:27.537 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562b6fe0860 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.528+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3c00021a30 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c00021bf0 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 10 client.5162 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5562b72df1e0 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562b6fe0860 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3c0002c420 con 0x5562b73f0890 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 10 client.5162 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 10 client.5162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 20 client.5162 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:27.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73ae7a0 0x5562b73aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 4 client.5162 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.529+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562b7031410 con 0x5562b73ae7a0 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.530+0000 7f3c1d000640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73ae7a0 0x5562b73aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.530+0000 7f3c1d000640 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73ae7a0 0x5562b73aeb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4d8855472e8c71 server_cookie=aa2e822efe14fae in_seq=0 out_seq=0 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.530+0000 7f3c06000640 10 client.5162 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c06000640 1 -- 172.21.15.100:0/583908095 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562b7031410 con 0x5562b73ae7a0 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c06000640 10 client.5162 handle_command_reply: tid=0 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 client.5162 shutdown 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 msgr2=0x5562b7374330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b7374330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c00023000 tx=0x7f3c00000bc0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 shutdown_connections 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73ae7a0 0x5562b73aeb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73fce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b7374330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 --2- 172.21.15.100:0/583908095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c06000640 0 client.5162 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 >> 172.21.15.100:0/583908095 conn(0x5562b73b51c0 msgr2=0x5562b7379200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 shutdown_connections 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 1 -- 172.21.15.100:0/583908095 wait complete. 2024-02-21T07:46:27.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.531+0000 7f3c227e6740 20 client.5162 trim_cache size 0 max 16384 2024-02-21T07:46:27.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.548+0000 7f3c227e6740 1 Processor -- start 2024-02-21T07:46:27.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.548+0000 7f3c227e6740 1 -- start start 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73f0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b73787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b70290c0 con 0x5562b73b5ae0 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b73abcb0 con 0x5562b7373ec0 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.549+0000 7f3c227e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b73ef3a0 con 0x5562b73f0890 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c0fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c0fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49362/0 (socket says 172.21.15.100:49362) 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c0fe00640 1 -- 172.21.15.100:0/307058428 learned_addr learned my addr 172.21.15.100:0/307058428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73f0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1da00640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b73787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 -- 172.21.15.100:0/307058428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 msgr2=0x5562b73787d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b73787d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 -- 172.21.15.100:0/307058428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 msgr2=0x5562b73fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 -- 172.21.15.100:0/307058428 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562b727ba90 con 0x5562b7373ec0 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.550+0000 7f3c1d000640 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73f0c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5562b73ab3d0 tx=0x7f3c08030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a7fd327b201f567 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.551+0000 7f3c0cc00640 1 -- 172.21.15.100:0/307058428 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08040040 con 0x5562b7373ec0 2024-02-21T07:46:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.551+0000 7f3c0cc00640 1 -- 172.21.15.100:0/307058428 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08004300 con 0x5562b7373ec0 2024-02-21T07:46:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.551+0000 7f3c0cc00640 1 -- 172.21.15.100:0/307058428 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08046410 con 0x5562b7373ec0 2024-02-21T07:46:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.551+0000 7f3c227e6740 1 -- 172.21.15.100:0/307058428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 msgr2=0x5562b73f0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.551+0000 7f3c227e6740 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73f0c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5562b73ab3d0 tx=0x7f3c08030000 comp rx=0 tx=0).stop 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 -- 172.21.15.100:0/307058428 shutdown_connections 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b73f0890 0x5562b73787d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73b5ae0 0x5562b73fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 --2- 172.21.15.100:0/307058428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b7373ec0 0x5562b73f0c70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 -- 172.21.15.100:0/307058428 >> 172.21.15.100:0/307058428 conn(0x5562b73b51c0 msgr2=0x5562b73efd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 -- 172.21.15.100:0/307058428 shutdown_connections 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 -- 172.21.15.100:0/307058428 wait complete. 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.552+0000 7f3c227e6740 1 -- start start 2024-02-21T07:46:27.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.553+0000 7f3c227e6740 1 Processor -- start 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 0x5562b73fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b7452450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b73ba2a0 con 0x5562b73f0890 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b73f9bd0 con 0x5562b73b5ae0 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562b73ebdc0 con 0x5562b7373ec0 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c227e6740 10 client.0 _ll_register_callbacks cb 0x7f3c00024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 0x5562b73fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c1da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c1d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 0x5562b73fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34088/0 (socket says 172.21.15.100:34088) 2024-02-21T07:46:27.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c1d000640 1 -- 172.21.15.100:0/4102616696 learned_addr learned my addr 172.21.15.100:0/4102616696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.554+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b7452450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 -- 172.21.15.100:0/4102616696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 msgr2=0x5562b73fa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 0x5562b73fa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 -- 172.21.15.100:0/4102616696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 msgr2=0x5562b7452450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b7452450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 -- 172.21.15.100:0/4102616696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562b72df1e0 con 0x5562b73f0890 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c0fe00640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b7452450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c1da00640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73ec270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c100c73c0 tx=0x7f3c1009fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa8e5d2a270d8c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c06000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1009f800 con 0x5562b73f0890 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3c1009f960 con 0x5562b73f0890 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562b73eeaf0 con 0x5562b73f0890 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c10004b60 con 0x5562b73f0890 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c227e6740 10 client.5001 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:27.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.555+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f3c18071840 con 0x5562b73f0890 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562b73eeaf0 con 0x5562b73f0890 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3c10004cc0 con 0x5562b73f0890 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 10 client.5001 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 10 client.5001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 20 client.5001 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73aae70 0x5562b74580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 4 client.5001 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f3c0001d070 con 0x5562b73aae70 2024-02-21T07:46:27.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.556+0000 7f3c1d000640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73aae70 0x5562b74580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.557+0000 7f3c1d000640 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73aae70 0x5562b74580d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ffc670607ae8e41 server_cookie=c17891709f49f2f6 in_seq=0 out_seq=0 2024-02-21T07:46:27.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.557+0000 7f3c06000640 10 client.5001 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.559+0000 7f3c06000640 1 -- 172.21.15.100:0/4102616696 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f3c0001d070 con 0x5562b73aae70 2024-02-21T07:46:27.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.559+0000 7f3c06000640 10 client.5001 handle_command_reply: tid=0 2024-02-21T07:46:27.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.559+0000 7f3c227e6740 1 client.5001 shutdown 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 msgr2=0x5562b73ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73ec270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c100c73c0 tx=0x7f3c1009fc90 comp rx=0 tx=0).stop 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 shutdown_connections 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5562b73aae70 0x5562b74580d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562b73f0890 0x5562b73ec270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5562b73b5ae0 0x5562b7452450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c06000640 0 client.5001 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 --2- 172.21.15.100:0/4102616696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5562b7373ec0 0x5562b73fa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 >> 172.21.15.100:0/4102616696 conn(0x5562b73b51c0 msgr2=0x5562b73ed770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 shutdown_connections 2024-02-21T07:46:27.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.560+0000 7f3c227e6740 1 -- 172.21.15.100:0/4102616696 wait complete. 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.561+0000 7f3c227e6740 20 client.5001 trim_cache size 0 max 16384 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "e69c62e7-ac37-4711-b361-50e55761474e", 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:46:27.567 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 msgr2=0x7f3bf40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 0x7f3bf40a15f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3c00001b70 tx=0x7f3c000166d0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 msgr2=0x7f3c180f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000ca70 tx=0x7f3c1000cf30 comp rx=0 tx=0).stop 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 shutdown_connections 2024-02-21T07:46:27.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3bf409f130 0x7f3bf40a15f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c18188b90 0x7f3c180f5390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c18183a50 0x7f3c180f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 --2- 172.21.15.100:0/162798302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3c18072600 0x7f3c18159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 >> 172.21.15.100:0/162798302 conn(0x7f3c180668b0 msgr2=0x7f3c180f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 shutdown_connections 2024-02-21T07:46:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.562+0000 7f3c1fa00640 1 -- 172.21.15.100:0/162798302 wait complete. 2024-02-21T07:46:27.583 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-21T07:46:27.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:46:27.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:46:27.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.814+0000 7f13e4400640 1 Processor -- start 2024-02-21T07:46:27.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.815+0000 7f13e4400640 1 -- start start 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.817+0000 7f13e4400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 0x7f13dc0d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.817+0000 7f13e4400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13dc18a280 0x7f13dc18a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.817+0000 7f13e4400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0d2e10 con 0x7f13dc18ac50 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.817+0000 7f13e4400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc189ab0 con 0x7f13dc18a280 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.817+0000 7f13e4400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc0d1db0 con 0x7f13dc186260 2024-02-21T07:46:27.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13dc18a280 0x7f13dc18a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13dc18a280 0x7f13dc18a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49376/0 (socket says 172.21.15.100:49376) 2024-02-21T07:46:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 -- 172.21.15.100:0/1429051582 learned_addr learned my addr 172.21.15.100:0/1429051582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1a00640 1 --2- 172.21.15.100:0/1429051582 >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 0x7f13dc0d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13dbe00640 1 -- 172.21.15.100:0/1429051582 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204031112 0 0) 0x7f13dc0d2e10 con 0x7f13dc18ac50 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13dbe00640 1 -- 172.21.15.100:0/1429051582 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c4003520 con 0x7f13dc18ac50 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 -- 172.21.15.100:0/1429051582 >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 msgr2=0x7f13dc0d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 --2- 172.21.15.100:0/1429051582 >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 0x7f13dc0d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 -- 172.21.15.100:0/1429051582 >> v1:172.21.15.156:6789/0 conn(0x7f13dc18ac50 legacy=0x7f13dc18c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1000640 1 -- 172.21.15.100:0/1429051582 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0d1fb0 con 0x7f13dc18a280 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.818+0000 7f13e1a00640 1 --2- 172.21.15.100:0/1429051582 >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 0x7f13dc0d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.819+0000 7f13e1000640 1 --2- 172.21.15.100:0/1429051582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc18a710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009870 tx=0x7f13c802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d3c09a80c87904 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.819+0000 7f13dbe00640 1 -- 172.21.15.100:0/1429051582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80317d0 con 0x7f13dc18a280 2024-02-21T07:46:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.819+0000 7f13dbe00640 1 -- 172.21.15.100:0/1429051582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c8031930 con 0x7f13dc18a280 2024-02-21T07:46:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13dbe00640 1 -- 172.21.15.100:0/1429051582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8031cc0 con 0x7f13dc18a280 2024-02-21T07:46:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 -- 172.21.15.100:0/1429051582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 msgr2=0x7f13dc18a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 --2- 172.21.15.100:0/1429051582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc18a710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009870 tx=0x7f13c802b870 comp rx=0 tx=0).stop 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 -- 172.21.15.100:0/1429051582 shutdown_connections 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 --2- 172.21.15.100:0/1429051582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc18a710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 --2- 172.21.15.100:0/1429051582 >> v2:172.21.15.156:3300/0 conn(0x7f13dc186260 0x7f13dc0d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 -- 172.21.15.100:0/1429051582 >> 172.21.15.100:0/1429051582 conn(0x7f13dc0fbf40 msgr2=0x7f13dc0fc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 -- 172.21.15.100:0/1429051582 shutdown_connections 2024-02-21T07:46:27.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.820+0000 7f13e4400640 1 -- 172.21.15.100:0/1429051582 wait complete. 2024-02-21T07:46:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.822+0000 7f13e4400640 1 Processor -- start 2024-02-21T07:46:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.822+0000 7f13e4400640 1 -- start start 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc186260 0x7f13dc08c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13dc18ac50 0x7f13dc220810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc08cd80 con 0x7f13dc18a280 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc181840 con 0x7f13dc186260 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e4400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc181280 con 0x7f13dc18ac50 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49378/0 (socket says 172.21.15.100:49378) 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 -- 172.21.15.100:0/3733987461 learned_addr learned my addr 172.21.15.100:0/3733987461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1a00640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc186260 0x7f13dc08c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e2400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13dc18ac50 0x7f13dc220810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 -- 172.21.15.100:0/3733987461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13dc18ac50 msgr2=0x7f13dc220810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13dc18ac50 0x7f13dc220810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 -- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc186260 msgr2=0x7f13dc08c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc186260 0x7f13dc08c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.824+0000 7f13e1000640 1 -- 172.21.15.100:0/3733987461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009a70 con 0x7f13dc18a280 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13e1000640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13c802b8b0 tx=0x7f13c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13d9600640 1 -- 172.21.15.100:0/3733987461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8032870 con 0x7f13dc18a280 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13d9600640 1 -- 172.21.15.100:0/3733987461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80329f0 con 0x7f13dc18a280 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c80094d0 con 0x7f13dc18a280 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13d9600640 1 -- 172.21.15.100:0/3733987461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8032da0 con 0x7f13dc18a280 2024-02-21T07:46:27.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.825+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc21fd30 con 0x7f13dc18a280 2024-02-21T07:46:27.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.828+0000 7f13d9600640 1 -- 172.21.15.100:0/3733987461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f13c8030070 con 0x7f13dc18a280 2024-02-21T07:46:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.829+0000 7f13e7008740 1 Processor -- start 2024-02-21T07:46:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.830+0000 7f13e7008740 1 -- start start 2024-02-21T07:46:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.830+0000 7f13d9600640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 0x7f13bc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.830+0000 7f13d9600640 1 -- 172.21.15.100:0/3733987461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13c80eb8d0 con 0x7f13dc18a280 2024-02-21T07:46:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.830+0000 7f13e2400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 0x7f13bc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61115ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e2400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 0x7f13bc0a15f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007fd0 tx=0x7f13d4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d6110e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61105e150 con 0x55d61115cf80 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61105b680 con 0x55d6111278e0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d611056e60 con 0x55d611126fc0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49382/0 (socket says 172.21.15.100:49382) 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e1000640 1 -- 172.21.15.100:0/218112892 learned_addr learned my addr 172.21.15.100:0/218112892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e1a00640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61115ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e2400640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d6110e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.831+0000 7f13e1000640 1 -- 172.21.15.100:0/218112892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 msgr2=0x55d61115ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1000640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61115ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1000640 1 -- 172.21.15.100:0/218112892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 msgr2=0x55d6110e9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1000640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d6110e9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1000640 1 -- 172.21.15.100:0/218112892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d611010060 con 0x55d61115cf80 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1a00640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61115ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13e1000640 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13c8006c40 tx=0x7f13c8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719cdc4a1c3d14e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13ce000640 1 -- 172.21.15.100:0/218112892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80b92e0 con 0x55d61115cf80 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13ce000640 1 -- 172.21.15.100:0/218112892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80bd430 con 0x55d61115cf80 2024-02-21T07:46:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.832+0000 7f13ce000640 1 -- 172.21.15.100:0/218112892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80c19f0 con 0x55d61115cf80 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 -- 172.21.15.100:0/218112892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 msgr2=0x55d6111273a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f13c8006c40 tx=0x7f13c8009240 comp rx=0 tx=0).stop 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 -- 172.21.15.100:0/218112892 shutdown_connections 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d6110e9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d6111273a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 --2- 172.21.15.100:0/218112892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61115ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 -- 172.21.15.100:0/218112892 >> 172.21.15.100:0/218112892 conn(0x55d6110b65a0 msgr2=0x55d6110edeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 -- 172.21.15.100:0/218112892 shutdown_connections 2024-02-21T07:46:27.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.833+0000 7f13e7008740 1 -- 172.21.15.100:0/218112892 wait complete. 2024-02-21T07:46:27.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.834+0000 7f13e7008740 1 -- start start 2024-02-21T07:46:27.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.834+0000 7f13e7008740 1 Processor -- start 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d610ffbec0 con 0x55d611126fc0 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d610ffbb60 con 0x55d6111278e0 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d610dc51c0 con 0x55d61115cf80 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e7008740 10 client.0 _ll_register_callbacks cb 0x55d61100f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.835+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49388/0 (socket says 172.21.15.100:49388) 2024-02-21T07:46:27.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 -- 172.21.15.100:0/550880831 learned_addr learned my addr 172.21.15.100:0/550880831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e2400640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1000640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 -- 172.21.15.100:0/550880831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 msgr2=0x55d6111566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 -- 172.21.15.100:0/550880831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 msgr2=0x55d611170220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 -- 172.21.15.100:0/550880831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc21fd30 con 0x55d611126fc0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13e1a00640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012f40 tx=0x7f13d00147b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2e84fd5f808649 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.836+0000 7f13c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000e040 con 0x55d611126fc0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13d001a070 con 0x55d611126fc0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d610d567e0 con 0x55d611126fc0 2024-02-21T07:46:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d0014ea0 con 0x55d611126fc0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 10 client.5013 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d6110554e0 con 0x55d611126fc0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d610d567e0 con 0x55d611126fc0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f13d0016810 con 0x55d611126fc0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 10 client.5013 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 10 client.5013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 20 client.5013 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d6111721a0 0x55d611172580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.837+0000 7f13e7008740 4 client.5013 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.838+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d610d93720 con 0x55d6111721a0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.838+0000 7f13e1000640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d6111721a0 0x55d611172580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.838+0000 7f13c2a00640 10 client.5013 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.838+0000 7f13e1000640 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d6111721a0 0x55d611172580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f7db2242c7ff712 server_cookie=5437b84d5b6c4be3 in_seq=0 out_seq=0 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13c2a00640 1 -- 172.21.15.100:0/550880831 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d610d93720 con 0x55d6111721a0 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13c2a00640 10 client.5013 handle_command_reply: tid=0 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 client.5013 shutdown 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 msgr2=0x55d61111d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012f40 tx=0x7f13d00147b0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 shutdown_connections 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d6111721a0 0x55d611172580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 --2- 172.21.15.100:0/550880831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d61111d100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.839+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 >> 172.21.15.100:0/550880831 conn(0x55d6110b65a0 msgr2=0x55d61115ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.840+0000 7f13c2a00640 0 client.5013 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.840+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 shutdown_connections 2024-02-21T07:46:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.840+0000 7f13e7008740 1 -- 172.21.15.100:0/550880831 wait complete. 2024-02-21T07:46:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.840+0000 7f13e7008740 20 client.5013 trim_cache size 0 max 16384 2024-02-21T07:46:27.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.857+0000 7f13e7008740 1 Processor -- start 2024-02-21T07:46:27.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.857+0000 7f13e7008740 1 -- start start 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61117f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6110eaa30 con 0x55d61115cf80 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61116bfd0 con 0x55d6111278e0 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d61111a4f0 con 0x55d611126fc0 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.858+0000 7f13e2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49398/0 (socket says 172.21.15.100:49398) 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e2400640 1 -- 172.21.15.100:0/2716976386 learned_addr learned my addr 172.21.15.100:0/2716976386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1a00640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61117f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 -- 172.21.15.100:0/2716976386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 msgr2=0x55d61117f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61117f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 -- 172.21.15.100:0/2716976386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 msgr2=0x55d61112ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 -- 172.21.15.100:0/2716976386 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d610ff1950 con 0x55d6111278e0 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e2400640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13e1000640 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13c80e9150 tx=0x7f13c80eb000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70bcb73b2851e3f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.859+0000 7f13cd600640 1 -- 172.21.15.100:0/2716976386 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80e8040 con 0x55d6111278e0 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13cd600640 1 -- 172.21.15.100:0/2716976386 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80c19f0 con 0x55d6111278e0 2024-02-21T07:46:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13cd600640 1 -- 172.21.15.100:0/2716976386 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80b75e0 con 0x55d6111278e0 2024-02-21T07:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 -- 172.21.15.100:0/2716976386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 msgr2=0x55d611170200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170200 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13c80e9150 tx=0x7f13c80eb000 comp rx=0 tx=0).stop 2024-02-21T07:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 -- 172.21.15.100:0/2716976386 shutdown_connections 2024-02-21T07:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d61115cf80 0x55d61112ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d611170200 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 --2- 172.21.15.100:0/2716976386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d611126fc0 0x55d61117f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 -- 172.21.15.100:0/2716976386 >> 172.21.15.100:0/2716976386 conn(0x55d6110b65a0 msgr2=0x55d6110ee150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 -- 172.21.15.100:0/2716976386 shutdown_connections 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.860+0000 7f13e7008740 1 -- 172.21.15.100:0/2716976386 wait complete. 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.861+0000 7f13e7008740 1 -- start start 2024-02-21T07:46:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.861+0000 7f13e7008740 1 Processor -- start 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d61111d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6110eb6b0 con 0x55d611126fc0 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6111b8f90 con 0x55d6111278e0 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d611116060 con 0x55d61115cf80 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e7008740 10 client.0 _ll_register_callbacks cb 0x7f13d00122a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49408/0 (socket says 172.21.15.100:49408) 2024-02-21T07:46:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 -- 172.21.15.100:0/441838611 learned_addr learned my addr 172.21.15.100:0/441838611 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e2400640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1000640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d61111d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 -- 172.21.15.100:0/441838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 msgr2=0x55d6111b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111b85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 -- 172.21.15.100:0/441838611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 msgr2=0x55d61111d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d61111d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.863+0000 7f13e1a00640 1 -- 172.21.15.100:0/441838611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c4003520 con 0x55d611126fc0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13e1a00640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012f40 tx=0x7f13d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d2269f56843ab9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000e070 con 0x55d611126fc0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13d0016610 con 0x55d611126fc0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13c80bd430 con 0x55d611126fc0 2024-02-21T07:46:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d0014ea0 con 0x55d611126fc0 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13e7008740 10 client.5019 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f13c80d4040 con 0x55d611126fc0 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.864+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d003b020 con 0x55d611126fc0 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f13d0003990 con 0x55d611126fc0 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 10 client.5019 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 10 client.5019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 20 client.5019 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d61111cd00 0x55d61115a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 4 client.5019 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d610de2890 con 0x55d61111cd00 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e1000640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d61111cd00 0x55d61115a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13c2a00640 10 client.5019 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.865+0000 7f13e1000640 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d61111cd00 0x55d61115a4f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba78ef21c95758f server_cookie=eb223cd3fd09d49b in_seq=0 out_seq=0 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13c2a00640 1 -- 172.21.15.100:0/441838611 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d610de2890 con 0x55d61111cd00 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13c2a00640 10 client.5019 handle_command_reply: tid=0 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 client.5019 shutdown 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 msgr2=0x55d611154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f13d0012f40 tx=0x7f13d0004a40 comp rx=0 tx=0).stop 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 shutdown_connections 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d61111cd00 0x55d61115a4f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d61115cf80 0x55d6111b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6111278e0 0x55d61111d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 --2- 172.21.15.100:0/441838611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d611126fc0 0x55d611154760 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13c2a00640 0 client.5019 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 >> 172.21.15.100:0/441838611 conn(0x55d6110b65a0 msgr2=0x55d61112f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 shutdown_connections 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 1 -- 172.21.15.100:0/441838611 wait complete. 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.866+0000 7f13e7008740 20 client.5019 trim_cache size 0 max 16384 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "e69c62e7-ac37-4711-b361-50e55761474e": { 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "e69c62e7-ac37-4711-b361-50e55761474e", 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:46:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:46:27.880 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:46:27.880 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 msgr2=0x7f13bc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 0x7f13bc0a15f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007fd0 tx=0x7f13d4009040 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 msgr2=0x7f13dc174f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f13c802b8b0 tx=0x7f13c80046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 shutdown_connections 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13dc18ac50 0x7f13dc220810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f130 0x7f13bc0a15f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc18a280 0x7f13dc174f00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 --2- 172.21.15.100:0/3733987461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc186260 0x7f13dc08c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 >> 172.21.15.100:0/3733987461 conn(0x7f13dc0fbf40 msgr2=0x7f13dc18bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 shutdown_connections 2024-02-21T07:46:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:27.867+0000 7f13e4400640 1 -- 172.21.15.100:0/3733987461 wait complete. 2024-02-21T07:46:27.890 INFO:tasks.cephfs.filesystem:scrub status for tag:e69c62e7-ac37-4711-b361-50e55761474e - {'path': '/', 'tag': 'e69c62e7-ac37-4711-b361-50e55761474e', 'options': 'recursive,force'} 2024-02-21T07:46:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.563+0000 7fe8d8c00640 1 Processor -- start 2024-02-21T07:46:40.569 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.564+0000 7fe8d8c00640 1 -- start start 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.565+0000 7fe8d8c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d4182840 0x7fe8d4186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.565+0000 7fe8d8c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 0x7fe8d40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.565+0000 7fe8d8c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d41896d0 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.565+0000 7fe8d8c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d40fec50 con 0x7fe8d4182840 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.565+0000 7fe8d8c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d4182c20 con 0x7fe8d4186b70 2024-02-21T07:46:40.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d4182840 0x7fe8d4186630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 0x7fe8d40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d4182840 0x7fe8d4186630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49196/0 (socket says 172.21.15.100:49196) 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 -- 172.21.15.100:0/774796085 learned_addr learned my addr 172.21.15.100:0/774796085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 -- 172.21.15.100:0/774796085 >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 msgr2=0x7fe8d40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 --2- 172.21.15.100:0/774796085 >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 0x7fe8d40d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 -- 172.21.15.100:0/774796085 >> v1:172.21.15.156:6789/0 conn(0x7fe8d40d0cc0 legacy=0x7fe8d418bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d3400640 1 -- 172.21.15.100:0/774796085 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4187ef0 con 0x7fe8d4182840 2024-02-21T07:46:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.566+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/774796085 >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 0x7fe8d40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.568+0000 7fe8d3400640 1 --2- 172.21.15.100:0/774796085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d4182840 0x7fe8d4186630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40d0090 tx=0x7fe8c402b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da4f5b5fb6b88ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.568+0000 7fe8d2000640 1 -- 172.21.15.100:0/774796085 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40317f0 con 0x7fe8d4182840 2024-02-21T07:46:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.568+0000 7fe8d2000640 1 -- 172.21.15.100:0/774796085 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4031950 con 0x7fe8d4182840 2024-02-21T07:46:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.568+0000 7fe8d2000640 1 -- 172.21.15.100:0/774796085 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4031ce0 con 0x7fe8d4182840 2024-02-21T07:46:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 -- 172.21.15.100:0/774796085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d4182840 msgr2=0x7fe8d4186630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/774796085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d4182840 0x7fe8d4186630 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40d0090 tx=0x7fe8c402b890 comp rx=0 tx=0).stop 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 -- 172.21.15.100:0/774796085 shutdown_connections 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/774796085 >> v2:172.21.15.156:3300/0 conn(0x7fe8d4186b70 0x7fe8d40d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/774796085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d4182840 0x7fe8d4186630 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 -- 172.21.15.100:0/774796085 >> 172.21.15.100:0/774796085 conn(0x7fe8d40615c0 msgr2=0x7fe8d40619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 -- 172.21.15.100:0/774796085 shutdown_connections 2024-02-21T07:46:40.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.569+0000 7fe8d8c00640 1 -- 172.21.15.100:0/774796085 wait complete. 2024-02-21T07:46:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.571+0000 7fe8d8c00640 1 Processor -- start 2024-02-21T07:46:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.571+0000 7fe8d8c00640 1 -- start start 2024-02-21T07:46:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 0x7fe8d417a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 0x7fe8d4165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40d3ed0 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40d41b0 con 0x7fe8d40d3a50 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.572+0000 7fe8d8c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40d4490 con 0x7fe8d4182840 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49212/0 (socket says 172.21.15.100:49212) 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 -- 172.21.15.100:0/3524938624 learned_addr learned my addr 172.21.15.100:0/3524938624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 0x7fe8d417a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 0x7fe8d4165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 -- 172.21.15.100:0/3524938624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 msgr2=0x7fe8d417a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 0x7fe8d417a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 -- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 msgr2=0x7fe8d4165f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 0x7fe8d4165f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3400640 1 -- 172.21.15.100:0/3524938624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009400 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 0x7fe8d4165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.573+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 0x7fe8d417a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe8c402b8d0 tx=0x7fe8c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8cb400640 1 -- 172.21.15.100:0/3524938624 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4032890 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8cb400640 1 -- 172.21.15.100:0/3524938624 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4032a10 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8cb400640 1 -- 172.21.15.100:0/3524938624 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4032dc0 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c40094d0 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.574+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d40d4a50 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.578+0000 7fe8cb400640 1 -- 172.21.15.100:0/3524938624 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe8c404e450 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.579+0000 7fe8dcde8740 1 Processor -- start 2024-02-21T07:46:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.579+0000 7fe8dcde8740 1 -- start start 2024-02-21T07:46:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.579+0000 7fe8cb400640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 0x7fe8b40a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.579+0000 7fe8cb400640 1 -- 172.21.15.100:0/3524938624 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe8c40ebf70 con 0x7fe8d40d0cc0 2024-02-21T07:46:40.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.579+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 0x7fe8b40a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 0x7fe8b40a1620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc001ce0 tx=0x7fe8cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd5145650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd514ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5106620 con 0x561fd514b1a0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd50b88c0 con 0x561fd51ba6e0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.580+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd50b5df0 con 0x561fd5186280 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd514ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49218/0 (socket says 172.21.15.100:49218) 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d3e00640 1 -- 172.21.15.100:0/3636489289 learned_addr learned my addr 172.21.15.100:0/3636489289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd5145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3636489289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 msgr2=0x561fd5145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd5145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3636489289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 msgr2=0x561fd5186660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3636489289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd5032b00 con 0x561fd51ba6e0 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.581+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd514ac60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cee80 tx=0x7fe8c0011820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df78ac3d5908b7fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8bf400640 1 -- 172.21.15.100:0/3636489289 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0013670 con 0x561fd51ba6e0 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8bf400640 1 -- 172.21.15.100:0/3636489289 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c00137d0 con 0x561fd51ba6e0 2024-02-21T07:46:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8bf400640 1 -- 172.21.15.100:0/3636489289 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0013b80 con 0x561fd51ba6e0 2024-02-21T07:46:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3636489289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 msgr2=0x561fd514ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd514ac60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40cee80 tx=0x7fe8c0011820 comp rx=0 tx=0).stop 2024-02-21T07:46:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3636489289 shutdown_connections 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd514ac60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3636489289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd5145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3636489289 >> 172.21.15.100:0/3636489289 conn(0x561fd51124b0 msgr2=0x561fd5149eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.582+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3636489289 shutdown_connections 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.583+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3636489289 wait complete. 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.583+0000 7fe8dcde8740 1 -- start start 2024-02-21T07:46:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.584+0000 7fe8dcde8740 1 Processor -- start 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5186280 0x561fd5181fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd51ba6e0 0x561fd51ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd50b15d0 con 0x561fd514b1a0 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd5056b50 con 0x561fd5186280 2024-02-21T07:46:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd50567f0 con 0x561fd51ba6e0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8dcde8740 10 client.0 _ll_register_callbacks cb 0x561fd506a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49222/0 (socket says 172.21.15.100:49222) 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8d3400640 1 -- 172.21.15.100:0/3975445388 learned_addr learned my addr 172.21.15.100:0/3975445388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5186280 0x561fd5181fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.585+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd51ba6e0 0x561fd51ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 -- 172.21.15.100:0/3975445388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd51ba6e0 msgr2=0x561fd51ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd51ba6e0 0x561fd51ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 -- 172.21.15.100:0/3975445388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5186280 msgr2=0x561fd5181fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5186280 0x561fd5181fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 -- 172.21.15.100:0/3975445388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c0009d00 con 0x561fd514b1a0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c00 tx=0x7fe8c40b92b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a228300cf036fca2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40c1e60 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe8c40bdaa0 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fd5083cd0 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8c40c20f0 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8dcde8740 10 client.5031 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.586+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561fd50afc50 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fd5083cd0 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe8c40e9240 con 0x561fd514b1a0 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 10 client.5031 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 10 client.5031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 20 client.5031 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51aeb10 0x561fd51b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 4 client.5031 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fd50a7ce0 con 0x561fd51aeb10 2024-02-21T07:46:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.587+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51aeb10 0x561fd51b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.588+0000 7fe8b3e00640 10 client.5031 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.588+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51aeb10 0x561fd51b0900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef76443abd34014 server_cookie=d20d4c7305fa5a31 in_seq=0 out_seq=0 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3975445388 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fd50a7ce0 con 0x561fd51aeb10 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8b3e00640 10 client.5031 handle_command_reply: tid=0 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 client.5031 shutdown 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 msgr2=0x561fd517f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4000c00 tx=0x7fe8c40b92b0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 shutdown_connections 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51aeb10 0x561fd51b0900 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd51ba6e0 0x561fd51ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd5186280 0x561fd5181fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8b3e00640 0 client.5031 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3975445388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd517f240 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 >> 172.21.15.100:0/3975445388 conn(0x561fd51124b0 msgr2=0x561fd5151090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 shutdown_connections 2024-02-21T07:46:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3975445388 wait complete. 2024-02-21T07:46:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.589+0000 7fe8dcde8740 20 client.5031 trim_cache size 0 max 16384 2024-02-21T07:46:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.605+0000 7fe8dcde8740 1 Processor -- start 2024-02-21T07:46:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.605+0000 7fe8dcde8740 1 -- start start 2024-02-21T07:46:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd51b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd51b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd4df9e60 con 0x561fd514b1a0 2024-02-21T07:46:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd51daa40 con 0x561fd51ba6e0 2024-02-21T07:46:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd518c260 con 0x561fd5186280 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd51b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:36742/0 (socket says 172.21.15.100:36742) 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd51b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd51b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49226/0 (socket says 172.21.15.100:49226) 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.606+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3986160488 learned_addr learned my addr 172.21.15.100:0/3986160488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3986160488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 msgr2=0x561fd51b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd51b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3986160488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 msgr2=0x561fd51b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd51b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3986160488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fd504c530 con 0x561fd5186280 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d418a730 tx=0x7fe8c0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=828c8245a3498a0b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8bea00640 1 -- 172.21.15.100:0/3986160488 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0022040 con 0x561fd5186280 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8bea00640 1 -- 172.21.15.100:0/3986160488 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0013bb0 con 0x561fd5186280 2024-02-21T07:46:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.607+0000 7fe8bea00640 1 -- 172.21.15.100:0/3986160488 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c002b070 con 0x561fd5186280 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3986160488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 msgr2=0x561fd51afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d418a730 tx=0x7fe8c0016000 comp rx=0 tx=0).stop 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3986160488 shutdown_connections 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd51b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51afe30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3986160488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd51b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3986160488 >> 172.21.15.100:0/3986160488 conn(0x561fd51124b0 msgr2=0x561fd51ae3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3986160488 shutdown_connections 2024-02-21T07:46:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.608+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3986160488 wait complete. 2024-02-21T07:46:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.609+0000 7fe8dcde8740 1 -- start start 2024-02-21T07:46:40.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.609+0000 7fe8dcde8740 1 Processor -- start 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.610+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.610+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51bb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8dcde8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd5146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd51a8140 con 0x561fd514b1a0 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd51d2030 con 0x561fd51ba6e0 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8dcde8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fd517a380 con 0x561fd5186280 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8dcde8740 10 client.0 _ll_register_callbacks cb 0x7fe8c0009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49230/0 (socket says 172.21.15.100:49230) 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d3400640 1 -- 172.21.15.100:0/3365350884 learned_addr learned my addr 172.21.15.100:0/3365350884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51bb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d3e00640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd5146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3365350884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 msgr2=0x561fd5146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd5146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 msgr2=0x561fd5186660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d2a00640 1 -- 172.21.15.100:0/3365350884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fd5032b00 con 0x561fd5186280 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.611+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8d2a00640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51bb720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00112e0 tx=0x7fe8c0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b03ad3f10b8a4c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0022040 con 0x561fd5186280 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fd50d6d30 con 0x561fd5186280 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe8c002b070 con 0x561fd5186280 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8c0011da0 con 0x561fd5186280 2024-02-21T07:46:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8dcde8740 10 client.5198 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561fd50722c0 con 0x561fd5186280 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0046080 con 0x561fd5186280 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe8c001b020 con 0x561fd5186280 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8dcde8740 10 client.5198 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.612+0000 7fe8dcde8740 10 client.5198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8dcde8740 20 client.5198 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51b9850 0x561fd5226e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8dcde8740 4 client.5198 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561fd4db1600 con 0x561fd51b9850 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51b9850 0x561fd5226e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8d3400640 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51b9850 0x561fd5226e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93192281e1eee202 server_cookie=525d5bc594f4346 in_seq=0 out_seq=0 2024-02-21T07:46:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.613+0000 7fe8b3e00640 10 client.5198 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8b3e00640 1 -- 172.21.15.100:0/3365350884 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561fd4db1600 con 0x561fd51b9850 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8b3e00640 10 client.5198 handle_command_reply: tid=0 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8dcde8740 1 client.5198 shutdown 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 msgr2=0x561fd51bb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51bb720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00112e0 tx=0x7fe8c0004730 comp rx=0 tx=0).stop 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 shutdown_connections 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.626+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fd51b9850 0x561fd5226e10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fd51ba6e0 0x561fd5146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fd5186280 0x561fd51bb720 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8b3e00640 0 client.5198 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 --2- 172.21.15.100:0/3365350884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fd514b1a0 0x561fd5186660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 >> 172.21.15.100:0/3365350884 conn(0x561fd51124b0 msgr2=0x561fd51b9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 shutdown_connections 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 1 -- 172.21.15.100:0/3365350884 wait complete. 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.627+0000 7fe8dcde8740 20 client.5198 trim_cache size 0 max 16384 2024-02-21T07:46:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:46:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:46:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:46:40.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 msgr2=0x7fe8b40a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 0x7fe8b40a1620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc001ce0 tx=0x7fe8cc009040 comp rx=0 tx=0).stop 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 msgr2=0x7fe8d40d5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe8c402b8d0 tx=0x7fe8c40046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 shutdown_connections 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d40d3a50 0x7fe8d4165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe8d4182840 0x7fe8d417a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8b409f160 0x7fe8b40a1620 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 --2- 172.21.15.100:0/3524938624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d40d0cc0 0x7fe8d40d5250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 >> 172.21.15.100:0/3524938624 conn(0x7fe8d40615c0 msgr2=0x7fe8d4188380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 shutdown_connections 2024-02-21T07:46:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:40.628+0000 7fe8d8c00640 1 -- 172.21.15.100:0/3524938624 wait complete. 2024-02-21T07:46:41.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:41.876 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:41.878 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.768+0000 7efc22800640 1 Processor -- start 2024-02-21T07:46:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.768+0000 7efc22800640 1 -- start start 2024-02-21T07:46:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.770+0000 7efc22800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc1c1868c0 0x7efc1c186d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.770+0000 7efc22800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc1c188a00 0x7efc1c188e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.770+0000 7efc22800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0cddc0 con 0x7efc1c1864e0 2024-02-21T07:46:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.770+0000 7efc22800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0cb5b0 con 0x7efc1c1868c0 2024-02-21T07:46:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.770+0000 7efc22800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0f6230 con 0x7efc1c188a00 2024-02-21T07:46:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc1c188a00 0x7efc1c188e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7efc1c1864e0 0x7efc1c0cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:43092/0 (socket says 172.21.15.100:43092) 2024-02-21T07:46:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efc1c188a00 0x7efc1c188e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47568/0 (socket says 172.21.15.100:47568) 2024-02-21T07:46:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc20a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc1c1868c0 0x7efc1c186d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21400640 1 -- 172.21.15.100:0/950312839 learned_addr learned my addr 172.21.15.100:0/950312839 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 -- 172.21.15.100:0/950312839 >> v2:172.21.15.100:3300/0 conn(0x7efc1c1868c0 msgr2=0x7efc1c186d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 --2- 172.21.15.100:0/950312839 >> v2:172.21.15.100:3300/0 conn(0x7efc1c1868c0 0x7efc1c186d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 -- 172.21.15.100:0/950312839 >> v1:172.21.15.156:6789/0 conn(0x7efc1c1864e0 legacy=0x7efc1c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.771+0000 7efc21e00640 1 -- 172.21.15.100:0/950312839 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c187960 con 0x7efc1c188a00 2024-02-21T07:46:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.773+0000 7efc21e00640 1 --2- 172.21.15.100:0/950312839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c188e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0f0b50 tx=0x7efc1402bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2cba01fc20704 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.773+0000 7efc1be00640 1 -- 172.21.15.100:0/950312839 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1402ca30 con 0x7efc1c188a00 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.773+0000 7efc1be00640 1 -- 172.21.15.100:0/950312839 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1402cb90 con 0x7efc1c188a00 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.773+0000 7efc1be00640 1 -- 172.21.15.100:0/950312839 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14034440 con 0x7efc1c188a00 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 -- 172.21.15.100:0/950312839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 msgr2=0x7efc1c188e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 --2- 172.21.15.100:0/950312839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c188e50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0f0b50 tx=0x7efc1402bd00 comp rx=0 tx=0).stop 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 -- 172.21.15.100:0/950312839 shutdown_connections 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 --2- 172.21.15.100:0/950312839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c188e50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 --2- 172.21.15.100:0/950312839 >> v2:172.21.15.100:3300/0 conn(0x7efc1c1868c0 0x7efc1c186d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 -- 172.21.15.100:0/950312839 >> 172.21.15.100:0/950312839 conn(0x7efc1c0cdfc0 msgr2=0x7efc1c0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 -- 172.21.15.100:0/950312839 shutdown_connections 2024-02-21T07:46:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.774+0000 7efc22800640 1 -- 172.21.15.100:0/950312839 wait complete. 2024-02-21T07:46:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.776+0000 7efc22800640 1 Processor -- start 2024-02-21T07:46:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.776+0000 7efc22800640 1 -- start start 2024-02-21T07:46:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 0x7efc1c17b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c21ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c187730 con 0x7efc1c1868c0 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c17bcf0 con 0x7efc1c188a00 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.777+0000 7efc22800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c17bfd0 con 0x7efc1c1864e0 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43626/0 (socket says 172.21.15.100:43626) 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 -- 172.21.15.100:0/735767662 learned_addr learned my addr 172.21.15.100:0/735767662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc21e00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c21ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc21400640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 0x7efc1c17b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 -- 172.21.15.100:0/735767662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 msgr2=0x7efc1c17b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 0x7efc1c17b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 -- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 msgr2=0x7efc1c21ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c21ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 -- 172.21.15.100:0/735767662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009a70 con 0x7efc1c1868c0 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc21400640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 0x7efc1c17b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.778+0000 7efc20a00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e870 tx=0x7efc0800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.779+0000 7efc19600640 1 -- 172.21.15.100:0/735767662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080094f0 con 0x7efc1c1868c0 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.779+0000 7efc19600640 1 -- 172.21.15.100:0/735767662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800c940 con 0x7efc1c1868c0 2024-02-21T07:46:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.779+0000 7efc19600640 1 -- 172.21.15.100:0/735767662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800ccf0 con 0x7efc1c1868c0 2024-02-21T07:46:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.779+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c17c2b0 con 0x7efc1c1868c0 2024-02-21T07:46:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.779+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c17c870 con 0x7efc1c1868c0 2024-02-21T07:46:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.782+0000 7efc19600640 1 -- 172.21.15.100:0/735767662 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7efc08013470 con 0x7efc1c1868c0 2024-02-21T07:46:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.783+0000 7efc26a6f740 1 Processor -- start 2024-02-21T07:46:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.783+0000 7efc26a6f740 1 -- start start 2024-02-21T07:46:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.784+0000 7efc19600640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 0x7efbfc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.784+0000 7efc19600640 1 -- 172.21.15.100:0/735767662 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efc080c9d60 con 0x7efc1c1868c0 2024-02-21T07:46:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.784+0000 7efc21e00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 0x7efbfc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc21e00640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 0x7efbfc0a15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc14036000 tx=0x7efc14030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea4e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea8f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393ea0f620 con 0x56393ea8f280 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e9c18c0 con 0x56393eac36e0 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.785+0000 7efc26a6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e9bedf0 con 0x56393ea541a0 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea4e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc20a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc20a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47584/0 (socket says 172.21.15.100:47584) 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc20a00640 1 -- 172.21.15.100:0/4189606757 learned_addr learned my addr 172.21.15.100:0/4189606757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21e00640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea8f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 -- 172.21.15.100:0/4189606757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 msgr2=0x56393ea8f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea8f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 -- 172.21.15.100:0/4189606757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 msgr2=0x56393ea53c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 -- 172.21.15.100:0/4189606757 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56393e93bb00 con 0x56393ea8f280 2024-02-21T07:46:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21e00640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea8f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc20a00640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc21400640 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea4e650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efc10007630 tx=0x7efc10005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95eb83c35a838656 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.786+0000 7efc0dc00640 1 -- 172.21.15.100:0/4189606757 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10001850 con 0x56393ea8f280 2024-02-21T07:46:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc0dc00640 1 -- 172.21.15.100:0/4189606757 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc100019b0 con 0x56393ea8f280 2024-02-21T07:46:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc0dc00640 1 -- 172.21.15.100:0/4189606757 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10001d40 con 0x56393ea8f280 2024-02-21T07:46:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 -- 172.21.15.100:0/4189606757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 msgr2=0x56393ea4e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea4e650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efc10007630 tx=0x7efc10005bc0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 -- 172.21.15.100:0/4189606757 shutdown_connections 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea8f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393ea53c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 --2- 172.21.15.100:0/4189606757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea4e650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 -- 172.21.15.100:0/4189606757 >> 172.21.15.100:0/4189606757 conn(0x56393ea1b4b0 msgr2=0x56393ea52eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 -- 172.21.15.100:0/4189606757 shutdown_connections 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.787+0000 7efc26a6f740 1 -- 172.21.15.100:0/4189606757 wait complete. 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.788+0000 7efc26a6f740 1 -- start start 2024-02-21T07:46:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.788+0000 7efc26a6f740 1 Processor -- start 2024-02-21T07:46:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 0x56393ea85d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393eac36e0 0x56393ea4f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e9ba5d0 con 0x56393ea8f280 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e95fb50 con 0x56393ea541a0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e95f7f0 con 0x56393eac36e0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc26a6f740 10 client.0 _ll_register_callbacks cb 0x56393e973550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43640/0 (socket says 172.21.15.100:43640) 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc20a00640 1 -- 172.21.15.100:0/2489778471 learned_addr learned my addr 172.21.15.100:0/2489778471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc21400640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 0x56393ea85d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.790+0000 7efc21e00640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393eac36e0 0x56393ea4f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 -- 172.21.15.100:0/2489778471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393eac36e0 msgr2=0x56393ea4f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393eac36e0 0x56393ea4f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 -- 172.21.15.100:0/2489778471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 msgr2=0x56393ea85d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 0x56393ea85d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 -- 172.21.15.100:0/2489778471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1000f040 con 0x56393ea8f280 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc21400640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 0x56393ea85d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc20a00640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c520 tx=0x7efc080c7a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0395c38eb0193d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc02000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0809b940 con 0x56393ea8f280 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efc0809ff90 con 0x56393ea8f280 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56393e98ccd0 con 0x56393ea8f280 2024-02-21T07:46:53.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc080af170 con 0x56393ea8f280 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc26a6f740 10 client.5049 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.791+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56393e9b8c50 con 0x56393ea8f280 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56393e98ccd0 con 0x56393ea8f280 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efc08011070 con 0x56393ea8f280 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 10 client.5049 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 10 client.5049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 20 client.5049 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393ea4ea30 0x56393eab7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 4 client.5049 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56393e9b0ce0 con 0x56393ea4ea30 2024-02-21T07:46:53.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.792+0000 7efc21400640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393ea4ea30 0x56393eab7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.793+0000 7efc21400640 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393ea4ea30 0x56393eab7d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b3f59024b066e3 server_cookie=8650161cce794f0d in_seq=0 out_seq=0 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.793+0000 7efc02000640 10 client.5049 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.793+0000 7efc02000640 1 -- 172.21.15.100:0/2489778471 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56393e9b0ce0 con 0x56393ea4ea30 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.793+0000 7efc02000640 10 client.5049 handle_command_reply: tid=0 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.793+0000 7efc26a6f740 1 client.5049 shutdown 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 msgr2=0x56393eac43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c520 tx=0x7efc080c7a30 comp rx=0 tx=0).stop 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 shutdown_connections 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393ea4ea30 0x56393eab7d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393eac36e0 0x56393ea4f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393eac43c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 --2- 172.21.15.100:0/2489778471 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea541a0 0x56393ea85d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 >> 172.21.15.100:0/2489778471 conn(0x56393ea1b4b0 msgr2=0x56393eac3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc02000640 0 client.5049 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 shutdown_connections 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 1 -- 172.21.15.100:0/2489778471 wait complete. 2024-02-21T07:46:53.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.794+0000 7efc26a6f740 20 client.5049 trim_cache size 0 max 16384 2024-02-21T07:46:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.808+0000 7efc26a6f740 1 Processor -- start 2024-02-21T07:46:53.815 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.808+0000 7efc26a6f740 1 -- start start 2024-02-21T07:46:53.818 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.809+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea4eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.809+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.809+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393eac40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.809+0000 7efc26a6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393e702e60 con 0x56393ea8f280 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc26a6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393eac59b0 con 0x56393eac36e0 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc26a6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393eac3340 con 0x56393ea541a0 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43646/0 (socket says 172.21.15.100:43646) 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 -- 172.21.15.100:0/564791536 learned_addr learned my addr 172.21.15.100:0/564791536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc21e00640 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393eac40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc21400640 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea4eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 -- 172.21.15.100:0/564791536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 msgr2=0x56393ea4eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea4eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 -- 172.21.15.100:0/564791536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 msgr2=0x56393eac40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393eac40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 -- 172.21.15.100:0/564791536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56393e955530 con 0x56393ea8f280 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.810+0000 7efc20a00640 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc080c76f0 tx=0x7efc08099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed867e547ba32c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc0d200640 1 -- 172.21.15.100:0/564791536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080af170 con 0x56393ea8f280 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc0d200640 1 -- 172.21.15.100:0/564791536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08097150 con 0x56393ea8f280 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc0d200640 1 -- 172.21.15.100:0/564791536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0809b940 con 0x56393ea8f280 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 -- 172.21.15.100:0/564791536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 msgr2=0x56393ea52e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc080c76f0 tx=0x7efc08099000 comp rx=0 tx=0).stop 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 -- 172.21.15.100:0/564791536 shutdown_connections 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393eac36e0 0x56393eac40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.820 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393ea8f280 0x56393ea52e70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 --2- 172.21.15.100:0/564791536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea4eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 -- 172.21.15.100:0/564791536 >> 172.21.15.100:0/564791536 conn(0x56393ea1b4b0 msgr2=0x56393ea51e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 -- 172.21.15.100:0/564791536 shutdown_connections 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.811+0000 7efc26a6f740 1 -- 172.21.15.100:0/564791536 wait complete. 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.812+0000 7efc26a6f740 1 -- start start 2024-02-21T07:46:53.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.812+0000 7efc26a6f740 1 Processor -- start 2024-02-21T07:46:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea79260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 0x56393eac2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393eac48d0 con 0x56393eac36e0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393eab7770 con 0x56393ea8f280 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393eab7bd0 con 0x56393ea541a0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc26a6f740 10 client.0 _ll_register_callbacks cb 0x7efc10007050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc21e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc21e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43650/0 (socket says 172.21.15.100:43650) 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc21e00640 1 -- 172.21.15.100:0/1523507633 learned_addr learned my addr 172.21.15.100:0/1523507633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 0x56393eac2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc21400640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea79260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 -- 172.21.15.100:0/1523507633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 msgr2=0x56393ea79260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea79260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 -- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 msgr2=0x56393eb2a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc20a00640 1 -- 172.21.15.100:0/1523507633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56393e9b8c50 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.814+0000 7efc21e00640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc20a00640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 0x56393eac2ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc0809fa60 tx=0x7efc08000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4425fdcf23dd9756 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc02000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0809b940 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efc080c7980 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56393e9dfd30 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc080af170 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc26a6f740 10 client.5179 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56393e97b2c0 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.815+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56393e9dfd30 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efc08011070 con 0x56393ea8f280 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 10 client.5179 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 10 client.5179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 20 client.5179 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393eab13e0 0x56393eacc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 4 client.5179 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56393e6ba600 con 0x56393eab13e0 2024-02-21T07:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc21400640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393eab13e0 0x56393eacc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc21400640 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393eab13e0 0x56393eacc2b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c76891e426f51b3 server_cookie=df1d0d90dc5a9443 in_seq=0 out_seq=0 2024-02-21T07:46:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.816+0000 7efc02000640 10 client.5179 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc02000640 1 -- 172.21.15.100:0/1523507633 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56393e6ba600 con 0x56393eab13e0 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc02000640 10 client.5179 handle_command_reply: tid=0 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 client.5179 shutdown 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 msgr2=0x56393eac2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 0x56393eac2ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc0809fa60 tx=0x7efc08000bc0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 shutdown_connections 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56393eab13e0 0x56393eacc2b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56393eac36e0 0x56393eb2a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56393ea8f280 0x56393eac2ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 --2- 172.21.15.100:0/1523507633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56393ea541a0 0x56393ea79260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc02000640 0 client.5179 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 >> 172.21.15.100:0/1523507633 conn(0x56393ea1b4b0 msgr2=0x56393ea94c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 shutdown_connections 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.823+0000 7efc26a6f740 1 -- 172.21.15.100:0/1523507633 wait complete. 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc26a6f740 20 client.5179 trim_cache size 0 max 16384 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:46:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:46:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 msgr2=0x7efbfc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 0x7efbfc0a15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc14036000 tx=0x7efc14030000 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 msgr2=0x7efc1c17b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e870 tx=0x7efc0800ed30 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 shutdown_connections 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efc1c188a00 0x7efc1c21ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efbfc09f130 0x7efbfc0a15f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc1c1868c0 0x7efc1c17b610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 --2- 172.21.15.100:0/735767662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efc1c1864e0 0x7efc1c17b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 >> 172.21.15.100:0/735767662 conn(0x7efc1c0cdfc0 msgr2=0x7efc1c16c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 shutdown_connections 2024-02-21T07:46:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:46:53.824+0000 7efc22800640 1 -- 172.21.15.100:0/735767662 wait complete. 2024-02-21T07:46:57.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:46:57.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:46:58.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.107+0000 7f0adec00640 1 Processor -- start 2024-02-21T07:46:58.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.107+0000 7f0adec00640 1 -- start start 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.109+0000 7f0adec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ad815daa0 0x7f0ad806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.109+0000 7f0adec00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad806b0a0 con 0x7f0ad8161a40 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.109+0000 7f0adec00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad808d330 con 0x7f0ad808c7e0 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.109+0000 7f0adec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad806c6b0 con 0x7f0ad815daa0 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ad815daa0 0x7f0ad806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ad815daa0 0x7f0ad806ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43666/0 (socket says 172.21.15.100:43666) 2024-02-21T07:46:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3218139463 learned_addr learned my addr 172.21.15.100:0/3218139463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad6a00640 1 -- 172.21.15.100:0/3218139463 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620909981 0 0) 0x7f0ad808d330 con 0x7f0ad808c7e0 2024-02-21T07:46:58.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3218139463 >> v1:172.21.15.170:6789/0 conn(0x7f0ad808c7e0 legacy=0x7f0ad808cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3218139463 >> v1:172.21.15.156:6789/0 conn(0x7f0ad8161a40 legacy=0x7f0ad8161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.110+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3218139463 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad81625c0 con 0x7f0ad815daa0 2024-02-21T07:46:58.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.111+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/3218139463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad815daa0 0x7f0ad806ab60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab495ec88eb8bc58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0ad6a00640 1 -- 172.21.15.100:0/3218139463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8030860 con 0x7f0ad815daa0 2024-02-21T07:46:58.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0ad6a00640 1 -- 172.21.15.100:0/3218139463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac80309c0 con 0x7f0ad815daa0 2024-02-21T07:46:58.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0ad6a00640 1 -- 172.21.15.100:0/3218139463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8030d50 con 0x7f0ad815daa0 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 -- 172.21.15.100:0/3218139463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad815daa0 msgr2=0x7f0ad806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 --2- 172.21.15.100:0/3218139463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad815daa0 0x7f0ad806ab60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac802b9a0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 -- 172.21.15.100:0/3218139463 shutdown_connections 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 --2- 172.21.15.100:0/3218139463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad815daa0 0x7f0ad806ab60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 -- 172.21.15.100:0/3218139463 >> 172.21.15.100:0/3218139463 conn(0x7f0ad80fe210 msgr2=0x7f0ad80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.112+0000 7f0adec00640 1 -- 172.21.15.100:0/3218139463 shutdown_connections 2024-02-21T07:46:58.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.113+0000 7f0adec00640 1 -- 172.21.15.100:0/3218139463 wait complete. 2024-02-21T07:46:58.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.115+0000 7f0adec00640 1 Processor -- start 2024-02-21T07:46:58.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.115+0000 7f0adec00640 1 -- start start 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad808c7e0 0x7f0ad82201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 0x7f0ad8220710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80fca60 con 0x7f0ad8161a40 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80fcd40 con 0x7f0ad808c7e0 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80fd020 con 0x7f0ad815daa0 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.116+0000 7f0adcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43678/0 (socket says 172.21.15.100:43678) 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 -- 172.21.15.100:0/494332921 learned_addr learned my addr 172.21.15.100:0/494332921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad808c7e0 0x7f0ad82201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0ad7400640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 0x7f0ad8220710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 -- 172.21.15.100:0/494332921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 msgr2=0x7f0ad8220710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 0x7f0ad8220710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 -- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad808c7e0 msgr2=0x7f0ad82201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad808c7e0 0x7f0ad82201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 -- 172.21.15.100:0/494332921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac80094d0 con 0x7f0ad8161a40 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0ad7400640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 0x7f0ad8220710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0adcc00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c780 tx=0x7f0ad000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0acfe00640 1 -- 172.21.15.100:0/494332921 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0004b60 con 0x7f0ad8161a40 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0acfe00640 1 -- 172.21.15.100:0/494332921 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad000ce90 con 0x7f0ad8161a40 2024-02-21T07:46:58.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.117+0000 7f0acfe00640 1 -- 172.21.15.100:0/494332921 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad000a850 con 0x7f0ad8161a40 2024-02-21T07:46:58.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.118+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad80fd300 con 0x7f0ad8161a40 2024-02-21T07:46:58.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.118+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad80fc720 con 0x7f0ad8161a40 2024-02-21T07:46:58.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.121+0000 7f0acfe00640 1 -- 172.21.15.100:0/494332921 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0ad000a9b0 con 0x7f0ad8161a40 2024-02-21T07:46:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.122+0000 7f0ae184e740 1 Processor -- start 2024-02-21T07:46:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.122+0000 7f0ae184e740 1 -- start start 2024-02-21T07:46:58.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.122+0000 7f0acfe00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 0x7f0ab80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0acfe00640 1 -- 172.21.15.100:0/494332921 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0ad00ca190 con 0x7f0ad8161a40 2024-02-21T07:46:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ad7400640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 0x7f0ab80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d1b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 0x556125cddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125c52150 con 0x556125d50f80 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125c4f680 con 0x556125d1afc0 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ae184e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125c4ae60 con 0x556125d1b8e0 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ad7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d1b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47624/0 (socket says 172.21.15.100:47624) 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.123+0000 7f0ad7e00640 1 -- 172.21.15.100:0/4025402166 learned_addr learned my addr 172.21.15.100:0/4025402166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0adcc00640 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 0x556125cddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 -- 172.21.15.100:0/4025402166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 msgr2=0x556125cddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 0x556125cddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 -- 172.21.15.100:0/4025402166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 msgr2=0x556125d1b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d1b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 -- 172.21.15.100:0/4025402166 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556125c04060 con 0x556125d1afc0 2024-02-21T07:46:58.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0adcc00640 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 0x556125cddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:58.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7400640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 0x7f0ab80a15f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ad821cba0 tx=0x7f0ac4015660 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac8030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406a0776e079146c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ac3e00640 1 -- 172.21.15.100:0/4025402166 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8030d30 con 0x556125d1afc0 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ac3e00640 1 -- 172.21.15.100:0/4025402166 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8039450 con 0x556125d1afc0 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.124+0000 7f0ac3e00640 1 -- 172.21.15.100:0/4025402166 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8039800 con 0x556125d1afc0 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 -- 172.21.15.100:0/4025402166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 msgr2=0x556125d50a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009870 tx=0x7f0ac8030000 comp rx=0 tx=0).stop 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 -- 172.21.15.100:0/4025402166 shutdown_connections 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1b8e0 0x556125cddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d1b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 --2- 172.21.15.100:0/4025402166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1afc0 0x556125d50a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 -- 172.21.15.100:0/4025402166 >> 172.21.15.100:0/4025402166 conn(0x556125caa5a0 msgr2=0x556125ce1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 -- 172.21.15.100:0/4025402166 shutdown_connections 2024-02-21T07:46:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.125+0000 7f0ae184e740 1 -- 172.21.15.100:0/4025402166 wait complete. 2024-02-21T07:46:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.126+0000 7f0ae184e740 1 -- start start 2024-02-21T07:46:58.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.127+0000 7f0ae184e740 1 Processor -- start 2024-02-21T07:46:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125befec0 con 0x556125d50f80 2024-02-21T07:46:58.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125befb60 con 0x556125d1b8e0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561259b91c0 con 0x556125d1afc0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ae184e740 10 client.0 _ll_register_callbacks cb 0x556125c03960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.128+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59176/0 (socket says 172.21.15.100:59176) 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47628/0 (socket says 172.21.15.100:47628) 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 -- 172.21.15.100:0/1106661624 learned_addr learned my addr 172.21.15.100:0/1106661624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0adcc00640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 -- 172.21.15.100:0/1106661624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 msgr2=0x556125d4aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 -- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 msgr2=0x556125d624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 -- 172.21.15.100:0/1106661624 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad81625c0 con 0x556125d1afc0 2024-02-21T07:46:58.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7400640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ac802bfb0 tx=0x7f0ac8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e93e31be40ea0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.129+0000 7f0ac0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8003810 con 0x556125d1afc0 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0ac803e040 con 0x556125d1afc0 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55612594a7e0 con 0x556125d1afc0 2024-02-21T07:46:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ac8003970 con 0x556125d1afc0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ae184e740 10 client.5225 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556125c494e0 con 0x556125d1afc0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.130+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55612594a7e0 con 0x556125d1afc0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0ac8042070 con 0x556125d1afc0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 10 client.5225 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 10 client.5225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 20 client.5225 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125d47b80 0x556125d55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 4 client.5225 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556125987720 con 0x556125d47b80 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.131+0000 7f0ad7400640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125d47b80 0x556125d55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.132+0000 7f0ad7400640 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125d47b80 0x556125d55670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e83ca4042c165 server_cookie=1b0a80ec3102a741 in_seq=0 out_seq=0 2024-02-21T07:46:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.132+0000 7f0ac0c00640 10 client.5225 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.132+0000 7f0ac0c00640 1 -- 172.21.15.100:0/1106661624 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556125987720 con 0x556125d47b80 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.132+0000 7f0ac0c00640 10 client.5225 handle_command_reply: tid=0 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 client.5225 shutdown 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 msgr2=0x556125d46f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0ac802bfb0 tx=0x7f0ac8004730 comp rx=0 tx=0).stop 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 shutdown_connections 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125d47b80 0x556125d55670 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d50f80 0x556125d624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d4aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 --2- 172.21.15.100:0/1106661624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d1afc0 0x556125d46f90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 >> 172.21.15.100:0/1106661624 conn(0x556125caa5a0 msgr2=0x556125d507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ac0c00640 0 client.5225 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:58.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 shutdown_connections 2024-02-21T07:46:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 1 -- 172.21.15.100:0/1106661624 wait complete. 2024-02-21T07:46:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.133+0000 7f0ae184e740 20 client.5225 trim_cache size 0 max 16384 2024-02-21T07:46:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.151+0000 7f0ae184e740 1 Processor -- start 2024-02-21T07:46:58.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.151+0000 7f0ae184e740 1 -- start start 2024-02-21T07:46:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125db5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125db60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125d63440 con 0x556125d1afc0 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125d55030 con 0x556125d1b8e0 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.152+0000 7f0ae184e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125d50dd0 con 0x556125d50f80 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43702/0 (socket says 172.21.15.100:43702) 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 -- 172.21.15.100:0/874767798 learned_addr learned my addr 172.21.15.100:0/874767798 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7400640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125db5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0adcc00640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125db60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 -- 172.21.15.100:0/874767798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 msgr2=0x556125db60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125db60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 -- 172.21.15.100:0/874767798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 msgr2=0x556125db5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125db5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 -- 172.21.15.100:0/874767798 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556125be5950 con 0x556125d1afc0 2024-02-21T07:46:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7400640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125db5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.153+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8000c00 tx=0x7f0ac804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0d08fb3b5e6036 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ac3400640 1 -- 172.21.15.100:0/874767798 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8003ed0 con 0x556125d1afc0 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ac3400640 1 -- 172.21.15.100:0/874767798 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8003610 con 0x556125d1afc0 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ac3400640 1 -- 172.21.15.100:0/874767798 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac80039a0 con 0x556125d1afc0 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 -- 172.21.15.100:0/874767798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 msgr2=0x556125d4edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8000c00 tx=0x7f0ac804c000 comp rx=0 tx=0).stop 2024-02-21T07:46:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 -- 172.21.15.100:0/874767798 shutdown_connections 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125db60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125db5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 --2- 172.21.15.100:0/874767798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d4edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.154+0000 7f0ae184e740 1 -- 172.21.15.100:0/874767798 >> 172.21.15.100:0/874767798 conn(0x556125caa5a0 msgr2=0x556125d55530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.155+0000 7f0ae184e740 1 -- 172.21.15.100:0/874767798 shutdown_connections 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.155+0000 7f0ae184e740 1 -- 172.21.15.100:0/874767798 wait complete. 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.155+0000 7f0ae184e740 1 -- start start 2024-02-21T07:46:58.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.156+0000 7f0ae184e740 1 Processor -- start 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d13b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125d23010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125db43d0 con 0x556125d1afc0 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125d44010 con 0x556125d1b8e0 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556125d140b0 con 0x556125d50f80 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ae184e740 10 client.0 _ll_register_callbacks cb 0x7f0ac8046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ad7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43706/0 (socket says 172.21.15.100:43706) 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3311357940 learned_addr learned my addr 172.21.15.100:0/3311357940 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0adcc00640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125d23010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.157+0000 7f0ad7400640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d13b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3311357940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 msgr2=0x556125d23010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125d23010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3311357940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 msgr2=0x556125d13b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d13b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 -- 172.21.15.100:0/3311357940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac4018720 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ad7e00640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009380 tx=0x7f0ac8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db7fa3cdc3d872 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ac0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac805a850 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0ac8030e40 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ac8039450 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ac8004080 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ae184e740 10 client.5073 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.158+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556125c494e0 con 0x556125d1afc0 2024-02-21T07:46:58.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8039450 con 0x556125d1afc0 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0ac8063070 con 0x556125d1afc0 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 10 client.5073 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 10 client.5073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 20 client.5073 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125ce06c0 0x556125daa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 4 client.5073 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5561259d6890 con 0x556125ce06c0 2024-02-21T07:46:58.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.159+0000 7f0ad7400640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125ce06c0 0x556125daa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ad7400640 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125ce06c0 0x556125daa980 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c4c6ca749c80eb server_cookie=d860331845f7bd05 in_seq=0 out_seq=0 2024-02-21T07:46:58.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ac0c00640 10 client.5073 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ac0c00640 1 -- 172.21.15.100:0/3311357940 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5561259d6890 con 0x556125ce06c0 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ac0c00640 10 client.5073 handle_command_reply: tid=0 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 client.5073 shutdown 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 msgr2=0x556125d19bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009380 tx=0x7f0ac8008030 comp rx=0 tx=0).stop 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 shutdown_connections 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556125ce06c0 0x556125daa980 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556125d50f80 0x556125d23010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556125d1b8e0 0x556125d13b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 --2- 172.21.15.100:0/3311357940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556125d1afc0 0x556125d19bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ac0c00640 0 client.5073 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 >> 172.21.15.100:0/3311357940 conn(0x556125caa5a0 msgr2=0x556125d22200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.160+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 shutdown_connections 2024-02-21T07:46:58.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0ae184e740 1 -- 172.21.15.100:0/3311357940 wait complete. 2024-02-21T07:46:58.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0ae184e740 20 client.5073 trim_cache size 0 max 16384 2024-02-21T07:46:58.171 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:46:58.171 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:46:58.171 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:46:58.171 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 msgr2=0x7f0ab80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 0x7f0ab80a15f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ad821cba0 tx=0x7f0ac4015660 comp rx=0 tx=0).stop 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 msgr2=0x7f0ad817ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c780 tx=0x7f0ad000cc40 comp rx=0 tx=0).stop 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 shutdown_connections 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab809f130 0x7f0ab80a15f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad8161a40 0x7f0ad817ae60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad815daa0 0x7f0ad8220710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 --2- 172.21.15.100:0/494332921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad808c7e0 0x7f0ad82201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.161+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 >> 172.21.15.100:0/494332921 conn(0x7f0ad80fe210 msgr2=0x7f0ad80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.162+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 shutdown_connections 2024-02-21T07:46:58.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.162+0000 7f0adec00640 1 -- 172.21.15.100:0/494332921 wait complete. 2024-02-21T07:46:58.187 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:46:58.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:46:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.374+0000 7fe085c00640 1 Processor -- start 2024-02-21T07:46:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.374+0000 7fe085c00640 1 -- start start 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe085c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe08017c040 0x7fe0800706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe085c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe080070f30 0x7fe0800713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe085c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800f50d0 con 0x7fe080188c00 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe085c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800f4ec0 con 0x7fe08017c040 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe085c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800f6450 con 0x7fe080070f30 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.376+0000 7fe07f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe080188c00 0x7fe080189090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37560/0 (socket says 172.21.15.100:37560) 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07f400640 1 -- 172.21.15.100:0/1492329282 learned_addr learned my addr 172.21.15.100:0/1492329282 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07ea00640 1 --2- 172.21.15.100:0/1492329282 >> v2:172.21.15.100:3300/0 conn(0x7fe08017c040 0x7fe0800706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe076000640 1 --2- 172.21.15.100:0/1492329282 >> v2:172.21.15.156:3300/0 conn(0x7fe080070f30 0x7fe0800713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07e000640 1 -- 172.21.15.100:0/1492329282 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437627779 0 0) 0x7fe0800f50d0 con 0x7fe080188c00 2024-02-21T07:46:58.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07e000640 1 -- 172.21.15.100:0/1492329282 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003520 con 0x7fe080188c00 2024-02-21T07:46:58.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07ea00640 1 -- 172.21.15.100:0/1492329282 >> v2:172.21.15.156:3300/0 conn(0x7fe080070f30 msgr2=0x7fe0800713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07ea00640 1 --2- 172.21.15.100:0/1492329282 >> v2:172.21.15.156:3300/0 conn(0x7fe080070f30 0x7fe0800713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07ea00640 1 -- 172.21.15.100:0/1492329282 >> v1:172.21.15.100:6789/0 conn(0x7fe080188c00 legacy=0x7fe080189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.377+0000 7fe07ea00640 1 -- 172.21.15.100:0/1492329282 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800f53b0 con 0x7fe08017c040 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.378+0000 7fe07ea00640 1 --2- 172.21.15.100:0/1492329282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe08017c040 0x7fe0800706b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0700097a0 tx=0x7fe07002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d1c1e8fcdda2e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.379+0000 7fe07e000640 1 -- 172.21.15.100:0/1492329282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070030610 con 0x7fe08017c040 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.379+0000 7fe07e000640 1 -- 172.21.15.100:0/1492329282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070030770 con 0x7fe08017c040 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.379+0000 7fe07e000640 1 -- 172.21.15.100:0/1492329282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070030b00 con 0x7fe08017c040 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.379+0000 7fe085c00640 1 -- 172.21.15.100:0/1492329282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe08017c040 msgr2=0x7fe0800706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.379+0000 7fe085c00640 1 --2- 172.21.15.100:0/1492329282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe08017c040 0x7fe0800706b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0700097a0 tx=0x7fe07002b960 comp rx=0 tx=0).stop 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 -- 172.21.15.100:0/1492329282 shutdown_connections 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 --2- 172.21.15.100:0/1492329282 >> v2:172.21.15.156:3300/0 conn(0x7fe080070f30 0x7fe0800713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 --2- 172.21.15.100:0/1492329282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe08017c040 0x7fe0800706b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 -- 172.21.15.100:0/1492329282 >> 172.21.15.100:0/1492329282 conn(0x7fe0800ce160 msgr2=0x7fe0800ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 -- 172.21.15.100:0/1492329282 shutdown_connections 2024-02-21T07:46:58.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.380+0000 7fe085c00640 1 -- 172.21.15.100:0/1492329282 wait complete. 2024-02-21T07:46:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.382+0000 7fe085c00640 1 Processor -- start 2024-02-21T07:46:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.382+0000 7fe085c00640 1 -- start start 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 0x7fe08006d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080188c00 0x7fe08006de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08006e3d0 con 0x7fe080070f30 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0801795a0 con 0x7fe080188c00 2024-02-21T07:46:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe085c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08006e5c0 con 0x7fe08017c040 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe07ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe07ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43718/0 (socket says 172.21.15.100:43718) 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe07ea00640 1 -- 172.21.15.100:0/3082674039 learned_addr learned my addr 172.21.15.100:0/3082674039 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe07f400640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080188c00 0x7fe08006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.383+0000 7fe076000640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 0x7fe08006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 -- 172.21.15.100:0/3082674039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 msgr2=0x7fe08006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 0x7fe08006d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 -- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080188c00 msgr2=0x7fe08006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080188c00 0x7fe08006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 -- 172.21.15.100:0/3082674039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe070009400 con 0x7fe080070f30 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe076000640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 0x7fe08006d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe07ea00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe07002bf70 tx=0x7fe070004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07003e040 con 0x7fe080070f30 2024-02-21T07:46:58.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070039a40 con 0x7fe080070f30 2024-02-21T07:46:58.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070039df0 con 0x7fe080070f30 2024-02-21T07:46:58.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08006e8a0 con 0x7fe080070f30 2024-02-21T07:46:58.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.384+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe08006ee60 con 0x7fe080070f30 2024-02-21T07:46:58.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.385+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080067c80 con 0x7fe080070f30 2024-02-21T07:46:58.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.387+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe0700423e0 con 0x7fe080070f30 2024-02-21T07:46:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.389+0000 7fe077400640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 0x7fe05c0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.389+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe0700ec4b0 con 0x7fe080070f30 2024-02-21T07:46:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.389+0000 7fe076000640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 0x7fe05c0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.390+0000 7fe076000640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 0x7fe05c0a1620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe080161db0 tx=0x7fe068008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.391+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe0700b6250 con 0x7fe080070f30 2024-02-21T07:46:58.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.636+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0800f7e30 con 0x7fe080070f30 2024-02-21T07:46:58.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.638+0000 7fe077400640 1 -- 172.21.15.100:0/3082674039 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7fe070034020 con 0x7fe080070f30 2024-02-21T07:46:58.772 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:46:58.772 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:46:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:46:58.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 msgr2=0x7fe05c0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 0x7fe05c0a1620 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe080161db0 tx=0x7fe068008040 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 msgr2=0x7fe080161fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe07002bf70 tx=0x7fe070004730 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 shutdown_connections 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe080188c00 0x7fe08006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe08017c040 0x7fe08006d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe05c09f160 0x7fe05c0a1620 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 --2- 172.21.15.100:0/3082674039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe080070f30 0x7fe080161fc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 >> 172.21.15.100:0/3082674039 conn(0x7fe0800ce160 msgr2=0x7fe080179840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 shutdown_connections 2024-02-21T07:46:58.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.641+0000 7fe085c00640 1 -- 172.21.15.100:0/3082674039 wait complete. 2024-02-21T07:46:58.775 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:46:58.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:46:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.986+0000 7f0c43c00640 1 Processor -- start 2024-02-21T07:46:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.987+0000 7f0c43c00640 1 -- start start 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.988+0000 7f0c43c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c3c06ab60 0x7f0c3c0f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.988+0000 7f0c43c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c43c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c08bfe0 con 0x7f0c3c188ab0 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c43c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c08d420 con 0x7f0c3c0f9ef0 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c43c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c08c880 con 0x7f0c3c06ab60 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43732/0 (socket says 172.21.15.100:43732) 2024-02-21T07:46:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 -- 172.21.15.100:0/3656763938 learned_addr learned my addr 172.21.15.100:0/3656763938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41200640 1 --1- 172.21.15.100:0/3656763938 >> v1:172.21.15.156:6789/0 conn(0x7f0c3c188ab0 0x7f0c3c08cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:43108/0 (socket says 172.21.15.100:43108) 2024-02-21T07:46:58.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c3be00640 1 --2- 172.21.15.100:0/3656763938 >> v2:172.21.15.170:3300/0 conn(0x7f0c3c06ab60 0x7f0c3c0f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:58.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 -- 172.21.15.100:0/3656763938 >> v2:172.21.15.170:3300/0 conn(0x7f0c3c06ab60 msgr2=0x7f0c3c0f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:58.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 --2- 172.21.15.100:0/3656763938 >> v2:172.21.15.170:3300/0 conn(0x7f0c3c06ab60 0x7f0c3c0f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 -- 172.21.15.100:0/3656763938 >> v1:172.21.15.156:6789/0 conn(0x7f0c3c188ab0 legacy=0x7f0c3c08cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.989+0000 7f0c41c00640 1 -- 172.21.15.100:0/3656763938 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0fa660 con 0x7f0c3c0f9ef0 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.990+0000 7f0c41c00640 1 --2- 172.21.15.100:0/3656763938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c066910 tx=0x7f0c3402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3b9a0d47134858 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.991+0000 7f0c3b400640 1 -- 172.21.15.100:0/3656763938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3402ca80 con 0x7f0c3c0f9ef0 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.991+0000 7f0c3b400640 1 -- 172.21.15.100:0/3656763938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3402cbe0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.991+0000 7f0c3b400640 1 -- 172.21.15.100:0/3656763938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c340343f0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.991+0000 7f0c43c00640 1 -- 172.21.15.100:0/3656763938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c0f9ef0 msgr2=0x7f0c3c188e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:58.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.991+0000 7f0c43c00640 1 --2- 172.21.15.100:0/3656763938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c066910 tx=0x7f0c3402bee0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 -- 172.21.15.100:0/3656763938 shutdown_connections 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 --2- 172.21.15.100:0/3656763938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c188e90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 --2- 172.21.15.100:0/3656763938 >> v2:172.21.15.170:3300/0 conn(0x7f0c3c06ab60 0x7f0c3c0f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 -- 172.21.15.100:0/3656763938 >> 172.21.15.100:0/3656763938 conn(0x7f0c3c0fe290 msgr2=0x7f0c3c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 -- 172.21.15.100:0/3656763938 shutdown_connections 2024-02-21T07:46:58.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.992+0000 7f0c43c00640 1 -- 172.21.15.100:0/3656763938 wait complete. 2024-02-21T07:46:59.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.994+0000 7f0c43c00640 1 Processor -- start 2024-02-21T07:46:59.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.994+0000 7f0c43c00640 1 -- start start 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c3c06ab60 0x7f0c3c0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c16be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0d1360 con 0x7f0c3c188ab0 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0d04b0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.995+0000 7f0c43c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c0d1cc0 con 0x7f0c3c06ab60 2024-02-21T07:46:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c41c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c41c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43744/0 (socket says 172.21.15.100:43744) 2024-02-21T07:46:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c41200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c3c06ab60 0x7f0c3c0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c16be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c41c00640 1 -- 172.21.15.100:0/541187282 learned_addr learned my addr 172.21.15.100:0/541187282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 -- 172.21.15.100:0/541187282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c3c06ab60 msgr2=0x7f0c3c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c3c06ab60 0x7f0c3c0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 -- 172.21.15.100:0/541187282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 msgr2=0x7f0c3c0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 -- 172.21.15.100:0/541187282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c34009b30 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c41c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.996+0000 7f0c3be00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c16be00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800e870 tx=0x7f0c2800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.997+0000 7f0c38c00640 1 -- 172.21.15.100:0/541187282 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ee60 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.997+0000 7f0c38c00640 1 -- 172.21.15.100:0/541187282 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800c940 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.997+0000 7f0c38c00640 1 -- 172.21.15.100:0/541187282 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800ccd0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.997+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c0d06e0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:58.997+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c0d0ca0 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.000+0000 7f0c38c00640 1 -- 172.21.15.100:0/541187282 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0c28013470 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.002+0000 7f0c469f6740 1 Processor -- start 2024-02-21T07:46:59.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.002+0000 7f0c469f6740 1 -- start start 2024-02-21T07:46:59.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.002+0000 7f0c38c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 0x7f0c1c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.002+0000 7f0c38c00640 1 -- 172.21.15.100:0/541187282 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c280c9c30 con 0x7f0c3c0f9ef0 2024-02-21T07:46:59.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.002+0000 7f0c41c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 0x7f0c1c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c41c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 0x7f0c1c0a15f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c3402bf20 tx=0x7f0c34030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda72320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed969210 con 0x55f1eda367e0 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed966740 con 0x55f1eda35ec0 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c469f6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed961f20 con 0x55f1eda71590 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.003+0000 7f0c3be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c41200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43746/0 (socket says 172.21.15.100:43746) 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 -- 172.21.15.100:0/3409144700 learned_addr learned my addr 172.21.15.100:0/3409144700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c41200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47692/0 (socket says 172.21.15.100:47692) 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c41c00640 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda72320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 -- 172.21.15.100:0/3409144700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 msgr2=0x55f1eda72320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda72320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 -- 172.21.15.100:0/3409144700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 msgr2=0x55f1eda362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 -- 172.21.15.100:0/3409144700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1ed923df0 con 0x55f1eda367e0 2024-02-21T07:46:59.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c41200640 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c3be00640 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c7530 tx=0x7f0c280958b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ef9fa137f74274 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c2d600640 1 -- 172.21.15.100:0/3409144700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2809b810 con 0x55f1eda367e0 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c2d600640 1 -- 172.21.15.100:0/3409144700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2809fe60 con 0x55f1eda367e0 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.004+0000 7f0c2d600640 1 -- 172.21.15.100:0/3409144700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280820b0 con 0x55f1eda367e0 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 -- 172.21.15.100:0/3409144700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 msgr2=0x55f1eda71050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c7530 tx=0x7f0c280958b0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 -- 172.21.15.100:0/3409144700 shutdown_connections 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda72320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda71050 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3409144700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda35ec0 0x55f1eda362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 -- 172.21.15.100:0/3409144700 >> 172.21.15.100:0/3409144700 conn(0x55f1ed9f8490 msgr2=0x55f1ed9f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 -- 172.21.15.100:0/3409144700 shutdown_connections 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.005+0000 7f0c469f6740 1 -- 172.21.15.100:0/3409144700 wait complete. 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.006+0000 7f0c469f6740 1 -- start start 2024-02-21T07:46:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.006+0000 7f0c469f6740 1 Processor -- start 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda71590 0x55f1eda7c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda78fb0 0x55f1eda5ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed907150 con 0x55f1eda367e0 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed906df0 con 0x55f1eda71590 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.007+0000 7f0c469f6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed6d01c0 con 0x55f1eda78fb0 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c469f6740 10 client.0 _ll_register_callbacks cb 0x55f1ed9562b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43748/0 (socket says 172.21.15.100:43748) 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 -- 172.21.15.100:0/876489687 learned_addr learned my addr 172.21.15.100:0/876489687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41c00640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda78fb0 0x55f1eda5ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c3be00640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda71590 0x55f1eda7c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 -- 172.21.15.100:0/876489687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda78fb0 msgr2=0x55f1eda5ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda78fb0 0x55f1eda5ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 -- 172.21.15.100:0/876489687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda71590 msgr2=0x55f1eda7c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda71590 0x55f1eda7c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.008+0000 7f0c41200640 1 -- 172.21.15.100:0/876489687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c0d0ca0 con 0x55f1eda367e0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c41200640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c30004f20 tx=0x7f0c30001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb351c502adae286 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300145b0 con 0x55f1eda367e0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c30014710 con 0x55f1eda367e0 2024-02-21T07:46:59.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1ed6617e0 con 0x55f1eda367e0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c300148d0 con 0x55f1eda367e0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c469f6740 10 client.5094 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f1ed9605a0 con 0x55f1eda367e0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f1ed6617e0 con 0x55f1eda367e0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.009+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0c30012050 con 0x55f1eda367e0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 10 client.5094 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 10 client.5094 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 20 client.5094 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda79430 0x55f1eda7c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 4 client.5094 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1ed69e720 con 0x55f1eda79430 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c3be00640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda79430 0x55f1eda7c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c22000640 10 client.5094 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:59.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.010+0000 7f0c3be00640 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda79430 0x55f1eda7c810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ec0151d6e54f6b1 server_cookie=91905b78728b7b30 in_seq=0 out_seq=0 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c22000640 1 -- 172.21.15.100:0/876489687 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f1ed69e720 con 0x55f1eda79430 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c22000640 10 client.5094 handle_command_reply: tid=0 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c469f6740 1 client.5094 shutdown 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 msgr2=0x55f1eda78620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0c30004f20 tx=0x7f0c30001740 comp rx=0 tx=0).stop 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 shutdown_connections 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.011+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda79430 0x55f1eda7c810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda78fb0 0x55f1eda5ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda71590 0x55f1eda7c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c22000640 0 client.5094 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 --2- 172.21.15.100:0/876489687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda78620 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 >> 172.21.15.100:0/876489687 conn(0x55f1eda35ec0 msgr2=0x55f1ed9f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 shutdown_connections 2024-02-21T07:46:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 1 -- 172.21.15.100:0/876489687 wait complete. 2024-02-21T07:46:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.012+0000 7f0c469f6740 20 client.5094 trim_cache size 0 max 16384 2024-02-21T07:46:59.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.025+0000 7f0c469f6740 1 Processor -- start 2024-02-21T07:46:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.025+0000 7f0c469f6740 1 -- start start 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda7d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda66dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed9f9ad0 con 0x55f1eda367e0 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed9f67b0 con 0x55f1eda78fb0 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.026+0000 7f0c469f6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1ed9f8230 con 0x55f1eda71590 2024-02-21T07:46:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43752/0 (socket says 172.21.15.100:43752) 2024-02-21T07:46:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 -- 172.21.15.100:0/3940735965 learned_addr learned my addr 172.21.15.100:0/3940735965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41c00640 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda66dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c3be00640 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda7d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 -- 172.21.15.100:0/3940735965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 msgr2=0x55f1eda7d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda7d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 -- 172.21.15.100:0/3940735965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 msgr2=0x55f1eda66dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda66dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 -- 172.21.15.100:0/3940735965 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1ed8fcab0 con 0x55f1eda367e0 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.027+0000 7f0c41200640 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c30004810 tx=0x7f0c3000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33202880bc067008 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c2cc00640 1 -- 172.21.15.100:0/3940735965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300077d0 con 0x55f1eda367e0 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c2cc00640 1 -- 172.21.15.100:0/3940735965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30007210 con 0x55f1eda367e0 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c2cc00640 1 -- 172.21.15.100:0/3940735965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300147f0 con 0x55f1eda367e0 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 -- 172.21.15.100:0/3940735965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 msgr2=0x55f1eda3b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0c30004810 tx=0x7f0c3000f000 comp rx=0 tx=0).stop 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 -- 172.21.15.100:0/3940735965 shutdown_connections 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda66dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda71590 0x55f1eda7d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 --2- 172.21.15.100:0/3940735965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda367e0 0x55f1eda3b730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 -- 172.21.15.100:0/3940735965 >> 172.21.15.100:0/3940735965 conn(0x55f1eda35ec0 msgr2=0x55f1eda3bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 -- 172.21.15.100:0/3940735965 shutdown_connections 2024-02-21T07:46:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.028+0000 7f0c469f6740 1 -- 172.21.15.100:0/3940735965 wait complete. 2024-02-21T07:46:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.029+0000 7f0c469f6740 1 -- start start 2024-02-21T07:46:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.029+0000 7f0c469f6740 1 Processor -- start 2024-02-21T07:46:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 0x55f1ed9f94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 0x55f1eda66de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda7a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1eda7bcf0 con 0x55f1eda71590 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1eda5c5b0 con 0x55f1eda78fb0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1eda79e10 con 0x55f1eda367e0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c469f6740 10 client.0 _ll_register_callbacks cb 0x7f0c280046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c41200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 0x55f1ed9f94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 0x55f1eda66de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c41200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 0x55f1ed9f94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59222/0 (socket says 172.21.15.100:59222) 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c41200640 1 -- 172.21.15.100:0/542377530 learned_addr learned my addr 172.21.15.100:0/542377530 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c41c00640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda7a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 -- 172.21.15.100:0/542377530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 msgr2=0x55f1ed9f94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 0x55f1ed9f94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 -- 172.21.15.100:0/542377530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 msgr2=0x55f1eda7a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda7a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 -- 172.21.15.100:0/542377530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1ed9605a0 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.031+0000 7f0c3be00640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 0x55f1eda66de0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c28097700 tx=0x7f0c280b6050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b9e67c88b00614 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2809b890 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c280c3040 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c2809fe60 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c28097540 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c469f6740 10 client.5100 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f1ed922650 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2809fe60 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.032+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0c28011070 con 0x55f1eda71590 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 10 client.5100 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 10 client.5100 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:46:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 20 client.5100 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda65dc0 0x55f1edac7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 4 client.5100 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:46:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f1ed6ed890 con 0x55f1eda65dc0 2024-02-21T07:46:59.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.033+0000 7f0c41200640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda65dc0 0x55f1edac7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c41200640 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda65dc0 0x55f1edac7d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49dc1f4e7da78a8d server_cookie=347601ac0cf838d4 in_seq=0 out_seq=0 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c22000640 10 client.5100 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c22000640 1 -- 172.21.15.100:0/542377530 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f1ed6ed890 con 0x55f1eda65dc0 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c22000640 10 client.5100 handle_command_reply: tid=0 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 client.5100 shutdown 2024-02-21T07:46:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 msgr2=0x55f1eda66de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 0x55f1eda66de0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0c28097700 tx=0x7f0c280b6050 comp rx=0 tx=0).stop 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 shutdown_connections 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f1eda65dc0 0x55f1edac7d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f1eda78fb0 0x55f1eda7a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1eda71590 0x55f1eda66de0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 --2- 172.21.15.100:0/542377530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f1eda367e0 0x55f1ed9f94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 >> 172.21.15.100:0/542377530 conn(0x55f1eda35ec0 msgr2=0x55f1eda6d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.034+0000 7f0c22000640 0 client.5100 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 shutdown_connections 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c469f6740 1 -- 172.21.15.100:0/542377530 wait complete. 2024-02-21T07:46:59.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c469f6740 20 client.5100 trim_cache size 0 max 16384 2024-02-21T07:46:59.045 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:46:59.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 msgr2=0x7f0c1c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 0x7f0c1c0a15f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0c3402bf20 tx=0x7f0c34030000 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 msgr2=0x7f0c3c16be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c16be00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800e870 tx=0x7f0c2800ed30 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 shutdown_connections 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c1c09f130 0x7f0c1c0a15f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c3c188ab0 0x7f0c3c0d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c3c0f9ef0 0x7f0c3c16be00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 --2- 172.21.15.100:0/541187282 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c3c06ab60 0x7f0c3c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.035+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 >> 172.21.15.100:0/541187282 conn(0x7f0c3c0fe290 msgr2=0x7f0c3c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.036+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 shutdown_connections 2024-02-21T07:46:59.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.036+0000 7f0c43c00640 1 -- 172.21.15.100:0/541187282 wait complete. 2024-02-21T07:46:59.058 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:46:59.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:46:59.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.254+0000 7fdce3200640 1 Processor -- start 2024-02-21T07:46:59.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.254+0000 7fdce3200640 1 -- start start 2024-02-21T07:46:59.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce3200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdce4188a30 0x7fdce40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce3200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fdce40f9890 0x7fdce40c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce3200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40f8510 con 0x7fdce40f7fe0 2024-02-21T07:46:59.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce3200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40f9470 con 0x7fdce4188a30 2024-02-21T07:46:59.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce3200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40f87f0 con 0x7fdce40f9890 2024-02-21T07:46:59.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdce4188a30 0x7fdce40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdce4188a30 0x7fdce40c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43770/0 (socket says 172.21.15.100:43770) 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdce1e00640 1 -- 172.21.15.100:0/2862358064 learned_addr learned my addr 172.21.15.100:0/2862358064 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.256+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/2862358064 >> v2:172.21.15.156:3300/0 conn(0x7fdce40f9890 0x7fdce40c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.257+0000 7fdce1e00640 1 -- 172.21.15.100:0/2862358064 >> v2:172.21.15.156:3300/0 conn(0x7fdce40f9890 msgr2=0x7fdce40c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.257+0000 7fdce1400640 1 -- 172.21.15.100:0/2862358064 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664732513 0 0) 0x7fdce40f8510 con 0x7fdce40f7fe0 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.257+0000 7fdce1e00640 1 --2- 172.21.15.100:0/2862358064 >> v2:172.21.15.156:3300/0 conn(0x7fdce40f9890 0x7fdce40c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.257+0000 7fdce1e00640 1 -- 172.21.15.100:0/2862358064 >> v1:172.21.15.156:6789/0 conn(0x7fdce40f7fe0 legacy=0x7fdce4188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.257+0000 7fdce1e00640 1 -- 172.21.15.100:0/2862358064 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40f8ad0 con 0x7fdce4188a30 2024-02-21T07:46:59.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.258+0000 7fdce1e00640 1 --2- 172.21.15.100:0/2862358064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce4188a30 0x7fdce40c9470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdce40ed780 tx=0x7fdcd402db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19cc9755a6951cfa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.258+0000 7fdce1400640 1 -- 172.21.15.100:0/2862358064 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd402f8e0 con 0x7fdce4188a30 2024-02-21T07:46:59.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.258+0000 7fdce1400640 1 -- 172.21.15.100:0/2862358064 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd402fa40 con 0x7fdce4188a30 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.258+0000 7fdce1400640 1 -- 172.21.15.100:0/2862358064 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd402fdd0 con 0x7fdce4188a30 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 -- 172.21.15.100:0/2862358064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce4188a30 msgr2=0x7fdce40c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 --2- 172.21.15.100:0/2862358064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce4188a30 0x7fdce40c9470 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdce40ed780 tx=0x7fdcd402db20 comp rx=0 tx=0).stop 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 -- 172.21.15.100:0/2862358064 shutdown_connections 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 --2- 172.21.15.100:0/2862358064 >> v2:172.21.15.156:3300/0 conn(0x7fdce40f9890 0x7fdce40c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 --2- 172.21.15.100:0/2862358064 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce4188a30 0x7fdce40c9470 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 -- 172.21.15.100:0/2862358064 >> 172.21.15.100:0/2862358064 conn(0x7fdce40ce150 msgr2=0x7fdce40ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 -- 172.21.15.100:0/2862358064 shutdown_connections 2024-02-21T07:46:59.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.259+0000 7fdce3200640 1 -- 172.21.15.100:0/2862358064 wait complete. 2024-02-21T07:46:59.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.261+0000 7fdce3200640 1 Processor -- start 2024-02-21T07:46:59.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.261+0000 7fdce3200640 1 -- start start 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 0x7fdce41791c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce4188a30 0x7fdce40f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce421fcb0 con 0x7fdce40f4a40 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40f53e0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.263+0000 7fdce3200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce421ff00 con 0x7fdce4188a30 2024-02-21T07:46:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 0x7fdce41791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43776/0 (socket says 172.21.15.100:43776) 2024-02-21T07:46:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce2800640 1 -- 172.21.15.100:0/4073850108 learned_addr learned my addr 172.21.15.100:0/4073850108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce4188a30 0x7fdce40f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 -- 172.21.15.100:0/4073850108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce4188a30 msgr2=0x7fdce40f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce4188a30 0x7fdce40f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 -- 172.21.15.100:0/4073850108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 msgr2=0x7fdce4220cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce1e00640 1 -- 172.21.15.100:0/4073850108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40094d0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.264+0000 7fdce2800640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdce1e00640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 0x7fdce41791c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4035000 tx=0x7fdcd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdcda000640 1 -- 172.21.15.100:0/4073850108 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4037c60 con 0x7fdce40f7fe0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdcda000640 1 -- 172.21.15.100:0/4073850108 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd4037dc0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce42201e0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdcda000640 1 -- 172.21.15.100:0/4073850108 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40426b0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.265+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce42207a0 con 0x7fdce40f7fe0 2024-02-21T07:46:59.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.269+0000 7fdcebd6f740 1 Processor -- start 2024-02-21T07:46:59.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.270+0000 7fdcebd6f740 1 -- start start 2024-02-21T07:46:59.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.270+0000 7fdcda000640 1 -- 172.21.15.100:0/4073850108 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fdcd4042810 con 0x7fdce40f7fe0 2024-02-21T07:46:59.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 0x5570079e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x557007a24200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700791c210 con 0x557007a24740 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557007919740 con 0x5570079e9070 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557007914f20 con 0x5570079e9990 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcda000640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 0x7fdcc00a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcdbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcdbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43782/0 (socket says 172.21.15.100:43782) 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdcdbe00640 1 -- 172.21.15.100:0/3986581531 learned_addr learned my addr 172.21.15.100:0/3986581531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdce1e00640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x557007a24200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.271+0000 7fdce2800640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 0x5570079e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcda000640 1 -- 172.21.15.100:0/4073850108 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdcd4033070 con 0x7fdce40f7fe0 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdce2800640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 0x7fdcc00a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 -- 172.21.15.100:0/3986581531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 msgr2=0x557007a24200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x557007a24200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 -- 172.21.15.100:0/3986581531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 msgr2=0x5570079e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 0x5570079e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 -- 172.21.15.100:0/3986581531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570078d6df0 con 0x557007a24740 2024-02-21T07:46:59.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdce1e00640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x557007a24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdce2800640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 0x5570079e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:59.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009ac0 tx=0x7fdccc009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64cda1705d49e6d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdce2800640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 0x7fdcc00a1570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5570079ab3c0 tx=0x7fdcdc001640 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.272+0000 7fdcd2a00640 1 -- 172.21.15.100:0/3986581531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc011cf0 con 0x557007a24740 2024-02-21T07:46:59.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcd2a00640 1 -- 172.21.15.100:0/3986581531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc011e50 con 0x557007a24740 2024-02-21T07:46:59.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcd2a00640 1 -- 172.21.15.100:0/3986581531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc004230 con 0x557007a24740 2024-02-21T07:46:59.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3986581531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 msgr2=0x557007a254d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009ac0 tx=0x7fdccc009f80 comp rx=0 tx=0).stop 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3986581531 shutdown_connections 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a254d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x557007a24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3986581531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9070 0x5570079e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3986581531 >> 172.21.15.100:0/3986581531 conn(0x5570079ab640 msgr2=0x5570079ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3986581531 shutdown_connections 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.273+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3986581531 wait complete. 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.274+0000 7fdcebd6f740 1 -- start start 2024-02-21T07:46:59.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.275+0000 7fdcebd6f740 1 Processor -- start 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x5570079dca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 0x5570079edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570078ba150 con 0x5570079ed530 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570078b9df0 con 0x557007a24740 2024-02-21T07:46:59.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570076831c0 con 0x5570079e9990 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcebd6f740 10 client.0 _ll_register_callbacks cb 0x5570079092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdce1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdce1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59258/0 (socket says 172.21.15.100:59258) 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdce1e00640 1 -- 172.21.15.100:0/1978278856 learned_addr learned my addr 172.21.15.100:0/1978278856 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdce2800640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 0x5570079edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.276+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x5570079dca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 -- 172.21.15.100:0/1978278856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 msgr2=0x5570079dca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x5570079dca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 -- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 msgr2=0x5570079edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 0x5570079edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 -- 172.21.15.100:0/1978278856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc009720 con 0x5570079e9990 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce2800640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 0x5570079edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40b6a90 tx=0x7fdcd408b5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb30e178bfad7a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcc7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b6040 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdcd40bad30 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570076147e0 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd40b61a0 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcebd6f740 10 client.5261 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5570079135a0 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.277+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570076147e0 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdcd4052020 con 0x5570079e9990 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 10 client.5261 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 10 client.5261 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 20 client.5261 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079de650 0x557007a309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 4 client.5261 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:59.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557007651720 con 0x5570079de650 2024-02-21T07:46:59.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.278+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079de650 0x557007a309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079de650 0x557007a309e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e5fab8e1c729809 server_cookie=4d5043b96bdcd606 in_seq=0 out_seq=0 2024-02-21T07:46:59.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcc7400640 10 client.5261 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcc7400640 1 -- 172.21.15.100:0/1978278856 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557007651720 con 0x5570079de650 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcc7400640 10 client.5261 handle_command_reply: tid=0 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcebd6f740 1 client.5261 shutdown 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 msgr2=0x5570079da8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.279+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40b6a90 tx=0x7fdcd408b5b0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 shutdown_connections 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079ed530 0x5570079edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079de650 0x557007a309e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x5570079dca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1978278856 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079e9990 0x5570079da8e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcc7400640 0 client.5261 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 >> 172.21.15.100:0/1978278856 conn(0x5570079e9070 msgr2=0x557007a24b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 shutdown_connections 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1978278856 wait complete. 2024-02-21T07:46:59.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.280+0000 7fdcebd6f740 20 client.5261 trim_cache size 0 max 16384 2024-02-21T07:46:59.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.293+0000 7fdcebd6f740 1 Processor -- start 2024-02-21T07:46:59.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.293+0000 7fdcebd6f740 1 -- start start 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x5570079ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557007a22680 con 0x557007a24740 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570079a7950 con 0x5570079e9990 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557007a35000 con 0x5570079ed530 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.294+0000 7fdce1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47758/0 (socket says 172.21.15.100:47758) 2024-02-21T07:46:59.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 -- 172.21.15.100:0/3439141670 learned_addr learned my addr 172.21.15.100:0/3439141670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce2800640 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x5570079ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 -- 172.21.15.100:0/3439141670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 msgr2=0x5570079ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x5570079ad140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 -- 172.21.15.100:0/3439141670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 msgr2=0x557007a24d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a24d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 -- 172.21.15.100:0/3439141670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570078afab0 con 0x5570079e9990 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.295+0000 7fdce1e00640 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ba5c0 tx=0x7fdcd40eeeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19d6e94671bbe66 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcd2000640 1 -- 172.21.15.100:0/3439141670 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40be7d0 con 0x5570079e9990 2024-02-21T07:46:59.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcd2000640 1 -- 172.21.15.100:0/3439141670 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40ba680 con 0x5570079e9990 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcd2000640 1 -- 172.21.15.100:0/3439141670 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40ba170 con 0x5570079e9990 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3439141670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 msgr2=0x5570079aad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ba5c0 tx=0x7fdcd40eeeb0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3439141670 shutdown_connections 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557007a24740 0x557007a24d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x5570079ad140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/3439141670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570079e9990 0x5570079aad10 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ba5c0 tx=0x7fdcd40eeeb0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3439141670 >> 172.21.15.100:0/3439141670 conn(0x5570079e9070 msgr2=0x5570079dc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3439141670 shutdown_connections 2024-02-21T07:46:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.296+0000 7fdcebd6f740 1 -- 172.21.15.100:0/3439141670 wait complete. 2024-02-21T07:46:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.297+0000 7fdcebd6f740 1 -- start start 2024-02-21T07:46:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.297+0000 7fdcebd6f740 1 Processor -- start 2024-02-21T07:46:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x557007a85210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x557007a35210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557007a85750 con 0x5570079e8050 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570079da250 con 0x557007a24740 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570079b4280 con 0x5570079ed530 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcebd6f740 10 client.0 _ll_register_callbacks cb 0x7fdccc009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43824/0 (socket says 172.21.15.100:43824) 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 -- 172.21.15.100:0/1170441905 learned_addr learned my addr 172.21.15.100:0/1170441905 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x557007a85210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdcdbe00640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x557007a35210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 -- 172.21.15.100:0/1170441905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 msgr2=0x557007a85210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x557007a85210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 -- 172.21.15.100:0/1170441905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 msgr2=0x557007a35210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x557007a35210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.299+0000 7fdce2800640 1 -- 172.21.15.100:0/1170441905 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570079135a0 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdce2800640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005380 tx=0x7fdcdc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a16cae67492954 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcc7400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0199d0 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdcdc019b30 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdccc011e50 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcdc019cf0 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcebd6f740 10 client.5118 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5570078d5650 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.300+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc035020 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdcdc017430 con 0x5570079e8050 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 10 client.5118 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 10 client.5118 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:46:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 20 client.5118 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079ac680 0x557007a8af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 4 client.5118 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:46:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5570076a0890 con 0x5570079ac680 2024-02-21T07:46:59.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079ac680 0x557007a8af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdcc7400640 10 client.5118 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.301+0000 7fdce1e00640 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079ac680 0x557007a8af90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77b0ecd922598664 server_cookie=6bff07e138c2210f in_seq=0 out_seq=0 2024-02-21T07:46:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcc7400640 1 -- 172.21.15.100:0/1170441905 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5570076a0890 con 0x5570079ac680 2024-02-21T07:46:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcc7400640 10 client.5118 handle_command_reply: tid=0 2024-02-21T07:46:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 client.5118 shutdown 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 msgr2=0x5570079b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc005380 tx=0x7fdcdc001250 comp rx=0 tx=0).stop 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 shutdown_connections 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570079e8050 0x5570079b3800 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5570079ac680 0x557007a8af90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557007a24740 0x557007a35210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 --2- 172.21.15.100:0/1170441905 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570079ed530 0x557007a85210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 >> 172.21.15.100:0/1170441905 conn(0x5570079e9070 msgr2=0x5570079a3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcc7400640 0 client.5118 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 shutdown_connections 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 1 -- 172.21.15.100:0/1170441905 wait complete. 2024-02-21T07:46:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.302+0000 7fdcebd6f740 20 client.5118 trim_cache size 0 max 16384 2024-02-21T07:46:59.313 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:46:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 msgr2=0x7fdcc00a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 0x7fdcc00a1570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5570079ab3c0 tx=0x7fdcdc001640 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 msgr2=0x7fdce41791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 0x7fdce41791c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4035000 tx=0x7fdcd40046c0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 shutdown_connections 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdcc009f0b0 0x7fdcc00a1570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdce40f4a40 0x7fdce4220cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdce4188a30 0x7fdce40f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 --2- 172.21.15.100:0/4073850108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdce40f7fe0 0x7fdce41791c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 >> 172.21.15.100:0/4073850108 conn(0x7fdce40ce150 msgr2=0x7fdce406f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 shutdown_connections 2024-02-21T07:46:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.303+0000 7fdce3200640 1 -- 172.21.15.100:0/4073850108 wait complete. 2024-02-21T07:46:59.327 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:46:59.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:46:59.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.525+0000 7f2e86600640 1 Processor -- start 2024-02-21T07:46:59.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.525+0000 7f2e86600640 1 -- start start 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e80189ca0 0x7f2e8006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 0x7f2e800cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e8018a080 0x7f2e8018a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800ca6a0 con 0x7f2e801871c0 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800f6450 con 0x7f2e8018a080 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e86600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800ca8d0 con 0x7f2e80189ca0 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.527+0000 7f2e7ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 0x7f2e800cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e8018a080 0x7f2e8018a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2e80189ca0 0x7f2e8006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2e8018a080 0x7f2e8018a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47766/0 (socket says 172.21.15.100:47766) 2024-02-21T07:46:59.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 -- 172.21.15.100:0/3806391333 learned_addr learned my addr 172.21.15.100:0/3806391333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 -- 172.21.15.100:0/3806391333 >> v2:172.21.15.170:3300/0 conn(0x7f2e80189ca0 msgr2=0x7f2e8006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/3806391333 >> v2:172.21.15.170:3300/0 conn(0x7f2e80189ca0 0x7f2e8006ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 -- 172.21.15.100:0/3806391333 >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 msgr2=0x7f2e800cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/3806391333 >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 0x7f2e800cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7fe00640 1 -- 172.21.15.100:0/3806391333 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800cabb0 con 0x7f2e8018a080 2024-02-21T07:46:59.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.528+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/3806391333 >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 0x7f2e800cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.529+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/3806391333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e8018a080 0x7f2e8018a4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2e800f7940 tx=0x7f2e7802bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e33b81052255f8e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e7e000640 1 -- 172.21.15.100:0/3806391333 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7802caa0 con 0x7f2e8018a080 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e7e000640 1 -- 172.21.15.100:0/3806391333 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7802cc00 con 0x7f2e8018a080 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e7e000640 1 -- 172.21.15.100:0/3806391333 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e780343f0 con 0x7f2e8018a080 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 -- 172.21.15.100:0/3806391333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e8018a080 msgr2=0x7f2e8018a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 --2- 172.21.15.100:0/3806391333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e8018a080 0x7f2e8018a4d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2e800f7940 tx=0x7f2e7802bf00 comp rx=0 tx=0).stop 2024-02-21T07:46:59.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 -- 172.21.15.100:0/3806391333 shutdown_connections 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 --2- 172.21.15.100:0/3806391333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e8018a080 0x7f2e8018a4d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 --2- 172.21.15.100:0/3806391333 >> v2:172.21.15.100:3300/0 conn(0x7f2e801871c0 0x7f2e800cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 --2- 172.21.15.100:0/3806391333 >> v2:172.21.15.170:3300/0 conn(0x7f2e80189ca0 0x7f2e8006ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 -- 172.21.15.100:0/3806391333 >> 172.21.15.100:0/3806391333 conn(0x7f2e800668b0 msgr2=0x7f2e80066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 -- 172.21.15.100:0/3806391333 shutdown_connections 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.530+0000 7f2e86600640 1 -- 172.21.15.100:0/3806391333 wait complete. 2024-02-21T07:46:59.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.532+0000 7f2e86600640 1 Processor -- start 2024-02-21T07:46:59.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.533+0000 7f2e86600640 1 -- start start 2024-02-21T07:46:59.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e801871c0 0x7f2e8020f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 0x7f2e8016c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80187bb0 con 0x7f2e8018a080 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80210310 con 0x7f2e801871c0 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e86600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8020f790 con 0x7f2e80189ca0 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 0x7f2e8016c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59302/0 (socket says 172.21.15.100:59302) 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e801871c0 0x7f2e8020f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 0x7f2e8016c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43852/0 (socket says 172.21.15.100:43852) 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 -- 172.21.15.100:0/2993017882 learned_addr learned my addr 172.21.15.100:0/2993017882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 -- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e801871c0 msgr2=0x7f2e8020f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e801871c0 0x7f2e8020f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 -- 172.21.15.100:0/2993017882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 msgr2=0x7f2e8016c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 0x7f2e8016c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.534+0000 7f2e7ea00640 1 -- 172.21.15.100:0/2993017882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009400 con 0x7f2e80189ca0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00e8e0 tx=0x7f2e6c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e77400640 1 -- 172.21.15.100:0/2993017882 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00c940 con 0x7f2e80189ca0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e77400640 1 -- 172.21.15.100:0/2993017882 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00caa0 con 0x7f2e80189ca0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e77400640 1 -- 172.21.15.100:0/2993017882 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00ce30 con 0x7f2e80189ca0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e78009b30 con 0x7f2e80189ca0 2024-02-21T07:46:59.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.535+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8020fd50 con 0x7f2e80189ca0 2024-02-21T07:46:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.540+0000 7f2e77400640 1 -- 172.21.15.100:0/2993017882 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f2e6c013470 con 0x7f2e80189ca0 2024-02-21T07:46:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.540+0000 7f2e8923c740 1 Processor -- start 2024-02-21T07:46:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.540+0000 7f2e8923c740 1 -- start start 2024-02-21T07:46:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.541+0000 7f2e77400640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 0x7f2e600a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.541+0000 7f2e77400640 1 -- 172.21.15.100:0/2993017882 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2e6c0c9d90 con 0x7f2e80189ca0 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.541+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 0x7f2e600a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.541+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa8824320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e8923c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa871b210 con 0x564aa87e7ec0 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e8923c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa8718740 con 0x564aa87e87e0 2024-02-21T07:46:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e8923c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa8713f20 con 0x564aa8823590 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43868/0 (socket says 172.21.15.100:43868) 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 -- 172.21.15.100:0/1084059543 learned_addr learned my addr 172.21.15.100:0/1084059543 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa8824320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 0x7f2e600a1620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2e78035000 tx=0x7f2e78030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 -- 172.21.15.100:0/1084059543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 msgr2=0x564aa8824320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa8824320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 -- 172.21.15.100:0/1084059543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 msgr2=0x564aa8823050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.542+0000 7f2e7f400640 1 -- 172.21.15.100:0/1084059543 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564aa86d5df0 con 0x564aa87e7ec0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e7f400640 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009c30 tx=0x7f2e70011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da499fe0461b88cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e6be00640 1 -- 172.21.15.100:0/1084059543 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70014440 con 0x564aa87e7ec0 2024-02-21T07:46:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e6be00640 1 -- 172.21.15.100:0/1084059543 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e700145a0 con 0x564aa87e7ec0 2024-02-21T07:46:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e6be00640 1 -- 172.21.15.100:0/1084059543 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70014930 con 0x564aa87e7ec0 2024-02-21T07:46:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 -- 172.21.15.100:0/1084059543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 msgr2=0x564aa87e82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009c30 tx=0x7f2e70011690 comp rx=0 tx=0).stop 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 -- 172.21.15.100:0/1084059543 shutdown_connections 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa8824320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 --2- 172.21.15.100:0/1084059543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87e7ec0 0x564aa87e82a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.543+0000 7f2e8923c740 1 -- 172.21.15.100:0/1084059543 >> 172.21.15.100:0/1084059543 conn(0x564aa87aa490 msgr2=0x564aa87ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.544+0000 7f2e8923c740 1 -- 172.21.15.100:0/1084059543 shutdown_connections 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.544+0000 7f2e8923c740 1 -- 172.21.15.100:0/1084059543 wait complete. 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.544+0000 7f2e8923c740 1 -- start start 2024-02-21T07:46:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.545+0000 7f2e8923c740 1 Processor -- start 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa87d6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa882f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa86b9150 con 0x564aa87d9d20 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa86b8df0 con 0x564aa87e87e0 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa84821c0 con 0x564aa8823590 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e8923c740 10 client.0 _ll_register_callbacks cb 0x564aa87082b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43882/0 (socket says 172.21.15.100:43882) 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e7fe00640 1 -- 172.21.15.100:0/4151162442 learned_addr learned my addr 172.21.15.100:0/4151162442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa882f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.546+0000 7f2e7f400640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa87d6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 -- 172.21.15.100:0/4151162442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 msgr2=0x564aa882f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa882f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 -- 172.21.15.100:0/4151162442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 msgr2=0x564aa87d6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa87d6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 -- 172.21.15.100:0/4151162442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e70009860 con 0x564aa87d9d20 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e7803fb50 tx=0x7f2e7802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77ae3050bb48b8d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e68c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78046070 con 0x564aa87d9d20 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2e7804c470 con 0x564aa87d9d20 2024-02-21T07:46:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.547+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564aa84137e0 con 0x564aa87d9d20 2024-02-21T07:46:59.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.548+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e7804c630 con 0x564aa87d9d20 2024-02-21T07:46:59.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.548+0000 7f2e8923c740 10 client.5130 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.548+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564aa87125a0 con 0x564aa87d9d20 2024-02-21T07:46:59.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.548+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564aa84137e0 con 0x564aa87d9d20 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2e7804c790 con 0x564aa87d9d20 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 10 client.5130 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 10 client.5130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 20 client.5130 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa882ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 4 client.5130 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564aa8450720 con 0x564aa87a75d0 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.549+0000 7f2e7f400640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa882ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e68c00640 10 client.5130 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e7f400640 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa882ff80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61274763aee43929 server_cookie=c9784a0bcaaca8f8 in_seq=0 out_seq=0 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e68c00640 1 -- 172.21.15.100:0/4151162442 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564aa8450720 con 0x564aa87a75d0 2024-02-21T07:46:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e68c00640 10 client.5130 handle_command_reply: tid=0 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e8923c740 1 client.5130 shutdown 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 msgr2=0x564aa87a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.550+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e7803fb50 tx=0x7f2e7802e070 comp rx=0 tx=0).stop 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 shutdown_connections 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa882ff80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa87d9d20 0x564aa87a6bc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa8823590 0x564aa882f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 --2- 172.21.15.100:0/4151162442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa87d6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 >> 172.21.15.100:0/4151162442 conn(0x564aa87e7ec0 msgr2=0x564aa87abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e68c00640 0 client.5130 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 shutdown_connections 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 1 -- 172.21.15.100:0/4151162442 wait complete. 2024-02-21T07:46:59.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.551+0000 7f2e8923c740 20 client.5130 trim_cache size 0 max 16384 2024-02-21T07:46:59.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.564+0000 7f2e8923c740 1 Processor -- start 2024-02-21T07:46:59.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.564+0000 7f2e8923c740 1 -- start start 2024-02-21T07:46:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87eb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa87a28c0 con 0x564aa8823590 2024-02-21T07:46:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa8823eb0 con 0x564aa87e87e0 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e8923c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa87aac00 con 0x564aa87d9d20 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59330/0 (socket says 172.21.15.100:59330) 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 -- 172.21.15.100:0/391043198 learned_addr learned my addr 172.21.15.100:0/391043198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 -- 172.21.15.100:0/391043198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 msgr2=0x564aa8823970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 -- 172.21.15.100:0/391043198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 msgr2=0x564aa87eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87eb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7f400640 1 -- 172.21.15.100:0/391043198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564aa86aeab0 con 0x564aa87d9d20 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.566+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:46:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.567+0000 7f2e7f400640 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2e70019000 tx=0x7f2e70016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aada90533b2201d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.567+0000 7f2e6b400640 1 -- 172.21.15.100:0/391043198 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70022040 con 0x564aa87d9d20 2024-02-21T07:46:59.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.567+0000 7f2e6b400640 1 -- 172.21.15.100:0/391043198 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70004140 con 0x564aa87d9d20 2024-02-21T07:46:59.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.567+0000 7f2e6b400640 1 -- 172.21.15.100:0/391043198 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e700044f0 con 0x564aa87d9d20 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.567+0000 7f2e8923c740 1 -- 172.21.15.100:0/391043198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 msgr2=0x564aa8822f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2e70019000 tx=0x7f2e70016000 comp rx=0 tx=0).stop 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 -- 172.21.15.100:0/391043198 shutdown_connections 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87e87e0 0x564aa8823970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 --2- 172.21.15.100:0/391043198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 -- 172.21.15.100:0/391043198 >> 172.21.15.100:0/391043198 conn(0x564aa87e7ec0 msgr2=0x564aa87c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 -- 172.21.15.100:0/391043198 shutdown_connections 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.568+0000 7f2e8923c740 1 -- 172.21.15.100:0/391043198 wait complete. 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.569+0000 7f2e8923c740 1 -- start start 2024-02-21T07:46:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.569+0000 7f2e8923c740 1 Processor -- start 2024-02-21T07:46:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.570+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.570+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87e87e0 0x564aa888c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.570+0000 7f2e8923c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.570+0000 7f2e8923c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa87dd2a0 con 0x564aa8823590 2024-02-21T07:46:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e8923c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa87a6480 con 0x564aa87d9d20 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e8923c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa87dcb10 con 0x564aa87e87e0 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e8923c740 10 client.0 _ll_register_callbacks cb 0x7f2e70009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43908/0 (socket says 172.21.15.100:43908) 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 -- 172.21.15.100:0/2326442575 learned_addr learned my addr 172.21.15.100:0/2326442575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7ea00640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87e87e0 0x564aa888c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7f400640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 -- 172.21.15.100:0/2326442575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87e87e0 msgr2=0x564aa888c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87e87e0 0x564aa888c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 -- 172.21.15.100:0/2326442575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 msgr2=0x564aa8822f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 -- 172.21.15.100:0/2326442575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564aa86d5df0 con 0x564aa8823590 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7f400640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:46:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e7fe00640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e7802f020 tx=0x7f2e78047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d341742b8f614042 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.571+0000 7f2e68c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7803f960 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2e7804c470 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e700145a0 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e7804c630 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e8923c740 10 client.5136 fetch_fsmap learned FSMap version 16 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564aa86d4650 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.572+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7806c020 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2e7804c790 con 0x564aa8823590 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 10 client.5136 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 10 client.5136 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 20 client.5136 populate_metadata read hostname 'smithi100' 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa87a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:59.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 4 client.5136 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:46:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564aa849f890 con 0x564aa87a75d0 2024-02-21T07:46:59.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e7f400640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa87a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e7f400640 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa87a5be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9925244b465188f5 server_cookie=c6861016fcffc7c6 in_seq=0 out_seq=0 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.573+0000 7f2e68c00640 10 client.5136 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e68c00640 1 -- 172.21.15.100:0/2326442575 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564aa849f890 con 0x564aa87a75d0 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e68c00640 10 client.5136 handle_command_reply: tid=0 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 client.5136 shutdown 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 msgr2=0x564aa87dc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2e7802f020 tx=0x7f2e78047000 comp rx=0 tx=0).stop 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 shutdown_connections 2024-02-21T07:46:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564aa87a75d0 0x564aa87a5be0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564aa8823590 0x564aa87dc5d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564aa87e87e0 0x564aa888c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 --2- 172.21.15.100:0/2326442575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564aa87d9d20 0x564aa8822f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e68c00640 0 client.5136 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 >> 172.21.15.100:0/2326442575 conn(0x564aa87e7ec0 msgr2=0x564aa87d6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 shutdown_connections 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 1 -- 172.21.15.100:0/2326442575 wait complete. 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.574+0000 7f2e8923c740 20 client.5136 trim_cache size 0 max 16384 2024-02-21T07:46:59.584 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:46:59.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 msgr2=0x7f2e600a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 0x7f2e600a1620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2e78035000 tx=0x7f2e78030000 comp rx=0 tx=0).stop 2024-02-21T07:46:59.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 msgr2=0x7f2e80072b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00e8e0 tx=0x7f2e6c00eda0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 shutdown_connections 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2e6009f160 0x7f2e600a1620 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e8018a080 0x7f2e8016c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2e80189ca0 0x7f2e80072b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 --2- 172.21.15.100:0/2993017882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e801871c0 0x7f2e8020f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 >> 172.21.15.100:0/2993017882 conn(0x7f2e800668b0 msgr2=0x7f2e8006ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 shutdown_connections 2024-02-21T07:46:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:46:59.575+0000 7f2e86600640 1 -- 172.21.15.100:0/2993017882 wait complete. 2024-02-21T07:47:00.599 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:47:00.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:47:00.599 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:47:00.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.815+0000 7faf39800640 1 Processor -- start 2024-02-21T07:47:00.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.816+0000 7faf39800640 1 -- start start 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.817+0000 7faf39800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf34184050 0x7faf3406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.817+0000 7faf39800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 0x7faf34184620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf39800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3406da60 con 0x7faf34189ca0 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf39800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3406e6e0 con 0x7faf34187390 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf39800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3406dd40 con 0x7faf34184050 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf34184050 0x7faf3406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7faf34184050 0x7faf3406eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42392/0 (socket says 172.21.15.100:42392) 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 -- 172.21.15.100:0/2122103936 learned_addr learned my addr 172.21.15.100:0/2122103936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32000640 1 --2- 172.21.15.100:0/2122103936 >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 0x7faf34184620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 -- 172.21.15.100:0/2122103936 >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 msgr2=0x7faf34184620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 --2- 172.21.15.100:0/2122103936 >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 0x7faf34184620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.818+0000 7faf32a00640 1 -- 172.21.15.100:0/2122103936 >> v1:172.21.15.100:6789/0 conn(0x7faf34189ca0 legacy=0x7faf3418a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.819+0000 7faf32a00640 1 -- 172.21.15.100:0/2122103936 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3406e020 con 0x7faf34184050 2024-02-21T07:47:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.819+0000 7faf32000640 1 --2- 172.21.15.100:0/2122103936 >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 0x7faf34184620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:00.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.820+0000 7faf32a00640 1 --2- 172.21.15.100:0/2122103936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf3406eb00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf34074b60 tx=0x7faf2402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c19c9c8b1b63b844 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.820+0000 7faf31600640 1 -- 172.21.15.100:0/2122103936 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240317e0 con 0x7faf34184050 2024-02-21T07:47:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.820+0000 7faf31600640 1 -- 172.21.15.100:0/2122103936 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24031940 con 0x7faf34184050 2024-02-21T07:47:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.820+0000 7faf31600640 1 -- 172.21.15.100:0/2122103936 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24031cd0 con 0x7faf34184050 2024-02-21T07:47:00.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 -- 172.21.15.100:0/2122103936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 msgr2=0x7faf3406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 --2- 172.21.15.100:0/2122103936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf3406eb00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf34074b60 tx=0x7faf2402b880 comp rx=0 tx=0).stop 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 -- 172.21.15.100:0/2122103936 shutdown_connections 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 --2- 172.21.15.100:0/2122103936 >> v2:172.21.15.100:3300/0 conn(0x7faf34187390 0x7faf34184620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 --2- 172.21.15.100:0/2122103936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf3406eb00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 -- 172.21.15.100:0/2122103936 >> 172.21.15.100:0/2122103936 conn(0x7faf340668b0 msgr2=0x7faf34066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 -- 172.21.15.100:0/2122103936 shutdown_connections 2024-02-21T07:47:00.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.821+0000 7faf39800640 1 -- 172.21.15.100:0/2122103936 wait complete. 2024-02-21T07:47:00.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.823+0000 7faf39800640 1 Processor -- start 2024-02-21T07:47:00.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.823+0000 7faf39800640 1 -- start start 2024-02-21T07:47:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.824+0000 7faf39800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf341895c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.824+0000 7faf39800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf39800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf34189ca0 0x7faf34188460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf39800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34187a80 con 0x7faf34187390 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf39800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34188040 con 0x7faf34184050 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf39800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34189b00 con 0x7faf34189ca0 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58856/0 (socket says 172.21.15.100:58856) 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 -- 172.21.15.100:0/1947892474 learned_addr learned my addr 172.21.15.100:0/1947892474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32a00640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf341895c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf33400640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf34189ca0 0x7faf34188460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 -- 172.21.15.100:0/1947892474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf34189ca0 msgr2=0x7faf34188460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf34189ca0 0x7faf34188460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 -- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 msgr2=0x7faf341895c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf341895c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.825+0000 7faf32000640 1 -- 172.21.15.100:0/1947892474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094d0 con 0x7faf34187390 2024-02-21T07:47:00.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf32000640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf2000c7f0 tx=0x7faf2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf2aa00640 1 -- 172.21.15.100:0/1947892474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf200077c0 con 0x7faf34187390 2024-02-21T07:47:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf2aa00640 1 -- 172.21.15.100:0/1947892474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20007920 con 0x7faf34187390 2024-02-21T07:47:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf2aa00640 1 -- 172.21.15.100:0/1947892474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20007c90 con 0x7faf34187390 2024-02-21T07:47:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340cc270 con 0x7faf34187390 2024-02-21T07:47:00.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.826+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf340cc830 con 0x7faf34187390 2024-02-21T07:47:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.829+0000 7faf2aa00640 1 -- 172.21.15.100:0/1947892474 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7faf200113f0 con 0x7faf34187390 2024-02-21T07:47:00.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.830+0000 7faf3c476740 1 Processor -- start 2024-02-21T07:47:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.830+0000 7faf3c476740 1 -- start start 2024-02-21T07:47:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.831+0000 7faf2aa00640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 0x7faf140a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.831+0000 7faf2aa00640 1 -- 172.21.15.100:0/1947892474 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faf200c9fa0 con 0x7faf34187390 2024-02-21T07:47:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.831+0000 7faf33400640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 0x7faf140a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaaae1c0 0x556aeaaae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf33400640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 0x7faf140a15f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0055e0 tx=0x7faf2c003d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaa2e300 con 0x556aeaaaeae0 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea9e0e50 con 0x556aeaae9890 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf3c476740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea9de380 con 0x556aeaaae1c0 2024-02-21T07:47:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf33400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf33400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42406/0 (socket says 172.21.15.100:42406) 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf33400640 1 -- 172.21.15.100:0/924121949 learned_addr learned my addr 172.21.15.100:0/924121949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58868/0 (socket says 172.21.15.100:58868) 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf32a00640 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaaae1c0 0x556aeaaae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.832+0000 7faf33400640 1 -- 172.21.15.100:0/924121949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaaae1c0 msgr2=0x556aeaaae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf33400640 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaaae1c0 0x556aeaaae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf33400640 1 -- 172.21.15.100:0/924121949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 msgr2=0x556aeaae9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf33400640 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf33400640 1 -- 172.21.15.100:0/924121949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556aea9a2c80 con 0x556aeaae9890 2024-02-21T07:47:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf32000640 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf33400640 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005780 tx=0x7faf2c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7e507109b076f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf1f400640 1 -- 172.21.15.100:0/924121949 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c01f410 con 0x556aeaae9890 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf1f400640 1 -- 172.21.15.100:0/924121949 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c01f570 con 0x556aeaae9890 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.833+0000 7faf1f400640 1 -- 172.21.15.100:0/924121949 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c01f900 con 0x556aeaae9890 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 -- 172.21.15.100:0/924121949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 msgr2=0x556aeaaea620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005780 tx=0x7faf2c012000 comp rx=0 tx=0).stop 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 -- 172.21.15.100:0/924121949 shutdown_connections 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaae9890 0x556aeaaea620 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaae9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 --2- 172.21.15.100:0/924121949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaaae1c0 0x556aeaaae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 -- 172.21.15.100:0/924121949 >> 172.21.15.100:0/924121949 conn(0x556aeaa70790 msgr2=0x556aeaa71810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 -- 172.21.15.100:0/924121949 shutdown_connections 2024-02-21T07:47:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.834+0000 7faf3c476740 1 -- 172.21.15.100:0/924121949 wait complete. 2024-02-21T07:47:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.835+0000 7faf3c476740 1 -- start start 2024-02-21T07:47:00.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.835+0000 7faf3c476740 1 Processor -- start 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaad920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa99260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea9d9b60 con 0x556aeaaaeae0 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea97efd0 con 0x556aeaa6e5c0 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea97ec70 con 0x556aeaae9890 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.836+0000 7faf3c476740 10 client.0 _ll_register_callbacks cb 0x556aea6eac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:57268/0 (socket says 172.21.15.100:57268) 2024-02-21T07:47:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 -- 172.21.15.100:0/999855173 learned_addr learned my addr 172.21.15.100:0/999855173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf33400640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa99260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 -- 172.21.15.100:0/999855173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 msgr2=0x556aeaa99260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa99260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 -- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 msgr2=0x556aeaaad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 -- 172.21.15.100:0/999855173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c00fe60 con 0x556aeaae9890 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf32000640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf2009fb90 tx=0x7faf200c7c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80d59b460c3603ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.837+0000 7faf13e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20097030 con 0x556aeaae9890 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556aea6d9860 con 0x556aeaae9890 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faf20093690 con 0x556aeaae9890 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf20097190 con 0x556aeaae9890 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 10 client.5294 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556aea9d81e0 con 0x556aeaae9890 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556aea6d9860 con 0x556aeaae9890 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7faf20093850 con 0x556aeaae9890 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 10 client.5294 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 10 client.5294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 20 client.5294 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaacc10 0x556aeaaacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 4 client.5294 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.838+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556aea72a410 con 0x556aeaaacc10 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.839+0000 7faf32a00640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaacc10 0x556aeaaacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.839+0000 7faf13e00640 10 client.5294 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:00.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.839+0000 7faf32a00640 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaacc10 0x556aeaaacff0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39a2f4bf0c593aa1 server_cookie=747be38e9143726b in_seq=0 out_seq=0 2024-02-21T07:47:00.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf13e00640 1 -- 172.21.15.100:0/999855173 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556aea72a410 con 0x556aeaaacc10 2024-02-21T07:47:00.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf13e00640 10 client.5294 handle_command_reply: tid=0 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 client.5294 shutdown 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 msgr2=0x556aeaa98d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf2009fb90 tx=0x7faf200c7c70 comp rx=0 tx=0).stop 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 shutdown_connections 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaacc10 0x556aeaaacff0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa99260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaa98d20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf13e00640 0 client.5294 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 --2- 172.21.15.100:0/999855173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.840+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 >> 172.21.15.100:0/999855173 conn(0x556aeaaae1c0 msgr2=0x556aeaa72200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.841+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 shutdown_connections 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.841+0000 7faf3c476740 1 -- 172.21.15.100:0/999855173 wait complete. 2024-02-21T07:47:00.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.841+0000 7faf3c476740 20 client.5294 trim_cache size 0 max 16384 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.859+0000 7faf3c476740 1 Processor -- start 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.859+0000 7faf3c476740 1 -- start start 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaaa3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaafa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaae90d0 con 0x556aeaaaeae0 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaa99d30 con 0x556aeaa6e5c0 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf3c476740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaae63d0 con 0x556aeaae9890 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58886/0 (socket says 172.21.15.100:58886) 2024-02-21T07:47:00.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf32000640 1 -- 172.21.15.100:0/3932852480 learned_addr learned my addr 172.21.15.100:0/3932852480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf32a00640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaaa3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.860+0000 7faf33400640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaafa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 -- 172.21.15.100:0/3932852480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 msgr2=0x556aeaafa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaafa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 -- 172.21.15.100:0/3932852480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 msgr2=0x556aeaaa3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaaa3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 -- 172.21.15.100:0/3932852480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556aea974a90 con 0x556aeaaaeae0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32a00640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaaa3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf32000640 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf20093da0 tx=0x7faf20099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970c88981387aa6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf1ea00640 1 -- 172.21.15.100:0/3932852480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000a450 con 0x556aeaaaeae0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf1ea00640 1 -- 172.21.15.100:0/3932852480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20097330 con 0x556aeaaaeae0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.861+0000 7faf1ea00640 1 -- 172.21.15.100:0/3932852480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20096ab0 con 0x556aeaaaeae0 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 -- 172.21.15.100:0/3932852480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 msgr2=0x556aeaa6f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faf20093da0 tx=0x7faf20099000 comp rx=0 tx=0).stop 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 -- 172.21.15.100:0/3932852480 shutdown_connections 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeaafa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaa6f870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 --2- 172.21.15.100:0/3932852480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaaa3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 -- 172.21.15.100:0/3932852480 >> 172.21.15.100:0/3932852480 conn(0x556aeaaae1c0 msgr2=0x556aeaa6ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 -- 172.21.15.100:0/3932852480 shutdown_connections 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.862+0000 7faf3c476740 1 -- 172.21.15.100:0/3932852480 wait complete. 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.863+0000 7faf3c476740 1 -- start start 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.863+0000 7faf3c476740 1 Processor -- start 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa72200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeab47790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aea7220c0 con 0x556aeaaaeae0 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaae9070 con 0x556aeaa6e5c0 2024-02-21T07:47:00.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556aeaaa3370 con 0x556aeaae9890 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.864+0000 7faf3c476740 10 client.0 _ll_register_callbacks cb 0x7faf2c016040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58892/0 (socket says 172.21.15.100:58892) 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 -- 172.21.15.100:0/988824261 learned_addr learned my addr 172.21.15.100:0/988824261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf33400640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeab47790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32a00640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa72200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 -- 172.21.15.100:0/988824261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 msgr2=0x556aeab47790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeab47790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 -- 172.21.15.100:0/988824261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 msgr2=0x556aeaa72200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa72200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 -- 172.21.15.100:0/988824261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556aea9d81e0 con 0x556aeaaaeae0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf32000640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf20095c80 tx=0x7faf200959e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d6f91be7a06ed8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf13e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:00.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.865+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000a450 con 0x556aeaaaeae0 2024-02-21T07:47:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faf20093690 con 0x556aeaaaeae0 2024-02-21T07:47:00.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf2c01f570 con 0x556aeaaaeae0 2024-02-21T07:47:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf20093850 con 0x556aeaaaeae0 2024-02-21T07:47:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 10 client.5151 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556aea99a6a0 con 0x556aeaaaeae0 2024-02-21T07:47:00.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf200a6020 con 0x556aeaaaeae0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7faf200af180 con 0x556aeaaaeae0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 10 client.5151 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 10 client.5151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 20 client.5151 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaa29b0 0x556aeaa76bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 4 client.5151 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.866+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556aea7167b0 con 0x556aeaaa29b0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.867+0000 7faf32a00640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaa29b0 0x556aeaa76bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.867+0000 7faf32a00640 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaa29b0 0x556aeaa76bb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=412a34f8ef4fc2c5 server_cookie=5e9462fec58e8253 in_seq=0 out_seq=0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.867+0000 7faf13e00640 10 client.5151 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.868+0000 7faf13e00640 1 -- 172.21.15.100:0/988824261 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556aea7167b0 con 0x556aeaaa29b0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.868+0000 7faf13e00640 10 client.5151 handle_command_reply: tid=0 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.868+0000 7faf3c476740 1 client.5151 shutdown 2024-02-21T07:47:00.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 msgr2=0x556aeaaa3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faf20095c80 tx=0x7faf200959e0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 shutdown_connections 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556aeaaa29b0 0x556aeaa76bb0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556aeaae9890 0x556aeab47790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556aeaaaeae0 0x556aeaaa3bd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 --2- 172.21.15.100:0/988824261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556aeaa6e5c0 0x556aeaa72200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 >> 172.21.15.100:0/988824261 conn(0x556aeaaae1c0 msgr2=0x556aeaa99200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf13e00640 0 client.5151 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 shutdown_connections 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.869+0000 7faf3c476740 1 -- 172.21.15.100:0/988824261 wait complete. 2024-02-21T07:47:00.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.870+0000 7faf3c476740 20 client.5151 trim_cache size 0 max 16384 2024-02-21T07:47:00.880 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:47:00.880 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:47:00.880 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "d0477328-aad4-4b41-a61e-456b4cbd1db9", 2024-02-21T07:47:00.880 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:47:00.880 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.870+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 msgr2=0x7faf140a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.870+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 0x7faf140a15f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0055e0 tx=0x7faf2c003d10 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.870+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 msgr2=0x7faf3421f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.870+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faf2000c7f0 tx=0x7faf2000ccb0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 shutdown_connections 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faf34189ca0 0x7faf34188460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faf1409f130 0x7faf140a15f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf34187390 0x7faf3421f410 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 --2- 172.21.15.100:0/1947892474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf34184050 0x7faf341895c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 >> 172.21.15.100:0/1947892474 conn(0x7faf340668b0 msgr2=0x7faf340c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 shutdown_connections 2024-02-21T07:47:00.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:00.871+0000 7faf39800640 1 -- 172.21.15.100:0/1947892474 wait complete. 2024-02-21T07:47:00.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:47:00.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:47:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.098+0000 7f41e5a00640 1 Processor -- start 2024-02-21T07:47:01.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.098+0000 7f41e5a00640 1 -- start start 2024-02-21T07:47:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41e5a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41e0164950 0x7f41e018b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41e5a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00f7150 con 0x7f41e018b860 2024-02-21T07:47:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41e5a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e0189fa0 con 0x7f41e00f8520 2024-02-21T07:47:01.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41e5a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e018af00 con 0x7f41e0164950 2024-02-21T07:47:01.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41e0164950 0x7f41e018b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41de000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f41e018b860 0x7f41e018bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50840/0 (socket says 172.21.15.100:50840) 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41de000640 1 -- 172.21.15.100:0/720860602 learned_addr learned my addr 172.21.15.100:0/720860602 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dd600640 1 -- 172.21.15.100:0/720860602 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920144365 0 0) 0x7f41e0189fa0 con 0x7f41e00f8520 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dd600640 1 -- 172.21.15.100:0/720860602 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c4003520 con 0x7f41e00f8520 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dea00640 1 -- 172.21.15.100:0/720860602 >> v1:172.21.15.170:6789/0 conn(0x7f41e00f8520 legacy=0x7f41e018c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dea00640 1 -- 172.21.15.100:0/720860602 >> v1:172.21.15.100:6789/0 conn(0x7f41e018b860 legacy=0x7f41e018bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.101+0000 7f41dea00640 1 -- 172.21.15.100:0/720860602 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e018a280 con 0x7f41e0164950 2024-02-21T07:47:01.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.102+0000 7f41dea00640 1 --2- 172.21.15.100:0/720860602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e0164950 0x7f41e018b320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097a0 tx=0x7f41d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cb57df18c0db52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.102+0000 7f41dd600640 1 -- 172.21.15.100:0/720860602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0031830 con 0x7f41e0164950 2024-02-21T07:47:01.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.102+0000 7f41dd600640 1 -- 172.21.15.100:0/720860602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d0031990 con 0x7f41e0164950 2024-02-21T07:47:01.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41dd600640 1 -- 172.21.15.100:0/720860602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d0031d20 con 0x7f41e0164950 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 -- 172.21.15.100:0/720860602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e0164950 msgr2=0x7f41e018b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 --2- 172.21.15.100:0/720860602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e0164950 0x7f41e018b320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41d00097a0 tx=0x7f41d002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 -- 172.21.15.100:0/720860602 shutdown_connections 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 --2- 172.21.15.100:0/720860602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e0164950 0x7f41e018b320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 -- 172.21.15.100:0/720860602 >> 172.21.15.100:0/720860602 conn(0x7f41e006ab60 msgr2=0x7f41e006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 -- 172.21.15.100:0/720860602 shutdown_connections 2024-02-21T07:47:01.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.103+0000 7f41e5a00640 1 -- 172.21.15.100:0/720860602 wait complete. 2024-02-21T07:47:01.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.105+0000 7f41e5a00640 1 Processor -- start 2024-02-21T07:47:01.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.105+0000 7f41e5a00640 1 -- start start 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.106+0000 7f41e5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41e5a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0164950 0x7f41e021f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41e5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e018b860 0x7f41e0183a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41e5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0155510 con 0x7f41e00f8520 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41e5a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01557f0 con 0x7f41e0164950 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41e5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0155ad0 con 0x7f41e018b860 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58916/0 (socket says 172.21.15.100:58916) 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 -- 172.21.15.100:0/3551699603 learned_addr learned my addr 172.21.15.100:0/3551699603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41de000640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0164950 0x7f41e021f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41df400640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e018b860 0x7f41e0183a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 -- 172.21.15.100:0/3551699603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e018b860 msgr2=0x7f41e0183a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e018b860 0x7f41e0183a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 -- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0164950 msgr2=0x7f41e021f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0164950 0x7f41e021f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.107+0000 7f41dea00640 1 -- 172.21.15.100:0/3551699603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0009400 con 0x7f41e00f8520 2024-02-21T07:47:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41dea00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41d0000c00 tx=0x7f41d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41d6a00640 1 -- 172.21.15.100:0/3551699603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d003a8f0 con 0x7f41e00f8520 2024-02-21T07:47:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41d6a00640 1 -- 172.21.15.100:0/3551699603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d003aa50 con 0x7f41e00f8520 2024-02-21T07:47:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e0155db0 con 0x7f41e00f8520 2024-02-21T07:47:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41d6a00640 1 -- 172.21.15.100:0/3551699603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d003ae00 con 0x7f41e00f8520 2024-02-21T07:47:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.108+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e0156370 con 0x7f41e00f8520 2024-02-21T07:47:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.111+0000 7f41d6a00640 1 -- 172.21.15.100:0/3551699603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f41d004d450 con 0x7f41e00f8520 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.113+0000 7f41e863c740 1 Processor -- start 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.113+0000 7f41d6a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 0x7f41c00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.113+0000 7f41e863c740 1 -- start start 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.114+0000 7f41d6a00640 1 -- 172.21.15.100:0/3551699603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41d00ebcf0 con 0x7f41e00f8520 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.114+0000 7f41df400640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 0x7f41c00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.114+0000 7f41df400640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 0x7f41c00a15f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41e00d37f0 tx=0x7f41d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbba13a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb915150 con 0x563bbb9de8e0 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb912680 con 0x563bbb9ddfc0 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.115+0000 7f41e863c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb90de60 con 0x563bbba13f80 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58930/0 (socket says 172.21.15.100:58930) 2024-02-21T07:47:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbba13a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41df400640 1 -- 172.21.15.100:0/2025002222 learned_addr learned my addr 172.21.15.100:0/2025002222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:01.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41de000640 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 -- 172.21.15.100:0/2025002222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 msgr2=0x563bbb9de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 -- 172.21.15.100:0/2025002222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 msgr2=0x563bbb9a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 -- 172.21.15.100:0/2025002222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bbb8c7060 con 0x563bbb9ddfc0 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41df400640 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.116+0000 7f41dea00640 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbba13a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d00e9510 tx=0x7f41d00b9d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c246995948e4367e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41cb400640 1 -- 172.21.15.100:0/2025002222 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00bd7c0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41cb400640 1 -- 172.21.15.100:0/2025002222 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d00c1e10 con 0x563bbb9ddfc0 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41cb400640 1 -- 172.21.15.100:0/2025002222 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00b5ce0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41e863c740 1 -- 172.21.15.100:0/2025002222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 msgr2=0x563bbba13a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41e863c740 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbba13a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d00e9510 tx=0x7f41d00b9d70 comp rx=0 tx=0).stop 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41e863c740 1 -- 172.21.15.100:0/2025002222 shutdown_connections 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.117+0000 7f41e863c740 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9de8e0 0x563bbb9a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 --2- 172.21.15.100:0/2025002222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbba13a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 -- 172.21.15.100:0/2025002222 >> 172.21.15.100:0/2025002222 conn(0x563bbb96d5a0 msgr2=0x563bbb9a4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 -- 172.21.15.100:0/2025002222 shutdown_connections 2024-02-21T07:47:01.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 -- 172.21.15.100:0/2025002222 wait complete. 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.118+0000 7f41e863c740 1 -- start start 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.119+0000 7f41e863c740 1 Processor -- start 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9de8e0 0x563bbb9dc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb8b2ec0 con 0x563bbba13f80 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb8b2b60 con 0x563bbb9ddfc0 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb67c1c0 con 0x563bbb9de8e0 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41e863c740 10 client.0 _ll_register_callbacks cb 0x563bbb8c6960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41dea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41dea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42482/0 (socket says 172.21.15.100:42482) 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41dea00640 1 -- 172.21.15.100:0/1764144272 learned_addr learned my addr 172.21.15.100:0/1764144272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.120+0000 7f41de000640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9de8e0 0x563bbb9dc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 -- 172.21.15.100:0/1764144272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9de8e0 msgr2=0x563bbb9dc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9de8e0 0x563bbb9dc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 -- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 msgr2=0x563bbba0e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba0e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 -- 172.21.15.100:0/1764144272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e0156370 con 0x563bbb9ddfc0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41df400640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41dea00640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41d00b5ad0 tx=0x7f41d00ea000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b07fb6565f3bbabd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00bd7c0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41d00d10d0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563bbb60d7e0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d00d1290 con 0x563bbb9ddfc0 2024-02-21T07:47:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41e863c740 10 client.5284 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.121+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563bbb90c4e0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563bbb60d7e0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f41d00c1980 con 0x563bbb9ddfc0 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 10 client.5284 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 10 client.5284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 20 client.5284 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0dea0 0x563bbba137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 4 client.5284 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563bbb64a720 con 0x563bbba0dea0 2024-02-21T07:47:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.122+0000 7f41de000640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0dea0 0x563bbba137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.123+0000 7f41de000640 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0dea0 0x563bbba137b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15507f9d5a92d38b server_cookie=b7a99f70e3a33d3 in_seq=0 out_seq=0 2024-02-21T07:47:01.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.123+0000 7f41bfe00640 10 client.5284 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41bfe00640 1 -- 172.21.15.100:0/1764144272 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563bbb64a720 con 0x563bbba0dea0 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41bfe00640 10 client.5284 handle_command_reply: tid=0 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 client.5284 shutdown 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 msgr2=0x563bbb9d7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41d00b5ad0 tx=0x7f41d00ea000 comp rx=0 tx=0).stop 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 shutdown_connections 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0dea0 0x563bbba137b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba0e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9de8e0 0x563bbb9dc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 --2- 172.21.15.100:0/1764144272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9ddfc0 0x563bbb9d7b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41bfe00640 0 client.5284 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 >> 172.21.15.100:0/1764144272 conn(0x563bbb96d5a0 msgr2=0x563bbb9a58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 shutdown_connections 2024-02-21T07:47:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 1 -- 172.21.15.100:0/1764144272 wait complete. 2024-02-21T07:47:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.124+0000 7f41e863c740 20 client.5284 trim_cache size 0 max 16384 2024-02-21T07:47:01.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.141+0000 7f41e863c740 1 Processor -- start 2024-02-21T07:47:01.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.141+0000 7f41e863c740 1 -- start start 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 0x563bbba137b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbb9aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb9dc9d0 con 0x563bbba13f80 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbba22c40 con 0x563bbb9de8e0 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.142+0000 7f41e863c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbba13cf0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41dea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 0x563bbba137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbb9aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58940/0 (socket says 172.21.15.100:58940) 2024-02-21T07:47:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41df400640 1 -- 172.21.15.100:0/3418022436 learned_addr learned my addr 172.21.15.100:0/3418022436 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 -- 172.21.15.100:0/3418022436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 msgr2=0x563bbba137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 0x563bbba137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 -- 172.21.15.100:0/3418022436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 msgr2=0x563bbba75dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 -- 172.21.15.100:0/3418022436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bbb8a8950 con 0x563bbb9de8e0 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41dea00640 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 0x563bbba137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41df400640 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.143+0000 7f41de000640 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbb9aaeb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x563bbba0e450 tx=0x7f41cc006040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7deeff8b33dc0a3f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41caa00640 1 -- 172.21.15.100:0/3418022436 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc020070 con 0x563bbb9de8e0 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41caa00640 1 -- 172.21.15.100:0/3418022436 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc01c130 con 0x563bbb9de8e0 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41caa00640 1 -- 172.21.15.100:0/3418022436 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc01c4c0 con 0x563bbb9de8e0 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 -- 172.21.15.100:0/3418022436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 msgr2=0x563bbb9aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbb9aaeb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x563bbba0e450 tx=0x7f41cc006040 comp rx=0 tx=0).stop 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 -- 172.21.15.100:0/3418022436 shutdown_connections 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbba13f80 0x563bbba75dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbb9aaeb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 --2- 172.21.15.100:0/3418022436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbb9ddfc0 0x563bbba137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 -- 172.21.15.100:0/3418022436 >> 172.21.15.100:0/3418022436 conn(0x563bbb96d5a0 msgr2=0x563bbb9d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 -- 172.21.15.100:0/3418022436 shutdown_connections 2024-02-21T07:47:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.144+0000 7f41e863c740 1 -- 172.21.15.100:0/3418022436 wait complete. 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.145+0000 7f41e863c740 1 -- start start 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.145+0000 7f41e863c740 1 Processor -- start 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbba83630 con 0x563bbb9ddfc0 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbba83160 con 0x563bbb9de8e0 2024-02-21T07:47:01.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bbb9d11e0 con 0x563bbba13f80 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41e863c740 10 client.0 _ll_register_callbacks cb 0x7f41d8017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41dea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41de000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41de000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42490/0 (socket says 172.21.15.100:42490) 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41dea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58944/0 (socket says 172.21.15.100:58944) 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.147+0000 7f41de000640 1 -- 172.21.15.100:0/1480802731 learned_addr learned my addr 172.21.15.100:0/1480802731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 -- 172.21.15.100:0/1480802731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 msgr2=0x563bbb9d0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9d0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 -- 172.21.15.100:0/1480802731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 msgr2=0x563bbba17cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 -- 172.21.15.100:0/1480802731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bbb90c4e0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41de000640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41dea00640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41d00b9830 tx=0x7f41d00d8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b34afdd333a409f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d00bd7c0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41d00c1980 con 0x563bbb9ddfc0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.148+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563bbb9a3c30 con 0x563bbb9ddfc0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d00d10b0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 10 client.5172 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:01.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f41d800fe80 con 0x563bbb9ddfc0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563bbb9a3c30 con 0x563bbb9ddfc0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f41d00d80b0 con 0x563bbb9ddfc0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 10 client.5172 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 10 client.5172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 20 client.5172 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0b790 0x563bbba75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 4 client.5172 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f41d00c1e10 con 0x563bbba0b790 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.149+0000 7f41de000640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0b790 0x563bbba75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41de000640 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0b790 0x563bbba75470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c93d9944b13fba36 server_cookie=2f7b90d1f4d6974 in_seq=0 out_seq=0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41bfe00640 10 client.5172 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41bfe00640 1 -- 172.21.15.100:0/1480802731 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f41d00c1e10 con 0x563bbba0b790 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41bfe00640 10 client.5172 handle_command_reply: tid=0 2024-02-21T07:47:01.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 client.5172 shutdown 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 msgr2=0x563bbb9aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41d00b9830 tx=0x7f41d00d8040 comp rx=0 tx=0).stop 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 shutdown_connections 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563bbba0b790 0x563bbba75470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563bbba13f80 0x563bbb9d0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563bbb9de8e0 0x563bbba17cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41e863c740 1 --2- 172.21.15.100:0/1480802731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563bbb9ddfc0 0x563bbb9aa360 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.150+0000 7f41bfe00640 0 client.5172 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 >> 172.21.15.100:0/1480802731 conn(0x563bbb96d5a0 msgr2=0x563bbba36320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 shutdown_connections 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e863c740 1 -- 172.21.15.100:0/1480802731 wait complete. 2024-02-21T07:47:01.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e863c740 20 client.5172 trim_cache size 0 max 16384 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "d0477328-aad4-4b41-a61e-456b4cbd1db9": { 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "d0477328-aad4-4b41-a61e-456b4cbd1db9", 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:47:01.161 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 msgr2=0x7f41c00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.151+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 0x7f41c00a15f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41e00d37f0 tx=0x7f41d8009040 comp rx=0 tx=0).stop 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 msgr2=0x7f41e0156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41d0000c00 tx=0x7f41d00046c0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 shutdown_connections 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e018b860 0x7f41e0183a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0164950 0x7f41e021f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f41c009f130 0x7f41c00a15f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 --2- 172.21.15.100:0/3551699603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e00f8520 0x7f41e0156890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 >> 172.21.15.100:0/3551699603 conn(0x7f41e006ab60 msgr2=0x7f41e00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 shutdown_connections 2024-02-21T07:47:01.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:01.152+0000 7f41e5a00640 1 -- 172.21.15.100:0/3551699603 wait complete. 2024-02-21T07:47:01.176 INFO:tasks.cephfs.filesystem:scrub status for tag:d0477328-aad4-4b41-a61e-456b4cbd1db9 - {'path': '/', 'tag': 'd0477328-aad4-4b41-a61e-456b4cbd1db9', 'options': 'recursive,force'} 2024-02-21T07:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.970+0000 7f4d5b200640 1 Processor -- start 2024-02-21T07:47:06.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.970+0000 7f4d5b200640 1 -- start start 2024-02-21T07:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d5b200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d5c182840 0x7f4d5c186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d5b200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c187ef0 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d5b200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c187000 con 0x7f4d5c186b70 2024-02-21T07:47:06.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d5b200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c0fec50 con 0x7f4d5c182840 2024-02-21T07:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d59e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4d5c182840 0x7f4d5c186630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d59400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4d5c186b70 0x7f4d5c0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48232/0 (socket says 172.21.15.100:48232) 2024-02-21T07:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.972+0000 7f4d59400640 1 -- 172.21.15.100:0/1057442829 learned_addr learned my addr 172.21.15.100:0/1057442829 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:06.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220158674 0 0) 0x7f4d5c187000 con 0x7f4d5c186b70 2024-02-21T07:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d40003520 con 0x7f4d5c186b70 2024-02-21T07:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159933550 0 0) 0x7f4d5c187ef0 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d59e00640 1 -- 172.21.15.100:0/1057442829 >> v1:172.21.15.156:6789/0 conn(0x7f4d5c186b70 legacy=0x7f4d5c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d59e00640 1 -- 172.21.15.100:0/1057442829 >> v1:172.21.15.100:6789/0 conn(0x7f4d5c0d0e90 legacy=0x7f4d5c1886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.973+0000 7f4d59e00640 1 -- 172.21.15.100:0/1057442829 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c1872e0 con 0x7f4d5c182840 2024-02-21T07:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.974+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1057442829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c182840 0x7f4d5c186630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d90 tx=0x7f4d4c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6bce5ab5c5ccd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.974+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c02cbd0 con 0x7f4d5c182840 2024-02-21T07:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.974+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c02cd30 con 0x7f4d5c182840 2024-02-21T07:47:06.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d58a00640 1 -- 172.21.15.100:0/1057442829 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c02cea0 con 0x7f4d5c182840 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 -- 172.21.15.100:0/1057442829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c182840 msgr2=0x7f4d5c186630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 --2- 172.21.15.100:0/1057442829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c182840 0x7f4d5c186630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d90 tx=0x7f4d4c02be20 comp rx=0 tx=0).stop 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 -- 172.21.15.100:0/1057442829 shutdown_connections 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 --2- 172.21.15.100:0/1057442829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c182840 0x7f4d5c186630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 -- 172.21.15.100:0/1057442829 >> 172.21.15.100:0/1057442829 conn(0x7f4d5c0615c0 msgr2=0x7f4d5c0619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 -- 172.21.15.100:0/1057442829 shutdown_connections 2024-02-21T07:47:06.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.975+0000 7f4d5b200640 1 -- 172.21.15.100:0/1057442829 wait complete. 2024-02-21T07:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.978+0000 7f4d5b200640 1 Processor -- start 2024-02-21T07:47:06.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.978+0000 7f4d5b200640 1 -- start start 2024-02-21T07:47:06.985 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5c16ead0 0x7f4d5c1898d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c18b110 con 0x7f4d5c182840 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c18a1b0 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.979+0000 7f4d5b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c18a490 con 0x7f4d5c16ead0 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42510/0 (socket says 172.21.15.100:42510) 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 -- 172.21.15.100:0/472736691 learned_addr learned my addr 172.21.15.100:0/472736691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58952/0 (socket says 172.21.15.100:58952) 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d5a800640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5c16ead0 0x7f4d5c1898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 -- 172.21.15.100:0/472736691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5c16ead0 msgr2=0x7f4d5c1898d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5c16ead0 0x7f4d5c1898d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 -- 172.21.15.100:0/472736691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 msgr2=0x7f4d5c189390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59e00640 1 -- 172.21.15.100:0/472736691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009a70 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.980+0000 7f4d59400640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d59e00640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c037040 tx=0x7f4d4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d52000640 1 -- 172.21.15.100:0/472736691 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c02cea0 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d52000640 1 -- 172.21.15.100:0/472736691 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c003b90 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d52000640 1 -- 172.21.15.100:0/472736691 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c004030 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c18a770 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.981+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c18ad30 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.984+0000 7f4d52000640 1 -- 172.21.15.100:0/472736691 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4d4c03b050 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.985+0000 7f4d63a12740 1 Processor -- start 2024-02-21T07:47:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.986+0000 7f4d52000640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 0x7f4d380a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.986+0000 7f4d63a12740 1 -- start start 2024-02-21T07:47:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.986+0000 7f4d52000640 1 -- 172.21.15.100:0/472736691 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4d4c0ec090 con 0x7f4d5c0d0e90 2024-02-21T07:47:06.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.986+0000 7f4d5a800640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 0x7f4d380a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.986+0000 7f4d5a800640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 0x7f4d380a15f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbf2e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbeae620 con 0x5626dbf626e0 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbe608c0 con 0x5626dbf2e280 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d63a12740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbe5ddf0 con 0x5626dbef31a0 2024-02-21T07:47:06.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d59400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42514/0 (socket says 172.21.15.100:42514) 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d59e00640 1 -- 172.21.15.100:0/2289971421 learned_addr learned my addr 172.21.15.100:0/2289971421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.987+0000 7f4d5a800640 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbf2e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 -- 172.21.15.100:0/2289971421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 msgr2=0x5626dbf2e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbf2e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 -- 172.21.15.100:0/2289971421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 msgr2=0x5626dbeed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 -- 172.21.15.100:0/2289971421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626dbddab00 con 0x5626dbf626e0 2024-02-21T07:47:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59e00640 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:06.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d59400640 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef2c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000f60 tx=0x7f4d44007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9132c424f339dc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d4aa00640 1 -- 172.21.15.100:0/2289971421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440069f0 con 0x5626dbf626e0 2024-02-21T07:47:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d4aa00640 1 -- 172.21.15.100:0/2289971421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d44007540 con 0x5626dbf626e0 2024-02-21T07:47:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.988+0000 7f4d4aa00640 1 -- 172.21.15.100:0/2289971421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440133f0 con 0x5626dbf626e0 2024-02-21T07:47:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 -- 172.21.15.100:0/2289971421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 msgr2=0x5626dbef2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef2c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000f60 tx=0x7f4d44007410 comp rx=0 tx=0).stop 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 -- 172.21.15.100:0/2289971421 shutdown_connections 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbf2e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef2c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 --2- 172.21.15.100:0/2289971421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbeed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 -- 172.21.15.100:0/2289971421 >> 172.21.15.100:0/2289971421 conn(0x5626dbeba4b0 msgr2=0x5626dbef1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 -- 172.21.15.100:0/2289971421 shutdown_connections 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.989+0000 7f4d63a12740 1 -- 172.21.15.100:0/2289971421 wait complete. 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.990+0000 7f4d63a12740 1 -- start start 2024-02-21T07:47:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.990+0000 7f4d63a12740 1 Processor -- start 2024-02-21T07:47:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf626e0 0x5626dbf73de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbe595d0 con 0x5626dbef31a0 2024-02-21T07:47:07.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbdfeb50 con 0x5626dbf2e280 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbdfe7f0 con 0x5626dbf626e0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d63a12740 10 client.0 _ll_register_callbacks cb 0x5626dbe12550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58972/0 (socket says 172.21.15.100:58972) 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 -- 172.21.15.100:0/1870270225 learned_addr learned my addr 172.21.15.100:0/1870270225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d5a800640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf626e0 0x5626dbf73de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59400640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 -- 172.21.15.100:0/1870270225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf626e0 msgr2=0x5626dbf73de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf626e0 0x5626dbf73de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 -- 172.21.15.100:0/1870270225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 msgr2=0x5626dbf74c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf74c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.992+0000 7f4d59e00640 1 -- 172.21.15.100:0/1870270225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d40003520 con 0x5626dbef31a0 2024-02-21T07:47:07.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b6070 tx=0x7f4d4c0b9d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e040f01e0f578e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0c2030 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4d4c0cdb70 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626dbe2bcd0 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d4c0cdd30 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d63a12740 10 client.5184 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5626dbe57c50 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0e7080 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.993+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4d4c0b90b0 con 0x5626dbef31a0 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 10 client.5184 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 10 client.5184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 20 client.5184 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:07.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbf221c0 0x5626dbf57490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 4 client.5184 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626dbe4fce0 con 0x5626dbf221c0 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d59400640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbf221c0 0x5626dbf57490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d59400640 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbf221c0 0x5626dbf57490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12dbbafee434dfb5 server_cookie=1a3ee0bf432f526e in_seq=0 out_seq=0 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.994+0000 7f4d3f400640 10 client.5184 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.995+0000 7f4d3f400640 1 -- 172.21.15.100:0/1870270225 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626dbe4fce0 con 0x5626dbf221c0 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.995+0000 7f4d3f400640 10 client.5184 handle_command_reply: tid=0 2024-02-21T07:47:07.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.995+0000 7f4d63a12740 1 client.5184 shutdown 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.995+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 msgr2=0x5626dbf292b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.995+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b6070 tx=0x7f4d4c0b9d20 comp rx=0 tx=0).stop 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 shutdown_connections 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbf221c0 0x5626dbf57490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf626e0 0x5626dbf73de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf74c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1870270225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbef31a0 0x5626dbf292b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 >> 172.21.15.100:0/1870270225 conn(0x5626dbeba4b0 msgr2=0x5626dbef9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d3f400640 0 client.5184 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 shutdown_connections 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 1 -- 172.21.15.100:0/1870270225 wait complete. 2024-02-21T07:47:07.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:06.996+0000 7f4d63a12740 20 client.5184 trim_cache size 0 max 16384 2024-02-21T07:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.011+0000 7f4d63a12740 1 Processor -- start 2024-02-21T07:47:07.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.011+0000 7f4d63a12740 1 -- start start 2024-02-21T07:47:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbeef830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf29f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbba1e60 con 0x5626dbf626e0 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbf517e0 con 0x5626dbf2e280 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d63a12740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbf51350 con 0x5626dbef31a0 2024-02-21T07:47:07.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58974/0 (socket says 172.21.15.100:58974) 2024-02-21T07:47:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d5a800640 1 -- 172.21.15.100:0/1328911113 learned_addr learned my addr 172.21.15.100:0/1328911113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbeef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.012+0000 7f4d59400640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf29f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 -- 172.21.15.100:0/1328911113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 msgr2=0x5626dbf29f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf29f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 -- 172.21.15.100:0/1328911113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 msgr2=0x5626dbef9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 -- 172.21.15.100:0/1328911113 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626dbdf4530 con 0x5626dbef31a0 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d5a800640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:07.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d59e00640 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbeef830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b7f10 tx=0x7f4d4c0cf000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f568d9331777af9b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d4a000640 1 -- 172.21.15.100:0/1328911113 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0bdd00 con 0x5626dbef31a0 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d4a000640 1 -- 172.21.15.100:0/1328911113 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626dbe2bcd0 con 0x5626dbef31a0 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.013+0000 7f4d4a000640 1 -- 172.21.15.100:0/1328911113 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0c2050 con 0x5626dbef31a0 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 -- 172.21.15.100:0/1328911113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 msgr2=0x5626dbeef830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbeef830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b7f10 tx=0x7f4d4c0cf000 comp rx=0 tx=0).stop 2024-02-21T07:47:07.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 -- 172.21.15.100:0/1328911113 shutdown_connections 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbef9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbf2e280 0x5626dbf29f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 --2- 172.21.15.100:0/1328911113 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbef31a0 0x5626dbeef830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 -- 172.21.15.100:0/1328911113 >> 172.21.15.100:0/1328911113 conn(0x5626dbeba4b0 msgr2=0x5626dbf29100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 -- 172.21.15.100:0/1328911113 shutdown_connections 2024-02-21T07:47:07.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.014+0000 7f4d63a12740 1 -- 172.21.15.100:0/1328911113 wait complete. 2024-02-21T07:47:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.015+0000 7f4d63a12740 1 -- start start 2024-02-21T07:47:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.015+0000 7f4d63a12740 1 Processor -- start 2024-02-21T07:47:07.032 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.016+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbef31a0 0x5626dbf29f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 0x5626dbf65240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbf826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbf31b90 con 0x5626dbf626e0 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbeefb70 con 0x5626dbef31a0 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626dbeef5b0 con 0x5626dbf2e280 2024-02-21T07:47:07.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d63a12740 10 client.0 _ll_register_callbacks cb 0x7f4d44006940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbf826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d59e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbef31a0 0x5626dbf29f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d59400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 0x5626dbf65240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d59400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 0x5626dbf65240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:57410/0 (socket says 172.21.15.100:57410) 2024-02-21T07:47:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d59400640 1 -- 172.21.15.100:0/848828700 learned_addr learned my addr 172.21.15.100:0/848828700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 -- 172.21.15.100:0/848828700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 msgr2=0x5626dbf65240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 0x5626dbf65240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 -- 172.21.15.100:0/848828700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbef31a0 msgr2=0x5626dbf29f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbef31a0 0x5626dbf29f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.017+0000 7f4d5a800640 1 -- 172.21.15.100:0/848828700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d54007030 con 0x5626dbf626e0 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d5a800640 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbf826c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5626dbef0440 tx=0x7f4d54000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d1e2830196d5a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d3f400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54027070 con 0x5626dbf626e0 2024-02-21T07:47:07.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4d5401b040 con 0x5626dbf626e0 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626dbe7ed30 con 0x5626dbf626e0 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d54006e80 con 0x5626dbf626e0 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d63a12740 10 client.5190 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.018+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5626dbe57c50 con 0x5626dbf626e0 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626dbe7ed30 con 0x5626dbf626e0 2024-02-21T07:47:07.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4d54012070 con 0x5626dbf626e0 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 10 client.5190 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 10 client.5190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 20 client.5190 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbef9470 0x5626dbef75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 4 client.5190 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5626dbb59600 con 0x5626dbef9470 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.019+0000 7f4d59e00640 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbef9470 0x5626dbef75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:07.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.020+0000 7f4d59e00640 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbef9470 0x5626dbef75a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf2e5013369cd8f server_cookie=7b6254a2fbbda6ec in_seq=0 out_seq=0 2024-02-21T07:47:07.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.020+0000 7f4d3f400640 10 client.5190 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d3f400640 1 -- 172.21.15.100:0/848828700 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5626dbb59600 con 0x5626dbef9470 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d3f400640 10 client.5190 handle_command_reply: tid=0 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 client.5190 shutdown 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 msgr2=0x5626dbf826c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbf826c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5626dbef0440 tx=0x7f4d54000ed0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 shutdown_connections 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5626dbef9470 0x5626dbef75a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5626dbf626e0 0x5626dbf826c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5626dbf2e280 0x5626dbf65240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 --2- 172.21.15.100:0/848828700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5626dbef31a0 0x5626dbf29f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 >> 172.21.15.100:0/848828700 conn(0x5626dbeba4b0 msgr2=0x5626dbf61bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:07.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.029+0000 7f4d3f400640 0 client.5190 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.030+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 shutdown_connections 2024-02-21T07:47:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.030+0000 7f4d63a12740 1 -- 172.21.15.100:0/848828700 wait complete. 2024-02-21T07:47:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.030+0000 7f4d63a12740 20 client.5190 trim_cache size 0 max 16384 2024-02-21T07:47:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:47:07.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:47:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:47:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:47:07.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 msgr2=0x7f4d380a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 0x7f4d380a15f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d54009040 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 msgr2=0x7f4d5c16e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c037040 tx=0x7f4d4c004a40 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 shutdown_connections 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d5c16ead0 0x7f4d5c1898d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4d3809f130 0x7f4d380a15f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d5c182840 0x7f4d5c189390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 --2- 172.21.15.100:0/472736691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4d5c0d0e90 0x7f4d5c16e590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 >> 172.21.15.100:0/472736691 conn(0x7f4d5c0615c0 msgr2=0x7f4d5c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 shutdown_connections 2024-02-21T07:47:07.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:07.031+0000 7f4d5b200640 1 -- 172.21.15.100:0/472736691 wait complete. 2024-02-21T07:47:12.327 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:12.332 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:12.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:20.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.185+0000 7fc583200640 1 Processor -- start 2024-02-21T07:47:20.191 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.185+0000 7fc583200640 1 -- start start 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc583200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc584182840 0x7fc584186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc583200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc5840d0e90 0x7fc5841886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc583200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc584187ef0 con 0x7fc584186b70 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc583200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840fec50 con 0x7fc584182840 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc583200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc584182c20 con 0x7fc5840d0e90 2024-02-21T07:47:20.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc581e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc584182840 0x7fc584186630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc581e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc584182840 0x7fc584186630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58186/0 (socket says 172.21.15.100:58186) 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc581e00640 1 -- 172.21.15.100:0/1478651969 learned_addr learned my addr 172.21.15.100:0/1478651969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.188+0000 7fc582800640 1 --2- 172.21.15.100:0/1478651969 >> v2:172.21.15.156:3300/0 conn(0x7fc5840d0e90 0x7fc5841886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.189+0000 7fc581e00640 1 -- 172.21.15.100:0/1478651969 >> v2:172.21.15.156:3300/0 conn(0x7fc5840d0e90 msgr2=0x7fc5841886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.189+0000 7fc581e00640 1 --2- 172.21.15.100:0/1478651969 >> v2:172.21.15.156:3300/0 conn(0x7fc5840d0e90 0x7fc5841886c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.189+0000 7fc581e00640 1 -- 172.21.15.100:0/1478651969 >> v1:172.21.15.156:6789/0 conn(0x7fc584186b70 legacy=0x7fc5840d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.189+0000 7fc581e00640 1 -- 172.21.15.100:0/1478651969 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584187000 con 0x7fc584182840 2024-02-21T07:47:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.190+0000 7fc581e00640 1 --2- 172.21.15.100:0/1478651969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584186630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc5841864d0 tx=0x7fc57402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d48dff3a1abacc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.191+0000 7fc580a00640 1 -- 172.21.15.100:0/1478651969 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740317e0 con 0x7fc584182840 2024-02-21T07:47:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.191+0000 7fc580a00640 1 -- 172.21.15.100:0/1478651969 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574031940 con 0x7fc584182840 2024-02-21T07:47:20.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.191+0000 7fc580a00640 1 -- 172.21.15.100:0/1478651969 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574031cd0 con 0x7fc584182840 2024-02-21T07:47:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.191+0000 7fc583200640 1 -- 172.21.15.100:0/1478651969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 msgr2=0x7fc584186630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.191+0000 7fc583200640 1 --2- 172.21.15.100:0/1478651969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584186630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc5841864d0 tx=0x7fc57402b880 comp rx=0 tx=0).stop 2024-02-21T07:47:20.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 -- 172.21.15.100:0/1478651969 shutdown_connections 2024-02-21T07:47:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 --2- 172.21.15.100:0/1478651969 >> v2:172.21.15.156:3300/0 conn(0x7fc5840d0e90 0x7fc5841886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 --2- 172.21.15.100:0/1478651969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584186630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 -- 172.21.15.100:0/1478651969 >> 172.21.15.100:0/1478651969 conn(0x7fc5840615c0 msgr2=0x7fc5840619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 -- 172.21.15.100:0/1478651969 shutdown_connections 2024-02-21T07:47:20.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.192+0000 7fc583200640 1 -- 172.21.15.100:0/1478651969 wait complete. 2024-02-21T07:47:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.195+0000 7fc583200640 1 Processor -- start 2024-02-21T07:47:20.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.195+0000 7fc583200640 1 -- start start 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584174c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc584168ef0 0x7fc584171250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841751b0 con 0x7fc584182840 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841762c0 con 0x7fc584168ef0 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.196+0000 7fc583200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5841753d0 con 0x7fc5840d0e90 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584174c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:43808/0 (socket says 172.21.15.100:43808) 2024-02-21T07:47:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 -- 172.21.15.100:0/2796689443 learned_addr learned my addr 172.21.15.100:0/2796689443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc582800640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc584168ef0 0x7fc584171250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 -- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc584168ef0 msgr2=0x7fc584171250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc584168ef0 0x7fc584171250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 -- 172.21.15.100:0/2796689443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 msgr2=0x7fc584174c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584174c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 -- 172.21.15.100:0/2796689443 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740094d0 con 0x7fc5840d0e90 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.197+0000 7fc581e00640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc5740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.198+0000 7fc57a000640 1 -- 172.21.15.100:0/2796689443 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574032880 con 0x7fc5840d0e90 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.198+0000 7fc57a000640 1 -- 172.21.15.100:0/2796689443 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574032a20 con 0x7fc5840d0e90 2024-02-21T07:47:20.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.198+0000 7fc57a000640 1 -- 172.21.15.100:0/2796689443 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574032dd0 con 0x7fc5840d0e90 2024-02-21T07:47:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.198+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5841756b0 con 0x7fc5840d0e90 2024-02-21T07:47:20.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.198+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584175c70 con 0x7fc5840d0e90 2024-02-21T07:47:20.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.201+0000 7fc57a000640 1 -- 172.21.15.100:0/2796689443 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc57404e450 con 0x7fc5840d0e90 2024-02-21T07:47:20.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.202+0000 7fc57a000640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 0x7fc5640a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.202+0000 7fc57a000640 1 -- 172.21.15.100:0/2796689443 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5740ebae0 con 0x7fc5840d0e90 2024-02-21T07:47:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.203+0000 7fc581400640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 0x7fc5640a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.203+0000 7fc58bb87740 1 Processor -- start 2024-02-21T07:47:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.204+0000 7fc58bb87740 1 -- start start 2024-02-21T07:47:20.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.204+0000 7fc581400640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 0x7fc5640a1590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5841804b0 tx=0x7fc570009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.205+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.205+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657de5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44492/0 (socket says 172.21.15.100:44492) 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e21660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc58bb87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657da1620 con 0x556657e556e0 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc58bb87740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657d538c0 con 0x556657e21280 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc58bb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657d50df0 con 0x556657de61a0 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 -- 172.21.15.100:0/3637072535 learned_addr learned my addr 172.21.15.100:0/3637072535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581400640 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657de5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 -- 172.21.15.100:0/3637072535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 msgr2=0x556657e21660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e21660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 -- 172.21.15.100:0/3637072535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 msgr2=0x556657de5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657de5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581e00640 1 -- 172.21.15.100:0/3637072535 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556657ccdb00 con 0x556657e21280 2024-02-21T07:47:20.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.206+0000 7fc581400640 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657de5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.207+0000 7fc581e00640 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b9490 tx=0x7fc57404b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb8fb1b09f8099e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.207+0000 7fc56ea00640 1 -- 172.21.15.100:0/3637072535 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740b95c0 con 0x556657e21280 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.207+0000 7fc56ea00640 1 -- 172.21.15.100:0/3637072535 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740bd710 con 0x556657e21280 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 -- 172.21.15.100:0/3637072535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 msgr2=0x556657de0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b9490 tx=0x7fc57404b000 comp rx=0 tx=0).stop 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 -- 172.21.15.100:0/3637072535 shutdown_connections 2024-02-21T07:47:20.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e21660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657de5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3637072535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de0650 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 -- 172.21.15.100:0/3637072535 >> 172.21.15.100:0/3637072535 conn(0x556657dad4b0 msgr2=0x556657de4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 -- 172.21.15.100:0/3637072535 shutdown_connections 2024-02-21T07:47:20.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.208+0000 7fc58bb87740 1 -- 172.21.15.100:0/3637072535 wait complete. 2024-02-21T07:47:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.209+0000 7fc58bb87740 1 -- start start 2024-02-21T07:47:20.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.210+0000 7fc58bb87740 1 Processor -- start 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657d4c5d0 con 0x556657e556e0 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657cf1b50 con 0x556657e21280 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657cf17f0 con 0x556657de61a0 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc58bb87740 10 client.0 _ll_register_callbacks cb 0x556657d05550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc582800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc582800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58224/0 (socket says 172.21.15.100:58224) 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc582800640 1 -- 172.21.15.100:0/3506754850 learned_addr learned my addr 172.21.15.100:0/3506754850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.212+0000 7fc581e00640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 -- 172.21.15.100:0/3506754850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 msgr2=0x556657e4aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 -- 172.21.15.100:0/3506754850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 msgr2=0x556657e666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc581400640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 -- 172.21.15.100:0/3506754850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584175c70 con 0x556657e556e0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc581400640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc582800640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc57c011d40 tx=0x7fc57c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56156b5a5821b68f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.213+0000 7fc563400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00e040 con 0x556657e556e0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc57c00fe10 con 0x556657e556e0 2024-02-21T07:47:20.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556657d1ecd0 con 0x556657e556e0 2024-02-21T07:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c015430 con 0x556657e556e0 2024-02-21T07:47:20.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc58bb87740 10 client.5199 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556657d4ac50 con 0x556657e556e0 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.214+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556657d1ecd0 con 0x556657e556e0 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc57c01b020 con 0x556657e556e0 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 10 client.5199 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 10 client.5199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 20 client.5199 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657de17a0 0x556657e1d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 4 client.5199 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556657d42ce0 con 0x556657de17a0 2024-02-21T07:47:20.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.215+0000 7fc581e00640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657de17a0 0x556657e1d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc581e00640 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657de17a0 0x556657e1d440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfbc21f731c649e8 server_cookie=cd442da3b9133ecd in_seq=0 out_seq=0 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc563400640 10 client.5199 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc563400640 1 -- 172.21.15.100:0/3506754850 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556657d42ce0 con 0x556657de17a0 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc563400640 10 client.5199 handle_command_reply: tid=0 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc58bb87740 1 client.5199 shutdown 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 msgr2=0x556657e56880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.216+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc57c011d40 tx=0x7fc57c00f580 comp rx=0 tx=0).stop 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 shutdown_connections 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657de17a0 0x556657e1d440 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657e556e0 0x556657e56880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc563400640 0 client.5199 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 --2- 172.21.15.100:0/3506754850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 >> 172.21.15.100:0/3506754850 conn(0x556657dad4b0 msgr2=0x556657e55b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 shutdown_connections 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 1 -- 172.21.15.100:0/3506754850 wait complete. 2024-02-21T07:47:20.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.217+0000 7fc58bb87740 20 client.5199 trim_cache size 0 max 16384 2024-02-21T07:47:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.243+0000 7fc58bb87740 1 Processor -- start 2024-02-21T07:47:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.243+0000 7fc58bb87740 1 -- start start 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657a94e60 con 0x556657de17a0 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657ddbd40 con 0x556657e21280 2024-02-21T07:47:20.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.245+0000 7fc58bb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657dec5d0 con 0x556657de61a0 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58240/0 (socket says 172.21.15.100:58240) 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 -- 172.21.15.100:0/2156091119 learned_addr learned my addr 172.21.15.100:0/2156091119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581400640 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc582800640 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 -- 172.21.15.100:0/2156091119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 msgr2=0x556657e4a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 -- 172.21.15.100:0/2156091119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 msgr2=0x556657de4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 -- 172.21.15.100:0/2156091119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556657e1c110 con 0x556657de17a0 2024-02-21T07:47:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.246+0000 7fc581e00640 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b7870 tx=0x7fc5740bc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cb237193dd166e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.247+0000 7fc56e000640 1 -- 172.21.15.100:0/2156091119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740d6040 con 0x556657de17a0 2024-02-21T07:47:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.247+0000 7fc56e000640 1 -- 172.21.15.100:0/2156091119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740bd710 con 0x556657de17a0 2024-02-21T07:47:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.247+0000 7fc56e000640 1 -- 172.21.15.100:0/2156091119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740b95c0 con 0x556657de17a0 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.247+0000 7fc58bb87740 1 -- 172.21.15.100:0/2156091119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 msgr2=0x556657dec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.247+0000 7fc58bb87740 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b7870 tx=0x7fc5740bc000 comp rx=0 tx=0).stop 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 -- 172.21.15.100:0/2156091119 shutdown_connections 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657de4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de61a0 0x556657e4a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 --2- 172.21.15.100:0/2156091119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de17a0 0x556657dec090 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 -- 172.21.15.100:0/2156091119 >> 172.21.15.100:0/2156091119 conn(0x556657dad4b0 msgr2=0x556657e665d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 -- 172.21.15.100:0/2156091119 shutdown_connections 2024-02-21T07:47:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.248+0000 7fc58bb87740 1 -- 172.21.15.100:0/2156091119 wait complete. 2024-02-21T07:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.249+0000 7fc58bb87740 1 -- start start 2024-02-21T07:47:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.249+0000 7fc58bb87740 1 Processor -- start 2024-02-21T07:47:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de17a0 0x556657eb52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de61a0 0x556657dec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657e443a0 con 0x556657de61a0 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657e545a0 con 0x556657e21280 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556657dec5d0 con 0x556657de17a0 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc58bb87740 10 client.0 _ll_register_callbacks cb 0x7fc574031fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc582800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc581400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de61a0 0x556657dec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc582800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44516/0 (socket says 172.21.15.100:44516) 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc582800640 1 -- 172.21.15.100:0/161856320 learned_addr learned my addr 172.21.15.100:0/161856320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.251+0000 7fc581e00640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de17a0 0x556657eb52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 -- 172.21.15.100:0/161856320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de17a0 msgr2=0x556657eb52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de17a0 0x556657eb52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 -- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de61a0 msgr2=0x556657dec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de61a0 0x556657dec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 -- 172.21.15.100:0/161856320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556657ccdb00 con 0x556657e21280 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc582800640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc57c000f80 tx=0x7fc57c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135b373d45a3cc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc563400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00e070 con 0x556657e21280 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556657d71d30 con 0x556657e21280 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.252+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc57c003da0 con 0x556657e21280 2024-02-21T07:47:20.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c015430 con 0x556657e21280 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 10 client.5326 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556657ce7530 con 0x556657e21280 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556657d71d30 con 0x556657e21280 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc57c01b040 con 0x556657e21280 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 10 client.5326 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 10 client.5326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 20 client.5326 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657e556e0 0x556657e565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 4 client.5326 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.253+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556657a4c600 con 0x556657e556e0 2024-02-21T07:47:20.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.254+0000 7fc581e00640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657e556e0 0x556657e565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.255+0000 7fc581e00640 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657e556e0 0x556657e565a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff6fb213fea42d1 server_cookie=e5df15ad9a97ca94 in_seq=0 out_seq=0 2024-02-21T07:47:20.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.255+0000 7fc563400640 10 client.5326 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.261+0000 7fc563400640 1 -- 172.21.15.100:0/161856320 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556657a4c600 con 0x556657e556e0 2024-02-21T07:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.261+0000 7fc563400640 10 client.5326 handle_command_reply: tid=0 2024-02-21T07:47:20.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.261+0000 7fc58bb87740 1 client.5326 shutdown 2024-02-21T07:47:20.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.261+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 msgr2=0x556657e43ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.261+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc57c000f80 tx=0x7fc57c00b040 comp rx=0 tx=0).stop 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 shutdown_connections 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556657e556e0 0x556657e565a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556657e21280 0x556657e43ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556657de61a0 0x556657dec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 --2- 172.21.15.100:0/161856320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556657de17a0 0x556657eb52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 >> 172.21.15.100:0/161856320 conn(0x556657dad4b0 msgr2=0x556657e55ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc563400640 0 client.5326 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:20.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 shutdown_connections 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 1 -- 172.21.15.100:0/161856320 wait complete. 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.262+0000 7fc58bb87740 20 client.5326 trim_cache size 0 max 16384 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:47:20.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:47:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 msgr2=0x7fc5640a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 0x7fc5640a1590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5841804b0 tx=0x7fc570009040 comp rx=0 tx=0).stop 2024-02-21T07:47:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 msgr2=0x7fc5842271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:20.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc574000c00 tx=0x7fc5740046c0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 shutdown_connections 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc584168ef0 0x7fc584171250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56409f0d0 0x7fc5640a1590 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc584182840 0x7fc584174c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 --2- 172.21.15.100:0/2796689443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5840d0e90 0x7fc5842271d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 >> 172.21.15.100:0/2796689443 conn(0x7fc5840615c0 msgr2=0x7fc5840fc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 shutdown_connections 2024-02-21T07:47:20.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:20.263+0000 7fc583200640 1 -- 172.21.15.100:0/2796689443 wait complete. 2024-02-21T07:47:31.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:47:31.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:47:31.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.354+0000 7f22c6a00640 1 Processor -- start 2024-02-21T07:47:31.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.354+0000 7f22c6a00640 1 -- start start 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22c0189ca0 0x7f22c00fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 0x7f22c00d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c0182c30 con 0x7f22c0182850 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c018a150 con 0x7f22c0189ca0 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c006cfa0 con 0x7f22c00fc460 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c4c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22c0189ca0 0x7f22c00fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c5600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f22c0182850 0x7f22c006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45200/0 (socket says 172.21.15.100:45200) 2024-02-21T07:47:31.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c5600640 1 -- 172.21.15.100:0/1630738703 learned_addr learned my addr 172.21.15.100:0/1630738703 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.356+0000 7f22c6000640 1 --2- 172.21.15.100:0/1630738703 >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 0x7f22c00d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.357+0000 7f22c4c00640 1 -- 172.21.15.100:0/1630738703 >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 msgr2=0x7f22c00d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.357+0000 7f22c4c00640 1 --2- 172.21.15.100:0/1630738703 >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 0x7f22c00d5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.357+0000 7f22c4c00640 1 -- 172.21.15.100:0/1630738703 >> v1:172.21.15.100:6789/0 conn(0x7f22c0182850 legacy=0x7f22c006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.357+0000 7f22c4c00640 1 -- 172.21.15.100:0/1630738703 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c01897c0 con 0x7f22c0189ca0 2024-02-21T07:47:31.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.357+0000 7f22c6000640 1 --2- 172.21.15.100:0/1630738703 >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 0x7f22c00d5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:31.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.358+0000 7f22c4c00640 1 --2- 172.21.15.100:0/1630738703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c0189ca0 0x7f22c00fbf20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22c00d0560 tx=0x7f22ac02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eb08e14f7c6048 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.358+0000 7f22bfe00640 1 -- 172.21.15.100:0/1630738703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031710 con 0x7f22c0189ca0 2024-02-21T07:47:31.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.358+0000 7f22bfe00640 1 -- 172.21.15.100:0/1630738703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac02f050 con 0x7f22c0189ca0 2024-02-21T07:47:31.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.358+0000 7f22bfe00640 1 -- 172.21.15.100:0/1630738703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac031a90 con 0x7f22c0189ca0 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.358+0000 7f22c6a00640 1 -- 172.21.15.100:0/1630738703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c0189ca0 msgr2=0x7f22c00fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1630738703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c0189ca0 0x7f22c00fbf20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22c00d0560 tx=0x7f22ac02b7b0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 -- 172.21.15.100:0/1630738703 shutdown_connections 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1630738703 >> v2:172.21.15.156:3300/0 conn(0x7f22c00fc460 0x7f22c00d5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1630738703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c0189ca0 0x7f22c00fbf20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 -- 172.21.15.100:0/1630738703 >> 172.21.15.100:0/1630738703 conn(0x7f22c00fe020 msgr2=0x7f22c00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 -- 172.21.15.100:0/1630738703 shutdown_connections 2024-02-21T07:47:31.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.359+0000 7f22c6a00640 1 -- 172.21.15.100:0/1630738703 wait complete. 2024-02-21T07:47:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.361+0000 7f22c6a00640 1 Processor -- start 2024-02-21T07:47:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.361+0000 7f22c6a00640 1 -- start start 2024-02-21T07:47:31.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22c0182850 0x7f22c00d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c0189ca0 0x7f22c017e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c017cf70 con 0x7f22c00fc460 2024-02-21T07:47:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c017d210 con 0x7f22c0189ca0 2024-02-21T07:47:31.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c6a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c017d4f0 con 0x7f22c0182850 2024-02-21T07:47:31.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33786/0 (socket says 172.21.15.100:33786) 2024-02-21T07:47:31.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.362+0000 7f22c5600640 1 -- 172.21.15.100:0/1208160701 learned_addr learned my addr 172.21.15.100:0/1208160701 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c6000640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c0189ca0 0x7f22c017e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c4c00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22c0182850 0x7f22c00d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 -- 172.21.15.100:0/1208160701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22c0182850 msgr2=0x7f22c00d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22c0182850 0x7f22c00d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 -- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c0189ca0 msgr2=0x7f22c017e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c0189ca0 0x7f22c017e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 -- 172.21.15.100:0/1208160701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009400 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.363+0000 7f22c5600640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c400 tx=0x7f22b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.364+0000 7f22bd600640 1 -- 172.21.15.100:0/1208160701 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4005ce0 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.364+0000 7f22bd600640 1 -- 172.21.15.100:0/1208160701 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4005e40 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.364+0000 7f22bd600640 1 -- 172.21.15.100:0/1208160701 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40072d0 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.364+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c017d7d0 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.364+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c017dd90 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.370+0000 7f22cadb7740 1 Processor -- start 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.370+0000 7f22cadb7740 1 -- start start 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.370+0000 7f22bd600640 1 -- 172.21.15.100:0/1208160701 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f22b40074f0 con 0x7f22c00fc460 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.372+0000 7f22bd600640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 0x7f22a00a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.372+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.372+0000 7f22bd600640 1 -- 172.21.15.100:0/1208160701 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f22b40c9140 con 0x7f22c00fc460 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.372+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5879570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c6000640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 0x7f22a00a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5879570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5879570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33794/0 (socket says 172.21.15.100:33794) 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c5600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b583c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c5600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59132/0 (socket says 172.21.15.100:59132) 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c5600640 1 -- 172.21.15.100:0/3524108620 learned_addr learned my addr 172.21.15.100:0/3524108620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b57b0150 con 0x5586b58af150 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b57ad680 con 0x5586b5879190 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b57a8e60 con 0x5586b5879ab0 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.373+0000 7f22c6000640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 0x7f22a00a16b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22b8007330 tx=0x7f22b8009730 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 -- 172.21.15.100:0/3524108620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 msgr2=0x5586b583c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b583c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 -- 172.21.15.100:0/3524108620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 msgr2=0x5586b5879570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5879570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 -- 172.21.15.100:0/3524108620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586b5762060 con 0x5586b5879190 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22c5600640 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22b40c6a50 tx=0x7f22b4096630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741b693816c5d187 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22b1c00640 1 -- 172.21.15.100:0/3524108620 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b409ad70 con 0x5586b5879190 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22b1c00640 1 -- 172.21.15.100:0/3524108620 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b409f3c0 con 0x5586b5879190 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.374+0000 7f22b1c00640 1 -- 172.21.15.100:0/3524108620 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4096120 con 0x5586b5879190 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 msgr2=0x5586b58aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f22b40c6a50 tx=0x7f22b4096630 comp rx=0 tx=0).stop 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 shutdown_connections 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b583c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5879570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3524108620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58aec10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 >> 172.21.15.100:0/3524108620 conn(0x5586b58085a0 msgr2=0x5586b5840080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 shutdown_connections 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.375+0000 7f22cadb7740 1 -- 172.21.15.100:0/3524108620 wait complete. 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.376+0000 7f22cadb7740 1 -- start start 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.376+0000 7f22cadb7740 1 Processor -- start 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.377+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.377+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.377+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5847980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22cadb7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b574dec0 con 0x5586b58af150 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22cadb7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b574db60 con 0x5586b5879190 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22cadb7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b55171c0 con 0x5586b5879ab0 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22cadb7740 10 client.0 _ll_register_callbacks cb 0x5586b5761960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5847980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39900/0 (socket says 172.21.15.100:39900) 2024-02-21T07:47:31.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 -- 172.21.15.100:0/377331698 learned_addr learned my addr 172.21.15.100:0/377331698 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c5600640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 -- 172.21.15.100:0/377331698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 msgr2=0x5586b58689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 -- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 msgr2=0x5586b5847980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5847980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.378+0000 7f22c4c00640 1 -- 172.21.15.100:0/377331698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c017dd90 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22c4c00640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009890 tx=0x7f22ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec8920b68b7713c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22a6000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac03d850 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586b54a87e0 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f22ac03d9b0 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22ac03db70 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22cadb7740 10 client.5351 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5586b57a74e0 con 0x5586b5879ab0 2024-02-21T07:47:31.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.379+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac052020 con 0x5586b5879ab0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f22ac03dcd0 con 0x5586b5879ab0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 10 client.5351 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 10 client.5351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 20 client.5351 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b58a5ca0 0x5586b586b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 4 client.5351 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586b54e5720 con 0x5586b58a5ca0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.380+0000 7f22c5600640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b58a5ca0 0x5586b586b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.381+0000 7f22a6000640 10 client.5351 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.381+0000 7f22c5600640 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b58a5ca0 0x5586b586b0a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=810c23550399057c server_cookie=8d53d458bfe70797 in_seq=0 out_seq=0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22a6000640 1 -- 172.21.15.100:0/377331698 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5586b54e5720 con 0x5586b58a5ca0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22a6000640 10 client.5351 handle_command_reply: tid=0 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 client.5351 shutdown 2024-02-21T07:47:31.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 msgr2=0x5586b58c2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009890 tx=0x7f22ac004730 comp rx=0 tx=0).stop 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 shutdown_connections 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b58a5ca0 0x5586b586b0a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b5847980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58c2800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 --2- 172.21.15.100:0/377331698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b58689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 >> 172.21.15.100:0/377331698 conn(0x5586b58085a0 msgr2=0x5586b58ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22a6000640 0 client.5351 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 shutdown_connections 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.382+0000 7f22cadb7740 1 -- 172.21.15.100:0/377331698 wait complete. 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.383+0000 7f22cadb7740 20 client.5351 trim_cache size 0 max 16384 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.398+0000 7f22cadb7740 1 Processor -- start 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.398+0000 7f22cadb7740 1 -- start start 2024-02-21T07:47:31.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.399+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b589f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22cadb7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b5847820 con 0x5586b58af150 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22cadb7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b583d6a0 con 0x5586b5879190 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22cadb7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b583e890 con 0x5586b5879ab0 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b589f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33808/0 (socket says 172.21.15.100:33808) 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c6000640 1 -- 172.21.15.100:0/3143190994 learned_addr learned my addr 172.21.15.100:0/3143190994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c4c00640 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 -- 172.21.15.100:0/3143190994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 msgr2=0x5586b58b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 -- 172.21.15.100:0/3143190994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 msgr2=0x5586b589e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c5600640 1 -- 172.21.15.100:0/3143190994 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586b5743950 con 0x5586b5879190 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.400+0000 7f22c6000640 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.401+0000 7f22c5600640 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b589f250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22b400cdc0 tx=0x7f22b401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e98b0337a4ff95 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.401+0000 7f22b1200640 1 -- 172.21.15.100:0/3143190994 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40b4040 con 0x5586b5879190 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.401+0000 7f22b1200640 1 -- 172.21.15.100:0/3143190994 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b40c6bf0 con 0x5586b5879190 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.401+0000 7f22b1200640 1 -- 172.21.15.100:0/3143190994 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4096120 con 0x5586b5879190 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 -- 172.21.15.100:0/3143190994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 msgr2=0x5586b589f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b589f250 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22b400cdc0 tx=0x7f22b401d000 comp rx=0 tx=0).stop 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 -- 172.21.15.100:0/3143190994 shutdown_connections 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b58af150 0x5586b589e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b5879ab0 0x5586b58b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3143190994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879190 0x5586b589f250 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 -- 172.21.15.100:0/3143190994 >> 172.21.15.100:0/3143190994 conn(0x5586b58085a0 msgr2=0x5586b58821a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 -- 172.21.15.100:0/3143190994 shutdown_connections 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.402+0000 7f22cadb7740 1 -- 172.21.15.100:0/3143190994 wait complete. 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.403+0000 7f22cadb7740 1 -- start start 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.403+0000 7f22cadb7740 1 Processor -- start 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 0x5586b592a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b58af150 0x5586b586a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b5840820 con 0x5586b5879190 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b5875c70 con 0x5586b5879ab0 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586b58be300 con 0x5586b58af150 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22cadb7740 10 client.0 _ll_register_callbacks cb 0x7f22ac009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33814/0 (socket says 172.21.15.100:33814) 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22c5600640 1 -- 172.21.15.100:0/3167711866 learned_addr learned my addr 172.21.15.100:0/3167711866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22c6000640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b58af150 0x5586b586a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.405+0000 7f22c4c00640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 0x5586b592a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 -- 172.21.15.100:0/3167711866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b58af150 msgr2=0x5586b586a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b58af150 0x5586b586a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 -- 172.21.15.100:0/3167711866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 msgr2=0x5586b592a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 0x5586b592a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 -- 172.21.15.100:0/3167711866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80155d0 con 0x5586b5879190 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c4c00640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 0x5586b592a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22c5600640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22b40930a0 tx=0x7f22b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec00aa528f72c21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22a6000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40b4040 con 0x5586b5879190 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f22b4096120 con 0x5586b5879190 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586b58d1a20 con 0x5586b5879190 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22b40962e0 con 0x5586b5879190 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22cadb7740 10 client.5226 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:31.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.406+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5586b5762060 con 0x5586b5879190 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586b58d1a20 con 0x5586b5879190 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f22b4092990 con 0x5586b5879190 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 10 client.5226 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 10 client.5226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 20 client.5226 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b583f000 0x5586b5870f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 4 client.5226 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f22b409f3c0 con 0x5586b583f000 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.407+0000 7f22c4c00640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b583f000 0x5586b5870f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22c4c00640 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b583f000 0x5586b5870f20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a3a401a03c8ee4 server_cookie=974a7deed9fc1ad1 in_seq=0 out_seq=0 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22a6000640 10 client.5226 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22a6000640 1 -- 172.21.15.100:0/3167711866 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f22b409f3c0 con 0x5586b583f000 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22a6000640 10 client.5226 handle_command_reply: tid=0 2024-02-21T07:47:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22cadb7740 1 client.5226 shutdown 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.408+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 msgr2=0x5586b58c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22b40930a0 tx=0x7f22b4000bc0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 shutdown_connections 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5586b583f000 0x5586b5870f20 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22a6000640 0 client.5226 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5586b58af150 0x5586b586a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586b5879ab0 0x5586b592a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 --2- 172.21.15.100:0/3167711866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586b5879190 0x5586b58c4150 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 >> 172.21.15.100:0/3167711866 conn(0x5586b58085a0 msgr2=0x5586b583a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 shutdown_connections 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 1 -- 172.21.15.100:0/3167711866 wait complete. 2024-02-21T07:47:31.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.409+0000 7f22cadb7740 20 client.5226 trim_cache size 0 max 16384 2024-02-21T07:47:31.478 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:47:31.478 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:47:31.478 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:47:31.478 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.410+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 msgr2=0x7f22a00a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.410+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 0x7f22a00a16b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f22b8007330 tx=0x7f22b8009730 comp rx=0 tx=0).stop 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.410+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 msgr2=0x7f22c016d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.410+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f22b400c400 tx=0x7f22b400c8c0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 shutdown_connections 2024-02-21T07:47:31.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f22c0189ca0 0x7f22c017e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f22c0182850 0x7f22c00d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f22a009f1f0 0x7f22a00a16b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 --2- 172.21.15.100:0/1208160701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c00fc460 0x7f22c016d9e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 >> 172.21.15.100:0/1208160701 conn(0x7f22c00fe020 msgr2=0x7f22c00d4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 shutdown_connections 2024-02-21T07:47:31.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.411+0000 7f22c6a00640 1 -- 172.21.15.100:0/1208160701 wait complete. 2024-02-21T07:47:31.480 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:47:31.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:47:31.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.671+0000 7fb55b200640 1 Processor -- start 2024-02-21T07:47:31.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.671+0000 7fb55b200640 1 -- start start 2024-02-21T07:47:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.673+0000 7fb55b200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0d6550 con 0x7fb55c189c60 2024-02-21T07:47:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.673+0000 7fb55b200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c06ce50 con 0x7fb55c1828d0 2024-02-21T07:47:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.673+0000 7fb55b200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0d6780 con 0x7fb55c0d6100 2024-02-21T07:47:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb559e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb55c1828d0 0x7fb55c06c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:51060/0 (socket says 172.21.15.100:51060) 2024-02-21T07:47:31.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb559e00640 1 -- 172.21.15.100:0/3679259436 learned_addr learned my addr 172.21.15.100:0/3679259436 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837108303 0 0) 0x7fb55c06ce50 con 0x7fb55c1828d0 2024-02-21T07:47:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb540003520 con 0x7fb55c1828d0 2024-02-21T07:47:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030525062 0 0) 0x7fb55c0d6780 con 0x7fb55c0d6100 2024-02-21T07:47:31.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c06ce50 con 0x7fb55c0d6100 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988186866 0 0) 0x7fb55c0d6550 con 0x7fb55c189c60 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.674+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0d6780 con 0x7fb55c189c60 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986891317 0 0) 0x7fb540003520 con 0x7fb55c1828d0 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 >> v1:172.21.15.170:6789/0 conn(0x7fb55c0d6100 legacy=0x7fb55c18bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 >> v1:172.21.15.100:6789/0 conn(0x7fb55c189c60 legacy=0x7fb55c0d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c06b980 con 0x7fb55c1828d0 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fb54c001670 con 0x7fb55c1828d0 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 >> v1:172.21.15.156:6789/0 conn(0x7fb55c1828d0 legacy=0x7fb55c06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb540003d80 0x7fb540004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb540004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5400053c0 0x7fb54000ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c2d0 con 0x7fb5400053c0 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c440 con 0x7fb540003d80 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000c600 con 0x7fb540004830 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb559400640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb540004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb559e00640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb540003d80 0x7fb540004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.675+0000 7fb55a800640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5400053c0 0x7fb54000ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb559400640 1 -- 172.21.15.100:0/3679259436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb540003d80 msgr2=0x7fb540004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb559400640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb540003d80 0x7fb540004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb559400640 1 -- 172.21.15.100:0/3679259436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5400053c0 msgr2=0x7fb54000ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb559400640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5400053c0 0x7fb54000ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb559400640 1 -- 172.21.15.100:0/3679259436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c06b980 con 0x7fb540004830 2024-02-21T07:47:31.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.676+0000 7fb55a800640 1 -- 172.21.15.100:0/3679259436 reap_dead start 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.677+0000 7fb559400640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb540004cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb548001890 tx=0x7fb5400057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153830b26329c284 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.677+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480052d0 con 0x7fb540004830 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.677+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548005450 con 0x7fb540004830 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.677+0000 7fb558a00640 1 -- 172.21.15.100:0/3679259436 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548003830 con 0x7fb540004830 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 -- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 msgr2=0x7fb540004cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb540004cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb548001890 tx=0x7fb5400057f0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 -- 172.21.15.100:0/3679259436 shutdown_connections 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 --2- 172.21.15.100:0/3679259436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb540004cb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 -- 172.21.15.100:0/3679259436 >> 172.21.15.100:0/3679259436 conn(0x7fb55c0fdf30 msgr2=0x7fb55c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 -- 172.21.15.100:0/3679259436 shutdown_connections 2024-02-21T07:47:31.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.678+0000 7fb55b200640 1 -- 172.21.15.100:0/3679259436 wait complete. 2024-02-21T07:47:31.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.681+0000 7fb55b200640 1 Processor -- start 2024-02-21T07:47:31.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.681+0000 7fb55b200640 1 -- start start 2024-02-21T07:47:31.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 0x7fb55c212c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c178210 0x7fb55c178690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c21e3c0 con 0x7fb55c21df40 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c21dab0 con 0x7fb55c178210 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c21cbc0 con 0x7fb540004830 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 0x7fb55c212c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 0x7fb55c212c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33834/0 (socket says 172.21.15.100:33834) 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb559400640 1 -- 172.21.15.100:0/2146241821 learned_addr learned my addr 172.21.15.100:0/2146241821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39938/0 (socket says 172.21.15.100:39938) 2024-02-21T07:47:31.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.682+0000 7fb55a800640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c178210 0x7fb55c178690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 -- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c178210 msgr2=0x7fb55c178690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c178210 0x7fb55c178690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 -- 172.21.15.100:0/2146241821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 msgr2=0x7fb55c212c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:31.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 0x7fb55c212c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 -- 172.21.15.100:0/2146241821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c21cea0 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb559e00640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb54c007310 tx=0x7fb54c007710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c001610 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00f8e0 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.683+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c21d180 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.684+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00fc90 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.684+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c21d740 con 0x7fb540004830 2024-02-21T07:47:31.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.685+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c21d900 con 0x7fb540004830 2024-02-21T07:47:31.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.688+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb54c01d460 con 0x7fb540004830 2024-02-21T07:47:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.689+0000 7fb552000640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 0x7fb53c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:31.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.689+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb54c0c9a80 con 0x7fb540004830 2024-02-21T07:47:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.690+0000 7fb559400640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 0x7fb53c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:31.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.691+0000 7fb559400640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 0x7fb53c0a1590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb55c18baf0 tx=0x7fb548031000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:31.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:31.694+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb54c093890 con 0x7fb540004830 2024-02-21T07:47:32.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.053+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb55c075160 con 0x7fb540004830 2024-02-21T07:47:32.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.054+0000 7fb552000640 1 -- 172.21.15.100:0/2146241821 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7fb54c096f50 con 0x7fb540004830 2024-02-21T07:47:32.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:47:32.061 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:47:32.061 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:47:32.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 msgr2=0x7fb53c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 0x7fb53c0a1590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb55c18baf0 tx=0x7fb548031000 comp rx=0 tx=0).stop 2024-02-21T07:47:32.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 msgr2=0x7fb55c21c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb54c007310 tx=0x7fb54c007710 comp rx=0 tx=0).stop 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 shutdown_connections 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb55c178210 0x7fb55c178690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb53c09f0d0 0x7fb53c0a1590 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb55c21df40 0x7fb55c212c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 --2- 172.21.15.100:0/2146241821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb540004830 0x7fb55c21c560 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 >> 172.21.15.100:0/2146241821 conn(0x7fb55c0fdf30 msgr2=0x7fb55c0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 shutdown_connections 2024-02-21T07:47:32.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.057+0000 7fb55b200640 1 -- 172.21.15.100:0/2146241821 wait complete. 2024-02-21T07:47:32.087 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:47:32.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:47:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.262+0000 7ff934c00640 1 Processor -- start 2024-02-21T07:47:32.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.263+0000 7ff934c00640 1 -- start start 2024-02-21T07:47:32.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.264+0000 7ff934c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 0x7ff930189ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.264+0000 7ff934c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff93006c890 0x7ff9300fbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.264+0000 7ff934c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff930182c30 con 0x7ff9300fc460 2024-02-21T07:47:32.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.264+0000 7ff934c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93006b8c0 con 0x7ff930182850 2024-02-21T07:47:32.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.264+0000 7ff934c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9301897c0 con 0x7ff93006c890 2024-02-21T07:47:32.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff93006c890 0x7ff9300fbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 0x7ff930189ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff93006c890 0x7ff9300fbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59192/0 (socket says 172.21.15.100:59192) 2024-02-21T07:47:32.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 -- 172.21.15.100:0/3099251394 learned_addr learned my addr 172.21.15.100:0/3099251394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92e000640 1 -- 172.21.15.100:0/3099251394 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573480196 0 0) 0x7ff930182c30 con 0x7ff9300fc460 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92e000640 1 -- 172.21.15.100:0/3099251394 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff914003520 con 0x7ff9300fc460 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 -- 172.21.15.100:0/3099251394 >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 msgr2=0x7ff930189ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 --2- 172.21.15.100:0/3099251394 >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 0x7ff930189ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 -- 172.21.15.100:0/3099251394 >> v1:172.21.15.156:6789/0 conn(0x7ff9300fc460 legacy=0x7ff9300d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.265+0000 7ff92ea00640 1 -- 172.21.15.100:0/3099251394 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300fcd60 con 0x7ff93006c890 2024-02-21T07:47:32.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.267+0000 7ff92f400640 1 --2- 172.21.15.100:0/3099251394 >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 0x7ff930189ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.267+0000 7ff92ea00640 1 --2- 172.21.15.100:0/3099251394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff93006c890 0x7ff9300fbf20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b670 tx=0x7ff91c02b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3105d7f02bf84e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.267+0000 7ff92e000640 1 -- 172.21.15.100:0/3099251394 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c031770 con 0x7ff93006c890 2024-02-21T07:47:32.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.267+0000 7ff92e000640 1 -- 172.21.15.100:0/3099251394 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c0318d0 con 0x7ff93006c890 2024-02-21T07:47:32.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.267+0000 7ff92e000640 1 -- 172.21.15.100:0/3099251394 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c031c40 con 0x7ff93006c890 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 -- 172.21.15.100:0/3099251394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff93006c890 msgr2=0x7ff9300fbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 --2- 172.21.15.100:0/3099251394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff93006c890 0x7ff9300fbf20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff93006b670 tx=0x7ff91c02b810 comp rx=0 tx=0).stop 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 -- 172.21.15.100:0/3099251394 shutdown_connections 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 --2- 172.21.15.100:0/3099251394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff93006c890 0x7ff9300fbf20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 --2- 172.21.15.100:0/3099251394 >> v2:172.21.15.100:3300/0 conn(0x7ff930182850 0x7ff930189ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 -- 172.21.15.100:0/3099251394 >> 172.21.15.100:0/3099251394 conn(0x7ff9300fe020 msgr2=0x7ff9300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 -- 172.21.15.100:0/3099251394 shutdown_connections 2024-02-21T07:47:32.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.268+0000 7ff934c00640 1 -- 172.21.15.100:0/3099251394 wait complete. 2024-02-21T07:47:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.271+0000 7ff934c00640 1 Processor -- start 2024-02-21T07:47:32.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.271+0000 7ff934c00640 1 -- start start 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93006c890 0x7ff930167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 0x7ff930220910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300f4780 con 0x7ff930182850 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300f4a60 con 0x7ff9300fc460 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff934c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93021fb50 con 0x7ff93006c890 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.273+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 0x7ff930220910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33852/0 (socket says 172.21.15.100:33852) 2024-02-21T07:47:32.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93006c890 0x7ff930167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92fe00640 1 -- 172.21.15.100:0/1846749834 learned_addr learned my addr 172.21.15.100:0/1846749834 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 -- 172.21.15.100:0/1846749834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93006c890 msgr2=0x7ff930167800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93006c890 0x7ff930167800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 -- 172.21.15.100:0/1846749834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 msgr2=0x7ff930220e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92ea00640 1 -- 172.21.15.100:0/1846749834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009400 con 0x7ff9300fc460 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.274+0000 7ff92fe00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff92ea00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 0x7ff930220910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff91c033000 tx=0x7ff91c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff927400640 1 -- 172.21.15.100:0/1846749834 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c004250 con 0x7ff9300fc460 2024-02-21T07:47:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff927400640 1 -- 172.21.15.100:0/1846749834 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c03f070 con 0x7ff9300fc460 2024-02-21T07:47:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff927400640 1 -- 172.21.15.100:0/1846749834 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c003610 con 0x7ff9300fc460 2024-02-21T07:47:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c0094d0 con 0x7ff9300fc460 2024-02-21T07:47:32.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.275+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930220110 con 0x7ff9300fc460 2024-02-21T07:47:32.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.279+0000 7ff938f71740 1 Processor -- start 2024-02-21T07:47:32.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.279+0000 7ff938f71740 1 -- start start 2024-02-21T07:47:32.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.280+0000 7ff927400640 1 -- 172.21.15.100:0/1846749834 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff91c003770 con 0x7ff9300fc460 2024-02-21T07:47:32.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e8818fb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818fb740 0x55e8818fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8817f3210 con 0x55e8818c0990 2024-02-21T07:47:32.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8817f0740 con 0x55e8818c0070 2024-02-21T07:47:32.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.281+0000 7ff938f71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8817ebf20 con 0x55e8818fb740 2024-02-21T07:47:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59218/0 (socket says 172.21.15.100:59218) 2024-02-21T07:47:32.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 -- 172.21.15.100:0/892120616 learned_addr learned my addr 172.21.15.100:0/892120616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92f400640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e8818fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92ea00640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818fb740 0x55e8818fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff927400640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 0x7ff9100a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 -- 172.21.15.100:0/892120616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818fb740 msgr2=0x55e8818fc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818fb740 0x55e8818fc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 -- 172.21.15.100:0/892120616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 msgr2=0x55e8818fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff927400640 1 -- 172.21.15.100:0/1846749834 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff91c0eb3a0 con 0x7ff9300fc460 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e8818fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.282+0000 7ff92fe00640 1 -- 172.21.15.100:0/892120616 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8817addf0 con 0x55e8818c0070 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff92fe00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 0x7ff9100a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff92f400640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e8818fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff92fe00640 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff92800f5a0 tx=0x7ff928001760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e41afc03bee6af6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff91b400640 1 -- 172.21.15.100:0/892120616 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928014af0 con 0x55e8818c0070 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff91b400640 1 -- 172.21.15.100:0/892120616 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928014d90 con 0x55e8818c0070 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.283+0000 7ff91b400640 1 -- 172.21.15.100:0/892120616 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280135c0 con 0x55e8818c0070 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 -- 172.21.15.100:0/892120616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 msgr2=0x55e8818c0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff92800f5a0 tx=0x7ff928001760 comp rx=0 tx=0).stop 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff92fe00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 0x7ff9100a1590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff92801e000 tx=0x7ff928021000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 -- 172.21.15.100:0/892120616 shutdown_connections 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818fb740 0x55e8818fc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e8818fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 --2- 172.21.15.100:0/892120616 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0070 0x55e8818c0450 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 -- 172.21.15.100:0/892120616 >> 172.21.15.100:0/892120616 conn(0x55e881882640 msgr2=0x55e8818836c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 -- 172.21.15.100:0/892120616 shutdown_connections 2024-02-21T07:47:32.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.284+0000 7ff938f71740 1 -- 172.21.15.100:0/892120616 wait complete. 2024-02-21T07:47:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.285+0000 7ff938f71740 1 -- start start 2024-02-21T07:47:32.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.286+0000 7ff938f71740 1 Processor -- start 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 0x55e881903e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e881791150 con 0x55e88187f050 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e881790df0 con 0x55e8818fb740 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e88155a1c0 con 0x55e8818c0990 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff938f71740 10 client.0 _ll_register_callbacks cb 0x55e8817e02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39968/0 (socket says 172.21.15.100:39968) 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff92f400640 1 -- 172.21.15.100:0/4103920718 learned_addr learned my addr 172.21.15.100:0/4103920718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.287+0000 7ff92fe00640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 0x55e881903e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92ea00640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 -- 172.21.15.100:0/4103920718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 msgr2=0x55e8819049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 -- 172.21.15.100:0/4103920718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 msgr2=0x55e8818b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 -- 172.21.15.100:0/4103920718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92800f1d0 con 0x55e88187f050 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92f400640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff92fe00640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 0x55e881903e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff92800f5a0 tx=0x7ff928001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b8c865b7f7dd68 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff90fe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.288+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff928006d30 con 0x55e88187f050 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff928019040 con 0x55e88187f050 2024-02-21T07:47:32.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e8814eb7e0 con 0x55e88187f050 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff928006e90 con 0x55e88187f050 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff938f71740 10 client.5244 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e8817ea5a0 con 0x55e88187f050 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.289+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e8814eb7e0 con 0x55e88187f050 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff92802f070 con 0x55e88187f050 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 10 client.5244 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 10 client.5244 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 20 client.5244 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818f9680 0x55e881904340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 4 client.5244 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e881528720 con 0x55e8818f9680 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.290+0000 7ff92f400640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818f9680 0x55e881904340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.291+0000 7ff92f400640 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818f9680 0x55e881904340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9f4f0cb18094e35 server_cookie=bb76706f4bc85c36 in_seq=0 out_seq=0 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.291+0000 7ff90fe00640 10 client.5244 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff90fe00640 1 -- 172.21.15.100:0/4103920718 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e881528720 con 0x55e8818f9680 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff90fe00640 10 client.5244 handle_command_reply: tid=0 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 client.5244 shutdown 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 msgr2=0x55e881903e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 0x55e881903e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff92800f5a0 tx=0x7ff928001400 comp rx=0 tx=0).stop 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 shutdown_connections 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818f9680 0x55e881904340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e88187f050 0x55e881903e00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 --2- 172.21.15.100:0/4103920718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e8818c0990 0x55e8819049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 >> 172.21.15.100:0/4103920718 conn(0x55e8818c0070 msgr2=0x55e8818840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff90fe00640 0 client.5244 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 shutdown_connections 2024-02-21T07:47:32.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.292+0000 7ff938f71740 1 -- 172.21.15.100:0/4103920718 wait complete. 2024-02-21T07:47:32.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.293+0000 7ff938f71740 20 client.5244 trim_cache size 0 max 16384 2024-02-21T07:47:32.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.317+0000 7ff938f71740 1 Processor -- start 2024-02-21T07:47:32.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.317+0000 7ff938f71740 1 -- start start 2024-02-21T07:47:32.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e88187a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8818c60c0 con 0x55e8818c0990 2024-02-21T07:47:32.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8818c8cb0 con 0x55e8818fb740 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff938f71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8818ed700 con 0x55e88187f050 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff92ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e88187a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39978/0 (socket says 172.21.15.100:39978) 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff92f400640 1 -- 172.21.15.100:0/4056863453 learned_addr learned my addr 172.21.15.100:0/4056863453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.319+0000 7ff92fe00640 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 -- 172.21.15.100:0/4056863453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 msgr2=0x55e8818c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 -- 172.21.15.100:0/4056863453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 msgr2=0x55e88187a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e88187a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 -- 172.21.15.100:0/4056863453 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8818f99f0 con 0x55e88187f050 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff92f400640 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff920009fd0 tx=0x7ff920009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ba748b5f8bc4f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff91aa00640 1 -- 172.21.15.100:0/4056863453 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92001a040 con 0x55e88187f050 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff91aa00640 1 -- 172.21.15.100:0/4056863453 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920025020 con 0x55e88187f050 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.320+0000 7ff91aa00640 1 -- 172.21.15.100:0/4056863453 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200216e0 con 0x55e88187f050 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 -- 172.21.15.100:0/4056863453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 msgr2=0x55e8819149c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff920009fd0 tx=0x7ff920009190 comp rx=0 tx=0).stop 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 -- 172.21.15.100:0/4056863453 shutdown_connections 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818fb740 0x55e8818c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818c0990 0x55e88187a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 --2- 172.21.15.100:0/4056863453 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8819149c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 -- 172.21.15.100:0/4056863453 >> 172.21.15.100:0/4056863453 conn(0x55e8818c0070 msgr2=0x55e8818840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.321+0000 7ff938f71740 1 -- 172.21.15.100:0/4056863453 shutdown_connections 2024-02-21T07:47:32.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.322+0000 7ff938f71740 1 -- 172.21.15.100:0/4056863453 wait complete. 2024-02-21T07:47:32.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.323+0000 7ff938f71740 1 -- start start 2024-02-21T07:47:32.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.323+0000 7ff938f71740 1 Processor -- start 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0990 0x55e88195e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 0x55e88195bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e881900e80 con 0x55e8818fb740 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e88195ef10 con 0x55e8818c0990 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e881900520 con 0x55e88187f050 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.325+0000 7ff938f71740 10 client.0 _ll_register_callbacks cb 0x7ff928001ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 0x55e88195bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39984/0 (socket says 172.21.15.100:39984) 2024-02-21T07:47:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 -- 172.21.15.100:0/512183603 learned_addr learned my addr 172.21.15.100:0/512183603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92ea00640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0990 0x55e88195e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 -- 172.21.15.100:0/512183603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0990 msgr2=0x55e88195e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0990 0x55e88195e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 -- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 msgr2=0x55e88195bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 0x55e88195bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.326+0000 7ff92f400640 1 -- 172.21.15.100:0/512183603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff920009e10 con 0x55e88187f050 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff92fe00640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 0x55e88195bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff92f400640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff920024040 tx=0x7ff920004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d931243eee3b24 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff90fe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92001a040 con 0x55e88187f050 2024-02-21T07:47:32.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff920031070 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff928014d90 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.327+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff920015a90 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 10 client.5378 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e881786ab0 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff928014d90 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff920011040 con 0x55e88187f050 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 10 client.5378 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 10 client.5378 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 20 client.5378 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818b4a10 0x55e881961970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 4 client.5378 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.328+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e881577890 con 0x55e8818b4a10 2024-02-21T07:47:32.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.329+0000 7ff92ea00640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818b4a10 0x55e881961970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.329+0000 7ff92ea00640 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818b4a10 0x55e881961970 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89a588a6fec94e02 server_cookie=bb2940b3360b5b8f in_seq=0 out_seq=0 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.329+0000 7ff90fe00640 10 client.5378 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.329+0000 7ff90fe00640 1 -- 172.21.15.100:0/512183603 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e881577890 con 0x55e8818b4a10 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.329+0000 7ff90fe00640 10 client.5378 handle_command_reply: tid=0 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 client.5378 shutdown 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 msgr2=0x55e8818c0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff920024040 tx=0x7ff920004730 comp rx=0 tx=0).stop 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 shutdown_connections 2024-02-21T07:47:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55e8818b4a10 0x55e881961970 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e8818fb740 0x55e88195bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e8818c0990 0x55e88195e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff90fe00640 0 client.5378 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 --2- 172.21.15.100:0/512183603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e88187f050 0x55e8818c0450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 >> 172.21.15.100:0/512183603 conn(0x55e8818c0070 msgr2=0x55e88188ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 shutdown_connections 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 1 -- 172.21.15.100:0/512183603 wait complete. 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.330+0000 7ff938f71740 20 client.5378 trim_cache size 0 max 16384 2024-02-21T07:47:32.339 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:47:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 msgr2=0x7ff9100a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 0x7ff9100a1590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff92801e000 tx=0x7ff928021000 comp rx=0 tx=0).stop 2024-02-21T07:47:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 msgr2=0x7ff930220910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 0x7ff930220910 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff91c033000 tx=0x7ff91c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 shutdown_connections 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff91009f0d0 0x7ff9100a1590 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff930182850 0x7ff930220e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9300fc460 0x7ff930220910 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 --2- 172.21.15.100:0/1846749834 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff93006c890 0x7ff930167800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.331+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 >> 172.21.15.100:0/1846749834 conn(0x7ff9300fe020 msgr2=0x7ff9300fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.332+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 shutdown_connections 2024-02-21T07:47:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.332+0000 7ff934c00640 1 -- 172.21.15.100:0/1846749834 wait complete. 2024-02-21T07:47:32.354 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:47:32.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:47:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.558+0000 7f14d0200640 1 Processor -- start 2024-02-21T07:47:32.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.558+0000 7f14d0200640 1 -- start start 2024-02-21T07:47:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14d0200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f14c818c310 0x7f14c818c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14d0200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c81868b0 con 0x7f14c818bf30 2024-02-21T07:47:32.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14d0200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c8189ed0 con 0x7f14c818b250 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14d0200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c818ae30 con 0x7f14c818c310 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14cd800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f14c818bf30 0x7f14c80ee100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45216/0 (socket says 172.21.15.100:45216) 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.561+0000 7f14cd800640 1 -- 172.21.15.100:0/1064738766 learned_addr learned my addr 172.21.15.100:0/1064738766 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14ce200640 1 --2- 172.21.15.100:0/1064738766 >> v2:172.21.15.156:3300/0 conn(0x7f14c818c310 0x7f14c818c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14c7e00640 1 -- 172.21.15.100:0/1064738766 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52128988 0 0) 0x7f14c8189ed0 con 0x7f14c818b250 2024-02-21T07:47:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14c7e00640 1 -- 172.21.15.100:0/1064738766 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b0003520 con 0x7f14c818b250 2024-02-21T07:47:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14ce200640 1 -- 172.21.15.100:0/1064738766 >> v1:172.21.15.170:6789/0 conn(0x7f14c818b250 legacy=0x7f14c818b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14ce200640 1 -- 172.21.15.100:0/1064738766 >> v1:172.21.15.100:6789/0 conn(0x7f14c818bf30 legacy=0x7f14c80ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.562+0000 7f14ce200640 1 -- 172.21.15.100:0/1064738766 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c818a1b0 con 0x7f14c818c310 2024-02-21T07:47:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.563+0000 7f14ce200640 1 --2- 172.21.15.100:0/1064738766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c818c7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7534c194e050f48a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.563+0000 7f14c7e00640 1 -- 172.21.15.100:0/1064738766 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c002ccf0 con 0x7f14c818c310 2024-02-21T07:47:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.563+0000 7f14c7e00640 1 -- 172.21.15.100:0/1064738766 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c002ce50 con 0x7f14c818c310 2024-02-21T07:47:32.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.563+0000 7f14c7e00640 1 -- 172.21.15.100:0/1064738766 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c0034660 con 0x7f14c818c310 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 -- 172.21.15.100:0/1064738766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 msgr2=0x7f14c818c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 --2- 172.21.15.100:0/1064738766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c818c7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14c0009d90 tx=0x7f14c002bf40 comp rx=0 tx=0).stop 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 -- 172.21.15.100:0/1064738766 shutdown_connections 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 --2- 172.21.15.100:0/1064738766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c818c7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 -- 172.21.15.100:0/1064738766 >> 172.21.15.100:0/1064738766 conn(0x7f14c80cf400 msgr2=0x7f14c80cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.564+0000 7f14d0200640 1 -- 172.21.15.100:0/1064738766 shutdown_connections 2024-02-21T07:47:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.565+0000 7f14d0200640 1 -- 172.21.15.100:0/1064738766 wait complete. 2024-02-21T07:47:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.567+0000 7f14d0200640 1 Processor -- start 2024-02-21T07:47:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.568+0000 7f14d0200640 1 -- start start 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.569+0000 7f14d0200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.569+0000 7f14d0200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14c818bf30 0x7f14c8222200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.569+0000 7f14d0200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c8222ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.569+0000 7f14d0200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c806fbc0 con 0x7f14c818b250 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.569+0000 7f14d0200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8220be0 con 0x7f14c818c310 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14d0200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8220e80 con 0x7f14c818bf30 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33892/0 (socket says 172.21.15.100:33892) 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 -- 172.21.15.100:0/3872643499 learned_addr learned my addr 172.21.15.100:0/3872643499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cce00640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14c818bf30 0x7f14c8222200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14ce200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c8222ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 -- 172.21.15.100:0/3872643499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14c818bf30 msgr2=0x7f14c8222200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14c818bf30 0x7f14c8222200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 -- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 msgr2=0x7f14c8222ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c8222ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.570+0000 7f14cd800640 1 -- 172.21.15.100:0/3872643499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0009a70 con 0x7f14c818b250 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14cd800640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c3c0 tx=0x7f14bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14c5600640 1 -- 172.21.15.100:0/3872643499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc005ce0 con 0x7f14c818b250 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14c5600640 1 -- 172.21.15.100:0/3872643499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc005e40 con 0x7f14c818b250 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14c5600640 1 -- 172.21.15.100:0/3872643499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0072d0 con 0x7f14c818b250 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c8221160 con 0x7f14c818b250 2024-02-21T07:47:32.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.571+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c8221720 con 0x7f14c818b250 2024-02-21T07:47:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.575+0000 7f14d2f7b740 1 Processor -- start 2024-02-21T07:47:32.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.575+0000 7f14d2f7b740 1 -- start start 2024-02-21T07:47:32.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.576+0000 7f14c5600640 1 -- 172.21.15.100:0/3872643499 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f14bc0074f0 con 0x7f14c818b250 2024-02-21T07:47:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec29aec0 0x55d7ec29b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec1ce210 con 0x55d7ec29b7e0 2024-02-21T07:47:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec1cb740 con 0x55d7ec29aec0 2024-02-21T07:47:32.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.577+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec1c6f20 con 0x55d7ec2d6590 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40002/0 (socket says 172.21.15.100:40002) 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 -- 172.21.15.100:0/3537129344 learned_addr learned my addr 172.21.15.100:0/3537129344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14ce200640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec29aec0 0x55d7ec29b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cd800640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14c5600640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 0x7f14a80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 -- 172.21.15.100:0/3537129344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec29aec0 msgr2=0x55d7ec29b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec29aec0 0x55d7ec29b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 -- 172.21.15.100:0/3537129344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 msgr2=0x55d7ec2d6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14ce200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 0x7f14a80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14c5600640 1 -- 172.21.15.100:0/3872643499 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14bc0c90d0 con 0x7f14c818b250 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cce00640 1 -- 172.21.15.100:0/3537129344 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7ec188df0 con 0x55d7ec2d6590 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.578+0000 7f14cd800640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.579+0000 7f14cce00640 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14b4001640 tx=0x7f14b4007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a0cb60528d1dae0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.579+0000 7f14ce200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 0x7f14a80a1560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14c0036000 tx=0x7f14c0009750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.579+0000 7f14ba000640 1 -- 172.21.15.100:0/3537129344 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4001ce0 con 0x55d7ec2d6590 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.579+0000 7f14ba000640 1 -- 172.21.15.100:0/3537129344 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b40052e0 con 0x55d7ec2d6590 2024-02-21T07:47:32.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.579+0000 7f14ba000640 1 -- 172.21.15.100:0/3537129344 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400f7b0 con 0x55d7ec2d6590 2024-02-21T07:47:32.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 -- 172.21.15.100:0/3537129344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 msgr2=0x55d7ec2d7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14b4001640 tx=0x7f14b4007d20 comp rx=0 tx=0).stop 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 -- 172.21.15.100:0/3537129344 shutdown_connections 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec2d6590 0x55d7ec2d7320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/3537129344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec29aec0 0x55d7ec29b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 -- 172.21.15.100:0/3537129344 >> 172.21.15.100:0/3537129344 conn(0x55d7ec25d490 msgr2=0x55d7ec25e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 -- 172.21.15.100:0/3537129344 shutdown_connections 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.580+0000 7f14d2f7b740 1 -- 172.21.15.100:0/3537129344 wait complete. 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.581+0000 7f14d2f7b740 1 -- start start 2024-02-21T07:47:32.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.581+0000 7f14d2f7b740 1 Processor -- start 2024-02-21T07:47:32.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.582+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec29b7e0 0x55d7ec290cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.582+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec16c150 con 0x55d7ec298de0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec16bdf0 con 0x55d7ec2d6590 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ebf351c0 con 0x55d7ec29b7e0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14d2f7b740 10 client.0 _ll_register_callbacks cb 0x55d7ec1bb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14ce200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14ce200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33918/0 (socket says 172.21.15.100:33918) 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14ce200640 1 -- 172.21.15.100:0/803366475 learned_addr learned my addr 172.21.15.100:0/803366475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cd800640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec29b7e0 0x55d7ec290cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 -- 172.21.15.100:0/803366475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec29b7e0 msgr2=0x55d7ec290cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec29b7e0 0x55d7ec290cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 -- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 msgr2=0x55d7ec25a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14cce00640 1 -- 172.21.15.100:0/803366475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0003520 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.583+0000 7f14ce200640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14cce00640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2c4230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f14b4014000 tx=0x7f14b4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bda135f5cf394ad0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14aea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4001d60 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7ebec67e0 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14b4007020 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14b40071e0 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.584+0000 7f14d2f7b740 10 client.5383 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d7ec1c55a0 con 0x55d7ec2d6590 2024-02-21T07:47:32.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7ebec67e0 con 0x55d7ec2d6590 2024-02-21T07:47:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f14b4012070 con 0x55d7ec2d6590 2024-02-21T07:47:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14d2f7b740 10 client.5383 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14d2f7b740 10 client.5383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14d2f7b740 20 client.5383 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.585+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2e2bb0 0x55d7ec2d3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.586+0000 7f14cd800640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2e2bb0 0x55d7ec2d3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.586+0000 7f14d2f7b740 4 client.5383 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.586+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7ebf03720 con 0x55d7ec2e2bb0 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.586+0000 7f14cd800640 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2e2bb0 0x55d7ec2d3a00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d11b74557e8e03e server_cookie=85682dd95f95a01c in_seq=0 out_seq=0 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.586+0000 7f14aea00640 10 client.5383 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14aea00640 1 -- 172.21.15.100:0/803366475 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d7ebf03720 con 0x55d7ec2e2bb0 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14aea00640 10 client.5383 handle_command_reply: tid=0 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 client.5383 shutdown 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 msgr2=0x55d7ec2c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2c4230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f14b4014000 tx=0x7f14b4000ed0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 shutdown_connections 2024-02-21T07:47:32.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec298de0 0x55d7ec25a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2e2bb0 0x55d7ec2d3a00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2c4230 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/803366475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec29b7e0 0x55d7ec290cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14aea00640 0 client.5383 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.587+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 >> 172.21.15.100:0/803366475 conn(0x55d7ec29aec0 msgr2=0x55d7ec25ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.588+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 shutdown_connections 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.588+0000 7f14d2f7b740 1 -- 172.21.15.100:0/803366475 wait complete. 2024-02-21T07:47:32.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.588+0000 7f14d2f7b740 20 client.5383 trim_cache size 0 max 16384 2024-02-21T07:47:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.612+0000 7f14d2f7b740 1 Processor -- start 2024-02-21T07:47:32.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.612+0000 7f14d2f7b740 1 -- start start 2024-02-21T07:47:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.613+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec29a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec25a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec25e840 con 0x55d7ec29b7e0 2024-02-21T07:47:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec2a3820 con 0x55d7ec2d6590 2024-02-21T07:47:32.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec25ac70 con 0x55d7ec298de0 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59298/0 (socket says 172.21.15.100:59298) 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14cd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec29a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 -- 172.21.15.100:0/1298344124 learned_addr learned my addr 172.21.15.100:0/1298344124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14cce00640 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec25a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 -- 172.21.15.100:0/1298344124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 msgr2=0x55d7ec29a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec29a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 -- 172.21.15.100:0/1298344124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 msgr2=0x55d7ec25a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.614+0000 7f14ce200640 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec25a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.615+0000 7f14ce200640 1 -- 172.21.15.100:0/1298344124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7ec161ab0 con 0x55d7ec2d6590 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.615+0000 7f14ce200640 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14c0041320 tx=0x7f14c0030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=802f5468c5e22ebc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.615+0000 7f14b9600640 1 -- 172.21.15.100:0/1298344124 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c004d7d0 con 0x55d7ec2d6590 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.615+0000 7f14b9600640 1 -- 172.21.15.100:0/1298344124 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c0051070 con 0x55d7ec2d6590 2024-02-21T07:47:32.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.615+0000 7f14b9600640 1 -- 172.21.15.100:0/1298344124 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c004db30 con 0x55d7ec2d6590 2024-02-21T07:47:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1298344124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 msgr2=0x55d7ec2e7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14c0041320 tx=0x7f14c0030000 comp rx=0 tx=0).stop 2024-02-21T07:47:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1298344124 shutdown_connections 2024-02-21T07:47:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2e7220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec25a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1298344124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec29a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.616+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1298344124 >> 172.21.15.100:0/1298344124 conn(0x55d7ec29aec0 msgr2=0x55d7ec25ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.617+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1298344124 shutdown_connections 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.617+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1298344124 wait complete. 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.618+0000 7f14d2f7b740 1 -- start start 2024-02-21T07:47:32.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.618+0000 7f14d2f7b740 1 Processor -- start 2024-02-21T07:47:32.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec25b450 con 0x55d7ec29b7e0 2024-02-21T07:47:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec2d2690 con 0x55d7ec2d6590 2024-02-21T07:47:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ec25d230 con 0x55d7ec298de0 2024-02-21T07:47:32.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.620+0000 7f14d2f7b740 10 client.0 _ll_register_callbacks cb 0x7f14b4001210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40022/0 (socket says 172.21.15.100:40022) 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 -- 172.21.15.100:0/1339680899 learned_addr learned my addr 172.21.15.100:0/1339680899 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cce00640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14ce200640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 -- 172.21.15.100:0/1339680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 msgr2=0x55d7ec2999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 -- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 msgr2=0x55d7ec2d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 -- 172.21.15.100:0/1339680899 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c818a1b0 con 0x55d7ec298de0 2024-02-21T07:47:32.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14cd800640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14bc093030 tx=0x7f14bc0c6940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e81eb70cd09429c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.621+0000 7f14aea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14bc09eec0 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7ec2c8040 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14bc09f020 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14bc0960b0 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 10 client.5396 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d7ec187650 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14bc0c4020 con 0x55d7ec298de0 2024-02-21T07:47:32.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f14bc096210 con 0x55d7ec298de0 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 10 client.5396 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 10 client.5396 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 20 client.5396 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.622+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2d2e10 0x55d7ec25cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.623+0000 7f14d2f7b740 4 client.5396 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.623+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f14b40052e0 con 0x55d7ec2d2e10 2024-02-21T07:47:32.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.623+0000 7f14cce00640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2d2e10 0x55d7ec25cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.624+0000 7f14aea00640 10 client.5396 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.624+0000 7f14cce00640 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2d2e10 0x55d7ec25cb60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f34a7ac4f05e17a3 server_cookie=b18c176102782859 in_seq=0 out_seq=0 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14aea00640 1 -- 172.21.15.100:0/1339680899 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f14b40052e0 con 0x55d7ec2d2e10 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14aea00640 10 client.5396 handle_command_reply: tid=0 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 client.5396 shutdown 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 msgr2=0x55d7ec258be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14bc093030 tx=0x7f14bc0c6940 comp rx=0 tx=0).stop 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 shutdown_connections 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7ec2d2e10 0x55d7ec25cb60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7ec2d6590 0x55d7ec2999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7ec29b7e0 0x55d7ec2d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14aea00640 0 client.5396 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 --2- 172.21.15.100:0/1339680899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7ec298de0 0x55d7ec258be0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 >> 172.21.15.100:0/1339680899 conn(0x55d7ec29aec0 msgr2=0x55d7ec25b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.625+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 shutdown_connections 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d2f7b740 1 -- 172.21.15.100:0/1339680899 wait complete. 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d2f7b740 20 client.5396 trim_cache size 0 max 16384 2024-02-21T07:47:32.634 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:47:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 msgr2=0x7f14a80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 0x7f14a80a1560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f14c0036000 tx=0x7f14c0009750 comp rx=0 tx=0).stop 2024-02-21T07:47:32.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 msgr2=0x7f14c8178c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.626+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f14bc00c3c0 tx=0x7f14bc00c880 comp rx=0 tx=0).stop 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 shutdown_connections 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14c818c310 0x7f14c8222ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f14c818bf30 0x7f14c8222200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f14a809f0a0 0x7f14a80a1560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 --2- 172.21.15.100:0/3872643499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c818b250 0x7f14c8178c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 >> 172.21.15.100:0/3872643499 conn(0x7f14c80cf400 msgr2=0x7f14c8188990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 shutdown_connections 2024-02-21T07:47:32.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.627+0000 7f14d0200640 1 -- 172.21.15.100:0/3872643499 wait complete. 2024-02-21T07:47:32.650 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:47:32.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:47:32.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.852+0000 7f9702600640 1 Processor -- start 2024-02-21T07:47:32.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.852+0000 7f9702600640 1 -- start start 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f9702600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f96fc1895d0 0x7f96fc0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f9702600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc0d1a30 con 0x7f96fc185f90 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f9702600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc0d1d10 con 0x7f96fc186370 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f9702600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc189a00 con 0x7f96fc1895d0 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f96fb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f96fc185f90 0x7f96fc0cc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45224/0 (socket says 172.21.15.100:45224) 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f96fb400640 1 -- 172.21.15.100:0/23033450 learned_addr learned my addr 172.21.15.100:0/23033450 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:32.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f96fbe00640 1 --2- 172.21.15.100:0/23033450 >> v2:172.21.15.170:3300/0 conn(0x7f96fc1895d0 0x7f96fc0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.854+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843322990 0 0) 0x7f96fc0d1d10 con 0x7f96fc186370 2024-02-21T07:47:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.855+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e0003520 con 0x7f96fc186370 2024-02-21T07:47:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.855+0000 7f96fbe00640 1 -- 172.21.15.100:0/23033450 >> v1:172.21.15.156:6789/0 conn(0x7f96fc186370 legacy=0x7f96fc071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.855+0000 7f96fbe00640 1 -- 172.21.15.100:0/23033450 >> v1:172.21.15.100:6789/0 conn(0x7f96fc185f90 legacy=0x7f96fc0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.855+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779780112 0 0) 0x7f96fc0d1a30 con 0x7f96fc185f90 2024-02-21T07:47:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.855+0000 7f96fbe00640 1 -- 172.21.15.100:0/23033450 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0d1ff0 con 0x7f96fc1895d0 2024-02-21T07:47:32.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.856+0000 7f96fbe00640 1 --2- 172.21.15.100:0/23033450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc1895d0 0x7f96fc0ccad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75e03f37d32daf58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.857+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f402cbd0 con 0x7f96fc1895d0 2024-02-21T07:47:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.857+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f402cd30 con 0x7f96fc1895d0 2024-02-21T07:47:32.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.857+0000 7f96fa000640 1 -- 172.21.15.100:0/23033450 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f402cea0 con 0x7f96fc1895d0 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 -- 172.21.15.100:0/23033450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc1895d0 msgr2=0x7f96fc0ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 --2- 172.21.15.100:0/23033450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc1895d0 0x7f96fc0ccad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f402be20 comp rx=0 tx=0).stop 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 -- 172.21.15.100:0/23033450 shutdown_connections 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 --2- 172.21.15.100:0/23033450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc1895d0 0x7f96fc0ccad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 -- 172.21.15.100:0/23033450 >> 172.21.15.100:0/23033450 conn(0x7f96fc0fc040 msgr2=0x7f96fc0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 -- 172.21.15.100:0/23033450 shutdown_connections 2024-02-21T07:47:32.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.858+0000 7f9702600640 1 -- 172.21.15.100:0/23033450 wait complete. 2024-02-21T07:47:32.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.861+0000 7f9702600640 1 Processor -- start 2024-02-21T07:47:32.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.861+0000 7f9702600640 1 -- start start 2024-02-21T07:47:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96fc1895d0 0x7f96fc2203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc08f2a0 con 0x7f96fc1895d0 2024-02-21T07:47:32.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc08ea00 con 0x7f96fc185f90 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f9702600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc08ece0 con 0x7f96fc186370 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96fb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96faa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96fb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59308/0 (socket says 172.21.15.100:59308) 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96faa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40038/0 (socket says 172.21.15.100:40038) 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96fb400640 1 -- 172.21.15.100:0/3978127499 learned_addr learned my addr 172.21.15.100:0/3978127499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.863+0000 7f96fbe00640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96fc1895d0 0x7f96fc2203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 -- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 msgr2=0x7f96fc171a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 -- 172.21.15.100:0/3978127499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96fc1895d0 msgr2=0x7f96fc2203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96fc1895d0 0x7f96fc2203f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 -- 172.21.15.100:0/3978127499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4009a70 con 0x7f96fc186370 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96fb400640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96faa00640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f96e8007fd0 tx=0x7f96e8001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.864+0000 7f96f3400640 1 -- 172.21.15.100:0/3978127499 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e80052d0 con 0x7f96fc186370 2024-02-21T07:47:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.865+0000 7f96f3400640 1 -- 172.21.15.100:0/3978127499 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e8005430 con 0x7f96fc186370 2024-02-21T07:47:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.865+0000 7f96f3400640 1 -- 172.21.15.100:0/3978127499 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e8003810 con 0x7f96fc186370 2024-02-21T07:47:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.865+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc08efc0 con 0x7f96fc186370 2024-02-21T07:47:32.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.865+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc21f990 con 0x7f96fc186370 2024-02-21T07:47:32.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.869+0000 7f96f3400640 1 -- 172.21.15.100:0/3978127499 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f96e8003970 con 0x7f96fc186370 2024-02-21T07:47:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.871+0000 7f96f3400640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 0x7f96dc0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.871+0000 7f96f3400640 1 -- 172.21.15.100:0/3978127499 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f96e80c8fc0 con 0x7f96fc186370 2024-02-21T07:47:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.871+0000 7f96fb400640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 0x7f96dc0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.871+0000 7f970527d740 1 Processor -- start 2024-02-21T07:47:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.871+0000 7f970527d740 1 -- start start 2024-02-21T07:47:32.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.872+0000 7f96fb400640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 0x7f96dc0a15e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007fd0 tx=0x7f96ec007240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f56f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f570320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f467210 con 0x56304f5347e0 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f464740 con 0x56304f56f590 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f970527d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f45ff20 con 0x56304f533ec0 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f96fb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f96fb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40048/0 (socket says 172.21.15.100:40048) 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f96fb400640 1 -- 172.21.15.100:0/1467917027 learned_addr learned my addr 172.21.15.100:0/1467917027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f96faa00640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f56f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.873+0000 7f96fbe00640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f570320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 -- 172.21.15.100:0/1467917027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 msgr2=0x56304f570320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f570320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 -- 172.21.15.100:0/1467917027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 msgr2=0x56304f56f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f56f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 -- 172.21.15.100:0/1467917027 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304f421df0 con 0x56304f533ec0 2024-02-21T07:47:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fbe00640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f570320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:32.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96faa00640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f56f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96fb400640 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96ec004e90 tx=0x7f96ec013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=132e69dacb95ffa2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96e7e00640 1 -- 172.21.15.100:0/1467917027 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec012350 con 0x56304f533ec0 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96e7e00640 1 -- 172.21.15.100:0/1467917027 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0124b0 con 0x56304f533ec0 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.874+0000 7f96e7e00640 1 -- 172.21.15.100:0/1467917027 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec012820 con 0x56304f533ec0 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 -- 172.21.15.100:0/1467917027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 msgr2=0x56304f5342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f96ec004e90 tx=0x7f96ec013000 comp rx=0 tx=0).stop 2024-02-21T07:47:32.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 -- 172.21.15.100:0/1467917027 shutdown_connections 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f570320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f56f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 --2- 172.21.15.100:0/1467917027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f533ec0 0x56304f5342a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 -- 172.21.15.100:0/1467917027 >> 172.21.15.100:0/1467917027 conn(0x56304f4f6490 msgr2=0x56304f4f7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 -- 172.21.15.100:0/1467917027 shutdown_connections 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.875+0000 7f970527d740 1 -- 172.21.15.100:0/1467917027 wait complete. 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.876+0000 7f970527d740 1 -- start start 2024-02-21T07:47:32.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.877+0000 7f970527d740 1 Processor -- start 2024-02-21T07:47:32.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f5225f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f57a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f405150 con 0x56304f5347e0 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f404df0 con 0x56304f56f590 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f1ce1c0 con 0x56304f562890 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f970527d740 10 client.0 _ll_register_callbacks cb 0x56304f4542b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f96fb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f5225f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40052/0 (socket says 172.21.15.100:40052) 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f96fbe00640 1 -- 172.21.15.100:0/1879250762 learned_addr learned my addr 172.21.15.100:0/1879250762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.879+0000 7f96faa00640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f57a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 -- 172.21.15.100:0/1879250762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 msgr2=0x56304f57a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f57a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 -- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 msgr2=0x56304f5225f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f5225f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 -- 172.21.15.100:0/1879250762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec001cd0 con 0x56304f562890 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96fbe00640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f96f4037040 tx=0x7f96f4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e6678529954b35 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:32.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f402cea0 con 0x56304f562890 2024-02-21T07:47:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56304f15f7e0 con 0x56304f562890 2024-02-21T07:47:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f96f4034ad0 con 0x56304f562890 2024-02-21T07:47:32.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96f4034c90 con 0x56304f562890 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f970527d740 10 client.5408 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.880+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56304f45e5a0 con 0x56304f562890 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f4054020 con 0x56304f562890 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f96f403f440 con 0x56304f562890 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 10 client.5408 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 10 client.5408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 20 client.5408 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f562d10 0x56304f57a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 4 client.5408 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56304f19c720 con 0x56304f562d10 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.881+0000 7f96fb400640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f562d10 0x56304f57a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.882+0000 7f96fb400640 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f562d10 0x56304f57a9b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bfcc99bb23f65e server_cookie=756e27ce5037ede4 in_seq=0 out_seq=0 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.882+0000 7f96e4c00640 10 client.5408 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:32.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f96e4c00640 1 -- 172.21.15.100:0/1879250762 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56304f19c720 con 0x56304f562d10 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f96e4c00640 10 client.5408 handle_command_reply: tid=0 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 client.5408 shutdown 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 msgr2=0x56304f561db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f96f4037040 tx=0x7f96f4004ab0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 shutdown_connections 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f562d10 0x56304f57a9b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f561db0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f56f590 0x56304f57a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 --2- 172.21.15.100:0/1879250762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f5347e0 0x56304f5225f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 >> 172.21.15.100:0/1879250762 conn(0x56304f533ec0 msgr2=0x56304f4f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f96e4c00640 0 client.5408 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 shutdown_connections 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.883+0000 7f970527d740 1 -- 172.21.15.100:0/1879250762 wait complete. 2024-02-21T07:47:32.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.884+0000 7f970527d740 20 client.5408 trim_cache size 0 max 16384 2024-02-21T07:47:32.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.896+0000 7f970527d740 1 Processor -- start 2024-02-21T07:47:32.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.896+0000 7f970527d740 1 -- start start 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f5347e0 0x56304f4f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f4f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f4f7cf0 con 0x56304f56f590 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f4f2510 con 0x56304f5347e0 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.898+0000 7f970527d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f57a260 con 0x56304f562890 2024-02-21T07:47:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33978/0 (socket says 172.21.15.100:33978) 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 -- 172.21.15.100:0/2517262892 learned_addr learned my addr 172.21.15.100:0/2517262892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96faa00640 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f4f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fb400640 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f5347e0 0x56304f4f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 -- 172.21.15.100:0/2517262892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 msgr2=0x56304f4f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f4f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 -- 172.21.15.100:0/2517262892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f5347e0 msgr2=0x56304f4f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f5347e0 0x56304f4f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 -- 172.21.15.100:0/2517262892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56304f56ca30 con 0x56304f56f590 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.899+0000 7f96fbe00640 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f4041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f976d679ec23a1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f96e7400640 1 -- 172.21.15.100:0/2517262892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f402cea0 con 0x56304f56f590 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f96e7400640 1 -- 172.21.15.100:0/2517262892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f4054040 con 0x56304f56f590 2024-02-21T07:47:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f96e7400640 1 -- 172.21.15.100:0/2517262892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f4034720 con 0x56304f56f590 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 -- 172.21.15.100:0/2517262892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 msgr2=0x56304f5c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009d90 tx=0x7f96f4041040 comp rx=0 tx=0).stop 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 -- 172.21.15.100:0/2517262892 shutdown_connections 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c6910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f562890 0x56304f4f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 --2- 172.21.15.100:0/2517262892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f5347e0 0x56304f4f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 -- 172.21.15.100:0/2517262892 >> 172.21.15.100:0/2517262892 conn(0x56304f533ec0 msgr2=0x56304f564c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.900+0000 7f970527d740 1 -- 172.21.15.100:0/2517262892 shutdown_connections 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.901+0000 7f970527d740 1 -- 172.21.15.100:0/2517262892 wait complete. 2024-02-21T07:47:32.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.901+0000 7f970527d740 1 -- start start 2024-02-21T07:47:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.901+0000 7f970527d740 1 Processor -- start 2024-02-21T07:47:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f562890 0x56304f5c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f539f30 con 0x56304f56f590 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f5788e0 con 0x56304f562890 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56304f5d2e30 con 0x56304f5347e0 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f970527d740 10 client.0 _ll_register_callbacks cb 0x7f96ec0073f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40078/0 (socket says 172.21.15.100:40078) 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 -- 172.21.15.100:0/3155890380 learned_addr learned my addr 172.21.15.100:0/3155890380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96faa00640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f562890 0x56304f5c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fbe00640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 -- 172.21.15.100:0/3155890380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f562890 msgr2=0x56304f5c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f562890 0x56304f5c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 -- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 msgr2=0x56304f5c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:32.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.903+0000 7f96fb400640 1 -- 172.21.15.100:0/3155890380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56304f45e5a0 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f96fb400640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96ec001a00 tx=0x7f96ec012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c090130d6371ba2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f96e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec032d10 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f96ec01b070 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96ec0124b0 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96ec032e70 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f970527d740 10 client.5414 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.904+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56304f3faab0 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec0124b0 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f96ec012070 con 0x56304f5347e0 2024-02-21T07:47:32.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 10 client.5414 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 10 client.5414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 20 client.5414 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f4f5570 0x56304f5d63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 4 client.5414 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56304f1eb890 con 0x56304f4f5570 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.905+0000 7f96faa00640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f4f5570 0x56304f5d63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.906+0000 7f96faa00640 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f4f5570 0x56304f5d63a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebbb732f1047c1b server_cookie=fc424c0ed8197e3a in_seq=0 out_seq=0 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.906+0000 7f96e4c00640 10 client.5414 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.906+0000 7f96e4c00640 1 -- 172.21.15.100:0/3155890380 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56304f1eb890 con 0x56304f4f5570 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.906+0000 7f96e4c00640 10 client.5414 handle_command_reply: tid=0 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.906+0000 7f970527d740 1 client.5414 shutdown 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 msgr2=0x56304f579010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f96ec001a00 tx=0x7f96ec012000 comp rx=0 tx=0).stop 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 shutdown_connections 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56304f4f5570 0x56304f5d63a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56304f56f590 0x56304f5c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56304f562890 0x56304f5c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 --2- 172.21.15.100:0/3155890380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56304f5347e0 0x56304f579010 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 >> 172.21.15.100:0/3155890380 conn(0x56304f533ec0 msgr2=0x56304f561ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f96e4c00640 0 client.5414 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 shutdown_connections 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 1 -- 172.21.15.100:0/3155890380 wait complete. 2024-02-21T07:47:32.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.907+0000 7f970527d740 20 client.5414 trim_cache size 0 max 16384 2024-02-21T07:47:32.918 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:47:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 msgr2=0x7f96dc0a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 0x7f96dc0a15e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96ec007fd0 tx=0x7f96ec007240 comp rx=0 tx=0).stop 2024-02-21T07:47:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 msgr2=0x7f96fc21feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f96e8007fd0 tx=0x7f96e8001e70 comp rx=0 tx=0).stop 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 shutdown_connections 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f96dc09f120 0x7f96dc0a15e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96fc1895d0 0x7f96fc2203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96fc186370 0x7f96fc21feb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 --2- 172.21.15.100:0/3978127499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f96fc185f90 0x7f96fc171a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 >> 172.21.15.100:0/3978127499 conn(0x7f96fc0fc040 msgr2=0x7f96fc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 shutdown_connections 2024-02-21T07:47:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:32.908+0000 7f9702600640 1 -- 172.21.15.100:0/3978127499 wait complete. 2024-02-21T07:47:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.387+0000 7f58c7200640 1 Processor -- start 2024-02-21T07:47:33.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.387+0000 7f58c7200640 1 -- start start 2024-02-21T07:47:33.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f58c8182840 0x7f58c8186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c7200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c8187ef0 con 0x7f58c8186b70 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c7200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c8187000 con 0x7f58c80d0e90 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c7200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c80fec50 con 0x7f58c8182840 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c5400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f58c8186b70 0x7f58c80d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45232/0 (socket says 172.21.15.100:45232) 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c5400640 1 -- 172.21.15.100:0/2589347606 learned_addr learned my addr 172.21.15.100:0/2589347606 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:33.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2589347606 >> v2:172.21.15.100:3300/0 conn(0x7f58c8182840 0x7f58c8186630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.389+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974191022 0 0) 0x7f58c8187ef0 con 0x7f58c8186b70 2024-02-21T07:47:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58ac003520 con 0x7f58c8186b70 2024-02-21T07:47:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020906835 0 0) 0x7f58c8187000 con 0x7f58c80d0e90 2024-02-21T07:47:33.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c8187ef0 con 0x7f58c80d0e90 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724150795 0 0) 0x7f58ac003520 con 0x7f58c8186b70 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 >> v2:172.21.15.100:3300/0 conn(0x7f58c8182840 msgr2=0x7f58c8186630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 --2- 172.21.15.100:0/2589347606 >> v2:172.21.15.100:3300/0 conn(0x7f58c8182840 0x7f58c8186630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 >> v1:172.21.15.156:6789/0 conn(0x7f58c80d0e90 legacy=0x7f58c81886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c81872e0 con 0x7f58c8186b70 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f58b4001670 con 0x7f58c8186b70 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 >> v1:172.21.15.100:6789/0 conn(0x7f58c8186b70 legacy=0x7f58c80d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 0x7f58ac003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58ac0047c0 0x7f58ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac005240 0x7f58ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c80fec50 con 0x7f58ac005240 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac00c180 con 0x7f58ac003b50 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac00c340 con 0x7f58ac0047c0 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.390+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 0x7f58ac003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c6800640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac005240 0x7f58ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c5e00640 1 -- 172.21.15.100:0/2589347606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58ac0047c0 msgr2=0x7f58ac004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58ac0047c0 0x7f58ac004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c5e00640 1 -- 172.21.15.100:0/2589347606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac005240 msgr2=0x7f58ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac005240 0x7f58ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c5e00640 1 -- 172.21.15.100:0/2589347606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c81872e0 con 0x7f58ac003b50 2024-02-21T07:47:33.399 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.391+0000 7f58c6800640 1 -- 172.21.15.100:0/2589347606 reap_dead start 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.392+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 0x7f58ac003f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ac0 tx=0x7f58ac0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9925ca039b4e9825 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.392+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b802c6f0 con 0x7f58ac003b50 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.392+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b802c850 con 0x7f58ac003b50 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.392+0000 7f58c4a00640 1 -- 172.21.15.100:0/2589347606 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b802cbe0 con 0x7f58ac003b50 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 -- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 msgr2=0x7f58ac003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 0x7f58ac003f50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009ac0 tx=0x7f58ac0057f0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 -- 172.21.15.100:0/2589347606 shutdown_connections 2024-02-21T07:47:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 --2- 172.21.15.100:0/2589347606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58ac003b50 0x7f58ac003f50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 -- 172.21.15.100:0/2589347606 >> 172.21.15.100:0/2589347606 conn(0x7f58c80615c0 msgr2=0x7f58c80619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 -- 172.21.15.100:0/2589347606 shutdown_connections 2024-02-21T07:47:33.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.393+0000 7f58c7200640 1 -- 172.21.15.100:0/2589347606 wait complete. 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.395+0000 7f58c7200640 1 Processor -- start 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.396+0000 7f58c7200640 1 -- start start 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c816b320 0x7f58c817e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c816b7a0 0x7f58c817e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c821f7a0 con 0x7f58ac003b50 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c817dff0 con 0x7f58c816b7a0 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c7200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c8189920 con 0x7f58c816b320 2024-02-21T07:47:33.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34026/0 (socket says 172.21.15.100:34026) 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 -- 172.21.15.100:0/1278520093 learned_addr learned my addr 172.21.15.100:0/1278520093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c6800640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c816b7a0 0x7f58c817e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5400640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c816b320 0x7f58c817e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 -- 172.21.15.100:0/1278520093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c816b320 msgr2=0x7f58c817e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c816b320 0x7f58c817e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 -- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c816b7a0 msgr2=0x7f58c817e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.397+0000 7f58c5e00640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c816b7a0 0x7f58c817e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58c5e00640 1 -- 172.21.15.100:0/1278520093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8189c00 con 0x7f58ac003b50 2024-02-21T07:47:33.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58c5e00640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58b8037040 tx=0x7f58b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58be000640 1 -- 172.21.15.100:0/1278520093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8003810 con 0x7f58ac003b50 2024-02-21T07:47:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58be000640 1 -- 172.21.15.100:0/1278520093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8003970 con 0x7f58ac003b50 2024-02-21T07:47:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c8189ee0 con 0x7f58ac003b50 2024-02-21T07:47:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58be000640 1 -- 172.21.15.100:0/1278520093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8003d20 con 0x7f58ac003b50 2024-02-21T07:47:33.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.398+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c818a4a0 con 0x7f58ac003b50 2024-02-21T07:47:33.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.402+0000 7f58be000640 1 -- 172.21.15.100:0/1278520093 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f58b8034440 con 0x7f58ac003b50 2024-02-21T07:47:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.403+0000 7f58be000640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 0x7f58a80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.403+0000 7f58be000640 1 -- 172.21.15.100:0/1278520093 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f58b80ebc70 con 0x7f58ac003b50 2024-02-21T07:47:33.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.403+0000 7f58c5400640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 0x7f58a80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.404+0000 7f58c5400640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 0x7f58a80a1560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58b4001860 tx=0x7f58b4001670 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.405+0000 7f58cfdad740 1 Processor -- start 2024-02-21T07:47:33.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.405+0000 7f58cfdad740 1 -- start start 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.406+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.406+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa44acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44e8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58cfdad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa4468620 con 0x558fa44e8280 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58cfdad740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa441a8c0 con 0x558fa44ad1a0 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58cfdad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa4417df0 con 0x558fa451c6e0 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34032/0 (socket says 172.21.15.100:34032) 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 -- 172.21.15.100:0/2845698161 learned_addr learned my addr 172.21.15.100:0/2845698161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5400640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa44acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c6800640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.418 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 -- 172.21.15.100:0/2845698161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 msgr2=0x558fa44acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa44acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 -- 172.21.15.100:0/2845698161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 msgr2=0x558fa44e8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44e8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c5e00640 1 -- 172.21.15.100:0/2845698161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fa4394b00 con 0x558fa44e8280 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.407+0000 7f58c6800640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.408+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f58b80c1b40 tx=0x7f58b802c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba882db99ac738f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.408+0000 7f58b2a00640 1 -- 172.21.15.100:0/2845698161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8003e80 con 0x558fa44e8280 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.408+0000 7f58b2a00640 1 -- 172.21.15.100:0/2845698161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80b9fd0 con 0x558fa44e8280 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.408+0000 7f58b2a00640 1 -- 172.21.15.100:0/2845698161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b98d0 con 0x558fa44e8280 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 -- 172.21.15.100:0/2845698161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 msgr2=0x558fa44a7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f58b80c1b40 tx=0x7f58b802c320 comp rx=0 tx=0).stop 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 -- 172.21.15.100:0/2845698161 shutdown_connections 2024-02-21T07:47:33.419 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44e8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa44acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2845698161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44a7650 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 -- 172.21.15.100:0/2845698161 >> 172.21.15.100:0/2845698161 conn(0x558fa44744b0 msgr2=0x558fa44abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 -- 172.21.15.100:0/2845698161 shutdown_connections 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.409+0000 7f58cfdad740 1 -- 172.21.15.100:0/2845698161 wait complete. 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.410+0000 7f58cfdad740 1 -- start start 2024-02-21T07:47:33.420 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.411+0000 7f58cfdad740 1 Processor -- start 2024-02-21T07:47:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 0x558fa4511690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa452ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa44135d0 con 0x558fa44ad1a0 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa43b8b50 con 0x558fa44e8280 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa43b87f0 con 0x558fa451c6e0 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58cfdad740 10 client.0 _ll_register_callbacks cb 0x558fa43cc550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34044/0 (socket says 172.21.15.100:34044) 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 -- 172.21.15.100:0/2955083088 learned_addr learned my addr 172.21.15.100:0/2955083088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 -- 172.21.15.100:0/2955083088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 msgr2=0x558fa452ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa452ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5400640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 0x558fa4511690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 -- 172.21.15.100:0/2955083088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 msgr2=0x558fa4511690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 0x558fa4511690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5e00640 1 -- 172.21.15.100:0/2955083088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c818a4a0 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.413+0000 7f58c5400640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 0x558fa4511690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58c5e00640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f58b80c1b40 tx=0x7f58b8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb104d900d7172 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58a7400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b9d30 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f58b80b9fd0 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fa43e5cd0 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b80bda20 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58cfdad740 10 client.5301 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.414+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558fa4411c50 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fa43e5cd0 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f58b80e5030 con 0x558fa44ad1a0 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 10 client.5301 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 10 client.5301 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 20 client.5301 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44d9590 0x558fa452f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 4 client.5301 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fa4409ce0 con 0x558fa44d9590 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.415+0000 7f58c5400640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44d9590 0x558fa452f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.416+0000 7f58c5400640 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44d9590 0x558fa452f690 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54539f5f2abea2b server_cookie=309377dd80f7b3a7 in_seq=0 out_seq=0 2024-02-21T07:47:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.416+0000 7f58a7400640 10 client.5301 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58a7400640 1 -- 172.21.15.100:0/2955083088 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558fa4409ce0 con 0x558fa44d9590 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58a7400640 10 client.5301 handle_command_reply: tid=0 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 client.5301 shutdown 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 msgr2=0x558fa44dbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f58b80c1b40 tx=0x7f58b8009190 comp rx=0 tx=0).stop 2024-02-21T07:47:33.426 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 shutdown_connections 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44d9590 0x558fa452f690 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa452ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44e8280 0x558fa4511690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 --2- 172.21.15.100:0/2955083088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa44dbe60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.417+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 >> 172.21.15.100:0/2955083088 conn(0x558fa44744b0 msgr2=0x558fa451cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.418+0000 7f58a7400640 0 client.5301 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.418+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 shutdown_connections 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.418+0000 7f58cfdad740 1 -- 172.21.15.100:0/2955083088 wait complete. 2024-02-21T07:47:33.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.418+0000 7f58cfdad740 20 client.5301 trim_cache size 0 max 16384 2024-02-21T07:47:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.440+0000 7f58cfdad740 1 Processor -- start 2024-02-21T07:47:33.446 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.440+0000 7f58cfdad740 1 -- start start 2024-02-21T07:47:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.441+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.441+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44e4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.441+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa45806d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58cfdad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa415be60 con 0x558fa44e8280 2024-02-21T07:47:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58cfdad740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa44acc60 con 0x558fa44ad1a0 2024-02-21T07:47:33.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58cfdad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa44aae30 con 0x558fa451c6e0 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59406/0 (socket says 172.21.15.100:59406) 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44e4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 -- 172.21.15.100:0/3420740346 learned_addr learned my addr 172.21.15.100:0/3420740346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c6800640 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa45806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 -- 172.21.15.100:0/3420740346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 msgr2=0x558fa45806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa45806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 -- 172.21.15.100:0/3420740346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 msgr2=0x558fa44e4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44e4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.442+0000 7f58c5e00640 1 -- 172.21.15.100:0/3420740346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fa43ae530 con 0x558fa44ad1a0 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.443+0000 7f58c5e00640 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b61c0 tx=0x7f58b80d2000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ece87f2576dabd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.443+0000 7f58b2000640 1 -- 172.21.15.100:0/3420740346 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80bda20 con 0x558fa44ad1a0 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.443+0000 7f58b2000640 1 -- 172.21.15.100:0/3420740346 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80b9fd0 con 0x558fa44ad1a0 2024-02-21T07:47:33.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.443+0000 7f58b2000640 1 -- 172.21.15.100:0/3420740346 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b9d30 con 0x558fa44ad1a0 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 -- 172.21.15.100:0/3420740346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 msgr2=0x558fa44aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b61c0 tx=0x7f58b80d2000 comp rx=0 tx=0).stop 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 -- 172.21.15.100:0/3420740346 shutdown_connections 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa451c6e0 0x558fa45806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44e8280 0x558fa44e4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 --2- 172.21.15.100:0/3420740346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa44ad1a0 0x558fa44aa580 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 -- 172.21.15.100:0/3420740346 >> 172.21.15.100:0/3420740346 conn(0x558fa44744b0 msgr2=0x558fa452eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 -- 172.21.15.100:0/3420740346 shutdown_connections 2024-02-21T07:47:33.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.444+0000 7f58cfdad740 1 -- 172.21.15.100:0/3420740346 wait complete. 2024-02-21T07:47:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.445+0000 7f58cfdad740 1 -- start start 2024-02-21T07:47:33.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.445+0000 7f58cfdad740 1 Processor -- start 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.447+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.447+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa44e8280 0x558fa451a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.447+0000 7f58cfdad740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa451c6e0 0x558fa452dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.447+0000 7f58cfdad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa4589d20 con 0x558fa44ad1a0 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58cfdad740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa44d8f00 con 0x558fa451c6e0 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58cfdad740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fa44f0920 con 0x558fa44e8280 2024-02-21T07:47:33.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58cfdad740 10 client.0 _ll_register_callbacks cb 0x7f58b802c270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34050/0 (socket says 172.21.15.100:34050) 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 -- 172.21.15.100:0/896931278 learned_addr learned my addr 172.21.15.100:0/896931278 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c6800640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa451c6e0 0x558fa452dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5400640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa44e8280 0x558fa451a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 -- 172.21.15.100:0/896931278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa44e8280 msgr2=0x558fa451a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa44e8280 0x558fa451a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 -- 172.21.15.100:0/896931278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa451c6e0 msgr2=0x558fa452dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa451c6e0 0x558fa452dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.448+0000 7f58c5e00640 1 -- 172.21.15.100:0/896931278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fa4411c50 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58c5e00640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b95d0 tx=0x7f58b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976b29f81b76708c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58a7400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80bda20 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f58b80b98d0 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fa44d9ce0 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b802de70 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58cfdad740 10 client.5307 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.449+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x558fa43d42c0 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80a0020 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f58b80e5040 con 0x558fa44ad1a0 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 10 client.5307 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 10 client.5307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:33.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 20 client.5307 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44aae30 0x558fa44e2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 4 client.5307 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558fa4438d30 con 0x558fa44aae30 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.450+0000 7f58c5400640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44aae30 0x558fa44e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.451+0000 7f58c5400640 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44aae30 0x558fa44e2570 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73934b39c84d5b3 server_cookie=64be7ef29a0a032 in_seq=0 out_seq=0 2024-02-21T07:47:33.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.451+0000 7f58a7400640 10 client.5307 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:33.463 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58a7400640 1 -- 172.21.15.100:0/896931278 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558fa4438d30 con 0x558fa44aae30 2024-02-21T07:47:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58a7400640 10 client.5307 handle_command_reply: tid=0 2024-02-21T07:47:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 client.5307 shutdown 2024-02-21T07:47:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 msgr2=0x558fa451acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f58b80b95d0 tx=0x7f58b8008040 comp rx=0 tx=0).stop 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 shutdown_connections 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558fa44aae30 0x558fa44e2570 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558fa451c6e0 0x558fa452dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558fa44e8280 0x558fa451a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 --2- 172.21.15.100:0/896931278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558fa44ad1a0 0x558fa451acd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 >> 172.21.15.100:0/896931278 conn(0x558fa44744b0 msgr2=0x558fa44e4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58a7400640 0 client.5307 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:33.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 shutdown_connections 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.458+0000 7f58cfdad740 1 -- 172.21.15.100:0/896931278 wait complete. 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.459+0000 7f58cfdad740 20 client.5307 trim_cache size 0 max 16384 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:47:33.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.459+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 msgr2=0x7f58a80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.459+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 0x7f58a80a1560 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f58b4001860 tx=0x7f58b4001670 comp rx=0 tx=0).stop 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.459+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 msgr2=0x7f58c821f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.459+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58b8037040 tx=0x7f58b8004730 comp rx=0 tx=0).stop 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 shutdown_connections 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c816b7a0 0x7f58c817e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f58c816b320 0x7f58c817e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f58a809f0a0 0x7f58a80a1560 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 --2- 172.21.15.100:0/1278520093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58ac003b50 0x7f58c821f260 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 >> 172.21.15.100:0/1278520093 conn(0x7f58c80615c0 msgr2=0x7f58c80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 shutdown_connections 2024-02-21T07:47:33.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:33.460+0000 7f58c7200640 1 -- 172.21.15.100:0/1278520093 wait complete. 2024-02-21T07:47:33.931 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:47:33.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:47:33.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:47:34.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.099+0000 7f2a2ea00640 1 Processor -- start 2024-02-21T07:47:34.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.099+0000 7f2a2ea00640 1 -- start start 2024-02-21T07:47:34.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2ea00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2a280fd170 0x7f2a280d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2ea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a28189890 con 0x7f2a2818be10 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2ea00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280fbd30 con 0x7f2a280d5da0 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2ea00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a280d4420 con 0x7f2a280fd170 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2d600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2a2818be10 0x7f2a280fca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45246/0 (socket says 172.21.15.100:45246) 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2d600640 1 -- 172.21.15.100:0/3855212485 learned_addr learned my addr 172.21.15.100:0/3855212485 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.102+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/3855212485 >> v2:172.21.15.170:3300/0 conn(0x7f2a280fd170 0x7f2a280d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.103+0000 7f2a27e00640 1 -- 172.21.15.100:0/3855212485 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732096662 0 0) 0x7f2a280fbd30 con 0x7f2a280d5da0 2024-02-21T07:47:34.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.103+0000 7f2a27e00640 1 -- 172.21.15.100:0/3855212485 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a10003520 con 0x7f2a280d5da0 2024-02-21T07:47:34.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.103+0000 7f2a2cc00640 1 -- 172.21.15.100:0/3855212485 >> v1:172.21.15.156:6789/0 conn(0x7f2a280d5da0 legacy=0x7f2a2818c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.103+0000 7f2a2cc00640 1 -- 172.21.15.100:0/3855212485 >> v1:172.21.15.100:6789/0 conn(0x7f2a2818be10 legacy=0x7f2a280fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.103+0000 7f2a2cc00640 1 -- 172.21.15.100:0/3855212485 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280fc5d0 con 0x7f2a280fd170 2024-02-21T07:47:34.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.105+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/3855212485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a280d5860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec7f63278ccd993 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.105+0000 7f2a27e00640 1 -- 172.21.15.100:0/3855212485 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1402e070 con 0x7f2a280fd170 2024-02-21T07:47:34.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.105+0000 7f2a27e00640 1 -- 172.21.15.100:0/3855212485 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140315a0 con 0x7f2a280fd170 2024-02-21T07:47:34.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.105+0000 7f2a27e00640 1 -- 172.21.15.100:0/3855212485 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14031910 con 0x7f2a280fd170 2024-02-21T07:47:34.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 -- 172.21.15.100:0/3855212485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 msgr2=0x7f2a280d5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/3855212485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a280d5860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2a140097a0 tx=0x7f2a1402b840 comp rx=0 tx=0).stop 2024-02-21T07:47:34.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 -- 172.21.15.100:0/3855212485 shutdown_connections 2024-02-21T07:47:34.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/3855212485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a280d5860 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 -- 172.21.15.100:0/3855212485 >> 172.21.15.100:0/3855212485 conn(0x7f2a280fdf30 msgr2=0x7f2a280fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 -- 172.21.15.100:0/3855212485 shutdown_connections 2024-02-21T07:47:34.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.106+0000 7f2a2ea00640 1 -- 172.21.15.100:0/3855212485 wait complete. 2024-02-21T07:47:34.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.109+0000 7f2a2ea00640 1 Processor -- start 2024-02-21T07:47:34.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.110+0000 7f2a2ea00640 1 -- start start 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a281774e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2818be10 0x7f2a2821eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28177050 con 0x7f2a280d5da0 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281764b0 con 0x7f2a2818be10 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2ea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28176720 con 0x7f2a280fd170 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34062/0 (socket says 172.21.15.100:34062) 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 -- 172.21.15.100:0/1126698504 learned_addr learned my addr 172.21.15.100:0/1126698504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2e000640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2818be10 0x7f2a2821eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a281774e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 -- 172.21.15.100:0/1126698504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 msgr2=0x7f2a281774e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a281774e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 -- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2818be10 msgr2=0x7f2a2821eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2818be10 0x7f2a2821eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.112+0000 7f2a2d600640 1 -- 172.21.15.100:0/1126698504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a14009400 con 0x7f2a280d5da0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a281774e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c3f0 tx=0x7f2a1c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a25600640 1 -- 172.21.15.100:0/1126698504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c005ce0 con 0x7f2a280d5da0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a25600640 1 -- 172.21.15.100:0/1126698504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c005e40 con 0x7f2a280d5da0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a25600640 1 -- 172.21.15.100:0/1126698504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0072f0 con 0x7f2a280d5da0 2024-02-21T07:47:34.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a28176a00 con 0x7f2a280d5da0 2024-02-21T07:47:34.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.113+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281791f0 con 0x7f2a280d5da0 2024-02-21T07:47:34.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.118+0000 7f2a25600640 1 -- 172.21.15.100:0/1126698504 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2a1c007450 con 0x7f2a280d5da0 2024-02-21T07:47:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.119+0000 7f2a32d95740 1 Processor -- start 2024-02-21T07:47:34.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.119+0000 7f2a32d95740 1 -- start start 2024-02-21T07:47:34.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.120+0000 7f2a25600640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 0x7f2a080a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.120+0000 7f2a25600640 1 -- 172.21.15.100:0/1126698504 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2a1c0c90d0 con 0x7f2a280d5da0 2024-02-21T07:47:34.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.120+0000 7f2a2e000640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 0x7f2a080a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356b390 0x55a83356b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2e000640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 0x7f2a080a1560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a2818bc80 tx=0x7f2a20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a8335a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8334eb300 con 0x55a83356b390 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83349de50 con 0x55a83356bcb0 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a32d95740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83349b380 con 0x55a8335a6a60 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59426/0 (socket says 172.21.15.100:59426) 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2cc00640 1 -- 172.21.15.100:0/167982047 learned_addr learned my addr 172.21.15.100:0/167982047 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2d600640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356b390 0x55a83356b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.121+0000 7f2a2e000640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a8335a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 -- 172.21.15.100:0/167982047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 msgr2=0x55a8335a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a8335a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 -- 172.21.15.100:0/167982047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356b390 msgr2=0x55a83356b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356b390 0x55a83356b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 -- 172.21.15.100:0/167982047 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a83345fc80 con 0x55a83356bcb0 2024-02-21T07:47:34.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2e000640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a8335a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098c0 tx=0x7f2a14030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fd6e7158c8c40c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a19c00640 1 -- 172.21.15.100:0/167982047 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14040070 con 0x55a83356bcb0 2024-02-21T07:47:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a19c00640 1 -- 172.21.15.100:0/167982047 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14031850 con 0x55a83356bcb0 2024-02-21T07:47:34.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.122+0000 7f2a19c00640 1 -- 172.21.15.100:0/167982047 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14031bc0 con 0x55a83356bcb0 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 -- 172.21.15.100:0/167982047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 msgr2=0x55a8335a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098c0 tx=0x7f2a14030000 comp rx=0 tx=0).stop 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 -- 172.21.15.100:0/167982047 shutdown_connections 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a8335a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a83356bcb0 0x55a8335a6520 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 --2- 172.21.15.100:0/167982047 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356b390 0x55a83356b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 -- 172.21.15.100:0/167982047 >> 172.21.15.100:0/167982047 conn(0x55a83352d960 msgr2=0x55a83352e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 -- 172.21.15.100:0/167982047 shutdown_connections 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.123+0000 7f2a32d95740 1 -- 172.21.15.100:0/167982047 wait complete. 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.124+0000 7f2a32d95740 1 -- start start 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.124+0000 7f2a32d95740 1 Processor -- start 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a8335b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a833555a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a833496b60 con 0x55a8335a6a60 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83343bfd0 con 0x55a8335555c0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83343bc70 con 0x55a83356bcb0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a32d95740 10 client.0 _ll_register_callbacks cb 0x55a8331a7c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a8335b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a2e000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a833555a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34072/0 (socket says 172.21.15.100:34072) 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.126+0000 7f2a2cc00640 1 -- 172.21.15.100:0/2508135725 learned_addr learned my addr 172.21.15.100:0/2508135725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 -- 172.21.15.100:0/2508135725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 msgr2=0x55a8335b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a8335b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 -- 172.21.15.100:0/2508135725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 msgr2=0x55a833555a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a833555a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 -- 172.21.15.100:0/2508135725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a280fc5d0 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a1402bd80 tx=0x7f2a14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d904559ff31cc0d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a0e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14040070 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2a14031dd0 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.127+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a833196860 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a14003610 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 10 client.5319 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a8334951e0 con 0x55a8335a6a60 2024-02-21T07:47:34.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a833196860 con 0x55a8335a6a60 2024-02-21T07:47:34.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2a1404d030 con 0x55a8335a6a60 2024-02-21T07:47:34.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 10 client.5319 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:34.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 10 client.5319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 20 client.5319 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a83352b210 0x55a8335b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 4 client.5319 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.128+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8331e7410 con 0x55a83352b210 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.129+0000 7f2a2d600640 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a83352b210 0x55a8335b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.129+0000 7f2a2d600640 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a83352b210 0x55a8335b30f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0cf5a05d70d261 server_cookie=7b8a4168757128ac in_seq=0 out_seq=0 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.129+0000 7f2a0e000640 10 client.5319 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.130+0000 7f2a0e000640 1 -- 172.21.15.100:0/2508135725 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8331e7410 con 0x55a83352b210 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.130+0000 7f2a0e000640 10 client.5319 handle_command_reply: tid=0 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.130+0000 7f2a32d95740 1 client.5319 shutdown 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 msgr2=0x55a83355fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2a1402bd80 tx=0x7f2a14004730 comp rx=0 tx=0).stop 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 shutdown_connections 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a83352b210 0x55a8335b30f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a833555a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a83355fa50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 --2- 172.21.15.100:0/2508135725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a8335b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 >> 172.21.15.100:0/2508135725 conn(0x55a83356b390 msgr2=0x55a83352f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a0e000640 0 client.5319 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 shutdown_connections 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 1 -- 172.21.15.100:0/2508135725 wait complete. 2024-02-21T07:47:34.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.131+0000 7f2a32d95740 20 client.5319 trim_cache size 0 max 16384 2024-02-21T07:47:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.162+0000 7f2a32d95740 1 Processor -- start 2024-02-21T07:47:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.162+0000 7f2a32d95740 1 -- start start 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a833567a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a833567f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8331df0c0 con 0x55a8335a6a60 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83352f160 con 0x55a8335555c0 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a32d95740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8335b1230 con 0x55a83356bcb0 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a2e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a833567f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.164+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a833567a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59434/0 (socket says 172.21.15.100:59434) 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 -- 172.21.15.100:0/565686766 learned_addr learned my addr 172.21.15.100:0/565686766 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 -- 172.21.15.100:0/565686766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 msgr2=0x55a833567a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a833567a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 -- 172.21.15.100:0/565686766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 msgr2=0x55a833567f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a833567f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2d600640 1 -- 172.21.15.100:0/565686766 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a83355ea30 con 0x55a8335555c0 2024-02-21T07:47:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.165+0000 7f2a2e000640 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a833567f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a2d600640 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c096b40 tx=0x7f2a1c0c6940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b99ec8c1eb39b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a19200640 1 -- 172.21.15.100:0/565686766 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0c6b80 con 0x55a8335555c0 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a19200640 1 -- 172.21.15.100:0/565686766 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0ae070 con 0x55a8335555c0 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a19200640 1 -- 172.21.15.100:0/565686766 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c093220 con 0x55a8335555c0 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a32d95740 1 -- 172.21.15.100:0/565686766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 msgr2=0x55a8335253b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.166+0000 7f2a32d95740 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c096b40 tx=0x7f2a1c0c6940 comp rx=0 tx=0).stop 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 -- 172.21.15.100:0/565686766 shutdown_connections 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8335a6a60 0x55a833567f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a83356bcb0 0x55a833567a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 --2- 172.21.15.100:0/565686766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335253b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 -- 172.21.15.100:0/565686766 >> 172.21.15.100:0/565686766 conn(0x55a83356b390 msgr2=0x55a83352f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 -- 172.21.15.100:0/565686766 shutdown_connections 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.167+0000 7f2a32d95740 1 -- 172.21.15.100:0/565686766 wait complete. 2024-02-21T07:47:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.168+0000 7f2a32d95740 1 -- start start 2024-02-21T07:47:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.168+0000 7f2a32d95740 1 Processor -- start 2024-02-21T07:47:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a833607e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83360de00 con 0x55a83356bcb0 2024-02-21T07:47:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a833563790 con 0x55a8335555c0 2024-02-21T07:47:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8335a42b0 con 0x55a8335a6a60 2024-02-21T07:47:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.170+0000 7f2a32d95740 10 client.0 _ll_register_callbacks cb 0x7f2a100036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34096/0 (socket says 172.21.15.100:34096) 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2cc00640 1 -- 172.21.15.100:0/1366809203 learned_addr learned my addr 172.21.15.100:0/1366809203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2e000640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a833607e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 -- 172.21.15.100:0/1366809203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 msgr2=0x55a833607e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a833607e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 -- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 msgr2=0x55a833563940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2d600640 1 -- 172.21.15.100:0/1366809203 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281791f0 con 0x55a8335555c0 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.171+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a2d600640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335590b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000fb0 tx=0x7f2a14031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddfad891875882be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a0e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c093220 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2a1c093380 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a14031850 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a1c096000 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a32d95740 10 client.5440 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a833431a90 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.172+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14031850 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2a1c0b4020 con 0x55a8335555c0 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 10 client.5440 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 10 client.5440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 20 client.5440 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a833536040 0x55a8335b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 4 client.5440 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:47:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a8331d37b0 con 0x55a833536040 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.173+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a833536040 0x55a8335b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.174+0000 7f2a2cc00640 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a833536040 0x55a8335b7540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fd25b1f777029f5 server_cookie=5cfb4f3dfa3307e5 in_seq=0 out_seq=0 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.174+0000 7f2a0e000640 10 client.5440 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.175+0000 7f2a0e000640 1 -- 172.21.15.100:0/1366809203 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a8331d37b0 con 0x55a833536040 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.175+0000 7f2a0e000640 10 client.5440 handle_command_reply: tid=0 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.175+0000 7f2a32d95740 1 client.5440 shutdown 2024-02-21T07:47:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 msgr2=0x55a8335590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335590b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c000fb0 tx=0x7f2a14031000 comp rx=0 tx=0).stop 2024-02-21T07:47:34.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 shutdown_connections 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a833536040 0x55a8335b7540 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a8335a6a60 0x55a833607e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a83356bcb0 0x55a833563940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 --2- 172.21.15.100:0/1366809203 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a8335555c0 0x55a8335590b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.176+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 >> 172.21.15.100:0/1366809203 conn(0x55a83356b390 msgr2=0x55a833598920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.177+0000 7f2a0e000640 0 client.5440 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.177+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 shutdown_connections 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.177+0000 7f2a32d95740 1 -- 172.21.15.100:0/1366809203 wait complete. 2024-02-21T07:47:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.177+0000 7f2a32d95740 20 client.5440 trim_cache size 0 max 16384 2024-02-21T07:47:34.185 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:47:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:47:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "d207a041-a9e0-4365-9e99-2ff0f7ef6b87", 2024-02-21T07:47:34.185 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:47:34.185 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 msgr2=0x7f2a080a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 0x7f2a080a1560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2a2818bc80 tx=0x7f2a20009040 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 msgr2=0x7f2a28170420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c3f0 tx=0x7f2a1c00c8b0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 shutdown_connections 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a2818be10 0x7f2a2821eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2a280fd170 0x7f2a281774e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2a0809f0a0 0x7f2a080a1560 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 --2- 172.21.15.100:0/1126698504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a280d5da0 0x7f2a28170420 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 >> 172.21.15.100:0/1126698504 conn(0x7f2a280fdf30 msgr2=0x7f2a2817ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.179+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 shutdown_connections 2024-02-21T07:47:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.180+0000 7f2a2ea00640 1 -- 172.21.15.100:0/1126698504 wait complete. 2024-02-21T07:47:34.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:47:34.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:47:34.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.415+0000 7f91a6400640 1 Processor -- start 2024-02-21T07:47:34.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.415+0000 7f91a6400640 1 -- start start 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.416+0000 7f91a6400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91a008c7e0 0x7f91a008cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.416+0000 7f91a6400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f91a008d140 0x7f91a0161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f91a6400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a006b330 con 0x7f91a015daa0 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f91a6400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a006c6b0 con 0x7f91a008c7e0 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f91a6400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a006b610 con 0x7f91a008d140 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f919f400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f91a015daa0 0x7f91a006ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40580/0 (socket says 172.21.15.100:40580) 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f919f400640 1 -- 172.21.15.100:0/2960771902 learned_addr learned my addr 172.21.15.100:0/2960771902 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:34.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f9197e00640 1 --2- 172.21.15.100:0/2960771902 >> v2:172.21.15.100:3300/0 conn(0x7f91a008c7e0 0x7f91a008cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f919fe00640 1 --2- 172.21.15.100:0/2960771902 >> v2:172.21.15.156:3300/0 conn(0x7f91a008d140 0x7f91a0161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907517647 0 0) 0x7f91a006b330 con 0x7f91a015daa0 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.417+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9184003520 con 0x7f91a015daa0 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.418+0000 7f9197e00640 1 -- 172.21.15.100:0/2960771902 >> v2:172.21.15.156:3300/0 conn(0x7f91a008d140 msgr2=0x7f91a0161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.418+0000 7f9197e00640 1 --2- 172.21.15.100:0/2960771902 >> v2:172.21.15.156:3300/0 conn(0x7f91a008d140 0x7f91a0161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.418+0000 7f9197e00640 1 -- 172.21.15.100:0/2960771902 >> v1:172.21.15.170:6789/0 conn(0x7f91a015daa0 legacy=0x7f91a006ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.418+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278670470 0 0) 0x7f9184003520 con 0x7f91a015daa0 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.418+0000 7f9197e00640 1 -- 172.21.15.100:0/2960771902 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a006b8f0 con 0x7f91a008c7e0 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.419+0000 7f9197e00640 1 --2- 172.21.15.100:0/2960771902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a008c7e0 0x7f91a008cc00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f91a00fbca0 tx=0x7f918802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85f6e490108fc98 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.419+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190001670 con 0x7f91a008c7e0 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.419+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188033440 con 0x7f91a008c7e0 2024-02-21T07:47:34.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.419+0000 7f919ea00640 1 -- 172.21.15.100:0/2960771902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880337d0 con 0x7f91a008c7e0 2024-02-21T07:47:34.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 -- 172.21.15.100:0/2960771902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a008c7e0 msgr2=0x7f91a008cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 --2- 172.21.15.100:0/2960771902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a008c7e0 0x7f91a008cc00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f91a00fbca0 tx=0x7f918802b7a0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 -- 172.21.15.100:0/2960771902 shutdown_connections 2024-02-21T07:47:34.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 --2- 172.21.15.100:0/2960771902 >> v2:172.21.15.156:3300/0 conn(0x7f91a008d140 0x7f91a0161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 --2- 172.21.15.100:0/2960771902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a008c7e0 0x7f91a008cc00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 -- 172.21.15.100:0/2960771902 >> 172.21.15.100:0/2960771902 conn(0x7f91a00fe210 msgr2=0x7f91a00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 -- 172.21.15.100:0/2960771902 shutdown_connections 2024-02-21T07:47:34.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.420+0000 7f91a6400640 1 -- 172.21.15.100:0/2960771902 wait complete. 2024-02-21T07:47:34.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.423+0000 7f91a6400640 1 Processor -- start 2024-02-21T07:47:34.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.423+0000 7f91a6400640 1 -- start start 2024-02-21T07:47:34.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91a008c7e0 0x7f91a0151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a0151e50 0x7f91a01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01529d0 con 0x7f91a0151e50 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0152cb0 con 0x7f91a015daa0 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.425+0000 7f91a6400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0152f90 con 0x7f91a008c7e0 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59470/0 (socket says 172.21.15.100:59470) 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 -- 172.21.15.100:0/860406769 learned_addr learned my addr 172.21.15.100:0/860406769 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f919f400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91a008c7e0 0x7f91a0151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f919fe00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a0151e50 0x7f91a01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 -- 172.21.15.100:0/860406769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91a008c7e0 msgr2=0x7f91a0151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91a008c7e0 0x7f91a0151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 -- 172.21.15.100:0/860406769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a0151e50 msgr2=0x7f91a01522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a0151e50 0x7f91a01522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 -- 172.21.15.100:0/860406769 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009400 con 0x7f91a015daa0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.426+0000 7f9197e00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f91880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.427+0000 7f9197400640 1 -- 172.21.15.100:0/860406769 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188030940 con 0x7f91a015daa0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.427+0000 7f9197400640 1 -- 172.21.15.100:0/860406769 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188030ac0 con 0x7f91a015daa0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.427+0000 7f9197400640 1 -- 172.21.15.100:0/860406769 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188030e70 con 0x7f91a015daa0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.427+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a021fea0 con 0x7f91a015daa0 2024-02-21T07:47:34.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.427+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a02206a0 con 0x7f91a015daa0 2024-02-21T07:47:34.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.432+0000 7f9197400640 1 -- 172.21.15.100:0/860406769 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f918803a040 con 0x7f91a015daa0 2024-02-21T07:47:34.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.434+0000 7f91a8fcd740 1 Processor -- start 2024-02-21T07:47:34.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.434+0000 7f9197400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 0x7f917c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.434+0000 7f9197400640 1 -- 172.21.15.100:0/860406769 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f91880eb800 con 0x7f91a015daa0 2024-02-21T07:47:34.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.434+0000 7f91a8fcd740 1 -- start start 2024-02-21T07:47:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.434+0000 7f919fe00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 0x7f917c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.435+0000 7f919fe00640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 0x7f917c0a1590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91a0092b60 tx=0x7f919800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 0x55728ea37690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728ea71050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e9a0150 con 0x55728eaa0ca0 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e99d680 con 0x55728ea70bf0 2024-02-21T07:47:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.436+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e998e60 con 0x55728ea70810 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34136/0 (socket says 172.21.15.100:34136) 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 -- 172.21.15.100:0/1137279390 learned_addr learned my addr 172.21.15.100:0/1137279390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f919f400640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 0x55728ea37690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f919fe00640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728ea71050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 -- 172.21.15.100:0/1137279390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 msgr2=0x55728ea37690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 0x55728ea37690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 -- 172.21.15.100:0/1137279390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 msgr2=0x55728ea71050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728ea71050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f9197e00640 1 -- 172.21.15.100:0/1137279390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55728e952060 con 0x55728eaa0ca0 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f919fe00640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728ea71050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.437+0000 7f919f400640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 0x55728ea37690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.438+0000 7f9197e00640 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9188031040 tx=0x7f91880b9510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4797611f28763ffe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.438+0000 7f918fe00640 1 -- 172.21.15.100:0/1137279390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880c1c00 con 0x55728eaa0ca0 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.438+0000 7f918fe00640 1 -- 172.21.15.100:0/1137279390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880b7810 con 0x55728eaa0ca0 2024-02-21T07:47:34.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.438+0000 7f918fe00640 1 -- 172.21.15.100:0/1137279390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880c1770 con 0x55728eaa0ca0 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1137279390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 msgr2=0x55728eaaf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9188031040 tx=0x7f91880b9510 comp rx=0 tx=0).stop 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1137279390 shutdown_connections 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728ea71050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728eaaf000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1137279390 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70810 0x55728ea37690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1137279390 >> 172.21.15.100:0/1137279390 conn(0x55728e9f85a0 msgr2=0x55728ea2feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1137279390 shutdown_connections 2024-02-21T07:47:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.439+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1137279390 wait complete. 2024-02-21T07:47:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.441+0000 7f91a8fcd740 1 -- start start 2024-02-21T07:47:34.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.441+0000 7f91a8fcd740 1 Processor -- start 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728eaa2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 0x55728ea5e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e93dec0 con 0x55728ea70810 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e93db60 con 0x55728ea70bf0 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728e7071c0 con 0x55728eaa0ca0 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f91a8fcd740 10 client.0 _ll_register_callbacks cb 0x55728e951960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f919f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f919f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34144/0 (socket says 172.21.15.100:34144) 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f919f400640 1 -- 172.21.15.100:0/681516109 learned_addr learned my addr 172.21.15.100:0/681516109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.443+0000 7f9197e00640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728eaa2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919fe00640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 0x55728ea5e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 -- 172.21.15.100:0/681516109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 msgr2=0x55728ea5e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 0x55728ea5e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 -- 172.21.15.100:0/681516109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 msgr2=0x55728eaa2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728eaa2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 -- 172.21.15.100:0/681516109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a02206a0 con 0x55728ea70810 2024-02-21T07:47:34.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919fe00640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 0x55728ea5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:47:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f919f400640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9190001380 tx=0x7f91900119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1025db1e0a3ee36 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f918cc00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:34.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.444+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190015680 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55728e6987e0 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f91900157e0 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91900159f0 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f91a8fcd740 10 client.5337 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55728e9974e0 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.445+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55728e6987e0 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9190015b50 con 0x55728ea70810 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 10 client.5337 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 10 client.5337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 20 client.5337 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eab97b0 0x55728ea9e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 4 client.5337 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55728e6d5720 con 0x55728eab97b0 2024-02-21T07:47:34.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.446+0000 7f9197e00640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eab97b0 0x55728ea9e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.447+0000 7f9197e00640 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eab97b0 0x55728ea9e900 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bb576871e309c8 server_cookie=1747158a9a927310 in_seq=0 out_seq=0 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.447+0000 7f918cc00640 10 client.5337 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.448+0000 7f918cc00640 1 -- 172.21.15.100:0/681516109 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55728e6d5720 con 0x55728eab97b0 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.448+0000 7f918cc00640 10 client.5337 handle_command_reply: tid=0 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.448+0000 7f91a8fcd740 1 client.5337 shutdown 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 msgr2=0x55728ea64a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9190001380 tx=0x7f91900119e0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 shutdown_connections 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eab97b0 0x55728ea9e900 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728eaa0ca0 0x55728ea5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70bf0 0x55728eaa2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/681516109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728ea64a70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 >> 172.21.15.100:0/681516109 conn(0x55728e9f85a0 msgr2=0x55728ea71050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f918cc00640 0 client.5337 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 shutdown_connections 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 1 -- 172.21.15.100:0/681516109 wait complete. 2024-02-21T07:47:34.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.449+0000 7f91a8fcd740 20 client.5337 trim_cache size 0 max 16384 2024-02-21T07:47:34.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.479+0000 7f91a8fcd740 1 Processor -- start 2024-02-21T07:47:34.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.479+0000 7f91a8fcd740 1 -- start start 2024-02-21T07:47:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728eaa1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728ea7b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728ea2e7f0 con 0x55728eaa0ca0 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728ea6d900 con 0x55728ea70810 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728eab9fb0 con 0x55728ea70bf0 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59510/0 (socket says 172.21.15.100:59510) 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 -- 172.21.15.100:0/1263619004 learned_addr learned my addr 172.21.15.100:0/1263619004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f9197e00640 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728eaa1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919fe00640 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728ea7b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 -- 172.21.15.100:0/1263619004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 msgr2=0x55728eaa1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728eaa1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 -- 172.21.15.100:0/1263619004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 msgr2=0x55728ea7b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728ea7b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.481+0000 7f919f400640 1 -- 172.21.15.100:0/1263619004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55728e933950 con 0x55728ea70810 2024-02-21T07:47:34.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.482+0000 7f919f400640 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f919000c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f380bd69443875c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.482+0000 7f918f400640 1 -- 172.21.15.100:0/1263619004 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011320 con 0x55728ea70810 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.482+0000 7f918f400640 1 -- 172.21.15.100:0/1263619004 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190015680 con 0x55728ea70810 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.482+0000 7f918f400640 1 -- 172.21.15.100:0/1263619004 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91900159f0 con 0x55728ea70810 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1263619004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 msgr2=0x55728ea9f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f919000c000 comp rx=0 tx=0).stop 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1263619004 shutdown_connections 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728eaa0ca0 0x55728ea7b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728eaa1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/1263619004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728ea70810 0x55728ea9f670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1263619004 >> 172.21.15.100:0/1263619004 conn(0x55728e9f85a0 msgr2=0x55728ea74f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1263619004 shutdown_connections 2024-02-21T07:47:34.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.483+0000 7f91a8fcd740 1 -- 172.21.15.100:0/1263619004 wait complete. 2024-02-21T07:47:34.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.485+0000 7f91a8fcd740 1 -- start start 2024-02-21T07:47:34.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.485+0000 7f91a8fcd740 1 Processor -- start 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728eb09a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728eaa0ca0 0x55728eabd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728eb144a0 con 0x55728ea70810 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728eb18970 con 0x55728eaa0ca0 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55728eb146a0 con 0x55728ea70bf0 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f91a8fcd740 10 client.0 _ll_register_callbacks cb 0x55728eaa4600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:34.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f9197e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f9197e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40254/0 (socket says 172.21.15.100:40254) 2024-02-21T07:47:34.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f9197e00640 1 -- 172.21.15.100:0/653468752 learned_addr learned my addr 172.21.15.100:0/653468752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:34.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f919f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728eb09a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.487+0000 7f919fe00640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728eaa0ca0 0x55728eabd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 -- 172.21.15.100:0/653468752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 msgr2=0x55728ea2e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 -- 172.21.15.100:0/653468752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728eaa0ca0 msgr2=0x55728eabd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728eaa0ca0 0x55728eabd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 -- 172.21.15.100:0/653468752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55728e9974e0 con 0x55728ea70810 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f9197e00640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f919f400640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728eb09a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9190020000 tx=0x7f91900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a766769bd2529459 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f918cc00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:34.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190011320 con 0x55728ea70810 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.488+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9190028840 con 0x55728ea70810 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.489+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91880b7810 con 0x55728ea70810 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.489+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9190028a20 con 0x55728ea70810 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.489+0000 7f91a8fcd740 10 client.5343 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.489+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55728e959430 con 0x55728ea70810 2024-02-21T07:47:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.489+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91880b7810 con 0x55728ea70810 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f919003c070 con 0x55728ea70810 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 10 client.5343 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 10 client.5343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 20 client.5343 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eaa1b90 0x55728eb14b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 4 client.5343 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.490+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55728e724890 con 0x55728eaa1b90 2024-02-21T07:47:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f9197e00640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eaa1b90 0x55728eb14b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f9197e00640 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eaa1b90 0x55728eb14b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c3cfa15fdb6726 server_cookie=fa811b95fa738e73 in_seq=0 out_seq=0 2024-02-21T07:47:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f918cc00640 10 client.5343 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f918cc00640 1 -- 172.21.15.100:0/653468752 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55728e724890 con 0x55728eaa1b90 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f918cc00640 10 client.5343 handle_command_reply: tid=0 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.491+0000 7f91a8fcd740 1 client.5343 shutdown 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 msgr2=0x55728eb09a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728eb09a90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9190020000 tx=0x7f91900057f0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 shutdown_connections 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55728eaa1b90 0x55728eb14b80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55728eaa0ca0 0x55728eabd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55728ea70bf0 0x55728ea2e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 --2- 172.21.15.100:0/653468752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55728ea70810 0x55728eb09a90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 >> 172.21.15.100:0/653468752 conn(0x55728e9f85a0 msgr2=0x55728eaa2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f918cc00640 0 client.5343 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 shutdown_connections 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 1 -- 172.21.15.100:0/653468752 wait complete. 2024-02-21T07:47:34.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.492+0000 7f91a8fcd740 20 client.5343 trim_cache size 0 max 16384 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "d207a041-a9e0-4365-9e99-2ff0f7ef6b87": { 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "d207a041-a9e0-4365-9e99-2ff0f7ef6b87", 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:47:34.500 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:47:34.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 msgr2=0x7f917c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 0x7f917c0a1590 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f91a0092b60 tx=0x7f919800b040 comp rx=0 tx=0).stop 2024-02-21T07:47:34.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 msgr2=0x7f91a0151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:34.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f91880046c0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 shutdown_connections 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f917c09f0d0 0x7f917c0a1590 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a0151e50 0x7f91a01522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f91a015daa0 0x7f91a0151780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 --2- 172.21.15.100:0/860406769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91a008c7e0 0x7f91a0151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 >> 172.21.15.100:0/860406769 conn(0x7f91a00fe210 msgr2=0x7f91a00d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 shutdown_connections 2024-02-21T07:47:34.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:47:34.493+0000 7f91a6400640 1 -- 172.21.15.100:0/860406769 wait complete. 2024-02-21T07:47:34.521 INFO:tasks.cephfs.filesystem:scrub status for tag:d207a041-a9e0-4365-9e99-2ff0f7ef6b87 - {'path': '/', 'tag': 'd207a041-a9e0-4365-9e99-2ff0f7ef6b87', 'options': 'recursive,force'} 2024-02-21T07:47:37.923 INFO:tasks.workunit.client.0.smithi100.stderr:Updating files: 76% (8732/11369) Updating files: 77% (8755/11369) Updating files: 78% (8868/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb'. 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-21T07:47:39.424 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:39.425 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at e96e3d6862e qa: switch away cephadm from fs:workload 2024-02-21T07:47:39.434 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-21T07:47:39.491 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-21T07:47:39.497 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T07:47:39.497 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-21T07:47:40.299 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-21T07:47:40.415 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-21T07:47:40.502 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T07:47:40.507 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T07:47:40.507 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-21T07:47:40.587 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T07:47:40.593 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:47:40.593 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-21T07:47:40.645 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-02-21T07:47:40.646 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-02-21T07:47:40.646 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-02-21T07:47:40.711 INFO:tasks.workunit.client.0.smithi100.stdout:getting iogen 2024-02-21T07:47:40.712 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'getting iogen' 2024-02-21T07:47:40.712 INFO:tasks.workunit.client.0.smithi100.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-02-21T07:47:40.752 INFO:tasks.workunit.client.0.smithi100.stderr:--2024-02-21 07:47:40-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-02-21T07:47:40.754 INFO:tasks.workunit.client.0.smithi100.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-02-21T07:47:40.811 INFO:tasks.workunit.client.0.smithi100.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-02-21T07:47:40.868 INFO:tasks.workunit.client.0.smithi100.stderr:HTTP request sent, awaiting response... 200 OK 2024-02-21T07:47:40.868 INFO:tasks.workunit.client.0.smithi100.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-02-21T07:47:40.873 INFO:tasks.workunit.client.0.smithi100.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-02-21T07:47:40.882 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:40.882 INFO:tasks.workunit.client.0.smithi100.stderr: 0K ....... 100% 233M=0s 2024-02-21T07:47:40.882 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:40.883 INFO:tasks.workunit.client.0.smithi100.stderr:2024-02-21 07:47:40 (233 MB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-02-21T07:47:40.883 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-02-21T07:47:40.885 INFO:tasks.workunit.client.0.smithi100.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-02-21T07:47:40.908 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0 2024-02-21T07:47:40.910 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/src 2024-02-21T07:47:40.912 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/src/iogen.8 2024-02-21T07:47:40.915 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/src/iogen.c 2024-02-21T07:47:40.917 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/README 2024-02-21T07:47:40.919 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/Makefile.bsd 2024-02-21T07:47:40.921 INFO:tasks.workunit.client.0.smithi100.stdout:iogen_3.1p0/Makefile 2024-02-21T07:47:40.924 INFO:tasks.workunit.client.0.smithi100.stderr:+ cd iogen_3.1p0 2024-02-21T07:47:40.924 INFO:tasks.workunit.client.0.smithi100.stdout:making iogen 2024-02-21T07:47:40.924 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'making iogen' 2024-02-21T07:47:40.924 INFO:tasks.workunit.client.0.smithi100.stderr:+ make 2024-02-21T07:47:40.940 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-02-21T07:47:41.418 INFO:tasks.workunit.client.0.smithi100.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-02-21T07:47:41.550 INFO:tasks.workunit.client.0.smithi100.stdout:running iogen 2024-02-21T07:47:41.550 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'running iogen' 2024-02-21T07:47:41.550 INFO:tasks.workunit.client.0.smithi100.stderr:+ ./iogen -n 5 -s 2g 2024-02-21T07:47:41.553 INFO:tasks.workunit.client.0.smithi100.stderr:child spawned 49701 2024-02-21T07:47:41.553 INFO:tasks.workunit.client.0.smithi100.stderr:child spawned 49702 2024-02-21T07:47:41.554 INFO:tasks.workunit.client.0.smithi100.stderr:child spawned 49703 2024-02-21T07:47:41.554 INFO:tasks.workunit.client.0.smithi100.stderr:child spawned 49704 2024-02-21T07:47:41.555 INFO:tasks.workunit.client.0.smithi100.stderr:child spawned 49705 2024-02-21T07:47:41.555 INFO:tasks.workunit.client.0.smithi100.stdout:sleep for 10 min 2024-02-21T07:47:41.556 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'sleep for 10 min' 2024-02-21T07:47:41.556 INFO:tasks.workunit.client.0.smithi100.stderr:+ sleep 600 2024-02-21T07:47:42.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:42.591 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:42.594 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.742+0000 7fb3c5200640 1 Processor -- start 2024-02-21T07:47:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.742+0000 7fb3c5200640 1 -- start start 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.750+0000 7fb3c5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3c00d0780 0x7fb3c00d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.750+0000 7fb3c5200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb3c01886c0 0x7fb3c0188ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.750+0000 7fb3c5200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c0187ef0 con 0x7fb3c0182840 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.750+0000 7fb3c5200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00fec50 con 0x7fb3c00d0780 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.750+0000 7fb3c5200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c0182c20 con 0x7fb3c01886c0 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.751+0000 7fb3bf400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb3c0182840 0x7fb3c0186630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:41128/0 (socket says 172.21.15.100:41128) 2024-02-21T07:47:46.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.751+0000 7fb3bf400640 1 -- 172.21.15.100:0/1113287942 learned_addr learned my addr 172.21.15.100:0/1113287942 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:47:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.752+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731952298 0 0) 0x7fb3c0187ef0 con 0x7fb3c0182840 2024-02-21T07:47:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.752+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a4003520 con 0x7fb3c0182840 2024-02-21T07:47:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.752+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1113287942 >> v2:172.21.15.156:3300/0 conn(0x7fb3c01886c0 0x7fb3c0188ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1113287942 >> v2:172.21.15.100:3300/0 conn(0x7fb3c00d0780 0x7fb3c00d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31230396 0 0) 0x7fb3a4003520 con 0x7fb3c0182840 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 >> v2:172.21.15.156:3300/0 conn(0x7fb3c01886c0 msgr2=0x7fb3c0188ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 --2- 172.21.15.100:0/1113287942 >> v2:172.21.15.156:3300/0 conn(0x7fb3c01886c0 0x7fb3c0188ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 >> v2:172.21.15.100:3300/0 conn(0x7fb3c00d0780 msgr2=0x7fb3c00d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 --2- 172.21.15.100:0/1113287942 >> v2:172.21.15.100:3300/0 conn(0x7fb3c00d0780 0x7fb3c00d0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0186d40 con 0x7fb3c0182840 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fb3b0001670 con 0x7fb3c0182840 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 >> v1:172.21.15.156:6789/0 conn(0x7fb3c0182840 legacy=0x7fb3c0186630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a40039c0 0x7fb3a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a40052a0 0x7fb3a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00fec50 con 0x7fb3a40052a0 2024-02-21T07:47:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0182c20 con 0x7fb3a40047c0 2024-02-21T07:47:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.753+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400c1f0 con 0x7fb3a40039c0 2024-02-21T07:47:46.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.754+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a40039c0 0x7fb3a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.754+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.755+0000 7fb3bea00640 1 -- 172.21.15.100:0/1113287942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a40039c0 msgr2=0x7fb3a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.755+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3a40039c0 0x7fb3a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.755+0000 7fb3bea00640 1 -- 172.21.15.100:0/1113287942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a40052a0 msgr2=0x7fb3a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.755+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3a40052a0 0x7fb3a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.755+0000 7fb3bea00640 1 -- 172.21.15.100:0/1113287942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0186d40 con 0x7fb3a40047c0 2024-02-21T07:47:46.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.758+0000 7fb3bfe00640 1 -- 172.21.15.100:0/1113287942 reap_dead start 2024-02-21T07:47:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.760+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3a4004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00ba30 tx=0x7fb3a40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1def493c19dd68c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.764+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac034d50 con 0x7fb3a40047c0 2024-02-21T07:47:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.764+0000 7fb3be000640 1 -- 172.21.15.100:0/1113287942 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac038070 con 0x7fb3a40047c0 2024-02-21T07:47:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.765+0000 7fb3c5200640 1 -- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 msgr2=0x7fb3a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.765+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3a4004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac00ba30 tx=0x7fb3a40057f0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.767+0000 7fb3c5200640 1 -- 172.21.15.100:0/1113287942 shutdown_connections 2024-02-21T07:47:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.767+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1113287942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3a4004c40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.767+0000 7fb3c5200640 1 -- 172.21.15.100:0/1113287942 >> 172.21.15.100:0/1113287942 conn(0x7fb3c00615c0 msgr2=0x7fb3c00619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.767+0000 7fb3c5200640 1 -- 172.21.15.100:0/1113287942 shutdown_connections 2024-02-21T07:47:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.767+0000 7fb3c5200640 1 -- 172.21.15.100:0/1113287942 wait complete. 2024-02-21T07:47:46.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.780+0000 7fb3c5200640 1 Processor -- start 2024-02-21T07:47:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.781+0000 7fb3c5200640 1 -- start start 2024-02-21T07:47:46.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 0x7fb3c00d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c0161800 0x7fb3c0161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00d4410 con 0x7fb3c0161800 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0217f20 con 0x7fb3a40047c0 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.783+0000 7fb3c5200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00d4630 con 0x7fb3c00d3a50 2024-02-21T07:47:46.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.792+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.793+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:51730/0 (socket says 172.21.15.100:51730) 2024-02-21T07:47:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.794+0000 7fb3bf400640 1 -- 172.21.15.100:0/1287512710 learned_addr learned my addr 172.21.15.100:0/1287512710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.797+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c0161800 0x7fb3c0161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.798+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 0x7fb3c00d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bf400640 1 -- 172.21.15.100:0/1287512710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 msgr2=0x7fb3c00d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 0x7fb3c00d3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bf400640 1 -- 172.21.15.100:0/1287512710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c0161800 msgr2=0x7fb3c0161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c0161800 0x7fb3c0161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bf400640 1 -- 172.21.15.100:0/1287512710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00d4910 con 0x7fb3a40047c0 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.802+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 0x7fb3c00d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:47:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.804+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0001200 tx=0x7fb3b00077f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.804+0000 7fb3b7400640 1 -- 172.21.15.100:0/1287512710 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000f9a0 con 0x7fb3a40047c0 2024-02-21T07:47:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.804+0000 7fb3b7400640 1 -- 172.21.15.100:0/1287512710 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b000fb20 con 0x7fb3a40047c0 2024-02-21T07:47:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.804+0000 7fb3b7400640 1 -- 172.21.15.100:0/1287512710 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b000fed0 con 0x7fb3a40047c0 2024-02-21T07:47:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.808+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00d4bf0 con 0x7fb3a40047c0 2024-02-21T07:47:46.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.808+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00d51b0 con 0x7fb3a40047c0 2024-02-21T07:47:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.816+0000 7fb3c9630740 1 Processor -- start 2024-02-21T07:47:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.816+0000 7fb3c9630740 1 -- start start 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x557039173650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x557039178c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557039134620 con 0x5570391791a0 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570390e68c0 con 0x5570391e86e0 2024-02-21T07:47:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.821+0000 7fb3c9630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570390e3df0 con 0x5570391b4280 2024-02-21T07:47:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.822+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x557039173650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.823+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x557039173650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38506/0 (socket says 172.21.15.100:38506) 2024-02-21T07:47:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.823+0000 7fb3bfe00640 1 -- 172.21.15.100:0/3870141717 learned_addr learned my addr 172.21.15.100:0/3870141717 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.823+0000 7fb3bea00640 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.824+0000 7fb3bea00640 1 -- 172.21.15.100:0/3870141717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 msgr2=0x557039173650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.824+0000 7fb3bea00640 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x557039173650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.824+0000 7fb3bea00640 1 -- 172.21.15.100:0/3870141717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 msgr2=0x557039178c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.825+0000 7fb3bea00640 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x557039178c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.825+0000 7fb3bea00640 1 -- 172.21.15.100:0/3870141717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557039060b00 con 0x5570391791a0 2024-02-21T07:47:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.825+0000 7fb3bea00640 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391b4660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32666632f81aab1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.826+0000 7fb3b7400640 1 -- 172.21.15.100:0/1287512710 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb3b001e3b0 con 0x7fb3a40047c0 2024-02-21T07:47:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.828+0000 7fb3abe00640 1 -- 172.21.15.100:0/3870141717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac03e480 con 0x5570391791a0 2024-02-21T07:47:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.828+0000 7fb3abe00640 1 -- 172.21.15.100:0/3870141717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac034b50 con 0x5570391791a0 2024-02-21T07:47:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.828+0000 7fb3abe00640 1 -- 172.21.15.100:0/3870141717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac004020 con 0x5570391791a0 2024-02-21T07:47:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.829+0000 7fb3b7400640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 0x7fb3a00a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.829+0000 7fb3b7400640 1 -- 172.21.15.100:0/1287512710 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb3b00c9790 con 0x7fb3a40047c0 2024-02-21T07:47:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.830+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 0x7fb3a00a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.830+0000 7fb3c9630740 1 -- 172.21.15.100:0/3870141717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 msgr2=0x5570391b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.830+0000 7fb3c9630740 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391b4660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006fd0 tx=0x7fb3ac036000 comp rx=0 tx=0).stop 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 0x7fb3a00a1660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80070b0 tx=0x7fb3b8007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3c9630740 1 -- 172.21.15.100:0/3870141717 shutdown_connections 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3c9630740 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391b4660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3c9630740 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x557039178c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3c9630740 1 --2- 172.21.15.100:0/3870141717 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x557039173650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.835+0000 7fb3c9630740 1 -- 172.21.15.100:0/3870141717 >> 172.21.15.100:0/3870141717 conn(0x5570391404b0 msgr2=0x557039177eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.837+0000 7fb3c9630740 1 -- 172.21.15.100:0/3870141717 shutdown_connections 2024-02-21T07:47:46.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.837+0000 7fb3c9630740 1 -- 172.21.15.100:0/3870141717 wait complete. 2024-02-21T07:47:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.838+0000 7fb3c9630740 1 -- start start 2024-02-21T07:47:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.839+0000 7fb3c9630740 1 Processor -- start 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570390df5d0 con 0x5570391b4280 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557039084b50 con 0x5570391e86e0 2024-02-21T07:47:46.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570390847f0 con 0x5570391791a0 2024-02-21T07:47:46.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.850+0000 7fb3c9630740 10 client.0 _ll_register_callbacks cb 0x557039098550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.853+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.853+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:51734/0 (socket says 172.21.15.100:51734) 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.853+0000 7fb3bfe00640 1 -- 172.21.15.100:0/1508748050 learned_addr learned my addr 172.21.15.100:0/1508748050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.853+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.854+0000 7fb3bfe00640 1 -- 172.21.15.100:0/1508748050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 msgr2=0x5570391adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.854+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.858 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.854+0000 7fb3bfe00640 1 -- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 msgr2=0x5570391ac220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:46.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.856+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.856+0000 7fb3bfe00640 1 -- 172.21.15.100:0/1508748050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c0186d40 con 0x5570391e86e0 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.857+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8017790 tx=0x7fb3b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a509768b0c681ba8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.857+0000 7fb3a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.858+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8018b90 con 0x5570391e86e0 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.858+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570390b1cd0 con 0x5570391e86e0 2024-02-21T07:47:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.858+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb3b8018cf0 con 0x5570391e86e0 2024-02-21T07:47:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.858+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b8023440 con 0x5570391e86e0 2024-02-21T07:47:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.859+0000 7fb3c9630740 10 client.5470 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.859+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5570390ddc50 con 0x5570391e86e0 2024-02-21T07:47:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.859+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570390b1cd0 con 0x5570391e86e0 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.859+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb3b80235a0 con 0x5570391e86e0 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.859+0000 7fb3c9630740 10 client.5470 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.860+0000 7fb3c9630740 10 client.5470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.860+0000 7fb3c9630740 20 client.5470 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.860+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391ac760 0x5570391af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.860+0000 7fb3c9630740 4 client.5470 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.860+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570390d5ce0 con 0x5570391ac760 2024-02-21T07:47:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.861+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391ac760 0x5570391af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.861+0000 7fb3bf400640 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391ac760 0x5570391af9e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ec5b6b2f1a6c6bc server_cookie=1f6dac6034e99749 in_seq=0 out_seq=0 2024-02-21T07:47:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.862+0000 7fb3a8c00640 10 client.5470 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.862+0000 7fb3a8c00640 1 -- 172.21.15.100:0/1508748050 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5570390d5ce0 con 0x5570391ac760 2024-02-21T07:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.862+0000 7fb3a8c00640 10 client.5470 handle_command_reply: tid=0 2024-02-21T07:47:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 client.5470 shutdown 2024-02-21T07:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 msgr2=0x5570391dd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8017790 tx=0x7fb3b8004a40 comp rx=0 tx=0).stop 2024-02-21T07:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 shutdown_connections 2024-02-21T07:47:46.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391ac760 0x5570391af9e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391dd300 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1508748050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 >> 172.21.15.100:0/1508748050 conn(0x5570391404b0 msgr2=0x5570391e8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.863+0000 7fb3a8c00640 0 client.5470 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.864+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 shutdown_connections 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.864+0000 7fb3c9630740 1 -- 172.21.15.100:0/1508748050 wait complete. 2024-02-21T07:47:46.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.864+0000 7fb3c9630740 20 client.5470 trim_cache size 0 max 16384 2024-02-21T07:47:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.893+0000 7fb3c9630740 1 Processor -- start 2024-02-21T07:47:46.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.893+0000 7fb3c9630740 1 -- start start 2024-02-21T07:47:46.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557038e27e60 con 0x5570391b4280 2024-02-21T07:47:46.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570391b4fa0 con 0x5570391e86e0 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3c9630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570391b49e0 con 0x5570391791a0 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42994/0 (socket says 172.21.15.100:42994) 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 -- 172.21.15.100:0/1976044573 learned_addr learned my addr 172.21.15.100:0/1976044573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 -- 172.21.15.100:0/1976044573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 msgr2=0x5570391df0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391df0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 -- 172.21.15.100:0/1976044573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 msgr2=0x5570391e1a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391e1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.895+0000 7fb3bea00640 1 -- 172.21.15.100:0/1976044573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703907a530 con 0x5570391b4280 2024-02-21T07:47:46.902 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.896+0000 7fb3bea00640 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac03e750 tx=0x7fb3ac036070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de0465866d505f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.896+0000 7fb3ab400640 1 -- 172.21.15.100:0/1976044573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac034b50 con 0x5570391b4280 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.896+0000 7fb3ab400640 1 -- 172.21.15.100:0/1976044573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ac034cb0 con 0x5570391b4280 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.896+0000 7fb3ab400640 1 -- 172.21.15.100:0/1976044573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac004240 con 0x5570391b4280 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 -- 172.21.15.100:0/1976044573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 msgr2=0x5570391b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac03e750 tx=0x7fb3ac036070 comp rx=0 tx=0).stop 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 -- 172.21.15.100:0/1976044573 shutdown_connections 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570391e1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391b4280 0x5570391b0260 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 --2- 172.21.15.100:0/1976044573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391791a0 0x5570391df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.897+0000 7fb3c9630740 1 -- 172.21.15.100:0/1976044573 >> 172.21.15.100:0/1976044573 conn(0x5570391404b0 msgr2=0x5570391dd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.898+0000 7fb3c9630740 1 -- 172.21.15.100:0/1976044573 shutdown_connections 2024-02-21T07:47:46.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.898+0000 7fb3c9630740 1 -- 172.21.15.100:0/1976044573 wait complete. 2024-02-21T07:47:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.899+0000 7fb3c9630740 1 -- start start 2024-02-21T07:47:46.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.899+0000 7fb3c9630740 1 Processor -- start 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x5570391f0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570392430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557039247e10 con 0x5570391791a0 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557039243610 con 0x5570391e86e0 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570391d6ad0 con 0x5570391b4280 2024-02-21T07:47:46.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3c9630740 10 client.0 _ll_register_callbacks cb 0x7fb3a40036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:47:46.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.900+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43000/0 (socket says 172.21.15.100:43000) 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 -- 172.21.15.100:0/2070549194 learned_addr learned my addr 172.21.15.100:0/2070549194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bea00640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x5570391f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bfe00640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570392430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 -- 172.21.15.100:0/2070549194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 msgr2=0x5570391f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x5570391f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 -- 172.21.15.100:0/2070549194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 msgr2=0x5570392430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570392430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.901+0000 7fb3bf400640 1 -- 172.21.15.100:0/2070549194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557039060b00 con 0x5570391791a0 2024-02-21T07:47:46.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.902+0000 7fb3bf400640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00c7500 tx=0x7fb3b00936f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45980cd5ec8685d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:47:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.902+0000 7fb3a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:47:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.904+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b009fa70 con 0x5570391791a0 2024-02-21T07:47:46.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.904+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb3b0095680 con 0x5570391791a0 2024-02-21T07:47:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.905+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570391b8ba0 con 0x5570391791a0 2024-02-21T07:47:46.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.905+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b00939f0 con 0x5570391791a0 2024-02-21T07:47:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.906+0000 7fb3c9630740 10 client.5358 fetch_fsmap learned FSMap version 16 2024-02-21T07:47:46.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.906+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5570390a02c0 con 0x5570391791a0 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570391b8ba0 con 0x5570391791a0 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb3b00b7080 con 0x5570391791a0 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 10 client.5358 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 10 client.5358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 20 client.5358 populate_metadata read hostname 'smithi100' 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391e9860 0x5570391744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 4 client.5358 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:47:46.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557039104d30 con 0x5570391e9860 2024-02-21T07:47:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.908+0000 7fb3bea00640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391e9860 0x5570391744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:47:46.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.909+0000 7fb3a8c00640 10 client.5358 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:46.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.915+0000 7fb3bea00640 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391e9860 0x5570391744e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cae261d67da8949 server_cookie=84dea4bad6a9613e in_seq=0 out_seq=0 2024-02-21T07:47:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.945+0000 7fb3a8c00640 1 -- 172.21.15.100:0/2070549194 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557039104d30 con 0x5570391e9860 2024-02-21T07:47:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.945+0000 7fb3a8c00640 10 client.5358 handle_command_reply: tid=0 2024-02-21T07:47:46.951 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 client.5358 shutdown 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 msgr2=0x5570391e1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00c7500 tx=0x7fb3b00936f0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 shutdown_connections 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5570391e9860 0x5570391744e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5570391e86e0 0x5570392430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570391b4280 0x5570391f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 --2- 172.21.15.100:0/2070549194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5570391791a0 0x5570391e1f60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 >> 172.21.15.100:0/2070549194 conn(0x5570391404b0 msgr2=0x5570391ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.946+0000 7fb3a8c00640 0 client.5358 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.947+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 shutdown_connections 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.947+0000 7fb3c9630740 1 -- 172.21.15.100:0/2070549194 wait complete. 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:47:46.953 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.947+0000 7fb3c9630740 20 client.5358 trim_cache size 0 max 16384 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 msgr2=0x7fb3a00a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 0x7fb3a00a1660 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80070b0 tx=0x7fb3b8007040 comp rx=0 tx=0).stop 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 msgr2=0x7fb3c021a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0001200 tx=0x7fb3b00077f0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 shutdown_connections 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb3a009f1a0 0x7fb3a00a1660 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3c0161800 0x7fb3c0161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3c00d3a50 0x7fb3c00d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 --2- 172.21.15.100:0/1287512710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb3a40047c0 0x7fb3c021a820 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 >> 172.21.15.100:0/1287512710 conn(0x7fb3c00615c0 msgr2=0x7fb3c0186530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:47:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 shutdown_connections 2024-02-21T07:47:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:47:46.948+0000 7fb3c5200640 1 -- 172.21.15.100:0/1287512710 wait complete. 2024-02-21T07:48:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.152+0000 7f1cba400640 1 Processor -- start 2024-02-21T07:48:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.153+0000 7f1cba400640 1 -- start start 2024-02-21T07:48:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cba400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1cb4183b10 0x7f1cb41859a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cba400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1cb41869d0 0x7f1cb4186de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cba400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb4184620 con 0x7f1cb4183ef0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cba400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb40f4660 con 0x7f1cb41869d0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cba400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb4184900 con 0x7f1cb4183b10 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1caaa00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1cb4183ef0 0x7f1cb4185ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48400/0 (socket says 172.21.15.100:48400) 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1caaa00640 1 -- 172.21.15.100:0/1775294440 learned_addr learned my addr 172.21.15.100:0/1775294440 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.154+0000 7f1cb3400640 1 --2- 172.21.15.100:0/1775294440 >> v2:172.21.15.170:3300/0 conn(0x7f1cb4183b10 0x7f1cb41859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/1775294440 >> v2:172.21.15.100:3300/0 conn(0x7f1cb41869d0 0x7f1cb4186de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb2a00640 1 -- 172.21.15.100:0/1775294440 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773254095 0 0) 0x7f1cb4184620 con 0x7f1cb4183ef0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb2a00640 1 -- 172.21.15.100:0/1775294440 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c98003520 con 0x7f1cb4183ef0 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb3400640 1 -- 172.21.15.100:0/1775294440 >> v2:172.21.15.100:3300/0 conn(0x7f1cb41869d0 msgr2=0x7f1cb4186de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb3400640 1 --2- 172.21.15.100:0/1775294440 >> v2:172.21.15.100:3300/0 conn(0x7f1cb41869d0 0x7f1cb4186de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb3400640 1 -- 172.21.15.100:0/1775294440 >> v1:172.21.15.156:6789/0 conn(0x7f1cb4183ef0 legacy=0x7f1cb4185ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.155+0000 7f1cb3400640 1 -- 172.21.15.100:0/1775294440 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb4184be0 con 0x7f1cb4183b10 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.156+0000 7f1cb3400640 1 --2- 172.21.15.100:0/1775294440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183b10 0x7f1cb41859a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cb408e040 tx=0x7f1ca402b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2bbbd943c4a8ef4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.156+0000 7f1cb2a00640 1 -- 172.21.15.100:0/1775294440 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4031520 con 0x7f1cb4183b10 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cb2a00640 1 -- 172.21.15.100:0/1775294440 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4031680 con 0x7f1cb4183b10 2024-02-21T07:48:00.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cb2a00640 1 -- 172.21.15.100:0/1775294440 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4031a10 con 0x7f1cb4183b10 2024-02-21T07:48:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 -- 172.21.15.100:0/1775294440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183b10 msgr2=0x7f1cb41859a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 --2- 172.21.15.100:0/1775294440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183b10 0x7f1cb41859a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cb408e040 tx=0x7f1ca402b7c0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 -- 172.21.15.100:0/1775294440 shutdown_connections 2024-02-21T07:48:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 --2- 172.21.15.100:0/1775294440 >> v2:172.21.15.100:3300/0 conn(0x7f1cb41869d0 0x7f1cb4186de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 --2- 172.21.15.100:0/1775294440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183b10 0x7f1cb41859a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.157+0000 7f1cba400640 1 -- 172.21.15.100:0/1775294440 >> 172.21.15.100:0/1775294440 conn(0x7f1cb40ce1b0 msgr2=0x7f1cb40ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.158+0000 7f1cba400640 1 -- 172.21.15.100:0/1775294440 shutdown_connections 2024-02-21T07:48:00.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.158+0000 7f1cba400640 1 -- 172.21.15.100:0/1775294440 wait complete. 2024-02-21T07:48:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.160+0000 7f1cba400640 1 Processor -- start 2024-02-21T07:48:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.160+0000 7f1cba400640 1 -- start start 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183ef0 0x7f1cb40f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 0x7f1cb40f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40cd2f0 con 0x7f1cb4183b10 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40cd5d0 con 0x7f1cb41869d0 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cba400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb40cd8b0 con 0x7f1cb4183ef0 2024-02-21T07:48:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46504/0 (socket says 172.21.15.100:46504) 2024-02-21T07:48:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cb3400640 1 -- 172.21.15.100:0/4151607052 learned_addr learned my addr 172.21.15.100:0/4151607052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 0x7f1cb40f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.161+0000 7f1caaa00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183ef0 0x7f1cb40f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 -- 172.21.15.100:0/4151607052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183ef0 msgr2=0x7f1cb40f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183ef0 0x7f1cb40f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 -- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 msgr2=0x7f1cb40f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 0x7f1cb40f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 -- 172.21.15.100:0/4151607052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4009400 con 0x7f1cb4183b10 2024-02-21T07:48:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 0x7f1cb40f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.162+0000 7f1cb3400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4000c00 tx=0x7f1ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.163+0000 7f1cabe00640 1 -- 172.21.15.100:0/4151607052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4031520 con 0x7f1cb4183b10 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.163+0000 7f1cabe00640 1 -- 172.21.15.100:0/4151607052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4033c50 con 0x7f1cb4183b10 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.163+0000 7f1cabe00640 1 -- 172.21.15.100:0/4151607052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca4031ec0 con 0x7f1cb4183b10 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.164+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb40cdb90 con 0x7f1cb4183b10 2024-02-21T07:48:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.164+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb40c95f0 con 0x7f1cb4183b10 2024-02-21T07:48:00.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.173+0000 7f1cabe00640 1 -- 172.21.15.100:0/4151607052 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1ca403a040 con 0x7f1cb4183b10 2024-02-21T07:48:00.185 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.178+0000 7f1cbd1d6740 1 Processor -- start 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.180+0000 7f1cbd1d6740 1 -- start start 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e04c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7e0a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 0x5628d7e45c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7dbd620 con 0x5628d7e79ce0 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7d6f8c0 con 0x5628d7e0a7a0 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.182+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7d6cdf0 con 0x5628d7e45880 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.183+0000 7f1cabe00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 0x7f1c900a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.185+0000 7f1cabe00640 1 -- 172.21.15.100:0/4151607052 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1ca40eb460 con 0x7f1cb4183b10 2024-02-21T07:48:00.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.194+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7e0a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.196+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7e0a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46512/0 (socket says 172.21.15.100:46512) 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.196+0000 7f1cb3400640 1 -- 172.21.15.100:0/286768994 learned_addr learned my addr 172.21.15.100:0/286768994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.196+0000 7f1caaa00640 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 0x5628d7e45c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.196+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e04c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.196+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 0x7f1c900a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.197+0000 7f1caaa00640 1 -- 172.21.15.100:0/286768994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 msgr2=0x5628d7e04c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.197+0000 7f1caaa00640 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e04c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.197+0000 7f1caaa00640 1 -- 172.21.15.100:0/286768994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 msgr2=0x5628d7e0a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.197+0000 7f1caaa00640 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7e0a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.197+0000 7f1caaa00640 1 -- 172.21.15.100:0/286768994 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628d7ce9b00 con 0x5628d7e0a7a0 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.198+0000 7f1caaa00640 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 0x5628d7e45c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005880 tx=0x7f1c9c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5107d3326d573dd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.198+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 0x7f1c900a16b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007c40 tx=0x7f1cac009a50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.198+0000 7f1ca3e00640 1 -- 172.21.15.100:0/286768994 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0058b0 con 0x5628d7e0a7a0 2024-02-21T07:48:00.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.198+0000 7f1ca3e00640 1 -- 172.21.15.100:0/286768994 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c005a30 con 0x5628d7e0a7a0 2024-02-21T07:48:00.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.198+0000 7f1ca3e00640 1 -- 172.21.15.100:0/286768994 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c005de0 con 0x5628d7e0a7a0 2024-02-21T07:48:00.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.199+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/286768994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 msgr2=0x5628d7e45c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.199+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 0x5628d7e45c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005880 tx=0x7f1c9c000bc0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.206+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/286768994 shutdown_connections 2024-02-21T07:48:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.206+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e0a7a0 0x5628d7e45c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.206+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7e0a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.206+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/286768994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e04c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.206+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/286768994 >> 172.21.15.100:0/286768994 conn(0x5628d7dc94b0 msgr2=0x5628d7e094b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.212+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/286768994 shutdown_connections 2024-02-21T07:48:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.212+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/286768994 wait complete. 2024-02-21T07:48:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.213+0000 7f1cbd1d6740 1 -- start start 2024-02-21T07:48:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.214+0000 7f1cbd1d6740 1 Processor -- start 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.220+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7e6c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e79ce0 0x5628d7e66090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7d685d0 con 0x5628d7e0a7a0 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7d0db50 con 0x5628d7e45880 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7d0d7f0 con 0x5628d7e79ce0 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cbd1d6740 10 client.0 _ll_register_callbacks cb 0x5628d7d21550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7e6c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1caaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1caaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33498/0 (socket says 172.21.15.100:33498) 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1caaa00640 1 -- 172.21.15.100:0/3426750201 learned_addr learned my addr 172.21.15.100:0/3426750201 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.221+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e79ce0 0x5628d7e66090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.223+0000 7f1caaa00640 1 -- 172.21.15.100:0/3426750201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e79ce0 msgr2=0x5628d7e66090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.223+0000 7f1caaa00640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e79ce0 0x5628d7e66090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.223+0000 7f1caaa00640 1 -- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 msgr2=0x5628d7e6c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.223+0000 7f1caaa00640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7e6c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.223+0000 7f1caaa00640 1 -- 172.21.15.100:0/3426750201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c00f040 con 0x5628d7e45880 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.224+0000 7f1caaa00640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c013000 tx=0x7f1c9c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3af0c313bd6c5f8a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.224+0000 7f1ca0c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.224+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0047e0 con 0x5628d7e45880 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.224+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1c9c004940 con 0x5628d7e45880 2024-02-21T07:48:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.225+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628d7d3acd0 con 0x5628d7e45880 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.225+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c9c004b00 con 0x5628d7e45880 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.225+0000 7f1cbd1d6740 10 client.5482 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.225+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5628d7d66c50 con 0x5628d7e45880 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.225+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628d7d3acd0 con 0x5628d7e45880 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.226+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1c9c01b070 con 0x5628d7e45880 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.226+0000 7f1cbd1d6740 10 client.5482 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.226+0000 7f1cbd1d6740 10 client.5482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.226+0000 7f1cbd1d6740 20 client.5482 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.227+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e48ce0 0x5628d7e490f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.227+0000 7f1cbd1d6740 4 client.5482 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.227+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628d7d5ece0 con 0x5628d7e48ce0 2024-02-21T07:48:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.227+0000 7f1cb3400640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e48ce0 0x5628d7e490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.228+0000 7f1ca0c00640 10 client.5482 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.229+0000 7f1cb3400640 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e48ce0 0x5628d7e490f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=972b57dee083bc4 server_cookie=dfa0f2528089b939 in_seq=0 out_seq=0 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.230+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3426750201 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628d7d5ece0 con 0x5628d7e48ce0 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.230+0000 7f1ca0c00640 10 client.5482 handle_command_reply: tid=0 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.230+0000 7f1cbd1d6740 1 client.5482 shutdown 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 msgr2=0x5628d7e6f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c013000 tx=0x7f1c9c000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 shutdown_connections 2024-02-21T07:48:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e48ce0 0x5628d7e490f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e79ce0 0x5628d7e66090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1ca0c00640 0 client.5482 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e45880 0x5628d7e6f180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3426750201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7e6c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 >> 172.21.15.100:0/3426750201 conn(0x5628d7dc94b0 msgr2=0x5628d7e7a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 shutdown_connections 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.232+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3426750201 wait complete. 2024-02-21T07:48:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.233+0000 7f1cbd1d6740 20 client.5482 trim_cache size 0 max 16384 2024-02-21T07:48:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.265+0000 7f1cbd1d6740 1 Processor -- start 2024-02-21T07:48:00.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.265+0000 7f1cbd1d6740 1 -- start start 2024-02-21T07:48:00.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.268+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7dfbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.268+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e4b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.269+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.269+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7ab0e60 con 0x5628d7e0a7a0 2024-02-21T07:48:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.269+0000 7f1cb3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.269+0000 7f1cb3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33510/0 (socket says 172.21.15.100:33510) 2024-02-21T07:48:00.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.269+0000 7f1cb3e00640 1 -- 172.21.15.100:0/327376699 learned_addr learned my addr 172.21.15.100:0/327376699 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.270+0000 7f1caaa00640 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e4b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.270+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7e6f8b0 con 0x5628d7e48ce0 2024-02-21T07:48:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.270+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7e29830 con 0x5628d7e45880 2024-02-21T07:48:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1cb3e00640 1 -- 172.21.15.100:0/327376699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 msgr2=0x5628d7e4b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e4b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1cb3e00640 1 -- 172.21.15.100:0/327376699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 msgr2=0x5628d7dfbc40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7dfbc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1cb3e00640 1 -- 172.21.15.100:0/327376699 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628d7d03530 con 0x5628d7e48ce0 2024-02-21T07:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.271+0000 7f1caaa00640 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e4b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.272+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0070e0 tx=0x7f1cac01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f1dd8a904b471e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.273+0000 7f1ca3400640 1 -- 172.21.15.100:0/327376699 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac007670 con 0x5628d7e48ce0 2024-02-21T07:48:00.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.273+0000 7f1ca3400640 1 -- 172.21.15.100:0/327376699 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac01ba00 con 0x5628d7e48ce0 2024-02-21T07:48:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.273+0000 7f1ca3400640 1 -- 172.21.15.100:0/327376699 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac01bd70 con 0x5628d7e48ce0 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 msgr2=0x5628d7ed5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1cac0070e0 tx=0x7f1cac01c000 comp rx=0 tx=0).stop 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 shutdown_connections 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed5d50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7e4b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/327376699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e0a7a0 0x5628d7dfbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.274+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 >> 172.21.15.100:0/327376699 conn(0x5628d7dc94b0 msgr2=0x5628d7e6c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.275+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 shutdown_connections 2024-02-21T07:48:00.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.275+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/327376699 wait complete. 2024-02-21T07:48:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.276+0000 7f1cbd1d6740 1 -- start start 2024-02-21T07:48:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.276+0000 7f1cbd1d6740 1 Processor -- start 2024-02-21T07:48:00.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.278+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.278+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.278+0000 7f1cbd1d6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.278+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cb3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47976/0 (socket says 172.21.15.100:47976) 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46538/0 (socket says 172.21.15.100:46538) 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7edcaf0 con 0x5628d7e79ce0 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7ed4fd0 con 0x5628d7e48ce0 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cbd1d6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628d7e49a20 con 0x5628d7e45880 2024-02-21T07:48:00.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cbd1d6740 10 client.0 _ll_register_callbacks cb 0x7f1c9c007d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cb3400640 1 -- 172.21.15.100:0/3373671462 learned_addr learned my addr 172.21.15.100:0/3373671462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.279+0000 7f1cb3e00640 1 -- 172.21.15.100:0/3373671462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 msgr2=0x5628d7edbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3e00640 1 -- 172.21.15.100:0/3373671462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 msgr2=0x5628d7ed4550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed4550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3400640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3e00640 1 -- 172.21.15.100:0/3373671462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c007e70 con 0x5628d7e79ce0 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1cb3e00640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cac018b60 tx=0x7f1cac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac5e8a4c3447b78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:00.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.280+0000 7f1ca0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.281+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0264f0 con 0x5628d7e79ce0 2024-02-21T07:48:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.281+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1cac026650 con 0x5628d7e79ce0 2024-02-21T07:48:00.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.281+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628d7d8dd30 con 0x5628d7e79ce0 2024-02-21T07:48:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.282+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cac026810 con 0x5628d7e79ce0 2024-02-21T07:48:00.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.282+0000 7f1cbd1d6740 10 client.5373 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.282+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f1cac020040 con 0x5628d7e79ce0 2024-02-21T07:48:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.283+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628d7d8dd30 con 0x5628d7e79ce0 2024-02-21T07:48:00.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.283+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1cac026970 con 0x5628d7e79ce0 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.283+0000 7f1cbd1d6740 10 client.5373 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.284+0000 7f1cbd1d6740 10 client.5373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.284+0000 7f1cbd1d6740 20 client.5373 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.284+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e6edc0 0x5628d7edf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.284+0000 7f1cbd1d6740 4 client.5373 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:48:00.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.284+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5628d7a68600 con 0x5628d7e6edc0 2024-02-21T07:48:00.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.285+0000 7f1cb3400640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e6edc0 0x5628d7edf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.286+0000 7f1cb3400640 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e6edc0 0x5628d7edf330 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bded1ab73b63c7 server_cookie=e7c651fcfb4bea03 in_seq=0 out_seq=0 2024-02-21T07:48:00.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.286+0000 7f1ca0c00640 10 client.5373 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.379+0000 7f1ca0c00640 1 -- 172.21.15.100:0/3373671462 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5628d7a68600 con 0x5628d7e6edc0 2024-02-21T07:48:00.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.379+0000 7f1ca0c00640 10 client.5373 handle_command_reply: tid=0 2024-02-21T07:48:00.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.379+0000 7f1cbd1d6740 1 client.5373 shutdown 2024-02-21T07:48:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.382+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 msgr2=0x5628d7ed4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.382+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1cac018b60 tx=0x7f1cac009750 comp rx=0 tx=0).stop 2024-02-21T07:48:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 shutdown_connections 2024-02-21T07:48:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5628d7e6edc0 0x5628d7edf330 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628d7e79ce0 0x5628d7ed4a90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628d7e48ce0 0x5628d7ed4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 --2- 172.21.15.100:0/3373671462 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628d7e45880 0x5628d7edbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.384+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 >> 172.21.15.100:0/3373671462 conn(0x5628d7dc94b0 msgr2=0x5628d7dfbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.385+0000 7f1ca0c00640 0 client.5373 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.386+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 shutdown_connections 2024-02-21T07:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.386+0000 7f1cbd1d6740 1 -- 172.21.15.100:0/3373671462 wait complete. 2024-02-21T07:48:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.387+0000 7f1cbd1d6740 20 client.5373 trim_cache size 0 max 16384 2024-02-21T07:48:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:48:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:48:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:48:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:48:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 msgr2=0x7f1c900a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 0x7f1c900a16b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007c40 tx=0x7f1cac009a50 comp rx=0 tx=0).stop 2024-02-21T07:48:00.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 msgr2=0x7f1cb416c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4000c00 tx=0x7f1ca40046c0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 shutdown_connections 2024-02-21T07:48:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1cb41869d0 0x7f1cb40f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1cb4183ef0 0x7f1cb40f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c9009f1f0 0x7f1c900a16b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 --2- 172.21.15.100:0/4151607052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb4183b10 0x7f1cb416c890 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4000c00 tx=0x7f1ca40046c0 comp rx=0 tx=0).stop 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.391+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 >> 172.21.15.100:0/4151607052 conn(0x7f1cb40ce1b0 msgr2=0x7f1cb40d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.392+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 shutdown_connections 2024-02-21T07:48:00.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:00.392+0000 7f1cba400640 1 -- 172.21.15.100:0/4151607052 wait complete. 2024-02-21T07:48:04.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:48:04.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:48:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.921+0000 7f4e02600640 1 Processor -- start 2024-02-21T07:48:04.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.921+0000 7f4e02600640 1 -- start start 2024-02-21T07:48:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.923+0000 7f4e02600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4dfc0fa0c0 0x7f4dfc188e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.924+0000 7f4dfaa00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4dfc06ab60 0x7f4dfc0f99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48416/0 (socket says 172.21.15.100:48416) 2024-02-21T07:48:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.925+0000 7f4dfb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4dfc188ab0 0x7f4dfc08cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40248/0 (socket says 172.21.15.100:40248) 2024-02-21T07:48:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.925+0000 7f4dfb400640 1 -- 172.21.15.100:0/4160198872 learned_addr learned my addr 172.21.15.100:0/4160198872 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:04.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.925+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc08bfe0 con 0x7f4dfc188ab0 2024-02-21T07:48:04.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.925+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/4160198872 >> v2:172.21.15.156:3300/0 conn(0x7f4dfc0fa0c0 0x7f4dfc188e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc08c880 con 0x7f4dfc06ab60 2024-02-21T07:48:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc08d420 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4dfa000640 1 -- 172.21.15.100:0/4160198872 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886335504 0 0) 0x7f4dfc08c880 con 0x7f4dfc06ab60 2024-02-21T07:48:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4dfa000640 1 -- 172.21.15.100:0/4160198872 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de0003520 con 0x7f4dfc06ab60 2024-02-21T07:48:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4dfbe00640 1 -- 172.21.15.100:0/4160198872 >> v1:172.21.15.156:6789/0 conn(0x7f4dfc06ab60 legacy=0x7f4dfc0f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:04.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.928+0000 7f4dfbe00640 1 -- 172.21.15.100:0/4160198872 >> v1:172.21.15.100:6789/0 conn(0x7f4dfc188ab0 legacy=0x7f4dfc08cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:04.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.929+0000 7f4dfbe00640 1 -- 172.21.15.100:0/4160198872 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0fa660 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.937+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/4160198872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc188e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009d90 tx=0x7f4df402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f296e595572660c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.938+0000 7f4dfa000640 1 -- 172.21.15.100:0/4160198872 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df402cc60 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.938+0000 7f4dfa000640 1 -- 172.21.15.100:0/4160198872 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df402cdc0 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.938+0000 7f4dfa000640 1 -- 172.21.15.100:0/4160198872 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4034660 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.939+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc0fa0c0 msgr2=0x7f4dfc188e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:04.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.939+0000 7f4e02600640 1 --2- 172.21.15.100:0/4160198872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc188e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009d90 tx=0x7f4df402beb0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.941+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 shutdown_connections 2024-02-21T07:48:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.941+0000 7f4e02600640 1 --2- 172.21.15.100:0/4160198872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc188e90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.941+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 >> 172.21.15.100:0/4160198872 conn(0x7f4dfc0fe290 msgr2=0x7f4dfc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.942+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 shutdown_connections 2024-02-21T07:48:04.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.942+0000 7f4e02600640 1 -- 172.21.15.100:0/4160198872 wait complete. 2024-02-21T07:48:04.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.946+0000 7f4e02600640 1 Processor -- start 2024-02-21T07:48:04.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.946+0000 7f4e02600640 1 -- start start 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc0fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc188ab0 0x7f4dfc176b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0d2690 con 0x7f4dfc06ab60 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc176730 con 0x7f4dfc188ab0 2024-02-21T07:48:04.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4e02600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0d20d0 con 0x7f4dfc0fa0c0 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4dfb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4dfb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46542/0 (socket says 172.21.15.100:46542) 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4dfb400640 1 -- 172.21.15.100:0/1731210770 learned_addr learned my addr 172.21.15.100:0/1731210770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc0fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.950+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc188ab0 0x7f4dfc176b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 -- 172.21.15.100:0/1731210770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dfc0fa0c0 msgr2=0x7f4dfc0fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc0fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 -- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc188ab0 msgr2=0x7f4dfc176b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:04.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc188ab0 0x7f4dfc176b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 -- 172.21.15.100:0/1731210770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009a70 con 0x7f4dfc06ab60 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c3c0 tx=0x7f4de800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4df3400640 1 -- 172.21.15.100:0/1731210770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de8005ce0 con 0x7f4dfc06ab60 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.951+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc0d23b0 con 0x7f4dfc06ab60 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.952+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc176350 con 0x7f4dfc06ab60 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.952+0000 7f4df3400640 1 -- 172.21.15.100:0/1731210770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de8005e40 con 0x7f4dfc06ab60 2024-02-21T07:48:04.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.952+0000 7f4df3400640 1 -- 172.21.15.100:0/1731210770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de80072d0 con 0x7f4dfc06ab60 2024-02-21T07:48:04.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.956+0000 7f4e0538b740 1 Processor -- start 2024-02-21T07:48:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.956+0000 7f4e0538b740 1 -- start start 2024-02-21T07:48:04.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.956+0000 7f4df3400640 1 -- 172.21.15.100:0/1731210770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4de80074f0 con 0x7f4dfc06ab60 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae3233a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae3238e0 0x564eae2e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae25a150 con 0x564eae3238e0 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae257680 con 0x564eae322fc0 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4e0538b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae252e60 con 0x564eae358f80 2024-02-21T07:48:04.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4dfb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae3233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33536/0 (socket says 172.21.15.100:33536) 2024-02-21T07:48:04.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.957+0000 7f4dfbe00640 1 -- 172.21.15.100:0/1771048150 learned_addr learned my addr 172.21.15.100:0/1771048150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:04.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 -- 172.21.15.100:0/1771048150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 msgr2=0x564eae3233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:04.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae3233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 -- 172.21.15.100:0/1771048150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae3238e0 msgr2=0x564eae2e5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae3238e0 0x564eae2e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 -- 172.21.15.100:0/1771048150 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eae20c060 con 0x564eae322fc0 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae3233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4df402c4c0 tx=0x7f4df402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df5663a7c4145db server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4de7e00640 1 -- 172.21.15.100:0/1771048150 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4034640 con 0x564eae322fc0 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4de7e00640 1 -- 172.21.15.100:0/1771048150 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df40347c0 con 0x564eae322fc0 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.958+0000 7f4de7e00640 1 -- 172.21.15.100:0/1771048150 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4034b70 con 0x564eae322fc0 2024-02-21T07:48:04.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4df3400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 0x7f4ddc0a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 0x7f4ddc0a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 -- 172.21.15.100:0/1771048150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 msgr2=0x564eae358a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4df402c4c0 tx=0x7f4df402e000 comp rx=0 tx=0).stop 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 -- 172.21.15.100:0/1771048150 shutdown_connections 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae3238e0 0x564eae2e5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae3233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 --2- 172.21.15.100:0/1771048150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae322fc0 0x564eae358a40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 -- 172.21.15.100:0/1771048150 >> 172.21.15.100:0/1771048150 conn(0x564eae2b25a0 msgr2=0x564eae2e9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.959+0000 7f4e0538b740 1 -- 172.21.15.100:0/1771048150 shutdown_connections 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.960+0000 7f4e0538b740 1 -- 172.21.15.100:0/1771048150 wait complete. 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.960+0000 7f4df3400640 1 -- 172.21.15.100:0/1731210770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4de80c9140 con 0x7f4dfc06ab60 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.960+0000 7f4dfb400640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 0x7f4ddc0a15c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4de8096920 tx=0x7f4de80ccac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:04.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.960+0000 7f4e0538b740 1 -- start start 2024-02-21T07:48:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.962+0000 7f4e0538b740 1 Processor -- start 2024-02-21T07:48:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae36b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae36a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae1f7ec0 con 0x564eae322fc0 2024-02-21T07:48:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae1f7b60 con 0x564eae3238e0 2024-02-21T07:48:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eadfc11c0 con 0x564eae358f80 2024-02-21T07:48:04.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.964+0000 7f4e0538b740 10 client.0 _ll_register_callbacks cb 0x564eae20b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33544/0 (socket says 172.21.15.100:33544) 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 -- 172.21.15.100:0/388261505 learned_addr learned my addr 172.21.15.100:0/388261505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 -- 172.21.15.100:0/388261505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 msgr2=0x564eae36a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae36a6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.965+0000 7f4dfaa00640 1 -- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 msgr2=0x564eae36b1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.966+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae36b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.966+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae36b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.966+0000 7f4dfaa00640 1 -- 172.21.15.100:0/388261505 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc0fa660 con 0x564eae3238e0 2024-02-21T07:48:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.966+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae36b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.966+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005be0 tx=0x7f4dec0016a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed34bb1f8d02fb0e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.967+0000 7f4de4c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.967+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0112e0 con 0x564eae3238e0 2024-02-21T07:48:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.967+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4dec011440 con 0x564eae3238e0 2024-02-21T07:48:04.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.967+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eadf527e0 con 0x564eae3238e0 2024-02-21T07:48:04.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.968+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dec011600 con 0x564eae3238e0 2024-02-21T07:48:04.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.968+0000 7f4e0538b740 10 client.5500 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:04.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.968+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564eae2514e0 con 0x564eae3238e0 2024-02-21T07:48:04.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.968+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec021020 con 0x564eae3238e0 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4dec011760 con 0x564eae3238e0 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 10 client.5500 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 10 client.5500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 20 client.5500 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae2e4a60 0x564eae2e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 4 client.5500 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:04.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:04.991+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eadf8f720 con 0x564eae2e4a60 2024-02-21T07:48:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.008+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae2e4a60 0x564eae2e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.017+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae2e4a60 0x564eae2e4e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a7c715195f63559 server_cookie=f4b508af5fcba85 in_seq=0 out_seq=0 2024-02-21T07:48:05.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.020+0000 7f4de4c00640 10 client.5500 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:05.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.020+0000 7f4de4c00640 1 -- 172.21.15.100:0/388261505 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564eadf8f720 con 0x564eae2e4a60 2024-02-21T07:48:05.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.024+0000 7f4de4c00640 10 client.5500 handle_command_reply: tid=0 2024-02-21T07:48:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.027+0000 7f4e0538b740 1 client.5500 shutdown 2024-02-21T07:48:05.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.029+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 msgr2=0x564eae36bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.029+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4dec005be0 tx=0x7f4dec0016a0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 shutdown_connections 2024-02-21T07:48:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae2e4a60 0x564eae2e4e70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae358f80 0x564eae36a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae36bb40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 --2- 172.21.15.100:0/388261505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae36b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.040+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 >> 172.21.15.100:0/388261505 conn(0x564eae2b25a0 msgr2=0x564eae2ea8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.041+0000 7f4de4c00640 0 client.5500 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.042+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 shutdown_connections 2024-02-21T07:48:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.045+0000 7f4e0538b740 1 -- 172.21.15.100:0/388261505 wait complete. 2024-02-21T07:48:05.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.045+0000 7f4e0538b740 20 client.5500 trim_cache size 0 max 16384 2024-02-21T07:48:05.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.080+0000 7f4e0538b740 1 Processor -- start 2024-02-21T07:48:05.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.081+0000 7f4e0538b740 1 -- start start 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae322fc0 0x564eae2e0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae2e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae372e60 con 0x564eae358f80 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae3729d0 con 0x564eae3238e0 2024-02-21T07:48:05.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.083+0000 7f4e0538b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae2e4e40 con 0x564eae322fc0 2024-02-21T07:48:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.084+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.084+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46576/0 (socket says 172.21.15.100:46576) 2024-02-21T07:48:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.084+0000 7f4dfbe00640 1 -- 172.21.15.100:0/2202030345 learned_addr learned my addr 172.21.15.100:0/2202030345 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.084+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae322fc0 0x564eae2e0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.085+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae2e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.085+0000 7f4dfbe00640 1 -- 172.21.15.100:0/2202030345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae322fc0 msgr2=0x564eae2e0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.085+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae322fc0 0x564eae2e0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.085+0000 7f4dfbe00640 1 -- 172.21.15.100:0/2202030345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 msgr2=0x564eae2e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.086+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae2e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.086+0000 7f4dfbe00640 1 -- 172.21.15.100:0/2202030345 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eae1ed950 con 0x564eae358f80 2024-02-21T07:48:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.086+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae2e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:05.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.086+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009d90 tx=0x7f4df4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47624057e97effa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.087+0000 7f4de7400640 1 -- 172.21.15.100:0/2202030345 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4050070 con 0x564eae358f80 2024-02-21T07:48:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.088+0000 7f4de7400640 1 -- 172.21.15.100:0/2202030345 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4050d00 con 0x564eae358f80 2024-02-21T07:48:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.088+0000 7f4de7400640 1 -- 172.21.15.100:0/2202030345 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4003b90 con 0x564eae358f80 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.089+0000 7f4e0538b740 1 -- 172.21.15.100:0/2202030345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 msgr2=0x564eae36b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.089+0000 7f4e0538b740 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009d90 tx=0x7f4df4031000 comp rx=0 tx=0).stop 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.094+0000 7f4e0538b740 1 -- 172.21.15.100:0/2202030345 shutdown_connections 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.094+0000 7f4e0538b740 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae358f80 0x564eae36b830 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.094+0000 7f4e0538b740 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae3238e0 0x564eae2e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.094+0000 7f4e0538b740 1 --2- 172.21.15.100:0/2202030345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae322fc0 0x564eae2e0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.094+0000 7f4e0538b740 1 -- 172.21.15.100:0/2202030345 >> 172.21.15.100:0/2202030345 conn(0x564eae2b25a0 msgr2=0x564eae31c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.095+0000 7f4e0538b740 1 -- 172.21.15.100:0/2202030345 shutdown_connections 2024-02-21T07:48:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.095+0000 7f4e0538b740 1 -- 172.21.15.100:0/2202030345 wait complete. 2024-02-21T07:48:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.096+0000 7f4e0538b740 1 -- start start 2024-02-21T07:48:05.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.097+0000 7f4e0538b740 1 Processor -- start 2024-02-21T07:48:05.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.099+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.100+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 0x564eae36b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.100+0000 7f4e0538b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae358f80 0x564eae3b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.100+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4dfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46588/0 (socket says 172.21.15.100:46588) 2024-02-21T07:48:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4e0538b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae31b9b0 con 0x564eae322fc0 2024-02-21T07:48:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4e0538b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae315b90 con 0x564eae358f80 2024-02-21T07:48:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4e0538b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eae315e70 con 0x564eae3238e0 2024-02-21T07:48:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4e0538b740 10 client.0 _ll_register_callbacks cb 0x7f4dec007d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4dfaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 0x564eae36b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4dfaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 0x564eae36b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48010/0 (socket says 172.21.15.100:48010) 2024-02-21T07:48:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.101+0000 7f4dfaa00640 1 -- 172.21.15.100:0/59545262 learned_addr learned my addr 172.21.15.100:0/59545262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae358f80 0x564eae3b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 -- 172.21.15.100:0/59545262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 msgr2=0x564eae36b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 0x564eae36b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 -- 172.21.15.100:0/59545262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae358f80 msgr2=0x564eae3b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae358f80 0x564eae3b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 -- 172.21.15.100:0/59545262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eae20c060 con 0x564eae322fc0 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4dfbe00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000f80 tx=0x7f4df4050a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a13f55dc060711 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.102+0000 7f4de4c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.103+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4057070 con 0x564eae322fc0 2024-02-21T07:48:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.103+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4df4034930 con 0x564eae322fc0 2024-02-21T07:48:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.105+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4df40347c0 con 0x564eae322fc0 2024-02-21T07:48:05.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.106+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df404e070 con 0x564eae322fc0 2024-02-21T07:48:05.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.106+0000 7f4e0538b740 10 client.5385 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:05.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.106+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564eae213430 con 0x564eae322fc0 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df40347c0 con 0x564eae322fc0 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4df405a020 con 0x564eae322fc0 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 10 client.5385 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 10 client.5385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 20 client.5385 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae3234d0 0x564eae2e6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 4 client.5385 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:48:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.107+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564eadfde890 con 0x564eae3234d0 2024-02-21T07:48:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.109+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae3234d0 0x564eae2e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.112+0000 7f4de4c00640 10 client.5385 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.112+0000 7f4dfaa00640 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae3234d0 0x564eae2e6720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b5df3c0fce49683 server_cookie=3beefc3c9e4abc in_seq=0 out_seq=0 2024-02-21T07:48:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4de4c00640 1 -- 172.21.15.100:0/59545262 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564eadfde890 con 0x564eae3234d0 2024-02-21T07:48:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4de4c00640 10 client.5385 handle_command_reply: tid=0 2024-02-21T07:48:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4e0538b740 1 client.5385 shutdown 2024-02-21T07:48:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 msgr2=0x564eae315570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000f80 tx=0x7f4df4050a90 comp rx=0 tx=0).stop 2024-02-21T07:48:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 shutdown_connections 2024-02-21T07:48:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.113+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564eae3234d0 0x564eae2e6720 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eae358f80 0x564eae3b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eae3238e0 0x564eae36b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4de4c00640 0 client.5385 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 --2- 172.21.15.100:0/59545262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eae322fc0 0x564eae315570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 >> 172.21.15.100:0/59545262 conn(0x564eae2b25a0 msgr2=0x564eae31c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:05.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 shutdown_connections 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 1 -- 172.21.15.100:0/59545262 wait complete. 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.114+0000 7f4e0538b740 20 client.5385 trim_cache size 0 max 16384 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:48:05.120 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 msgr2=0x7f4ddc0a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 0x7f4ddc0a15c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4de8096920 tx=0x7f4de80ccac0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 msgr2=0x7f4dfc174f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4de800c3c0 tx=0x7f4de800c880 comp rx=0 tx=0).stop 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 shutdown_connections 2024-02-21T07:48:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4dfc188ab0 0x7f4dfc176b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4dfc0fa0c0 0x7f4dfc0fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ddc09f100 0x7f4ddc0a15c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 --2- 172.21.15.100:0/1731210770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dfc06ab60 0x7f4dfc174f00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.115+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 >> 172.21.15.100:0/1731210770 conn(0x7f4dfc0fe290 msgr2=0x7f4dfc08cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.116+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 shutdown_connections 2024-02-21T07:48:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.116+0000 7f4e02600640 1 -- 172.21.15.100:0/1731210770 wait complete. 2024-02-21T07:48:05.146 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:48:05.147 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:48:05.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.454+0000 7ff815400640 1 Processor -- start 2024-02-21T07:48:05.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.455+0000 7ff815400640 1 -- start start 2024-02-21T07:48:05.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff815400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 0x7ff810185250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff815400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff810185790 0x7ff8100d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff815400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8100f9e30 con 0x7ff8101823f0 2024-02-21T07:48:05.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff815400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100f8fd0 con 0x7ff810185790 2024-02-21T07:48:05.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff815400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8100f92b0 con 0x7ff8100f8ac0 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff80e800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff8101823f0 0x7ff8100f83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48420/0 (socket says 172.21.15.100:48420) 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff80f200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff810185790 0x7ff8100d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.458+0000 7ff80e800640 1 -- 172.21.15.100:0/181059128 learned_addr learned my addr 172.21.15.100:0/181059128 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80f200640 1 -- 172.21.15.100:0/181059128 >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 msgr2=0x7ff810185250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80de00640 1 --2- 172.21.15.100:0/181059128 >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 0x7ff810185250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80f200640 1 --2- 172.21.15.100:0/181059128 >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 0x7ff810185250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80f200640 1 -- 172.21.15.100:0/181059128 >> v1:172.21.15.156:6789/0 conn(0x7ff8101823f0 legacy=0x7ff8100f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80f200640 1 -- 172.21.15.100:0/181059128 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100f9590 con 0x7ff810185790 2024-02-21T07:48:05.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.459+0000 7ff80de00640 1 --2- 172.21.15.100:0/181059128 >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 0x7ff810185250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:05.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.461+0000 7ff80f200640 1 --2- 172.21.15.100:0/181059128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100d0780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00ba40 tx=0x7ff7fc02e020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abe869911f367470 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:05.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.462+0000 7ff80d400640 1 -- 172.21.15.100:0/181059128 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc02edd0 con 0x7ff810185790 2024-02-21T07:48:05.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.462+0000 7ff80d400640 1 -- 172.21.15.100:0/181059128 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc036440 con 0x7ff810185790 2024-02-21T07:48:05.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.462+0000 7ff80d400640 1 -- 172.21.15.100:0/181059128 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0367b0 con 0x7ff810185790 2024-02-21T07:48:05.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.463+0000 7ff815400640 1 -- 172.21.15.100:0/181059128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 msgr2=0x7ff8100d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 --2- 172.21.15.100:0/181059128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100d0780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00ba40 tx=0x7ff7fc02e020 comp rx=0 tx=0).stop 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 -- 172.21.15.100:0/181059128 shutdown_connections 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 --2- 172.21.15.100:0/181059128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100d0780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 --2- 172.21.15.100:0/181059128 >> v2:172.21.15.170:3300/0 conn(0x7ff8100f8ac0 0x7ff810185250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 -- 172.21.15.100:0/181059128 >> 172.21.15.100:0/181059128 conn(0x7ff81006e380 msgr2=0x7ff81006e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 -- 172.21.15.100:0/181059128 shutdown_connections 2024-02-21T07:48:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.464+0000 7ff815400640 1 -- 172.21.15.100:0/181059128 wait complete. 2024-02-21T07:48:05.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.469+0000 7ff815400640 1 Processor -- start 2024-02-21T07:48:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.470+0000 7ff815400640 1 -- start start 2024-02-21T07:48:05.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8101823f0 0x7ff8100f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100f56c0 con 0x7ff8100f8ac0 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100f59a0 con 0x7ff810185790 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff815400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100f5c80 con 0x7ff8101823f0 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff80e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff80e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46592/0 (socket says 172.21.15.100:46592) 2024-02-21T07:48:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.472+0000 7ff80e800640 1 -- 172.21.15.100:0/1369903879 learned_addr learned my addr 172.21.15.100:0/1369903879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:05.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80f200640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80de00640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8101823f0 0x7ff8100f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80e800640 1 -- 172.21.15.100:0/1369903879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8101823f0 msgr2=0x7ff8100f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80e800640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8101823f0 0x7ff8100f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80e800640 1 -- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 msgr2=0x7ff8100ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80e800640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.474+0000 7ff80e800640 1 -- 172.21.15.100:0/1369903879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc00b6a0 con 0x7ff8100f8ac0 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.475+0000 7ff80f200640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.475+0000 7ff80e800640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff80800ca30 tx=0x7ff80800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:05.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.476+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800abd0 con 0x7ff8100f8ac0 2024-02-21T07:48:05.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.477+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8100f5f60 con 0x7ff8100f8ac0 2024-02-21T07:48:05.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.477+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8100cc830 con 0x7ff8100f8ac0 2024-02-21T07:48:05.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.478+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800ad30 con 0x7ff8100f8ac0 2024-02-21T07:48:05.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.478+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800aea0 con 0x7ff8100f8ac0 2024-02-21T07:48:05.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.479+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e8005290 con 0x7ff8100f8ac0 2024-02-21T07:48:05.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.481+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff808012660 con 0x7ff8100f8ac0 2024-02-21T07:48:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.484+0000 7ff806a00640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 0x7ff7f00a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.484+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff8080ca300 con 0x7ff8100f8ac0 2024-02-21T07:48:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.485+0000 7ff80de00640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 0x7ff7f00a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:05.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.485+0000 7ff80de00640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 0x7ff7f00a1610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff810189300 tx=0x7ff800008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:05.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:05.491+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff808097bb0 con 0x7ff8100f8ac0 2024-02-21T07:48:06.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.029+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e8005ac0 con 0x7ff8100f8ac0 2024-02-21T07:48:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.033+0000 7ff806a00640 1 -- 172.21.15.100:0/1369903879 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7ff808001af0 con 0x7ff8100f8ac0 2024-02-21T07:48:06.038 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:48:06.039 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:48:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 msgr2=0x7ff7f00a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 0x7ff7f00a1610 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff810189300 tx=0x7ff800008040 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 msgr2=0x7ff81016dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff80800ca30 tx=0x7ff80800cef0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 shutdown_connections 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff810185790 0x7ff8100ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff8101823f0 0x7ff8100f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff7f009f150 0x7ff7f00a1610 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff810189300 tx=0x7ff800008040 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 --2- 172.21.15.100:0/1369903879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8100f8ac0 0x7ff81016dc30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 >> 172.21.15.100:0/1369903879 conn(0x7ff81006e380 msgr2=0x7ff81006e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.038+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 shutdown_connections 2024-02-21T07:48:06.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.039+0000 7ff815400640 1 -- 172.21.15.100:0/1369903879 wait complete. 2024-02-21T07:48:06.090 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:06.090 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:48:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.470+0000 7f8f42000640 1 Processor -- start 2024-02-21T07:48:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.470+0000 7f8f42000640 1 -- start start 2024-02-21T07:48:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.472+0000 7f8f42000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c08cff0 con 0x7f8f3c185cd0 2024-02-21T07:48:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.472+0000 7f8f42000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c06bab0 con 0x7f8f3c1860b0 2024-02-21T07:48:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.472+0000 7f8f42000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0f9590 con 0x7f8f3c1892f0 2024-02-21T07:48:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.472+0000 7f8f3be00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8f3c1860b0 0x7f8f3c188be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48426/0 (socket says 172.21.15.100:48426) 2024-02-21T07:48:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.472+0000 7f8f3be00640 1 -- 172.21.15.100:0/1501376647 learned_addr learned my addr 172.21.15.100:0/1501376647 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.473+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626117189 0 0) 0x7f8f3c06bab0 con 0x7f8f3c1860b0 2024-02-21T07:48:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.473+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f24003520 con 0x7f8f3c1860b0 2024-02-21T07:48:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.473+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687901048 0 0) 0x7f8f3c08cff0 con 0x7f8f3c185cd0 2024-02-21T07:48:06.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.473+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f3c06bab0 con 0x7f8f3c185cd0 2024-02-21T07:48:06.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3709351109 0 0) 0x7f8f24003520 con 0x7f8f3c1860b0 2024-02-21T07:48:06.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 >> v1:172.21.15.170:6789/0 conn(0x7f8f3c1892f0 legacy=0x7f8f3c06ab60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 >> v1:172.21.15.100:6789/0 conn(0x7f8f3c185cd0 legacy=0x7f8f3c0d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0f9870 con 0x7f8f3c1860b0 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f8f280015a0 con 0x7f8f3c1860b0 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 >> v1:172.21.15.156:6789/0 conn(0x7f8f3c1860b0 legacy=0x7f8f3c188be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24003bd0 0x7f8f24003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f240047c0 0x7f8f24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 0x7f8f2400bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2400c350 con 0x7f8f240047c0 2024-02-21T07:48:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2400c4c0 con 0x7f8f24009970 2024-02-21T07:48:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.474+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2400c680 con 0x7f8f24003bd0 2024-02-21T07:48:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.475+0000 7f8f41600640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 0x7f8f2400bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.476+0000 7f8f41600640 1 -- 172.21.15.100:0/1501376647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24003bd0 msgr2=0x7f8f24003fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:06.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.476+0000 7f8f41600640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24003bd0 0x7f8f24003fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.476+0000 7f8f41600640 1 -- 172.21.15.100:0/1501376647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f240047c0 msgr2=0x7f8f24004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:06.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.476+0000 7f8f41600640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f240047c0 0x7f8f24004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.476+0000 7f8f41600640 1 -- 172.21.15.100:0/1501376647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0f9870 con 0x7f8f24009970 2024-02-21T07:48:06.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.478+0000 7f8f41600640 1 -- 172.21.15.100:0/1501376647 reap_dead start 2024-02-21T07:48:06.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.478+0000 7f8f41600640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 0x7f8f2400bd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009e60 tx=0x7f8f240057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e51a12f1113e89cd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.479+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3402cdb0 con 0x7f8f24009970 2024-02-21T07:48:06.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.479+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34034440 con 0x7f8f24009970 2024-02-21T07:48:06.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.479+0000 7f8f3b400640 1 -- 172.21.15.100:0/1501376647 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340347f0 con 0x7f8f24009970 2024-02-21T07:48:06.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.480+0000 7f8f42000640 1 -- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 msgr2=0x7f8f2400bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.480+0000 7f8f42000640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 0x7f8f2400bd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009e60 tx=0x7f8f240057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.483+0000 7f8f42000640 1 -- 172.21.15.100:0/1501376647 shutdown_connections 2024-02-21T07:48:06.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.483+0000 7f8f42000640 1 --2- 172.21.15.100:0/1501376647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f24009970 0x7f8f2400bd60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.483+0000 7f8f42000640 1 -- 172.21.15.100:0/1501376647 >> 172.21.15.100:0/1501376647 conn(0x7f8f3c0fe060 msgr2=0x7f8f3c0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.483+0000 7f8f42000640 1 -- 172.21.15.100:0/1501376647 shutdown_connections 2024-02-21T07:48:06.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.483+0000 7f8f42000640 1 -- 172.21.15.100:0/1501376647 wait complete. 2024-02-21T07:48:06.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.486+0000 7f8f42000640 1 Processor -- start 2024-02-21T07:48:06.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.487+0000 7f8f42000640 1 -- start start 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 0x7f8f3c170bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c0d42e0 0x7f8f3c21fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 0x7f8f3c0fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c176020 con 0x7f8f3c220050 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c171130 con 0x7f8f3c0d42e0 2024-02-21T07:48:06.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.489+0000 7f8f42000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c2204d0 con 0x7f8f24009970 2024-02-21T07:48:06.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f41600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 0x7f8f3c0fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 0x7f8f3c170bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f41600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 0x7f8f3c0fc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46600/0 (socket says 172.21.15.100:46600) 2024-02-21T07:48:06.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f41600640 1 -- 172.21.15.100:0/1200232346 learned_addr learned my addr 172.21.15.100:0/1200232346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f3be00640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c0d42e0 0x7f8f3c21fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 -- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c0d42e0 msgr2=0x7f8f3c21fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c0d42e0 0x7f8f3c21fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 -- 172.21.15.100:0/1200232346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 msgr2=0x7f8f3c0fc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 0x7f8f3c0fc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.490+0000 7f8f40c00640 1 -- 172.21.15.100:0/1200232346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c175130 con 0x7f8f24009970 2024-02-21T07:48:06.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.491+0000 7f8f40c00640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 0x7f8f3c170bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c340 tx=0x7f8f3000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.491+0000 7f8f38c00640 1 -- 172.21.15.100:0/1200232346 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300052d0 con 0x7f8f24009970 2024-02-21T07:48:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.491+0000 7f8f38c00640 1 -- 172.21.15.100:0/1200232346 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30005430 con 0x7f8f24009970 2024-02-21T07:48:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.491+0000 7f8f38c00640 1 -- 172.21.15.100:0/1200232346 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30003830 con 0x7f8f24009970 2024-02-21T07:48:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.492+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c175410 con 0x7f8f24009970 2024-02-21T07:48:06.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.492+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c1759d0 con 0x7f8f24009970 2024-02-21T07:48:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.497+0000 7f8f38c00640 1 -- 172.21.15.100:0/1200232346 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8f30003990 con 0x7f8f24009970 2024-02-21T07:48:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.497+0000 7f8f463ab740 1 Processor -- start 2024-02-21T07:48:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.497+0000 7f8f463ab740 1 -- start start 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.498+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 0x55b679658450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.498+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.498+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b6796944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.498+0000 7f8f463ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67958b210 con 0x55b679658070 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f463ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679588740 con 0x55b679658990 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f463ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679583f20 con 0x55b679693740 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33606/0 (socket says 172.21.15.100:33606) 2024-02-21T07:48:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f40c00640 1 -- 172.21.15.100:0/214122483 learned_addr learned my addr 172.21.15.100:0/214122483 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f3be00640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b6796944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f41600640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 0x55b679658450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f38c00640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 0x7f8f1c0a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f38c00640 1 -- 172.21.15.100:0/1200232346 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8f300c9060 con 0x7f8f24009970 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.499+0000 7f8f41600640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 0x7f8f1c0a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 -- 172.21.15.100:0/214122483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 msgr2=0x55b679693200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 -- 172.21.15.100:0/214122483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 msgr2=0x55b679658450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 0x55b679658450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 -- 172.21.15.100:0/214122483 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b679545df0 con 0x55b679693740 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f41600640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 0x55b679658450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f40c00640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f3be00640 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b6796944d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f280058f0 tx=0x7f8f28005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c03de87d409b31 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f2d200640 1 -- 172.21.15.100:0/214122483 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800e950 con 0x55b679693740 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f2d200640 1 -- 172.21.15.100:0/214122483 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800eab0 con 0x55b679693740 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f2d200640 1 -- 172.21.15.100:0/214122483 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800ee40 con 0x55b679693740 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.500+0000 7f8f41600640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 0x7f8f1c0a1660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b67961a3c0 tx=0x7f8f34009540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 -- 172.21.15.100:0/214122483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 msgr2=0x55b6796944d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b6796944d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8f280058f0 tx=0x7f8f28005db0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 -- 172.21.15.100:0/214122483 shutdown_connections 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b6796944d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679658990 0x55b679693200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 --2- 172.21.15.100:0/214122483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658070 0x55b679658450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 -- 172.21.15.100:0/214122483 >> 172.21.15.100:0/214122483 conn(0x55b67961a640 msgr2=0x55b67961b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 -- 172.21.15.100:0/214122483 shutdown_connections 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.501+0000 7f8f463ab740 1 -- 172.21.15.100:0/214122483 wait complete. 2024-02-21T07:48:06.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.502+0000 7f8f463ab740 1 -- start start 2024-02-21T07:48:06.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.503+0000 7f8f463ab740 1 Processor -- start 2024-02-21T07:48:06.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6796488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b6796633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679645790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679529150 con 0x55b679658990 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679528df0 con 0x55b679693740 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6792f21c0 con 0x55b679652680 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f463ab740 10 client.0 _ll_register_callbacks cb 0x55b6795782b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6796488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6796488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46620/0 (socket says 172.21.15.100:46620) 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f40c00640 1 -- 172.21.15.100:0/4200408493 learned_addr learned my addr 172.21.15.100:0/4200408493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.504+0000 7f8f41600640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679645790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.505+0000 7f8f41600640 1 -- 172.21.15.100:0/4200408493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 msgr2=0x55b6796633f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.505+0000 7f8f41600640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b6796633f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.505+0000 7f8f41600640 1 -- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 msgr2=0x55b6796488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.505+0000 7f8f41600640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6796488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.505+0000 7f8f41600640 1 -- 172.21.15.100:0/4200408493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2800f040 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.506+0000 7f8f41600640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679645790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f3402c820 tx=0x7f8f34004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=108dac7d48386769 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.506+0000 7f8f21600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.506+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34042630 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.507+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8f34042790 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.507+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6792837e0 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.508+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f34042950 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.508+0000 7f8f463ab740 10 client.5501 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.508+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b6795825a0 con 0x55b679652680 2024-02-21T07:48:06.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.509+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6792837e0 con 0x55b679652680 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.509+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f34054070 con 0x55b679652680 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 10 client.5501 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 10 client.5501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 20 client.5501 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b67965fa90 0x55b6796b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 4 client.5501 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:06.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6792c0720 con 0x55b67965fa90 2024-02-21T07:48:06.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.510+0000 7f8f40c00640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b67965fa90 0x55b6796b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.511+0000 7f8f40c00640 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b67965fa90 0x55b6796b0f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e79a97310e1186de server_cookie=4d0c262c7d0d23fe in_seq=0 out_seq=0 2024-02-21T07:48:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.511+0000 7f8f21600640 10 client.5501 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.512+0000 7f8f21600640 1 -- 172.21.15.100:0/4200408493 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6792c0720 con 0x55b67965fa90 2024-02-21T07:48:06.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.512+0000 7f8f21600640 10 client.5501 handle_command_reply: tid=0 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 client.5501 shutdown 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 msgr2=0x55b679645790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679645790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f3402c820 tx=0x7f8f34004af0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 shutdown_connections 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b67965fa90 0x55b6796b0f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679645790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b6796633f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.513+0000 7f8f463ab740 1 --2- 172.21.15.100:0/4200408493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6796488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.514+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 >> 172.21.15.100:0/4200408493 conn(0x55b679658070 msgr2=0x55b67961c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.514+0000 7f8f21600640 0 client.5501 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.514+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 shutdown_connections 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.514+0000 7f8f463ab740 1 -- 172.21.15.100:0/4200408493 wait complete. 2024-02-21T07:48:06.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.514+0000 7f8f463ab740 20 client.5501 trim_cache size 0 max 16384 2024-02-21T07:48:06.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.540+0000 7f8f463ab740 1 Processor -- start 2024-02-21T07:48:06.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.542+0000 7f8f463ab740 1 -- start start 2024-02-21T07:48:06.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.545+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679663360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.545+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b679663f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.545+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b67965fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f463ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679693430 con 0x55b679658990 2024-02-21T07:48:06.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f463ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679616610 con 0x55b679693740 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f463ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679693120 con 0x55b679652680 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f40c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679663360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b679663f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f3be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b679663f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46634/0 (socket says 172.21.15.100:46634) 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.546+0000 7f8f3be00640 1 -- 172.21.15.100:0/3611203528 learned_addr learned my addr 172.21.15.100:0/3611203528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.547+0000 7f8f41600640 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b67965fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.548+0000 7f8f41600640 1 -- 172.21.15.100:0/3611203528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 msgr2=0x55b679663360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.548+0000 7f8f41600640 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679663360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.548+0000 7f8f41600640 1 -- 172.21.15.100:0/3611203528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 msgr2=0x55b679663f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.548+0000 7f8f41600640 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b679663f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.548+0000 7f8f41600640 1 -- 172.21.15.100:0/3611203528 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b67951eab0 con 0x55b679693740 2024-02-21T07:48:06.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.549+0000 7f8f41600640 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b67965fe70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f3403ea60 tx=0x7f8f3404b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea25ef139851d873 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.549+0000 7f8f23e00640 1 -- 172.21.15.100:0/3611203528 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34009bd0 con 0x55b679693740 2024-02-21T07:48:06.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.550+0000 7f8f23e00640 1 -- 172.21.15.100:0/3611203528 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34034d30 con 0x55b679693740 2024-02-21T07:48:06.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.550+0000 7f8f23e00640 1 -- 172.21.15.100:0/3611203528 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340553a0 con 0x55b679693740 2024-02-21T07:48:06.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.550+0000 7f8f463ab740 1 -- 172.21.15.100:0/3611203528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 msgr2=0x55b67965fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.550+0000 7f8f463ab740 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b67965fe70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f3403ea60 tx=0x7f8f3404b000 comp rx=0 tx=0).stop 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 -- 172.21.15.100:0/3611203528 shutdown_connections 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679693740 0x55b67965fe70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b679663f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 --2- 172.21.15.100:0/3611203528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679652680 0x55b679663360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 -- 172.21.15.100:0/3611203528 >> 172.21.15.100:0/3611203528 conn(0x55b679658070 msgr2=0x55b67961c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 -- 172.21.15.100:0/3611203528 shutdown_connections 2024-02-21T07:48:06.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.551+0000 7f8f463ab740 1 -- 172.21.15.100:0/3611203528 wait complete. 2024-02-21T07:48:06.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.552+0000 7f8f463ab740 1 -- start start 2024-02-21T07:48:06.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.552+0000 7f8f463ab740 1 Processor -- start 2024-02-21T07:48:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.557+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679652680 0x55b67965fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6797063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679709720 con 0x55b679658990 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b679690e80 con 0x55b679652680 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6796603b0 con 0x55b679693740 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f463ab740 10 client.0 _ll_register_callbacks cb 0x7f8f240046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f41600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f41600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48072/0 (socket says 172.21.15.100:48072) 2024-02-21T07:48:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f41600640 1 -- 172.21.15.100:0/2141134495 learned_addr learned my addr 172.21.15.100:0/2141134495 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f41600640 1 -- 172.21.15.100:0/2141134495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679652680 msgr2=0x55b67965fe70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.558+0000 7f8f41600640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679652680 0x55b67965fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f41600640 1 -- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 msgr2=0x55b6797063e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f3be00640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6797063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f41600640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6797063e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f41600640 1 -- 172.21.15.100:0/2141134495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6795825a0 con 0x55b679693740 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f3be00640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6797063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f41600640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f34034ea0 tx=0x7f8f3402e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c518ebcd39e16aeb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.559+0000 7f8f21600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3403ed50 con 0x55b679693740 2024-02-21T07:48:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f2800eab0 con 0x55b679693740 2024-02-21T07:48:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8f340553a0 con 0x55b679693740 2024-02-21T07:48:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f34009bd0 con 0x55b679693740 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f463ab740 10 client.5507 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b679544650 con 0x55b679693740 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.560+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34076020 con 0x55b679693740 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f34054070 con 0x55b679693740 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 10 client.5507 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 10 client.5507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 20 client.5507 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b679706920 0x55b67970c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 4 client.5507 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.561+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b67930f890 con 0x55b679706920 2024-02-21T07:48:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.562+0000 7f8f40c00640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b679706920 0x55b67970c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.563+0000 7f8f40c00640 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b679706920 0x55b67970c3c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eaadbcccbdd8fb78 server_cookie=ae68c772085bbd0b in_seq=0 out_seq=0 2024-02-21T07:48:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.563+0000 7f8f21600640 10 client.5507 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.564+0000 7f8f21600640 1 -- 172.21.15.100:0/2141134495 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b67930f890 con 0x55b679706920 2024-02-21T07:48:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.564+0000 7f8f21600640 10 client.5507 handle_command_reply: tid=0 2024-02-21T07:48:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.564+0000 7f8f463ab740 1 client.5507 shutdown 2024-02-21T07:48:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.564+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 msgr2=0x55b679698480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.564+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8f34034ea0 tx=0x7f8f3402e000 comp rx=0 tx=0).stop 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 shutdown_connections 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b679706920 0x55b67970c3c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b679693740 0x55b679698480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b679658990 0x55b6797063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 --2- 172.21.15.100:0/2141134495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b679652680 0x55b67965fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 >> 172.21.15.100:0/2141134495 conn(0x55b679658070 msgr2=0x55b6796bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.565+0000 7f8f21600640 0 client.5507 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:06.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.566+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 shutdown_connections 2024-02-21T07:48:06.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.566+0000 7f8f463ab740 1 -- 172.21.15.100:0/2141134495 wait complete. 2024-02-21T07:48:06.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.566+0000 7f8f463ab740 20 client.5507 trim_cache size 0 max 16384 2024-02-21T07:48:06.571 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:06.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.567+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 msgr2=0x7f8f1c0a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.567+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 0x7f8f1c0a1660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55b67961a3c0 tx=0x7f8f34009540 comp rx=0 tx=0).stop 2024-02-21T07:48:06.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.567+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 msgr2=0x7f8f3c170bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.567+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 0x7f8f3c170bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c340 tx=0x7f8f3000c800 comp rx=0 tx=0).stop 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 shutdown_connections 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f1c09f1a0 0x7f8f1c0a1660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f3c220050 0x7f8f3c0fc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f3c0d42e0 0x7f8f3c21fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 --2- 172.21.15.100:0/1200232346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f24009970 0x7f8f3c170bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.569+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 >> 172.21.15.100:0/1200232346 conn(0x7f8f3c0fe060 msgr2=0x7f8f3c17bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.570+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 shutdown_connections 2024-02-21T07:48:06.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.570+0000 7f8f42000640 1 -- 172.21.15.100:0/1200232346 wait complete. 2024-02-21T07:48:06.600 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:06.600 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:48:06.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.887+0000 7ff165200640 1 Processor -- start 2024-02-21T07:48:06.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.888+0000 7ff165200640 1 -- start start 2024-02-21T07:48:06.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff165200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff16006de10 0x7ff1600f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff165200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600f5230 con 0x7ff16006da30 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff165200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1600706e0 con 0x7ff1600f5c00 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff165200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600709c0 con 0x7ff16006de10 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff15d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff16006de10 0x7ff1600f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff15d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff16006de10 0x7ff1600f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46644/0 (socket says 172.21.15.100:46644) 2024-02-21T07:48:06.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.890+0000 7ff15d400640 1 -- 172.21.15.100:0/1354865503 learned_addr learned my addr 172.21.15.100:0/1354865503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.891+0000 7ff15d400640 1 -- 172.21.15.100:0/1354865503 >> v1:172.21.15.170:6789/0 conn(0x7ff1600f5c00 legacy=0x7ff16006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.891+0000 7ff15d400640 1 -- 172.21.15.100:0/1354865503 >> v1:172.21.15.156:6789/0 conn(0x7ff16006da30 legacy=0x7ff160188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.891+0000 7ff15d400640 1 -- 172.21.15.100:0/1354865503 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600f4900 con 0x7ff16006de10 2024-02-21T07:48:06.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.893+0000 7ff15d400640 1 --2- 172.21.15.100:0/1354865503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006de10 0x7ff1600f56c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146e94a3fe073a04 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.893+0000 7ff15ca00640 1 -- 172.21.15.100:0/1354865503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0317e0 con 0x7ff16006de10 2024-02-21T07:48:06.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.893+0000 7ff15ca00640 1 -- 172.21.15.100:0/1354865503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c031940 con 0x7ff16006de10 2024-02-21T07:48:06.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.893+0000 7ff15ca00640 1 -- 172.21.15.100:0/1354865503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c031cd0 con 0x7ff16006de10 2024-02-21T07:48:06.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.894+0000 7ff165200640 1 -- 172.21.15.100:0/1354865503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006de10 msgr2=0x7ff1600f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.894+0000 7ff165200640 1 --2- 172.21.15.100:0/1354865503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006de10 0x7ff1600f56c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009870 tx=0x7ff14c02b880 comp rx=0 tx=0).stop 2024-02-21T07:48:06.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.894+0000 7ff165200640 1 -- 172.21.15.100:0/1354865503 shutdown_connections 2024-02-21T07:48:06.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.894+0000 7ff165200640 1 --2- 172.21.15.100:0/1354865503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006de10 0x7ff1600f56c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.894+0000 7ff165200640 1 -- 172.21.15.100:0/1354865503 >> 172.21.15.100:0/1354865503 conn(0x7ff1600668b0 msgr2=0x7ff160066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.895+0000 7ff165200640 1 -- 172.21.15.100:0/1354865503 shutdown_connections 2024-02-21T07:48:06.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.895+0000 7ff165200640 1 -- 172.21.15.100:0/1354865503 wait complete. 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.898+0000 7ff165200640 1 Processor -- start 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.898+0000 7ff165200640 1 -- start start 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.900+0000 7ff165200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 0x7ff160174770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.900+0000 7ff165200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 0x7ff160159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.900+0000 7ff165200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 0x7ff16015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff15d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 0x7ff160159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff15d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 0x7ff160159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48078/0 (socket says 172.21.15.100:48078) 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff165200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16015ab90 con 0x7ff16006da30 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff165200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff160179ae0 con 0x7ff1600f5c00 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff165200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16015a2f0 con 0x7ff16006de10 2024-02-21T07:48:06.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.901+0000 7ff15e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 0x7ff16015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.902+0000 7ff15e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 0x7ff16015af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33636/0 (socket says 172.21.15.100:33636) 2024-02-21T07:48:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.902+0000 7ff15e800640 1 -- 172.21.15.100:0/219862755 learned_addr learned my addr 172.21.15.100:0/219862755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.902+0000 7ff15de00640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 0x7ff160174770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.903+0000 7ff15de00640 1 -- 172.21.15.100:0/219862755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 msgr2=0x7ff160159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.903+0000 7ff15de00640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 0x7ff160159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.903+0000 7ff15de00640 1 -- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 msgr2=0x7ff16015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.903+0000 7ff15de00640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 0x7ff16015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.903+0000 7ff15de00640 1 -- 172.21.15.100:0/219862755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0094d0 con 0x7ff16006da30 2024-02-21T07:48:06.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.904+0000 7ff15de00640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 0x7ff160174770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c500 tx=0x7ff15000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.908+0000 7ff156000640 1 -- 172.21.15.100:0/219862755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500052d0 con 0x7ff16006da30 2024-02-21T07:48:06.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.908+0000 7ff156000640 1 -- 172.21.15.100:0/219862755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150005450 con 0x7ff16006da30 2024-02-21T07:48:06.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.908+0000 7ff156000640 1 -- 172.21.15.100:0/219862755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150007260 con 0x7ff16006da30 2024-02-21T07:48:06.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.908+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16015a5d0 con 0x7ff16006da30 2024-02-21T07:48:06.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.910+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1601698f0 con 0x7ff16006da30 2024-02-21T07:48:06.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.913+0000 7ff156000640 1 -- 172.21.15.100:0/219862755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff1500073c0 con 0x7ff16006da30 2024-02-21T07:48:06.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.915+0000 7ff156000640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 0x7ff1400a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.917+0000 7ff156000640 1 -- 172.21.15.100:0/219862755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff1500c9230 con 0x7ff16006da30 2024-02-21T07:48:06.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.923+0000 7ff167e66740 1 Processor -- start 2024-02-21T07:48:06.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.927+0000 7ff15d400640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 0x7ff1400a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.933+0000 7ff167e66740 1 -- start start 2024-02-21T07:48:06.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.941+0000 7ff15d400640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 0x7ff1400a16b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff14c036000 tx=0x7ff14c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 0x55fd45c6b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45ca7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45b9e210 con 0x55fd45c6b7e0 2024-02-21T07:48:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45b9b740 con 0x55fd45c6aec0 2024-02-21T07:48:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.948+0000 7ff167e66740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45b96f20 con 0x55fd45ca6590 2024-02-21T07:48:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.950+0000 7ff15d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.950+0000 7ff15d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46656/0 (socket says 172.21.15.100:46656) 2024-02-21T07:48:06.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.954+0000 7ff15d400640 1 -- 172.21.15.100:0/3907507572 learned_addr learned my addr 172.21.15.100:0/3907507572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.951+0000 7ff15de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 0x55fd45c6b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.951+0000 7ff15e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45ca7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.955+0000 7ff15d400640 1 -- 172.21.15.100:0/3907507572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 msgr2=0x55fd45ca7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.955+0000 7ff15d400640 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45ca7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.955+0000 7ff15d400640 1 -- 172.21.15.100:0/3907507572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 msgr2=0x55fd45c6b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.960+0000 7ff15d400640 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 0x55fd45c6b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.960+0000 7ff15d400640 1 -- 172.21.15.100:0/3907507572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd45b58df0 con 0x55fd45c6b7e0 2024-02-21T07:48:06.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.961+0000 7ff15de00640 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 0x55fd45c6b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.963+0000 7ff15d400640 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0090b0 tx=0x7ff14c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4c7e1e30a87f43 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.965+0000 7ff14aa00640 1 -- 172.21.15.100:0/3907507572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c04a070 con 0x55fd45c6b7e0 2024-02-21T07:48:06.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.966+0000 7ff14aa00640 1 -- 172.21.15.100:0/3907507572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c032e90 con 0x55fd45c6b7e0 2024-02-21T07:48:06.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.966+0000 7ff14aa00640 1 -- 172.21.15.100:0/3907507572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c04a070 con 0x55fd45c6b7e0 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.968+0000 7ff167e66740 1 -- 172.21.15.100:0/3907507572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 msgr2=0x55fd45ca6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.968+0000 7ff167e66740 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0090b0 tx=0x7ff14c030000 comp rx=0 tx=0).stop 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 -- 172.21.15.100:0/3907507572 shutdown_connections 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45ca7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c6b7e0 0x55fd45ca6050 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 --2- 172.21.15.100:0/3907507572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45c6aec0 0x55fd45c6b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 -- 172.21.15.100:0/3907507572 >> 172.21.15.100:0/3907507572 conn(0x55fd45c2d490 msgr2=0x55fd45c2e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:06.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 -- 172.21.15.100:0/3907507572 shutdown_connections 2024-02-21T07:48:06.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.970+0000 7ff167e66740 1 -- 172.21.15.100:0/3907507572 wait complete. 2024-02-21T07:48:06.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.973+0000 7ff167e66740 1 -- start start 2024-02-21T07:48:06.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.973+0000 7ff167e66740 1 Processor -- start 2024-02-21T07:48:06.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45c98db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45c5f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45caf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45b3c150 con 0x55fd45cb02a0 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45b3bdf0 con 0x55fd45ca6590 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.983+0000 7ff167e66740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd459051c0 con 0x55fd45c676c0 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.984+0000 7ff167e66740 10 client.0 _ll_register_callbacks cb 0x55fd45b8b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.986+0000 7ff15e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45caf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.986+0000 7ff15e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45caf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48092/0 (socket says 172.21.15.100:48092) 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.986+0000 7ff15e800640 1 -- 172.21.15.100:0/1403973338 learned_addr learned my addr 172.21.15.100:0/1403973338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45c98db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:06.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 -- 172.21.15.100:0/1403973338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 msgr2=0x55fd45caf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45caf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 -- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 msgr2=0x55fd45c5f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45c5f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.991+0000 7ff15de00640 1 -- 172.21.15.100:0/1403973338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600f4900 con 0x55fd45ca6590 2024-02-21T07:48:06.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.992+0000 7ff15de00640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45c98db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1500c6c30 tx=0x7ff150097680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9dd3ef0b12cf4a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.992+0000 7ff13f400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.992+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500c9070 con 0x55fd45ca6590 2024-02-21T07:48:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.992+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff15009d0b0 con 0x55fd45ca6590 2024-02-21T07:48:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.993+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd458967e0 con 0x55fd45ca6590 2024-02-21T07:48:06.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.993+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15009bea0 con 0x55fd45ca6590 2024-02-21T07:48:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.994+0000 7ff167e66740 10 client.5533 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:06.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.994+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fd45b955a0 con 0x55fd45ca6590 2024-02-21T07:48:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.995+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fd458967e0 con 0x55fd45ca6590 2024-02-21T07:48:07.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.995+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff150019030 con 0x55fd45ca6590 2024-02-21T07:48:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.996+0000 7ff167e66740 10 client.5533 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.996+0000 7ff167e66740 10 client.5533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:48:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.996+0000 7ff167e66740 20 client.5533 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:07.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.996+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45cafb70 0x55fd45c993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.997+0000 7ff167e66740 4 client.5533 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:07.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:06.997+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd458d3720 con 0x55fd45cafb70 2024-02-21T07:48:07.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.001+0000 7ff15d400640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45cafb70 0x55fd45c993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.006+0000 7ff15d400640 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45cafb70 0x55fd45c993f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf41b7df0a19a88b server_cookie=7ed28830e48e3b7f in_seq=0 out_seq=0 2024-02-21T07:48:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.008+0000 7ff13f400640 10 client.5533 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.008+0000 7ff13f400640 1 -- 172.21.15.100:0/1403973338 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fd458d3720 con 0x55fd45cafb70 2024-02-21T07:48:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.008+0000 7ff13f400640 10 client.5533 handle_command_reply: tid=0 2024-02-21T07:48:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.009+0000 7ff167e66740 1 client.5533 shutdown 2024-02-21T07:48:07.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.010+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 msgr2=0x55fd45c98db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.010+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45c98db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff1500c6c30 tx=0x7ff150097680 comp rx=0 tx=0).stop 2024-02-21T07:48:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 shutdown_connections 2024-02-21T07:48:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45caf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45c5f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45cafb70 0x55fd45c993f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 --2- 172.21.15.100:0/1403973338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45c98db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.011+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 >> 172.21.15.100:0/1403973338 conn(0x55fd45c6aec0 msgr2=0x55fd45ca69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.013+0000 7ff13f400640 0 client.5533 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.013+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 shutdown_connections 2024-02-21T07:48:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.014+0000 7ff167e66740 1 -- 172.21.15.100:0/1403973338 wait complete. 2024-02-21T07:48:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.014+0000 7ff167e66740 20 client.5533 trim_cache size 0 max 16384 2024-02-21T07:48:07.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.041+0000 7ff167e66740 1 Processor -- start 2024-02-21T07:48:07.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.041+0000 7ff167e66740 1 -- start start 2024-02-21T07:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.043+0000 7ff167e66740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c676c0 0x55fd45c67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.043+0000 7ff167e66740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.043+0000 7ff167e66740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45cb02a0 0x55fd45d04f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.044+0000 7ff167e66740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45ca6c50 con 0x55fd45c676c0 2024-02-21T07:48:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.044+0000 7ff167e66740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45ca6970 con 0x55fd45cb02a0 2024-02-21T07:48:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.044+0000 7ff167e66740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45c5f100 con 0x55fd45ca6590 2024-02-21T07:48:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.045+0000 7ff15d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.046+0000 7ff15d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48094/0 (socket says 172.21.15.100:48094) 2024-02-21T07:48:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.046+0000 7ff15d400640 1 -- 172.21.15.100:0/1887840760 learned_addr learned my addr 172.21.15.100:0/1887840760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.056+0000 7ff15d400640 1 -- 172.21.15.100:0/1887840760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45cb02a0 msgr2=0x55fd45d04f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.056+0000 7ff15d400640 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45cb02a0 0x55fd45d04f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.056+0000 7ff15d400640 1 -- 172.21.15.100:0/1887840760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c676c0 msgr2=0x55fd45c67120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.056+0000 7ff15d400640 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c676c0 0x55fd45c67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.057+0000 7ff15d400640 1 -- 172.21.15.100:0/1887840760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd45b31ab0 con 0x55fd45ca6590 2024-02-21T07:48:07.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.057+0000 7ff15d400640 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff14c053040 tx=0x7ff14c02e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea94ba7deaa3b09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.059+0000 7ff14a000640 1 -- 172.21.15.100:0/1887840760 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c04a040 con 0x55fd45ca6590 2024-02-21T07:48:07.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.059+0000 7ff14a000640 1 -- 172.21.15.100:0/1887840760 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c05b2d0 con 0x55fd45ca6590 2024-02-21T07:48:07.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.059+0000 7ff14a000640 1 -- 172.21.15.100:0/1887840760 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c05b640 con 0x55fd45ca6590 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 -- 172.21.15.100:0/1887840760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 msgr2=0x55fd45d049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff14c053040 tx=0x7ff14c02e000 comp rx=0 tx=0).stop 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 -- 172.21.15.100:0/1887840760 shutdown_connections 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45cb02a0 0x55fd45d04f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45ca6590 0x55fd45d049f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 --2- 172.21.15.100:0/1887840760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45c676c0 0x55fd45c67120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.061+0000 7ff167e66740 1 -- 172.21.15.100:0/1887840760 >> 172.21.15.100:0/1887840760 conn(0x55fd45c6aec0 msgr2=0x55fd45c2e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.062+0000 7ff167e66740 1 -- 172.21.15.100:0/1887840760 shutdown_connections 2024-02-21T07:48:07.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.062+0000 7ff167e66740 1 -- 172.21.15.100:0/1887840760 wait complete. 2024-02-21T07:48:07.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.063+0000 7ff167e66740 1 -- start start 2024-02-21T07:48:07.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.064+0000 7ff167e66740 1 Processor -- start 2024-02-21T07:48:07.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.066+0000 7ff167e66740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45c632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.067+0000 7ff167e66740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.067+0000 7ff167e66740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45cfda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff167e66740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45d0dd00 con 0x55fd45cb02a0 2024-02-21T07:48:07.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff167e66740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45c34500 con 0x55fd45ca6590 2024-02-21T07:48:07.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff15d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff15d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33666/0 (socket says 172.21.15.100:33666) 2024-02-21T07:48:07.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff15d400640 1 -- 172.21.15.100:0/3008748831 learned_addr learned my addr 172.21.15.100:0/3008748831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.068+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd45cfdfb0 con 0x55fd45c676c0 2024-02-21T07:48:07.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.069+0000 7ff15e800640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45cfda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.069+0000 7ff15de00640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45c632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.070+0000 7ff167e66740 10 client.0 _ll_register_callbacks cb 0x7ff14c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:07.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.070+0000 7ff15e800640 1 -- 172.21.15.100:0/3008748831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 msgr2=0x55fd45c632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.070+0000 7ff15e800640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45c632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.071+0000 7ff15e800640 1 -- 172.21.15.100:0/3008748831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 msgr2=0x55fd45cfd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.071+0000 7ff15e800640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.071+0000 7ff15e800640 1 -- 172.21.15.100:0/3008748831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd45b58df0 con 0x55fd45cb02a0 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.071+0000 7ff15d400640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.072+0000 7ff15e800640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45cfda70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff158013a90 tx=0x7ff158013f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c71b74969c5255 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.072+0000 7ff13f400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:07.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.077+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158006b50 con 0x55fd45cb02a0 2024-02-21T07:48:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.078+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff158006cb0 con 0x55fd45cb02a0 2024-02-21T07:48:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.078+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff14c032e90 con 0x55fd45cb02a0 2024-02-21T07:48:07.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.082+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff158006e70 con 0x55fd45cb02a0 2024-02-21T07:48:07.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.083+0000 7ff167e66740 10 client.5415 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:07.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.084+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fd45b57650 con 0x55fd45cb02a0 2024-02-21T07:48:07.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.085+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c032e90 con 0x55fd45cb02a0 2024-02-21T07:48:07.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff158011910 con 0x55fd45cb02a0 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 10 client.5415 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 10 client.5415 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 20 client.5415 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45c99b50 0x55fd45ca4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 4 client.5415 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:07.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.087+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fd45922890 con 0x55fd45c99b50 2024-02-21T07:48:07.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.088+0000 7ff15de00640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45c99b50 0x55fd45ca4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.088+0000 7ff15de00640 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45c99b50 0x55fd45ca4a70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adeebcb0f193ddc4 server_cookie=a9b295677015e1ad in_seq=0 out_seq=0 2024-02-21T07:48:07.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff13f400640 10 client.5415 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:07.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff13f400640 1 -- 172.21.15.100:0/3008748831 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fd45922890 con 0x55fd45c99b50 2024-02-21T07:48:07.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff13f400640 10 client.5415 handle_command_reply: tid=0 2024-02-21T07:48:07.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 client.5415 shutdown 2024-02-21T07:48:07.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 msgr2=0x55fd45cfda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45cfda70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff158013a90 tx=0x7ff158013f50 comp rx=0 tx=0).stop 2024-02-21T07:48:07.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 shutdown_connections 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd45cb02a0 0x55fd45cfda70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fd45c99b50 0x55fd45ca4a70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff13f400640 0 client.5415 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.089+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd45ca6590 0x55fd45cfd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.090+0000 7ff167e66740 1 --2- 172.21.15.100:0/3008748831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd45c676c0 0x55fd45c632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.090+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 >> 172.21.15.100:0/3008748831 conn(0x55fd45c6aec0 msgr2=0x55fd45c35920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.090+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 shutdown_connections 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.090+0000 7ff167e66740 1 -- 172.21.15.100:0/3008748831 wait complete. 2024-02-21T07:48:07.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.090+0000 7ff167e66740 20 client.5415 trim_cache size 0 max 16384 2024-02-21T07:48:07.097 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:07.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.091+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 msgr2=0x7ff1400a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.091+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 0x7ff1400a16b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff14c036000 tx=0x7ff14c03d040 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.091+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 msgr2=0x7ff160174770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.091+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 0x7ff160174770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c500 tx=0x7ff15000c9c0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 shutdown_connections 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1600f5c00 0x7ff16015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff16006de10 0x7ff160159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff14009f1f0 0x7ff1400a16b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 --2- 172.21.15.100:0/219862755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff16006da30 0x7ff160174770 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c500 tx=0x7ff15000c9c0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 >> 172.21.15.100:0/219862755 conn(0x7ff1600668b0 msgr2=0x7ff160072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 shutdown_connections 2024-02-21T07:48:07.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.092+0000 7ff165200640 1 -- 172.21.15.100:0/219862755 wait complete. 2024-02-21T07:48:07.128 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:07.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:48:07.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.490+0000 7f0059000640 1 Processor -- start 2024-02-21T07:48:07.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.491+0000 7f0059000640 1 -- start start 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0059000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0054070a30 0x7f005406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0059000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005418dc80 con 0x7f0054190260 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0059000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540f55d0 con 0x7f005406ebf0 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0059000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005406f060 con 0x7f0054070a30 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0052800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f005406ebf0 0x7f0054190640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48436/0 (socket says 172.21.15.100:48436) 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0052800640 1 -- 172.21.15.100:0/19592035 learned_addr learned my addr 172.21.15.100:0/19592035 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:07.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.493+0000 7f0051e00640 1 --1- 172.21.15.100:0/19592035 >> v1:172.21.15.100:6789/0 conn(0x7f0054190260 0x7f00540f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40268/0 (socket says 172.21.15.100:40268) 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f004be00640 1 --2- 172.21.15.100:0/19592035 >> v2:172.21.15.100:3300/0 conn(0x7f0054070a30 0x7f005406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152981547 0 0) 0x7f00540f55d0 con 0x7f005406ebf0 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0038003520 con 0x7f005406ebf0 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2178088777 0 0) 0x7f0038003520 con 0x7f005406ebf0 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 >> v2:172.21.15.100:3300/0 conn(0x7f0054070a30 msgr2=0x7f005406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 --2- 172.21.15.100:0/19592035 >> v2:172.21.15.100:3300/0 conn(0x7f0054070a30 0x7f005406e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 >> v1:172.21.15.100:6789/0 conn(0x7f0054190260 legacy=0x7f00540f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540f58b0 con 0x7f005406ebf0 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f004c0019d0 con 0x7f005406ebf0 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 >> v1:172.21.15.156:6789/0 conn(0x7f005406ebf0 legacy=0x7f0054190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380039e0 0x7f0038003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00380047c0 0x7f0038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 0x7f003800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003800c1c0 con 0x7f00380039e0 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003800c330 con 0x7f00380052a0 2024-02-21T07:48:07.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.494+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003800c4f0 con 0x7f00380047c0 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 0x7f003800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0051e00640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380039e0 0x7f0038003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f004be00640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00380047c0 0x7f0038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 -- 172.21.15.100:0/19592035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00380047c0 msgr2=0x7f0038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00380047c0 0x7f0038004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 -- 172.21.15.100:0/19592035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380039e0 msgr2=0x7f0038003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380039e0 0x7f0038003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f0052800640 1 -- 172.21.15.100:0/19592035 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540f58b0 con 0x7f00380052a0 2024-02-21T07:48:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.495+0000 7f004be00640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00380047c0 0x7f0038004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.496+0000 7f0052800640 1 -- 172.21.15.100:0/19592035 reap_dead start 2024-02-21T07:48:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.496+0000 7f0052800640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 0x7f003800b980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a7d0 tx=0x7f00380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724f8e9f40fc961b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.497+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0072d0 con 0x7f00380052a0 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.497+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c02f070 con 0x7f00380052a0 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.497+0000 7f0051400640 1 -- 172.21.15.100:0/19592035 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c007670 con 0x7f00380052a0 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.497+0000 7f0059000640 1 -- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 msgr2=0x7f003800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.497+0000 7f0059000640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 0x7f003800b980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a7d0 tx=0x7f00380057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.498+0000 7f0059000640 1 -- 172.21.15.100:0/19592035 shutdown_connections 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.498+0000 7f0059000640 1 --2- 172.21.15.100:0/19592035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00380052a0 0x7f003800b980 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.498+0000 7f0059000640 1 -- 172.21.15.100:0/19592035 >> 172.21.15.100:0/19592035 conn(0x7f00540668b0 msgr2=0x7f0054066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.498+0000 7f0059000640 1 -- 172.21.15.100:0/19592035 shutdown_connections 2024-02-21T07:48:07.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.498+0000 7f0059000640 1 -- 172.21.15.100:0/19592035 wait complete. 2024-02-21T07:48:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.500+0000 7f0059000640 1 Processor -- start 2024-02-21T07:48:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.500+0000 7f0059000640 1 -- start start 2024-02-21T07:48:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 0x7f0054174df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00540ede60 0x7f0054225fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00542249f0 con 0x7f00380052a0 2024-02-21T07:48:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054225b20 con 0x7f0054224540 2024-02-21T07:48:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0059000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0054224c30 con 0x7f00540ede60 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0052800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0052800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33682/0 (socket says 172.21.15.100:33682) 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0052800640 1 -- 172.21.15.100:0/2974263640 learned_addr learned my addr 172.21.15.100:0/2974263640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f0051e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 0x7f0054174df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.502+0000 7f004be00640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00540ede60 0x7f0054225fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 -- 172.21.15.100:0/2974263640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00540ede60 msgr2=0x7f0054225fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00540ede60 0x7f0054225fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 -- 172.21.15.100:0/2974263640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 msgr2=0x7f0054174df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 0x7f0054174df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 -- 172.21.15.100:0/2974263640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054224f10 con 0x7f0054224540 2024-02-21T07:48:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0051e00640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 0x7f0054174df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.503+0000 7f0052800640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a8f0 tx=0x7f004c001c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.507+0000 7f004a000640 1 -- 172.21.15.100:0/2974263640 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c039030 con 0x7f0054224540 2024-02-21T07:48:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.507+0000 7f004a000640 1 -- 172.21.15.100:0/2974263640 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c035870 con 0x7f0054224540 2024-02-21T07:48:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.507+0000 7f004a000640 1 -- 172.21.15.100:0/2974263640 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c03c040 con 0x7f0054224540 2024-02-21T07:48:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.507+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00542251f0 con 0x7f0054224540 2024-02-21T07:48:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.507+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00542257b0 con 0x7f0054224540 2024-02-21T07:48:07.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.516+0000 7f005bbef740 1 Processor -- start 2024-02-21T07:48:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.516+0000 7f004a000640 1 -- 172.21.15.100:0/2974263640 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f004c035c20 con 0x7f0054224540 2024-02-21T07:48:07.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.516+0000 7f005bbef740 1 -- start start 2024-02-21T07:48:07.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f9ec0 0x564b4d8fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d936320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d82d210 con 0x564b4d935590 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d82a740 con 0x564b4d8f9ec0 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.518+0000 7f005bbef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d825f20 con 0x564b4d8fa7e0 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48136/0 (socket says 172.21.15.100:48136) 2024-02-21T07:48:07.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 -- 172.21.15.100:0/3472344250 learned_addr learned my addr 172.21.15.100:0/3472344250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f004be00640 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d936320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 -- 172.21.15.100:0/3472344250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f9ec0 msgr2=0x564b4d8fa2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f9ec0 0x564b4d8fa2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.519+0000 7f0051e00640 1 -- 172.21.15.100:0/3472344250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 msgr2=0x564b4d936320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f004a000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 0x7f00300a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f0051e00640 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d936320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f0051e00640 1 -- 172.21.15.100:0/3472344250 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b4d7e7df0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f004a000640 1 -- 172.21.15.100:0/2974263640 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f004c0eaed0 con 0x7f0054224540 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f004be00640 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d936320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f004be00640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 0x7f00300a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.520+0000 7f0051e00640 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f003c0049a0 tx=0x7f003c007cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dbbc53c4e35ab33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.521+0000 7f0042a00640 1 -- 172.21.15.100:0/3472344250 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c001b10 con 0x564b4d8fa7e0 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.521+0000 7f0042a00640 1 -- 172.21.15.100:0/3472344250 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c001c70 con 0x564b4d8fa7e0 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.521+0000 7f0042a00640 1 -- 172.21.15.100:0/3472344250 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c015440 con 0x564b4d8fa7e0 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 -- 172.21.15.100:0/3472344250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 msgr2=0x564b4d935050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f003c0049a0 tx=0x7f003c007cb0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f004be00640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 0x7f00300a16b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564b4d8bc210 tx=0x7f0044008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 -- 172.21.15.100:0/3472344250 shutdown_connections 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d936320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d935050 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 --2- 172.21.15.100:0/3472344250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f9ec0 0x564b4d8fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 -- 172.21.15.100:0/3472344250 >> 172.21.15.100:0/3472344250 conn(0x564b4d8bc490 msgr2=0x564b4d8bd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 -- 172.21.15.100:0/3472344250 shutdown_connections 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.522+0000 7f005bbef740 1 -- 172.21.15.100:0/3472344250 wait complete. 2024-02-21T07:48:07.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.523+0000 7f005bbef740 1 -- start start 2024-02-21T07:48:07.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.524+0000 7f005bbef740 1 Processor -- start 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d8f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f7a20 0x564b4d8e8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d7cb150 con 0x564b4d935590 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d7cadf0 con 0x564b4d8f7a20 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d5941c0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f005bbef740 10 client.0 _ll_register_callbacks cb 0x564b4d81a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f0051e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f0051e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48146/0 (socket says 172.21.15.100:48146) 2024-02-21T07:48:07.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.525+0000 7f0051e00640 1 -- 172.21.15.100:0/1511046483 learned_addr learned my addr 172.21.15.100:0/1511046483 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 -- 172.21.15.100:0/1511046483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f7a20 msgr2=0x564b4d8e8080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:07.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f7a20 0x564b4d8e8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 -- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 msgr2=0x564b4d8f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d8f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 -- 172.21.15.100:0/1511046483 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005418dc80 con 0x564b4d8fa7e0 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0051e00640 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f003c018040 tx=0x7f003c001190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=841cfd2585edb066 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0037400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.526+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c001b10 con 0x564b4d8fa7e0 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.527+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f003c020440 con 0x564b4d8fa7e0 2024-02-21T07:48:07.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.527+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b4d5257e0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.527+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f003c020600 con 0x564b4d8fa7e0 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.527+0000 7f005bbef740 10 client.5531 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.527+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b4d8245a0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b4d5257e0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f003c012050 con 0x564b4d8fa7e0 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 10 client.5531 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 10 client.5531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:07.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 20 client.5531 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d93e5e0 0x564b4d93e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 4 client.5531 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.528+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b4d562720 con 0x564b4d93e5e0 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.529+0000 7f004be00640 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d93e5e0 0x564b4d93e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.529+0000 7f0037400640 10 client.5531 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:07.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.529+0000 7f004be00640 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d93e5e0 0x564b4d93e9e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d690bcf9968db933 server_cookie=be0c0340952603ec in_seq=0 out_seq=0 2024-02-21T07:48:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.530+0000 7f0037400640 1 -- 172.21.15.100:0/1511046483 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b4d562720 con 0x564b4d93e5e0 2024-02-21T07:48:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.530+0000 7f0037400640 10 client.5531 handle_command_reply: tid=0 2024-02-21T07:48:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.530+0000 7f005bbef740 1 client.5531 shutdown 2024-02-21T07:48:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 msgr2=0x564b4d8ec5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f003c018040 tx=0x7f003c001190 comp rx=0 tx=0).stop 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 shutdown_connections 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d93e5e0 0x564b4d93e9e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f0037400640 0 client.5531 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8f7a20 0x564b4d8e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d935590 0x564b4d8f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 --2- 172.21.15.100:0/1511046483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d8fa7e0 0x564b4d8ec5f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 >> 172.21.15.100:0/1511046483 conn(0x564b4d8f9ec0 msgr2=0x564b4d8bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 shutdown_connections 2024-02-21T07:48:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 1 -- 172.21.15.100:0/1511046483 wait complete. 2024-02-21T07:48:07.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.531+0000 7f005bbef740 20 client.5531 trim_cache size 0 max 16384 2024-02-21T07:48:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.552+0000 7f005bbef740 1 Processor -- start 2024-02-21T07:48:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.552+0000 7f005bbef740 1 -- start start 2024-02-21T07:48:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.554+0000 7f005bbef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d8fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.554+0000 7f005bbef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d8b4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.554+0000 7f005bbef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f005bbef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d8c39e0 con 0x564b4d8f7a20 2024-02-21T07:48:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f005bbef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d8bcb40 con 0x564b4d8fa7e0 2024-02-21T07:48:07.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f005bbef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d8c3c80 con 0x564b4d935590 2024-02-21T07:48:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f0052800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f0052800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48162/0 (socket says 172.21.15.100:48162) 2024-02-21T07:48:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f0052800640 1 -- 172.21.15.100:0/609348167 learned_addr learned my addr 172.21.15.100:0/609348167 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f0051e00640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d8fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.556+0000 7f0052800640 1 -- 172.21.15.100:0/609348167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 msgr2=0x564b4d8b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.555+0000 7f004be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d8b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.556+0000 7f0052800640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d8b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.556+0000 7f0052800640 1 -- 172.21.15.100:0/609348167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 msgr2=0x564b4d8fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.556+0000 7f0052800640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d8fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.556+0000 7f0052800640 1 -- 172.21.15.100:0/609348167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b4d7c0ab0 con 0x564b4d935590 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.557+0000 7f0052800640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f004c0b86b0 tx=0x7f004c0b8780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df60650de596d5aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.557+0000 7f0042000640 1 -- 172.21.15.100:0/609348167 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b90b0 con 0x564b4d935590 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.557+0000 7f0042000640 1 -- 172.21.15.100:0/609348167 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c0b89b0 con 0x564b4d935590 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.557+0000 7f0042000640 1 -- 172.21.15.100:0/609348167 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c0bcb00 con 0x564b4d935590 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.558+0000 7f005bbef740 1 -- 172.21.15.100:0/609348167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 msgr2=0x564b4d98d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.558+0000 7f005bbef740 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f004c0b86b0 tx=0x7f004c0b8780 comp rx=0 tx=0).stop 2024-02-21T07:48:07.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.558+0000 7f004be00640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d8b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:07.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f0051e00640 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d8fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 -- 172.21.15.100:0/609348167 shutdown_connections 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d98d880 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d8b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 --2- 172.21.15.100:0/609348167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d8fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 -- 172.21.15.100:0/609348167 >> 172.21.15.100:0/609348167 conn(0x564b4d8f9ec0 msgr2=0x564b4d8e7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.562+0000 7f005bbef740 1 -- 172.21.15.100:0/609348167 shutdown_connections 2024-02-21T07:48:07.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.563+0000 7f005bbef740 1 -- 172.21.15.100:0/609348167 wait complete. 2024-02-21T07:48:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.564+0000 7f005bbef740 1 -- start start 2024-02-21T07:48:07.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.565+0000 7f005bbef740 1 Processor -- start 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d94e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d92abf0 con 0x564b4d8f7a20 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d92a590 con 0x564b4d8fa7e0 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4d8bd4d0 con 0x564b4d935590 2024-02-21T07:48:07.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f005bbef740 10 client.0 _ll_register_callbacks cb 0x7f0044009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:07.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.571+0000 7f004be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33714/0 (socket says 172.21.15.100:33714) 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 -- 172.21.15.100:0/487665117 learned_addr learned my addr 172.21.15.100:0/487665117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 -- 172.21.15.100:0/487665117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 msgr2=0x564b4d983090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 -- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 msgr2=0x564b4d94e320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d94e320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 -- 172.21.15.100:0/487665117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00542257b0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f004be00640 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f005418fdf0 tx=0x7f00440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f686adb6305ca4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.572+0000 7f0037400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044029540 con 0x564b4d8fa7e0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f00440296a0 con 0x564b4d8fa7e0 2024-02-21T07:48:07.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f003c001c70 con 0x564b4d8fa7e0 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0044029860 con 0x564b4d8fa7e0 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f005bbef740 10 client.5545 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.573+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b4d7e6650 con 0x564b4d8fa7e0 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c001c70 con 0x564b4d8fa7e0 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f004401f040 con 0x564b4d8fa7e0 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 10 client.5545 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:07.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 10 client.5545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 20 client.5545 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d8e8ae0 0x564b4d99d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 4 client.5545 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:07.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.574+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b4d5b1890 con 0x564b4d8e8ae0 2024-02-21T07:48:07.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.577+0000 7f0051e00640 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d8e8ae0 0x564b4d99d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:07.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.579+0000 7f0051e00640 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d8e8ae0 0x564b4d99d050 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2cc7571cf371424 server_cookie=304dd9bf4ceea4b4 in_seq=0 out_seq=0 2024-02-21T07:48:07.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.580+0000 7f0037400640 10 client.5545 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:07.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.580+0000 7f0037400640 1 -- 172.21.15.100:0/487665117 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b4d5b1890 con 0x564b4d8e8ae0 2024-02-21T07:48:07.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.580+0000 7f0037400640 10 client.5545 handle_command_reply: tid=0 2024-02-21T07:48:07.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.580+0000 7f005bbef740 1 client.5545 shutdown 2024-02-21T07:48:07.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.581+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 msgr2=0x564b4d982b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.581+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f005418fdf0 tx=0x7f00440046c0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 shutdown_connections 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b4d8e8ae0 0x564b4d99d050 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b4d935590 0x564b4d983090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b4d8fa7e0 0x564b4d982b50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 --2- 172.21.15.100:0/487665117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b4d8f7a20 0x564b4d94e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 >> 172.21.15.100:0/487665117 conn(0x564b4d8f9ec0 msgr2=0x564b4d8f6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f0037400640 0 client.5545 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 shutdown_connections 2024-02-21T07:48:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 1 -- 172.21.15.100:0/487665117 wait complete. 2024-02-21T07:48:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.582+0000 7f005bbef740 20 client.5545 trim_cache size 0 max 16384 2024-02-21T07:48:07.588 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 msgr2=0x7f00300a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 0x7f00300a16b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564b4d8bc210 tx=0x7f0044008040 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 msgr2=0x7f0054221040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f004c00a8f0 tx=0x7f004c001c90 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 shutdown_connections 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0054224540 0x7f0054221040 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f00540ede60 0x7f0054225fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f003009f1f0 0x7f00300a16b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 --2- 172.21.15.100:0/2974263640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00380052a0 0x7f0054174df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 >> 172.21.15.100:0/2974263640 conn(0x7f00540668b0 msgr2=0x7f005406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 shutdown_connections 2024-02-21T07:48:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:07.584+0000 7f0059000640 1 -- 172.21.15.100:0/2974263640 wait complete. 2024-02-21T07:48:08.626 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:48:08.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:48:08.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:48:08.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.977+0000 7f6f3d600640 1 Processor -- start 2024-02-21T07:48:08.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.978+0000 7f6f3d600640 1 -- start start 2024-02-21T07:48:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.981+0000 7f6f3d600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6f38187b20 0x7f6f38187fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.981+0000 7f6f3d600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f38188790 0x7f6f38188c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.981+0000 7f6f3d600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f38187690 con 0x7f6f38182970 2024-02-21T07:48:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.981+0000 7f6f3d600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380d3a00 con 0x7f6f38188790 2024-02-21T07:48:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.981+0000 7f6f3d600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f381867a0 con 0x7f6f38187b20 2024-02-21T07:48:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.982+0000 7f6f37400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f38188790 0x7f6f38188c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.982+0000 7f6f37400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6f38188790 0x7f6f38188c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46740/0 (socket says 172.21.15.100:46740) 2024-02-21T07:48:08.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.982+0000 7f6f37400640 1 -- 172.21.15.100:0/3067014787 learned_addr learned my addr 172.21.15.100:0/3067014787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.983+0000 7f6f37400640 1 -- 172.21.15.100:0/3067014787 >> v2:172.21.15.170:3300/0 conn(0x7f6f38187b20 msgr2=0x7f6f38187fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:08.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.983+0000 7f6f37400640 1 --2- 172.21.15.100:0/3067014787 >> v2:172.21.15.170:3300/0 conn(0x7f6f38187b20 0x7f6f38187fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:08.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.984+0000 7f6f37400640 1 -- 172.21.15.100:0/3067014787 >> v1:172.21.15.156:6789/0 conn(0x7f6f38182970 legacy=0x7f6f3806d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.984+0000 7f6f37400640 1 -- 172.21.15.100:0/3067014787 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38186a80 con 0x7f6f38188790 2024-02-21T07:48:08.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.986+0000 7f6f37400640 1 --2- 172.21.15.100:0/3067014787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38188790 0x7f6f38188c00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f380f8790 tx=0x7f6f3002bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11989a5a2d5335f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:08.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.987+0000 7f6f35600640 1 -- 172.21.15.100:0/3067014787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3002c7e0 con 0x7f6f38188790 2024-02-21T07:48:08.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.987+0000 7f6f35600640 1 -- 172.21.15.100:0/3067014787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3002c940 con 0x7f6f38188790 2024-02-21T07:48:08.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.988+0000 7f6f35600640 1 -- 172.21.15.100:0/3067014787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3002ccb0 con 0x7f6f38188790 2024-02-21T07:48:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.989+0000 7f6f3d600640 1 -- 172.21.15.100:0/3067014787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38188790 msgr2=0x7f6f38188c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.989+0000 7f6f3d600640 1 --2- 172.21.15.100:0/3067014787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38188790 0x7f6f38188c00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f380f8790 tx=0x7f6f3002bcc0 comp rx=0 tx=0).stop 2024-02-21T07:48:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.990+0000 7f6f3d600640 1 -- 172.21.15.100:0/3067014787 shutdown_connections 2024-02-21T07:48:08.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.990+0000 7f6f3d600640 1 --2- 172.21.15.100:0/3067014787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38188790 0x7f6f38188c00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:08.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.990+0000 7f6f3d600640 1 --2- 172.21.15.100:0/3067014787 >> v2:172.21.15.170:3300/0 conn(0x7f6f38187b20 0x7f6f38187fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:08.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.990+0000 7f6f3d600640 1 -- 172.21.15.100:0/3067014787 >> 172.21.15.100:0/3067014787 conn(0x7f6f380fac10 msgr2=0x7f6f380fb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:08.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.991+0000 7f6f3d600640 1 -- 172.21.15.100:0/3067014787 shutdown_connections 2024-02-21T07:48:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:08.994+0000 7f6f3d600640 1 -- 172.21.15.100:0/3067014787 wait complete. 2024-02-21T07:48:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.000+0000 7f6f3d600640 1 Processor -- start 2024-02-21T07:48:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.000+0000 7f6f3d600640 1 -- start start 2024-02-21T07:48:09.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 0x7f6f3816f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 0x7f6f381707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 0x7f6f380d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38174af0 con 0x7f6f38187b20 2024-02-21T07:48:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f38174dd0 con 0x7f6f38182970 2024-02-21T07:48:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.002+0000 7f6f3d600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381750b0 con 0x7f6f38188790 2024-02-21T07:48:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.006+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 0x7f6f380d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.006+0000 7f6f36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 0x7f6f3816f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.007+0000 7f6f36000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 0x7f6f381707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.007+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 0x7f6f380d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48196/0 (socket says 172.21.15.100:48196) 2024-02-21T07:48:09.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.008+0000 7f6f36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 0x7f6f3816f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33716/0 (socket says 172.21.15.100:33716) 2024-02-21T07:48:09.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.008+0000 7f6f36a00640 1 -- 172.21.15.100:0/565268451 learned_addr learned my addr 172.21.15.100:0/565268451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.010+0000 7f6f36000640 1 -- 172.21.15.100:0/565268451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 msgr2=0x7f6f380d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.010+0000 7f6f36000640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 0x7f6f380d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.010+0000 7f6f36000640 1 -- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 msgr2=0x7f6f3816f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.010+0000 7f6f36000640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 0x7f6f3816f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.010+0000 7f6f36000640 1 -- 172.21.15.100:0/565268451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30009b30 con 0x7f6f38187b20 2024-02-21T07:48:09.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.013+0000 7f6f36000640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 0x7f6f381707a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800b780 tx=0x7f6f2800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.014+0000 7f6f2ea00640 1 -- 172.21.15.100:0/565268451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800c720 con 0x7f6f38187b20 2024-02-21T07:48:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.014+0000 7f6f2ea00640 1 -- 172.21.15.100:0/565268451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2800c880 con 0x7f6f38187b20 2024-02-21T07:48:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.014+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f380d0940 con 0x7f6f38187b20 2024-02-21T07:48:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.014+0000 7f6f2ea00640 1 -- 172.21.15.100:0/565268451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2800cc30 con 0x7f6f38187b20 2024-02-21T07:48:09.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.014+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380d0f00 con 0x7f6f38187b20 2024-02-21T07:48:09.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.023+0000 7f6f40397740 1 Processor -- start 2024-02-21T07:48:09.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.023+0000 7f6f2ea00640 1 -- 172.21.15.100:0/565268451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6f2801d3b0 con 0x7f6f38187b20 2024-02-21T07:48:09.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.023+0000 7f6f40397740 1 -- start start 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 0x56241fa4a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa4b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f98f300 con 0x56241fa0f1c0 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f941e50 con 0x56241fa4a890 2024-02-21T07:48:09.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.025+0000 7f6f40397740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f93f380 con 0x56241fa0fae0 2024-02-21T07:48:09.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.026+0000 7f6f37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.026+0000 7f6f37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46754/0 (socket says 172.21.15.100:46754) 2024-02-21T07:48:09.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.026+0000 7f6f37400640 1 -- 172.21.15.100:0/2005656293 learned_addr learned my addr 172.21.15.100:0/2005656293 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.027+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 0x56241fa4a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.029+0000 7f6f36a00640 1 -- 172.21.15.100:0/2005656293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 msgr2=0x56241fa4b620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.029+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa4b620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.029+0000 7f6f36a00640 1 -- 172.21.15.100:0/2005656293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 msgr2=0x56241fa0f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.030+0000 7f6f2ea00640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 0x7f6f180a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.031+0000 7f6f2ea00640 1 -- 172.21.15.100:0/565268451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f280c91a0 con 0x7f6f38187b20 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.032+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.032+0000 7f6f36a00640 1 -- 172.21.15.100:0/2005656293 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241f903c80 con 0x56241fa0fae0 2024-02-21T07:48:09.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.032+0000 7f6f37400640 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.032+0000 7f6f36000640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 0x7f6f180a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.033+0000 7f6f36000640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 0x7f6f180a1560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f2809eef0 tx=0x7f6f2800bd70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.033+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 0x56241fa4a350 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f24001a80 tx=0x7f6f24007e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34a3232ab250ec8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.035+0000 7f6f23000640 1 -- 172.21.15.100:0/2005656293 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400fc40 con 0x56241fa0fae0 2024-02-21T07:48:09.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.035+0000 7f6f23000640 1 -- 172.21.15.100:0/2005656293 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400fda0 con 0x56241fa0fae0 2024-02-21T07:48:09.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.035+0000 7f6f23000640 1 -- 172.21.15.100:0/2005656293 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240052f0 con 0x56241fa0fae0 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 -- 172.21.15.100:0/2005656293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 msgr2=0x56241fa4a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 0x56241fa4a350 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6f24001a80 tx=0x7f6f24007e90 comp rx=0 tx=0).stop 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 -- 172.21.15.100:0/2005656293 shutdown_connections 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa4b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241fa0fae0 0x56241fa4a350 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 --2- 172.21.15.100:0/2005656293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0f1c0 0x56241fa0f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.036+0000 7f6f40397740 1 -- 172.21.15.100:0/2005656293 >> 172.21.15.100:0/2005656293 conn(0x56241f9d1790 msgr2=0x56241f9d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.037+0000 7f6f40397740 1 -- 172.21.15.100:0/2005656293 shutdown_connections 2024-02-21T07:48:09.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.037+0000 7f6f40397740 1 -- 172.21.15.100:0/2005656293 wait complete. 2024-02-21T07:48:09.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.038+0000 7f6f40397740 1 -- start start 2024-02-21T07:48:09.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.039+0000 7f6f40397740 1 Processor -- start 2024-02-21T07:48:09.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa02f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f93ab60 con 0x56241fa0fae0 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f8dffd0 con 0x56241fa4a890 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f8dfc70 con 0x56241f9ce230 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f40397740 10 client.0 _ll_register_callbacks cb 0x56241f64bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f36a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33728/0 (socket says 172.21.15.100:33728) 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f36a00640 1 -- 172.21.15.100:0/1940743923 learned_addr learned my addr 172.21.15.100:0/1940743923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.042+0000 7f6f37400640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa02f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 -- 172.21.15.100:0/1940743923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 msgr2=0x56241fa082a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 -- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 msgr2=0x56241fa02f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa02f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 -- 172.21.15.100:0/1940743923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f24001680 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6f24015040 tx=0x7f6f24000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f242ba082c81f7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f17400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.043+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2400fc40 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f24003d30 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56241f63a860 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f24027420 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 10 client.5554 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56241f9391e0 con 0x56241fa4a890 2024-02-21T07:48:09.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56241f63a860 con 0x56241fa4a890 2024-02-21T07:48:09.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6f24012070 con 0x56241fa4a890 2024-02-21T07:48:09.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 10 client.5554 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:09.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 10 client.5554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.044+0000 7f6f40397740 20 client.5554 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.045+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa08cb0 0x56241fa563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.045+0000 7f6f40397740 4 client.5554 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.045+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56241f68b410 con 0x56241fa08cb0 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.045+0000 7f6f37400640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa08cb0 0x56241fa563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.046+0000 7f6f37400640 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa08cb0 0x56241fa563b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d93d0e780a110602 server_cookie=fd661dfd80e139d6 in_seq=0 out_seq=0 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.046+0000 7f6f17400640 10 client.5554 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.046+0000 7f6f17400640 1 -- 172.21.15.100:0/1940743923 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56241f68b410 con 0x56241fa08cb0 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.046+0000 7f6f17400640 10 client.5554 handle_command_reply: tid=0 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 client.5554 shutdown 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 msgr2=0x56241fa042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6f24015040 tx=0x7f6f24000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 shutdown_connections 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa08cb0 0x56241fa563b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa042a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 --2- 172.21.15.100:0/1940743923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa02f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 >> 172.21.15.100:0/1940743923 conn(0x56241fa0f1c0 msgr2=0x56241fa0b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.047+0000 7f6f17400640 0 client.5554 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.048+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 shutdown_connections 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.048+0000 7f6f40397740 1 -- 172.21.15.100:0/1940743923 wait complete. 2024-02-21T07:48:09.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.048+0000 7f6f40397740 20 client.5554 trim_cache size 0 max 16384 2024-02-21T07:48:09.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.064+0000 7f6f40397740 1 Processor -- start 2024-02-21T07:48:09.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.064+0000 7f6f40397740 1 -- start start 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa1a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 0x56241f9d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa4a890 0x56241f9d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f6830c0 con 0x56241fa4a890 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f9d13a0 con 0x56241fa0fae0 2024-02-21T07:48:09.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f40397740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f9d0900 con 0x56241f9ce230 2024-02-21T07:48:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa1a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa1a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48222/0 (socket says 172.21.15.100:48222) 2024-02-21T07:48:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f37400640 1 -- 172.21.15.100:0/1461179087 learned_addr learned my addr 172.21.15.100:0/1461179087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.066+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 0x56241f9d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f37400640 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa4a890 0x56241f9d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 -- 172.21.15.100:0/1461179087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 msgr2=0x56241fa1a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa1a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 -- 172.21.15.100:0/1461179087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa4a890 msgr2=0x56241f9d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa4a890 0x56241f9d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 -- 172.21.15.100:0/1461179087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241f8d5a90 con 0x56241fa0fae0 2024-02-21T07:48:09.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f36a00640 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 0x56241f9d2860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f24015040 tx=0x7f6f24020070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a00c43b48a54327 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f22600640 1 -- 172.21.15.100:0/1461179087 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24003d30 con 0x56241fa0fae0 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f22600640 1 -- 172.21.15.100:0/1461179087 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400fa30 con 0x56241fa0fae0 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.067+0000 7f6f22600640 1 -- 172.21.15.100:0/1461179087 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240069f0 con 0x56241fa0fae0 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.068+0000 7f6f40397740 1 -- 172.21.15.100:0/1461179087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 msgr2=0x56241f9d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.068+0000 7f6f40397740 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 0x56241f9d2860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f24015040 tx=0x7f6f24020070 comp rx=0 tx=0).stop 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 -- 172.21.15.100:0/1461179087 shutdown_connections 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa4a890 0x56241f9d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa0fae0 0x56241f9d2860 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 --2- 172.21.15.100:0/1461179087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 -- 172.21.15.100:0/1461179087 >> 172.21.15.100:0/1461179087 conn(0x56241fa0f1c0 msgr2=0x56241fa02d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 -- 172.21.15.100:0/1461179087 shutdown_connections 2024-02-21T07:48:09.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.069+0000 7f6f40397740 1 -- 172.21.15.100:0/1461179087 wait complete. 2024-02-21T07:48:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.070+0000 7f6f40397740 1 -- start start 2024-02-21T07:48:09.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.070+0000 7f6f40397740 1 Processor -- start 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa12760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241f9d7ee0 con 0x56241fa0fae0 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241fa37fc0 con 0x56241fa4a890 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241fa11ff0 con 0x56241f9ce230 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f40397740 10 client.0 _ll_register_callbacks cb 0x7f6f24001470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f37400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48230/0 (socket says 172.21.15.100:48230) 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f37400640 1 -- 172.21.15.100:0/2279927914 learned_addr learned my addr 172.21.15.100:0/2279927914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.072+0000 7f6f37400640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa12760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 -- 172.21.15.100:0/2279927914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 msgr2=0x56241fa12760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa12760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 -- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 msgr2=0x56241fa5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa5af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 -- 172.21.15.100:0/2279927914 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56241f9391e0 con 0x56241f9ce230 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f37400640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f30003dc0 tx=0x7f6f3004e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1dbbbc31a9c771e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.073+0000 7f6f17400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.074+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30045040 con 0x56241f9ce230 2024-02-21T07:48:09.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.074+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f30003e20 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.074+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f2400fda0 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f3004a580 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 10 client.5546 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56241f8fb6a0 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400fda0 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6f3003c070 con 0x56241f9ce230 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 10 client.5546 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 10 client.5546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 20 client.5546 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa17a70 0x56241fab1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 4 client.5546 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.075+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56241f6777b0 con 0x56241fa17a70 2024-02-21T07:48:09.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.076+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa17a70 0x56241fab1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.076+0000 7f6f36a00640 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa17a70 0x56241fab1e20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f747198adcc9055 server_cookie=7b56a938ffa6dc3c in_seq=0 out_seq=0 2024-02-21T07:48:09.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.076+0000 7f6f17400640 10 client.5546 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.080+0000 7f6f17400640 1 -- 172.21.15.100:0/2279927914 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56241f6777b0 con 0x56241fa17a70 2024-02-21T07:48:09.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.080+0000 7f6f17400640 10 client.5546 handle_command_reply: tid=0 2024-02-21T07:48:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.082+0000 7f6f40397740 1 client.5546 shutdown 2024-02-21T07:48:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 msgr2=0x56241fa19bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f30003dc0 tx=0x7f6f3004e040 comp rx=0 tx=0).stop 2024-02-21T07:48:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 shutdown_connections 2024-02-21T07:48:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56241fa17a70 0x56241fab1e20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241fa4a890 0x56241fa12760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56241fa0fae0 0x56241fa5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 --2- 172.21.15.100:0/2279927914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56241f9ce230 0x56241fa19bc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.083+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 >> 172.21.15.100:0/2279927914 conn(0x56241fa0f1c0 msgr2=0x56241f9cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.084+0000 7f6f17400640 0 client.5546 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.086+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 shutdown_connections 2024-02-21T07:48:09.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.088+0000 7f6f40397740 1 -- 172.21.15.100:0/2279927914 wait complete. 2024-02-21T07:48:09.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.088+0000 7f6f40397740 20 client.5546 trim_cache size 0 max 16384 2024-02-21T07:48:09.098 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:48:09.098 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "a802527f-ebcc-43ec-9464-a6f3028332b2", 2024-02-21T07:48:09.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:48:09.101 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 msgr2=0x7f6f180a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 0x7f6f180a1560 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f2809eef0 tx=0x7f6f2800bd70 comp rx=0 tx=0).stop 2024-02-21T07:48:09.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 msgr2=0x7f6f381707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 0x7f6f381707a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6f2800b780 tx=0x7f6f2800bc40 comp rx=0 tx=0).stop 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 shutdown_connections 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6f38188790 0x7f6f380d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6f1809f0a0 0x7f6f180a1560 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f38187b20 0x7f6f381707a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 --2- 172.21.15.100:0/565268451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f38182970 0x7f6f3816f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.094+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 >> 172.21.15.100:0/565268451 conn(0x7f6f380fac10 msgr2=0x7f6f381817f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.096+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 shutdown_connections 2024-02-21T07:48:09.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.096+0000 7f6f3d600640 1 -- 172.21.15.100:0/565268451 wait complete. 2024-02-21T07:48:09.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:48:09.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:48:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.414+0000 7f25bfa00640 1 Processor -- start 2024-02-21T07:48:09.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.415+0000 7f25bfa00640 1 -- start start 2024-02-21T07:48:09.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bfa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f25b8198a00 0x7f25b806de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bfa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8199160 con 0x7f25b80f53e0 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bfa00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b8199440 con 0x7f25b806da30 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bfa00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80f4fc0 con 0x7f25b8198a00 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25b7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f25b80f53e0 0x7f25b8196900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40272/0 (socket says 172.21.15.100:40272) 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25b7e00640 1 -- 172.21.15.100:0/2487829977 learned_addr learned my addr 172.21.15.100:0/2487829977 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bd000640 1 --1- 172.21.15.100:0/2487829977 >> v1:172.21.15.156:6789/0 conn(0x7f25b806da30 0x7f25b808b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48456/0 (socket says 172.21.15.100:48456) 2024-02-21T07:48:09.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25bda00640 1 --2- 172.21.15.100:0/2487829977 >> v2:172.21.15.170:3300/0 conn(0x7f25b8198a00 0x7f25b806de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.418+0000 7f25b7400640 1 -- 172.21.15.100:0/2487829977 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966576766 0 0) 0x7f25b8199160 con 0x7f25b80f53e0 2024-02-21T07:48:09.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.419+0000 7f25b7400640 1 -- 172.21.15.100:0/2487829977 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a0003520 con 0x7f25b80f53e0 2024-02-21T07:48:09.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.419+0000 7f25bda00640 1 -- 172.21.15.100:0/2487829977 >> v1:172.21.15.156:6789/0 conn(0x7f25b806da30 legacy=0x7f25b808b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.419+0000 7f25bda00640 1 -- 172.21.15.100:0/2487829977 >> v1:172.21.15.100:6789/0 conn(0x7f25b80f53e0 legacy=0x7f25b8196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.419+0000 7f25bda00640 1 -- 172.21.15.100:0/2487829977 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b8199720 con 0x7f25b8198a00 2024-02-21T07:48:09.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.420+0000 7f25bda00640 1 --2- 172.21.15.100:0/2487829977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b8198a00 0x7f25b806de10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009d90 tx=0x7f25b002bc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97b6f316797d7f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.421+0000 7f25b7400640 1 -- 172.21.15.100:0/2487829977 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b002c9c0 con 0x7f25b8198a00 2024-02-21T07:48:09.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.421+0000 7f25b7400640 1 -- 172.21.15.100:0/2487829977 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b002cb20 con 0x7f25b8198a00 2024-02-21T07:48:09.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.421+0000 7f25b7400640 1 -- 172.21.15.100:0/2487829977 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0034440 con 0x7f25b8198a00 2024-02-21T07:48:09.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.422+0000 7f25bfa00640 1 -- 172.21.15.100:0/2487829977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b8198a00 msgr2=0x7f25b806de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.422+0000 7f25bfa00640 1 --2- 172.21.15.100:0/2487829977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b8198a00 0x7f25b806de10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009d90 tx=0x7f25b002bc90 comp rx=0 tx=0).stop 2024-02-21T07:48:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.422+0000 7f25bfa00640 1 -- 172.21.15.100:0/2487829977 shutdown_connections 2024-02-21T07:48:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.422+0000 7f25bfa00640 1 --2- 172.21.15.100:0/2487829977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b8198a00 0x7f25b806de10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.422+0000 7f25bfa00640 1 -- 172.21.15.100:0/2487829977 >> 172.21.15.100:0/2487829977 conn(0x7f25b80668b0 msgr2=0x7f25b8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.423+0000 7f25bfa00640 1 -- 172.21.15.100:0/2487829977 shutdown_connections 2024-02-21T07:48:09.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.423+0000 7f25bfa00640 1 -- 172.21.15.100:0/2487829977 wait complete. 2024-02-21T07:48:09.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.426+0000 7f25bfa00640 1 Processor -- start 2024-02-21T07:48:09.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.426+0000 7f25bfa00640 1 -- start start 2024-02-21T07:48:09.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b80f53e0 0x7f25b8085300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 0x7f25b818b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8085840 con 0x7f25b8198a00 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b806c9f0 con 0x7f25b80f53e0 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.428+0000 7f25bfa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b8189e50 con 0x7f25b806da30 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48252/0 (socket says 172.21.15.100:48252) 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 -- 172.21.15.100:0/3777579642 learned_addr learned my addr 172.21.15.100:0/3777579642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b80f53e0 0x7f25b8085300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bda00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 0x7f25b818b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 -- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b80f53e0 msgr2=0x7f25b8085300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b80f53e0 0x7f25b8085300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 -- 172.21.15.100:0/3777579642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 msgr2=0x7f25b818b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 0x7f25b818b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 -- 172.21.15.100:0/3777579642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009a70 con 0x7f25b806da30 2024-02-21T07:48:09.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bda00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 0x7f25b818b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.429+0000 7f25bd000640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c750 tx=0x7f25a400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.430+0000 7f25b4c00640 1 -- 172.21.15.100:0/3777579642 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40072d0 con 0x7f25b806da30 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.430+0000 7f25b4c00640 1 -- 172.21.15.100:0/3777579642 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4007450 con 0x7f25b806da30 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.430+0000 7f25b4c00640 1 -- 172.21.15.100:0/3777579642 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40047e0 con 0x7f25b806da30 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.430+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b818a130 con 0x7f25b806da30 2024-02-21T07:48:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.430+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b818a6f0 con 0x7f25b806da30 2024-02-21T07:48:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.433+0000 7f25b4c00640 1 -- 172.21.15.100:0/3777579642 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f25a4004960 con 0x7f25b806da30 2024-02-21T07:48:09.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.434+0000 7f25b4c00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 0x7f25980a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.434+0000 7f25b4c00640 1 -- 172.21.15.100:0/3777579642 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f25a40c8f70 con 0x7f25b806da30 2024-02-21T07:48:09.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.434+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 0x7f25980a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.435+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 0x7f25980a15e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25b80f4270 tx=0x7f25ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.436+0000 7f25c27fb740 1 Processor -- start 2024-02-21T07:48:09.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.436+0000 7f25c27fb740 1 -- start start 2024-02-21T07:48:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2e65ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2dda150 con 0x5591e2ea38e0 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2dd7680 con 0x5591e2ed8f80 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.438+0000 7f25c27fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2dd2e60 con 0x5591e2ea2fc0 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48254/0 (socket says 172.21.15.100:48254) 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 -- 172.21.15.100:0/1240818265 learned_addr learned my addr 172.21.15.100:0/1240818265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33770/0 (socket says 172.21.15.100:33770) 2024-02-21T07:48:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bda00640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2e65ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 -- 172.21.15.100:0/1240818265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 msgr2=0x5591e2ea33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 -- 172.21.15.100:0/1240818265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 msgr2=0x5591e2e65ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2e65ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bd000640 1 -- 172.21.15.100:0/1240818265 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e2d8c060 con 0x5591e2ea2fc0 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25b7e00640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.439+0000 7f25bda00640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2e65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.440+0000 7f25bd000640 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f25a40c6880 tx=0x7f25a4000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=326423344ef6c1aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.440+0000 7f25a9600640 1 -- 172.21.15.100:0/1240818265 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a409aba0 con 0x5591e2ea2fc0 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.440+0000 7f25a9600640 1 -- 172.21.15.100:0/1240818265 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a409f1f0 con 0x5591e2ea2fc0 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.440+0000 7f25a9600640 1 -- 172.21.15.100:0/1240818265 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40930c0 con 0x5591e2ea2fc0 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 -- 172.21.15.100:0/1240818265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 msgr2=0x5591e2ed8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f25a40c6880 tx=0x7f25a4000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 -- 172.21.15.100:0/1240818265 shutdown_connections 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2e65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2ea33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 --2- 172.21.15.100:0/1240818265 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2ed8a40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 -- 172.21.15.100:0/1240818265 >> 172.21.15.100:0/1240818265 conn(0x5591e2e325a0 msgr2=0x5591e2e69eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 -- 172.21.15.100:0/1240818265 shutdown_connections 2024-02-21T07:48:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.441+0000 7f25c27fb740 1 -- 172.21.15.100:0/1240818265 wait complete. 2024-02-21T07:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.443+0000 7f25c27fb740 1 -- start start 2024-02-21T07:48:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.443+0000 7f25c27fb740 1 Processor -- start 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2eadaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2eedf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2d77ec0 con 0x5591e2ea2fc0 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2d77b60 con 0x5591e2ed8f80 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2b411c0 con 0x5591e2ea38e0 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25c27fb740 10 client.0 _ll_register_callbacks cb 0x5591e2d8b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.445+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48268/0 (socket says 172.21.15.100:48268) 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 -- 172.21.15.100:0/3005610559 learned_addr learned my addr 172.21.15.100:0/3005610559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25bd000640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2eadaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25bda00640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2eedf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 -- 172.21.15.100:0/3005610559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 msgr2=0x5591e2eedf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2eedf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 -- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 msgr2=0x5591e2eadaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2eadaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 -- 172.21.15.100:0/3005610559 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b818a6f0 con 0x5591e2ea38e0 2024-02-21T07:48:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f25b7e00640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0156e0 tx=0x7f25ac000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e786df2ef1a2e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.446+0000 7f259e000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac013680 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f25ac0137e0 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591e2ad27e0 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25ac0139a0 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f25c27fb740 10 client.5558 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.447+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5591e2dd14e0 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.448+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591e2ad27e0 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f25ac020070 con 0x5591e2ea38e0 2024-02-21T07:48:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 10 client.5558 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:09.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 10 client.5558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:09.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 20 client.5558 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:09.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2e99190 0x5591e2e64f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 4 client.5558 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.449+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591e2b0f720 con 0x5591e2e99190 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.450+0000 7f25bd000640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2e99190 0x5591e2e64f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.451+0000 7f259e000640 10 client.5558 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.451+0000 7f25bd000640 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2e99190 0x5591e2e64f20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea8c35238bc0e73 server_cookie=c914ea98d41b3854 in_seq=0 out_seq=0 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.452+0000 7f259e000640 1 -- 172.21.15.100:0/3005610559 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5591e2b0f720 con 0x5591e2e99190 2024-02-21T07:48:09.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.452+0000 7f259e000640 10 client.5558 handle_command_reply: tid=0 2024-02-21T07:48:09.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.452+0000 7f25c27fb740 1 client.5558 shutdown 2024-02-21T07:48:09.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.453+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 msgr2=0x5591e2eee870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.453+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0156e0 tx=0x7f25ac000bc0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 shutdown_connections 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2e99190 0x5591e2e64f20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ed8f80 0x5591e2eedf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea38e0 0x5591e2eee870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f259e000640 0 client.5558 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.454+0000 7f25c27fb740 1 --2- 172.21.15.100:0/3005610559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2eadaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.455+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 >> 172.21.15.100:0/3005610559 conn(0x5591e2e325a0 msgr2=0x5591e2e6a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.456+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 shutdown_connections 2024-02-21T07:48:09.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.456+0000 7f25c27fb740 1 -- 172.21.15.100:0/3005610559 wait complete. 2024-02-21T07:48:09.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.458+0000 7f25c27fb740 20 client.5558 trim_cache size 0 max 16384 2024-02-21T07:48:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.487+0000 7f25c27fb740 1 Processor -- start 2024-02-21T07:48:09.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.487+0000 7f25c27fb740 1 -- start start 2024-02-21T07:48:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.488+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 0x5591e2e67bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2e686c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2f34ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25c27fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2e64910 con 0x5591e2ea38e0 2024-02-21T07:48:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25c27fb740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2e9c750 con 0x5591e2e99190 2024-02-21T07:48:09.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25c27fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2ece880 con 0x5591e2ea2fc0 2024-02-21T07:48:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25bd000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 0x5591e2e67bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2e686c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25bda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2f34ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25bd000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 0x5591e2e67bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33788/0 (socket says 172.21.15.100:33788) 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25bd000640 1 -- 172.21.15.100:0/531533166 learned_addr learned my addr 172.21.15.100:0/531533166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25b7e00640 1 -- 172.21.15.100:0/531533166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 msgr2=0x5591e2e67bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25b7e00640 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 0x5591e2e67bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.489+0000 7f25b7e00640 1 -- 172.21.15.100:0/531533166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 msgr2=0x5591e2f34ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25b7e00640 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2f34ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25b7e00640 1 -- 172.21.15.100:0/531533166 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591e2d6d950 con 0x5591e2ea2fc0 2024-02-21T07:48:09.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25b7e00640 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2e686c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f60 tx=0x7f25ac020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9d7d13f089d206 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25a8c00640 1 -- 172.21.15.100:0/531533166 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac013d10 con 0x5591e2ea2fc0 2024-02-21T07:48:09.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25a8c00640 1 -- 172.21.15.100:0/531533166 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac019070 con 0x5591e2ea2fc0 2024-02-21T07:48:09.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.490+0000 7f25a8c00640 1 -- 172.21.15.100:0/531533166 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac013880 con 0x5591e2ea2fc0 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 -- 172.21.15.100:0/531533166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 msgr2=0x5591e2e686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2e686c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f60 tx=0x7f25ac020000 comp rx=0 tx=0).stop 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 -- 172.21.15.100:0/531533166 shutdown_connections 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea38e0 0x5591e2f34ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2ea2fc0 0x5591e2e686c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 --2- 172.21.15.100:0/531533166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2e99190 0x5591e2e67bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.492+0000 7f25c27fb740 1 -- 172.21.15.100:0/531533166 >> 172.21.15.100:0/531533166 conn(0x5591e2e325a0 msgr2=0x5591e2eab510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.493+0000 7f25c27fb740 1 -- 172.21.15.100:0/531533166 shutdown_connections 2024-02-21T07:48:09.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.493+0000 7f25c27fb740 1 -- 172.21.15.100:0/531533166 wait complete. 2024-02-21T07:48:09.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.495+0000 7f25c27fb740 1 -- start start 2024-02-21T07:48:09.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.496+0000 7f25c27fb740 1 Processor -- start 2024-02-21T07:48:09.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.500+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 0x5591e2ed89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.500+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.501+0000 7f25c27fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 0x5591e2ea10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.501+0000 7f25c27fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2f4ebb0 con 0x5591e2ea2fc0 2024-02-21T07:48:09.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.501+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.502+0000 7f25b7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46814/0 (socket says 172.21.15.100:46814) 2024-02-21T07:48:09.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.502+0000 7f25b7e00640 1 -- 172.21.15.100:0/2904102665 learned_addr learned my addr 172.21.15.100:0/2904102665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:09.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.503+0000 7f25bda00640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 0x5591e2ea10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.503+0000 7f25bd000640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 0x5591e2ed89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.503+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2f4e300 con 0x5591e2ea38e0 2024-02-21T07:48:09.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.503+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591e2f2ebc0 con 0x5591e2e99190 2024-02-21T07:48:09.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.503+0000 7f25c27fb740 10 client.0 _ll_register_callbacks cb 0x7f25ac001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:09.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 -- 172.21.15.100:0/2904102665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 msgr2=0x5591e2ea10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 0x5591e2ea10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 -- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 msgr2=0x5591e2ef2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:09.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591e2dd14e0 con 0x5591e2e99190 2024-02-21T07:48:09.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.504+0000 7f25bd000640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 0x5591e2ed89e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25a4094d00 tx=0x7f25a401e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea7b4318db0c216 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.510+0000 7f259e000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.510+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40930c0 con 0x5591e2e99190 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.510+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f25a4093220 con 0x5591e2e99190 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.510+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25a409f1f0 con 0x5591e2e99190 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.511+0000 7f25bda00640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 0x5591e2ea10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:09.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.512+0000 7f25b7e00640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:09.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.513+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a409ed60 con 0x5591e2e99190 2024-02-21T07:48:09.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.514+0000 7f25c27fb740 10 client.5564 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:09.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.514+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5591e2d93430 con 0x5591e2e99190 2024-02-21T07:48:09.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.516+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a409f1f0 con 0x5591e2e99190 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f25a40b5050 con 0x5591e2e99190 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 10 client.5564 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 10 client.5564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 20 client.5564 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2ed8f80 0x5591e2e9b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 4 client.5564 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:48:09.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.520+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591e2b5e890 con 0x5591e2ed8f80 2024-02-21T07:48:09.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.521+0000 7f25b7e00640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2ed8f80 0x5591e2e9b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:09.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25b7e00640 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2ed8f80 0x5591e2e9b580 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7310c120d5d7c4d server_cookie=9ee36ce44e78d613 in_seq=0 out_seq=0 2024-02-21T07:48:09.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f259e000640 10 client.5564 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f259e000640 1 -- 172.21.15.100:0/2904102665 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5591e2b5e890 con 0x5591e2ed8f80 2024-02-21T07:48:09.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f259e000640 10 client.5564 handle_command_reply: tid=0 2024-02-21T07:48:09.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 client.5564 shutdown 2024-02-21T07:48:09.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 msgr2=0x5591e2ed89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 0x5591e2ed89e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f25a4094d00 tx=0x7f25a401e070 comp rx=0 tx=0).stop 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 shutdown_connections 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5591e2ed8f80 0x5591e2e9b580 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591e2ea38e0 0x5591e2ea10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5591e2ea2fc0 0x5591e2ef2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 --2- 172.21.15.100:0/2904102665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5591e2e99190 0x5591e2ed89e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.522+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 >> 172.21.15.100:0/2904102665 conn(0x5591e2e325a0 msgr2=0x5591e2ecee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.523+0000 7f259e000640 0 client.5564 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.523+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 shutdown_connections 2024-02-21T07:48:09.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.523+0000 7f25c27fb740 1 -- 172.21.15.100:0/2904102665 wait complete. 2024-02-21T07:48:09.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.523+0000 7f25c27fb740 20 client.5564 trim_cache size 0 max 16384 2024-02-21T07:48:09.530 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:48:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:48:09.530 INFO:teuthology.orchestra.run.smithi100.stdout: "a802527f-ebcc-43ec-9464-a6f3028332b2": { 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "a802527f-ebcc-43ec-9464-a6f3028332b2", 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:48:09.531 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:09.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 msgr2=0x7f25980a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 0x7f25980a15e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25b80f4270 tx=0x7f25ac009040 comp rx=0 tx=0).stop 2024-02-21T07:48:09.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 msgr2=0x7f25b8084dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c750 tx=0x7f25a400cc10 comp rx=0 tx=0).stop 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 shutdown_connections 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f259809f120 0x7f25980a15e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25b8198a00 0x7f25b818b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25b80f53e0 0x7f25b8085300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 --2- 172.21.15.100:0/3777579642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f25b806da30 0x7f25b8084dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.524+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 >> 172.21.15.100:0/3777579642 conn(0x7f25b80668b0 msgr2=0x7f25b81741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.525+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 shutdown_connections 2024-02-21T07:48:09.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:09.525+0000 7f25bfa00640 1 -- 172.21.15.100:0/3777579642 wait complete. 2024-02-21T07:48:09.556 INFO:tasks.cephfs.filesystem:scrub status for tag:a802527f-ebcc-43ec-9464-a6f3028332b2 - {'path': '/', 'tag': 'a802527f-ebcc-43ec-9464-a6f3028332b2', 'options': 'recursive,force'} 2024-02-21T07:48:12.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:12.748 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:12.751 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:13.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.646+0000 7f3538000640 1 Processor -- start 2024-02-21T07:48:13.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.647+0000 7f3538000640 1 -- start start 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.650+0000 7f3538000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f35301825f0 0x7f35300d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.650+0000 7f3538000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f35300d0d80 0x7f35300f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.650+0000 7f3538000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300d1240 con 0x7f3530189480 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.650+0000 7f3538000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300d21a0 con 0x7f35300d0d80 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.650+0000 7f3538000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35300d1520 con 0x7f35301825f0 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.651+0000 7f3536000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3530189480 0x7f353018bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50732/0 (socket says 172.21.15.100:50732) 2024-02-21T07:48:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.651+0000 7f3536000640 1 -- 172.21.15.100:0/4240082042 learned_addr learned my addr 172.21.15.100:0/4240082042 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.651+0000 7f3534c00640 1 --2- 172.21.15.100:0/4240082042 >> v2:172.21.15.100:3300/0 conn(0x7f35300d0d80 0x7f35300f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.652+0000 7f3535600640 1 --2- 172.21.15.100:0/4240082042 >> v2:172.21.15.156:3300/0 conn(0x7f35301825f0 0x7f35300d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.652+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351224434 0 0) 0x7f35300d1240 con 0x7f3530189480 2024-02-21T07:48:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.652+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003520 con 0x7f3530189480 2024-02-21T07:48:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.652+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263738432 0 0) 0x7f3518003520 con 0x7f3530189480 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 >> v2:172.21.15.156:3300/0 conn(0x7f35301825f0 msgr2=0x7f35300d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 --2- 172.21.15.100:0/4240082042 >> v2:172.21.15.156:3300/0 conn(0x7f35301825f0 0x7f35300d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 >> v2:172.21.15.100:3300/0 conn(0x7f35300d0d80 msgr2=0x7f35300f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 --2- 172.21.15.100:0/4240082042 >> v2:172.21.15.100:3300/0 conn(0x7f35300d0d80 0x7f35300f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300d1800 con 0x7f3530189480 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f35280019f0 con 0x7f3530189480 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 >> v1:172.21.15.100:6789/0 conn(0x7f3530189480 legacy=0x7f353018bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f3518003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35180047c0 0x7f3518004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3518005180 0x7f351800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300d21a0 con 0x7f35180047c0 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35300d1520 con 0x7f3518005180 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351800c150 con 0x7f35180039c0 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.653+0000 7f3534c00640 1 --2- 172.21.15.100:0/4240082042 >> v2:172.21.15.100:3300/0 conn(0x7f35300d0d80 0x7f35300f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.654+0000 7f3535600640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f3518003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.654+0000 7f3536000640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3518005180 0x7f351800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3535600640 1 -- 172.21.15.100:0/4240082042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3518005180 msgr2=0x7f351800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3535600640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3518005180 0x7f351800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3535600640 1 -- 172.21.15.100:0/4240082042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35180047c0 msgr2=0x7f3518004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3535600640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35180047c0 0x7f3518004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3535600640 1 -- 172.21.15.100:0/4240082042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300d1800 con 0x7f35180039c0 2024-02-21T07:48:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.655+0000 7f3536000640 1 -- 172.21.15.100:0/4240082042 reap_dead start 2024-02-21T07:48:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.656+0000 7f3535600640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f3518003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba30 tx=0x7f35180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9fe23624f946df2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.657+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524032650 con 0x7f35180039c0 2024-02-21T07:48:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.657+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240327b0 con 0x7f35180039c0 2024-02-21T07:48:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.657+0000 7f352fe00640 1 -- 172.21.15.100:0/4240082042 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524032b40 con 0x7f35180039c0 2024-02-21T07:48:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 -- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 msgr2=0x7f3518003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f3518003de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba30 tx=0x7f35180057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 -- 172.21.15.100:0/4240082042 shutdown_connections 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 --2- 172.21.15.100:0/4240082042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f3518003de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 -- 172.21.15.100:0/4240082042 >> 172.21.15.100:0/4240082042 conn(0x7f35300615c0 msgr2=0x7f35300619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 -- 172.21.15.100:0/4240082042 shutdown_connections 2024-02-21T07:48:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.658+0000 7f3538000640 1 -- 172.21.15.100:0/4240082042 wait complete. 2024-02-21T07:48:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.665+0000 7f3538000640 1 Processor -- start 2024-02-21T07:48:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.667+0000 7f3538000640 1 -- start start 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35302208f0 0x7f35300cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300ccf20 0x7f353018a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530179d10 con 0x7f35300ccf20 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530220eb0 con 0x7f35302208f0 2024-02-21T07:48:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.669+0000 7f3538000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3530221190 con 0x7f35180039c0 2024-02-21T07:48:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53922/0 (socket says 172.21.15.100:53922) 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 -- 172.21.15.100:0/3603811289 learned_addr learned my addr 172.21.15.100:0/3603811289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 -- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35302208f0 msgr2=0x7f35300cc9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35302208f0 0x7f35300cc9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.670+0000 7f3535600640 1 -- 172.21.15.100:0/3603811289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300ccf20 msgr2=0x7f353018a320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.672+0000 7f3536000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300ccf20 0x7f353018a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.673+0000 7f3535600640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300ccf20 0x7f353018a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.673+0000 7f3535600640 1 -- 172.21.15.100:0/3603811289 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300d2740 con 0x7f35180039c0 2024-02-21T07:48:13.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.674+0000 7f3535600640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba30 tx=0x7f3524004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.678+0000 7f352d600640 1 -- 172.21.15.100:0/3603811289 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524032e10 con 0x7f35180039c0 2024-02-21T07:48:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.678+0000 7f352d600640 1 -- 172.21.15.100:0/3603811289 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352403b630 con 0x7f35180039c0 2024-02-21T07:48:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.678+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3530221470 con 0x7f35180039c0 2024-02-21T07:48:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.678+0000 7f352d600640 1 -- 172.21.15.100:0/3603811289 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352403b9a0 con 0x7f35180039c0 2024-02-21T07:48:13.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.678+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3530221a30 con 0x7f35180039c0 2024-02-21T07:48:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.691+0000 7f352d600640 1 -- 172.21.15.100:0/3603811289 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f352402e070 con 0x7f35180039c0 2024-02-21T07:48:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.694+0000 7f353ad7a740 1 Processor -- start 2024-02-21T07:48:13.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.695+0000 7f352d600640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 0x7f35100a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.696+0000 7f353ad7a740 1 -- start start 2024-02-21T07:48:13.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.696+0000 7f352d600640 1 -- 172.21.15.100:0/3603811289 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f35240eb950 con 0x7f35180039c0 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.698+0000 7f3536000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 0x7f35100a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.698+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.699+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200226ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.699+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 0x5620022a7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.699+0000 7f353ad7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562002227620 con 0x56200226bf90 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.699+0000 7f353ad7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620021d98c0 con 0x5620022a7070 2024-02-21T07:48:13.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.699+0000 7f353ad7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620021d6df0 con 0x5620022db4d0 2024-02-21T07:48:13.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.700+0000 7f3535600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.700+0000 7f3535600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:52612/0 (socket says 172.21.15.100:52612) 2024-02-21T07:48:13.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3535600640 1 -- 172.21.15.100:0/4237935807 learned_addr learned my addr 172.21.15.100:0/4237935807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:13.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3534c00640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200226ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3536000640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 0x5620022a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3535600640 1 -- 172.21.15.100:0/4237935807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 msgr2=0x56200226ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3535600640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200226ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.701+0000 7f3535600640 1 -- 172.21.15.100:0/4237935807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 msgr2=0x5620022a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.702+0000 7f3535600640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 0x5620022a7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.703+0000 7f3535600640 1 -- 172.21.15.100:0/4237935807 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562002153b00 con 0x5620022a7070 2024-02-21T07:48:13.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.703+0000 7f3536000640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 0x5620022a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:13.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.703+0000 7f3535600640 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35240b93c0 tx=0x7f35240b90a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da6b23e5f66e83a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.707+0000 7f3521c00640 1 -- 172.21.15.100:0/4237935807 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240b9430 con 0x5620022a7070 2024-02-21T07:48:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.707+0000 7f3521c00640 1 -- 172.21.15.100:0/4237935807 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240bd580 con 0x5620022a7070 2024-02-21T07:48:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.707+0000 7f3521c00640 1 -- 172.21.15.100:0/4237935807 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240c1bd0 con 0x5620022a7070 2024-02-21T07:48:13.716 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.707+0000 7f3536000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 0x7f35100a16b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3530091800 tx=0x7f35280013e0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.714+0000 7f353ad7a740 1 -- 172.21.15.100:0/4237935807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 msgr2=0x562002266440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.714+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f35240b93c0 tx=0x7f35240b90a0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.716+0000 7f353ad7a740 1 -- 172.21.15.100:0/4237935807 shutdown_connections 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.716+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56200226bf90 0x5620022a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.716+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200226ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.716+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4237935807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022a7070 0x562002266440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.716+0000 7f353ad7a740 1 -- 172.21.15.100:0/4237935807 >> 172.21.15.100:0/4237935807 conn(0x5620022334b0 msgr2=0x56200226aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.717+0000 7f353ad7a740 1 -- 172.21.15.100:0/4237935807 shutdown_connections 2024-02-21T07:48:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.717+0000 7f353ad7a740 1 -- 172.21.15.100:0/4237935807 wait complete. 2024-02-21T07:48:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.719+0000 7f353ad7a740 1 -- start start 2024-02-21T07:48:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.720+0000 7f353ad7a740 1 Processor -- start 2024-02-21T07:48:13.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 0x5620022d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f3535600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 0x5620022d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 0x5620022ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620021d25d0 con 0x5620022a7070 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562002177b50 con 0x5620022db4d0 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.723+0000 7f353ad7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620021777f0 con 0x56200226bf90 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.724+0000 7f3534c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.724+0000 7f3534c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60028/0 (socket says 172.21.15.100:60028) 2024-02-21T07:48:13.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.724+0000 7f3534c00640 1 -- 172.21.15.100:0/4010816267 learned_addr learned my addr 172.21.15.100:0/4010816267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.725+0000 7f353ad7a740 10 client.0 _ll_register_callbacks cb 0x56200218b550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:13.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.725+0000 7f3536000640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 0x5620022ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3534c00640 1 -- 172.21.15.100:0/4010816267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 msgr2=0x5620022d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3534c00640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 0x5620022d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3534c00640 1 -- 172.21.15.100:0/4010816267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 msgr2=0x5620022ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3534c00640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 0x5620022ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3534c00640 1 -- 172.21.15.100:0/4010816267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3530221a30 con 0x5620022a7070 2024-02-21T07:48:13.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3536000640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 0x5620022ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:13.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.726+0000 7f3535600640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 0x5620022d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:13.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.727+0000 7f3534c00640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f351c009f00 tx=0x7f351c0105c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6877379db3ed5f6d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.727+0000 7f3516000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:13.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.728+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c015670 con 0x5620022a7070 2024-02-21T07:48:13.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.728+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f351c0157d0 con 0x5620022a7070 2024-02-21T07:48:13.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.729+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620021a4cd0 con 0x5620022a7070 2024-02-21T07:48:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.729+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f351c010ec0 con 0x5620022a7070 2024-02-21T07:48:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.729+0000 7f353ad7a740 10 client.5466 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.729+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5620021d0c50 con 0x5620022a7070 2024-02-21T07:48:13.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.730+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5620021a4cd0 con 0x5620022a7070 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.730+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f351c015990 con 0x5620022a7070 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.730+0000 7f353ad7a740 10 client.5466 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.731+0000 7f353ad7a740 10 client.5466 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.731+0000 7f353ad7a740 20 client.5466 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.731+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ee840 0x5620022eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.731+0000 7f353ad7a740 4 client.5466 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.731+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620021c8ce0 con 0x5620022ee840 2024-02-21T07:48:13.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.732+0000 7f3535600640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ee840 0x5620022eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.742 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.732+0000 7f3516000640 10 client.5466 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:13.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.737+0000 7f3535600640 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ee840 0x5620022eec20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef5726e6c82b57 server_cookie=4f65ae837bb3148d in_seq=0 out_seq=0 2024-02-21T07:48:13.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.739+0000 7f3516000640 1 -- 172.21.15.100:0/4010816267 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f35240e2e90 con 0x5620022ee840 2024-02-21T07:48:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.739+0000 7f3516000640 10 client.5466 handle_command_reply: tid=0 2024-02-21T07:48:13.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.739+0000 7f353ad7a740 1 client.5466 shutdown 2024-02-21T07:48:13.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 msgr2=0x56200229c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f351c009f00 tx=0x7f351c0105c0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 shutdown_connections 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ee840 0x5620022eec20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5620022db4d0 0x5620022ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200229c930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 --2- 172.21.15.100:0/4010816267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56200226bf90 0x5620022d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 >> 172.21.15.100:0/4010816267 conn(0x5620022334b0 msgr2=0x5620022d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.741+0000 7f3516000640 0 client.5466 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.742+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 shutdown_connections 2024-02-21T07:48:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.744+0000 7f353ad7a740 1 -- 172.21.15.100:0/4010816267 wait complete. 2024-02-21T07:48:13.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.744+0000 7f353ad7a740 20 client.5466 trim_cache size 0 max 16384 2024-02-21T07:48:13.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.781+0000 7f353ad7a740 1 Processor -- start 2024-02-21T07:48:13.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.782+0000 7f353ad7a740 1 -- start start 2024-02-21T07:48:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.784+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x56200229c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.784+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022a7070 0x5620022690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.784+0000 7f3535600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x56200229c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.784+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f3536000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f3536000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60036/0 (socket says 172.21.15.100:60036) 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f3536000640 1 -- 172.21.15.100:0/2168329101 learned_addr learned my addr 172.21.15.100:0/2168329101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562001f1ae60 con 0x5620022db4d0 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620022ed9b0 con 0x56200226bf90 2024-02-21T07:48:13.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.785+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562002338a00 con 0x5620022a7070 2024-02-21T07:48:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.786+0000 7f3536000640 1 -- 172.21.15.100:0/2168329101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022a7070 msgr2=0x5620022690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.786+0000 7f3534c00640 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022a7070 0x5620022690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.786+0000 7f3536000640 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022a7070 0x5620022690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.786+0000 7f3536000640 1 -- 172.21.15.100:0/2168329101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 msgr2=0x56200229c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.791+0000 7f3536000640 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x56200229c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.791+0000 7f3536000640 1 -- 172.21.15.100:0/2168329101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56200216d530 con 0x5620022db4d0 2024-02-21T07:48:13.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.791+0000 7f3535600640 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x56200229c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.791+0000 7f3536000640 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f35300fb8b0 tx=0x7f3528017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b23ea01393b71e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.792+0000 7f3521200640 1 -- 172.21.15.100:0/2168329101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528022430 con 0x5620022db4d0 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.792+0000 7f3521200640 1 -- 172.21.15.100:0/2168329101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528022590 con 0x5620022db4d0 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.793+0000 7f3521200640 1 -- 172.21.15.100:0/2168329101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528022430 con 0x5620022db4d0 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.793+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 msgr2=0x56200226b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.793+0000 7f353ad7a740 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f35300fb8b0 tx=0x7f3528017000 comp rx=0 tx=0).stop 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.794+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 shutdown_connections 2024-02-21T07:48:13.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.794+0000 7f353ad7a740 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022db4d0 0x56200226b690 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.794+0000 7f353ad7a740 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022a7070 0x5620022690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.794+0000 7f353ad7a740 1 --2- 172.21.15.100:0/2168329101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x56200229c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.794+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 >> 172.21.15.100:0/2168329101 conn(0x5620022334b0 msgr2=0x5620022d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.799+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 shutdown_connections 2024-02-21T07:48:13.806 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.799+0000 7f353ad7a740 1 -- 172.21.15.100:0/2168329101 wait complete. 2024-02-21T07:48:13.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.801+0000 7f353ad7a740 1 -- start start 2024-02-21T07:48:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.801+0000 7f353ad7a740 1 Processor -- start 2024-02-21T07:48:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.803+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.803+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200232c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.803+0000 7f353ad7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200232cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.804+0000 7f353ad7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620022cd4c0 con 0x5620022a7070 2024-02-21T07:48:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.804+0000 7f353ad7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620022cd0a0 con 0x56200226bf90 2024-02-21T07:48:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.804+0000 7f353ad7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620022e4330 con 0x5620022db4d0 2024-02-21T07:48:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.804+0000 7f353ad7a740 10 client.0 _ll_register_callbacks cb 0x5620022dbdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:52642/0 (socket says 172.21.15.100:52642) 2024-02-21T07:48:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 -- 172.21.15.100:0/1544375278 learned_addr learned my addr 172.21.15.100:0/1544375278 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3534c00640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200232c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 -- 172.21.15.100:0/1544375278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 msgr2=0x56200232cd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200232cd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.805+0000 7f3535600640 1 -- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 msgr2=0x56200232c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.806+0000 7f3535600640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200232c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.806+0000 7f3535600640 1 -- 172.21.15.100:0/1544375278 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3528007790 con 0x56200226bf90 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.806+0000 7f3534c00640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200232c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.806+0000 7f3535600640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f352402bfa0 tx=0x7f352404c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb31eb2a27c786fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.806+0000 7f3516000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240c1c50 con 0x56200226bf90 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f35240b9430 con 0x56200226bf90 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620021f7d30 con 0x56200226bf90 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35240b5640 con 0x56200226bf90 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f353ad7a740 10 client.5584 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.807+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5620021932c0 con 0x56200226bf90 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5620021f7d30 con 0x56200226bf90 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f35240b5a10 con 0x56200226bf90 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 10 client.5584 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 10 client.5584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 20 client.5584 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ca260 0x56200233ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 4 client.5584 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:48:13.814 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.808+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562001ed2600 con 0x5620022ca260 2024-02-21T07:48:13.815 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.810+0000 7f3534c00640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ca260 0x56200233ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:13.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.811+0000 7f3534c00640 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ca260 0x56200233ae40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8bcf7d41974f08f server_cookie=6bdf52a175d83e14 in_seq=0 out_seq=0 2024-02-21T07:48:13.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.811+0000 7f3516000640 10 client.5584 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.863+0000 7f3516000640 1 -- 172.21.15.100:0/1544375278 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562001ed2600 con 0x5620022ca260 2024-02-21T07:48:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.863+0000 7f3516000640 10 client.5584 handle_command_reply: tid=0 2024-02-21T07:48:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.864+0000 7f353ad7a740 1 client.5584 shutdown 2024-02-21T07:48:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 msgr2=0x5620022e3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f352402bfa0 tx=0x7f352404c000 comp rx=0 tx=0).stop 2024-02-21T07:48:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 shutdown_connections 2024-02-21T07:48:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5620022ca260 0x56200233ae40 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5620022db4d0 0x56200232cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5620022a7070 0x56200232c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 --2- 172.21.15.100:0/1544375278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56200226bf90 0x5620022e3690 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.865+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 >> 172.21.15.100:0/1544375278 conn(0x5620022334b0 msgr2=0x562002267f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.873 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.866+0000 7f3516000640 0 client.5584 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.867+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 shutdown_connections 2024-02-21T07:48:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.867+0000 7f353ad7a740 1 -- 172.21.15.100:0/1544375278 wait complete. 2024-02-21T07:48:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.867+0000 7f353ad7a740 20 client.5584 trim_cache size 0 max 16384 2024-02-21T07:48:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:48:13.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.868+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 msgr2=0x7f35100a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.868+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 0x7f35100a16b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3530091800 tx=0x7f35280013e0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.868+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 msgr2=0x7f35301797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:13.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.868+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f352400ba30 tx=0x7f3524004730 comp rx=0 tx=0).stop 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 shutdown_connections 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351009f1f0 0x7f35100a16b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35300ccf20 0x7f353018a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35302208f0 0x7f35300cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 --2- 172.21.15.100:0/3603811289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35180039c0 0x7f35301797d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.870+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 >> 172.21.15.100:0/3603811289 conn(0x7f35300615c0 msgr2=0x7f35300619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.871+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 shutdown_connections 2024-02-21T07:48:13.877 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:13.871+0000 7f3538000640 1 -- 172.21.15.100:0/3603811289 wait complete. 2024-02-21T07:48:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.082+0000 7f0c1be00640 1 Processor -- start 2024-02-21T07:48:27.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.083+0000 7f0c1be00640 1 -- start start 2024-02-21T07:48:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.086+0000 7f0c1be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c1410fa00 0x7f0c14006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.086+0000 7f0c1be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c14115080 0x7f0c14115480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.086+0000 7f0c1be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c1410fe80 con 0x7f0c1410bc40 2024-02-21T07:48:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.086+0000 7f0c1be00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c14110160 con 0x7f0c1410fa00 2024-02-21T07:48:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.086+0000 7f0c1be00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c14110440 con 0x7f0c14115080 2024-02-21T07:48:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0c1410bc40 0x7f0c14056c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55822/0 (socket says 172.21.15.100:55822) 2024-02-21T07:48:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1a000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0c1410fa00 0x7f0c14006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c14115080 0x7f0c14115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c14115080 0x7f0c14115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54630/0 (socket says 172.21.15.100:54630) 2024-02-21T07:48:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 -- 172.21.15.100:0/3770628561 learned_addr learned my addr 172.21.15.100:0/3770628561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 -- 172.21.15.100:0/3770628561 >> v2:172.21.15.156:3300/0 conn(0x7f0c1410fa00 msgr2=0x7f0c14006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 --2- 172.21.15.100:0/3770628561 >> v2:172.21.15.156:3300/0 conn(0x7f0c1410fa00 0x7f0c14006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 -- 172.21.15.100:0/3770628561 >> v1:172.21.15.100:6789/0 conn(0x7f0c1410bc40 legacy=0x7f0c14056c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.087+0000 7f0c1b400640 1 -- 172.21.15.100:0/3770628561 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14110720 con 0x7f0c14115080 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.088+0000 7f0c1b400640 1 --2- 172.21.15.100:0/3770628561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c14115080 0x7f0c14115480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c062740 tx=0x7f0c1c0a6f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95e8b4df6a10079 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.088+0000 7f0c19600640 1 -- 172.21.15.100:0/3770628561 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0a7bf0 con 0x7f0c14115080 2024-02-21T07:48:27.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.088+0000 7f0c19600640 1 -- 172.21.15.100:0/3770628561 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0a7d90 con 0x7f0c14115080 2024-02-21T07:48:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.088+0000 7f0c19600640 1 -- 172.21.15.100:0/3770628561 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0af640 con 0x7f0c14115080 2024-02-21T07:48:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 -- 172.21.15.100:0/3770628561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c14115080 msgr2=0x7f0c14115480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 --2- 172.21.15.100:0/3770628561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c14115080 0x7f0c14115480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c062740 tx=0x7f0c1c0a6f90 comp rx=0 tx=0).stop 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 -- 172.21.15.100:0/3770628561 shutdown_connections 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 --2- 172.21.15.100:0/3770628561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c14115080 0x7f0c14115480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 --2- 172.21.15.100:0/3770628561 >> v2:172.21.15.156:3300/0 conn(0x7f0c1410fa00 0x7f0c14006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.089+0000 7f0c1be00640 1 -- 172.21.15.100:0/3770628561 >> 172.21.15.100:0/3770628561 conn(0x7f0c14052de0 msgr2=0x7f0c140531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.090+0000 7f0c1be00640 1 -- 172.21.15.100:0/3770628561 shutdown_connections 2024-02-21T07:48:27.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.090+0000 7f0c1be00640 1 -- 172.21.15.100:0/3770628561 wait complete. 2024-02-21T07:48:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.092+0000 7f0c1be00640 1 Processor -- start 2024-02-21T07:48:27.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.092+0000 7f0c1be00640 1 -- start start 2024-02-21T07:48:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1410bc40 0x7f0c140ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1410fa00 0x7f0c141a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1410a3b0 con 0x7f0c1410fa00 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1410a690 con 0x7f0c14115080 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1410a970 con 0x7f0c1410bc40 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56108/0 (socket says 172.21.15.100:56108) 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.093+0000 7f0c1b400640 1 -- 172.21.15.100:0/2959489460 learned_addr learned my addr 172.21.15.100:0/2959489460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 -- 172.21.15.100:0/2959489460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1410bc40 msgr2=0x7f0c140ed640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1410bc40 0x7f0c140ed640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 -- 172.21.15.100:0/2959489460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1410fa00 msgr2=0x7f0c141a9000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1410fa00 0x7f0c141a9000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 -- 172.21.15.100:0/2959489460 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c04fdd0 con 0x7f0c14115080 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c1b400640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c069aa0 tx=0x7f0c1c0643c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.094+0000 7f0c12a00640 1 -- 172.21.15.100:0/2959489460 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b8610 con 0x7f0c14115080 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.095+0000 7f0c12a00640 1 -- 172.21.15.100:0/2959489460 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0b8770 con 0x7f0c14115080 2024-02-21T07:48:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.095+0000 7f0c12a00640 1 -- 172.21.15.100:0/2959489460 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0b8b60 con 0x7f0c14115080 2024-02-21T07:48:27.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.095+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1410ac50 con 0x7f0c14115080 2024-02-21T07:48:27.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.095+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c140edb80 con 0x7f0c14115080 2024-02-21T07:48:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.102+0000 7f0c24369740 1 Processor -- start 2024-02-21T07:48:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.113+0000 7f0c12a00640 1 -- 172.21.15.100:0/2959489460 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0c1c0b6040 con 0x7f0c14115080 2024-02-21T07:48:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.115+0000 7f0c12a00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 0x7f0bfc0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.116+0000 7f0c12a00640 1 -- 172.21.15.100:0/2959489460 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c1c166ab0 con 0x7f0c14115080 2024-02-21T07:48:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.116+0000 7f0c24369740 1 -- start start 2024-02-21T07:48:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.119+0000 7f0c24369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.119+0000 7f0c1a000640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 0x7f0bfc0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.119+0000 7f0c24369740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 0x564b83ae4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c1a000640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 0x7f0bfc0a1630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c1407ad90 tx=0x7f0c08009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c24369740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83ae5150 0x564b83b20610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c24369740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83aa0620 con 0x564b83b54690 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c24369740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83a528c0 con 0x564b83ae5150 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c24369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83a4fdf0 con 0x564b83b20230 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c1aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c1aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54634/0 (socket says 172.21.15.100:54634) 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.121+0000 7f0c1aa00640 1 -- 172.21.15.100:0/2645804292 learned_addr learned my addr 172.21.15.100:0/2645804292 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.122+0000 7f0c1a000640 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 0x564b83ae4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1aa00640 1 -- 172.21.15.100:0/2645804292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83ae5150 msgr2=0x564b83b20610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83ae5150 0x564b83b20610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1aa00640 1 -- 172.21.15.100:0/2645804292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 msgr2=0x564b83ae4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 0x564b83ae4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1aa00640 1 -- 172.21.15.100:0/2645804292 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b839ccb00 con 0x564b83b20230 2024-02-21T07:48:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.126+0000 7f0c1a000640 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 0x564b83ae4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.127+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c004fa0 tx=0x7f0c0c005460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55bff03401676996 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.129+0000 7f0c07000640 1 -- 172.21.15.100:0/2645804292 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0074e0 con 0x564b83b20230 2024-02-21T07:48:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.129+0000 7f0c07000640 1 -- 172.21.15.100:0/2645804292 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c007640 con 0x564b83b20230 2024-02-21T07:48:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.130+0000 7f0c24369740 1 -- 172.21.15.100:0/2645804292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 msgr2=0x564b83adf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.130+0000 7f0c24369740 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c004fa0 tx=0x7f0c0c005460 comp rx=0 tx=0).stop 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.132+0000 7f0c24369740 1 -- 172.21.15.100:0/2645804292 shutdown_connections 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.132+0000 7f0c24369740 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83ae5150 0x564b83b20610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.132+0000 7f0c24369740 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b54690 0x564b83ae4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.132+0000 7f0c24369740 1 --2- 172.21.15.100:0/2645804292 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b20230 0x564b83adf600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.132+0000 7f0c24369740 1 -- 172.21.15.100:0/2645804292 >> 172.21.15.100:0/2645804292 conn(0x564b83aac4b0 msgr2=0x564b83ae3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.133+0000 7f0c24369740 1 -- 172.21.15.100:0/2645804292 shutdown_connections 2024-02-21T07:48:27.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.133+0000 7f0c24369740 1 -- 172.21.15.100:0/2645804292 wait complete. 2024-02-21T07:48:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.136+0000 7f0c24369740 1 -- start start 2024-02-21T07:48:27.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.136+0000 7f0c24369740 1 Processor -- start 2024-02-21T07:48:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.140+0000 7f0c24369740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 0x564b83b1c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.140+0000 7f0c24369740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b52c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.140+0000 7f0c24369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83b557b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.140+0000 7f0c1aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 0x564b83b1c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c24369740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83a4b5d0 con 0x564b83ae5150 2024-02-21T07:48:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c1a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b52c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c1b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83b557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c1a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b52c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56128/0 (socket says 172.21.15.100:56128) 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c1b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83b557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54650/0 (socket says 172.21.15.100:54650) 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c1a000640 1 -- 172.21.15.100:0/450978514 learned_addr learned my addr 172.21.15.100:0/450978514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b839f0b50 con 0x564b83b20230 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b839f07f0 con 0x564b83b54690 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.141+0000 7f0c24369740 10 client.0 _ll_register_callbacks cb 0x564b83a04550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.142+0000 7f0c1aa00640 1 -- 172.21.15.100:0/450978514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 msgr2=0x564b83b557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.142+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83b557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.142+0000 7f0c1aa00640 1 -- 172.21.15.100:0/450978514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 msgr2=0x564b83b52c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.142+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b52c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.142+0000 7f0c1aa00640 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c004ba0 con 0x564b83ae5150 2024-02-21T07:48:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.143+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 0x564b83b1c150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c014000 tx=0x7f0c0c004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c3a4b625dcad9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.143+0000 7f0bfb400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.145+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0058b0 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.145+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c0c005a10 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.145+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b83a1dcd0 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.146+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c0c00cea0 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.146+0000 7f0c24369740 10 client.5478 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.146+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b83a49c50 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b83a1dcd0 con 0x564b83ae5150 2024-02-21T07:48:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0c0c019070 con 0x564b83ae5150 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 10 client.5478 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 10 client.5478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 20 client.5478 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b1ba60 0x564b83adebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 4 client.5478 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.147+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b83a41ce0 con 0x564b83b1ba60 2024-02-21T07:48:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.148+0000 7f0c1a000640 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b1ba60 0x564b83adebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.148+0000 7f0c1a000640 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b1ba60 0x564b83adebc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23ab6cd6883fe164 server_cookie=209185f1e19bf103 in_seq=0 out_seq=0 2024-02-21T07:48:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.149+0000 7f0bfb400640 10 client.5478 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.149+0000 7f0bfb400640 1 -- 172.21.15.100:0/450978514 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b83a41ce0 con 0x564b83b1ba60 2024-02-21T07:48:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.149+0000 7f0bfb400640 10 client.5478 handle_command_reply: tid=0 2024-02-21T07:48:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.149+0000 7f0c24369740 1 client.5478 shutdown 2024-02-21T07:48:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 msgr2=0x564b83b1c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 0x564b83b1c150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c014000 tx=0x7f0c0c004930 comp rx=0 tx=0).stop 2024-02-21T07:48:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 shutdown_connections 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b1ba60 0x564b83adebc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83b557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b52c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 --2- 172.21.15.100:0/450978514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83ae5150 0x564b83b1c150 secure :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c014000 tx=0x7f0c0c004930 comp rx=0 tx=0).stop 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.150+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 >> 172.21.15.100:0/450978514 conn(0x564b83aac4b0 msgr2=0x564b83b54b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.152+0000 7f0bfb400640 0 client.5478 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.153+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 shutdown_connections 2024-02-21T07:48:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.154+0000 7f0c24369740 1 -- 172.21.15.100:0/450978514 wait complete. 2024-02-21T07:48:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.155+0000 7f0c24369740 20 client.5478 trim_cache size 0 max 16384 2024-02-21T07:48:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.173+0000 7f0c24369740 1 Processor -- start 2024-02-21T07:48:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.174+0000 7f0c24369740 1 -- start start 2024-02-21T07:48:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b20230 0x564b83ae25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 0x564b83b53930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83b44e00 con 0x564b83b20230 2024-02-21T07:48:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83793e60 con 0x564b83b54690 2024-02-21T07:48:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c24369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83ae4620 con 0x564b83b146d0 2024-02-21T07:48:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c1a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c1a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56130/0 (socket says 172.21.15.100:56130) 2024-02-21T07:48:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c1a000640 1 -- 172.21.15.100:0/1183560091 learned_addr learned my addr 172.21.15.100:0/1183560091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.175+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b20230 0x564b83ae25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1b400640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 0x564b83b53930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 -- 172.21.15.100:0/1183560091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 msgr2=0x564b83b53930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 0x564b83b53930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 -- 172.21.15.100:0/1183560091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b20230 msgr2=0x564b83ae25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b20230 0x564b83ae25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 -- 172.21.15.100:0/1183560091 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b839e6530 con 0x564b83b54690 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1b400640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 0x564b83b53930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.176+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800e980 tx=0x7f0c08015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f78f4283de91835 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.177+0000 7f0c06600640 1 -- 172.21.15.100:0/1183560091 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08015e10 con 0x564b83b54690 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.177+0000 7f0c06600640 1 -- 172.21.15.100:0/1183560091 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08028040 con 0x564b83b54690 2024-02-21T07:48:27.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.177+0000 7f0c06600640 1 -- 172.21.15.100:0/1183560091 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08022430 con 0x564b83b54690 2024-02-21T07:48:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 -- 172.21.15.100:0/1183560091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 msgr2=0x564b83ae40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800e980 tx=0x7f0c08015000 comp rx=0 tx=0).stop 2024-02-21T07:48:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 -- 172.21.15.100:0/1183560091 shutdown_connections 2024-02-21T07:48:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b146d0 0x564b83b53930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b54690 0x564b83ae40e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 --2- 172.21.15.100:0/1183560091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b20230 0x564b83ae25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 -- 172.21.15.100:0/1183560091 >> 172.21.15.100:0/1183560091 conn(0x564b83aac4b0 msgr2=0x564b83b529d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 -- 172.21.15.100:0/1183560091 shutdown_connections 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.178+0000 7f0c24369740 1 -- 172.21.15.100:0/1183560091 wait complete. 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.180+0000 7f0c24369740 1 -- start start 2024-02-21T07:48:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.180+0000 7f0c24369740 1 Processor -- start 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b1be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83bc2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83bbf570 con 0x564b83b146d0 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83b1c3b0 con 0x564b83b20230 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b83bc2720 con 0x564b83b54690 2024-02-21T07:48:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.182+0000 7f0c24369740 10 client.0 _ll_register_callbacks cb 0x7f0c0c007d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50570/0 (socket says 172.21.15.100:50570) 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 -- 172.21.15.100:0/1353820683 learned_addr learned my addr 172.21.15.100:0/1353820683 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b1be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 -- 172.21.15.100:0/1353820683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 msgr2=0x564b83bc2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83bc2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 -- 172.21.15.100:0/1353820683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 msgr2=0x564b83b1be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b1be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.188 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.183+0000 7f0c1aa00640 1 -- 172.21.15.100:0/1353820683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0801a040 con 0x564b83b146d0 2024-02-21T07:48:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.184+0000 7f0c1aa00640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x564b83b57370 tx=0x7f0c0c007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af2e6d7d65ce19 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.184+0000 7f0bfb400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.184+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00c4b0 con 0x564b83b146d0 2024-02-21T07:48:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.184+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c0c000e40 con 0x564b83b146d0 2024-02-21T07:48:27.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.184+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b83a70d30 con 0x564b83b146d0 2024-02-21T07:48:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.185+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c0c0075f0 con 0x564b83b146d0 2024-02-21T07:48:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.185+0000 7f0c24369740 10 client.5484 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.185+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b83a0c2c0 con 0x564b83b146d0 2024-02-21T07:48:27.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.185+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b83a70d30 con 0x564b83b146d0 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0c0c049070 con 0x564b83b146d0 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 10 client.5484 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 10 client.5484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 20 client.5484 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b755d0 0x564b83ba7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 4 client.5484 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:48:27.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.187+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b8374b600 con 0x564b83b755d0 2024-02-21T07:48:27.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.194+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b755d0 0x564b83ba7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.196+0000 7f0c1a000640 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b755d0 0x564b83ba7e70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ca27ea2edc66324 server_cookie=2a4ed90b93dc4e85 in_seq=0 out_seq=0 2024-02-21T07:48:27.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.196+0000 7f0bfb400640 10 client.5484 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.234+0000 7f0bfb400640 1 -- 172.21.15.100:0/1353820683 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b8374b600 con 0x564b83b755d0 2024-02-21T07:48:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.234+0000 7f0bfb400640 10 client.5484 handle_command_reply: tid=0 2024-02-21T07:48:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.234+0000 7f0c24369740 1 client.5484 shutdown 2024-02-21T07:48:27.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.236+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 msgr2=0x564b83bac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.236+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x564b83b57370 tx=0x7f0c0c007ea0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 shutdown_connections 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b83b755d0 0x564b83ba7e70 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b83b54690 0x564b83bc2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b83b20230 0x564b83b1be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 --2- 172.21.15.100:0/1353820683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b83b146d0 0x564b83bac2c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.237+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 >> 172.21.15.100:0/1353820683 conn(0x564b83aac4b0 msgr2=0x564b83b567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.238+0000 7f0bfb400640 0 client.5484 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.238+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 shutdown_connections 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.238+0000 7f0c24369740 1 -- 172.21.15.100:0/1353820683 wait complete. 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.238+0000 7f0c24369740 20 client.5484 trim_cache size 0 max 16384 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:48:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:48:27.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.239+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 msgr2=0x7f0bfc0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.239+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 0x7f0bfc0a1630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c1407ad90 tx=0x7f0c08009190 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.239+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 msgr2=0x7f0c141a9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.239+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c069aa0 tx=0x7f0c1c0643c0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 shutdown_connections 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c14115080 0x7f0c141a9540 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0bfc09f170 0x7f0bfc0a1630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1410fa00 0x7f0c141a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 --2- 172.21.15.100:0/2959489460 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c1410bc40 0x7f0c140ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 >> 172.21.15.100:0/2959489460 conn(0x7f0c14052de0 msgr2=0x7f0c14051730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 shutdown_connections 2024-02-21T07:48:27.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:27.240+0000 7f0c1be00640 1 -- 172.21.15.100:0/2959489460 wait complete. 2024-02-21T07:48:39.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:48:39.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:48:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.919+0000 7fef37a00640 1 Processor -- start 2024-02-21T07:48:39.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.923+0000 7fef37a00640 1 -- start start 2024-02-21T07:48:39.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.926+0000 7fef37a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef3006edc0 0x7fef30190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.926+0000 7fef37a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3018dc80 con 0x7fef30190260 2024-02-21T07:48:39.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.926+0000 7fef37a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300f55d0 con 0x7fef30070a30 2024-02-21T07:48:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.926+0000 7fef37a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300f5b90 con 0x7fef3006edc0 2024-02-21T07:48:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.927+0000 7fef35a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef3006edc0 0x7fef30190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.927+0000 7fef35a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fef3006edc0 0x7fef30190640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39290/0 (socket says 172.21.15.100:39290) 2024-02-21T07:48:39.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.927+0000 7fef35a00640 1 -- 172.21.15.100:0/109860505 learned_addr learned my addr 172.21.15.100:0/109860505 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:39.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.928+0000 7fef35a00640 1 -- 172.21.15.100:0/109860505 >> v1:172.21.15.156:6789/0 conn(0x7fef30070a30 legacy=0x7fef3006e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:39.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.928+0000 7fef35a00640 1 -- 172.21.15.100:0/109860505 >> v1:172.21.15.100:6789/0 conn(0x7fef30190260 legacy=0x7fef300f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:39.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.928+0000 7fef35a00640 1 -- 172.21.15.100:0/109860505 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300f58b0 con 0x7fef3006edc0 2024-02-21T07:48:39.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.930+0000 7fef35a00640 1 --2- 172.21.15.100:0/109860505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef3006edc0 0x7fef30190640 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef28009e50 tx=0x7fef2802bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aee72081d474ac2d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:39.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.930+0000 7fef2f400640 1 -- 172.21.15.100:0/109860505 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2802c7b0 con 0x7fef3006edc0 2024-02-21T07:48:39.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.931+0000 7fef2f400640 1 -- 172.21.15.100:0/109860505 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2802c910 con 0x7fef3006edc0 2024-02-21T07:48:39.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.931+0000 7fef2f400640 1 -- 172.21.15.100:0/109860505 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2802cca0 con 0x7fef3006edc0 2024-02-21T07:48:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.931+0000 7fef37a00640 1 -- 172.21.15.100:0/109860505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef3006edc0 msgr2=0x7fef30190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.931+0000 7fef37a00640 1 --2- 172.21.15.100:0/109860505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef3006edc0 0x7fef30190640 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fef28009e50 tx=0x7fef2802bc90 comp rx=0 tx=0).stop 2024-02-21T07:48:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.932+0000 7fef37a00640 1 -- 172.21.15.100:0/109860505 shutdown_connections 2024-02-21T07:48:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.932+0000 7fef37a00640 1 --2- 172.21.15.100:0/109860505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef3006edc0 0x7fef30190640 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.932+0000 7fef37a00640 1 -- 172.21.15.100:0/109860505 >> 172.21.15.100:0/109860505 conn(0x7fef300668b0 msgr2=0x7fef30066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.935+0000 7fef37a00640 1 -- 172.21.15.100:0/109860505 shutdown_connections 2024-02-21T07:48:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.937+0000 7fef37a00640 1 -- 172.21.15.100:0/109860505 wait complete. 2024-02-21T07:48:39.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.939+0000 7fef37a00640 1 Processor -- start 2024-02-21T07:48:39.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.940+0000 7fef37a00640 1 -- start start 2024-02-21T07:48:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30070a30 0x7fef30221020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef30223d50 0x7fef300cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef301738e0 con 0x7fef30190260 2024-02-21T07:48:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300cc380 con 0x7fef30223d50 2024-02-21T07:48:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.942+0000 7fef37a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300cc660 con 0x7fef30070a30 2024-02-21T07:48:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55486/0 (socket says 172.21.15.100:55486) 2024-02-21T07:48:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 -- 172.21.15.100:0/1596443914 learned_addr learned my addr 172.21.15.100:0/1596443914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef35a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef30223d50 0x7fef300cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 -- 172.21.15.100:0/1596443914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30070a30 msgr2=0x7fef30221020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30070a30 0x7fef30221020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 -- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef30223d50 msgr2=0x7fef300cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.943+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef30223d50 0x7fef300cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.944+0000 7fef2fe00640 1 -- 172.21.15.100:0/1596443914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef28009b30 con 0x7fef30190260 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.944+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef2400b3f0 tx=0x7fef2400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.944+0000 7fef2cc00640 1 -- 172.21.15.100:0/1596443914 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011830 con 0x7fef30190260 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.944+0000 7fef2cc00640 1 -- 172.21.15.100:0/1596443914 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24011990 con 0x7fef30190260 2024-02-21T07:48:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.944+0000 7fef2cc00640 1 -- 172.21.15.100:0/1596443914 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24011d40 con 0x7fef30190260 2024-02-21T07:48:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.945+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300cc940 con 0x7fef30190260 2024-02-21T07:48:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.946+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300ccf00 con 0x7fef30190260 2024-02-21T07:48:39.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.949+0000 7fef2cc00640 1 -- 172.21.15.100:0/1596443914 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fef2401a400 con 0x7fef30190260 2024-02-21T07:48:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.950+0000 7fef2cc00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 0x7fef100a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.951+0000 7fef2cc00640 1 -- 172.21.15.100:0/1596443914 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fef240c9bb0 con 0x7fef30190260 2024-02-21T07:48:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.951+0000 7fef35000640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 0x7fef100a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.952+0000 7fef35000640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 0x7fef100a1660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef30183e20 tx=0x7fef1c007990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:39.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.954+0000 7fef3a5f8740 1 Processor -- start 2024-02-21T07:48:39.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.955+0000 7fef3a5f8740 1 -- start start 2024-02-21T07:48:39.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.957+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 0x556b47d94a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.957+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.958+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.958+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47c96150 con 0x556b47d94f80 2024-02-21T07:48:39.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.958+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47c93680 con 0x556b47d5f8e0 2024-02-21T07:48:39.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.958+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47c8ee60 con 0x556b47d5efc0 2024-02-21T07:48:39.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.958+0000 7fef35000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 0x556b47d94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 0x556b47d94a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50898/0 (socket says 172.21.15.100:50898) 2024-02-21T07:48:39.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35000640 1 -- 172.21.15.100:0/264769975 learned_addr learned my addr 172.21.15.100:0/264769975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:39.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef2fe00640 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 -- 172.21.15.100:0/264769975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 msgr2=0x556b47d94a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 0x556b47d94a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 -- 172.21.15.100:0/264769975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 msgr2=0x556b47d5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.959+0000 7fef35a00640 1 -- 172.21.15.100:0/264769975 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b47c48060 con 0x556b47d5f8e0 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.960+0000 7fef35a00640 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d21ef0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fef30074ae0 tx=0x7fef2802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b3c9795c137ba3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:39.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.960+0000 7fef21600640 1 -- 172.21.15.100:0/264769975 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2802cb40 con 0x556b47d5f8e0 2024-02-21T07:48:39.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.960+0000 7fef21600640 1 -- 172.21.15.100:0/264769975 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2802cca0 con 0x556b47d5f8e0 2024-02-21T07:48:39.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.960+0000 7fef21600640 1 -- 172.21.15.100:0/264769975 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2802cb40 con 0x556b47d5f8e0 2024-02-21T07:48:39.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.961+0000 7fef3a5f8740 1 -- 172.21.15.100:0/264769975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 msgr2=0x556b47d21ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.961+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d21ef0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fef30074ae0 tx=0x7fef2802e000 comp rx=0 tx=0).stop 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.961+0000 7fef3a5f8740 1 -- 172.21.15.100:0/264769975 shutdown_connections 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.961+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d21ef0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.962+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.962+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/264769975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5efc0 0x556b47d94a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.962+0000 7fef3a5f8740 1 -- 172.21.15.100:0/264769975 >> 172.21.15.100:0/264769975 conn(0x556b47cee5a0 msgr2=0x556b47d25eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.962+0000 7fef3a5f8740 1 -- 172.21.15.100:0/264769975 shutdown_connections 2024-02-21T07:48:39.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.962+0000 7fef3a5f8740 1 -- 172.21.15.100:0/264769975 wait complete. 2024-02-21T07:48:39.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.964+0000 7fef3a5f8740 1 -- start start 2024-02-21T07:48:39.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.964+0000 7fef3a5f8740 1 Processor -- start 2024-02-21T07:48:39.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47c33ec0 con 0x556b47d94f80 2024-02-21T07:48:39.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47c33b60 con 0x556b47d5efc0 2024-02-21T07:48:39.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b479fd1c0 con 0x556b47d5f8e0 2024-02-21T07:48:39.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.968+0000 7fef3a5f8740 10 client.0 _ll_register_callbacks cb 0x556b47c47960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:39.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.969+0000 7fef35000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.969+0000 7fef35000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39314/0 (socket says 172.21.15.100:39314) 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.969+0000 7fef35000640 1 -- 172.21.15.100:0/1575853492 learned_addr learned my addr 172.21.15.100:0/1575853492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.969+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.969+0000 7fef35a00640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 -- 172.21.15.100:0/1575853492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 msgr2=0x556b47d5e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:39.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d5e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 -- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 msgr2=0x556b47d5cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 -- 172.21.15.100:0/1575853492 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300f58b0 con 0x556b47d5efc0 2024-02-21T07:48:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35a00640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:39.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef35000640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fef1c003fc0 tx=0x7fef1c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5c87f0f6536446 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:39.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.970+0000 7fef16000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.975+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c01d040 con 0x556b47d5efc0 2024-02-21T07:48:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.975+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b4798e7e0 con 0x556b47d5efc0 2024-02-21T07:48:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.975+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fef1c007250 con 0x556b47d5efc0 2024-02-21T07:48:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.976+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef1c01d040 con 0x556b47d5efc0 2024-02-21T07:48:39.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.976+0000 7fef3a5f8740 10 client.5611 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:39.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.976+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556b47c8d4e0 con 0x556b47d5efc0 2024-02-21T07:48:39.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.978+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556b4798e7e0 con 0x556b47d5efc0 2024-02-21T07:48:39.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.978+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fef1c007410 con 0x556b47d5efc0 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 10 client.5611 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 10 client.5611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 20 client.5611 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d2d7b0 0x556b47d20d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 4 client.5611 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.984+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b479cb720 con 0x556b47d2d7b0 2024-02-21T07:48:39.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.985+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d2d7b0 0x556b47d20d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.986+0000 7fef2fe00640 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d2d7b0 0x556b47d20d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a98f49f3569f36 server_cookie=ce91ba37486d9eec in_seq=0 out_seq=0 2024-02-21T07:48:39.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.986+0000 7fef16000640 10 client.5611 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:39.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.987+0000 7fef16000640 1 -- 172.21.15.100:0/1575853492 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b479cb720 con 0x556b47d2d7b0 2024-02-21T07:48:39.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.988+0000 7fef16000640 10 client.5611 handle_command_reply: tid=0 2024-02-21T07:48:39.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.988+0000 7fef3a5f8740 1 client.5611 shutdown 2024-02-21T07:48:39.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.988+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 msgr2=0x556b47d54dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.988+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fef1c003fc0 tx=0x7fef1c000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 shutdown_connections 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d2d7b0 0x556b47d20d20 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef16000640 0 client.5611 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d94f80 0x556b47d5cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d5e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/1575853492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47d54dd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:39.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 >> 172.21.15.100:0/1575853492 conn(0x556b47cee5a0 msgr2=0x556b47d94810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 shutdown_connections 2024-02-21T07:48:39.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.992+0000 7fef3a5f8740 1 -- 172.21.15.100:0/1575853492 wait complete. 2024-02-21T07:48:39.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:39.994+0000 7fef3a5f8740 20 client.5611 trim_cache size 0 max 16384 2024-02-21T07:48:40.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.026+0000 7fef3a5f8740 1 Processor -- start 2024-02-21T07:48:40.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.026+0000 7fef3a5f8740 1 -- start start 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d2d7b0 0x556b47daeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47d2c930 con 0x556b47d5efc0 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47d91530 con 0x556b47d5f8e0 2024-02-21T07:48:40.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.028+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47d2c6e0 con 0x556b47d2d7b0 2024-02-21T07:48:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef35a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef35a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d23b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39316/0 (socket says 172.21.15.100:39316) 2024-02-21T07:48:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef35a00640 1 -- 172.21.15.100:0/86798262 learned_addr learned my addr 172.21.15.100:0/86798262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55524/0 (socket says 172.21.15.100:55524) 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef35000640 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d2d7b0 0x556b47daeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 -- 172.21.15.100:0/86798262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d2d7b0 msgr2=0x556b47daeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d2d7b0 0x556b47daeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 -- 172.21.15.100:0/86798262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 msgr2=0x556b47d23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d23b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.029+0000 7fef2fe00640 1 -- 172.21.15.100:0/86798262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b47c29950 con 0x556b47d5efc0 2024-02-21T07:48:40.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.030+0000 7fef2fe00640 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef240c7600 tx=0x7fef240c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa43658cd476549a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.031+0000 7fef20c00640 1 -- 172.21.15.100:0/86798262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef240959f0 con 0x556b47d5efc0 2024-02-21T07:48:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.031+0000 7fef20c00640 1 -- 172.21.15.100:0/86798262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef24093d60 con 0x556b47d5efc0 2024-02-21T07:48:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.031+0000 7fef20c00640 1 -- 172.21.15.100:0/86798262 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24093ed0 con 0x556b47d5efc0 2024-02-21T07:48:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.032+0000 7fef3a5f8740 1 -- 172.21.15.100:0/86798262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 msgr2=0x556b47d23530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.032+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef240c7600 tx=0x7fef240c9040 comp rx=0 tx=0).stop 2024-02-21T07:48:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 -- 172.21.15.100:0/86798262 shutdown_connections 2024-02-21T07:48:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5f8e0 0x556b47d23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d5efc0 0x556b47d23530 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/86798262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d2d7b0 0x556b47daeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 -- 172.21.15.100:0/86798262 >> 172.21.15.100:0/86798262 conn(0x556b47cee5a0 msgr2=0x556b47d5dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.035+0000 7fef3a5f8740 1 -- 172.21.15.100:0/86798262 shutdown_connections 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.036+0000 7fef3a5f8740 1 -- 172.21.15.100:0/86798262 wait complete. 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.037+0000 7fef3a5f8740 1 -- start start 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.037+0000 7fef3a5f8740 1 Processor -- start 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d2d7b0 0x556b47d23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d98940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47e16660 con 0x556b47d2d7b0 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47e13120 con 0x556b47d5efc0 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b47d4aad0 con 0x556b47d5f8e0 2024-02-21T07:48:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.039+0000 7fef3a5f8740 10 client.0 _ll_register_callbacks cb 0x556b47d67f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.040+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.040+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39326/0 (socket says 172.21.15.100:39326) 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.040+0000 7fef2fe00640 1 -- 172.21.15.100:0/361691418 learned_addr learned my addr 172.21.15.100:0/361691418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef35a00640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d98940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef2fe00640 1 -- 172.21.15.100:0/361691418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 msgr2=0x556b47d98940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef2fe00640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d98940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef2fe00640 1 -- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d2d7b0 msgr2=0x556b47d23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef2fe00640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d2d7b0 0x556b47d23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.041+0000 7fef2fe00640 1 -- 172.21.15.100:0/361691418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef300ccf00 con 0x556b47d5efc0 2024-02-21T07:48:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.042+0000 7fef2fe00640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fef24097fa0 tx=0x7fef1c010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876140926629f842 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.042+0000 7fef16000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.043+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24096b40 con 0x556b47d5efc0 2024-02-21T07:48:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.043+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fef24096ca0 con 0x556b47d5efc0 2024-02-21T07:48:40.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.044+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b47d2d640 con 0x556b47d5efc0 2024-02-21T07:48:40.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.045+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef24096b40 con 0x556b47d5efc0 2024-02-21T07:48:40.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.045+0000 7fef3a5f8740 10 client.5617 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:40.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.045+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x556b47c4f430 con 0x556b47d5efc0 2024-02-21T07:48:40.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.046+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240bb080 con 0x556b47d5efc0 2024-02-21T07:48:40.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.046+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fef240b60b0 con 0x556b47d5efc0 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 10 client.5617 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 10 client.5617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 20 client.5617 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d94f80 0x556b47e16a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 4 client.5617 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:48:40.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fef2802cca0 con 0x556b47d94f80 2024-02-21T07:48:40.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.047+0000 7fef35000640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d94f80 0x556b47e16a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.048+0000 7fef35000640 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d94f80 0x556b47e16a80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3585eb890068ffc server_cookie=6ffcba3e325d4b09 in_seq=0 out_seq=0 2024-02-21T07:48:40.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.048+0000 7fef16000640 10 client.5617 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.048+0000 7fef16000640 1 -- 172.21.15.100:0/361691418 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fef2802cca0 con 0x556b47d94f80 2024-02-21T07:48:40.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.048+0000 7fef16000640 10 client.5617 handle_command_reply: tid=0 2024-02-21T07:48:40.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.048+0000 7fef3a5f8740 1 client.5617 shutdown 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 msgr2=0x556b47daa110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fef24097fa0 tx=0x7fef1c010000 comp rx=0 tx=0).stop 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 shutdown_connections 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b47d94f80 0x556b47e16a80 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b47d5f8e0 0x556b47d98940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b47d5efc0 0x556b47daa110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 --2- 172.21.15.100:0/361691418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b47d2d7b0 0x556b47d23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.053+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 >> 172.21.15.100:0/361691418 conn(0x556b47cee5a0 msgr2=0x556b47da3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.054+0000 7fef16000640 0 client.5617 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.054+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 shutdown_connections 2024-02-21T07:48:40.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.054+0000 7fef3a5f8740 1 -- 172.21.15.100:0/361691418 wait complete. 2024-02-21T07:48:40.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.055+0000 7fef3a5f8740 20 client.5617 trim_cache size 0 max 16384 2024-02-21T07:48:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:40.060 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:48:40.060 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:48:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 msgr2=0x7fef100a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 0x7fef100a1660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fef30183e20 tx=0x7fef1c007990 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 msgr2=0x7fef301733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef2400b3f0 tx=0x7fef2400b8b0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 shutdown_connections 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef30223d50 0x7fef300cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fef1009f1a0 0x7fef100a1660 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef30190260 0x7fef301733a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 --2- 172.21.15.100:0/1596443914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fef30070a30 0x7fef30221020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 >> 172.21.15.100:0/1596443914 conn(0x7fef300668b0 msgr2=0x7fef3006e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 shutdown_connections 2024-02-21T07:48:40.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.060+0000 7fef37a00640 1 -- 172.21.15.100:0/1596443914 wait complete. 2024-02-21T07:48:40.089 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:48:40.089 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:48:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.505+0000 7f6e37200640 1 Processor -- start 2024-02-21T07:48:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.505+0000 7f6e37200640 1 -- start start 2024-02-21T07:48:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.508+0000 7f6e37200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6e2c054a90 0x7f6e2c107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.508+0000 7f6e37200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 0x7f6e2c079290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e37200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c07a250 con 0x7f6e2c106f70 2024-02-21T07:48:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e37200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c07aaf0 con 0x7f6e2c054a90 2024-02-21T07:48:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e37200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c107ab0 con 0x7f6e2c108410 2024-02-21T07:48:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e35e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6e2c106f70 0x7f6e2c054380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36082/0 (socket says 172.21.15.100:36082) 2024-02-21T07:48:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e35e00640 1 -- 172.21.15.100:0/4162923635 learned_addr learned my addr 172.21.15.100:0/4162923635 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.509+0000 7f6e35400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6e2c054a90 0x7f6e2c107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.510+0000 7f6e36800640 1 --2- 172.21.15.100:0/4162923635 >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 0x7f6e2c079290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.510+0000 7f6e35400640 1 -- 172.21.15.100:0/4162923635 >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 msgr2=0x7f6e2c079290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.510+0000 7f6e35400640 1 --2- 172.21.15.100:0/4162923635 >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 0x7f6e2c079290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.510+0000 7f6e35400640 1 -- 172.21.15.100:0/4162923635 >> v1:172.21.15.156:6789/0 conn(0x7f6e2c106f70 legacy=0x7f6e2c054380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.510+0000 7f6e35400640 1 -- 172.21.15.100:0/4162923635 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c10a590 con 0x7f6e2c054a90 2024-02-21T07:48:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.511+0000 7f6e36800640 1 --2- 172.21.15.100:0/4162923635 >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 0x7f6e2c079290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.514+0000 7f6e35400640 1 --2- 172.21.15.100:0/4162923635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c054a90 0x7f6e2c107ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c500 tx=0x7f6e2402b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308bd716977d6519 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.514+0000 7f6e34a00640 1 -- 172.21.15.100:0/4162923635 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24031710 con 0x7f6e2c054a90 2024-02-21T07:48:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.514+0000 7f6e34a00640 1 -- 172.21.15.100:0/4162923635 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2402f050 con 0x7f6e2c054a90 2024-02-21T07:48:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.514+0000 7f6e34a00640 1 -- 172.21.15.100:0/4162923635 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24031a90 con 0x7f6e2c054a90 2024-02-21T07:48:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.515+0000 7f6e37200640 1 -- 172.21.15.100:0/4162923635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c054a90 msgr2=0x7f6e2c107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.515+0000 7f6e37200640 1 --2- 172.21.15.100:0/4162923635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c054a90 0x7f6e2c107ed0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c500 tx=0x7f6e2402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.516+0000 7f6e37200640 1 -- 172.21.15.100:0/4162923635 shutdown_connections 2024-02-21T07:48:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.516+0000 7f6e37200640 1 --2- 172.21.15.100:0/4162923635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c054a90 0x7f6e2c107ed0 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c500 tx=0x7f6e2402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.516+0000 7f6e37200640 1 --2- 172.21.15.100:0/4162923635 >> v2:172.21.15.170:3300/0 conn(0x7f6e2c108410 0x7f6e2c079290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.516+0000 7f6e37200640 1 -- 172.21.15.100:0/4162923635 >> 172.21.15.100:0/4162923635 conn(0x7f6e2c052de0 msgr2=0x7f6e2c0531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.519+0000 7f6e37200640 1 -- 172.21.15.100:0/4162923635 shutdown_connections 2024-02-21T07:48:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.520+0000 7f6e37200640 1 -- 172.21.15.100:0/4162923635 wait complete. 2024-02-21T07:48:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.523+0000 7f6e37200640 1 Processor -- start 2024-02-21T07:48:40.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.523+0000 7f6e37200640 1 -- start start 2024-02-21T07:48:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.526+0000 7f6e37200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e2c106f70 0x7f6e2c1a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.526+0000 7f6e37200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c108410 0x7f6e2c1a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.526+0000 7f6e37200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e37200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0da560 con 0x7f6e2c106f70 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e37200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c052a00 con 0x7f6e2c108410 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e37200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0d9bc0 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50938/0 (socket says 172.21.15.100:50938) 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 -- 172.21.15.100:0/3167694325 learned_addr learned my addr 172.21.15.100:0/3167694325 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e35e00640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e2c106f70 0x7f6e2c1a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e35400640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c108410 0x7f6e2c1a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 -- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c108410 msgr2=0x7f6e2c1a30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c108410 0x7f6e2c1a30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 -- 172.21.15.100:0/3167694325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e2c106f70 msgr2=0x7f6e2c1a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e2c106f70 0x7f6e2c1a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.527+0000 7f6e36800640 1 -- 172.21.15.100:0/3167694325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e24009400 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.531+0000 7f6e36800640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e30069be0 tx=0x7f6e3006bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.532+0000 7feb7f200640 1 Processor -- start 2024-02-21T07:48:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.532+0000 7feb7f200640 1 -- start start 2024-02-21T07:48:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.539+0000 7f6e2a000640 1 -- 172.21.15.100:0/3167694325 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30069290 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.539+0000 7f6e2a000640 1 -- 172.21.15.100:0/3167694325 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30071050 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.539+0000 7f6e2a000640 1 -- 172.21.15.100:0/3167694325 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30073450 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.547+0000 7feb7f200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feb7410f260 0x7feb7407aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.547+0000 7feb7f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7410f640 con 0x7feb74008ac0 2024-02-21T07:48:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.548+0000 7feb7f200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb74055fd0 con 0x7feb74008f50 2024-02-21T07:48:40.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.548+0000 7feb7f200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb740562b0 con 0x7feb7410f260 2024-02-21T07:48:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.550+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c0d9ea0 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.550+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c1a35f0 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.548+0000 7feb80800640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7feb74008f50 0x7feb7410f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36092/0 (socket says 172.21.15.100:36092) 2024-02-21T07:48:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.548+0000 7feb80800640 1 -- 172.21.15.100:0/354047340 learned_addr learned my addr 172.21.15.100:0/354047340 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.548+0000 7feb7de00640 1 --2- 172.21.15.100:0/354047340 >> v2:172.21.15.170:3300/0 conn(0x7feb7410f260 0x7feb7407aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.550+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783818487 0 0) 0x7feb74055fd0 con 0x7feb74008f50 2024-02-21T07:48:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.550+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb60003520 con 0x7feb74008f50 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212738081 0 0) 0x7feb60003520 con 0x7feb74008f50 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 >> v2:172.21.15.170:3300/0 conn(0x7feb7410f260 msgr2=0x7feb7407aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 --2- 172.21.15.100:0/354047340 >> v2:172.21.15.170:3300/0 conn(0x7feb7410f260 0x7feb7407aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 >> v1:172.21.15.100:6789/0 conn(0x7feb74008ac0 legacy=0x7feb74054340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74056590 con 0x7feb74008f50 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7feb78068eb0 con 0x7feb74008f50 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 >> v1:172.21.15.156:6789/0 conn(0x7feb74008f50 legacy=0x7feb7410f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003970 0x7feb60003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600047c0 0x7feb60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb740562b0 con 0x7feb60003970 2024-02-21T07:48:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6000c0b0 con 0x7feb60005180 2024-02-21T07:48:40.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.554+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6000c270 con 0x7feb600047c0 2024-02-21T07:48:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.556+0000 7f6e3b453740 1 Processor -- start 2024-02-21T07:48:40.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.556+0000 7f6e2a000640 1 -- 172.21.15.100:0/3167694325 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6e300735b0 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.556+0000 7feb7d400640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600047c0 0x7feb60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.556+0000 7feb7de00640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003970 0x7feb60003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.556+0000 7feb80800640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.557+0000 7f6e3b453740 1 -- start start 2024-02-21T07:48:40.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.559+0000 7f6e2a000640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 0x7f6e140a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.559+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b524ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.559+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 0x5612b5250420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.559+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b528be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b524ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b524ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39362/0 (socket says 172.21.15.100:39362) 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e35e00640 1 -- 172.21.15.100:0/3978420087 learned_addr learned my addr 172.21.15.100:0/3978420087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e36800640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b528be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5203620 con 0x5612b52bfea0 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b51b58c0 con 0x5612b528ba40 2024-02-21T07:48:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b51b2df0 con 0x5612b5250960 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.560+0000 7f6e35400640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 0x7f6e140a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.561+0000 7f6e2a000640 1 -- 172.21.15.100:0/3167694325 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e301448f0 con 0x7f6e2c0f9f40 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.561+0000 7f6e35400640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 0x5612b5250420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 0x7f6e140a16b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e24035000 tx=0x7f6e2402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 -- 172.21.15.100:0/3978420087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 msgr2=0x5612b528be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b528be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 -- 172.21.15.100:0/3978420087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 msgr2=0x5612b524ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b524ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.562+0000 7f6e35400640 1 -- 172.21.15.100:0/3978420087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b512fb00 con 0x5612b52bfea0 2024-02-21T07:48:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.563+0000 7f6e36800640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b528be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.563+0000 7f6e35400640 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 0x5612b5250420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009890 tx=0x7f6e24048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125f4b9113375f69 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.559+0000 7feb80800640 1 -- 172.21.15.100:0/354047340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600047c0 msgr2=0x7feb60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.559+0000 7feb80800640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb600047c0 0x7feb60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.559+0000 7feb80800640 1 -- 172.21.15.100:0/354047340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003970 msgr2=0x7feb60003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.559+0000 7feb80800640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003970 0x7feb60003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.559+0000 7feb80800640 1 -- 172.21.15.100:0/354047340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74056590 con 0x7feb60005180 2024-02-21T07:48:40.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.565+0000 7feb80800640 1 -- 172.21.15.100:0/354047340 reap_dead start 2024-02-21T07:48:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.565+0000 7feb80800640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb6000b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb780648e0 tx=0x7feb600057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d243a3d2e465bc29 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.566+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780ae400 con 0x7feb60005180 2024-02-21T07:48:40.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.565+0000 7f6e1e600640 1 -- 172.21.15.100:0/3978420087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24045070 con 0x5612b52bfea0 2024-02-21T07:48:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.567+0000 7f6e1e600640 1 -- 172.21.15.100:0/3978420087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240044d0 con 0x5612b52bfea0 2024-02-21T07:48:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.567+0000 7f6e1e600640 1 -- 172.21.15.100:0/3978420087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24003e40 con 0x5612b52bfea0 2024-02-21T07:48:40.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.567+0000 7feb7ca00640 1 -- 172.21.15.100:0/354047340 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780aa050 con 0x7feb60005180 2024-02-21T07:48:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.568+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 msgr2=0x5612b5250420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.569+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 0x5612b5250420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009890 tx=0x7f6e24048000 comp rx=0 tx=0).stop 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.568+0000 7feb7f200640 1 -- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 msgr2=0x7feb6000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.568+0000 7feb7f200640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb6000b980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb780648e0 tx=0x7feb600057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.572+0000 7feb7f200640 1 -- 172.21.15.100:0/354047340 shutdown_connections 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.572+0000 7feb7f200640 1 --2- 172.21.15.100:0/354047340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb6000b980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.572+0000 7feb7f200640 1 -- 172.21.15.100:0/354047340 >> 172.21.15.100:0/354047340 conn(0x7feb74052fc0 msgr2=0x7feb740533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.573+0000 7feb7f200640 1 -- 172.21.15.100:0/354047340 shutdown_connections 2024-02-21T07:48:40.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.573+0000 7feb7f200640 1 -- 172.21.15.100:0/354047340 wait complete. 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 shutdown_connections 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b528be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b52bfea0 0x5612b5250420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3978420087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b524ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 >> 172.21.15.100:0/3978420087 conn(0x5612b520f4b0 msgr2=0x5612b524f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.581+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 shutdown_connections 2024-02-21T07:48:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.582+0000 7f6e3b453740 1 -- 172.21.15.100:0/3978420087 wait complete. 2024-02-21T07:48:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.585+0000 7feb7f200640 1 Processor -- start 2024-02-21T07:48:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.588+0000 7feb7f200640 1 -- start start 2024-02-21T07:48:40.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.587+0000 7f6e3b453740 1 -- start start 2024-02-21T07:48:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.595+0000 7f6e3b453740 1 Processor -- start 2024-02-21T07:48:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.608+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 0x5612b52cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.608+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.612+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b52bfea0 0x5612b52ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.612+0000 7f6e3b453740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b51ae5d0 con 0x5612b5250960 2024-02-21T07:48:40.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.612+0000 7f6e3b453740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5153b50 con 0x5612b528ba40 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.612+0000 7f6e3b453740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b51537f0 con 0x5612b52bfea0 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.613+0000 7f6e3b453740 10 client.0 _ll_register_callbacks cb 0x5612b5167550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.614+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 0x5612b52cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.614+0000 7f6e35400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.614+0000 7f6e35400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39366/0 (socket says 172.21.15.100:39366) 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.614+0000 7f6e35400640 1 -- 172.21.15.100:0/3002206104 learned_addr learned my addr 172.21.15.100:0/3002206104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.615+0000 7f6e35400640 1 -- 172.21.15.100:0/3002206104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b52bfea0 msgr2=0x5612b52ce270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.615+0000 7f6e35400640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b52bfea0 0x5612b52ce270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.615+0000 7f6e35400640 1 -- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 msgr2=0x5612b52cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.617+0000 7f6e35400640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 0x5612b52cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.617+0000 7f6e35400640 1 -- 172.21.15.100:0/3002206104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24003940 con 0x5612b528ba40 2024-02-21T07:48:40.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.617+0000 7f6e35e00640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 0x5612b52cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.619+0000 7f6e35400640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e2402b7f0 tx=0x7f6e24004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b43bc50caf1f62d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.619+0000 7f6e12a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:40.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.619+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24059070 con 0x5612b528ba40 2024-02-21T07:48:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.619+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e2404b430 con 0x5612b528ba40 2024-02-21T07:48:40.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.620+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612b5180cd0 con 0x5612b528ba40 2024-02-21T07:48:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.620+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e2404b5f0 con 0x5612b528ba40 2024-02-21T07:48:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.620+0000 7f6e3b453740 10 client.5635 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.620+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5612b51acc50 con 0x5612b528ba40 2024-02-21T07:48:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.620+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612b5180cd0 con 0x5612b528ba40 2024-02-21T07:48:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.621+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6e2405c030 con 0x5612b528ba40 2024-02-21T07:48:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.621+0000 7f6e3b453740 10 client.5635 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.621+0000 7f6e3b453740 10 client.5635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.622+0000 7f6e3b453740 20 client.5635 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.622+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b51f0 0x5612b52416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.622+0000 7f6e3b453740 4 client.5635 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.622+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612b51a4ce0 con 0x5612b52b51f0 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb741a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 0x7feb741a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741a8b10 con 0x7feb741a9e90 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741a8df0 con 0x7feb60005180 2024-02-21T07:48:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.623+0000 7feb7f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741a90d0 con 0x7feb740ed010 2024-02-21T07:48:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.626+0000 7feb7d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 0x7feb741a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.626+0000 7feb80800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.626+0000 7feb80800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50984/0 (socket says 172.21.15.100:50984) 2024-02-21T07:48:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.626+0000 7feb80800640 1 -- 172.21.15.100:0/1411732467 learned_addr learned my addr 172.21.15.100:0/1411732467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.626+0000 7f6e35e00640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b51f0 0x5612b52416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.627+0000 7feb7de00640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb741a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.628+0000 7f6e35e00640 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b51f0 0x5612b52416d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55c93fcec809911 server_cookie=77a2a6a4d04c5da8 in_seq=0 out_seq=0 2024-02-21T07:48:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.628+0000 7f6e12a00640 10 client.5635 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.629+0000 7f6e12a00640 1 -- 172.21.15.100:0/3002206104 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5612b51a4ce0 con 0x5612b52b51f0 2024-02-21T07:48:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.630+0000 7f6e12a00640 10 client.5635 handle_command_reply: tid=0 2024-02-21T07:48:40.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.630+0000 7f6e3b453740 1 client.5635 shutdown 2024-02-21T07:48:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.630+0000 7feb80800640 1 -- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 msgr2=0x7feb741a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.631+0000 7feb80800640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb741a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.631+0000 7feb80800640 1 -- 172.21.15.100:0/1411732467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 msgr2=0x7feb741a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.631+0000 7feb80800640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 0x7feb741a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.631+0000 7feb80800640 1 -- 172.21.15.100:0/1411732467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb741a93b0 con 0x7feb740ed010 2024-02-21T07:48:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.631+0000 7feb7d400640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 0x7feb741a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.633+0000 7feb80800640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb78000b60 tx=0x7feb78062950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 msgr2=0x5612b5286500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6e2402b7f0 tx=0x7f6e24004730 comp rx=0 tx=0).stop 2024-02-21T07:48:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.634+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780ae400 con 0x7feb740ed010 2024-02-21T07:48:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.634+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb780aa040 con 0x7feb740ed010 2024-02-21T07:48:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.634+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb780adab0 con 0x7feb740ed010 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 shutdown_connections 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b51f0 0x5612b52416d0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b52bfea0 0x5612b52ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b528ba40 0x5612b5286500 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 --2- 172.21.15.100:0/3002206104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b5250960 0x5612b52cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 >> 172.21.15.100:0/3002206104 conn(0x5612b520f4b0 msgr2=0x5612b52c02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.634+0000 7f6e12a00640 0 client.5635 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.635+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb741a9690 con 0x7feb740ed010 2024-02-21T07:48:40.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.635+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb741aa310 con 0x7feb740ed010 2024-02-21T07:48:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.636+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 shutdown_connections 2024-02-21T07:48:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.636+0000 7f6e3b453740 1 -- 172.21.15.100:0/3002206104 wait complete. 2024-02-21T07:48:40.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.636+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74056e10 con 0x7feb740ed010 2024-02-21T07:48:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.639+0000 7f6e3b453740 20 client.5635 trim_cache size 0 max 16384 2024-02-21T07:48:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.647+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feb780ae560 con 0x7feb740ed010 2024-02-21T07:48:40.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.651+0000 7feb72000640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 0x7feb5c0a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.652+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb78166520 con 0x7feb740ed010 2024-02-21T07:48:40.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.652+0000 7feb7de00640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 0x7feb5c0a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.654+0000 7feb7de00640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 0x7feb5c0a16e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:40.655+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb781668f0 con 0x7feb740ed010 2024-02-21T07:48:40.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.703+0000 7f6e3b453740 1 Processor -- start 2024-02-21T07:48:40.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.703+0000 7f6e3b453740 1 -- start start 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.705+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5286680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.705+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b524f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.705+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.705+0000 7f6e3b453740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b4ef6e60 con 0x5612b528ba40 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e3b453740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5286bc0 con 0x5612b52bfea0 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e3b453740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b52ce190 con 0x5612b5250960 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e36800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e36800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39396/0 (socket says 172.21.15.100:39396) 2024-02-21T07:48:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e36800640 1 -- 172.21.15.100:0/996374134 learned_addr learned my addr 172.21.15.100:0/996374134 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.706+0000 7f6e36800640 1 -- 172.21.15.100:0/996374134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 msgr2=0x5612b5286680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:40.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.707+0000 7f6e36800640 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5286680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.708+0000 7f6e36800640 1 -- 172.21.15.100:0/996374134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 msgr2=0x5612b524f630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.713+0000 7f6e35400640 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b524f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.714+0000 7f6e36800640 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b524f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.714+0000 7f6e36800640 1 -- 172.21.15.100:0/996374134 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612b5149530 con 0x5612b52bfea0 2024-02-21T07:48:40.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.715+0000 7f6e35400640 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b524f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.720+0000 7f6e36800640 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e3004f960 tx=0x7f6e30067c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8884b46e5eb30b05 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.721+0000 7f6e1dc00640 1 -- 172.21.15.100:0/996374134 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e301310c0 con 0x5612b52bfea0 2024-02-21T07:48:40.726 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.721+0000 7f6e1dc00640 1 -- 172.21.15.100:0/996374134 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e30112b60 con 0x5612b52bfea0 2024-02-21T07:48:40.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.722+0000 7f6e1dc00640 1 -- 172.21.15.100:0/996374134 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30112460 con 0x5612b52bfea0 2024-02-21T07:48:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.723+0000 7f6e3b453740 1 -- 172.21.15.100:0/996374134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 msgr2=0x5612b531b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.723+0000 7f6e3b453740 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e3004f960 tx=0x7f6e30067c70 comp rx=0 tx=0).stop 2024-02-21T07:48:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.728+0000 7f6e3b453740 1 -- 172.21.15.100:0/996374134 shutdown_connections 2024-02-21T07:48:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.728+0000 7f6e3b453740 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b531b810 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.728+0000 7f6e3b453740 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b524f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.728+0000 7f6e3b453740 1 --2- 172.21.15.100:0/996374134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5286680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.728+0000 7f6e3b453740 1 -- 172.21.15.100:0/996374134 >> 172.21.15.100:0/996374134 conn(0x5612b520f4b0 msgr2=0x5612b527ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.729+0000 7f6e3b453740 1 -- 172.21.15.100:0/996374134 shutdown_connections 2024-02-21T07:48:40.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.729+0000 7f6e3b453740 1 -- 172.21.15.100:0/996374134 wait complete. 2024-02-21T07:48:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.733+0000 7f6e3b453740 1 -- start start 2024-02-21T07:48:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.736+0000 7f6e3b453740 1 Processor -- start 2024-02-21T07:48:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.741+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5278b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.742+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b52c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.742+0000 7f6e3b453740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.742+0000 7f6e3b453740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5256670 con 0x5612b528ba40 2024-02-21T07:48:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e36800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e36800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39408/0 (socket says 172.21.15.100:39408) 2024-02-21T07:48:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e36800640 1 -- 172.21.15.100:0/4229238629 learned_addr learned my addr 172.21.15.100:0/4229238629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:40.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e35e00640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5278b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5255600 con 0x5612b52bfea0 2024-02-21T07:48:40.748 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.743+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612b5254e70 con 0x5612b5250960 2024-02-21T07:48:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.744+0000 7f6e36800640 1 -- 172.21.15.100:0/4229238629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 msgr2=0x5612b5278b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.744+0000 7f6e36800640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5278b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.744+0000 7f6e36800640 1 -- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 msgr2=0x5612b52c1460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.744+0000 7f6e3b453740 10 client.0 _ll_register_callbacks cb 0x7f6e24009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:40.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.744+0000 7f6e35400640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b52c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.745+0000 7f6e36800640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b52c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.745+0000 7f6e36800640 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c1a35f0 con 0x5612b52bfea0 2024-02-21T07:48:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.745+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612b51d3d30 con 0x5612b52bfea0 2024-02-21T07:48:40.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.745+0000 7f6e35400640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b52c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.762+0000 7f6e36800640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e30062740 tx=0x7f6e30142160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e6641721d1b3fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.762+0000 7f6e12a00640 10 client.5644 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.763+0000 7f6e12a00640 1 -- 172.21.15.100:0/4229238629 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30116320 con 0x5612b52bfea0 2024-02-21T07:48:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.763+0000 7f6e12a00640 1 -- 172.21.15.100:0/4229238629 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e3011ab70 con 0x5612b52bfea0 2024-02-21T07:48:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.763+0000 7f6e12a00640 1 -- 172.21.15.100:0/4229238629 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e30112460 con 0x5612b52bfea0 2024-02-21T07:48:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.763+0000 7f6e3b453740 10 client.5644 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.763+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=16}) v3 -- 0x5612b516f2c0 con 0x5612b52bfea0 2024-02-21T07:48:40.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e12a00640 1 -- 172.21.15.100:0/4229238629 <== mon.1 v2:172.21.15.156:3300/0 4 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6e30092020 con 0x5612b52bfea0 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 10 client.5644 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 10 client.5644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 20 client.5644 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b4920 0x5612b524c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 4 client.5644 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:48:40.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.767+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612b4eae600 con 0x5612b52b4920 2024-02-21T07:48:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.771+0000 7f6e35e00640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b4920 0x5612b524c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.773+0000 7f6e35e00640 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b4920 0x5612b524c9a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec586e0211de9725 server_cookie=7cf9f70e09af5c7c in_seq=0 out_seq=0 2024-02-21T07:48:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.773+0000 7f6e12a00640 10 client.5644 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.825+0000 7f6e12a00640 1 -- 172.21.15.100:0/4229238629 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612b4eae600 con 0x5612b52b4920 2024-02-21T07:48:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.825+0000 7f6e12a00640 10 client.5644 handle_command_reply: tid=0 2024-02-21T07:48:40.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.826+0000 7f6e3b453740 1 client.5644 shutdown 2024-02-21T07:48:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 msgr2=0x5612b5285660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e30062740 tx=0x7f6e30142160 comp rx=0 tx=0).stop 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 shutdown_connections 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5612b52b4920 0x5612b524c9a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612b52bfea0 0x5612b5285660 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5612b528ba40 0x5612b52c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 --2- 172.21.15.100:0/4229238629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5612b5250960 0x5612b5278b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.828+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 >> 172.21.15.100:0/4229238629 conn(0x5612b520f4b0 msgr2=0x5612b524f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.829+0000 7f6e12a00640 0 client.5644 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:40.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.830+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 shutdown_connections 2024-02-21T07:48:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.830+0000 7f6e3b453740 1 -- 172.21.15.100:0/4229238629 wait complete. 2024-02-21T07:48:40.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.831+0000 7f6e3b453740 20 client.5644 trim_cache size 0 max 16384 2024-02-21T07:48:40.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:48:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:48:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:48:40.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:48:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.833+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 msgr2=0x7f6e140a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.833+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 0x7f6e140a16b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e24035000 tx=0x7f6e2402e000 comp rx=0 tx=0).stop 2024-02-21T07:48:40.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.833+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 msgr2=0x7f6e2c0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.833+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e30069be0 tx=0x7f6e3006bf30 comp rx=0 tx=0).stop 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 shutdown_connections 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e2c0f9f40 0x7f6e2c0fa3d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e2c108410 0x7f6e2c1a30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e1409f1f0 0x7f6e140a16b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 --2- 172.21.15.100:0/3167694325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e2c106f70 0x7f6e2c1a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:40.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.834+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 >> 172.21.15.100:0/3167694325 conn(0x7f6e2c052de0 msgr2=0x7f6e2c0e4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.838+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 shutdown_connections 2024-02-21T07:48:40.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:40.838+0000 7f6e37200640 1 -- 172.21.15.100:0/3167694325 wait complete. 2024-02-21T07:48:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.227+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb741a9bb0 con 0x7feb740ed010 2024-02-21T07:48:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.247+0000 7feb72000640 1 -- 172.21.15.100:0/1411732467 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7feb741a9bb0 con 0x7feb740ed010 2024-02-21T07:48:41.251 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:48:41.258 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:48:41.259 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 msgr2=0x7feb5c0a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 0x7feb5c0a16e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c008040 comp rx=0 tx=0).stop 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 msgr2=0x7feb740ed490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feb78000b60 tx=0x7feb78062950 comp rx=0 tx=0).stop 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 shutdown_connections 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb740ed010 0x7feb740ed490 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5c09f220 0x7feb5c0a16e0 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c008040 comp rx=0 tx=0).stop 2024-02-21T07:48:41.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb741a9e90 0x7feb741a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 --2- 172.21.15.100:0/1411732467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb60005180 0x7feb741a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.275+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 >> 172.21.15.100:0/1411732467 conn(0x7feb74052fc0 msgr2=0x7feb7410e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.278+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 shutdown_connections 2024-02-21T07:48:41.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.278+0000 7feb7f200640 1 -- 172.21.15.100:0/1411732467 wait complete. 2024-02-21T07:48:41.315 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:41.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:48:41.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.638+0000 7fc593200640 1 Processor -- start 2024-02-21T07:48:41.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.639+0000 7fc593200640 1 -- start start 2024-02-21T07:48:41.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.642+0000 7fc593200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc58c190260 0x7fc58c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.642+0000 7fc593200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc58c06edc0 0x7fc58c0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.642+0000 7fc593200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c18dc80 con 0x7fc58c0f4b20 2024-02-21T07:48:41.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.642+0000 7fc593200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0f5b90 con 0x7fc58c190260 2024-02-21T07:48:41.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.642+0000 7fc593200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0f55d0 con 0x7fc58c06edc0 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc58c190260 0x7fc58c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc58c190260 0x7fc58c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39422/0 (socket says 172.21.15.100:39422) 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 -- 172.21.15.100:0/1728668923 learned_addr learned my addr 172.21.15.100:0/1728668923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 -- 172.21.15.100:0/1728668923 >> v2:172.21.15.170:3300/0 conn(0x7fc58c06edc0 msgr2=0x7fc58c0f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 --2- 172.21.15.100:0/1728668923 >> v2:172.21.15.170:3300/0 conn(0x7fc58c06edc0 0x7fc58c0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 -- 172.21.15.100:0/1728668923 >> v1:172.21.15.156:6789/0 conn(0x7fc58c0f4b20 legacy=0x7fc58c06e6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:41.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.643+0000 7fc58be00640 1 -- 172.21.15.100:0/1728668923 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0f58b0 con 0x7fc58c190260 2024-02-21T07:48:41.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.650+0000 7fc58be00640 1 --2- 172.21.15.100:0/1728668923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c190260 0x7fc58c070a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc58c08e480 tx=0x7fc57c02b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28ebd017ffa71c36 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.650+0000 7fc58aa00640 1 -- 172.21.15.100:0/1728668923 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c031750 con 0x7fc58c190260 2024-02-21T07:48:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.650+0000 7fc58aa00640 1 -- 172.21.15.100:0/1728668923 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0318b0 con 0x7fc58c190260 2024-02-21T07:48:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.650+0000 7fc58aa00640 1 -- 172.21.15.100:0/1728668923 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c031c40 con 0x7fc58c190260 2024-02-21T07:48:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.651+0000 7fc593200640 1 -- 172.21.15.100:0/1728668923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c190260 msgr2=0x7fc58c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.651+0000 7fc593200640 1 --2- 172.21.15.100:0/1728668923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c190260 0x7fc58c070a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc58c08e480 tx=0x7fc57c02b7f0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.653+0000 7fc593200640 1 -- 172.21.15.100:0/1728668923 shutdown_connections 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.653+0000 7fc593200640 1 --2- 172.21.15.100:0/1728668923 >> v2:172.21.15.170:3300/0 conn(0x7fc58c06edc0 0x7fc58c0f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.653+0000 7fc593200640 1 --2- 172.21.15.100:0/1728668923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c190260 0x7fc58c070a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.653+0000 7fc593200640 1 -- 172.21.15.100:0/1728668923 >> 172.21.15.100:0/1728668923 conn(0x7fc58c0668b0 msgr2=0x7fc58c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.654+0000 7fc593200640 1 -- 172.21.15.100:0/1728668923 shutdown_connections 2024-02-21T07:48:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.654+0000 7fc593200640 1 -- 172.21.15.100:0/1728668923 wait complete. 2024-02-21T07:48:41.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.657+0000 7fc593200640 1 Processor -- start 2024-02-21T07:48:41.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.657+0000 7fc593200640 1 -- start start 2024-02-21T07:48:41.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58c0f4b20 0x7fc58c18ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c18f220 con 0x7fc58c0f4b20 2024-02-21T07:48:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c18f500 con 0x7fc58c16e2d0 2024-02-21T07:48:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc593200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c18f7e0 con 0x7fc58c190260 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc591200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.658+0000 7fc58b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39432/0 (socket says 172.21.15.100:39432) 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 -- 172.21.15.100:0/3095480433 learned_addr learned my addr 172.21.15.100:0/3095480433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc58b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51006/0 (socket says 172.21.15.100:51006) 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc58be00640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58c0f4b20 0x7fc58c18ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 -- 172.21.15.100:0/3095480433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 msgr2=0x7fc58c0672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 -- 172.21.15.100:0/3095480433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58c0f4b20 msgr2=0x7fc58c18ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58c0f4b20 0x7fc58c18ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 -- 172.21.15.100:0/3095480433 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0094d0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc58b400640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.659+0000 7fc591200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b9e0 tx=0x7fc58400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.660+0000 7fc583e00640 1 -- 172.21.15.100:0/3095480433 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400cb20 con 0x7fc58c16e2d0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.660+0000 7fc583e00640 1 -- 172.21.15.100:0/3095480433 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400cca0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.660+0000 7fc583e00640 1 -- 172.21.15.100:0/3095480433 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584014680 con 0x7fc58c16e2d0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.660+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c18fac0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.660+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c16ecc0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.663+0000 7fc583e00640 1 -- 172.21.15.100:0/3095480433 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc58401d3b0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.665+0000 7fc583e00640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 0x7fc56c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.665+0000 7fc583e00640 1 -- 172.21.15.100:0/3095480433 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5840c99e0 con 0x7fc58c16e2d0 2024-02-21T07:48:41.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.665+0000 7fc58be00640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 0x7fc56c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.667+0000 7fc58be00640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 0x7fc56c0a1590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc57c035000 tx=0x7fc57c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.672+0000 7fc595e38740 1 Processor -- start 2024-02-21T07:48:41.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.672+0000 7fc595e38740 1 -- start start 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b8ec0 0x5571c88b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c87ec210 con 0x5571c88b8ec0 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c87e9740 con 0x5571c88f4590 2024-02-21T07:48:41.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc595e38740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c87e4f20 con 0x5571c88b97e0 2024-02-21T07:48:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39446/0 (socket says 172.21.15.100:39446) 2024-02-21T07:48:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 -- 172.21.15.100:0/534998889 learned_addr learned my addr 172.21.15.100:0/534998889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 -- 172.21.15.100:0/534998889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 msgr2=0x5571c88f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 -- 172.21.15.100:0/534998889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b8ec0 msgr2=0x5571c88b92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b8ec0 0x5571c88b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.674+0000 7fc591200640 1 -- 172.21.15.100:0/534998889 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571c87a6df0 con 0x5571c88f4590 2024-02-21T07:48:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.675+0000 7fc591200640 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5840955f0 tx=0x7fc584097570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f20af5f79315428 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.675+0000 7fc580c00640 1 -- 172.21.15.100:0/534998889 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5840820c0 con 0x5571c88f4590 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.675+0000 7fc580c00640 1 -- 172.21.15.100:0/534998889 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400ce10 con 0x5571c88f4590 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.675+0000 7fc580c00640 1 -- 172.21.15.100:0/534998889 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584093b50 con 0x5571c88f4590 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.676+0000 7fc595e38740 1 -- 172.21.15.100:0/534998889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 msgr2=0x5571c88f5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.676+0000 7fc595e38740 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc5840955f0 tx=0x7fc584097570 comp rx=0 tx=0).stop 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.678+0000 7fc595e38740 1 -- 172.21.15.100:0/534998889 shutdown_connections 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.678+0000 7fc595e38740 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88f5320 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.678+0000 7fc595e38740 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.678+0000 7fc595e38740 1 --2- 172.21.15.100:0/534998889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b8ec0 0x5571c88b92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.678+0000 7fc595e38740 1 -- 172.21.15.100:0/534998889 >> 172.21.15.100:0/534998889 conn(0x5571c887b490 msgr2=0x5571c887c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.679+0000 7fc595e38740 1 -- 172.21.15.100:0/534998889 shutdown_connections 2024-02-21T07:48:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.679+0000 7fc595e38740 1 -- 172.21.15.100:0/534998889 wait complete. 2024-02-21T07:48:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.680+0000 7fc595e38740 1 -- start start 2024-02-21T07:48:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.681+0000 7fc595e38740 1 Processor -- start 2024-02-21T07:48:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c8910740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c88a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c878a150 con 0x5571c88a4230 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c8789df0 con 0x5571c88f4590 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.684+0000 7fc595e38740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c85531c0 con 0x5571c88b97e0 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.685+0000 7fc595e38740 10 client.0 _ll_register_callbacks cb 0x5571c87d92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.685+0000 7fc58b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.685+0000 7fc58b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39458/0 (socket says 172.21.15.100:39458) 2024-02-21T07:48:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.685+0000 7fc58b400640 1 -- 172.21.15.100:0/679044286 learned_addr learned my addr 172.21.15.100:0/679044286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.685+0000 7fc58be00640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c8910740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.691+0000 7fc58b400640 1 -- 172.21.15.100:0/679044286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 msgr2=0x5571c8910740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.691+0000 7fc58b400640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c8910740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.691+0000 7fc58b400640 1 -- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 msgr2=0x5571c88a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.691+0000 7fc58b400640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c88a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.691+0000 7fc58b400640 1 -- 172.21.15.100:0/679044286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c16ecc0 con 0x5571c88f4590 2024-02-21T07:48:41.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.693+0000 7fc58b400640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc57800e590 tx=0x7fc57800ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1e8ecf2febe01d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.693+0000 7fc575600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:41.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.695+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578013680 con 0x5571c88f4590 2024-02-21T07:48:41.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.696+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5780137e0 con 0x5571c88f4590 2024-02-21T07:48:41.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.696+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571c84e47e0 con 0x5571c88f4590 2024-02-21T07:48:41.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.697+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5780139a0 con 0x5571c88f4590 2024-02-21T07:48:41.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.697+0000 7fc595e38740 10 client.5656 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:41.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.697+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5571c87e35a0 con 0x5571c88f4590 2024-02-21T07:48:41.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.697+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5571c84e47e0 con 0x5571c88f4590 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.698+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc578011070 con 0x5571c88f4590 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 10 client.5656 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 10 client.5656 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 20 client.5656 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c88a46b0 0x5571c88b2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 4 client.5656 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571c8521720 con 0x5571c88a46b0 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc58be00640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c88a46b0 0x5571c88b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc58be00640 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c88a46b0 0x5571c88b2370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=caad993d6b9c24aa server_cookie=95f735ec5a10013c in_seq=0 out_seq=0 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.699+0000 7fc575600640 10 client.5656 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.700+0000 7fc575600640 1 -- 172.21.15.100:0/679044286 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571c8521720 con 0x5571c88a46b0 2024-02-21T07:48:41.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.700+0000 7fc575600640 10 client.5656 handle_command_reply: tid=0 2024-02-21T07:48:41.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.700+0000 7fc595e38740 1 client.5656 shutdown 2024-02-21T07:48:41.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.701+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 msgr2=0x5571c890e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.701+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc57800e590 tx=0x7fc57800ea50 comp rx=0 tx=0).stop 2024-02-21T07:48:41.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 shutdown_connections 2024-02-21T07:48:41.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c88a46b0 0x5571c88b2370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c88a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c890e800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 --2- 172.21.15.100:0/679044286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c8910740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 >> 172.21.15.100:0/679044286 conn(0x5571c88b8ec0 msgr2=0x5571c887cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc575600640 0 client.5656 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 shutdown_connections 2024-02-21T07:48:41.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.704+0000 7fc595e38740 1 -- 172.21.15.100:0/679044286 wait complete. 2024-02-21T07:48:41.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.705+0000 7fc595e38740 20 client.5656 trim_cache size 0 max 16384 2024-02-21T07:48:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.729+0000 7fc595e38740 1 Processor -- start 2024-02-21T07:48:41.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.730+0000 7fc595e38740 1 -- start start 2024-02-21T07:48:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.731+0000 7fc595e38740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.731+0000 7fc595e38740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.731+0000 7fc595e38740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc595e38740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c88e9dd0 con 0x5571c88a4230 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc595e38740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c890bd10 con 0x5571c88f4590 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc595e38740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c890b7e0 con 0x5571c88b97e0 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc58be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc58be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55604/0 (socket says 172.21.15.100:55604) 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc58be00640 1 -- 172.21.15.100:0/2568535936 learned_addr learned my addr 172.21.15.100:0/2568535936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.732+0000 7fc591200640 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 -- 172.21.15.100:0/2568535936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 msgr2=0x5571c88f4c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 -- 172.21.15.100:0/2568535936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 msgr2=0x5571c88c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 -- 172.21.15.100:0/2568535936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571c877fab0 con 0x5571c88a4230 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.733+0000 7fc58be00640 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0090b0 tx=0x7fc57c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6123102f05a8269 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.734+0000 7fc577e00640 1 -- 172.21.15.100:0/2568535936 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c04d040 con 0x5571c88a4230 2024-02-21T07:48:41.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.734+0000 7fc577e00640 1 -- 172.21.15.100:0/2568535936 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c04f040 con 0x5571c88a4230 2024-02-21T07:48:41.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.734+0000 7fc577e00640 1 -- 172.21.15.100:0/2568535936 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c054350 con 0x5571c88a4230 2024-02-21T07:48:41.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.735+0000 7fc595e38740 1 -- 172.21.15.100:0/2568535936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 msgr2=0x5571c887ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.735+0000 7fc595e38740 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0090b0 tx=0x7fc57c02e000 comp rx=0 tx=0).stop 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 -- 172.21.15.100:0/2568535936 shutdown_connections 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c88c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88b97e0 0x5571c88f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 --2- 172.21.15.100:0/2568535936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88a4230 0x5571c887ada0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 -- 172.21.15.100:0/2568535936 >> 172.21.15.100:0/2568535936 conn(0x5571c88b8ec0 msgr2=0x5571c887cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.739+0000 7fc595e38740 1 -- 172.21.15.100:0/2568535936 shutdown_connections 2024-02-21T07:48:41.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.740+0000 7fc595e38740 1 -- 172.21.15.100:0/2568535936 wait complete. 2024-02-21T07:48:41.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.742+0000 7fc595e38740 1 -- start start 2024-02-21T07:48:41.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.742+0000 7fc595e38740 1 Processor -- start 2024-02-21T07:48:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 0x5571c897dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c8969c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c897e530 con 0x5571c88b97e0 2024-02-21T07:48:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c896a920 con 0x5571c88f4590 2024-02-21T07:48:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.747+0000 7fc595e38740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571c8915d00 con 0x5571c88a4230 2024-02-21T07:48:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.748+0000 7fc595e38740 10 client.0 _ll_register_callbacks cb 0x7fc584093800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.749+0000 7fc58b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.749+0000 7fc58b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55610/0 (socket says 172.21.15.100:55610) 2024-02-21T07:48:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.750+0000 7fc58b400640 1 -- 172.21.15.100:0/4154839748 learned_addr learned my addr 172.21.15.100:0/4154839748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.750+0000 7fc58be00640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 0x5571c897dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 -- 172.21.15.100:0/4154839748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 msgr2=0x5571c8969c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c8969c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 -- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 msgr2=0x5571c88e8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:41.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 -- 172.21.15.100:0/4154839748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c043070 con 0x5571c88a4230 2024-02-21T07:48:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58b400640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc58be00640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 0x5571c897dca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc57c056000 tx=0x7fc57c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=860bb3cbbc65705d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.751+0000 7fc575600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.753+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c04d040 con 0x5571c88a4230 2024-02-21T07:48:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.753+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc57c054550 con 0x5571c88a4230 2024-02-21T07:48:41.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.754+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc58400ce10 con 0x5571c88a4230 2024-02-21T07:48:41.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.754+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c054710 con 0x5571c88a4230 2024-02-21T07:48:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.754+0000 7fc595e38740 10 client.5612 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.754+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5571c87a5650 con 0x5571c88a4230 2024-02-21T07:48:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.755+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400ce10 con 0x5571c88a4230 2024-02-21T07:48:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.755+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc57c068070 con 0x5571c88a4230 2024-02-21T07:48:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.757+0000 7fc595e38740 10 client.5612 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.757+0000 7fc595e38740 10 client.5612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:48:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.757+0000 7fc595e38740 20 client.5612 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.757+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c8916190 0x5571c896a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.758+0000 7fc595e38740 4 client.5612 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.758+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5571c8570890 con 0x5571c8916190 2024-02-21T07:48:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.758+0000 7fc58b400640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c8916190 0x5571c896a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.759+0000 7fc58b400640 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c8916190 0x5571c896a1c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c3032ee10008c13 server_cookie=b6aa92d116722bf9 in_seq=0 out_seq=0 2024-02-21T07:48:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.759+0000 7fc575600640 10 client.5612 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.759+0000 7fc575600640 1 -- 172.21.15.100:0/4154839748 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571c8570890 con 0x5571c8916190 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc575600640 10 client.5612 handle_command_reply: tid=0 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 client.5612 shutdown 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 msgr2=0x5571c897dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 0x5571c897dca0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc57c056000 tx=0x7fc57c004730 comp rx=0 tx=0).stop 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 shutdown_connections 2024-02-21T07:48:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5571c8916190 0x5571c896a1c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.760+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571c88f4590 0x5571c8969c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5571c88b97e0 0x5571c88e8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc595e38740 1 --2- 172.21.15.100:0/4154839748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5571c88a4230 0x5571c897dca0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 >> 172.21.15.100:0/4154839748 conn(0x5571c88b8ec0 msgr2=0x5571c8879760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc575600640 0 client.5612 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 shutdown_connections 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.761+0000 7fc595e38740 1 -- 172.21.15.100:0/4154839748 wait complete. 2024-02-21T07:48:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.762+0000 7fc595e38740 20 client.5612 trim_cache size 0 max 16384 2024-02-21T07:48:41.767 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 msgr2=0x7fc56c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 0x7fc56c0a1590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc57c035000 tx=0x7fc57c008030 comp rx=0 tx=0).stop 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 msgr2=0x7fc58c16e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b9e0 tx=0x7fc58400bea0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 shutdown_connections 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc58c16e2d0 0x7fc58c16e780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58c190260 0x7fc58c0672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56c09f0d0 0x7fc56c0a1590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 --2- 172.21.15.100:0/3095480433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58c0f4b20 0x7fc58c18ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.763+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 >> 172.21.15.100:0/3095480433 conn(0x7fc58c0668b0 msgr2=0x7fc58c06e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.764+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 shutdown_connections 2024-02-21T07:48:41.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:41.764+0000 7fc593200640 1 -- 172.21.15.100:0/3095480433 wait complete. 2024-02-21T07:48:41.795 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:41.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:48:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.155+0000 7fb16bc00640 1 Processor -- start 2024-02-21T07:48:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.155+0000 7fb16bc00640 1 -- start start 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb16bc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 0x7fb1640cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb16bc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1640cca40 0x7fb164190820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb16bc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1640fab80 con 0x7fb164190d60 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb16bc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16418de60 con 0x7fb1640cca40 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb16bc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640d5ec0 con 0x7fb164190440 2024-02-21T07:48:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb169200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 0x7fb1640cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb169200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 0x7fb1640cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51036/0 (socket says 172.21.15.100:51036) 2024-02-21T07:48:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.160+0000 7fb169200640 1 -- 172.21.15.100:0/1351894742 learned_addr learned my addr 172.21.15.100:0/1351894742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.161+0000 7fb15be00640 1 --2- 172.21.15.100:0/1351894742 >> v2:172.21.15.100:3300/0 conn(0x7fb1640cca40 0x7fb164190820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.162+0000 7fb15be00640 1 -- 172.21.15.100:0/1351894742 >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 msgr2=0x7fb1640cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.162+0000 7fb15be00640 1 --2- 172.21.15.100:0/1351894742 >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 0x7fb1640cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.162+0000 7fb15be00640 1 -- 172.21.15.100:0/1351894742 >> v1:172.21.15.170:6789/0 conn(0x7fb164190d60 legacy=0x7fb16408bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.162+0000 7fb15be00640 1 -- 172.21.15.100:0/1351894742 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1640f9ae0 con 0x7fb1640cca40 2024-02-21T07:48:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.164+0000 7fb15be00640 1 --2- 172.21.15.100:0/1351894742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb164190820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb1640668e0 tx=0x7fb15002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4e0462eecebe03 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.169+0000 7fb163e00640 1 -- 172.21.15.100:0/1351894742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150033640 con 0x7fb1640cca40 2024-02-21T07:48:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.169+0000 7fb163e00640 1 -- 172.21.15.100:0/1351894742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1500337a0 con 0x7fb1640cca40 2024-02-21T07:48:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.169+0000 7fb163e00640 1 -- 172.21.15.100:0/1351894742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150033b30 con 0x7fb1640cca40 2024-02-21T07:48:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.170+0000 7fb16bc00640 1 -- 172.21.15.100:0/1351894742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 msgr2=0x7fb164190820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.170+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1351894742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb164190820 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb1640668e0 tx=0x7fb15002b720 comp rx=0 tx=0).stop 2024-02-21T07:48:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.172+0000 7fb16bc00640 1 -- 172.21.15.100:0/1351894742 shutdown_connections 2024-02-21T07:48:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.172+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1351894742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb164190820 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.172+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1351894742 >> v2:172.21.15.170:3300/0 conn(0x7fb164190440 0x7fb1640cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.172+0000 7fb16bc00640 1 -- 172.21.15.100:0/1351894742 >> 172.21.15.100:0/1351894742 conn(0x7fb1640fe290 msgr2=0x7fb1640fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.173+0000 7fb16bc00640 1 -- 172.21.15.100:0/1351894742 shutdown_connections 2024-02-21T07:48:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.173+0000 7fb16bc00640 1 -- 172.21.15.100:0/1351894742 wait complete. 2024-02-21T07:48:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.177+0000 7fb16bc00640 1 Processor -- start 2024-02-21T07:48:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.180+0000 7fb16bc00640 1 -- start start 2024-02-21T07:48:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb16417cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb164190440 0x7fb16422b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640ce4e0 con 0x7fb1640cca40 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640cdeb0 con 0x7fb164190d60 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb16bc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16422be80 con 0x7fb164190440 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.185+0000 7fb169c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39484/0 (socket says 172.21.15.100:39484) 2024-02-21T07:48:42.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 -- 172.21.15.100:0/1125725549 learned_addr learned my addr 172.21.15.100:0/1125725549 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169200640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb16417cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 -- 172.21.15.100:0/1125725549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb164190440 msgr2=0x7fb16422b400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb164190440 0x7fb16422b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 -- 172.21.15.100:0/1125725549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 msgr2=0x7fb16417cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb16417cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169c00640 1 -- 172.21.15.100:0/1125725549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009400 con 0x7fb164190d60 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.186+0000 7fb169200640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb16417cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.187+0000 7fb169c00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00b970 tx=0x7fb15c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.187+0000 7fb161600640 1 -- 172.21.15.100:0/1125725549 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00cb40 con 0x7fb164190d60 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.187+0000 7fb161600640 1 -- 172.21.15.100:0/1125725549 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c00cca0 con 0x7fb164190d60 2024-02-21T07:48:42.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.187+0000 7fb161600640 1 -- 172.21.15.100:0/1125725549 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c014680 con 0x7fb164190d60 2024-02-21T07:48:42.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.190+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb164185b30 con 0x7fb164190d60 2024-02-21T07:48:42.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.190+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1641860f0 con 0x7fb164190d60 2024-02-21T07:48:42.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.222+0000 7fb16e822740 1 Processor -- start 2024-02-21T07:48:42.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.223+0000 7fb161600640 1 -- 172.21.15.100:0/1125725549 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb15c01c360 con 0x7fb164190d60 2024-02-21T07:48:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.226+0000 7fb161600640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 0x7fb1440a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.226+0000 7fb161600640 1 -- 172.21.15.100:0/1125725549 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb15c0c9b00 con 0x7fb164190d60 2024-02-21T07:48:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.226+0000 7fb16e822740 1 -- start start 2024-02-21T07:48:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.227+0000 7fb15be00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 0x7fb1440a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.228+0000 7fb15be00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 0x7fb1440a15e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb150035000 tx=0x7fb15002f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.230+0000 7fb16e822740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 0x55ac6b33b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.230+0000 7fb16e822740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.230+0000 7fb16e822740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b377320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.230+0000 7fb16e822740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b26e210 con 0x55ac6b33aec0 2024-02-21T07:48:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.230+0000 7fb16e822740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b26b740 con 0x55ac6b376590 2024-02-21T07:48:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb16e822740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b266f20 con 0x55ac6b33b7e0 2024-02-21T07:48:42.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb15be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb169200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 0x55ac6b33b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb15be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51056/0 (socket says 172.21.15.100:51056) 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb15be00640 1 -- 172.21.15.100:0/4267131140 learned_addr learned my addr 172.21.15.100:0/4267131140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.231+0000 7fb169c00640 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b377320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 -- 172.21.15.100:0/4267131140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 msgr2=0x55ac6b376050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 -- 172.21.15.100:0/4267131140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 msgr2=0x55ac6b377320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b377320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 -- 172.21.15.100:0/4267131140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac6b228df0 con 0x55ac6b33aec0 2024-02-21T07:48:42.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.232+0000 7fb169200640 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 0x55ac6b33b2a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb154009cb0 tx=0x7fb154009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd07ff90bc19e201 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.233+0000 7fb159600640 1 -- 172.21.15.100:0/4267131140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154010e60 con 0x55ac6b33aec0 2024-02-21T07:48:42.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.233+0000 7fb159600640 1 -- 172.21.15.100:0/4267131140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540143f0 con 0x55ac6b33aec0 2024-02-21T07:48:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.233+0000 7fb159600640 1 -- 172.21.15.100:0/4267131140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154014760 con 0x55ac6b33aec0 2024-02-21T07:48:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.235+0000 7fb16e822740 1 -- 172.21.15.100:0/4267131140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 msgr2=0x55ac6b33b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.235+0000 7fb16e822740 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 0x55ac6b33b2a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb154009cb0 tx=0x7fb154009240 comp rx=0 tx=0).stop 2024-02-21T07:48:42.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.237+0000 7fb16e822740 1 -- 172.21.15.100:0/4267131140 shutdown_connections 2024-02-21T07:48:42.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.237+0000 7fb16e822740 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b377320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.237+0000 7fb16e822740 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.237+0000 7fb16e822740 1 --2- 172.21.15.100:0/4267131140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33aec0 0x55ac6b33b2a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.237+0000 7fb16e822740 1 -- 172.21.15.100:0/4267131140 >> 172.21.15.100:0/4267131140 conn(0x55ac6b2fd490 msgr2=0x55ac6b2fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.240+0000 7fb16e822740 1 -- 172.21.15.100:0/4267131140 shutdown_connections 2024-02-21T07:48:42.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.240+0000 7fb16e822740 1 -- 172.21.15.100:0/4267131140 wait complete. 2024-02-21T07:48:42.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.244+0000 7fb16e822740 1 -- start start 2024-02-21T07:48:42.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.246+0000 7fb16e822740 1 Processor -- start 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 0x55ac6b330db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b20c150 con 0x55ac6b380520 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b20bdf0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6afd51c0 con 0x55ac6b376590 2024-02-21T07:48:42.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.248+0000 7fb16e822740 10 client.0 _ll_register_callbacks cb 0x55ac6b25b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39506/0 (socket says 172.21.15.100:39506) 2024-02-21T07:48:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 -- 172.21.15.100:0/1714710465 learned_addr learned my addr 172.21.15.100:0/1714710465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb15be00640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 -- 172.21.15.100:0/1714710465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 msgr2=0x55ac6b3642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169c00640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 0x55ac6b330db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.249+0000 7fb169200640 1 -- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 msgr2=0x55ac6b330db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.250+0000 7fb169200640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 0x55ac6b330db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.250+0000 7fb169200640 1 -- 172.21.15.100:0/1714710465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb154009680 con 0x55ac6b33b7e0 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.250+0000 7fb169c00640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 0x55ac6b330db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.251+0000 7fb169200640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb154017000 tx=0x7fb154004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0c66dc4a38a0ad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.251+0000 7fb14e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:42.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.253+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154022070 con 0x55ac6b33b7e0 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.253+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb154003610 con 0x55ac6b33b7e0 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.254+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac6af667e0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.255+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1540037d0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.255+0000 7fb16e822740 10 client.5665 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.255+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ac6b2655a0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.255+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ac6af667e0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.259+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb154003930 con 0x55ac6b33b7e0 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.259+0000 7fb16e822740 10 client.5665 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb16e822740 10 client.5665 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb16e822740 20 client.5665 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3346e0 0x55ac6b3737d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb16e822740 4 client.5665 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:42.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac6afa3720 con 0x55ac6b3346e0 2024-02-21T07:48:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.260+0000 7fb15be00640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3346e0 0x55ac6b3737d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.261+0000 7fb15be00640 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3346e0 0x55ac6b3737d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa4509468bb67db9 server_cookie=69b54832d25a6ac5 in_seq=0 out_seq=0 2024-02-21T07:48:42.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.261+0000 7fb14e000640 10 client.5665 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.262+0000 7fb14e000640 1 -- 172.21.15.100:0/1714710465 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ac6afa3720 con 0x55ac6b3346e0 2024-02-21T07:48:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.262+0000 7fb14e000640 10 client.5665 handle_command_reply: tid=0 2024-02-21T07:48:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 client.5665 shutdown 2024-02-21T07:48:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 msgr2=0x55ac6b2f9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb154017000 tx=0x7fb154004730 comp rx=0 tx=0).stop 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 shutdown_connections 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b380520 0x55ac6b330db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3346e0 0x55ac6b3737d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 --2- 172.21.15.100:0/1714710465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b33b7e0 0x55ac6b2f9bc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.263+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 >> 172.21.15.100:0/1714710465 conn(0x55ac6b33aec0 msgr2=0x55ac6b2fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.264+0000 7fb14e000640 0 client.5665 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:42.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.264+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 shutdown_connections 2024-02-21T07:48:42.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.265+0000 7fb16e822740 1 -- 172.21.15.100:0/1714710465 wait complete. 2024-02-21T07:48:42.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.269+0000 7fb16e822740 20 client.5665 trim_cache size 0 max 16384 2024-02-21T07:48:42.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.326+0000 7fb16e822740 1 Processor -- start 2024-02-21T07:48:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.328+0000 7fb16e822740 1 -- start start 2024-02-21T07:48:42.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.331+0000 7fb16e822740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b333a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.331+0000 7fb16e822740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b3d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.335+0000 7fb16e822740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 0x55ac6b3d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.335+0000 7fb16e822740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b390cf0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb16e822740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b304b00 con 0x55ac6b376590 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb16e822740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b2fb820 con 0x55ac6b380520 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb15be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b3d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb15be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b3d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39508/0 (socket says 172.21.15.100:39508) 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb15be00640 1 -- 172.21.15.100:0/4007869353 learned_addr learned my addr 172.21.15.100:0/4007869353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb169c00640 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 0x55ac6b3d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.336+0000 7fb169200640 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b333a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.337+0000 7fb169c00640 1 -- 172.21.15.100:0/4007869353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 msgr2=0x55ac6b3d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.337+0000 7fb169c00640 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b3d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.337+0000 7fb169c00640 1 -- 172.21.15.100:0/4007869353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 msgr2=0x55ac6b333a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.337+0000 7fb169c00640 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b333a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.337+0000 7fb169c00640 1 -- 172.21.15.100:0/4007869353 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac6b201ab0 con 0x55ac6b380520 2024-02-21T07:48:42.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.344+0000 7fb169c00640 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 0x55ac6b3d13c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0c7470 tx=0x7fb15c097e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb9b8c16b3ea66 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.346+0000 7fb158c00640 1 -- 172.21.15.100:0/4007869353 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c09fd80 con 0x55ac6b380520 2024-02-21T07:48:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.346+0000 7fb158c00640 1 -- 172.21.15.100:0/4007869353 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0c75b0 con 0x55ac6b380520 2024-02-21T07:48:42.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.346+0000 7fb158c00640 1 -- 172.21.15.100:0/4007869353 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0b60c0 con 0x55ac6b380520 2024-02-21T07:48:42.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.348+0000 7fb16e822740 1 -- 172.21.15.100:0/4007869353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 msgr2=0x55ac6b3d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.348+0000 7fb16e822740 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 0x55ac6b3d13c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0c7470 tx=0x7fb15c097e30 comp rx=0 tx=0).stop 2024-02-21T07:48:42.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 -- 172.21.15.100:0/4007869353 shutdown_connections 2024-02-21T07:48:42.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b380520 0x55ac6b3d13c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b376590 0x55ac6b3d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 --2- 172.21.15.100:0/4007869353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b333a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 -- 172.21.15.100:0/4007869353 >> 172.21.15.100:0/4007869353 conn(0x55ac6b33aec0 msgr2=0x55ac6b33e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.350+0000 7fb16e822740 1 -- 172.21.15.100:0/4007869353 shutdown_connections 2024-02-21T07:48:42.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.351+0000 7fb16e822740 1 -- 172.21.15.100:0/4007869353 wait complete. 2024-02-21T07:48:42.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.353+0000 7fb16e822740 1 -- start start 2024-02-21T07:48:42.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.353+0000 7fb16e822740 1 Processor -- start 2024-02-21T07:48:42.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.357+0000 7fb16e822740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.357+0000 7fb16e822740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb169200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb169200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55674/0 (socket says 172.21.15.100:55674) 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb16e822740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b380520 0x55ac6b334f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb16e822740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b383930 con 0x55ac6b33b7e0 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb169200640 1 -- 172.21.15.100:0/1646568222 learned_addr learned my addr 172.21.15.100:0/1646568222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.358+0000 7fb15be00640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.359+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b304070 con 0x55ac6b380520 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.359+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6b36edb0 con 0x55ac6b376590 2024-02-21T07:48:42.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.359+0000 7fb16e822740 10 client.0 _ll_register_callbacks cb 0x7fb154009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:42.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.360+0000 7fb169c00640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b380520 0x55ac6b334f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.362+0000 7fb169200640 1 -- 172.21.15.100:0/1646568222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 msgr2=0x55ac6b3d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.362+0000 7fb169200640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.362+0000 7fb169200640 1 -- 172.21.15.100:0/1646568222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b380520 msgr2=0x55ac6b334f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.362+0000 7fb169200640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b380520 0x55ac6b334f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.362+0000 7fb169200640 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1641860f0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.363+0000 7fb169200640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb154003840 tx=0x7fb154008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7d36b17b31704a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.363+0000 7fb14e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.363+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154014970 con 0x55ac6b33b7e0 2024-02-21T07:48:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.363+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1540143f0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.363+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb154000e40 con 0x55ac6b33b7e0 2024-02-21T07:48:42.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.364+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb154003d50 con 0x55ac6b33b7e0 2024-02-21T07:48:42.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.364+0000 7fb16e822740 10 client.5529 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:42.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.364+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ac6b227650 con 0x55ac6b33b7e0 2024-02-21T07:48:42.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1540143f0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb154014ad0 con 0x55ac6b33b7e0 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 10 client.5529 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 10 client.5529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 20 client.5529 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3688e0 0x55ac6b304490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 4 client.5529 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.365+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ac6aff2890 con 0x55ac6b3688e0 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.366+0000 7fb15be00640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3688e0 0x55ac6b304490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.366+0000 7fb15be00640 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3688e0 0x55ac6b304490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3ef5cc43fa949b89 server_cookie=74f076fdda681f9e in_seq=0 out_seq=0 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.366+0000 7fb14e000640 10 client.5529 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.367+0000 7fb14e000640 1 -- 172.21.15.100:0/1646568222 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ac6aff2890 con 0x55ac6b3688e0 2024-02-21T07:48:42.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.367+0000 7fb14e000640 10 client.5529 handle_command_reply: tid=0 2024-02-21T07:48:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.367+0000 7fb16e822740 1 client.5529 shutdown 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 msgr2=0x55ac6b376d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb154003840 tx=0x7fb154008040 comp rx=0 tx=0).stop 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 shutdown_connections 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ac6b3688e0 0x55ac6b304490 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ac6b380520 0x55ac6b334f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ac6b376590 0x55ac6b3d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 --2- 172.21.15.100:0/1646568222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ac6b33b7e0 0x55ac6b376d10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 >> 172.21.15.100:0/1646568222 conn(0x55ac6b33aec0 msgr2=0x55ac6b2fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb14e000640 0 client.5529 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 shutdown_connections 2024-02-21T07:48:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 1 -- 172.21.15.100:0/1646568222 wait complete. 2024-02-21T07:48:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.368+0000 7fb16e822740 20 client.5529 trim_cache size 0 max 16384 2024-02-21T07:48:42.374 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 msgr2=0x7fb1440a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 0x7fb1440a15e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb150035000 tx=0x7fb15002f000 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 msgr2=0x7fb16422b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00b970 tx=0x7fb15c00be30 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 shutdown_connections 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb164190d60 0x7fb16422b940 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb164190440 0x7fb16422b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb14409f120 0x7fb1440a15e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 --2- 172.21.15.100:0/1125725549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1640cca40 0x7fb16417cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 >> 172.21.15.100:0/1125725549 conn(0x7fb1640fe290 msgr2=0x7fb16418e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.369+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 shutdown_connections 2024-02-21T07:48:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.370+0000 7fb16bc00640 1 -- 172.21.15.100:0/1125725549 wait complete. 2024-02-21T07:48:42.405 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:48:42.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:48:42.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:42.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:42.935 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:42.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.943+0000 7f683ac00640 1 Processor -- start 2024-02-21T07:48:42.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.943+0000 7f683ac00640 1 -- start start 2024-02-21T07:48:42.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.947+0000 7f683ac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f683415cd30 0x7f683415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.948+0000 7f683ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340f5230 con 0x7f683415c950 2024-02-21T07:48:42.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.948+0000 7f683ac00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68340706e0 con 0x7f68340f56c0 2024-02-21T07:48:42.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.948+0000 7f683ac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68340709c0 con 0x7f683415cd30 2024-02-21T07:48:42.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.948+0000 7f6833400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f683415cd30 0x7f683415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.949+0000 7f6838c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f68340f56c0 0x7f68340f5b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:36118/0 (socket says 172.21.15.100:36118) 2024-02-21T07:48:42.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.949+0000 7f6838c00640 1 -- 172.21.15.100:0/2560162236 learned_addr learned my addr 172.21.15.100:0/2560162236 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:42.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.950+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618252597 0 0) 0x7f68340706e0 con 0x7f68340f56c0 2024-02-21T07:48:42.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.950+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681c003520 con 0x7f68340f56c0 2024-02-21T07:48:42.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.950+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338594769 0 0) 0x7f681c003520 con 0x7f68340f56c0 2024-02-21T07:48:42.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.950+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 >> v2:172.21.15.100:3300/0 conn(0x7f683415cd30 msgr2=0x7f683415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.950+0000 7f6832a00640 1 --2- 172.21.15.100:0/2560162236 >> v2:172.21.15.100:3300/0 conn(0x7f683415cd30 0x7f683415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 >> v1:172.21.15.100:6789/0 conn(0x7f683415c950 legacy=0x7f6834188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340f4900 con 0x7f68340f56c0 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f682c0019d0 con 0x7f68340f56c0 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 >> v1:172.21.15.156:6789/0 conn(0x7f68340f56c0 legacy=0x7f68340f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 0x7f681c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f681c0047c0 0x7f681c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f681c0051d0 0x7f681c00fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68340709c0 con 0x7f681c0051d0 2024-02-21T07:48:42.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c010510 con 0x7f681c003970 2024-02-21T07:48:42.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.951+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c0106d0 con 0x7f681c0047c0 2024-02-21T07:48:42.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.952+0000 7f6833e00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 0x7f681c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.953+0000 7f6833400640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f681c0047c0 0x7f681c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.953+0000 7f6838c00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f681c0051d0 0x7f681c00fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.953+0000 7f6833e00640 1 -- 172.21.15.100:0/2560162236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f681c0047c0 msgr2=0x7f681c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.953+0000 7f6833e00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f681c0047c0 0x7f681c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.954+0000 7f6833e00640 1 -- 172.21.15.100:0/2560162236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f681c0051d0 msgr2=0x7f681c00fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.954+0000 7f6833e00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f681c0051d0 0x7f681c00fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.954+0000 7f6833e00640 1 -- 172.21.15.100:0/2560162236 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68340f4900 con 0x7f681c003970 2024-02-21T07:48:42.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.954+0000 7f6838c00640 1 -- 172.21.15.100:0/2560162236 reap_dead start 2024-02-21T07:48:42.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.957+0000 7f6833e00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 0x7f681c003db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f681c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70deceaf242d079b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.958+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68280052d0 con 0x7f681c003970 2024-02-21T07:48:42.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.958+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682802e050 con 0x7f681c003970 2024-02-21T07:48:42.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.958+0000 7f6832a00640 1 -- 172.21.15.100:0/2560162236 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828003830 con 0x7f681c003970 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.959+0000 7f683ac00640 1 -- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 msgr2=0x7f681c003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.959+0000 7f683ac00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 0x7f681c003db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f681c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.959+0000 7f683ac00640 1 -- 172.21.15.100:0/2560162236 shutdown_connections 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.959+0000 7f683ac00640 1 --2- 172.21.15.100:0/2560162236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f681c003970 0x7f681c003db0 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f681c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.959+0000 7f683ac00640 1 -- 172.21.15.100:0/2560162236 >> 172.21.15.100:0/2560162236 conn(0x7f68340668b0 msgr2=0x7f6834066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.960+0000 7f683ac00640 1 -- 172.21.15.100:0/2560162236 shutdown_connections 2024-02-21T07:48:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.960+0000 7f683ac00640 1 -- 172.21.15.100:0/2560162236 wait complete. 2024-02-21T07:48:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.965+0000 7f683ac00640 1 Processor -- start 2024-02-21T07:48:42.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.966+0000 7f683ac00640 1 -- start start 2024-02-21T07:48:42.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.968+0000 7f683ac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 0x7f68341747c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.968+0000 7f683ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 0x7f683417f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.969+0000 7f6833e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 0x7f68341747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.969+0000 7f6833e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 0x7f68341747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51094/0 (socket says 172.21.15.100:51094) 2024-02-21T07:48:42.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.969+0000 7f6833e00640 1 -- 172.21.15.100:0/3635960522 learned_addr learned my addr 172.21.15.100:0/3635960522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.969+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 0x7f683421b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.970+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834185d60 con 0x7f6834174d00 2024-02-21T07:48:42.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.970+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834175210 con 0x7f683417f8e0 2024-02-21T07:48:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.970+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683417fe90 con 0x7f68341743e0 2024-02-21T07:48:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.970+0000 7f6833400640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 0x7f683417f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 0x7f683421b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 -- 172.21.15.100:0/3635960522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 msgr2=0x7f68341747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 0x7f68341747c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 -- 172.21.15.100:0/3635960522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 msgr2=0x7f683417f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 0x7f683417f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.971+0000 7f6838c00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834180170 con 0x7f683417f8e0 2024-02-21T07:48:42.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.972+0000 7f6833400640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 0x7f683417f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.973+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 0x7f683421b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f683406f180 tx=0x7f682c007a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.973+0000 7f6827e00640 1 -- 172.21.15.100:0/3635960522 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00e8a0 con 0x7f683417f8e0 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.973+0000 7f6827e00640 1 -- 172.21.15.100:0/3635960522 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00ea40 con 0x7f683417f8e0 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.975+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6834180450 con 0x7f683417f8e0 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.975+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834180a10 con 0x7f683417f8e0 2024-02-21T07:48:42.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.975+0000 7f6827e00640 1 -- 172.21.15.100:0/3635960522 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00edf0 con 0x7f683417f8e0 2024-02-21T07:48:42.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.979+0000 7f683d802740 1 Processor -- start 2024-02-21T07:48:42.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.980+0000 7f6827e00640 1 -- 172.21.15.100:0/3635960522 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f682c014480 con 0x7f683417f8e0 2024-02-21T07:48:42.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.980+0000 7f683d802740 1 -- start start 2024-02-21T07:48:42.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 0x55f21113ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21116c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 0x55f21116cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21106e210 con 0x55f21113fb60 2024-02-21T07:48:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21106b740 con 0x55f211146100 2024-02-21T07:48:42.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.981+0000 7f683d802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f211066f20 con 0x55f211146580 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6833400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 0x55f21113ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6833400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 0x55f21113ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55716/0 (socket says 172.21.15.100:55716) 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6833400640 1 -- 172.21.15.100:0/3300315496 learned_addr learned my addr 172.21.15.100:0/3300315496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6833400640 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 0x55f21116cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6833e00640 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21116c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.982+0000 7f6827e00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 0x7f68140a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6827e00640 1 -- 172.21.15.100:0/3635960522 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f682c0c9320 con 0x7f683417f8e0 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 -- 172.21.15.100:0/3300315496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 msgr2=0x55f21116c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21116c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 -- 172.21.15.100:0/3300315496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 msgr2=0x55f21113ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 0x55f21113ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 -- 172.21.15.100:0/3300315496 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f211028df0 con 0x55f211146580 2024-02-21T07:48:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 0x7f68140a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f6833400640 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 0x55f21116cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6820019400 tx=0x7f6820008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e536f51a6152e4c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.983+0000 7f681be00640 1 -- 172.21.15.100:0/3300315496 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682001d070 con 0x55f211146580 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f681be00640 1 -- 172.21.15.100:0/3300315496 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820004020 con 0x55f211146580 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f681be00640 1 -- 172.21.15.100:0/3300315496 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004190 con 0x55f211146580 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 -- 172.21.15.100:0/3300315496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 msgr2=0x55f21116cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 0x55f21116cbc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6820019400 tx=0x7f6820008040 comp rx=0 tx=0).stop 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f6838c00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 0x7f68140a1660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f682c001b00 tx=0x7f682c09d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 -- 172.21.15.100:0/3300315496 shutdown_connections 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146580 0x55f21116cbc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21116c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 --2- 172.21.15.100:0/3300315496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f21113fb60 0x55f21113ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.984+0000 7f683d802740 1 -- 172.21.15.100:0/3300315496 >> 172.21.15.100:0/3300315496 conn(0x55f2110fd490 msgr2=0x55f2110fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:42.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.985+0000 7f683d802740 1 -- 172.21.15.100:0/3300315496 shutdown_connections 2024-02-21T07:48:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.986+0000 7f683d802740 1 -- 172.21.15.100:0/3300315496 wait complete. 2024-02-21T07:48:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.986+0000 7f683d802740 1 -- start start 2024-02-21T07:48:42.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.987+0000 7f683d802740 1 Processor -- start 2024-02-21T07:48:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21113dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 0x55f21116e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21100c150 con 0x55f211146580 2024-02-21T07:48:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21100bdf0 con 0x55f211146100 2024-02-21T07:48:42.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f210dd51c0 con 0x55f211180b40 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f683d802740 10 client.0 _ll_register_callbacks cb 0x55f21105b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f6833e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f6833e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55722/0 (socket says 172.21.15.100:55722) 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f6833e00640 1 -- 172.21.15.100:0/786539652 learned_addr learned my addr 172.21.15.100:0/786539652 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f6833400640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21113dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.988+0000 7f6833400640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 0x55f21116e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 -- 172.21.15.100:0/786539652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 msgr2=0x55f21116e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 0x55f21116e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 -- 172.21.15.100:0/786539652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 msgr2=0x55f21113dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21113dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 -- 172.21.15.100:0/786539652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6820009c60 con 0x55f211146580 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833400640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 0x55f21116e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:42.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6833e00640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6828001870 tx=0x7f6828001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4d4587f8ec790f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.989+0000 7f6818c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828007580 con 0x55f211146580 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68280067d0 con 0x55f211146580 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f210d667e0 con 0x55f211146580 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68280076e0 con 0x55f211146580 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f683d802740 10 client.5541 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f2110655a0 con 0x55f211146580 2024-02-21T07:48:42.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.990+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f210d667e0 con 0x55f211146580 2024-02-21T07:48:42.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6828006990 con 0x55f211146580 2024-02-21T07:48:42.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 10 client.5541 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:42.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 10 client.5541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 20 client.5541 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f21116ffd0 0x55f21118a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 4 client.5541 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.991+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f210da3720 con 0x55f21116ffd0 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.992+0000 7f6833400640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f21116ffd0 0x55f21118a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.992+0000 7f6833400640 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f21116ffd0 0x55f21118a8f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0490675936d649a server_cookie=cd1bd26606b8665d in_seq=0 out_seq=0 2024-02-21T07:48:42.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.992+0000 7f6818c00640 10 client.5541 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:42.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.994+0000 7f6818c00640 1 -- 172.21.15.100:0/786539652 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f210da3720 con 0x55f21116ffd0 2024-02-21T07:48:42.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.994+0000 7f6818c00640 10 client.5541 handle_command_reply: tid=0 2024-02-21T07:48:42.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 client.5541 shutdown 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 msgr2=0x55f211139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6828001870 tx=0x7f6828001190 comp rx=0 tx=0).stop 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 shutdown_connections 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f21116ffd0 0x55f21118a8f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211180b40 0x55f21116e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f211146580 0x55f211139780 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 --2- 172.21.15.100:0/786539652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211146100 0x55f21113dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 >> 172.21.15.100:0/786539652 conn(0x55f21113fb60 msgr2=0x55f2110f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:43.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.995+0000 7f6818c00640 0 client.5541 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:43.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.996+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 shutdown_connections 2024-02-21T07:48:43.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.996+0000 7f683d802740 1 -- 172.21.15.100:0/786539652 wait complete. 2024-02-21T07:48:43.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:42.996+0000 7f683d802740 20 client.5541 trim_cache size 0 max 16384 2024-02-21T07:48:43.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.030+0000 7f683d802740 1 Processor -- start 2024-02-21T07:48:43.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.031+0000 7f683d802740 1 -- start start 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f2111d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 0x55f211171320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 0x55f21116f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21116f680 con 0x55f2111369b0 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2111d91e0 con 0x55f211180b40 2024-02-21T07:48:43.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.033+0000 7f683d802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21113db50 con 0x55f211146100 2024-02-21T07:48:43.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.035+0000 7f6833400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f2111d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:43.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.035+0000 7f6833400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f2111d71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51132/0 (socket says 172.21.15.100:51132) 2024-02-21T07:48:43.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.035+0000 7f6833400640 1 -- 172.21.15.100:0/975463245 learned_addr learned my addr 172.21.15.100:0/975463245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:43.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 0x55f211171320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833400640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 0x55f21116f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 -- 172.21.15.100:0/975463245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 msgr2=0x55f2111d71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f2111d71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 -- 172.21.15.100:0/975463245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 msgr2=0x55f21116f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 0x55f21116f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833e00640 1 -- 172.21.15.100:0/975463245 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f211001ab0 con 0x55f211180b40 2024-02-21T07:48:43.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.038+0000 7f6833400640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 0x55f21116f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:43.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.039+0000 7f6833e00640 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 0x55f211171320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f6828041040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c63b4923a3b95cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:43.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.039+0000 7f681b400640 1 -- 172.21.15.100:0/975463245 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828005490 con 0x55f211180b40 2024-02-21T07:48:43.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.039+0000 7f681b400640 1 -- 172.21.15.100:0/975463245 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6828006e00 con 0x55f211180b40 2024-02-21T07:48:43.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.039+0000 7f681b400640 1 -- 172.21.15.100:0/975463245 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68280067d0 con 0x55f211180b40 2024-02-21T07:48:43.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.040+0000 7f683d802740 1 -- 172.21.15.100:0/975463245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 msgr2=0x55f211171320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:43.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.040+0000 7f683d802740 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 0x55f211171320 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f6828041040 comp rx=0 tx=0).stop 2024-02-21T07:48:43.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 -- 172.21.15.100:0/975463245 shutdown_connections 2024-02-21T07:48:43.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111369b0 0x55f21116f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f211180b40 0x55f211171320 secure :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6828001750 tx=0x7f6828041040 comp rx=0 tx=0).stop 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 --2- 172.21.15.100:0/975463245 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f2111d71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 -- 172.21.15.100:0/975463245 >> 172.21.15.100:0/975463245 conn(0x55f21113fb60 msgr2=0x55f211139590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 -- 172.21.15.100:0/975463245 shutdown_connections 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.041+0000 7f683d802740 1 -- 172.21.15.100:0/975463245 wait complete. 2024-02-21T07:48:43.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.042+0000 7f683d802740 1 -- start start 2024-02-21T07:48:43.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.042+0000 7f683d802740 1 Processor -- start 2024-02-21T07:48:43.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2111369b0 0x55f21113d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111d72d0 0x55f211145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f21113be10 con 0x55f2111d72d0 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2111e6920 con 0x55f2111369b0 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2110fe4d0 con 0x55f211146100 2024-02-21T07:48:43.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.044+0000 7f683d802740 10 client.0 _ll_register_callbacks cb 0x7f6820009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.045+0000 7f6833e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.045+0000 7f6833e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51144/0 (socket says 172.21.15.100:51144) 2024-02-21T07:48:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.045+0000 7f6833e00640 1 -- 172.21.15.100:0/4185795941 learned_addr learned my addr 172.21.15.100:0/4185795941 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.047+0000 7f6833e00640 1 -- 172.21.15.100:0/4185795941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2111369b0 msgr2=0x55f21113d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.047+0000 7f6833e00640 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2111369b0 0x55f21113d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.047+0000 7f6833e00640 1 -- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111d72d0 msgr2=0x55f211145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.047+0000 7f6833e00640 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111d72d0 0x55f211145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.047+0000 7f6833e00640 1 -- 172.21.15.100:0/4185795941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2110655a0 con 0x55f211146100 2024-02-21T07:48:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.048+0000 7f6818c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.048+0000 7f6833e00640 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f682802bc50 tx=0x7f6828007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449f46bdd73eb843 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.048+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828005490 con 0x55f211146100 2024-02-21T07:48:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.048+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68280069e0 con 0x55f211146100 2024-02-21T07:48:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.049+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6820004020 con 0x55f211146100 2024-02-21T07:48:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.049+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68280035f0 con 0x55f211146100 2024-02-21T07:48:43.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.050+0000 7f683d802740 10 client.5642 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.050+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f211027650 con 0x55f211146100 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.050+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820004020 con 0x55f211146100 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.050+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6828003750 con 0x55f211146100 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 10 client.5642 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 10 client.5642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 20 client.5642 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f2111d61b0 0x55f21113c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 4 client.5642 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:48:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.052+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f210df2890 con 0x55f2111d61b0 2024-02-21T07:48:43.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.068+0000 7f6833400640 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f2111d61b0 0x55f21113c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.078+0000 7f6833400640 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f2111d61b0 0x55f21113c230 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30b8186049ebdc3 server_cookie=736d7140de98be6f in_seq=0 out_seq=0 2024-02-21T07:48:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.078+0000 7f6818c00640 10 client.5642 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.079+0000 7f6818c00640 1 -- 172.21.15.100:0/4185795941 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f210df2890 con 0x55f2111d61b0 2024-02-21T07:48:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.079+0000 7f6818c00640 10 client.5642 handle_command_reply: tid=0 2024-02-21T07:48:43.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.079+0000 7f683d802740 1 client.5642 shutdown 2024-02-21T07:48:43.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.079+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 msgr2=0x55f21117bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:43.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.079+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f682802bc50 tx=0x7f6828007c80 comp rx=0 tx=0).stop 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.080+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 shutdown_connections 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.080+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f2111d61b0 0x55f21113c230 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.080+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f2111d72d0 0x55f211145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.080+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f211146100 0x55f21117bed0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.080+0000 7f683d802740 1 --2- 172.21.15.100:0/4185795941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f2111369b0 0x55f21113d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.081+0000 7f6818c00640 0 client.5642 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:43.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.081+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 >> 172.21.15.100:0/4185795941 conn(0x55f21113fb60 msgr2=0x55f211105930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.085+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 shutdown_connections 2024-02-21T07:48:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.086+0000 7f683d802740 1 -- 172.21.15.100:0/4185795941 wait complete. 2024-02-21T07:48:43.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.086+0000 7f683d802740 20 client.5642 trim_cache size 0 max 16384 2024-02-21T07:48:43.092 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:48:43.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.088+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 msgr2=0x7f68140a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:43.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.088+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 0x7f68140a1660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f682c001b00 tx=0x7f682c09d040 comp rx=0 tx=0).stop 2024-02-21T07:48:43.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.088+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 msgr2=0x7f683421b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:43.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.088+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 0x7f683421b0a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f683406f180 tx=0x7f682c007a80 comp rx=0 tx=0).stop 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 shutdown_connections 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f683417f8e0 0x7f683421b0a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f681409f1a0 0x7f68140a1660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834174d00 0x7f683417f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 --2- 172.21.15.100:0/3635960522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68341743e0 0x7f68341747c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:43.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 >> 172.21.15.100:0/3635960522 conn(0x7f68340668b0 msgr2=0x7f68341788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:43.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.090+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 shutdown_connections 2024-02-21T07:48:43.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:43.093+0000 7f683ac00640 1 -- 172.21.15.100:0/3635960522 wait complete. 2024-02-21T07:48:44.142 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:48:44.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:48:44.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:48:44.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.481+0000 7f6894200640 1 Processor -- start 2024-02-21T07:48:44.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.482+0000 7f6894200640 1 -- start start 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.483+0000 7f6894200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f688c0d69b0 0x7f688c06bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.483+0000 7f6894200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c06c350 con 0x7f688c164740 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.483+0000 7f6894200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c06c630 con 0x7f688c18a940 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.483+0000 7f6894200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c164b20 con 0x7f688c0d69b0 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.484+0000 7f6891800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f688c164740 0x7f688c18a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56488/0 (socket says 172.21.15.100:56488) 2024-02-21T07:48:44.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.484+0000 7f6891800640 1 -- 172.21.15.100:0/2562327659 learned_addr learned my addr 172.21.15.100:0/2562327659 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.484+0000 7f6890e00640 1 --2- 172.21.15.100:0/2562327659 >> v2:172.21.15.170:3300/0 conn(0x7f688c0d69b0 0x7f688c06bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.485+0000 7f6890e00640 1 -- 172.21.15.100:0/2562327659 >> v1:172.21.15.156:6789/0 conn(0x7f688c18a940 legacy=0x7f688c188960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.485+0000 7f6890e00640 1 -- 172.21.15.100:0/2562327659 >> v1:172.21.15.100:6789/0 conn(0x7f688c164740 legacy=0x7f688c18a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.485+0000 7f688be00640 1 -- 172.21.15.100:0/2562327659 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246321355 0 0) 0x7f688c06c350 con 0x7f688c164740 2024-02-21T07:48:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.485+0000 7f6890e00640 1 -- 172.21.15.100:0/2562327659 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c06c910 con 0x7f688c0d69b0 2024-02-21T07:48:44.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.486+0000 7f6890e00640 1 --2- 172.21.15.100:0/2562327659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c0d69b0 0x7f688c06bbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68780097a0 tx=0x7f687802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64f648a93695bda server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.486+0000 7f688be00640 1 -- 172.21.15.100:0/2562327659 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878030610 con 0x7f688c0d69b0 2024-02-21T07:48:44.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.486+0000 7f688be00640 1 -- 172.21.15.100:0/2562327659 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878030770 con 0x7f688c0d69b0 2024-02-21T07:48:44.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.486+0000 7f688be00640 1 -- 172.21.15.100:0/2562327659 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878030b00 con 0x7f688c0d69b0 2024-02-21T07:48:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 -- 172.21.15.100:0/2562327659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c0d69b0 msgr2=0x7f688c06bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 --2- 172.21.15.100:0/2562327659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c0d69b0 0x7f688c06bbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f68780097a0 tx=0x7f687802b960 comp rx=0 tx=0).stop 2024-02-21T07:48:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 -- 172.21.15.100:0/2562327659 shutdown_connections 2024-02-21T07:48:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 --2- 172.21.15.100:0/2562327659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c0d69b0 0x7f688c06bbf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 -- 172.21.15.100:0/2562327659 >> 172.21.15.100:0/2562327659 conn(0x7f688c0fe1a0 msgr2=0x7f688c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 -- 172.21.15.100:0/2562327659 shutdown_connections 2024-02-21T07:48:44.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.487+0000 7f6894200640 1 -- 172.21.15.100:0/2562327659 wait complete. 2024-02-21T07:48:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.489+0000 7f6894200640 1 Processor -- start 2024-02-21T07:48:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.489+0000 7f6894200640 1 -- start start 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c0d69b0 0x7f688c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c18a940 0x7f688c0d4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0f9f10 con 0x7f688c0d69b0 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0ce6f0 con 0x7f688c164740 2024-02-21T07:48:44.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.490+0000 7f6894200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0f9950 con 0x7f688c18a940 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.491+0000 7f6890e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.491+0000 7f6890e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39572/0 (socket says 172.21.15.100:39572) 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.491+0000 7f6890e00640 1 -- 172.21.15.100:0/794099009 learned_addr learned my addr 172.21.15.100:0/794099009 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.491+0000 7f6891800640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c0d69b0 0x7f688c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.491+0000 7f6892200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c18a940 0x7f688c0d4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 -- 172.21.15.100:0/794099009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c18a940 msgr2=0x7f688c0d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c18a940 0x7f688c0d4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 -- 172.21.15.100:0/794099009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c0d69b0 msgr2=0x7f688c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c0d69b0 0x7f688c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 -- 172.21.15.100:0/794099009 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878009400 con 0x7f688c164740 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.492+0000 7f6890e00640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68780098c0 tx=0x7f6878004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.493+0000 7f6889600640 1 -- 172.21.15.100:0/794099009 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687803e040 con 0x7f688c164740 2024-02-21T07:48:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.493+0000 7f6889600640 1 -- 172.21.15.100:0/794099009 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878039c90 con 0x7f688c164740 2024-02-21T07:48:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.493+0000 7f6889600640 1 -- 172.21.15.100:0/794099009 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780443f0 con 0x7f688c164740 2024-02-21T07:48:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.493+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0f9c30 con 0x7f688c164740 2024-02-21T07:48:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.493+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c0cec00 con 0x7f688c164740 2024-02-21T07:48:44.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.499+0000 7f6896e0d740 1 Processor -- start 2024-02-21T07:48:44.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.499+0000 7f6896e0d740 1 -- start start 2024-02-21T07:48:44.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.499+0000 7f6889600640 1 -- 172.21.15.100:0/794099009 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f687804d3b0 con 0x7f688c164740 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 0x5641bc13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 0x5641bc17a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc17b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc0bf300 con 0x5641bc13fae0 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc071e50 con 0x5641bc17a890 2024-02-21T07:48:44.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.500+0000 7f6896e0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc06f380 con 0x5641bc13f1c0 2024-02-21T07:48:44.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6892200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 0x5641bc13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6892200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 0x5641bc13f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51168/0 (socket says 172.21.15.100:51168) 2024-02-21T07:48:44.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6890e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc17b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6890e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc17b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39584/0 (socket says 172.21.15.100:39584) 2024-02-21T07:48:44.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6890e00640 1 -- 172.21.15.100:0/2865475076 learned_addr learned my addr 172.21.15.100:0/2865475076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:44.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.501+0000 7f6891800640 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 0x5641bc17a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.502+0000 7f6891800640 1 -- 172.21.15.100:0/2865475076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 msgr2=0x5641bc13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.502+0000 7f6891800640 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 0x5641bc13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.502+0000 7f6891800640 1 -- 172.21.15.100:0/2865475076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 msgr2=0x5641bc17b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.502+0000 7f6891800640 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc17b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.502+0000 7f6891800640 1 -- 172.21.15.100:0/2865475076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641bc033c80 con 0x5641bc13fae0 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.503+0000 7f6891800640 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 0x5641bc17a350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68800011e0 tx=0x7f6880004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc59009a9d0c9e42 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.503+0000 7f6889600640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 0x7f686c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.503+0000 7f6892200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 0x7f686c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.503+0000 7f6889600640 1 -- 172.21.15.100:0/794099009 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68780ec0f0 con 0x7f688c164740 2024-02-21T07:48:44.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.504+0000 7f687e000640 1 -- 172.21.15.100:0/2865475076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800018b0 con 0x5641bc13fae0 2024-02-21T07:48:44.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.504+0000 7f687e000640 1 -- 172.21.15.100:0/2865475076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880001a10 con 0x5641bc13fae0 2024-02-21T07:48:44.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.504+0000 7f687e000640 1 -- 172.21.15.100:0/2865475076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880001d80 con 0x5641bc13fae0 2024-02-21T07:48:44.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6892200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 0x7f686c0a1560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5641bc101510 tx=0x7f6884009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 -- 172.21.15.100:0/2865475076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 msgr2=0x5641bc17a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 0x5641bc17a350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f68800011e0 tx=0x7f6880004bb0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 -- 172.21.15.100:0/2865475076 shutdown_connections 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc17b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc13fae0 0x5641bc17a350 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2865475076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc13f1c0 0x5641bc13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.505+0000 7f6896e0d740 1 -- 172.21.15.100:0/2865475076 >> 172.21.15.100:0/2865475076 conn(0x5641bc101790 msgr2=0x5641bc102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.506+0000 7f6896e0d740 1 -- 172.21.15.100:0/2865475076 shutdown_connections 2024-02-21T07:48:44.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.506+0000 7f6896e0d740 1 -- 172.21.15.100:0/2865475076 wait complete. 2024-02-21T07:48:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.511+0000 7f6896e0d740 1 -- start start 2024-02-21T07:48:44.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.511+0000 7f6896e0d740 1 Processor -- start 2024-02-21T07:48:44.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc0ff470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc12ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc06ab60 con 0x5641bc12f200 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc00ffd0 con 0x5641bc17a890 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc00fc70 con 0x5641bc1280d0 2024-02-21T07:48:44.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6896e0d740 10 client.0 _ll_register_callbacks cb 0x5641bbd7bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.514+0000 7f6890e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55758/0 (socket says 172.21.15.100:55758) 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 -- 172.21.15.100:0/2251445848 learned_addr learned my addr 172.21.15.100:0/2251445848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 -- 172.21.15.100:0/2251445848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 msgr2=0x5641bc12ca50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc12ca50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 -- 172.21.15.100:0/2251445848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 msgr2=0x5641bc0ff470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc0ff470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.515+0000 7f6890e00640 1 -- 172.21.15.100:0/2251445848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800072f0 con 0x5641bc12f200 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.516+0000 7f6890e00640 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f68780b9c70 tx=0x7f6878006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c0f76a3c64754f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.516+0000 7f6872a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:48:44.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780b9640 con 0x5641bc12f200 2024-02-21T07:48:44.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68780b9ce0 con 0x5641bc12f200 2024-02-21T07:48:44.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641bbd6a860 con 0x5641bc12f200 2024-02-21T07:48:44.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68780bdd80 con 0x5641bc12f200 2024-02-21T07:48:44.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6896e0d740 10 client.5553 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:44.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.517+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5641bc0691e0 con 0x5641bc12f200 2024-02-21T07:48:44.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.518+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641bbd6a860 con 0x5641bc12f200 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.518+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f68780b9130 con 0x5641bc12f200 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.518+0000 7f6896e0d740 10 client.5553 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.518+0000 7f6896e0d740 10 client.5553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.519+0000 7f6896e0d740 20 client.5553 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.519+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc12d460 0x5641bc18f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.519+0000 7f6896e0d740 4 client.5553 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.519+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641bbdbb410 con 0x5641bc12d460 2024-02-21T07:48:44.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.519+0000 7f6891800640 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc12d460 0x5641bc18f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.521+0000 7f6891800640 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc12d460 0x5641bc18f430 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0492cd8471c300a server_cookie=fe569379d281e64a in_seq=0 out_seq=0 2024-02-21T07:48:44.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.521+0000 7f6872a00640 10 client.5553 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:44.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.523+0000 7f6872a00640 1 -- 172.21.15.100:0/2251445848 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641bbdbb410 con 0x5641bc12d460 2024-02-21T07:48:44.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.523+0000 7f6872a00640 10 client.5553 handle_command_reply: tid=0 2024-02-21T07:48:44.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.523+0000 7f6896e0d740 1 client.5553 shutdown 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.523+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 msgr2=0x5641bc127b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.523+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f68780b9c70 tx=0x7f6878006ef0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 shutdown_connections 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc12d460 0x5641bc18f430 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc12ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc127b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 --2- 172.21.15.100:0/2251445848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc0ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 >> 172.21.15.100:0/2251445848 conn(0x5641bc13f1c0 msgr2=0x5641bc103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6872a00640 0 client.5553 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.524+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 shutdown_connections 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.525+0000 7f6896e0d740 1 -- 172.21.15.100:0/2251445848 wait complete. 2024-02-21T07:48:44.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.525+0000 7f6896e0d740 20 client.5553 trim_cache size 0 max 16384 2024-02-21T07:48:44.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.562+0000 7f6896e0d740 1 Processor -- start 2024-02-21T07:48:44.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.563+0000 7f6896e0d740 1 -- start start 2024-02-21T07:48:44.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 0x5641bc109c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 0x5641bc1dbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bbdb30c0 con 0x5641bc17a890 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc102d10 con 0x5641bc1280d0 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.565+0000 7f6896e0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc127bd0 con 0x5641bc12f200 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.566+0000 7f6891800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.566+0000 7f6891800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39592/0 (socket says 172.21.15.100:39592) 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.566+0000 7f6891800640 1 -- 172.21.15.100:0/1727082151 learned_addr learned my addr 172.21.15.100:0/1727082151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:44.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6890e00640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 0x5641bc109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6892200640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 0x5641bc1dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6891800640 1 -- 172.21.15.100:0/1727082151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 msgr2=0x5641bc109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6891800640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 0x5641bc109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6891800640 1 -- 172.21.15.100:0/1727082151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 msgr2=0x5641bc1dbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.567+0000 7f6891800640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 0x5641bc1dbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.568+0000 7f6891800640 1 -- 172.21.15.100:0/1727082151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641bc005a90 con 0x5641bc1280d0 2024-02-21T07:48:44.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.569+0000 7f6890e00640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 0x5641bc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:44.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.569+0000 7f6892200640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 0x5641bc1dbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:44.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.571+0000 7f6891800640 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6880018040 tx=0x7f688000c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499efb1322709e9b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.572+0000 7f687d600640 1 -- 172.21.15.100:0/1727082151 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800077b0 con 0x5641bc1280d0 2024-02-21T07:48:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.572+0000 7f687d600640 1 -- 172.21.15.100:0/1727082151 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880024150 con 0x5641bc1280d0 2024-02-21T07:48:44.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.572+0000 7f687d600640 1 -- 172.21.15.100:0/1727082151 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800077b0 con 0x5641bc1280d0 2024-02-21T07:48:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.574+0000 7f6896e0d740 1 -- 172.21.15.100:0/1727082151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 msgr2=0x5641bc1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.574+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6880018040 tx=0x7f688000c000 comp rx=0 tx=0).stop 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.587+0000 7f6896e0d740 1 -- 172.21.15.100:0/1727082151 shutdown_connections 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.587+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc17a890 0x5641bc1dbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.587+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc12f200 0x5641bc109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.587+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1727082151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.587+0000 7f6896e0d740 1 -- 172.21.15.100:0/1727082151 >> 172.21.15.100:0/1727082151 conn(0x5641bc13f1c0 msgr2=0x5641bc0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.588+0000 7f6896e0d740 1 -- 172.21.15.100:0/1727082151 shutdown_connections 2024-02-21T07:48:44.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.588+0000 7f6896e0d740 1 -- 172.21.15.100:0/1727082151 wait complete. 2024-02-21T07:48:44.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.591+0000 7f6896e0d740 1 -- start start 2024-02-21T07:48:44.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.592+0000 7f6896e0d740 1 Processor -- start 2024-02-21T07:48:44.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc1d8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc124f30 con 0x5641bc12f200 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc120bb0 con 0x5641bc17a890 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641bc124070 con 0x5641bc1280d0 2024-02-21T07:48:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.594+0000 7f6896e0d740 10 client.0 _ll_register_callbacks cb 0x7f68800070e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.596+0000 7f6891800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.596+0000 7f6890e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.596+0000 7f6891800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51192/0 (socket says 172.21.15.100:51192) 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.596+0000 7f6891800640 1 -- 172.21.15.100:0/1877778549 learned_addr learned my addr 172.21.15.100:0/1877778549 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6892200640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc1d8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 -- 172.21.15.100:0/1877778549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 msgr2=0x5641bc1d8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc1d8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 -- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 msgr2=0x5641bc13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 -- 172.21.15.100:0/1877778549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688400f040 con 0x5641bc1280d0 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6891800640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f688c0fa6b0 tx=0x7f6880000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a0c29b5a0f4144 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6890e00640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:44.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.597+0000 7f6872a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.600+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800244c0 con 0x5641bc1280d0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.600+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6880024e40 con 0x5641bc1280d0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.601+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6880001a10 con 0x5641bc1280d0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.601+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68800077b0 con 0x5641bc1280d0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.601+0000 7f6896e0d740 10 client.5654 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.601+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5641bc033c80 con 0x5641bc1280d0 2024-02-21T07:48:44.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.601+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880001a10 con 0x5641bc1280d0 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6880012070 con 0x5641bc1280d0 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 10 client.5654 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 10 client.5654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 20 client.5654 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc179bd0 0x5641bc1db330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 4 client.5654 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:48:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.602+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5641bbda77b0 con 0x5641bc179bd0 2024-02-21T07:48:44.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.607+0000 7f6890e00640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc179bd0 0x5641bc1db330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:44.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.624+0000 7f6890e00640 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc179bd0 0x5641bc1db330 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c3bc83b40dcb33 server_cookie=c2cf16e8c898f105 in_seq=0 out_seq=0 2024-02-21T07:48:44.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.625+0000 7f6872a00640 10 client.5654 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.629+0000 7f6872a00640 1 -- 172.21.15.100:0/1877778549 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5641bbda77b0 con 0x5641bc179bd0 2024-02-21T07:48:44.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.629+0000 7f6872a00640 10 client.5654 handle_command_reply: tid=0 2024-02-21T07:48:44.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.629+0000 7f6896e0d740 1 client.5654 shutdown 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 msgr2=0x5641bc1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f688c0fa6b0 tx=0x7f6880000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 shutdown_connections 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641bc179bd0 0x5641bc1db330 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641bc17a890 0x5641bc1d8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641bc12f200 0x5641bc13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 --2- 172.21.15.100:0/1877778549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641bc1280d0 0x5641bc1027d0 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f688c0fa6b0 tx=0x7f6880000ed0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 >> 172.21.15.100:0/1877778549 conn(0x5641bc13f1c0 msgr2=0x5641bc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.631+0000 7f6872a00640 0 client.5654 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:44.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.632+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 shutdown_connections 2024-02-21T07:48:44.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.632+0000 7f6896e0d740 1 -- 172.21.15.100:0/1877778549 wait complete. 2024-02-21T07:48:44.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.635+0000 7f6896e0d740 20 client.5654 trim_cache size 0 max 16384 2024-02-21T07:48:44.640 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:48:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "b068d764-801c-422f-96d6-f6cccdd83234", 2024-02-21T07:48:44.640 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:48:44.640 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.637+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 msgr2=0x7f686c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.637+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 0x7f686c0a1560 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5641bc101510 tx=0x7f6884009040 comp rx=0 tx=0).stop 2024-02-21T07:48:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.637+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 msgr2=0x7f688c0d4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:44.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.637+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68780098c0 tx=0x7f6878004730 comp rx=0 tx=0).stop 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 shutdown_connections 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c18a940 0x7f688c0d4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f688c164740 0x7f688c0d4320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f0a0 0x7f686c0a1560 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 --2- 172.21.15.100:0/794099009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c0d69b0 0x7f688c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.638+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 >> 172.21.15.100:0/794099009 conn(0x7f688c0fe1a0 msgr2=0x7f688c0fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:44.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.642+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 shutdown_connections 2024-02-21T07:48:44.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:44.642+0000 7f6894200640 1 -- 172.21.15.100:0/794099009 wait complete. 2024-02-21T07:48:44.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:48:44.674 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:48:45.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.032+0000 7ff0b8e00640 1 Processor -- start 2024-02-21T07:48:45.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.033+0000 7ff0b8e00640 1 -- start start 2024-02-21T07:48:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b8e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff0b41868b0 0x7ff0b4186d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b8e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b406eed0 con 0x7ff0b40cec70 2024-02-21T07:48:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b8e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0b4185720 con 0x7ff0b417b3f0 2024-02-21T07:48:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b8e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0b4071f20 con 0x7ff0b41868b0 2024-02-21T07:48:45.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b3400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ff0b417b3f0 0x7ff0b4185010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:54888/0 (socket says 172.21.15.100:54888) 2024-02-21T07:48:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.035+0000 7ff0b3400640 1 -- 172.21.15.100:0/146111213 learned_addr learned my addr 172.21.15.100:0/146111213 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:48:45.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.037+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/146111213 >> v2:172.21.15.156:3300/0 conn(0x7ff0b41868b0 0x7ff0b4186d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.037+0000 7ff0b2a00640 1 -- 172.21.15.100:0/146111213 >> v1:172.21.15.170:6789/0 conn(0x7ff0b417b3f0 legacy=0x7ff0b4185010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.037+0000 7ff0b2a00640 1 -- 172.21.15.100:0/146111213 >> v1:172.21.15.100:6789/0 conn(0x7ff0b40cec70 legacy=0x7ff0b406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.037+0000 7ff0b2000640 1 -- 172.21.15.100:0/146111213 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510777709 0 0) 0x7ff0b4185720 con 0x7ff0b417b3f0 2024-02-21T07:48:45.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.037+0000 7ff0b2a00640 1 -- 172.21.15.100:0/146111213 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b406e910 con 0x7ff0b41868b0 2024-02-21T07:48:45.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.039+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/146111213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b4186d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00097a0 tx=0x7ff0a002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c9fffd2c63c13d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.039+0000 7ff0b2000640 1 -- 172.21.15.100:0/146111213 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00317c0 con 0x7ff0b41868b0 2024-02-21T07:48:45.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.040+0000 7ff0b2000640 1 -- 172.21.15.100:0/146111213 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0031920 con 0x7ff0b41868b0 2024-02-21T07:48:45.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.040+0000 7ff0b2000640 1 -- 172.21.15.100:0/146111213 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0031cb0 con 0x7ff0b41868b0 2024-02-21T07:48:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.043+0000 7ff0b8e00640 1 -- 172.21.15.100:0/146111213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 msgr2=0x7ff0b4186d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.043+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/146111213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b4186d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00097a0 tx=0x7ff0a002b860 comp rx=0 tx=0).stop 2024-02-21T07:48:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.044+0000 7ff0b8e00640 1 -- 172.21.15.100:0/146111213 shutdown_connections 2024-02-21T07:48:45.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.044+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/146111213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b4186d10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.044+0000 7ff0b8e00640 1 -- 172.21.15.100:0/146111213 >> 172.21.15.100:0/146111213 conn(0x7ff0b40ce150 msgr2=0x7ff0b40ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.044+0000 7ff0b8e00640 1 -- 172.21.15.100:0/146111213 shutdown_connections 2024-02-21T07:48:45.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.044+0000 7ff0b8e00640 1 -- 172.21.15.100:0/146111213 wait complete. 2024-02-21T07:48:45.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.048+0000 7ff0b8e00640 1 Processor -- start 2024-02-21T07:48:45.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.048+0000 7ff0b8e00640 1 -- start start 2024-02-21T07:48:45.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 0x7ff0b4179c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0b417b3f0 0x7ff0b40c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40f58f0 con 0x7ff0b40cec70 2024-02-21T07:48:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40f5bd0 con 0x7ff0b41868b0 2024-02-21T07:48:45.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b8e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40f5eb0 con 0x7ff0b417b3f0 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.050+0000 7ff0b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39604/0 (socket says 172.21.15.100:39604) 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 -- 172.21.15.100:0/2952197812 learned_addr learned my addr 172.21.15.100:0/2952197812 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3400640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 0x7ff0b4179c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 -- 172.21.15.100:0/2952197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0b417b3f0 msgr2=0x7ff0b40c7e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0b417b3f0 0x7ff0b40c7e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 -- 172.21.15.100:0/2952197812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 msgr2=0x7ff0b4179c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 0x7ff0b4179c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3e00640 1 -- 172.21.15.100:0/2952197812 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a0009400 con 0x7ff0b41868b0 2024-02-21T07:48:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.051+0000 7ff0b3400640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 0x7ff0b4179c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:45.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c680 tx=0x7ff0ac00cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0ab400640 1 -- 172.21.15.100:0/2952197812 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac003b70 con 0x7ff0b41868b0 2024-02-21T07:48:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0ab400640 1 -- 172.21.15.100:0/2952197812 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac003cd0 con 0x7ff0b41868b0 2024-02-21T07:48:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0ab400640 1 -- 172.21.15.100:0/2952197812 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac0052f0 con 0x7ff0b41868b0 2024-02-21T07:48:45.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b40f6190 con 0x7ff0b41868b0 2024-02-21T07:48:45.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.052+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b40f7cd0 con 0x7ff0b41868b0 2024-02-21T07:48:45.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.057+0000 7ff0ab400640 1 -- 172.21.15.100:0/2952197812 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff0ac005450 con 0x7ff0b41868b0 2024-02-21T07:48:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.059+0000 7ff0bcff7740 1 Processor -- start 2024-02-21T07:48:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.059+0000 7ff0ab400640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 0x7ff0940a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.059+0000 7ff0ab400640 1 -- 172.21.15.100:0/2952197812 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff0ac0c99c0 con 0x7ff0b41868b0 2024-02-21T07:48:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.060+0000 7ff0bcff7740 1 -- start start 2024-02-21T07:48:45.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.060+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 0x7ff0940a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc557bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 0x7ff0940a15e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0036000 tx=0x7ff0a0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc55090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc547d150 con 0x55dcc5546ab0 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc547a680 con 0x55dcc557c150 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc5475e60 con 0x55dcc5546190 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39616/0 (socket says 172.21.15.100:39616) 2024-02-21T07:48:45.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.062+0000 7ff0b2a00640 1 -- 172.21.15.100:0/719550044 learned_addr learned my addr 172.21.15.100:0/719550044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.063+0000 7ff0b3400640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc557bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.064+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc55090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.064+0000 7ff0b2a00640 1 -- 172.21.15.100:0/719550044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 msgr2=0x55dcc557bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:45.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc557bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b2a00640 1 -- 172.21.15.100:0/719550044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 msgr2=0x55dcc55090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:45.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc55090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b2a00640 1 -- 172.21.15.100:0/719550044 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc542f060 con 0x55dcc557c150 2024-02-21T07:48:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc55090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009890 tx=0x7ff0a0030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e468e8d13579fbd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.065+0000 7ff09fe00640 1 -- 172.21.15.100:0/719550044 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00329a0 con 0x55dcc557c150 2024-02-21T07:48:45.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.066+0000 7ff09fe00640 1 -- 172.21.15.100:0/719550044 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a004b070 con 0x55dcc557c150 2024-02-21T07:48:45.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.066+0000 7ff09fe00640 1 -- 172.21.15.100:0/719550044 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0032d00 con 0x55dcc557c150 2024-02-21T07:48:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.067+0000 7ff0bcff7740 1 -- 172.21.15.100:0/719550044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 msgr2=0x55dcc5546570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.067+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009890 tx=0x7ff0a0030000 comp rx=0 tx=0).stop 2024-02-21T07:48:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 -- 172.21.15.100:0/719550044 shutdown_connections 2024-02-21T07:48:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc55090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5546570 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/719550044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc557bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 -- 172.21.15.100:0/719550044 >> 172.21.15.100:0/719550044 conn(0x55dcc54d55a0 msgr2=0x55dcc550d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 -- 172.21.15.100:0/719550044 shutdown_connections 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.068+0000 7ff0bcff7740 1 -- 172.21.15.100:0/719550044 wait complete. 2024-02-21T07:48:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.070+0000 7ff0bcff7740 1 -- start start 2024-02-21T07:48:45.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.070+0000 7ff0bcff7740 1 Processor -- start 2024-02-21T07:48:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546190 0x55dcc5579470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc557c150 0x55dcc5534dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc541aec0 con 0x55dcc5546190 2024-02-21T07:48:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc541ab60 con 0x55dcc5546ab0 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc51e41c0 con 0x55dcc557c150 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0bcff7740 10 client.0 _ll_register_callbacks cb 0x55dcc542e960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39632/0 (socket says 172.21.15.100:39632) 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1117575822 learned_addr learned my addr 172.21.15.100:0/1117575822 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1117575822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc557c150 msgr2=0x55dcc5534dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc557c150 0x55dcc5534dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.073+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546190 msgr2=0x55dcc5579470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff0b3400640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546190 0x55dcc5579470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546190 0x55dcc5579470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1117575822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a0041070 con 0x55dcc5546ab0 2024-02-21T07:48:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0000c00 tx=0x7ff0a0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236414967177e05 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff09cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004410 con 0x55dcc5546ab0 2024-02-21T07:48:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.074+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff0a00329a0 con 0x55dcc5546ab0 2024-02-21T07:48:45.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.075+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcc51757e0 con 0x55dcc5546ab0 2024-02-21T07:48:45.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.075+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0a0032b60 con 0x55dcc5546ab0 2024-02-21T07:48:45.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.075+0000 7ff0bcff7740 10 client.5713 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:45.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.076+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55dcc54744e0 con 0x55dcc5546ab0 2024-02-21T07:48:45.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.076+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dcc51757e0 con 0x55dcc5546ab0 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.076+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff0a0032cc0 con 0x55dcc5546ab0 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 10 client.5713 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 10 client.5713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 20 client.5713 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc5509500 0x55dcc558db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 4 client.5713 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.077+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcc51b2720 con 0x55dcc5509500 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.079+0000 7ff0b3400640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc5509500 0x55dcc558db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.080+0000 7ff0b3400640 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc5509500 0x55dcc558db60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af618571997db0b server_cookie=cbeb5da162f616d8 in_seq=0 out_seq=0 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.080+0000 7ff09cc00640 10 client.5713 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.081+0000 7ff09cc00640 1 -- 172.21.15.100:0/1117575822 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dcc51b2720 con 0x55dcc5509500 2024-02-21T07:48:45.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.081+0000 7ff09cc00640 10 client.5713 handle_command_reply: tid=0 2024-02-21T07:48:45.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 client.5713 shutdown 2024-02-21T07:48:45.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 msgr2=0x55dcc558f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0000c00 tx=0x7ff0a0004730 comp rx=0 tx=0).stop 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 shutdown_connections 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc5509500 0x55dcc558db60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc557c150 0x55dcc5534dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546ab0 0x55dcc558f460 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1117575822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546190 0x55dcc5579470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 >> 172.21.15.100:0/1117575822 conn(0x55dcc54d55a0 msgr2=0x55dcc557dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff09cc00640 0 client.5713 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:45.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.082+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 shutdown_connections 2024-02-21T07:48:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.083+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1117575822 wait complete. 2024-02-21T07:48:45.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.083+0000 7ff0bcff7740 20 client.5713 trim_cache size 0 max 16384 2024-02-21T07:48:45.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.122+0000 7ff0bcff7740 1 Processor -- start 2024-02-21T07:48:45.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.122+0000 7ff0bcff7740 1 -- start start 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 0x55dcc5509910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 0x55dcc558fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc5509e50 con 0x55dcc557c150 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc5503d30 con 0x55dcc5546190 2024-02-21T07:48:45.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc5535230 con 0x55dcc5546ab0 2024-02-21T07:48:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.124+0000 7ff0b3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 0x55dcc5509910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.125+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.125+0000 7ff0b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51226/0 (socket says 172.21.15.100:51226) 2024-02-21T07:48:45.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.125+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1606383400 learned_addr learned my addr 172.21.15.100:0/1606383400 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.125+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 0x55dcc558fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1606383400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 msgr2=0x55dcc5509910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 0x55dcc5509910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1606383400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 msgr2=0x55dcc558fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 0x55dcc558fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b2a00640 1 -- 172.21.15.100:0/1606383400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcc5410950 con 0x55dcc5546ab0 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b3400640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 0x55dcc5509910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.126+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 0x55dcc558fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.127+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00318f0 tx=0x7ff0a0056000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0309500ea4da945 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.127+0000 7ff09f400640 1 -- 172.21.15.100:0/1606383400 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00328a0 con 0x55dcc5546ab0 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.128+0000 7ff09f400640 1 -- 172.21.15.100:0/1606383400 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0032a00 con 0x55dcc5546ab0 2024-02-21T07:48:45.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.128+0000 7ff09f400640 1 -- 172.21.15.100:0/1606383400 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00328a0 con 0x55dcc5546ab0 2024-02-21T07:48:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.129+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1606383400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 msgr2=0x55dcc558f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.129+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00318f0 tx=0x7ff0a0056000 comp rx=0 tx=0).stop 2024-02-21T07:48:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.129+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1606383400 shutdown_connections 2024-02-21T07:48:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.129+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc557c150 0x55dcc558fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.130+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546ab0 0x55dcc558f340 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.130+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/1606383400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc5546190 0x55dcc5509910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.130+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1606383400 >> 172.21.15.100:0/1606383400 conn(0x55dcc54d55a0 msgr2=0x55dcc5513aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.130+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1606383400 shutdown_connections 2024-02-21T07:48:45.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.130+0000 7ff0bcff7740 1 -- 172.21.15.100:0/1606383400 wait complete. 2024-02-21T07:48:45.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.131+0000 7ff0bcff7740 1 -- start start 2024-02-21T07:48:45.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.132+0000 7ff0bcff7740 1 Processor -- start 2024-02-21T07:48:45.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.134+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc554de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc558f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc55d7fc0 con 0x55dcc5546ab0 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc554e3b0 con 0x55dcc557c150 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcc558f940 con 0x55dcc5546190 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39658/0 (socket says 172.21.15.100:39658) 2024-02-21T07:48:45.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0b3e00640 1 -- 172.21.15.100:0/507913576 learned_addr learned my addr 172.21.15.100:0/507913576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:45.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.135+0000 7ff0bcff7740 10 client.0 _ll_register_callbacks cb 0x7ff0ac0937c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:45.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b3e00640 1 -- 172.21.15.100:0/507913576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 msgr2=0x55dcc554de70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:48:45.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc554de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b3e00640 1 -- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 msgr2=0x55dcc558f400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc558f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc558f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b3e00640 1 -- 172.21.15.100:0/507913576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a400f040 con 0x55dcc557c150 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.136+0000 7ff0b2a00640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc558f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.137+0000 7ff0b3e00640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0971a0 tx=0x7ff0ac001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89d538907396a432 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.137+0000 7ff09cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:45.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.137+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac09b5f0 con 0x55dcc557c150 2024-02-21T07:48:45.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.137+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff0ac003e40 con 0x55dcc557c150 2024-02-21T07:48:45.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0a004b070 con 0x55dcc557c150 2024-02-21T07:48:45.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0ac09fc40 con 0x55dcc557c150 2024-02-21T07:48:45.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff0bcff7740 10 client.5719 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:45.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55dcc54744e0 con 0x55dcc557c150 2024-02-21T07:48:45.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a004b070 con 0x55dcc557c150 2024-02-21T07:48:45.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.138+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff0ac019020 con 0x55dcc557c150 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 10 client.5719 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 10 client.5719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 20 client.5719 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc557b900 0x55dcc559e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 4 client.5719 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dcc5201890 con 0x55dcc557b900 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.139+0000 7ff0b3400640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc557b900 0x55dcc559e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.140+0000 7ff09cc00640 10 client.5719 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.140+0000 7ff0b3400640 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc557b900 0x55dcc559e780 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c770f2edf2f95fdd server_cookie=7988e43aae5deef7 in_seq=0 out_seq=0 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.141+0000 7ff09cc00640 1 -- 172.21.15.100:0/507913576 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dcc5201890 con 0x55dcc557b900 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.141+0000 7ff09cc00640 10 client.5719 handle_command_reply: tid=0 2024-02-21T07:48:45.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.141+0000 7ff0bcff7740 1 client.5719 shutdown 2024-02-21T07:48:45.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.141+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 msgr2=0x55dcc5507ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.141+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0971a0 tx=0x7ff0ac001400 comp rx=0 tx=0).stop 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 shutdown_connections 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dcc557b900 0x55dcc559e780 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcc557c150 0x55dcc5507ab0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcc5546ab0 0x55dcc558f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 --2- 172.21.15.100:0/507913576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dcc5546190 0x55dcc554de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 >> 172.21.15.100:0/507913576 conn(0x55dcc54d55a0 msgr2=0x55dcc5573b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff09cc00640 0 client.5719 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 shutdown_connections 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 1 -- 172.21.15.100:0/507913576 wait complete. 2024-02-21T07:48:45.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.142+0000 7ff0bcff7740 20 client.5719 trim_cache size 0 max 16384 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "b068d764-801c-422f-96d6-f6cccdd83234": { 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "b068d764-801c-422f-96d6-f6cccdd83234", 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:48:45.149 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.143+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 msgr2=0x7ff0940a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.143+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 0x7ff0940a15e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0036000 tx=0x7ff0a0008030 comp rx=0 tx=0).stop 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.143+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 msgr2=0x7ff0b40f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.143+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c680 tx=0x7ff0ac00cb40 comp rx=0 tx=0).stop 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 shutdown_connections 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0b41868b0 0x7ff0b40f81f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0b417b3f0 0x7ff0b40c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff09409f120 0x7ff0940a15e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 --2- 172.21.15.100:0/2952197812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0b40cec70 0x7ff0b4179c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:45.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 >> 172.21.15.100:0/2952197812 conn(0x7ff0b40ce150 msgr2=0x7ff0b406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:45.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 shutdown_connections 2024-02-21T07:48:45.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:48:45.144+0000 7ff0b8e00640 1 -- 172.21.15.100:0/2952197812 wait complete. 2024-02-21T07:48:45.188 INFO:tasks.cephfs.filesystem:scrub status for tag:b068d764-801c-422f-96d6-f6cccdd83234 - {'path': '/', 'tag': 'b068d764-801c-422f-96d6-f6cccdd83234', 'options': 'recursive,force'} 2024-02-21T07:48:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.089+0000 7f3fc9800640 1 Processor -- start 2024-02-21T07:48:54.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.090+0000 7f3fc9800640 1 -- start start 2024-02-21T07:48:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc9800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3fc418d400 0x7f3fc40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc9800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 0x7f3fc40f9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc9800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40fa8a0 con 0x7f3fc415eb10 2024-02-21T07:48:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc9800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40ce5c0 con 0x7f3fc40cfad0 2024-02-21T07:48:54.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc9800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40ce7d0 con 0x7f3fc418d400 2024-02-21T07:48:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.093+0000 7f3fc3400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3fc418d400 0x7f3fc40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3fc418d400 0x7f3fc40cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59138/0 (socket says 172.21.15.100:59138) 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 -- 172.21.15.100:0/3798920858 learned_addr learned my addr 172.21.15.100:0/3798920858 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/3798920858 >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 0x7f3fc40f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 -- 172.21.15.100:0/3798920858 >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 msgr2=0x7f3fc40f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 --2- 172.21.15.100:0/3798920858 >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 0x7f3fc40f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 -- 172.21.15.100:0/3798920858 >> v1:172.21.15.170:6789/0 conn(0x7f3fc415eb10 legacy=0x7f3fc418ccf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc3400640 1 -- 172.21.15.100:0/3798920858 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40ceab0 con 0x7f3fc418d400 2024-02-21T07:48:54.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.094+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/3798920858 >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 0x7f3fc40f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.096+0000 7f3fc3400640 1 --2- 172.21.15.100:0/3798920858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc418d400 0x7f3fc40cf590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40cda20 tx=0x7f3fbc02be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1be029cdc6024e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.096+0000 7f3fc2a00640 1 -- 172.21.15.100:0/3798920858 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc02c9f0 con 0x7f3fc418d400 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.096+0000 7f3fc2a00640 1 -- 172.21.15.100:0/3798920858 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc02cb50 con 0x7f3fc418d400 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.096+0000 7f3fc2a00640 1 -- 172.21.15.100:0/3798920858 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc0343f0 con 0x7f3fc418d400 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.097+0000 7f3fc9800640 1 -- 172.21.15.100:0/3798920858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc418d400 msgr2=0x7f3fc40cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.097+0000 7f3fc9800640 1 --2- 172.21.15.100:0/3798920858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc418d400 0x7f3fc40cf590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40cda20 tx=0x7f3fbc02be50 comp rx=0 tx=0).stop 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.098+0000 7f3fc9800640 1 -- 172.21.15.100:0/3798920858 shutdown_connections 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.098+0000 7f3fc9800640 1 --2- 172.21.15.100:0/3798920858 >> v2:172.21.15.100:3300/0 conn(0x7f3fc40cfad0 0x7f3fc40f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.098+0000 7f3fc9800640 1 --2- 172.21.15.100:0/3798920858 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc418d400 0x7f3fc40cf590 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.098+0000 7f3fc9800640 1 -- 172.21.15.100:0/3798920858 >> 172.21.15.100:0/3798920858 conn(0x7f3fc4072c80 msgr2=0x7f3fc4073090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.102+0000 7f3fc9800640 1 -- 172.21.15.100:0/3798920858 shutdown_connections 2024-02-21T07:48:54.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.106+0000 7f3fc9800640 1 -- 172.21.15.100:0/3798920858 wait complete. 2024-02-21T07:48:54.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.110+0000 7f3fc9800640 1 Processor -- start 2024-02-21T07:48:54.138 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.119+0000 7f3fc9800640 1 -- start start 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 0x7f3fc4152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41551c0 con 0x7f3fc40cfad0 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4154ee0 con 0x7f3fc418d400 2024-02-21T07:48:54.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.121+0000 7f3fc9800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4224080 con 0x7f3fc41525c0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 0x7f3fc4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59146/0 (socket says 172.21.15.100:59146) 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc8e00640 1 -- 172.21.15.100:0/1220720416 learned_addr learned my addr 172.21.15.100:0/1220720416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.125+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60432/0 (socket says 172.21.15.100:60432) 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.126+0000 7f3fc8e00640 1 -- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 msgr2=0x7f3fc4182ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.126+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.126+0000 7f3fc8e00640 1 -- 172.21.15.100:0/1220720416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 msgr2=0x7f3fc4152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.126+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 0x7f3fc4152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.126+0000 7f3fc8e00640 1 -- 172.21.15.100:0/1220720416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009400 con 0x7f3fc41525c0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.127+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400e960 tx=0x7f3fb400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.128+0000 7f3fbbe00640 1 -- 172.21.15.100:0/1220720416 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4004020 con 0x7f3fc41525c0 2024-02-21T07:48:54.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.128+0000 7f3fbbe00640 1 -- 172.21.15.100:0/1220720416 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40041a0 con 0x7f3fc41525c0 2024-02-21T07:48:54.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.128+0000 7f3fbbe00640 1 -- 172.21.15.100:0/1220720416 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400ca00 con 0x7f3fc41525c0 2024-02-21T07:48:54.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.129+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc009b30 con 0x7f3fc41525c0 2024-02-21T07:48:54.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.129+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4224640 con 0x7f3fc41525c0 2024-02-21T07:48:54.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.132+0000 7f3fc3400640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:48:54.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.132+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 0x7f3fc4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.143+0000 7f3fcdba4740 1 Processor -- start 2024-02-21T07:48:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.144+0000 7f3fbbe00640 1 -- 172.21.15.100:0/1220720416 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3fb400cb60 con 0x7f3fc41525c0 2024-02-21T07:48:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.150+0000 7f3fcdba4740 1 -- start start 2024-02-21T07:48:54.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.168+0000 7f3fbbe00640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 0x7f3fa40a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.168+0000 7f3fbbe00640 1 -- 172.21.15.100:0/1220720416 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fb40ebba0 con 0x7f3fc41525c0 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.168+0000 7f3fc3400640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 0x7f3fa40a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 0x5624be01e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be023c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be05f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdfdf620 con 0x5624be093690 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdf918c0 con 0x5624be05f230 2024-02-21T07:48:54.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.170+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdf8edf0 con 0x5624be024150 2024-02-21T07:48:54.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.173+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 0x5624be01e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.173+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 0x5624be01e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60436/0 (socket says 172.21.15.100:60436) 2024-02-21T07:48:54.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.173+0000 7f3fc3e00640 1 -- 172.21.15.100:0/4120919835 learned_addr learned my addr 172.21.15.100:0/4120919835 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.176+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be05f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.177+0000 7f3fc8e00640 1 -- 172.21.15.100:0/4120919835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 msgr2=0x5624be01e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.177+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 0x5624be01e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.177+0000 7f3fc8e00640 1 -- 172.21.15.100:0/4120919835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 msgr2=0x5624be023c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.178+0000 7f3fc3400640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be023c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.178+0000 7f3fc3400640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 0x7f3fa40a1590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc035000 tx=0x7f3fbc030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.178+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be023c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.178+0000 7f3fc8e00640 1 -- 172.21.15.100:0/4120919835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bdf0bb00 con 0x5624be024150 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.178+0000 7f3fc3400640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be023c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.179+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be05f610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40e9570 tx=0x7f3fb40b95e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c509d528fcf621a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.180+0000 7f3fb8c00640 1 -- 172.21.15.100:0/4120919835 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40b96e0 con 0x5624be024150 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.180+0000 7f3fb8c00640 1 -- 172.21.15.100:0/4120919835 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40bd830 con 0x5624be024150 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.180+0000 7f3fb8c00640 1 -- 172.21.15.100:0/4120919835 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40c1e80 con 0x5624be024150 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.181+0000 7f3fcdba4740 1 -- 172.21.15.100:0/4120919835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 msgr2=0x5624be05f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.181+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be05f610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40e9570 tx=0x7f3fb40b95e0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.185+0000 7f3fcdba4740 1 -- 172.21.15.100:0/4120919835 shutdown_connections 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.185+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be05f610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.185+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be023c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.185+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/4120919835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be05f230 0x5624be01e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.185+0000 7f3fcdba4740 1 -- 172.21.15.100:0/4120919835 >> 172.21.15.100:0/4120919835 conn(0x5624bdfeb4b0 msgr2=0x5624be022e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.190+0000 7f3fcdba4740 1 -- 172.21.15.100:0/4120919835 shutdown_connections 2024-02-21T07:48:54.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.190+0000 7f3fcdba4740 1 -- 172.21.15.100:0/4120919835 wait complete. 2024-02-21T07:48:54.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.192+0000 7f3fcdba4740 1 -- start start 2024-02-21T07:48:54.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.192+0000 7f3fcdba4740 1 Processor -- start 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.202+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be094e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.202+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be087f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdf8a5d0 con 0x5624be087ac0 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdf2fb50 con 0x5624be093690 2024-02-21T07:48:54.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdf2f7f0 con 0x5624be024150 2024-02-21T07:48:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fc3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be094e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60448/0 (socket says 172.21.15.100:60448) 2024-02-21T07:48:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.203+0000 7f3fc3400640 1 -- 172.21.15.100:0/1283796439 learned_addr learned my addr 172.21.15.100:0/1283796439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.204+0000 7f3fc3e00640 1 -- 172.21.15.100:0/1283796439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 msgr2=0x5624be0519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.204+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.204+0000 7f3fc3e00640 1 -- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 msgr2=0x5624be087f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.204+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be087f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.204+0000 7f3fc3e00640 1 -- 172.21.15.100:0/1283796439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4224640 con 0x5624be024150 2024-02-21T07:48:54.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.208+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be094e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5624be0963d0 tx=0x7f3fb000f5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=969b348b74c2f8da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.208+0000 7f3fad600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:48:54.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.208+0000 7f3fad600640 1 -- 172.21.15.100:0/1283796439 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0014680 con 0x5624be024150 2024-02-21T07:48:54.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.208+0000 7f3fad600640 1 -- 172.21.15.100:0/1283796439 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fb00147e0 con 0x5624be024150 2024-02-21T07:48:54.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.208+0000 7f3fad600640 10 client.0 inactive, discarding osd_map(30..30 src has 1..30) v4 2024-02-21T07:48:54.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.209+0000 7f3fcdba4740 10 client.0 _ll_register_callbacks cb 0x5624bdf43550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:54.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.209+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624bdf5ccd0 con 0x5624be024150 2024-02-21T07:48:54.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.209+0000 7f3fad600640 1 -- 172.21.15.100:0/1283796439 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fb00149a0 con 0x5624be024150 2024-02-21T07:48:54.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.209+0000 7f3fcdba4740 10 client.5675 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:54.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.209+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=16}) v3 -- 0x5624bdf88c50 con 0x5624be024150 2024-02-21T07:48:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fad600640 1 -- 172.21.15.100:0/1283796439 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3fb0014b00 con 0x5624be024150 2024-02-21T07:48:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 10 client.5675 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 10 client.5675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:54.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 20 client.5675 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be095470 0x5624be01d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 4 client.5675 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:48:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.210+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624bdf80ce0 con 0x5624be095470 2024-02-21T07:48:54.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.211+0000 7f3fc3400640 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be095470 0x5624be01d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.215+0000 7f3fc3400640 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be095470 0x5624be01d980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397fe50a112d112b server_cookie=922e5b1ffa0a18bd in_seq=0 out_seq=0 2024-02-21T07:48:54.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.215+0000 7f3fad600640 10 client.5675 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.218+0000 7f3fad600640 1 -- 172.21.15.100:0/1283796439 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5624bdf80ce0 con 0x5624be095470 2024-02-21T07:48:54.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.218+0000 7f3fad600640 10 client.5675 handle_command_reply: tid=0 2024-02-21T07:48:54.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.218+0000 7f3fcdba4740 1 client.5675 shutdown 2024-02-21T07:48:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.220+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 msgr2=0x5624be094e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.220+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be094e40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x5624be0963d0 tx=0x7f3fb000f5b0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 shutdown_connections 2024-02-21T07:48:54.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be095470 0x5624be01d980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be087f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/1283796439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be094e40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.221+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 >> 172.21.15.100:0/1283796439 conn(0x5624bdfeb4b0 msgr2=0x5624be02a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.224+0000 7f3fad600640 0 client.5675 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:54.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.226+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 shutdown_connections 2024-02-21T07:48:54.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.227+0000 7f3fcdba4740 1 -- 172.21.15.100:0/1283796439 wait complete. 2024-02-21T07:48:54.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.227+0000 7f3fcdba4740 20 client.5675 trim_cache size 0 max 16384 2024-02-21T07:48:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.294+0000 7f3fcdba4740 1 Processor -- start 2024-02-21T07:48:54.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.295+0000 7f3fcdba4740 1 -- start start 2024-02-21T07:48:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be019bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be02a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bdcd2e60 con 0x5624be087ac0 2024-02-21T07:48:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624be09c690 con 0x5624be093690 2024-02-21T07:48:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624be01e950 con 0x5624be024150 2024-02-21T07:48:54.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fc8e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60450/0 (socket says 172.21.15.100:60450) 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.297+0000 7f3fc8e00640 1 -- 172.21.15.100:0/788938469 learned_addr learned my addr 172.21.15.100:0/788938469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.298+0000 7f3fc8e00640 1 -- 172.21.15.100:0/788938469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 msgr2=0x5624be019bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.298+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be019bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.298+0000 7f3fc3400640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be02a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be019bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc8e00640 1 -- 172.21.15.100:0/788938469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 msgr2=0x5624be02a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be02a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc8e00640 1 -- 172.21.15.100:0/788938469 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bdf25530 con 0x5624be093690 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be019bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc3400640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be02a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c520 tx=0x7f3fb40a4050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44afdb6fd84c206 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fafe00640 1 -- 172.21.15.100:0/788938469 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40b58f0 con 0x5624be093690 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fafe00640 1 -- 172.21.15.100:0/788938469 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb40bd830 con 0x5624be093690 2024-02-21T07:48:54.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.299+0000 7f3fafe00640 1 -- 172.21.15.100:0/788938469 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40c1e80 con 0x5624be093690 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.300+0000 7f3fcdba4740 1 -- 172.21.15.100:0/788938469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 msgr2=0x5624be0212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c520 tx=0x7f3fb40a4050 comp rx=0 tx=0).stop 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 -- 172.21.15.100:0/788938469 shutdown_connections 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be093690 0x5624be0212a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be087ac0 0x5624be02a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/788938469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be024150 0x5624be019bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.301+0000 7f3fcdba4740 1 -- 172.21.15.100:0/788938469 >> 172.21.15.100:0/788938469 conn(0x5624bdfeb4b0 msgr2=0x5624be01d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.302+0000 7f3fcdba4740 1 -- 172.21.15.100:0/788938469 shutdown_connections 2024-02-21T07:48:54.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.303+0000 7f3fcdba4740 1 -- 172.21.15.100:0/788938469 wait complete. 2024-02-21T07:48:54.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.304+0000 7f3fcdba4740 1 -- start start 2024-02-21T07:48:54.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.304+0000 7f3fcdba4740 1 Processor -- start 2024-02-21T07:48:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 0x5624be0eebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be019bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624be102380 con 0x5624be093690 2024-02-21T07:48:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624be064b60 con 0x5624be024150 2024-02-21T07:48:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624be0905a0 con 0x5624be087ac0 2024-02-21T07:48:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.310+0000 7f3fcdba4740 10 client.0 _ll_register_callbacks cb 0x7f3fb4004550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:48:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.311+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.311+0000 7f3fc3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59192/0 (socket says 172.21.15.100:59192) 2024-02-21T07:48:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.311+0000 7f3fc3400640 1 -- 172.21.15.100:0/3231421755 learned_addr learned my addr 172.21.15.100:0/3231421755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:48:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.311+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be019bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.311+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 0x5624be0eebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.312+0000 7f3fc3e00640 1 -- 172.21.15.100:0/3231421755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 msgr2=0x5624be090060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.313+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.313+0000 7f3fc3e00640 1 -- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 msgr2=0x5624be019bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.313+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be019bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.313+0000 7f3fc3e00640 1 -- 172.21.15.100:0/3231421755 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624bdf0bb00 con 0x5624be024150 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.313+0000 7f3fc8e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be019bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.314+0000 7f3fc3400640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:48:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.314+0000 7f3fc3e00640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 0x5624be0eebb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000b010 tx=0x7f3fb0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1456d9e8d29d8ede server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:48:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.317+0000 7f3fad600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:48:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.317+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0014bc0 con 0x5624be024150 2024-02-21T07:48:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.317+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fb002b070 con 0x5624be024150 2024-02-21T07:48:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.317+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624bdfafd30 con 0x5624be024150 2024-02-21T07:48:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.320+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fb0004020 con 0x5624be024150 2024-02-21T07:48:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.320+0000 7f3fcdba4740 10 client.5734 fetch_fsmap learned FSMap version 16 2024-02-21T07:48:54.328 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.321+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5624bdf4b2c0 con 0x5624be024150 2024-02-21T07:48:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.323+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624bdfafd30 con 0x5624be024150 2024-02-21T07:48:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3fb0006d20 con 0x5624be024150 2024-02-21T07:48:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 10 client.5734 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:48:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 10 client.5734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:48:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 20 client.5734 populate_metadata read hostname 'smithi100' 2024-02-21T07:48:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be1019c0 0x5624be0f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 4 client.5734 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:48:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.325+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5624bdc8a600 con 0x5624be1019c0 2024-02-21T07:48:54.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.326+0000 7f3fc3400640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be1019c0 0x5624be0f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:48:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.327+0000 7f3fc3400640 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be1019c0 0x5624be0f7a30 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33cf5cf796843e7c server_cookie=735c231bfe9b38ab in_seq=0 out_seq=0 2024-02-21T07:48:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.327+0000 7f3fad600640 10 client.5734 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.374+0000 7f3fad600640 1 -- 172.21.15.100:0/3231421755 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5624bdc8a600 con 0x5624be1019c0 2024-02-21T07:48:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.374+0000 7f3fad600640 10 client.5734 handle_command_reply: tid=0 2024-02-21T07:48:54.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.374+0000 7f3fcdba4740 1 client.5734 shutdown 2024-02-21T07:48:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.375+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 msgr2=0x5624be0eebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.375+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 0x5624be0eebb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000b010 tx=0x7f3fb0004770 comp rx=0 tx=0).stop 2024-02-21T07:48:54.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.375+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 shutdown_connections 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.375+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5624be1019c0 0x5624be0f7a30 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.376+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5624be093690 0x5624be019bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.376+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5624be087ac0 0x5624be090060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.376+0000 7f3fcdba4740 1 --2- 172.21.15.100:0/3231421755 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5624be024150 0x5624be0eebb0 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000b010 tx=0x7f3fb0004770 comp rx=0 tx=0).stop 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.376+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 >> 172.21.15.100:0/3231421755 conn(0x5624bdfeb4b0 msgr2=0x5624be0515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.376+0000 7f3fad600640 0 client.5734 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:48:54.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.377+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 shutdown_connections 2024-02-21T07:48:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.377+0000 7f3fcdba4740 1 -- 172.21.15.100:0/3231421755 wait complete. 2024-02-21T07:48:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.377+0000 7f3fcdba4740 20 client.5734 trim_cache size 0 max 16384 2024-02-21T07:48:54.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:48:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:48:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:48:54.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:48:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.380+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 msgr2=0x7f3fa40a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.380+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 0x7f3fa40a1590 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc035000 tx=0x7f3fbc030000 comp rx=0 tx=0).stop 2024-02-21T07:48:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.380+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 msgr2=0x7f3fc4183010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:48:54.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.380+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400e960 tx=0x7f3fb400ee20 comp rx=0 tx=0).stop 2024-02-21T07:48:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.381+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 shutdown_connections 2024-02-21T07:48:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.381+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3fc41525c0 0x7f3fc4183010 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.381+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fc418d400 0x7f3fc4182ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.381+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3fa409f0d0 0x7f3fa40a1590 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.381+0000 7f3fc9800640 1 --2- 172.21.15.100:0/1220720416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fc40cfad0 0x7f3fc4152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.382+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 >> 172.21.15.100:0/1220720416 conn(0x7f3fc4072c80 msgr2=0x7f3fc4073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:48:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.383+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 shutdown_connections 2024-02-21T07:48:54.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:48:54.383+0000 7f3fc9800640 1 -- 172.21.15.100:0/1220720416 wait complete. 2024-02-21T07:49:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.644+0000 7f2463200640 1 Processor -- start 2024-02-21T07:49:07.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.644+0000 7f2463200640 1 -- start start 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.648+0000 7f2463200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f245c186b60 0x7f245c18bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.648+0000 7f2463200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 0x7f245c18df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f2463200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c186f40 con 0x7f245c18c260 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f2463200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0f4660 con 0x7f245c0d1ab0 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f2463200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c18a9a0 con 0x7f245c186b60 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f245be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f245c186b60 0x7f245c18bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f245be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f245c186b60 0x7f245c18bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44104/0 (socket says 172.21.15.100:44104) 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f245be00640 1 -- 172.21.15.100:0/2312117067 learned_addr learned my addr 172.21.15.100:0/2312117067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.649+0000 7f2461200640 1 --2- 172.21.15.100:0/2312117067 >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 0x7f245c18df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.650+0000 7f245be00640 1 -- 172.21.15.100:0/2312117067 >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 msgr2=0x7f245c18df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.650+0000 7f245be00640 1 --2- 172.21.15.100:0/2312117067 >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 0x7f245c18df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.650+0000 7f245be00640 1 -- 172.21.15.100:0/2312117067 >> v1:172.21.15.170:6789/0 conn(0x7f245c18c260 legacy=0x7f245c0d13a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.650+0000 7f245be00640 1 -- 172.21.15.100:0/2312117067 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c18ac80 con 0x7f245c186b60 2024-02-21T07:49:07.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.650+0000 7f2461200640 1 --2- 172.21.15.100:0/2312117067 >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 0x7f245c18df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:07.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.654+0000 7f245be00640 1 --2- 172.21.15.100:0/2312117067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c18bd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f245c075450 tx=0x7f244402b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1c3fb0a0c20689b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.655+0000 7f245aa00640 1 -- 172.21.15.100:0/2312117067 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444031750 con 0x7f245c186b60 2024-02-21T07:49:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.655+0000 7f245aa00640 1 -- 172.21.15.100:0/2312117067 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24440318b0 con 0x7f245c186b60 2024-02-21T07:49:07.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.655+0000 7f245aa00640 1 -- 172.21.15.100:0/2312117067 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444031c40 con 0x7f245c186b60 2024-02-21T07:49:07.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.656+0000 7f2463200640 1 -- 172.21.15.100:0/2312117067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 msgr2=0x7f245c18bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.656+0000 7f2463200640 1 --2- 172.21.15.100:0/2312117067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c18bd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f245c075450 tx=0x7f244402b7f0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.659+0000 7f2463200640 1 -- 172.21.15.100:0/2312117067 shutdown_connections 2024-02-21T07:49:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.659+0000 7f2463200640 1 --2- 172.21.15.100:0/2312117067 >> v2:172.21.15.100:3300/0 conn(0x7f245c0d1ab0 0x7f245c18df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.659+0000 7f2463200640 1 --2- 172.21.15.100:0/2312117067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c18bd20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.659+0000 7f2463200640 1 -- 172.21.15.100:0/2312117067 >> 172.21.15.100:0/2312117067 conn(0x7f245c0ce1b0 msgr2=0x7f245c0ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.661+0000 7f2463200640 1 -- 172.21.15.100:0/2312117067 shutdown_connections 2024-02-21T07:49:07.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.661+0000 7f2463200640 1 -- 172.21.15.100:0/2312117067 wait complete. 2024-02-21T07:49:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.663+0000 7f2463200640 1 Processor -- start 2024-02-21T07:49:07.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.663+0000 7f2463200640 1 -- start start 2024-02-21T07:49:07.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f245c0d1ab0 0x7f245c172f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c18c260 0x7f245c0f9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0f7b80 con 0x7f245c18c260 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0f7e60 con 0x7f245c0d1ab0 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.665+0000 7f2463200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0f8140 con 0x7f245c186b60 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.666+0000 7f245b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.666+0000 7f245b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44108/0 (socket says 172.21.15.100:44108) 2024-02-21T07:49:07.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.666+0000 7f245b400640 1 -- 172.21.15.100:0/1781419935 learned_addr learned my addr 172.21.15.100:0/1781419935 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.667+0000 7f2461200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c18c260 0x7f245c0f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.668+0000 7f245b400640 1 -- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f245c0d1ab0 msgr2=0x7f245c172f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.668+0000 7f245b400640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f245c0d1ab0 0x7f245c172f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.669+0000 7f245b400640 1 -- 172.21.15.100:0/1781419935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c18c260 msgr2=0x7f245c0f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.669+0000 7f245b400640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c18c260 0x7f245c0f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.669+0000 7f245b400640 1 -- 172.21.15.100:0/1781419935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440094d0 con 0x7f245c186b60 2024-02-21T07:49:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.670+0000 7f245b400640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f244c00ba50 tx=0x7f244c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.670+0000 7f2453e00640 1 -- 172.21.15.100:0/1781419935 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c00cc10 con 0x7f245c186b60 2024-02-21T07:49:07.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.670+0000 7f2453e00640 1 -- 172.21.15.100:0/1781419935 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c00cd70 con 0x7f245c186b60 2024-02-21T07:49:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.671+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c0f8420 con 0x7f245c186b60 2024-02-21T07:49:07.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.671+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c0f3b70 con 0x7f245c186b60 2024-02-21T07:49:07.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.671+0000 7f2453e00640 1 -- 172.21.15.100:0/1781419935 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c014680 con 0x7f245c186b60 2024-02-21T07:49:07.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.676+0000 7f2453e00640 1 -- 172.21.15.100:0/1781419935 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f244c01d3b0 con 0x7f245c186b60 2024-02-21T07:49:07.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.678+0000 7f2453e00640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 0x7f24380a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.678+0000 7f2453e00640 1 -- 172.21.15.100:0/1781419935 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f244c0c9b80 con 0x7f245c186b60 2024-02-21T07:49:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.680+0000 7f245be00640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 0x7f24380a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.681+0000 7f245be00640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 0x7f24380a1630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2444035000 tx=0x7f2444030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.689+0000 7f2465fbc740 1 Processor -- start 2024-02-21T07:49:07.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.689+0000 7f2465fbc740 1 -- start start 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c299a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 0x56271c2d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c255620 con 0x56271c299f90 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c2078c0 con 0x56271c2d5070 2024-02-21T07:49:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.692+0000 7f2465fbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c204df0 con 0x56271c3094d0 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f2461200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 0x56271c2d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:50308/0 (socket says 172.21.15.100:50308) 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 -- 172.21.15.100:0/396926967 learned_addr learned my addr 172.21.15.100:0/396926967 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 -- 172.21.15.100:0/396926967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 msgr2=0x56271c299a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c299a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.693+0000 7f245be00640 1 -- 172.21.15.100:0/396926967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 msgr2=0x56271c2d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.694+0000 7f245be00640 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 0x56271c2d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.694+0000 7f245be00640 1 -- 172.21.15.100:0/396926967 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271c181b00 con 0x56271c2d5070 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.694+0000 7f2461200640 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 0x56271c2d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.694+0000 7f245be00640 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2444009930 tx=0x7f2444008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab34d155848a288 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.695+0000 7f2450c00640 1 -- 172.21.15.100:0/396926967 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244403dcb0 con 0x56271c2d5070 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.695+0000 7f2450c00640 1 -- 172.21.15.100:0/396926967 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244403de10 con 0x56271c2d5070 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.695+0000 7f2450c00640 1 -- 172.21.15.100:0/396926967 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444049640 con 0x56271c2d5070 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.695+0000 7f2465fbc740 1 -- 172.21.15.100:0/396926967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 msgr2=0x56271c294440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.695+0000 7f2465fbc740 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2444009930 tx=0x7f2444008030 comp rx=0 tx=0).stop 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 -- 172.21.15.100:0/396926967 shutdown_connections 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c299f90 0x56271c2d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c299a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 --2- 172.21.15.100:0/396926967 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c2d5070 0x56271c294440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 -- 172.21.15.100:0/396926967 >> 172.21.15.100:0/396926967 conn(0x56271c2614b0 msgr2=0x56271c298ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 -- 172.21.15.100:0/396926967 shutdown_connections 2024-02-21T07:49:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.696+0000 7f2465fbc740 1 -- 172.21.15.100:0/396926967 wait complete. 2024-02-21T07:49:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.697+0000 7f2465fbc740 1 -- start start 2024-02-21T07:49:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.697+0000 7f2465fbc740 1 Processor -- start 2024-02-21T07:49:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c30b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c2ff570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c2005d0 con 0x56271c3094d0 2024-02-21T07:49:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c1a5b50 con 0x56271c299f90 2024-02-21T07:49:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c1a57f0 con 0x56271c2d5070 2024-02-21T07:49:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.699+0000 7f2465fbc740 10 client.0 _ll_register_callbacks cb 0x56271c1b9550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.700+0000 7f245b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c30b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.700+0000 7f245be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.700+0000 7f245be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:50318/0 (socket says 172.21.15.100:50318) 2024-02-21T07:49:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.700+0000 7f245be00640 1 -- 172.21.15.100:0/2072457302 learned_addr learned my addr 172.21.15.100:0/2072457302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f2461200640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c2ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f245be00640 1 -- 172.21.15.100:0/2072457302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 msgr2=0x56271c30b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f245be00640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c30b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f245be00640 1 -- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 msgr2=0x56271c2ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f245be00640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c2ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.702+0000 7f245be00640 1 -- 172.21.15.100:0/2072457302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c18ac80 con 0x56271c299f90 2024-02-21T07:49:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.703+0000 7f245be00640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2444009960 tx=0x7f2444004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34b02bdde1600184 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.703+0000 7f2449600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.703+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444049880 con 0x56271c299f90 2024-02-21T07:49:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.704+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2444043040 con 0x56271c299f90 2024-02-21T07:49:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.704+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56271c1d2cd0 con 0x56271c299f90 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.704+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24440499e0 con 0x56271c299f90 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.704+0000 7f2465fbc740 10 client.5740 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.704+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56271c1fec50 con 0x56271c299f90 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56271c1d2cd0 con 0x56271c299f90 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2444049b40 con 0x56271c299f90 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 10 client.5740 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 10 client.5740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 20 client.5740 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cb9c0 0x56271c2cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 4 client.5740 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56271c1f6ce0 con 0x56271c2cb9c0 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.705+0000 7f245b400640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cb9c0 0x56271c2cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.706+0000 7f245b400640 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cb9c0 0x56271c2cbdd0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7805d585adf50e18 server_cookie=12aa66b317cf9d8a in_seq=0 out_seq=0 2024-02-21T07:49:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.706+0000 7f2449600640 10 client.5740 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.707+0000 7f2449600640 1 -- 172.21.15.100:0/2072457302 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56271c1f6ce0 con 0x56271c2cb9c0 2024-02-21T07:49:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.707+0000 7f2449600640 10 client.5740 handle_command_reply: tid=0 2024-02-21T07:49:07.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.707+0000 7f2465fbc740 1 client.5740 shutdown 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 msgr2=0x56271c2d9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2444009960 tx=0x7f2444004730 comp rx=0 tx=0).stop 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 shutdown_connections 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cb9c0 0x56271c2cbdd0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c2ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c30b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 --2- 172.21.15.100:0/2072457302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2d9750 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 >> 172.21.15.100:0/2072457302 conn(0x56271c2614b0 msgr2=0x56271c309930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2449600640 0 client.5740 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 shutdown_connections 2024-02-21T07:49:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.708+0000 7f2465fbc740 1 -- 172.21.15.100:0/2072457302 wait complete. 2024-02-21T07:49:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.709+0000 7f2465fbc740 20 client.5740 trim_cache size 0 max 16384 2024-02-21T07:49:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.747+0000 7f2465fbc740 1 Processor -- start 2024-02-21T07:49:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.748+0000 7f2465fbc740 1 -- start start 2024-02-21T07:49:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c28fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271bf48e60 con 0x56271c3094d0 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c3679c0 con 0x56271c299f90 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.749+0000 7f2465fbc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c319010 con 0x56271c2d5070 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.750+0000 7f2461200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.750+0000 7f2461200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36204/0 (socket says 172.21.15.100:36204) 2024-02-21T07:49:07.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.750+0000 7f2461200640 1 -- 172.21.15.100:0/4036254248 learned_addr learned my addr 172.21.15.100:0/4036254248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.751+0000 7f2461200640 1 -- 172.21.15.100:0/4036254248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 msgr2=0x56271c28fbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.751+0000 7f2461200640 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c28fbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.751+0000 7f2461200640 1 -- 172.21.15.100:0/4036254248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 msgr2=0x56271c2cb980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.751+0000 7f2461200640 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2cb980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.751+0000 7f2461200640 1 -- 172.21.15.100:0/4036254248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56271c2d1020 con 0x56271c3094d0 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.752+0000 7f2461200640 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2454006fd0 tx=0x7f245400ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cae16225fb9e9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.752+0000 7f244be00640 1 -- 172.21.15.100:0/4036254248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454004440 con 0x56271c3094d0 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.752+0000 7f244be00640 1 -- 172.21.15.100:0/4036254248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245400c040 con 0x56271c3094d0 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.752+0000 7f244be00640 1 -- 172.21.15.100:0/4036254248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454015bc0 con 0x56271c3094d0 2024-02-21T07:49:07.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 -- 172.21.15.100:0/4036254248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 msgr2=0x56271c366b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2454006fd0 tx=0x7f245400ab70 comp rx=0 tx=0).stop 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 -- 172.21.15.100:0/4036254248 shutdown_connections 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c3094d0 0x56271c366b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c2d5070 0x56271c28fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 --2- 172.21.15.100:0/4036254248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c2cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.753+0000 7f2465fbc740 1 -- 172.21.15.100:0/4036254248 >> 172.21.15.100:0/4036254248 conn(0x56271c2614b0 msgr2=0x56271c2daac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.755+0000 7f2465fbc740 1 -- 172.21.15.100:0/4036254248 shutdown_connections 2024-02-21T07:49:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.755+0000 7f2465fbc740 1 -- 172.21.15.100:0/4036254248 wait complete. 2024-02-21T07:49:07.765 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.757+0000 7f2465fbc740 1 -- start start 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.757+0000 7f2465fbc740 1 Processor -- start 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.759+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c295e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.759+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c363d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.759+0000 7f2465fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2461200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f245be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c295e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2465fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c387700 con 0x56271c2a0490 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2461200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36210/0 (socket says 172.21.15.100:36210) 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c2cf6c0 con 0x56271c299f90 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2461200640 1 -- 172.21.15.100:0/1010867552 learned_addr learned my addr 172.21.15.100:0/1010867552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56271c2f78c0 con 0x56271c3094d0 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f245b400640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c363d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.760+0000 7f2465fbc740 10 client.0 _ll_register_callbacks cb 0x7f2444036070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 -- 172.21.15.100:0/1010867552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 msgr2=0x56271c363d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c363d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 -- 172.21.15.100:0/1010867552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 msgr2=0x56271c295e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c295e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245400a790 con 0x56271c2a0490 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f245be00640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c295e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2461200640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f245401b000 tx=0x7f2454004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ef930bd1826a34 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:07.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.761+0000 7f2449600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454003610 con 0x56271c2a0490 2024-02-21T07:49:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2454003770 con 0x56271c2a0490 2024-02-21T07:49:07.768 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56271c225d30 con 0x56271c2a0490 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2454003930 con 0x56271c2a0490 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2465fbc740 10 client.5586 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.762+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56271c19b530 con 0x56271c2a0490 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56271c225d30 con 0x56271c2a0490 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2454025070 con 0x56271c2a0490 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 10 client.5586 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 10 client.5586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 20 client.5586 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cd900 0x56271c366df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 4 client.5586 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.763+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56271bf00600 con 0x56271c2cd900 2024-02-21T07:49:07.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.764+0000 7f245be00640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cd900 0x56271c366df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.765+0000 7f245be00640 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cd900 0x56271c366df0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c18819f29a6353 server_cookie=17dcbe00db09c96b in_seq=0 out_seq=0 2024-02-21T07:49:07.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.765+0000 7f2449600640 10 client.5586 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.784+0000 7f2449600640 1 -- 172.21.15.100:0/1010867552 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56271bf00600 con 0x56271c2cd900 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.784+0000 7f2449600640 10 client.5586 handle_command_reply: tid=0 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.784+0000 7f2465fbc740 1 client.5586 shutdown 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.784+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 msgr2=0x56271c2cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.784+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f245401b000 tx=0x7f2454004730 comp rx=0 tx=0).stop 2024-02-21T07:49:07.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 shutdown_connections 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56271c2cd900 0x56271c366df0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56271c2a0490 0x56271c2cf180 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56271c3094d0 0x56271c363d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 --2- 172.21.15.100:0/1010867552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56271c299f90 0x56271c295e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 >> 172.21.15.100:0/1010867552 conn(0x56271c2614b0 msgr2=0x56271c329b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2449600640 0 client.5586 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 shutdown_connections 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 1 -- 172.21.15.100:0/1010867552 wait complete. 2024-02-21T07:49:07.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.785+0000 7f2465fbc740 20 client.5586 trim_cache size 0 max 16384 2024-02-21T07:49:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:49:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:49:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:49:07.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 msgr2=0x7f24380a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 0x7f24380a1630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2444035000 tx=0x7f2444030000 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 msgr2=0x7f245c0f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f244c00ba50 tx=0x7f244c00bf10 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 shutdown_connections 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f243809f170 0x7f24380a1630 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f245c18c260 0x7f245c0f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f245c186b60 0x7f245c0f8c20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 --2- 172.21.15.100:0/1781419935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f245c0d1ab0 0x7f245c172f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 >> 172.21.15.100:0/1781419935 conn(0x7f245c0ce1b0 msgr2=0x7f245c18c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 shutdown_connections 2024-02-21T07:49:07.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:07.786+0000 7f2463200640 1 -- 172.21.15.100:0/1781419935 wait complete. 2024-02-21T07:49:13.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:13.098 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:13.101 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:15.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:49:15.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:49:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.569+0000 7f982ba00640 1 Processor -- start 2024-02-21T07:49:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.569+0000 7f982ba00640 1 -- start start 2024-02-21T07:49:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.572+0000 7f982ba00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9824190260 0x7f9824070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.573+0000 7f9823e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f98240f4b20 0x7f982406e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:58942/0 (socket says 172.21.15.100:58942) 2024-02-21T07:49:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.577+0000 7f982ba00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982418dc80 con 0x7f98240f4b20 2024-02-21T07:49:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.577+0000 7f982ba00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240f55d0 con 0x7f982406edc0 2024-02-21T07:49:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.577+0000 7f982ba00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240f5b90 con 0x7f9824190260 2024-02-21T07:49:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.577+0000 7f9823e00640 1 -- 172.21.15.100:0/2178465040 learned_addr learned my addr 172.21.15.100:0/2178465040 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.577+0000 7f9829000640 1 --2- 172.21.15.100:0/2178465040 >> v2:172.21.15.156:3300/0 conn(0x7f9824190260 0x7f9824070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.578+0000 7f9829000640 1 -- 172.21.15.100:0/2178465040 >> v1:172.21.15.170:6789/0 conn(0x7f982406edc0 legacy=0x7f9824190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.578+0000 7f9829000640 1 -- 172.21.15.100:0/2178465040 >> v1:172.21.15.156:6789/0 conn(0x7f98240f4b20 legacy=0x7f982406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.578+0000 7f9829000640 1 -- 172.21.15.100:0/2178465040 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240f58b0 con 0x7f9824190260 2024-02-21T07:49:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.579+0000 7f9829000640 1 --2- 172.21.15.100:0/2178465040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f9824070a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097a0 tx=0x7f981c02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befb0a23aac42b7f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.580+0000 7f9823400640 1 -- 172.21.15.100:0/2178465040 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0317c0 con 0x7f9824190260 2024-02-21T07:49:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.580+0000 7f9823400640 1 -- 172.21.15.100:0/2178465040 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c031920 con 0x7f9824190260 2024-02-21T07:49:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.580+0000 7f9823400640 1 -- 172.21.15.100:0/2178465040 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c031cf0 con 0x7f9824190260 2024-02-21T07:49:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.581+0000 7f982ba00640 1 -- 172.21.15.100:0/2178465040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 msgr2=0x7f9824070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.581+0000 7f982ba00640 1 --2- 172.21.15.100:0/2178465040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f9824070a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097a0 tx=0x7f981c02b860 comp rx=0 tx=0).stop 2024-02-21T07:49:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.582+0000 7f982ba00640 1 -- 172.21.15.100:0/2178465040 shutdown_connections 2024-02-21T07:49:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.582+0000 7f982ba00640 1 --2- 172.21.15.100:0/2178465040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f9824070a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.582+0000 7f982ba00640 1 -- 172.21.15.100:0/2178465040 >> 172.21.15.100:0/2178465040 conn(0x7f98240668b0 msgr2=0x7f9824066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.582+0000 7f982ba00640 1 -- 172.21.15.100:0/2178465040 shutdown_connections 2024-02-21T07:49:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.582+0000 7f982ba00640 1 -- 172.21.15.100:0/2178465040 wait complete. 2024-02-21T07:49:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.584+0000 7f982ba00640 1 Processor -- start 2024-02-21T07:49:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.584+0000 7f982ba00640 1 -- start start 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.585+0000 7f982ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 0x7f982417f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f982ba00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f982418dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f982ba00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 0x7f9824220a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f982ba00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982418e530 con 0x7f98240f4b20 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f982ba00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982418e750 con 0x7f9824190260 2024-02-21T07:49:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f982ba00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982418ea30 con 0x7f9824174980 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f9829a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 0x7f9824220a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f9829a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 0x7f9824220a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35638/0 (socket says 172.21.15.100:35638) 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f9829a00640 1 -- 172.21.15.100:0/227066582 learned_addr learned my addr 172.21.15.100:0/227066582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f9829000640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 0x7f982417f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.586+0000 7f9823e00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f982418dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 -- 172.21.15.100:0/227066582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 msgr2=0x7f9824220a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 0x7f9824220a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 -- 172.21.15.100:0/227066582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 msgr2=0x7f982417f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 0x7f982417f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 -- 172.21.15.100:0/227066582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981c009400 con 0x7f9824190260 2024-02-21T07:49:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9829000640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 0x7f982417f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.587+0000 7f9823e00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f982418dff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9810000f60 tx=0x7f981000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.590+0000 7f9820c00640 1 -- 172.21.15.100:0/227066582 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810005ce0 con 0x7f9824190260 2024-02-21T07:49:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.590+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982418ed10 con 0x7f9824190260 2024-02-21T07:49:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.590+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982418f2d0 con 0x7f9824190260 2024-02-21T07:49:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.590+0000 7f9820c00640 1 -- 172.21.15.100:0/227066582 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810005e40 con 0x7f9824190260 2024-02-21T07:49:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.590+0000 7f9820c00640 1 -- 172.21.15.100:0/227066582 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100072d0 con 0x7f9824190260 2024-02-21T07:49:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.597+0000 7f982e648740 1 Processor -- start 2024-02-21T07:49:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.597+0000 7f982e648740 1 -- start start 2024-02-21T07:49:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.598+0000 7f9820c00640 1 -- 172.21.15.100:0/227066582 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f98100074f0 con 0x7f9824190260 2024-02-21T07:49:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100a7f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a41ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1009b6150 con 0x55e100a7efc0 2024-02-21T07:49:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1009b3680 con 0x55e100ab4f80 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f982e648740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1009aee60 con 0x55e100a7f8e0 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f9829a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f9829000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100a7f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f9823e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a41ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.599+0000 7f9829000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100a7f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57100/0 (socket says 172.21.15.100:57100) 2024-02-21T07:49:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829000640 1 -- 172.21.15.100:0/1055025504 learned_addr learned my addr 172.21.15.100:0/1055025504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829a00640 1 -- 172.21.15.100:0/1055025504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 msgr2=0x55e100a41ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829a00640 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a41ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9820c00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 0x7f98040a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829a00640 1 -- 172.21.15.100:0/1055025504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 msgr2=0x55e100a7f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829a00640 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100a7f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9829a00640 1 -- 172.21.15.100:0/1055025504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e100968060 con 0x55e100a7efc0 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9823e00640 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a41ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.600+0000 7f9820c00640 1 -- 172.21.15.100:0/227066582 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f98100c8ef0 con 0x7f9824190260 2024-02-21T07:49:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.601+0000 7f9829a00640 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab4a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9814001c80 tx=0x7f98140015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78eb36c951432ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.601+0000 7f9829a00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 0x7f98040a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.602+0000 7f9829a00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 0x7f98040a15e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9814019000 tx=0x7f9814016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.602+0000 7f9819600640 1 -- 172.21.15.100:0/1055025504 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814019030 con 0x55e100a7efc0 2024-02-21T07:49:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.602+0000 7f9819600640 1 -- 172.21.15.100:0/1055025504 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400fc60 con 0x55e100a7efc0 2024-02-21T07:49:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.602+0000 7f9819600640 1 -- 172.21.15.100:0/1055025504 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98140055a0 con 0x55e100a7efc0 2024-02-21T07:49:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.605+0000 7f982e648740 1 -- 172.21.15.100:0/1055025504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 msgr2=0x55e100ab4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.605+0000 7f982e648740 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab4a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9814001c80 tx=0x7f98140015f0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.605+0000 7f982e648740 1 -- 172.21.15.100:0/1055025504 shutdown_connections 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.605+0000 7f982e648740 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a41ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.606+0000 7f982e648740 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100a7f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.606+0000 7f982e648740 1 --2- 172.21.15.100:0/1055025504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab4a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.606+0000 7f982e648740 1 -- 172.21.15.100:0/1055025504 >> 172.21.15.100:0/1055025504 conn(0x55e100a0e5a0 msgr2=0x55e100a45eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.606+0000 7f982e648740 1 -- 172.21.15.100:0/1055025504 shutdown_connections 2024-02-21T07:49:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.606+0000 7f982e648740 1 -- 172.21.15.100:0/1055025504 wait complete. 2024-02-21T07:49:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.611+0000 7f982e648740 1 -- start start 2024-02-21T07:49:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.611+0000 7f982e648740 1 Processor -- start 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 0x55e100a41e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100ab4f80 0x55e100a42650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100953ec0 con 0x55e100a7efc0 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100953b60 con 0x55e100a7f8e0 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10071d1c0 con 0x55e100ab4f80 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.612+0000 7f982e648740 10 client.0 _ll_register_callbacks cb 0x55e100967960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.613+0000 7f9829000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.613+0000 7f9829000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46028/0 (socket says 172.21.15.100:46028) 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.613+0000 7f9829000640 1 -- 172.21.15.100:0/3451180931 learned_addr learned my addr 172.21.15.100:0/3451180931 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.613+0000 7f9829a00640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100ab4f80 0x55e100a42650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9829000640 1 -- 172.21.15.100:0/3451180931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100ab4f80 msgr2=0x55e100a42650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9829000640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100ab4f80 0x55e100a42650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9829000640 1 -- 172.21.15.100:0/3451180931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 msgr2=0x55e100a41e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9823e00640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 0x55e100a41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9829000640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 0x55e100a41e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9829000640 1 -- 172.21.15.100:0/3451180931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98240f55d0 con 0x55e100a7efc0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.614+0000 7f9823e00640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 0x55e100a41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.615+0000 7f9829000640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f981c02be70 tx=0x7f981c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4e8dbaf53c09cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.615+0000 7f980e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.615+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c032a00 con 0x55e100a7efc0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.615+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f981c040070 con 0x55e100a7efc0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.615+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1006ae7e0 con 0x55e100a7efc0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981c032b60 con 0x55e100a7efc0 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 10 client.5595 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e1009ad4e0 con 0x55e100a7efc0 2024-02-21T07:49:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e1006ae7e0 con 0x55e100a7efc0 2024-02-21T07:49:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f981c032cc0 con 0x55e100a7efc0 2024-02-21T07:49:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 10 client.5595 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 10 client.5595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 20 client.5595 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.616+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100a6df50 0x55e100ab5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.617+0000 7f982e648740 4 client.5595 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.617+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1006eb720 con 0x55e100a6df50 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.617+0000 7f9823e00640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100a6df50 0x55e100ab5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.618+0000 7f980e000640 10 client.5595 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.618+0000 7f9823e00640 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100a6df50 0x55e100ab5870 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6035848fb24f6ae9 server_cookie=fee05d8ffcbf9333 in_seq=0 out_seq=0 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.618+0000 7f980e000640 1 -- 172.21.15.100:0/3451180931 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e1006eb720 con 0x55e100a6df50 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.618+0000 7f980e000640 10 client.5595 handle_command_reply: tid=0 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 client.5595 shutdown 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 msgr2=0x55e100ab8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f981c02be70 tx=0x7f981c004730 comp rx=0 tx=0).stop 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 shutdown_connections 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100a6df50 0x55e100ab5870 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100ab4f80 0x55e100a42650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7f8e0 0x55e100a41e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 --2- 172.21.15.100:0/3451180931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7efc0 0x55e100ab8f60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 >> 172.21.15.100:0/3451180931 conn(0x55e100a0e5a0 msgr2=0x55e100a78eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f980e000640 0 client.5595 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.619+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 shutdown_connections 2024-02-21T07:49:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.620+0000 7f982e648740 1 -- 172.21.15.100:0/3451180931 wait complete. 2024-02-21T07:49:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.620+0000 7f982e648740 20 client.5595 trim_cache size 0 max 16384 2024-02-21T07:49:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.644+0000 7f982e648740 1 Processor -- start 2024-02-21T07:49:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.644+0000 7f982e648740 1 -- start start 2024-02-21T07:49:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 0x55e100a7e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 0x55e100a85cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100ab9000 con 0x55e100ab4f80 2024-02-21T07:49:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100a4d2d0 con 0x55e100a7efc0 2024-02-21T07:49:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.645+0000 7f982e648740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100a46380 con 0x55e100a7f8e0 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 0x55e100a7e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 0x55e100a7e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57114/0 (socket says 172.21.15.100:57114) 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829000640 1 -- 172.21.15.100:0/546203600 learned_addr learned my addr 172.21.15.100:0/546203600 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 0x55e100a85cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 -- 172.21.15.100:0/546203600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 msgr2=0x55e100a42ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a42ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 -- 172.21.15.100:0/546203600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 msgr2=0x55e100a7e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 0x55e100a7e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.646+0000 7f9829a00640 1 -- 172.21.15.100:0/546203600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e100949950 con 0x55e100ab4f80 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.647+0000 7f9829a00640 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 0x55e100a85cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f981401a040 tx=0x7f981400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ab19b3fb9edfb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.647+0000 7f9818c00640 1 -- 172.21.15.100:0/546203600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814005820 con 0x55e100ab4f80 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.647+0000 7f9818c00640 1 -- 172.21.15.100:0/546203600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814006b50 con 0x55e100ab4f80 2024-02-21T07:49:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.647+0000 7f9818c00640 1 -- 172.21.15.100:0/546203600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814007020 con 0x55e100ab4f80 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 -- 172.21.15.100:0/546203600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 msgr2=0x55e100a85cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 0x55e100a85cf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f981401a040 tx=0x7f981400a000 comp rx=0 tx=0).stop 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 -- 172.21.15.100:0/546203600 shutdown_connections 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100ab4f80 0x55e100a85cf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7f8e0 0x55e100a42ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 --2- 172.21.15.100:0/546203600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100a7efc0 0x55e100a7e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 -- 172.21.15.100:0/546203600 >> 172.21.15.100:0/546203600 conn(0x55e100a0e5a0 msgr2=0x55e100a88010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 -- 172.21.15.100:0/546203600 shutdown_connections 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.648+0000 7f982e648740 1 -- 172.21.15.100:0/546203600 wait complete. 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.649+0000 7f982e648740 1 -- start start 2024-02-21T07:49:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.649+0000 7f982e648740 1 Processor -- start 2024-02-21T07:49:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.651+0000 7f982e648740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7efc0 0x55e100ac3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.651+0000 7f982e648740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7f8e0 0x55e100ac2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.651+0000 7f982e648740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57118/0 (socket says 172.21.15.100:57118) 2024-02-21T07:49:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 -- 172.21.15.100:0/1922580015 learned_addr learned my addr 172.21.15.100:0/1922580015 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829000640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7efc0 0x55e100ac3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100b21760 con 0x55e100a7f8e0 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9823e00640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7f8e0 0x55e100ac2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100ac3240 con 0x55e100ab4f80 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e100ac3fc0 con 0x55e100a7efc0 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f982e648740 10 client.0 _ll_register_callbacks cb 0x55e100aba600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 -- 172.21.15.100:0/1922580015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7efc0 msgr2=0x55e100ac3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7efc0 0x55e100ac3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 -- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7f8e0 msgr2=0x55e100ac2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7f8e0 0x55e100ac2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.652+0000 7f9829a00640 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e100968060 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f9829a00640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9814015000 tx=0x7f9814001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b35bfe29eba9bb4f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f980e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814001700 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f981401a070 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f981400fc60 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981402ba70 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f982e648740 10 client.5761 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.653+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e10096f430 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400fc60 con 0x55e100ab4f80 2024-02-21T07:49:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9814031020 con 0x55e100ab4f80 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f982e648740 10 client.5761 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f982e648740 10 client.5761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f982e648740 20 client.5761 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.654+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100ab8c10 0x55e100b249e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.655+0000 7f982e648740 4 client.5761 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.655+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e10073a890 con 0x55e100ab8c10 2024-02-21T07:49:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.655+0000 7f9829000640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100ab8c10 0x55e100b249e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.655+0000 7f9829000640 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100ab8c10 0x55e100b249e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d1833f76b975d99 server_cookie=783d156b839ff727 in_seq=0 out_seq=0 2024-02-21T07:49:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.655+0000 7f980e000640 10 client.5761 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.656+0000 7f980e000640 1 -- 172.21.15.100:0/1922580015 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e10073a890 con 0x55e100ab8c10 2024-02-21T07:49:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.656+0000 7f980e000640 10 client.5761 handle_command_reply: tid=0 2024-02-21T07:49:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.656+0000 7f982e648740 1 client.5761 shutdown 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 msgr2=0x55e100b10ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9814015000 tx=0x7f9814001330 comp rx=0 tx=0).stop 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 shutdown_connections 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e100ab8c10 0x55e100b249e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e100ab4f80 0x55e100b10ef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e100a7f8e0 0x55e100ac2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f980e000640 0 client.5761 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 --2- 172.21.15.100:0/1922580015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e100a7efc0 0x55e100ac3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 >> 172.21.15.100:0/1922580015 conn(0x55e100a0e5a0 msgr2=0x55e100a7e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 shutdown_connections 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 1 -- 172.21.15.100:0/1922580015 wait complete. 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.657+0000 7f982e648740 20 client.5761 trim_cache size 0 max 16384 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:49:15.663 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 msgr2=0x7f98040a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 0x7f98040a15e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9814019000 tx=0x7f9814016000 comp rx=0 tx=0).stop 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 msgr2=0x7f982418dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f982418dff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9810000f60 tx=0x7f981000c760 comp rx=0 tx=0).stop 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 shutdown_connections 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9824174980 0x7f9824220a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9824190260 0x7f982418dff0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f980409f120 0x7f98040a15e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 --2- 172.21.15.100:0/227066582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98240f4b20 0x7f982417f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.658+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 >> 172.21.15.100:0/227066582 conn(0x7f98240668b0 msgr2=0x7f98240f6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.659+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 shutdown_connections 2024-02-21T07:49:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.659+0000 7f982ba00640 1 -- 172.21.15.100:0/227066582 wait complete. 2024-02-21T07:49:15.682 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:49:15.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:49:15.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.967+0000 7f4ade400640 1 Processor -- start 2024-02-21T07:49:15.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.967+0000 7f4ade400640 1 -- start start 2024-02-21T07:49:15.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ade400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ad80cb490 0x7f4ad80f7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:15.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ade400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad80727f0 con 0x7f4ad8183fc0 2024-02-21T07:49:15.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ade400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad8071470 con 0x7f4ad80f79b0 2024-02-21T07:49:15.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ade400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad80cb920 con 0x7f4ad80cb490 2024-02-21T07:49:15.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ad6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ad80cb490 0x7f4ad80f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ad6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ad80cb490 0x7f4ad80f7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46058/0 (socket says 172.21.15.100:46058) 2024-02-21T07:49:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.970+0000 7f4ad6a00640 1 -- 172.21.15.100:0/788530099 learned_addr learned my addr 172.21.15.100:0/788530099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.971+0000 7f4ad6a00640 1 -- 172.21.15.100:0/788530099 >> v1:172.21.15.156:6789/0 conn(0x7f4ad80f79b0 legacy=0x7f4ad80f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.971+0000 7f4ad6a00640 1 -- 172.21.15.100:0/788530099 >> v1:172.21.15.100:6789/0 conn(0x7f4ad8183fc0 legacy=0x7f4ad80cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:15.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.971+0000 7f4ad6a00640 1 -- 172.21.15.100:0/788530099 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad8071750 con 0x7f4ad80cb490 2024-02-21T07:49:15.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.973+0000 7f4ad6a00640 1 --2- 172.21.15.100:0/788530099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad80cb490 0x7f4ad80f7470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009870 tx=0x7f4ac402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4f30bfaad81e3b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:15.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.974+0000 7f4ad6000640 1 -- 172.21.15.100:0/788530099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac40317e0 con 0x7f4ad80cb490 2024-02-21T07:49:15.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.974+0000 7f4ad6000640 1 -- 172.21.15.100:0/788530099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4031940 con 0x7f4ad80cb490 2024-02-21T07:49:15.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.974+0000 7f4ad6000640 1 -- 172.21.15.100:0/788530099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4031cd0 con 0x7f4ad80cb490 2024-02-21T07:49:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.975+0000 7f4ade400640 1 -- 172.21.15.100:0/788530099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad80cb490 msgr2=0x7f4ad80f7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:15.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.975+0000 7f4ade400640 1 --2- 172.21.15.100:0/788530099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad80cb490 0x7f4ad80f7470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009870 tx=0x7f4ac402b880 comp rx=0 tx=0).stop 2024-02-21T07:49:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.984+0000 7f4ade400640 1 -- 172.21.15.100:0/788530099 shutdown_connections 2024-02-21T07:49:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.984+0000 7f4ade400640 1 --2- 172.21.15.100:0/788530099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad80cb490 0x7f4ad80f7470 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:15.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.984+0000 7f4ade400640 1 -- 172.21.15.100:0/788530099 >> 172.21.15.100:0/788530099 conn(0x7f4ad80fbea0 msgr2=0x7f4ad80fc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.986+0000 7f4ade400640 1 -- 172.21.15.100:0/788530099 shutdown_connections 2024-02-21T07:49:15.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:15.986+0000 7f4ade400640 1 -- 172.21.15.100:0/788530099 wait complete. 2024-02-21T07:49:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.002+0000 7f4ade400640 1 Processor -- start 2024-02-21T07:49:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.002+0000 7f4ade400640 1 -- start start 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.004+0000 7f4ade400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad80cb490 0x7f4ad8224660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.004+0000 7f4ade400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 0x7f4ad81584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.005+0000 7f4ade400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 0x7f4ad8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.005+0000 7f4ade400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8224ba0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.005+0000 7f4ade400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8157170 con 0x7f4ad80cb490 2024-02-21T07:49:16.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.005+0000 7f4ade400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8157450 con 0x7f4ad80f79b0 2024-02-21T07:49:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.006+0000 7f4ad6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 0x7f4ad81584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.007+0000 7f4ad6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 0x7f4ad81584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35672/0 (socket says 172.21.15.100:35672) 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.007+0000 7f4ad6a00640 1 -- 172.21.15.100:0/2681263223 learned_addr learned my addr 172.21.15.100:0/2681263223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.007+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad80cb490 0x7f4ad8224660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.007+0000 7f4ad7e00640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 0x7f4ad8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.008+0000 7f4ad7e00640 1 -- 172.21.15.100:0/2681263223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 msgr2=0x7f4ad81584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.008+0000 7f4ad7e00640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 0x7f4ad81584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.008+0000 7f4ad7e00640 1 -- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad80cb490 msgr2=0x7f4ad8224660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.008+0000 7f4ad7e00640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad80cb490 0x7f4ad8224660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.008+0000 7f4ad7e00640 1 -- 172.21.15.100:0/2681263223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40094d0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.009+0000 7f4ad7e00640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 0x7f4ad8155700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000bf70 tx=0x7f4ad000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.009+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad000ce40 con 0x7f4ad8183fc0 2024-02-21T07:49:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.009+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0014440 con 0x7f4ad8183fc0 2024-02-21T07:49:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.009+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00147f0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.010+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad8157730 con 0x7f4ad8183fc0 2024-02-21T07:49:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.011+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad8157cf0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.016+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad80900a0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.019+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4ad001d3b0 con 0x7f4ad8183fc0 2024-02-21T07:49:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.022+0000 7f4acf400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 0x7f4ab80a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.022+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ad00ca050 con 0x7f4ad8183fc0 2024-02-21T07:49:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.023+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 0x7f4ab80a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.025+0000 7f4ad7400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 0x7f4ab80a1630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8001640 tx=0x7f4ac8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.028+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ad0093f40 con 0x7f4ad8183fc0 2024-02-21T07:49:16.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.576+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad808f240 con 0x7f4ad8183fc0 2024-02-21T07:49:16.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.578+0000 7f4acf400640 1 -- 172.21.15.100:0/2681263223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7f4ad0019020 con 0x7f4ad8183fc0 2024-02-21T07:49:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:49:16.584 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:49:16.584 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:49:16.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.591+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 msgr2=0x7f4ab80a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.591+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 0x7f4ab80a1630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8001640 tx=0x7f4ac8009040 comp rx=0 tx=0).stop 2024-02-21T07:49:16.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.591+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 msgr2=0x7f4ad8155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.591+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 0x7f4ad8155700 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000bf70 tx=0x7f4ad000c4d0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 shutdown_connections 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ab809f170 0x7f4ab80a1630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad8183fc0 0x7f4ad8155700 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ad80f79b0 0x7f4ad81584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 --2- 172.21.15.100:0/2681263223 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4ad80cb490 0x7f4ad8224660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.596+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 >> 172.21.15.100:0/2681263223 conn(0x7f4ad80fbea0 msgr2=0x7f4ad80cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.597+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 shutdown_connections 2024-02-21T07:49:16.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.597+0000 7f4ade400640 1 -- 172.21.15.100:0/2681263223 wait complete. 2024-02-21T07:49:16.649 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:16.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:49:16.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.985+0000 7fa207800640 1 Processor -- start 2024-02-21T07:49:16.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.985+0000 7fa207800640 1 -- start start 2024-02-21T07:49:16.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa207800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa200187b40 0x7fa2000f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa207800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2000f9580 0x7fa2000f9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa207800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20018b640 con 0x7fa2001828b0 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa207800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20018b920 con 0x7fa2000f9580 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa207800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20018bc00 con 0x7fa200187b40 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa205800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2000f9580 0x7fa2000f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa204e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa2001828b0 0x7fa200187430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34836/0 (socket says 172.21.15.100:34836) 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa204e00640 1 -- 172.21.15.100:0/226398119 learned_addr learned my addr 172.21.15.100:0/226398119 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa205800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa2000f9580 0x7fa2000f9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57146/0 (socket says 172.21.15.100:57146) 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.988+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/226398119 >> v2:172.21.15.170:3300/0 conn(0x7fa200187b40 0x7fa2000f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.989+0000 7fa205800640 1 -- 172.21.15.100:0/226398119 >> v2:172.21.15.170:3300/0 conn(0x7fa200187b40 msgr2=0x7fa2000f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.989+0000 7fa205800640 1 --2- 172.21.15.100:0/226398119 >> v2:172.21.15.170:3300/0 conn(0x7fa200187b40 0x7fa2000f9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.989+0000 7fa205800640 1 -- 172.21.15.100:0/226398119 >> v1:172.21.15.100:6789/0 conn(0x7fa2001828b0 legacy=0x7fa200187430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.989+0000 7fa205800640 1 -- 172.21.15.100:0/226398119 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200186950 con 0x7fa2000f9580 2024-02-21T07:49:16.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.990+0000 7fa205800640 1 --2- 172.21.15.100:0/226398119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2000f9580 0x7fa2000f9980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa200186510 tx=0x7fa1f802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a8c8ec2b9ee903 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:16.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.991+0000 7fa1ff400640 1 -- 172.21.15.100:0/226398119 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f802cb60 con 0x7fa2000f9580 2024-02-21T07:49:16.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.991+0000 7fa1ff400640 1 -- 172.21.15.100:0/226398119 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f802ccc0 con 0x7fa2000f9580 2024-02-21T07:49:16.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.991+0000 7fa1ff400640 1 -- 172.21.15.100:0/226398119 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8034660 con 0x7fa2000f9580 2024-02-21T07:49:16.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 -- 172.21.15.100:0/226398119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2000f9580 msgr2=0x7fa2000f9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:16.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 --2- 172.21.15.100:0/226398119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2000f9580 0x7fa2000f9980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa200186510 tx=0x7fa1f802bdb0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 -- 172.21.15.100:0/226398119 shutdown_connections 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 --2- 172.21.15.100:0/226398119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2000f9580 0x7fa2000f9980 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 --2- 172.21.15.100:0/226398119 >> v2:172.21.15.170:3300/0 conn(0x7fa200187b40 0x7fa2000f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 -- 172.21.15.100:0/226398119 >> 172.21.15.100:0/226398119 conn(0x7fa2000fe230 msgr2=0x7fa2000fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.992+0000 7fa207800640 1 -- 172.21.15.100:0/226398119 shutdown_connections 2024-02-21T07:49:16.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.993+0000 7fa207800640 1 -- 172.21.15.100:0/226398119 wait complete. 2024-02-21T07:49:17.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.996+0000 7fa207800640 1 Processor -- start 2024-02-21T07:49:17.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.996+0000 7fa207800640 1 -- start start 2024-02-21T07:49:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2001828b0 0x7fa20015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa200187b40 0x7fa20021dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20021c940 con 0x7fa200187b40 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20021cc20 con 0x7fa2001828b0 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa207800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20021cf00 con 0x7fa2000f9580 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa204e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa205800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa200187b40 0x7fa20021dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa204e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35682/0 (socket says 172.21.15.100:35682) 2024-02-21T07:49:17.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.998+0000 7fa204e00640 1 -- 172.21.15.100:0/2352120058 learned_addr learned my addr 172.21.15.100:0/2352120058 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2001828b0 0x7fa20015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 -- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2001828b0 msgr2=0x7fa20015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2001828b0 0x7fa20015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 -- 172.21.15.100:0/2352120058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa200187b40 msgr2=0x7fa20021dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa200187b40 0x7fa20021dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 -- 172.21.15.100:0/2352120058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009a70 con 0x7fa2000f9580 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:16.999+0000 7fa204e00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c3c0 tx=0x7fa1f400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.000+0000 7fa1fcc00640 1 -- 172.21.15.100:0/2352120058 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4005ce0 con 0x7fa2000f9580 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.000+0000 7fa1fcc00640 1 -- 172.21.15.100:0/2352120058 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4005e40 con 0x7fa2000f9580 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.000+0000 7fa1fcc00640 1 -- 172.21.15.100:0/2352120058 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40072d0 con 0x7fa2000f9580 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.000+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20021d1e0 con 0x7fa2000f9580 2024-02-21T07:49:17.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.000+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20021d7a0 con 0x7fa2000f9580 2024-02-21T07:49:17.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.004+0000 7fa1fcc00640 1 -- 172.21.15.100:0/2352120058 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa1f40074f0 con 0x7fa2000f9580 2024-02-21T07:49:17.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.006+0000 7fa1fcc00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 0x7fa1e00a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.006+0000 7fa1fcc00640 1 -- 172.21.15.100:0/2352120058 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1f40c9120 con 0x7fa2000f9580 2024-02-21T07:49:17.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.006+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 0x7fa1e00a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.007+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 0x7fa1e00a1630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2000d5a00 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.007+0000 7fa20a615740 1 Processor -- start 2024-02-21T07:49:17.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.007+0000 7fa20a615740 1 -- start start 2024-02-21T07:49:17.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed91ec0 0x56325ed922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325edce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ecc5210 con 0x56325ed91ec0 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ecc2740 con 0x56325ed927e0 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.008+0000 7fa20a615740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ecbdf20 con 0x56325edcd590 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa205800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325edce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57166/0 (socket says 172.21.15.100:57166) 2024-02-21T07:49:17.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 -- 172.21.15.100:0/2199669566 learned_addr learned my addr 172.21.15.100:0/2199669566 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa204e00640 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed91ec0 0x56325ed922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 -- 172.21.15.100:0/2199669566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 msgr2=0x56325edce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325edce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 -- 172.21.15.100:0/2199669566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed91ec0 msgr2=0x56325ed922a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed91ec0 0x56325ed922a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 -- 172.21.15.100:0/2199669566 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56325ec7fdf0 con 0x56325ed927e0 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec011d60 tx=0x7fa1ec014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d388bd899e878fb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.009+0000 7fa1f1600640 1 -- 172.21.15.100:0/2199669566 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec011d90 con 0x56325ed927e0 2024-02-21T07:49:17.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa1f1600640 1 -- 172.21.15.100:0/2199669566 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec021440 con 0x56325ed927e0 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa1f1600640 1 -- 172.21.15.100:0/2199669566 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0217b0 con 0x56325ed927e0 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 -- 172.21.15.100:0/2199669566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 msgr2=0x56325edcd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec011d60 tx=0x7fa1ec014000 comp rx=0 tx=0).stop 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 -- 172.21.15.100:0/2199669566 shutdown_connections 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325edce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcd050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 --2- 172.21.15.100:0/2199669566 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed91ec0 0x56325ed922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.010+0000 7fa20a615740 1 -- 172.21.15.100:0/2199669566 >> 172.21.15.100:0/2199669566 conn(0x56325ed54490 msgr2=0x56325ed55510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.011+0000 7fa20a615740 1 -- 172.21.15.100:0/2199669566 shutdown_connections 2024-02-21T07:49:17.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.011+0000 7fa20a615740 1 -- 172.21.15.100:0/2199669566 wait complete. 2024-02-21T07:49:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.012+0000 7fa20a615740 1 -- start start 2024-02-21T07:49:17.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.012+0000 7fa20a615740 1 Processor -- start 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed8b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed4fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ec63150 con 0x56325ed891f0 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ec62df0 con 0x56325ed927e0 2024-02-21T07:49:17.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ea2c1c0 con 0x56325edcd590 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa20a615740 10 client.0 _ll_register_callbacks cb 0x56325ecb22b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.014+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35692/0 (socket says 172.21.15.100:35692) 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 -- 172.21.15.100:0/1254099713 learned_addr learned my addr 172.21.15.100:0/1254099713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa205800640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed4fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa204e00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed8b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 -- 172.21.15.100:0/1254099713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 msgr2=0x56325ed8b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed8b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 -- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 msgr2=0x56325ed4fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed4fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 -- 172.21.15.100:0/1254099713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec011a10 con 0x56325edcd590 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa205800640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed4fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:17.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1ffe00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec008010 tx=0x7fa1ec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef68f85eeb74302c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.015+0000 7fa1e6000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:17.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec021b40 con 0x56325edcd590 2024-02-21T07:49:17.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56325e9bd7e0 con 0x56325edcd590 2024-02-21T07:49:17.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1ec031070 con 0x56325edcd590 2024-02-21T07:49:17.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1ec021ca0 con 0x56325edcd590 2024-02-21T07:49:17.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa20a615740 10 client.5720 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56325ecbc5a0 con 0x56325edcd590 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.016+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56325e9bd7e0 con 0x56325edcd590 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa1ec036480 con 0x56325edcd590 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 10 client.5720 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 10 client.5720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 20 client.5720 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed89670 0x56325ed505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 4 client.5720 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56325e9fa720 con 0x56325ed89670 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa204e00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed89670 0x56325ed505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa204e00640 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed89670 0x56325ed505f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4536f318a0491c2d server_cookie=11869f35f462fb3d in_seq=0 out_seq=0 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.017+0000 7fa1e6000640 10 client.5720 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:17.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.018+0000 7fa1e6000640 1 -- 172.21.15.100:0/1254099713 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56325e9fa720 con 0x56325ed89670 2024-02-21T07:49:17.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.018+0000 7fa1e6000640 10 client.5720 handle_command_reply: tid=0 2024-02-21T07:49:17.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.018+0000 7fa20a615740 1 client.5720 shutdown 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 msgr2=0x56325ed865e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec008010 tx=0x7fa1ec0046c0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 shutdown_connections 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed89670 0x56325ed505f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed4fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ed865e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 --2- 172.21.15.100:0/1254099713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed8b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa1e6000640 0 client.5720 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 >> 172.21.15.100:0/1254099713 conn(0x56325ed91ec0 msgr2=0x56325edcd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 shutdown_connections 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 1 -- 172.21.15.100:0/1254099713 wait complete. 2024-02-21T07:49:17.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.020+0000 7fa20a615740 20 client.5720 trim_cache size 0 max 16384 2024-02-21T07:49:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.042+0000 7fa20a615740 1 Processor -- start 2024-02-21T07:49:17.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.042+0000 7fa20a615740 1 -- start start 2024-02-21T07:49:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed96aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ee2ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ed56520 con 0x56325ed891f0 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ede7030 con 0x56325ed927e0 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa20a615740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ed8b050 con 0x56325edcd590 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa204e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed96aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa204e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46096/0 (socket says 172.21.15.100:46096) 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.043+0000 7fa204e00640 1 -- 172.21.15.100:0/370294405 learned_addr learned my addr 172.21.15.100:0/370294405 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa205800640 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ee2ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 -- 172.21.15.100:0/370294405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 msgr2=0x56325ee2ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ee2ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 -- 172.21.15.100:0/370294405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 msgr2=0x56325ed96aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed96aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 -- 172.21.15.100:0/370294405 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56325edcabe0 con 0x56325ed891f0 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.044+0000 7fa204e00640 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4096960 tx=0x7fa1f4097f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b937be6f12ed47 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.045+0000 7fa1f0c00640 1 -- 172.21.15.100:0/370294405 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40b4260 con 0x56325ed891f0 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.045+0000 7fa1f0c00640 1 -- 172.21.15.100:0/370294405 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4096c60 con 0x56325ed891f0 2024-02-21T07:49:17.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.045+0000 7fa1f0c00640 1 -- 172.21.15.100:0/370294405 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f409adb0 con 0x56325ed891f0 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 -- 172.21.15.100:0/370294405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 msgr2=0x56325ed55fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4096960 tx=0x7fa1f4097f90 comp rx=0 tx=0).stop 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 -- 172.21.15.100:0/370294405 shutdown_connections 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325edcd590 0x56325ee2ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325ed96aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 --2- 172.21.15.100:0/370294405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325ed891f0 0x56325ed55fe0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 -- 172.21.15.100:0/370294405 >> 172.21.15.100:0/370294405 conn(0x56325ed91ec0 msgr2=0x56325ed86f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 -- 172.21.15.100:0/370294405 shutdown_connections 2024-02-21T07:49:17.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.046+0000 7fa20a615740 1 -- 172.21.15.100:0/370294405 wait complete. 2024-02-21T07:49:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.047+0000 7fa20a615740 1 -- start start 2024-02-21T07:49:17.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.048+0000 7fa20a615740 1 Processor -- start 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 0x56325ee3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 0x56325ede7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ee3ab00 con 0x56325edcd590 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ed83b80 con 0x56325ed927e0 2024-02-21T07:49:17.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56325ed8e5e0 con 0x56325ed8f080 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.049+0000 7fa20a615740 10 client.0 _ll_register_callbacks cb 0x7fa1ec009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.050+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 0x56325ee3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.050+0000 7fa1ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 0x56325ee3a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46106/0 (socket says 172.21.15.100:46106) 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.050+0000 7fa1ffe00640 1 -- 172.21.15.100:0/1110671582 learned_addr learned my addr 172.21.15.100:0/1110671582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.050+0000 7fa205800640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 0x56325ede7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa204e00640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 -- 172.21.15.100:0/1110671582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 msgr2=0x56325edcb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 -- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 msgr2=0x56325ee3a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 0x56325ee3a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 -- 172.21.15.100:0/1110671582 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20021d7a0 con 0x56325ed8f080 2024-02-21T07:49:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa1e6000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.051+0000 7fa205800640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 0x56325ede7280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8033000 tx=0x7fa1f8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a767ae7ef246269e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.052+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8044040 con 0x56325ed8f080 2024-02-21T07:49:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.052+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1f804a840 con 0x56325ed8f080 2024-02-21T07:49:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.053+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1ec021440 con 0x56325ed8f080 2024-02-21T07:49:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.053+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1f8044040 con 0x56325ed8f080 2024-02-21T07:49:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.054+0000 7fa20a615740 10 client.5726 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:17.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.054+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56325ec58ab0 con 0x56325ed8f080 2024-02-21T07:49:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec021440 con 0x56325ed8f080 2024-02-21T07:49:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa1f8053050 con 0x56325ed8f080 2024-02-21T07:49:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 10 client.5726 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 10 client.5726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:49:17.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 20 client.5726 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed92330 0x56325edd6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 4 client.5726 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56325ea49890 con 0x56325ed92330 2024-02-21T07:49:17.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.055+0000 7fa204e00640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed92330 0x56325edd6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.056+0000 7fa204e00640 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed92330 0x56325edd6fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc2f689f4840fce4 server_cookie=1b4930bcd7192b46 in_seq=0 out_seq=0 2024-02-21T07:49:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.056+0000 7fa1e6000640 10 client.5726 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.056+0000 7fa1e6000640 1 -- 172.21.15.100:0/1110671582 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56325ea49890 con 0x56325ed92330 2024-02-21T07:49:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.056+0000 7fa1e6000640 10 client.5726 handle_command_reply: tid=0 2024-02-21T07:49:17.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.056+0000 7fa20a615740 1 client.5726 shutdown 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 msgr2=0x56325ede7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 0x56325ede7280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8033000 tx=0x7fa1f8004ab0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 shutdown_connections 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56325ed92330 0x56325edd6fd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56325ed8f080 0x56325ede7280 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56325edcd590 0x56325ee3a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 --2- 172.21.15.100:0/1110671582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56325ed927e0 0x56325edcb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.059+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 >> 172.21.15.100:0/1110671582 conn(0x56325ed91ec0 msgr2=0x56325ed78fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.060+0000 7fa1e6000640 0 client.5726 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.061+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 shutdown_connections 2024-02-21T07:49:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.061+0000 7fa20a615740 1 -- 172.21.15.100:0/1110671582 wait complete. 2024-02-21T07:49:17.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.061+0000 7fa20a615740 20 client.5726 trim_cache size 0 max 16384 2024-02-21T07:49:17.066 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 msgr2=0x7fa1e00a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 0x7fa1e00a1630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2000d5a00 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 msgr2=0x7fa20021f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c3c0 tx=0x7fa1f400c880 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 shutdown_connections 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1e009f170 0x7fa1e00a1630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa200187b40 0x7fa20021dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2001828b0 0x7fa20015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 --2- 172.21.15.100:0/2352120058 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa2000f9580 0x7fa20021f250 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 >> 172.21.15.100:0/2352120058 conn(0x7fa2000fe230 msgr2=0x7fa2000f9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.062+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 shutdown_connections 2024-02-21T07:49:17.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.063+0000 7fa207800640 1 -- 172.21.15.100:0/2352120058 wait complete. 2024-02-21T07:49:17.093 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:17.093 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:49:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.422+0000 7fc55c800640 1 Processor -- start 2024-02-21T07:49:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.422+0000 7fc55c800640 1 -- start start 2024-02-21T07:49:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.425+0000 7fc55c800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc554188ab0 0x7fc55406ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.425+0000 7fc55c800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55408bfe0 con 0x7fc55408d1c0 2024-02-21T07:49:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc55c800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55408c880 con 0x7fc55408cd10 2024-02-21T07:49:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc55c800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540fa660 con 0x7fc554188ab0 2024-02-21T07:49:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc554188ab0 0x7fc55406ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc554188ab0 0x7fc55406ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46114/0 (socket says 172.21.15.100:46114) 2024-02-21T07:49:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 -- 172.21.15.100:0/1094570024 learned_addr learned my addr 172.21.15.100:0/1094570024 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 -- 172.21.15.100:0/1094570024 >> v1:172.21.15.170:6789/0 conn(0x7fc55408cd10 legacy=0x7fc5540f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 -- 172.21.15.100:0/1094570024 >> v1:172.21.15.156:6789/0 conn(0x7fc55408d1c0 legacy=0x7fc554188e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.426+0000 7fc559e00640 1 -- 172.21.15.100:0/1094570024 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5540fa940 con 0x7fc554188ab0 2024-02-21T07:49:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.428+0000 7fc559e00640 1 --2- 172.21.15.100:0/1094570024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55406ab60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc54802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1274302ccb2b84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.429+0000 7fc558a00640 1 -- 172.21.15.100:0/1094570024 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548031750 con 0x7fc554188ab0 2024-02-21T07:49:17.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.429+0000 7fc558a00640 1 -- 172.21.15.100:0/1094570024 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480318b0 con 0x7fc554188ab0 2024-02-21T07:49:17.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.429+0000 7fc558a00640 1 -- 172.21.15.100:0/1094570024 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548031c40 con 0x7fc554188ab0 2024-02-21T07:49:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 -- 172.21.15.100:0/1094570024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 msgr2=0x7fc55406ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 --2- 172.21.15.100:0/1094570024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55406ab60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc54802b7f0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 -- 172.21.15.100:0/1094570024 shutdown_connections 2024-02-21T07:49:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 --2- 172.21.15.100:0/1094570024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55406ab60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 -- 172.21.15.100:0/1094570024 >> 172.21.15.100:0/1094570024 conn(0x7fc5540fe290 msgr2=0x7fc5540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 -- 172.21.15.100:0/1094570024 shutdown_connections 2024-02-21T07:49:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.430+0000 7fc55c800640 1 -- 172.21.15.100:0/1094570024 wait complete. 2024-02-21T07:49:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.432+0000 7fc55c800640 1 Processor -- start 2024-02-21T07:49:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.433+0000 7fc55c800640 1 -- start start 2024-02-21T07:49:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc55408d1c0 0x7fc554162570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55416e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55416ad10 con 0x7fc554188ab0 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55416d490 con 0x7fc55408cd10 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55c800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55416aa30 con 0x7fc55408d1c0 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc559e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc559e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57218/0 (socket says 172.21.15.100:57218) 2024-02-21T07:49:17.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc559e00640 1 -- 172.21.15.100:0/821904887 learned_addr learned my addr 172.21.15.100:0/821904887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.434+0000 7fc55a800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55416e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 -- 172.21.15.100:0/821904887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc55408d1c0 msgr2=0x7fc554162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc55408d1c0 0x7fc554162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 -- 172.21.15.100:0/821904887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 msgr2=0x7fc55416e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55416e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 -- 172.21.15.100:0/821904887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480094d0 con 0x7fc55408cd10 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc559e00640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc5480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.435+0000 7fc54e000640 1 -- 172.21.15.100:0/821904887 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548033c80 con 0x7fc55408cd10 2024-02-21T07:49:17.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.436+0000 7fc54e000640 1 -- 172.21.15.100:0/821904887 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc548033de0 con 0x7fc55408cd10 2024-02-21T07:49:17.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.436+0000 7fc54e000640 1 -- 172.21.15.100:0/821904887 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54803d6b0 con 0x7fc55408cd10 2024-02-21T07:49:17.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.437+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55416d730 con 0x7fc55408cd10 2024-02-21T07:49:17.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.437+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55416dcf0 con 0x7fc55408cd10 2024-02-21T07:49:17.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.444+0000 7fc55f59a740 1 Processor -- start 2024-02-21T07:49:17.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.444+0000 7fc55f59a740 1 -- start start 2024-02-21T07:49:17.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.445+0000 7fc54e000640 1 -- 172.21.15.100:0/821904887 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc54803a040 con 0x7fc55408cd10 2024-02-21T07:49:17.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc54e000640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 0x7fc5380a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc54e000640 1 -- 172.21.15.100:0/821904887 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5480ebbc0 con 0x7fc55408cd10 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 0x5584b68032a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b683f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b6736210 con 0x5584b6802ec0 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b6733740 con 0x5584b68037e0 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.448+0000 7fc55f59a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b672ef20 con 0x5584b683e590 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57224/0 (socket says 172.21.15.100:57224) 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 -- 172.21.15.100:0/2432595969 learned_addr learned my addr 172.21.15.100:0/2432595969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc55a800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 0x7fc5380a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559e00640 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 0x5584b68032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 -- 172.21.15.100:0/2432595969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 msgr2=0x5584b683f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b683f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 -- 172.21.15.100:0/2432595969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 msgr2=0x5584b68032a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 0x5584b68032a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559400640 1 -- 172.21.15.100:0/2432595969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584b66f0df0 con 0x5584b68037e0 2024-02-21T07:49:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc559e00640 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 0x5584b68032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:17.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.449+0000 7fc55a800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 0x7fc5380a1560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc554092b00 tx=0x7fc55000f1d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.450+0000 7fc559400640 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc544009720 tx=0x7fc544009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56b723944826a5f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.450+0000 7fc542600640 1 -- 172.21.15.100:0/2432595969 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400bad0 con 0x5584b68037e0 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.450+0000 7fc542600640 1 -- 172.21.15.100:0/2432595969 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400bc50 con 0x5584b68037e0 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.450+0000 7fc542600640 1 -- 172.21.15.100:0/2432595969 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544009e30 con 0x5584b68037e0 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.451+0000 7fc55f59a740 1 -- 172.21.15.100:0/2432595969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 msgr2=0x5584b683e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.451+0000 7fc55f59a740 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc544009720 tx=0x7fc544009be0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.452+0000 7fc55f59a740 1 -- 172.21.15.100:0/2432595969 shutdown_connections 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.452+0000 7fc55f59a740 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b683f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.452+0000 7fc55f59a740 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b683e050 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.452+0000 7fc55f59a740 1 --2- 172.21.15.100:0/2432595969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6802ec0 0x5584b68032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.452+0000 7fc55f59a740 1 -- 172.21.15.100:0/2432595969 >> 172.21.15.100:0/2432595969 conn(0x5584b67c5490 msgr2=0x5584b67c6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.453+0000 7fc55f59a740 1 -- 172.21.15.100:0/2432595969 shutdown_connections 2024-02-21T07:49:17.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.455+0000 7fc55f59a740 1 -- 172.21.15.100:0/2432595969 wait complete. 2024-02-21T07:49:17.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.456+0000 7fc55f59a740 1 -- start start 2024-02-21T07:49:17.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.456+0000 7fc55f59a740 1 Processor -- start 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 0x5584b683c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b680d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b6831c80 0x5584b6830db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b66d4150 con 0x5584b68037e0 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b66d3df0 con 0x5584b683e590 2024-02-21T07:49:17.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b649d1c0 con 0x5584b6831c80 2024-02-21T07:49:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc55f59a740 10 client.0 _ll_register_callbacks cb 0x5584b67232b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc559400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b680d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc559400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b680d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57234/0 (socket says 172.21.15.100:57234) 2024-02-21T07:49:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc559400640 1 -- 172.21.15.100:0/3419876789 learned_addr learned my addr 172.21.15.100:0/3419876789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.459+0000 7fc559e00640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 0x5584b683c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.460+0000 7fc559e00640 1 -- 172.21.15.100:0/3419876789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b6831c80 msgr2=0x5584b6830db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.460+0000 7fc559e00640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b6831c80 0x5584b6830db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.460+0000 7fc559e00640 1 -- 172.21.15.100:0/3419876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 msgr2=0x5584b680d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.460+0000 7fc559e00640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b680d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.460+0000 7fc559e00640 1 -- 172.21.15.100:0/3419876789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544009350 con 0x5584b68037e0 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.461+0000 7fc559e00640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 0x5584b683c3d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc5480e9610 tx=0x7fc5480b9600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e3943488a38308 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.461+0000 7fc536a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:17.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.461+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480a42b0 con 0x5584b68037e0 2024-02-21T07:49:17.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.461+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5480c1ea0 con 0x5584b68037e0 2024-02-21T07:49:17.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.461+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584b642e7e0 con 0x5584b68037e0 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.462+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5480b8b50 con 0x5584b68037e0 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.462+0000 7fc55f59a740 10 client.5637 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.462+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5584b672d5a0 con 0x5584b68037e0 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.463+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5584b642e7e0 con 0x5584b68037e0 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.463+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc548050020 con 0x5584b68037e0 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.464+0000 7fc55f59a740 10 client.5637 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.464+0000 7fc55f59a740 10 client.5637 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.464+0000 7fc55f59a740 20 client.5637 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.465+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b68312f0 0x5584b67f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.465+0000 7fc55f59a740 4 client.5637 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.465+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584b646b720 con 0x5584b68312f0 2024-02-21T07:49:17.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.465+0000 7fc559400640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b68312f0 0x5584b67f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.466+0000 7fc559400640 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b68312f0 0x5584b67f87f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f41922eb6c3c74e server_cookie=8980dc5cb00560d3 in_seq=0 out_seq=0 2024-02-21T07:49:17.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.466+0000 7fc536a00640 10 client.5637 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:17.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.467+0000 7fc536a00640 1 -- 172.21.15.100:0/3419876789 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584b646b720 con 0x5584b68312f0 2024-02-21T07:49:17.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.467+0000 7fc536a00640 10 client.5637 handle_command_reply: tid=0 2024-02-21T07:49:17.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.467+0000 7fc55f59a740 1 client.5637 shutdown 2024-02-21T07:49:17.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 msgr2=0x5584b683c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 0x5584b683c3d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc5480e9610 tx=0x7fc5480b9600 comp rx=0 tx=0).stop 2024-02-21T07:49:17.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 shutdown_connections 2024-02-21T07:49:17.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b6831c80 0x5584b6830db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b68312f0 0x5584b67f87f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc536a00640 0 client.5637 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:17.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b680d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.468+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3419876789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b68037e0 0x5584b683c3d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.469+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 >> 172.21.15.100:0/3419876789 conn(0x5584b6802ec0 msgr2=0x5584b683e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.470+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 shutdown_connections 2024-02-21T07:49:17.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.470+0000 7fc55f59a740 1 -- 172.21.15.100:0/3419876789 wait complete. 2024-02-21T07:49:17.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.470+0000 7fc55f59a740 20 client.5637 trim_cache size 0 max 16384 2024-02-21T07:49:17.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.486+0000 7fc55f59a740 1 Processor -- start 2024-02-21T07:49:17.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.487+0000 7fc55f59a740 1 -- start start 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b683bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b6896620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b680d6f0 con 0x5584b6831c80 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b67f5ce0 con 0x5584b68037e0 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55f59a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b6830850 con 0x5584b683e590 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc559e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc559e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57248/0 (socket says 172.21.15.100:57248) 2024-02-21T07:49:17.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc559e00640 1 -- 172.21.15.100:0/3764205340 learned_addr learned my addr 172.21.15.100:0/3764205340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc559400640 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b683bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.489+0000 7fc55a800640 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b6896620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 -- 172.21.15.100:0/3764205340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 msgr2=0x5584b6896620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b6896620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 -- 172.21.15.100:0/3764205340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 msgr2=0x5584b683bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b683bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 -- 172.21.15.100:0/3764205340 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584b66c9ab0 con 0x5584b68037e0 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.490+0000 7fc559e00640 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5480b6080 tx=0x7fc548041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d1ff7c26710545 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.491+0000 7fc541c00640 1 -- 172.21.15.100:0/3764205340 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480a42b0 con 0x5584b68037e0 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.491+0000 7fc541c00640 1 -- 172.21.15.100:0/3764205340 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480d1330 con 0x5584b68037e0 2024-02-21T07:49:17.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.491+0000 7fc541c00640 1 -- 172.21.15.100:0/3764205340 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480bac70 con 0x5584b68037e0 2024-02-21T07:49:17.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.492+0000 7fc55f59a740 1 -- 172.21.15.100:0/3764205340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 msgr2=0x5584b680d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.492+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc5480b6080 tx=0x7fc548041000 comp rx=0 tx=0).stop 2024-02-21T07:49:17.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 -- 172.21.15.100:0/3764205340 shutdown_connections 2024-02-21T07:49:17.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b683e590 0x5584b6896620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b683bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 --2- 172.21.15.100:0/3764205340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b68037e0 0x5584b680d1b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 -- 172.21.15.100:0/3764205340 >> 172.21.15.100:0/3764205340 conn(0x5584b6802ec0 msgr2=0x5584b680e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 -- 172.21.15.100:0/3764205340 shutdown_connections 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.493+0000 7fc55f59a740 1 -- 172.21.15.100:0/3764205340 wait complete. 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.494+0000 7fc55f59a740 1 -- start start 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.494+0000 7fc55f59a740 1 Processor -- start 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.495+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 0x5584b683c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b6837200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b683e310 con 0x5584b6831c80 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b68a1fc0 con 0x5584b683e590 2024-02-21T07:49:17.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584b68a6200 con 0x5584b68037e0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55f59a740 10 client.0 _ll_register_callbacks cb 0x7fc544006ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 0x5584b683c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46164/0 (socket says 172.21.15.100:46164) 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559400640 1 -- 172.21.15.100:0/869483412 learned_addr learned my addr 172.21.15.100:0/869483412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc55a800640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b6837200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 -- 172.21.15.100:0/869483412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 msgr2=0x5584b6837200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b6837200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 -- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 msgr2=0x5584b68477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559e00640 1 -- 172.21.15.100:0/869483412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc544009350 con 0x5584b68037e0 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.496+0000 7fc559400640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:17.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.497+0000 7fc559e00640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 0x5584b683c1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc54802bd60 tx=0x7fc5480a4040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbaeb43aa6bd17c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.497+0000 7fc536a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:17.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.497+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480e9220 con 0x5584b68037e0 2024-02-21T07:49:17.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.497+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5480c1ea0 con 0x5584b68037e0 2024-02-21T07:49:17.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.497+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc54400bc50 con 0x5584b68037e0 2024-02-21T07:49:17.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.498+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5480b9060 con 0x5584b68037e0 2024-02-21T07:49:17.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 10 client.5732 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:17.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5584b66ef650 con 0x5584b68037e0 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400bc50 con 0x5584b68037e0 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fc548050070 con 0x5584b68037e0 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 10 client.5732 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 10 client.5732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 20 client.5732 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b689a370 0x5584b6836c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 4 client.5732 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.501+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5584b64ba890 con 0x5584b689a370 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.502+0000 7fc559400640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b689a370 0x5584b6836c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc559400640 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b689a370 0x5584b6836c10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=599ca2f38eab1767 server_cookie=d2d1428b858e078f in_seq=0 out_seq=0 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc536a00640 10 client.5732 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc536a00640 1 -- 172.21.15.100:0/869483412 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5584b64ba890 con 0x5584b689a370 2024-02-21T07:49:17.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc536a00640 10 client.5732 handle_command_reply: tid=0 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc55f59a740 1 client.5732 shutdown 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 msgr2=0x5584b683c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.503+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 0x5584b683c1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc54802bd60 tx=0x7fc5480a4040 comp rx=0 tx=0).stop 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 shutdown_connections 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5584b689a370 0x5584b6836c10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc536a00640 0 client.5732 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5584b683e590 0x5584b6837200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584b6831c80 0x5584b68477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 --2- 172.21.15.100:0/869483412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5584b68037e0 0x5584b683c1d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 >> 172.21.15.100:0/869483412 conn(0x5584b6802ec0 msgr2=0x5584b68328d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 shutdown_connections 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 1 -- 172.21.15.100:0/869483412 wait complete. 2024-02-21T07:49:17.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.504+0000 7fc55f59a740 20 client.5732 trim_cache size 0 max 16384 2024-02-21T07:49:17.511 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:17.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 msgr2=0x7fc5380a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 0x7fc5380a1560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc554092b00 tx=0x7fc55000f1d0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 msgr2=0x7fc55421fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc548009870 tx=0x7fc5480046c0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 shutdown_connections 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc53809f0a0 0x7fc5380a1560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc554188ab0 0x7fc55416e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc55408d1c0 0x7fc554162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 --2- 172.21.15.100:0/821904887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc55408cd10 0x7fc55421fce0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 >> 172.21.15.100:0/821904887 conn(0x7fc5540fe290 msgr2=0x7fc5540d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 shutdown_connections 2024-02-21T07:49:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.505+0000 7fc55c800640 1 -- 172.21.15.100:0/821904887 wait complete. 2024-02-21T07:49:17.527 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:17.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:49:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.861+0000 7f273a400640 1 Processor -- start 2024-02-21T07:49:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.861+0000 7f273a400640 1 -- start start 2024-02-21T07:49:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.864+0000 7f273a400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f272c058cd0 0x7f272c059140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.864+0000 7f273a400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c10fa30 con 0x7f272c115c70 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.864+0000 7f273a400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c10fd10 con 0x7f272c1086c0 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.864+0000 7f273a400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0521b0 con 0x7f272c058cd0 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f272c1086c0 0x7f272c115560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:36570/0 (socket says 172.21.15.100:36570) 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733400640 1 -- 172.21.15.100:0/3761739840 learned_addr learned my addr 172.21.15.100:0/3761739840 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733e00640 1 --2- 172.21.15.100:0/3761739840 >> v2:172.21.15.170:3300/0 conn(0x7f272c058cd0 0x7f272c059140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2732000640 1 -- 172.21.15.100:0/3761739840 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995854784 0 0) 0x7f272c10fd10 con 0x7f272c1086c0 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2732000640 1 -- 172.21.15.100:0/3761739840 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c003520 con 0x7f272c1086c0 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733e00640 1 -- 172.21.15.100:0/3761739840 >> v1:172.21.15.170:6789/0 conn(0x7f272c1086c0 legacy=0x7f272c115560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733e00640 1 -- 172.21.15.100:0/3761739840 >> v1:172.21.15.156:6789/0 conn(0x7f272c115c70 legacy=0x7f272c0585c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.865+0000 7f2733e00640 1 -- 172.21.15.100:0/3761739840 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c10fff0 con 0x7f272c058cd0 2024-02-21T07:49:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.866+0000 7f2733e00640 1 --2- 172.21.15.100:0/3761739840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c058cd0 0x7f272c059140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f273404f400 tx=0x7f27340a6d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99b1447f234d748d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.866+0000 7f2732000640 1 -- 172.21.15.100:0/3761739840 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340a7b90 con 0x7f272c058cd0 2024-02-21T07:49:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.867+0000 7f2732000640 1 -- 172.21.15.100:0/3761739840 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27340a7d30 con 0x7f272c058cd0 2024-02-21T07:49:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.867+0000 7f2732000640 1 -- 172.21.15.100:0/3761739840 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340af640 con 0x7f272c058cd0 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.867+0000 7f273a400640 1 -- 172.21.15.100:0/3761739840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c058cd0 msgr2=0x7f272c059140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.867+0000 7f273a400640 1 --2- 172.21.15.100:0/3761739840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c058cd0 0x7f272c059140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f273404f400 tx=0x7f27340a6d20 comp rx=0 tx=0).stop 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.868+0000 7f273a400640 1 -- 172.21.15.100:0/3761739840 shutdown_connections 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.868+0000 7f273a400640 1 --2- 172.21.15.100:0/3761739840 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c058cd0 0x7f272c059140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.868+0000 7f273a400640 1 -- 172.21.15.100:0/3761739840 >> 172.21.15.100:0/3761739840 conn(0x7f272c057240 msgr2=0x7f272c057650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.868+0000 7f273a400640 1 -- 172.21.15.100:0/3761739840 shutdown_connections 2024-02-21T07:49:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.868+0000 7f273a400640 1 -- 172.21.15.100:0/3761739840 wait complete. 2024-02-21T07:49:17.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.871+0000 7f273a400640 1 Processor -- start 2024-02-21T07:49:17.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.871+0000 7f273a400640 1 -- start start 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272c058cd0 0x7f272c0fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f272c115c70 0x7f272c1a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1a5a10 con 0x7f272c058cd0 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c008b70 con 0x7f272c115c70 2024-02-21T07:49:17.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f273a400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1a5670 con 0x7f272c1086c0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.872+0000 7f2732a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35764/0 (socket says 172.21.15.100:35764) 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 -- 172.21.15.100:0/656876806 learned_addr learned my addr 172.21.15.100:0/656876806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2733e00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f272c115c70 0x7f272c1a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 -- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f272c115c70 msgr2=0x7f272c1a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f272c115c70 0x7f272c1a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 -- 172.21.15.100:0/656876806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272c058cd0 msgr2=0x7f272c0fd130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272c058cd0 0x7f272c0fd130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 -- 172.21.15.100:0/656876806 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734068eb0 con 0x7f272c1086c0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.873+0000 7f2732a00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f272800b3e0 tx=0x7f272800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.874+0000 7f2723400640 1 -- 172.21.15.100:0/656876806 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728011830 con 0x7f272c1086c0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.874+0000 7f2723400640 1 -- 172.21.15.100:0/656876806 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27280119b0 con 0x7f272c1086c0 2024-02-21T07:49:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.874+0000 7f2723400640 1 -- 172.21.15.100:0/656876806 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728011d60 con 0x7f272c1086c0 2024-02-21T07:49:17.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.874+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c0082d0 con 0x7f272c1086c0 2024-02-21T07:49:17.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.874+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c008890 con 0x7f272c1086c0 2024-02-21T07:49:17.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.877+0000 7f2723400640 1 -- 172.21.15.100:0/656876806 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f272801a400 con 0x7f272c1086c0 2024-02-21T07:49:17.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.880+0000 7f273d078740 1 Processor -- start 2024-02-21T07:49:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.881+0000 7f273d078740 1 -- start start 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.881+0000 7f2723400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 0x7f27180a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.881+0000 7f2723400640 1 -- 172.21.15.100:0/656876806 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f27280c9cd0 con 0x7f272c1086c0 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576070 0x55edf4576450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f2733e00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 0x7f27180a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4576990 0x55edf45b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf44a9210 con 0x55edf45b1740 2024-02-21T07:49:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf44a6740 con 0x55edf4576990 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.882+0000 7f273d078740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf44a1f20 con 0x55edf4576070 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46178/0 (socket says 172.21.15.100:46178) 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 -- 172.21.15.100:0/336347457 learned_addr learned my addr 172.21.15.100:0/336347457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 0x7f27180a16b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2734050430 tx=0x7f27340a9000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 -- 172.21.15.100:0/336347457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576070 msgr2=0x55edf4576450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576070 0x55edf4576450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 -- 172.21.15.100:0/336347457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4576990 msgr2=0x55edf45b1200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.883+0000 7f2733e00640 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4576990 0x55edf45b1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.884+0000 7f2733e00640 1 -- 172.21.15.100:0/336347457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf4463df0 con 0x55edf45b1740 2024-02-21T07:49:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.884+0000 7f2733e00640 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27340507e0 tx=0x7f27340c2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732173afe5e03f37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.886+0000 7f2717e00640 1 -- 172.21.15.100:0/336347457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340a7ea0 con 0x55edf45b1740 2024-02-21T07:49:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.886+0000 7f2717e00640 1 -- 172.21.15.100:0/336347457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27340c9450 con 0x55edf45b1740 2024-02-21T07:49:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.887+0000 7f2717e00640 1 -- 172.21.15.100:0/336347457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340c97c0 con 0x55edf45b1740 2024-02-21T07:49:17.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.888+0000 7f273d078740 1 -- 172.21.15.100:0/336347457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 msgr2=0x55edf45b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.888+0000 7f273d078740 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27340507e0 tx=0x7f27340c2000 comp rx=0 tx=0).stop 2024-02-21T07:49:17.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 -- 172.21.15.100:0/336347457 shutdown_connections 2024-02-21T07:49:17.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf45b24d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4576990 0x55edf45b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 --2- 172.21.15.100:0/336347457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576070 0x55edf4576450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 -- 172.21.15.100:0/336347457 >> 172.21.15.100:0/336347457 conn(0x55edf4538640 msgr2=0x55edf45396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 -- 172.21.15.100:0/336347457 shutdown_connections 2024-02-21T07:49:17.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.890+0000 7f273d078740 1 -- 172.21.15.100:0/336347457 wait complete. 2024-02-21T07:49:17.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.895+0000 7f273d078740 1 -- start start 2024-02-21T07:49:17.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.896+0000 7f273d078740 1 Processor -- start 2024-02-21T07:49:17.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.904+0000 7f273d078740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf4563b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf4570650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4447150 con 0x55edf45b1740 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4446df0 con 0x55edf4571210 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf42101c0 con 0x55edf4576990 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.905+0000 7f273d078740 10 client.0 _ll_register_callbacks cb 0x55edf44962b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.906+0000 7f2733400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.907+0000 7f2733400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35768/0 (socket says 172.21.15.100:35768) 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.907+0000 7f2733400640 1 -- 172.21.15.100:0/1703160473 learned_addr learned my addr 172.21.15.100:0/1703160473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.907+0000 7f2732a00640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf4563b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733e00640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf4570650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 -- 172.21.15.100:0/1703160473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 msgr2=0x55edf4570650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf4570650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 -- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 msgr2=0x55edf4563b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf4563b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 -- 172.21.15.100:0/1703160473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340c5070 con 0x55edf4576990 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2732a00640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf4563b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.908+0000 7f2733400640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2724001e40 tx=0x7f2724001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1311c07d98cf542 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f2714c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240058b0 con 0x55edf4576990 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2724005a10 con 0x55edf4576990 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edf41a17e0 con 0x55edf4576990 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2724005bd0 con 0x55edf4576990 2024-02-21T07:49:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f273d078740 10 client.5744 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55edf44a05a0 con 0x55edf4576990 2024-02-21T07:49:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.909+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272401f020 con 0x55edf4576990 2024-02-21T07:49:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.910+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f27240070d0 con 0x55edf4576990 2024-02-21T07:49:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.911+0000 7f273d078740 10 client.5744 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:17.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.911+0000 7f273d078740 10 client.5744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:17.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.911+0000 7f273d078740 20 client.5744 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:17.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.911+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4535ef0 0x55edf455ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.912+0000 7f273d078740 4 client.5744 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:17.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.912+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edf41de720 con 0x55edf4535ef0 2024-02-21T07:49:17.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.913+0000 7f2732a00640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4535ef0 0x55edf455ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.916+0000 7f2732a00640 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4535ef0 0x55edf455ed80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917f6f80c4e79f14 server_cookie=a2a96bfeb73f271b in_seq=0 out_seq=0 2024-02-21T07:49:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.916+0000 7f2714c00640 10 client.5744 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:17.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.917+0000 7f2714c00640 1 -- 172.21.15.100:0/1703160473 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55edf41de720 con 0x55edf4535ef0 2024-02-21T07:49:17.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.917+0000 7f2714c00640 10 client.5744 handle_command_reply: tid=0 2024-02-21T07:49:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.921+0000 7f273d078740 1 client.5744 shutdown 2024-02-21T07:49:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.925+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 msgr2=0x55edf45a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:17.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.925+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2724001e40 tx=0x7f2724001e70 comp rx=0 tx=0).stop 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.927+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 shutdown_connections 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.927+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4535ef0 0x55edf455ed80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.928+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf4570650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.928+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf45b1740 0x55edf4563b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.928+0000 7f273d078740 1 --2- 172.21.15.100:0/1703160473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf4576990 0x55edf45a33c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.928+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 >> 172.21.15.100:0/1703160473 conn(0x55edf4576070 msgr2=0x55edf453a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:17.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.929+0000 7f2714c00640 0 client.5744 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:17.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.929+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 shutdown_connections 2024-02-21T07:49:17.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.929+0000 7f273d078740 1 -- 172.21.15.100:0/1703160473 wait complete. 2024-02-21T07:49:17.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:17.929+0000 7f273d078740 20 client.5744 trim_cache size 0 max 16384 2024-02-21T07:49:18.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.027+0000 7f273d078740 1 Processor -- start 2024-02-21T07:49:18.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.027+0000 7f273d078740 1 -- start start 2024-02-21T07:49:18.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.029+0000 7f273d078740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.029+0000 7f273d078740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf4581440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.029+0000 7f2733400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.029+0000 7f2733400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57296/0 (socket says 172.21.15.100:57296) 2024-02-21T07:49:18.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.030+0000 7f2733400640 1 -- 172.21.15.100:0/1421146569 learned_addr learned my addr 172.21.15.100:0/1421146569 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:18.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.030+0000 7f273d078740 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf45b0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.030+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4563f10 con 0x55edf4576990 2024-02-21T07:49:18.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.030+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf45a3d50 con 0x55edf4571210 2024-02-21T07:49:18.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.031+0000 7f2733e00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf45b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.031+0000 7f2732a00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf4581440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.031+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf457c450 con 0x55edf45b1740 2024-02-21T07:49:18.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2733e00640 1 -- 172.21.15.100:0/1421146569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 msgr2=0x55edf45b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:18.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2733e00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2733e00640 1 -- 172.21.15.100:0/1421146569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 msgr2=0x55edf4581440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:18.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2733e00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf4581440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2733e00640 1 -- 172.21.15.100:0/1421146569 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf443cab0 con 0x55edf45b1740 2024-02-21T07:49:18.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.032+0000 7f2732a00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf4581440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:18.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.033+0000 7f2733e00640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf45b0410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f273402d330 tx=0x7f2734062680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda3c2f15e1b6225 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:18.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.033+0000 7f2733400640 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:18.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.034+0000 7f2717400640 1 -- 172.21.15.100:0/1421146569 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340a7ea0 con 0x55edf45b1740 2024-02-21T07:49:18.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.035+0000 7f2717400640 1 -- 172.21.15.100:0/1421146569 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27340bf2a0 con 0x55edf45b1740 2024-02-21T07:49:18.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.035+0000 7f2717400640 1 -- 172.21.15.100:0/1421146569 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340c97c0 con 0x55edf45b1740 2024-02-21T07:49:18.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.036+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 msgr2=0x55edf45b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:18.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.036+0000 7f273d078740 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf45b0410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f273402d330 tx=0x7f2734062680 comp rx=0 tx=0).stop 2024-02-21T07:49:18.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.037+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 shutdown_connections 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.037+0000 7f273d078740 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf45b0410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.037+0000 7f273d078740 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf4581440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.037+0000 7f273d078740 1 --2- 172.21.15.100:0/1421146569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.037+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 >> 172.21.15.100:0/1421146569 conn(0x55edf4576070 msgr2=0x55edf4530550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.038+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 shutdown_connections 2024-02-21T07:49:18.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.038+0000 7f273d078740 1 -- 172.21.15.100:0/1421146569 wait complete. 2024-02-21T07:49:18.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.040+0000 7f273d078740 1 -- start start 2024-02-21T07:49:18.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.040+0000 7f273d078740 1 Processor -- start 2024-02-21T07:49:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.043+0000 7f273d078740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.043+0000 7f273d078740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf461c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.043+0000 7f2733400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.043+0000 7f2733400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57310/0 (socket says 172.21.15.100:57310) 2024-02-21T07:49:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.044+0000 7f2732a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf461c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.044+0000 7f2733400640 1 -- 172.21.15.100:0/1764224791 learned_addr learned my addr 172.21.15.100:0/1764224791 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:18.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.044+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf455ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.045+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf45a64b0 con 0x55edf4576990 2024-02-21T07:49:18.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.045+0000 7f2733e00640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf455ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.045+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf45a6ba0 con 0x55edf4571210 2024-02-21T07:49:18.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.046+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4537500 con 0x55edf45b1740 2024-02-21T07:49:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.046+0000 7f2733e00640 1 -- 172.21.15.100:0/1764224791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 msgr2=0x55edf45a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.046+0000 7f2733e00640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45a5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.046+0000 7f2733e00640 1 -- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 msgr2=0x55edf461c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.047+0000 7f2733e00640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf461c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.047+0000 7f2733e00640 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c008890 con 0x55edf45b1740 2024-02-21T07:49:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.047+0000 7f2732a00640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf461c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.048+0000 7f2733e00640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf455ad90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f273404f400 tx=0x7f27340a9070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9444eab8200a64d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.048+0000 7f273d078740 10 client.0 _ll_register_callbacks cb 0x7f271c0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.048+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27340c9450 con 0x55edf45b1740 2024-02-21T07:49:18.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.048+0000 7f2714c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:18.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.051+0000 7f2714c00640 1 -- 172.21.15.100:0/1764224791 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340a7ea0 con 0x55edf45b1740 2024-02-21T07:49:18.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.051+0000 7f2714c00640 1 -- 172.21.15.100:0/1764224791 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f27340d4480 con 0x55edf45b1740 2024-02-21T07:49:18.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.052+0000 7f2714c00640 1 -- 172.21.15.100:0/1764224791 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27340d4680 con 0x55edf45b1740 2024-02-21T07:49:18.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.070+0000 7f273d078740 10 client.5750 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:18.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.070+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=16}) v3 -- 0x55edf4463df0 con 0x55edf45b1740 2024-02-21T07:49:18.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.071+0000 7f2714c00640 1 -- 172.21.15.100:0/1764224791 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f27340b9040 con 0x55edf45b1740 2024-02-21T07:49:18.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.073+0000 7f273d078740 10 client.5750 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:18.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.073+0000 7f273d078740 10 client.5750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:18.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.073+0000 7f273d078740 20 client.5750 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:18.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.073+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4563220 0x55edf455b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:18.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.074+0000 7f273d078740 4 client.5750 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:18.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.074+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55edf422d890 con 0x55edf4563220 2024-02-21T07:49:18.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.074+0000 7f2733400640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4563220 0x55edf455b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:18.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.078+0000 7f2714c00640 10 client.5750 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:18.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.078+0000 7f2733400640 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4563220 0x55edf455b2d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1845490278664d5 server_cookie=16e0370058f580c3 in_seq=0 out_seq=0 2024-02-21T07:49:18.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.079+0000 7f2714c00640 1 -- 172.21.15.100:0/1764224791 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55edf422d890 con 0x55edf4563220 2024-02-21T07:49:18.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.079+0000 7f2714c00640 10 client.5750 handle_command_reply: tid=0 2024-02-21T07:49:18.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.079+0000 7f273d078740 1 client.5750 shutdown 2024-02-21T07:49:18.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.079+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 msgr2=0x55edf455ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:18.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.079+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf455ad90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f273404f400 tx=0x7f27340a9070 comp rx=0 tx=0).stop 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 shutdown_connections 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf4563220 0x55edf455b2d0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf45b1740 0x55edf455ad90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf4576990 0x55edf461c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 --2- 172.21.15.100:0/1764224791 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf4571210 0x55edf45a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 >> 172.21.15.100:0/1764224791 conn(0x55edf4576070 msgr2=0x55edf45a9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:18.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f2714c00640 0 client.5750 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:18.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.080+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 shutdown_connections 2024-02-21T07:49:18.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.081+0000 7f273d078740 1 -- 172.21.15.100:0/1764224791 wait complete. 2024-02-21T07:49:18.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.081+0000 7f273d078740 20 client.5750 trim_cache size 0 max 16384 2024-02-21T07:49:18.086 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:18.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.082+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 msgr2=0x7f27180a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.082+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 0x7f27180a16b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2734050430 tx=0x7f27340a9000 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.082+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 msgr2=0x7f272c1a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.082+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f272800b3e0 tx=0x7f272800b8a0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 shutdown_connections 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f272c115c70 0x7f272c1a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f272c1086c0 0x7f272c1a5e30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f271809f1f0 0x7f27180a16b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 --2- 172.21.15.100:0/656876806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f272c058cd0 0x7f272c0fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.083+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 >> 172.21.15.100:0/656876806 conn(0x7f272c057240 msgr2=0x7f272c058390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.084+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 shutdown_connections 2024-02-21T07:49:18.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:18.084+0000 7f273a400640 1 -- 172.21.15.100:0/656876806 wait complete. 2024-02-21T07:49:19.155 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:49:19.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:49:19.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:49:19.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.502+0000 7fb76f600640 1 Processor -- start 2024-02-21T07:49:19.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.502+0000 7fb76f600640 1 -- start start 2024-02-21T07:49:19.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.505+0000 7fb76f600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb768186d90 0x7fb76818f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.506+0000 7fb76f600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 0x7fb768190a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.506+0000 7fb76f600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76818e230 con 0x7fb76818f780 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.506+0000 7fb767e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb76818f780 0x7fb768190330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:58986/0 (socket says 172.21.15.100:58986) 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.506+0000 7fb767e00640 1 -- 172.21.15.100:0/2264585615 learned_addr learned my addr 172.21.15.100:0/2264585615 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb768073100 con 0x7fb76818fc30 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7680f85f0 con 0x7fb768186d90 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76cc00640 1 --2- 172.21.15.100:0/2264585615 >> v2:172.21.15.156:3300/0 conn(0x7fb768186d90 0x7fb76818f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76d600640 1 --2- 172.21.15.100:0/2264585615 >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 0x7fb768190a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76cc00640 1 -- 172.21.15.100:0/2264585615 >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 msgr2=0x7fb768190a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76cc00640 1 --2- 172.21.15.100:0/2264585615 >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 0x7fb768190a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76cc00640 1 -- 172.21.15.100:0/2264585615 >> v1:172.21.15.156:6789/0 conn(0x7fb76818f780 legacy=0x7fb768190330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76cc00640 1 -- 172.21.15.100:0/2264585615 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76818e480 con 0x7fb768186d90 2024-02-21T07:49:19.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.507+0000 7fb76d600640 1 --2- 172.21.15.100:0/2264585615 >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 0x7fb768190a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:19.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.509+0000 7fb76cc00640 1 --2- 172.21.15.100:0/2264585615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb768186d90 0x7fb76818f240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb7680902b0 tx=0x7fb75402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b8f245f76fe227f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.511+0000 7fb767400640 1 -- 172.21.15.100:0/2264585615 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540317c0 con 0x7fb768186d90 2024-02-21T07:49:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.511+0000 7fb767400640 1 -- 172.21.15.100:0/2264585615 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754031920 con 0x7fb768186d90 2024-02-21T07:49:19.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.512+0000 7fb767400640 1 -- 172.21.15.100:0/2264585615 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754031cb0 con 0x7fb768186d90 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.513+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb768186d90 msgr2=0x7fb76818f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.513+0000 7fb76f600640 1 --2- 172.21.15.100:0/2264585615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb768186d90 0x7fb76818f240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb7680902b0 tx=0x7fb75402b860 comp rx=0 tx=0).stop 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.514+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 shutdown_connections 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.514+0000 7fb76f600640 1 --2- 172.21.15.100:0/2264585615 >> v2:172.21.15.100:3300/0 conn(0x7fb76818fc30 0x7fb768190a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.514+0000 7fb76f600640 1 --2- 172.21.15.100:0/2264585615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb768186d90 0x7fb76818f240 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.514+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 >> 172.21.15.100:0/2264585615 conn(0x7fb7680fbec0 msgr2=0x7fb7680fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.516+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 shutdown_connections 2024-02-21T07:49:19.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.516+0000 7fb76f600640 1 -- 172.21.15.100:0/2264585615 wait complete. 2024-02-21T07:49:19.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.519+0000 7fb76f600640 1 Processor -- start 2024-02-21T07:49:19.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.520+0000 7fb76f600640 1 -- start start 2024-02-21T07:49:19.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768186d90 0x7fb768224230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb76818f780 0x7fb7682167d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768216340 con 0x7fb76818fc30 2024-02-21T07:49:19.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768215450 con 0x7fb76818f780 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.524+0000 7fb76f600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768215730 con 0x7fb768186d90 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.525+0000 7fb76d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.525+0000 7fb76d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46226/0 (socket says 172.21.15.100:46226) 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.525+0000 7fb76d600640 1 -- 172.21.15.100:0/1464235871 learned_addr learned my addr 172.21.15.100:0/1464235871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.525+0000 7fb767e00640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb76818f780 0x7fb7682167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.526+0000 7fb76d600640 1 -- 172.21.15.100:0/1464235871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768186d90 msgr2=0x7fb768224230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.526+0000 7fb76d600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768186d90 0x7fb768224230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.526+0000 7fb76d600640 1 -- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb76818f780 msgr2=0x7fb7682167d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.526+0000 7fb76d600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb76818f780 0x7fb7682167d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.526+0000 7fb76d600640 1 -- 172.21.15.100:0/1464235871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009400 con 0x7fb76818fc30 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.527+0000 7fb76d600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb76000cea0 tx=0x7fb76000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.528+0000 7fb764c00640 1 -- 172.21.15.100:0/1464235871 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760003b90 con 0x7fb76818fc30 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.528+0000 7fb764c00640 1 -- 172.21.15.100:0/1464235871 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760003d10 con 0x7fb76818fc30 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.528+0000 7fb764c00640 1 -- 172.21.15.100:0/1464235871 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760004260 con 0x7fb76818fc30 2024-02-21T07:49:19.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.528+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb768215a10 con 0x7fb76818fc30 2024-02-21T07:49:19.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.530+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb768215fd0 con 0x7fb76818fc30 2024-02-21T07:49:19.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.535+0000 7fb764c00640 1 -- 172.21.15.100:0/1464235871 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb7600043c0 con 0x7fb76818fc30 2024-02-21T07:49:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.544+0000 7fb764c00640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 0x7fb7480a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.544+0000 7fb764c00640 1 -- 172.21.15.100:0/1464235871 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb7600cc220 con 0x7fb76818fc30 2024-02-21T07:49:19.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.544+0000 7fb76cc00640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 0x7fb7480a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.545+0000 7fb772418740 1 Processor -- start 2024-02-21T07:49:19.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.546+0000 7fb76cc00640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 0x7fb7480a1630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb754036000 tx=0x7fb754008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.546+0000 7fb772418740 1 -- start start 2024-02-21T07:49:19.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.552+0000 7fb772418740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 0x563e674cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.554+0000 7fb772418740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6750a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.555+0000 7fb772418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e6750b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.557+0000 7fb772418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e6744f300 con 0x563e6750a890 2024-02-21T07:49:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.557+0000 7fb772418740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67401e50 con 0x563e674cfae0 2024-02-21T07:49:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.553+0000 7fb76cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 0x563e674cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.557+0000 7fb76cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 0x563e674cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35814/0 (socket says 172.21.15.100:35814) 2024-02-21T07:49:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.557+0000 7fb76cc00640 1 -- 172.21.15.100:0/1451338213 learned_addr learned my addr 172.21.15.100:0/1451338213 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.558+0000 7fb767e00640 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6750a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.558+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e673ff380 con 0x563e674cf1c0 2024-02-21T07:49:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.558+0000 7fb76d600640 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e6750b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.559+0000 7fb767e00640 1 -- 172.21.15.100:0/1451338213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 msgr2=0x563e674cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.559+0000 7fb767e00640 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 0x563e674cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.559+0000 7fb767e00640 1 -- 172.21.15.100:0/1451338213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 msgr2=0x563e6750b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.559+0000 7fb767e00640 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e6750b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.559+0000 7fb767e00640 1 -- 172.21.15.100:0/1451338213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e673c3c80 con 0x563e674cfae0 2024-02-21T07:49:19.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.561+0000 7fb767e00640 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6750a350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb75c007fd0 tx=0x7fb75c007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a36d21a2177118 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.561+0000 7fb759200640 1 -- 172.21.15.100:0/1451338213 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c004e90 con 0x563e674cfae0 2024-02-21T07:49:19.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.561+0000 7fb759200640 1 -- 172.21.15.100:0/1451338213 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c007770 con 0x563e674cfae0 2024-02-21T07:49:19.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.561+0000 7fb759200640 1 -- 172.21.15.100:0/1451338213 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0019b0 con 0x563e674cfae0 2024-02-21T07:49:19.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.566+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 msgr2=0x563e6750a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.566+0000 7fb772418740 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6750a350 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb75c007fd0 tx=0x7fb75c007430 comp rx=0 tx=0).stop 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 shutdown_connections 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e6750b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6750a350 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 --2- 172.21.15.100:0/1451338213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674cf1c0 0x563e674cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 >> 172.21.15.100:0/1451338213 conn(0x563e67491790 msgr2=0x563e67492810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 shutdown_connections 2024-02-21T07:49:19.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.569+0000 7fb772418740 1 -- 172.21.15.100:0/1451338213 wait complete. 2024-02-21T07:49:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.571+0000 7fb772418740 1 -- start start 2024-02-21T07:49:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.571+0000 7fb772418740 1 Processor -- start 2024-02-21T07:49:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e67516f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e673fab60 con 0x563e6750a890 2024-02-21T07:49:19.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e6739ffd0 con 0x563e674cfae0 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e6739fc70 con 0x563e674ccd20 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.573+0000 7fb772418740 10 client.0 _ll_register_callbacks cb 0x563e6710bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35816/0 (socket says 172.21.15.100:35816) 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 -- 172.21.15.100:0/627545059 learned_addr learned my addr 172.21.15.100:0/627545059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76cc00640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e67516f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb767e00640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 -- 172.21.15.100:0/627545059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 msgr2=0x563e67516f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e67516f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 -- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 msgr2=0x563e674b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76d600640 1 -- 172.21.15.100:0/627545059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76818e230 con 0x563e674ccd20 2024-02-21T07:49:19.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.574+0000 7fb76cc00640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e67516f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.576+0000 7fb76d600640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb76000ce70 tx=0x7fb760098450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bb885140fa32a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.576+0000 7fb74d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.576+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600a0460 con 0x563e674ccd20 2024-02-21T07:49:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.576+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb760096050 con 0x563e674ccd20 2024-02-21T07:49:19.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.576+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e6714b410 con 0x563e674ccd20 2024-02-21T07:49:19.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.577+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7600b5280 con 0x563e674ccd20 2024-02-21T07:49:19.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.578+0000 7fb772418740 10 client.5756 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:19.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.578+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563e673f91e0 con 0x563e674ccd20 2024-02-21T07:49:19.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.578+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563e6714b410 con 0x563e674ccd20 2024-02-21T07:49:19.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.581+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb760008040 con 0x563e674ccd20 2024-02-21T07:49:19.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 10 client.5756 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:19.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 10 client.5756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:19.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 20 client.5756 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:19.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674cd240 0x563e6748e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 4 client.5756 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:19.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.582+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e671377b0 con 0x563e674cd240 2024-02-21T07:49:19.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.583+0000 7fb76cc00640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674cd240 0x563e6748e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.583+0000 7fb76cc00640 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674cd240 0x563e6748e070 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be0ebb67fa2b3434 server_cookie=8c0348882712ea79 in_seq=0 out_seq=0 2024-02-21T07:49:19.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.583+0000 7fb74d600640 10 client.5756 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:19.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.584+0000 7fb74d600640 1 -- 172.21.15.100:0/627545059 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563e671377b0 con 0x563e674cd240 2024-02-21T07:49:19.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.584+0000 7fb74d600640 10 client.5756 handle_command_reply: tid=0 2024-02-21T07:49:19.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 client.5756 shutdown 2024-02-21T07:49:19.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 msgr2=0x563e674b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb76000ce70 tx=0x7fb760098450 comp rx=0 tx=0).stop 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 shutdown_connections 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674cd240 0x563e6748e070 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674b9880 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 --2- 172.21.15.100:0/627545059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e67516f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 >> 172.21.15.100:0/627545059 conn(0x563e674cf1c0 msgr2=0x563e67493200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.585+0000 7fb74d600640 0 client.5756 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.586+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 shutdown_connections 2024-02-21T07:49:19.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.586+0000 7fb772418740 1 -- 172.21.15.100:0/627545059 wait complete. 2024-02-21T07:49:19.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.586+0000 7fb772418740 20 client.5756 trim_cache size 0 max 16384 2024-02-21T07:49:19.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.635+0000 7fb772418740 1 Processor -- start 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.635+0000 7fb772418740 1 -- start start 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e67490dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6748f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e671430c0 con 0x563e6750a890 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e67507e80 con 0x563e674cfae0 2024-02-21T07:49:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.637+0000 7fb772418740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e674c3770 con 0x563e674ccd20 2024-02-21T07:49:19.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.640+0000 7fb76d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.640+0000 7fb76d600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46258/0 (socket says 172.21.15.100:46258) 2024-02-21T07:49:19.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.640+0000 7fb76d600640 1 -- 172.21.15.100:0/4265730372 learned_addr learned my addr 172.21.15.100:0/4265730372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.640+0000 7fb767e00640 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6748f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 -- 172.21.15.100:0/4265730372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 msgr2=0x563e67490dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e67490dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 -- 172.21.15.100:0/4265730372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 msgr2=0x563e6748f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6748f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 -- 172.21.15.100:0/4265730372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e67395a90 con 0x563e6750a890 2024-02-21T07:49:19.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.641+0000 7fb76d600640 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7600941b0 tx=0x7fb76009e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194332a430572c9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.645+0000 7fb74fe00640 1 -- 172.21.15.100:0/4265730372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600a0460 con 0x563e6750a890 2024-02-21T07:49:19.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.646+0000 7fb74fe00640 1 -- 172.21.15.100:0/4265730372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760097890 con 0x563e6750a890 2024-02-21T07:49:19.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.646+0000 7fb74fe00640 1 -- 172.21.15.100:0/4265730372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760004870 con 0x563e6750a890 2024-02-21T07:49:19.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 -- 172.21.15.100:0/4265730372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 msgr2=0x563e674b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb7600941b0 tx=0x7fb76009e050 comp rx=0 tx=0).stop 2024-02-21T07:49:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 -- 172.21.15.100:0/4265730372 shutdown_connections 2024-02-21T07:49:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e6750a890 0x563e674b9280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e674cfae0 0x563e6748f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.647+0000 7fb772418740 1 --2- 172.21.15.100:0/4265730372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e67490dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.648+0000 7fb772418740 1 -- 172.21.15.100:0/4265730372 >> 172.21.15.100:0/4265730372 conn(0x563e674cf1c0 msgr2=0x563e674cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.650+0000 7fb772418740 1 -- 172.21.15.100:0/4265730372 shutdown_connections 2024-02-21T07:49:19.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.650+0000 7fb772418740 1 -- 172.21.15.100:0/4265730372 wait complete. 2024-02-21T07:49:19.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.652+0000 7fb772418740 1 -- start start 2024-02-21T07:49:19.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.653+0000 7fb772418740 1 Processor -- start 2024-02-21T07:49:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e674cfae0 0x563e674d4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e6750a890 0x563e6755e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e6749a750 con 0x563e674cfae0 2024-02-21T07:49:19.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e674d4760 con 0x563e6750a890 2024-02-21T07:49:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e674b9160 con 0x563e674ccd20 2024-02-21T07:49:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb772418740 10 client.0 _ll_register_callbacks cb 0x7fb75c0048e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb76cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb76cc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:35834/0 (socket says 172.21.15.100:35834) 2024-02-21T07:49:19.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.655+0000 7fb76cc00640 1 -- 172.21.15.100:0/139447028 learned_addr learned my addr 172.21.15.100:0/139447028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 -- 172.21.15.100:0/139447028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e6750a890 msgr2=0x563e6755e460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e6750a890 0x563e6755e460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 -- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e674cfae0 msgr2=0x563e674d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e674cfae0 0x563e674d4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 -- 172.21.15.100:0/139447028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e673f91e0 con 0x563e674ccd20 2024-02-21T07:49:19.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.656+0000 7fb76cc00640 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb754034040 tx=0x7fb754004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2541cae96fdacd83 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.657+0000 7fb74d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:19.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.657+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75404d040 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.657+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb754004490 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.657+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e670fa860 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.658+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb754052630 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.658+0000 7fb772418740 10 client.5759 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.658+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563e673bb6a0 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.658+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75405f020 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb754052790 con 0x563e674ccd20 2024-02-21T07:49:19.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 10 client.5759 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:19.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 10 client.5759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:19.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 20 client.5759 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:19.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674c8d30 0x563e674b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:19.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 4 client.5759 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:49:19.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.659+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563e670a6990 con 0x563e674c8d30 2024-02-21T07:49:19.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.660+0000 7fb767e00640 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674c8d30 0x563e674b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:19.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.665+0000 7fb767e00640 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674c8d30 0x563e674b5820 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=627b13ddf2bfc3c9 server_cookie=2dd22fdccd409f2f in_seq=0 out_seq=0 2024-02-21T07:49:19.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.666+0000 7fb74d600640 10 client.5759 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:19.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.682+0000 7fb74d600640 1 -- 172.21.15.100:0/139447028 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563e670a6990 con 0x563e674c8d30 2024-02-21T07:49:19.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.684+0000 7fb74d600640 10 client.5759 handle_command_reply: tid=0 2024-02-21T07:49:19.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.685+0000 7fb772418740 1 client.5759 shutdown 2024-02-21T07:49:19.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.688+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 msgr2=0x563e674c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.688+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb754034040 tx=0x7fb754004730 comp rx=0 tx=0).stop 2024-02-21T07:49:19.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 shutdown_connections 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563e674c8d30 0x563e674b5820 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e6750a890 0x563e6755e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563e674cfae0 0x563e674d4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 --2- 172.21.15.100:0/139447028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563e674ccd20 0x563e674c4900 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.689+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 >> 172.21.15.100:0/139447028 conn(0x563e674cf1c0 msgr2=0x563e67508300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.690+0000 7fb74d600640 0 client.5759 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:19.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.690+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 shutdown_connections 2024-02-21T07:49:19.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.690+0000 7fb772418740 1 -- 172.21.15.100:0/139447028 wait complete. 2024-02-21T07:49:19.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.702+0000 7fb772418740 20 client.5759 trim_cache size 0 max 16384 2024-02-21T07:49:19.712 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:49:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "6e0ee33e-473e-44de-98fe-af7a1b508e61", 2024-02-21T07:49:19.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:49:19.713 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.709+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 msgr2=0x7fb7480a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.709+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 0x7fb7480a1630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb754036000 tx=0x7fb754008030 comp rx=0 tx=0).stop 2024-02-21T07:49:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.709+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 msgr2=0x7fb768178990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:19.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.709+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb76000cea0 tx=0x7fb76000cf90 comp rx=0 tx=0).stop 2024-02-21T07:49:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 shutdown_connections 2024-02-21T07:49:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb74809f170 0x7fb7480a1630 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb76818fc30 0x7fb768178990 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb76818f780 0x7fb7682167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 --2- 172.21.15.100:0/1464235871 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb768186d90 0x7fb768224230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:19.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.711+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 >> 172.21.15.100:0/1464235871 conn(0x7fb7680fbec0 msgr2=0x7fb7680fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:19.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.712+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 shutdown_connections 2024-02-21T07:49:19.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:19.712+0000 7fb76f600640 1 -- 172.21.15.100:0/1464235871 wait complete. 2024-02-21T07:49:19.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:49:19.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:49:20.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.196+0000 7fd3a6000640 1 Processor -- start 2024-02-21T07:49:20.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.196+0000 7fd3a6000640 1 -- start start 2024-02-21T07:49:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd3a6000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3a00f7c30 0x7fd3a00f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd3a6000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a0182eb0 con 0x7fd3a0183660 2024-02-21T07:49:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd3a6000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00f8720 con 0x7fd3a0182ad0 2024-02-21T07:49:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd3a6000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00f8a00 con 0x7fd3a00f7c30 2024-02-21T07:49:20.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd39ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd3a00f7c30 0x7fd3a00f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd39fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd3a0183660 0x7fd3a0183af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38310/0 (socket says 172.21.15.100:38310) 2024-02-21T07:49:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.198+0000 7fd39fe00640 1 -- 172.21.15.100:0/2955111372 learned_addr learned my addr 172.21.15.100:0/2955111372 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.199+0000 7fd39ea00640 1 -- 172.21.15.100:0/2955111372 >> v1:172.21.15.170:6789/0 conn(0x7fd3a0182ad0 legacy=0x7fd3a006e650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:20.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.199+0000 7fd39ea00640 1 -- 172.21.15.100:0/2955111372 >> v1:172.21.15.100:6789/0 conn(0x7fd3a0183660 legacy=0x7fd3a0183af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.199+0000 7fd39ea00640 1 -- 172.21.15.100:0/2955111372 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00f8ce0 con 0x7fd3a00f7c30 2024-02-21T07:49:20.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.202+0000 7fd39ea00640 1 --2- 172.21.15.100:0/2955111372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a00f7c30 0x7fd3a00f8090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00ba40 tx=0x7fd38c02df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b136b252398f44 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.202+0000 7fd39e000640 1 -- 172.21.15.100:0/2955111372 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c02ed30 con 0x7fd3a00f7c30 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.202+0000 7fd39e000640 1 -- 172.21.15.100:0/2955111372 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c02ee90 con 0x7fd3a00f7c30 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.202+0000 7fd39e000640 1 -- 172.21.15.100:0/2955111372 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c036660 con 0x7fd3a00f7c30 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.203+0000 7fd3a6000640 1 -- 172.21.15.100:0/2955111372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a00f7c30 msgr2=0x7fd3a00f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.203+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2955111372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a00f7c30 0x7fd3a00f8090 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00ba40 tx=0x7fd38c02df80 comp rx=0 tx=0).stop 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.203+0000 7fd3a6000640 1 -- 172.21.15.100:0/2955111372 shutdown_connections 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.203+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2955111372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a00f7c30 0x7fd3a00f8090 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.203+0000 7fd3a6000640 1 -- 172.21.15.100:0/2955111372 >> 172.21.15.100:0/2955111372 conn(0x7fd3a00ce200 msgr2=0x7fd3a00ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.204+0000 7fd3a6000640 1 -- 172.21.15.100:0/2955111372 shutdown_connections 2024-02-21T07:49:20.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.204+0000 7fd3a6000640 1 -- 172.21.15.100:0/2955111372 wait complete. 2024-02-21T07:49:20.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.206+0000 7fd3a6000640 1 Processor -- start 2024-02-21T07:49:20.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.206+0000 7fd3a6000640 1 -- start start 2024-02-21T07:49:20.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3a00f7c30 0x7fd3a0162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a0183660 0x7fd3a0181040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a016ef40 con 0x7fd3a00f7c30 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a016dfe0 con 0x7fd3a0182ad0 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.207+0000 7fd3a6000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a016e2c0 con 0x7fd3a0183660 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a0183660 0x7fd3a0181040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38044/0 (socket says 172.21.15.100:38044) 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 -- 172.21.15.100:0/2208014476 learned_addr learned my addr 172.21.15.100:0/2208014476 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:20.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39f400640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3a00f7c30 0x7fd3a0162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 -- 172.21.15.100:0/2208014476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a0183660 msgr2=0x7fd3a0181040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a0183660 0x7fd3a0181040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 -- 172.21.15.100:0/2208014476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3a00f7c30 msgr2=0x7fd3a0162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3a00f7c30 0x7fd3a0162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.208+0000 7fd39ea00640 1 -- 172.21.15.100:0/2208014476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c00b6a0 con 0x7fd3a0182ad0 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.209+0000 7fd39ea00640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00bb60 tx=0x7fd38c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.209+0000 7fd397400640 1 -- 172.21.15.100:0/2208014476 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c040810 con 0x7fd3a0182ad0 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.209+0000 7fd397400640 1 -- 172.21.15.100:0/2208014476 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c040990 con 0x7fd3a0182ad0 2024-02-21T07:49:20.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.209+0000 7fd397400640 1 -- 172.21.15.100:0/2208014476 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c040d40 con 0x7fd3a0182ad0 2024-02-21T07:49:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.209+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a016e5a0 con 0x7fd3a0182ad0 2024-02-21T07:49:20.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.210+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a016eb60 con 0x7fd3a0182ad0 2024-02-21T07:49:20.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.212+0000 7fd397400640 1 -- 172.21.15.100:0/2208014476 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd38c03f3a0 con 0x7fd3a0182ad0 2024-02-21T07:49:20.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.214+0000 7fd397400640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 0x7fd3800a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.214+0000 7fd397400640 1 -- 172.21.15.100:0/2208014476 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd38c0ec4b0 con 0x7fd3a0182ad0 2024-02-21T07:49:20.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.216+0000 7fd3a8c17740 1 Processor -- start 2024-02-21T07:49:20.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.217+0000 7fd3a8c17740 1 -- start start 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.218+0000 7fd39f400640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 0x7fd3800a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352c6f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52496/0 (socket says 172.21.15.100:52496) 2024-02-21T07:49:20.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd39f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd39f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45494/0 (socket says 172.21.15.100:45494) 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd39ea00640 1 -- 172.21.15.100:0/960762198 learned_addr learned my addr 172.21.15.100:0/960762198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352be3150 con 0x55a352cac1a0 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352be0680 con 0x55a352cacac0 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39fe00640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352c6f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.219+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352bdbe60 con 0x55a352ce2160 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 -- 172.21.15.100:0/960762198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 msgr2=0x55a352c6f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352c6f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 -- 172.21.15.100:0/960762198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 msgr2=0x55a352ce1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 -- 172.21.15.100:0/960762198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a352b95060 con 0x55a352ce2160 2024-02-21T07:49:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39ea00640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006e80 tx=0x7fd38c02e550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5e7577856a56ea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39f400640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.220+0000 7fd39fe00640 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352c6f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.221+0000 7fd39f400640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 0x7fd3800a1560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390009480 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.221+0000 7fd38b400640 1 -- 172.21.15.100:0/960762198 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0be120 con 0x55a352ce2160 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.221+0000 7fd38b400640 1 -- 172.21.15.100:0/960762198 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0c2770 con 0x55a352ce2160 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.221+0000 7fd38b400640 1 -- 172.21.15.100:0/960762198 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0b66f0 con 0x55a352ce2160 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.222+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 msgr2=0x55a352cac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.222+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd38c006e80 tx=0x7fd38c02e550 comp rx=0 tx=0).stop 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.223+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 shutdown_connections 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.223+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352c6f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.223+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352cac580 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.223+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/960762198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cac1a0 0x55a352ce1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.223+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 >> 172.21.15.100:0/960762198 conn(0x55a352c3b5a0 msgr2=0x55a352c73090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.224+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 shutdown_connections 2024-02-21T07:49:20.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.224+0000 7fd3a8c17740 1 -- 172.21.15.100:0/960762198 wait complete. 2024-02-21T07:49:20.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.225+0000 7fd3a8c17740 1 -- start start 2024-02-21T07:49:20.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.226+0000 7fd3a8c17740 1 Processor -- start 2024-02-21T07:49:20.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.228+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352cf7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd39f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352ce5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352b80ec0 con 0x55a352cacac0 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352b80b60 con 0x55a352cac1a0 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a35294a1c0 con 0x55a352ce2160 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd39f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38066/0 (socket says 172.21.15.100:38066) 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd39f400640 1 -- 172.21.15.100:0/241655159 learned_addr learned my addr 172.21.15.100:0/241655159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:20.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.229+0000 7fd39fe00640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352ce5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 -- 172.21.15.100:0/241655159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 msgr2=0x55a352ce5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352ce5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 -- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 msgr2=0x55a352cf7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352cf7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 -- 172.21.15.100:0/241655159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a016eb60 con 0x55a352cac1a0 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd3a8c17740 10 client.0 _ll_register_callbacks cb 0x55a352b94960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3528db7e0 con 0x55a352cac1a0 2024-02-21T07:49:20.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.230+0000 7fd39f400640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd390015690 tx=0x7fd390004640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7679f8c92992c885 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.231+0000 7fd37fe00640 10 client.5830 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:20.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.231+0000 7fd37fe00640 1 -- 172.21.15.100:0/241655159 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390016a90 con 0x55a352cac1a0 2024-02-21T07:49:20.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.235+0000 7fd37fe00640 1 -- 172.21.15.100:0/241655159 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd39001b040 con 0x55a352cac1a0 2024-02-21T07:49:20.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.235+0000 7fd37fe00640 1 -- 172.21.15.100:0/241655159 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd390016bf0 con 0x55a352cac1a0 2024-02-21T07:49:20.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.236+0000 7fd3a8c17740 10 client.5830 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:20.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.236+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=16}) v3 -- 0x55a352bda4e0 con 0x55a352cac1a0 2024-02-21T07:49:20.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd37fe00640 1 -- 172.21.15.100:0/241655159 <== mon.1 v2:172.21.15.156:3300/0 4 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd3900203f0 con 0x55a352cac1a0 2024-02-21T07:49:20.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 10 client.5830 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:20.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 10 client.5830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:20.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 20 client.5830 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:20.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352cd8e70 0x55a352ce4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 4 client.5830 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:20.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.237+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a352918720 con 0x55a352cd8e70 2024-02-21T07:49:20.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.240+0000 7fd39ea00640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352cd8e70 0x55a352ce4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.240+0000 7fd39ea00640 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352cd8e70 0x55a352ce4680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d84f642da739edab server_cookie=e9a51f6e08d42198 in_seq=0 out_seq=0 2024-02-21T07:49:20.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.241+0000 7fd37fe00640 10 client.5830 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:20.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.242+0000 7fd37fe00640 1 -- 172.21.15.100:0/241655159 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a352918720 con 0x55a352cd8e70 2024-02-21T07:49:20.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.242+0000 7fd37fe00640 10 client.5830 handle_command_reply: tid=0 2024-02-21T07:49:20.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.243+0000 7fd3a8c17740 1 client.5830 shutdown 2024-02-21T07:49:20.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.246+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 msgr2=0x55a352ca3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.246+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd390015690 tx=0x7fd390004640 comp rx=0 tx=0).stop 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 shutdown_connections 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352cd8e70 0x55a352ce4680 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd37fe00640 0 client.5830 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ce2160 0x55a352ce5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352cf7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/241655159 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cac1a0 0x55a352ca3db0 secure :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd390015690 tx=0x7fd390004640 comp rx=0 tx=0).stop 2024-02-21T07:49:20.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.248+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 >> 172.21.15.100:0/241655159 conn(0x55a352c3b5a0 msgr2=0x55a352c70d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.251+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 shutdown_connections 2024-02-21T07:49:20.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.252+0000 7fd3a8c17740 1 -- 172.21.15.100:0/241655159 wait complete. 2024-02-21T07:49:20.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.252+0000 7fd3a8c17740 20 client.5830 trim_cache size 0 max 16384 2024-02-21T07:49:20.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.325+0000 7fd3a8c17740 1 Processor -- start 2024-02-21T07:49:20.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.325+0000 7fd3a8c17740 1 -- start start 2024-02-21T07:49:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 0x55a352d42ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352cab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352c70e90 con 0x55a352ce2160 2024-02-21T07:49:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352c72490 con 0x55a352cacac0 2024-02-21T07:49:20.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352cb5700 con 0x55a352ca26e0 2024-02-21T07:49:20.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd39f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd39f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38076/0 (socket says 172.21.15.100:38076) 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 0x55a352d42ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.329+0000 7fd39f400640 1 -- 172.21.15.100:0/1498540879 learned_addr learned my addr 172.21.15.100:0/1498540879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39fe00640 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352cab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39f400640 1 -- 172.21.15.100:0/1498540879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 msgr2=0x55a352cab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39f400640 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352cab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39f400640 1 -- 172.21.15.100:0/1498540879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 msgr2=0x55a352d42ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39f400640 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 0x55a352d42ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.330+0000 7fd39f400640 1 -- 172.21.15.100:0/1498540879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a352b76950 con 0x55a352cacac0 2024-02-21T07:49:20.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.331+0000 7fd39ea00640 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 0x55a352d42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:20.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.331+0000 7fd39f400640 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd390009130 tx=0x7fd39001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0003ae4fe37fd83 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.332+0000 7fd38aa00640 1 -- 172.21.15.100:0/1498540879 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900092b0 con 0x55a352cacac0 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.332+0000 7fd38aa00640 1 -- 172.21.15.100:0/1498540879 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a3528db7e0 con 0x55a352cacac0 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.332+0000 7fd38aa00640 1 -- 172.21.15.100:0/1498540879 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900203f0 con 0x55a352cacac0 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.333+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1498540879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 msgr2=0x55a352cf7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.333+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd390009130 tx=0x7fd39001f000 comp rx=0 tx=0).stop 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.334+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1498540879 shutdown_connections 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.334+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352cab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.334+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352ce2160 0x55a352d42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.334+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1498540879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352cacac0 0x55a352cf7630 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.334+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1498540879 >> 172.21.15.100:0/1498540879 conn(0x55a352c3b5a0 msgr2=0x55a352c69f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.335+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1498540879 shutdown_connections 2024-02-21T07:49:20.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.336+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1498540879 wait complete. 2024-02-21T07:49:20.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.340+0000 7fd3a8c17740 1 -- start start 2024-02-21T07:49:20.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.341+0000 7fd3a8c17740 1 Processor -- start 2024-02-21T07:49:20.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.343+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.343+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.343+0000 7fd3a8c17740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352ce2160 0x55a352d526c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.344+0000 7fd39f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.344+0000 7fd39f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52528/0 (socket says 172.21.15.100:52528) 2024-02-21T07:49:20.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352d530d0 con 0x55a352cacac0 2024-02-21T07:49:20.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd3a8c17740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352ca1d70 con 0x55a352ce2160 2024-02-21T07:49:20.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45512/0 (socket says 172.21.15.100:45512) 2024-02-21T07:49:20.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd39ea00640 1 -- 172.21.15.100:0/1978254844 learned_addr learned my addr 172.21.15.100:0/1978254844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:20.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.348+0000 7fd39fe00640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352ce2160 0x55a352d526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.349+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a352d52c00 con 0x55a352ca26e0 2024-02-21T07:49:20.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.349+0000 7fd3a8c17740 10 client.0 _ll_register_callbacks cb 0x55a352ca4950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:20.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.350+0000 7fd39ea00640 1 -- 172.21.15.100:0/1978254844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 msgr2=0x55a352d42ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.350+0000 7fd39ea00640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.350+0000 7fd39ea00640 1 -- 172.21.15.100:0/1978254844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352ce2160 msgr2=0x55a352d526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:20.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.350+0000 7fd39ea00640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352ce2160 0x55a352d526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.350+0000 7fd39ea00640 1 -- 172.21.15.100:0/1978254844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a352b95060 con 0x55a352cacac0 2024-02-21T07:49:20.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.351+0000 7fd39f400640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:20.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.353+0000 7fd39ea00640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0ba010 tx=0x7fd38c008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bc69e390a767e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:20.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.353+0000 7fd37fe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:20.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.354+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c040ea0 con 0x55a352cacac0 2024-02-21T07:49:20.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.354+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd38c0b8380 con 0x55a352cacac0 2024-02-21T07:49:20.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.355+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd38c0c2770 con 0x55a352cacac0 2024-02-21T07:49:20.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.355+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd38c040ea0 con 0x55a352cacac0 2024-02-21T07:49:20.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.355+0000 7fd3a8c17740 10 client.5673 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:20.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.355+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a352bda4e0 con 0x55a352cacac0 2024-02-21T07:49:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.356+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0a0080 con 0x55a352cacac0 2024-02-21T07:49:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.358+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd38c0b66f0 con 0x55a352cacac0 2024-02-21T07:49:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.358+0000 7fd3a8c17740 10 client.5673 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.358+0000 7fd3a8c17740 10 client.5673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.358+0000 7fd3a8c17740 20 client.5673 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.358+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352c6fd20 0x55a352cd21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.359+0000 7fd3a8c17740 4 client.5673 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:49:20.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.360+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a352967890 con 0x55a352c6fd20 2024-02-21T07:49:20.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.362+0000 7fd39f400640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352c6fd20 0x55a352cd21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:20.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.366+0000 7fd39f400640 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352c6fd20 0x55a352cd21c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae659f4c69e6f1b1 server_cookie=9eeb8205f39f164a in_seq=0 out_seq=0 2024-02-21T07:49:20.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.367+0000 7fd37fe00640 10 client.5673 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:20.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.370+0000 7fd37fe00640 1 -- 172.21.15.100:0/1978254844 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a352967890 con 0x55a352c6fd20 2024-02-21T07:49:20.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.370+0000 7fd37fe00640 10 client.5673 handle_command_reply: tid=0 2024-02-21T07:49:20.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.370+0000 7fd3a8c17740 1 client.5673 shutdown 2024-02-21T07:49:20.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.377+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 msgr2=0x55a352ce3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.377+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0ba010 tx=0x7fd38c008070 comp rx=0 tx=0).stop 2024-02-21T07:49:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 shutdown_connections 2024-02-21T07:49:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a352c6fd20 0x55a352cd21c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a352ce2160 0x55a352d526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a352cacac0 0x55a352ce3b70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 --2- 172.21.15.100:0/1978254844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a352ca26e0 0x55a352d42ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.378+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 >> 172.21.15.100:0/1978254844 conn(0x55a352c3b5a0 msgr2=0x55a352cdd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.379+0000 7fd37fe00640 0 client.5673 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.381+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 shutdown_connections 2024-02-21T07:49:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.381+0000 7fd3a8c17740 1 -- 172.21.15.100:0/1978254844 wait complete. 2024-02-21T07:49:20.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.382+0000 7fd3a8c17740 20 client.5673 trim_cache size 0 max 16384 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "6e0ee33e-473e-44de-98fe-af7a1b508e61": { 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "6e0ee33e-473e-44de-98fe-af7a1b508e61", 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:49:20.387 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.385+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 msgr2=0x7fd3800a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.385+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 0x7fd3800a1560 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd390006fd0 tx=0x7fd390009480 comp rx=0 tx=0).stop 2024-02-21T07:49:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.385+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 msgr2=0x7fd3a0180b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.385+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd38c00bb60 tx=0x7fd38c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 shutdown_connections 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3a0183660 0x7fd3a0181040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3a0182ad0 0x7fd3a0180b00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd38009f0a0 0x7fd3800a1560 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 --2- 172.21.15.100:0/2208014476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3a00f7c30 0x7fd3a0162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.386+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 >> 172.21.15.100:0/2208014476 conn(0x7fd3a00ce200 msgr2=0x7fd3a00ca140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.387+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 shutdown_connections 2024-02-21T07:49:20.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:20.387+0000 7fd3a6000640 1 -- 172.21.15.100:0/2208014476 wait complete. 2024-02-21T07:49:20.437 INFO:tasks.cephfs.filesystem:scrub status for tag:6e0ee33e-473e-44de-98fe-af7a1b508e61 - {'path': '/', 'tag': '6e0ee33e-473e-44de-98fe-af7a1b508e61', 'options': 'recursive,force'} 2024-02-21T07:49:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.043+0000 7f0a79800640 1 Processor -- start 2024-02-21T07:49:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.049+0000 7f0a79800640 1 -- start start 2024-02-21T07:49:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.052+0000 7f0a79800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cc0e0 con 0x7f0a740f61d0 2024-02-21T07:49:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.052+0000 7f0a79800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cc380 con 0x7f0a7418a590 2024-02-21T07:49:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.052+0000 7f0a79800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a740cc660 con 0x7f0a740f5670 2024-02-21T07:49:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.053+0000 7f0a72000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0a740f61d0 0x7f0a741901a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38320/0 (socket says 172.21.15.100:38320) 2024-02-21T07:49:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.053+0000 7f0a72000640 1 -- 172.21.15.100:0/4060654214 learned_addr learned my addr 172.21.15.100:0/4060654214 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.053+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392274929 0 0) 0x7f0a740cc660 con 0x7f0a740f5670 2024-02-21T07:49:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.053+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a58003520 con 0x7f0a740f5670 2024-02-21T07:49:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.053+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140504198 0 0) 0x7f0a740cc380 con 0x7f0a7418a590 2024-02-21T07:49:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a740cc660 con 0x7f0a7418a590 2024-02-21T07:49:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 650511140 0 0) 0x7f0a58003520 con 0x7f0a740f5670 2024-02-21T07:49:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 >> v1:172.21.15.156:6789/0 conn(0x7f0a7418a590 legacy=0x7f0a740cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 >> v1:172.21.15.100:6789/0 conn(0x7f0a740f61d0 legacy=0x7f0a741901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740cc940 con 0x7f0a740f5670 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f0a64001670 con 0x7f0a740f5670 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 >> v1:172.21.15.170:6789/0 conn(0x7f0a740f5670 legacy=0x7f0a741908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a58003ba0 0x7f0a58003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58009970 0x7f0a5800bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5800c350 con 0x7f0a58009970 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5800c4c0 con 0x7f0a58003ba0 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.054+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5800c680 con 0x7f0a580047c0 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.055+0000 7f0a72a00640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a58003ba0 0x7f0a58003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.055+0000 7f0a72000640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.056+0000 7f0a73400640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58009970 0x7f0a5800bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.057+0000 7f0a72000640 1 -- 172.21.15.100:0/4060654214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a58003ba0 msgr2=0x7f0a58003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.057+0000 7f0a72000640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a58003ba0 0x7f0a58003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.057+0000 7f0a72000640 1 -- 172.21.15.100:0/4060654214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58009970 msgr2=0x7f0a5800bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.057+0000 7f0a72000640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58009970 0x7f0a5800bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.057+0000 7f0a72000640 1 -- 172.21.15.100:0/4060654214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740cc940 con 0x7f0a580047c0 2024-02-21T07:49:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.064+0000 7f0a73400640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a58009970 0x7f0a5800bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.064+0000 7f0a73400640 1 -- 172.21.15.100:0/4060654214 reap_dead start 2024-02-21T07:49:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.064+0000 7f0a72000640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a58004c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001740 tx=0x7f0a580057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d30fc07c121b461 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.065+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004aa0 con 0x7f0a580047c0 2024-02-21T07:49:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.065+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6002e070 con 0x7f0a580047c0 2024-02-21T07:49:21.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.066+0000 7f0a79800640 1 -- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 msgr2=0x7f0a58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a58004c40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001740 tx=0x7f0a580057f0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a71600640 1 -- 172.21.15.100:0/4060654214 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004e80 con 0x7f0a580047c0 2024-02-21T07:49:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 -- 172.21.15.100:0/4060654214 shutdown_connections 2024-02-21T07:49:21.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 --2- 172.21.15.100:0/4060654214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a58004c40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 -- 172.21.15.100:0/4060654214 >> 172.21.15.100:0/4060654214 conn(0x7f0a740ce1b0 msgr2=0x7f0a740ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 -- 172.21.15.100:0/4060654214 shutdown_connections 2024-02-21T07:49:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.067+0000 7f0a79800640 1 -- 172.21.15.100:0/4060654214 wait complete. 2024-02-21T07:49:21.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.074+0000 7f0a79800640 1 Processor -- start 2024-02-21T07:49:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.075+0000 7f0a79800640 1 -- start start 2024-02-21T07:49:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.083+0000 7f0a79800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a740d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.084+0000 7f0a79800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.086+0000 7f0a72000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.086+0000 7f0a72000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45532/0 (socket says 172.21.15.100:45532) 2024-02-21T07:49:21.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.086+0000 7f0a72000640 1 -- 172.21.15.100:0/1293653286 learned_addr learned my addr 172.21.15.100:0/1293653286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:21.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.086+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a740d2570 0x7f0a7422e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.088+0000 7f0a73400640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a740d2570 0x7f0a7422e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.088+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a742298e0 con 0x7f0a740d20f0 2024-02-21T07:49:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.088+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7422f0f0 con 0x7f0a740d2570 2024-02-21T07:49:21.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.088+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a740d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.088+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74228cd0 con 0x7f0a580047c0 2024-02-21T07:49:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.092+0000 7f0a72a00640 1 -- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a740d2570 msgr2=0x7f0a7422e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.092+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a740d2570 0x7f0a7422e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.092+0000 7f0a72a00640 1 -- 172.21.15.100:0/1293653286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 msgr2=0x7f0a7422e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.096+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.096+0000 7f0a72a00640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74228fb0 con 0x7f0a580047c0 2024-02-21T07:49:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.096+0000 7f0a72000640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.105+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a740d1bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00fb10 tx=0x7f0a6c002090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.109+0000 7f0a6aa00640 1 -- 172.21.15.100:0/1293653286 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003b80 con 0x7f0a580047c0 2024-02-21T07:49:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.109+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74229290 con 0x7f0a580047c0 2024-02-21T07:49:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.109+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a741763e0 con 0x7f0a580047c0 2024-02-21T07:49:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.109+0000 7f0a6aa00640 1 -- 172.21.15.100:0/1293653286 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c003ce0 con 0x7f0a580047c0 2024-02-21T07:49:21.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.109+0000 7f0a6aa00640 1 -- 172.21.15.100:0/1293653286 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003b80 con 0x7f0a580047c0 2024-02-21T07:49:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.125+0000 7f0a7c426740 1 Processor -- start 2024-02-21T07:49:21.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.126+0000 7f0a7c426740 1 -- start start 2024-02-21T07:49:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.128+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 0x5559dc136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.128+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc13bf90 0x5559dc177450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a6aa00640 1 -- 172.21.15.100:0/1293653286 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0a6c00d7c0 con 0x7f0a580047c0 2024-02-21T07:49:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38120/0 (socket says 172.21.15.100:38120) 2024-02-21T07:49:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a72a00640 1 -- 172.21.15.100:0/2327236640 learned_addr learned my addr 172.21.15.100:0/2327236640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.129+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc0f7620 con 0x5559dc177070 2024-02-21T07:49:21.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.130+0000 7f0a73400640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 0x5559dc136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.130+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc0a98c0 con 0x5559dc1ab4d0 2024-02-21T07:49:21.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.130+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc0a6df0 con 0x5559dc13bf90 2024-02-21T07:49:21.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.131+0000 7f0a6aa00640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 0x7f0a540a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.131+0000 7f0a72000640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc13bf90 0x5559dc177450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.133+0000 7f0a73400640 1 -- 172.21.15.100:0/2327236640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc13bf90 msgr2=0x5559dc177450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.133+0000 7f0a73400640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc13bf90 0x5559dc177450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.133+0000 7f0a73400640 1 -- 172.21.15.100:0/2327236640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 msgr2=0x5559dc13ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.135+0000 7f0a73400640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.135+0000 7f0a73400640 1 -- 172.21.15.100:0/2327236640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559dc023b00 con 0x5559dc177070 2024-02-21T07:49:21.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.135+0000 7f0a72a00640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:21.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.136+0000 7f0a73400640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 0x7f0a540a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.137+0000 7f0a73400640 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 0x5559dc136440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a740f7860 tx=0x7f0a64007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb153aba9133ca36 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.143 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.139+0000 7f0a5f400640 1 -- 172.21.15.100:0/2327236640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6401f5b0 con 0x5559dc177070 2024-02-21T07:49:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.140+0000 7f0a5f400640 1 -- 172.21.15.100:0/2327236640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400d070 con 0x5559dc177070 2024-02-21T07:49:21.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.140+0000 7f0a5f400640 1 -- 172.21.15.100:0/2327236640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6401f910 con 0x5559dc177070 2024-02-21T07:49:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.141+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 msgr2=0x5559dc136440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.141+0000 7f0a7c426740 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 0x5559dc136440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0a740f7860 tx=0x7f0a64007d20 comp rx=0 tx=0).stop 2024-02-21T07:49:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.154+0000 7f0a6aa00640 1 -- 172.21.15.100:0/1293653286 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a6c0c99c0 con 0x7f0a580047c0 2024-02-21T07:49:21.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.154+0000 7f0a73400640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 0x7f0a540a1640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a7408dde0 tx=0x7f0a64022000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 shutdown_connections 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc13bf90 0x5559dc177450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc13ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 --2- 172.21.15.100:0/2327236640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc177070 0x5559dc136440 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 >> 172.21.15.100:0/2327236640 conn(0x5559dc1034b0 msgr2=0x5559dc13aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 shutdown_connections 2024-02-21T07:49:21.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.155+0000 7f0a7c426740 1 -- 172.21.15.100:0/2327236640 wait complete. 2024-02-21T07:49:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.158+0000 7f0a7c426740 1 -- start start 2024-02-21T07:49:21.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.158+0000 7f0a7c426740 1 Processor -- start 2024-02-21T07:49:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc1a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc0a25d0 con 0x5559dc13bf90 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc047b50 con 0x5559dc1ab4d0 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc0477f0 con 0x5559dc177070 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a7c426740 10 client.0 _ll_register_callbacks cb 0x5559dc05b550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:21.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.160+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.161+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45560/0 (socket says 172.21.15.100:45560) 2024-02-21T07:49:21.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.161+0000 7f0a72a00640 1 -- 172.21.15.100:0/1888986769 learned_addr learned my addr 172.21.15.100:0/1888986769 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 -- 172.21.15.100:0/1888986769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 msgr2=0x5559dc1ad080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:21.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1ad080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 -- 172.21.15.100:0/1888986769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 msgr2=0x5559dc1a11b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc1a11b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 -- 172.21.15.100:0/1888986769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a64001c40 con 0x5559dc13bf90 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00fae0 tx=0x7f0a6c097160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d647792287603a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.162+0000 7f0a53e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.163+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c097530 con 0x5559dc13bf90 2024-02-21T07:49:21.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.163+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a6c09b680 con 0x5559dc13bf90 2024-02-21T07:49:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.163+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559dc074cd0 con 0x5559dc13bf90 2024-02-21T07:49:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.164+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c09fc40 con 0x5559dc13bf90 2024-02-21T07:49:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.164+0000 7f0a7c426740 10 client.5685 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:21.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.164+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5559dc0a0c50 con 0x5559dc13bf90 2024-02-21T07:49:21.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.164+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559dc074cd0 con 0x5559dc13bf90 2024-02-21T07:49:21.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0a6c012070 con 0x5559dc13bf90 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 10 client.5685 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 10 client.5685 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 20 client.5685 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1ac0d0 0x5559dc1ac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 4 client.5685 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:21.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.166+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559dc098ce0 con 0x5559dc1ac0d0 2024-02-21T07:49:21.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.168+0000 7f0a72000640 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1ac0d0 0x5559dc1ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.169+0000 7f0a72000640 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1ac0d0 0x5559dc1ac560 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d30dc9a7903069e5 server_cookie=6ddec8e0433269b1 in_seq=0 out_seq=0 2024-02-21T07:49:21.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.169+0000 7f0a53e00640 10 client.5685 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.171+0000 7f0a53e00640 1 -- 172.21.15.100:0/1888986769 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5559dc098ce0 con 0x5559dc1ac0d0 2024-02-21T07:49:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.171+0000 7f0a53e00640 10 client.5685 handle_command_reply: tid=0 2024-02-21T07:49:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.172+0000 7f0a7c426740 1 client.5685 shutdown 2024-02-21T07:49:21.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.173+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 msgr2=0x5559dc1bce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.178 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.173+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00fae0 tx=0x7f0a6c097160 comp rx=0 tx=0).stop 2024-02-21T07:49:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 shutdown_connections 2024-02-21T07:49:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1ac0d0 0x5559dc1ac560 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc1a11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1888986769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc1bce40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.176+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 >> 172.21.15.100:0/1888986769 conn(0x5559dc1034b0 msgr2=0x5559dc1ab950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.177+0000 7f0a53e00640 0 client.5685 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.177+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 shutdown_connections 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.178+0000 7f0a7c426740 1 -- 172.21.15.100:0/1888986769 wait complete. 2024-02-21T07:49:21.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.178+0000 7f0a7c426740 20 client.5685 trim_cache size 0 max 16384 2024-02-21T07:49:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.212+0000 7f0a7c426740 1 Processor -- start 2024-02-21T07:49:21.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.212+0000 7f0a7c426740 1 -- start start 2024-02-21T07:49:21.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 0x5559dc141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc1ab4d0 0x5559dc2094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dbdeae60 con 0x5559dc1ab4d0 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc132230 con 0x5559dc13bf90 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.214+0000 7f0a7c426740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc1398e0 con 0x5559dc177070 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 0x5559dc141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 0x5559dc141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38140/0 (socket says 172.21.15.100:38140) 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72a00640 1 -- 172.21.15.100:0/1457642915 learned_addr learned my addr 172.21.15.100:0/1457642915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:21.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 -- 172.21.15.100:0/1457642915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 msgr2=0x5559dc141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 0x5559dc141cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 -- 172.21.15.100:0/1457642915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc1ab4d0 msgr2=0x5559dc2094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc1ab4d0 0x5559dc2094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.215+0000 7f0a72000640 1 -- 172.21.15.100:0/1457642915 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559dc03d530 con 0x5559dc177070 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.216+0000 7f0a72000640 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1710d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000c00 tx=0x7f0a60007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c3c53fe2893b1a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.217+0000 7f0a5ea00640 1 -- 172.21.15.100:0/1457642915 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600049f0 con 0x5559dc177070 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.217+0000 7f0a5ea00640 1 -- 172.21.15.100:0/1457642915 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559dc098ce0 con 0x5559dc177070 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.217+0000 7f0a5ea00640 1 -- 172.21.15.100:0/1457642915 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60004d90 con 0x5559dc177070 2024-02-21T07:49:21.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.217+0000 7f0a7c426740 1 -- 172.21.15.100:0/1457642915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 msgr2=0x5559dc1710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.217+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1710d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0a60000c00 tx=0x7f0a60007000 comp rx=0 tx=0).stop 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 -- 172.21.15.100:0/1457642915 shutdown_connections 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc1ab4d0 0x5559dc2094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc1710d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1457642915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc13bf90 0x5559dc141cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 -- 172.21.15.100:0/1457642915 >> 172.21.15.100:0/1457642915 conn(0x5559dc1034b0 msgr2=0x5559dc138890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 -- 172.21.15.100:0/1457642915 shutdown_connections 2024-02-21T07:49:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.218+0000 7f0a7c426740 1 -- 172.21.15.100:0/1457642915 wait complete. 2024-02-21T07:49:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.219+0000 7f0a7c426740 1 -- start start 2024-02-21T07:49:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.219+0000 7f0a7c426740 1 Processor -- start 2024-02-21T07:49:21.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.220+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.220+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc16dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.221+0000 7f0a7c426740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc202920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.221+0000 7f0a7c426740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc1404a0 con 0x5559dc13bf90 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.221+0000 7f0a7c426740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc1a9fb0 con 0x5559dc1ab4d0 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.221+0000 7f0a7c426740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559dc19a340 con 0x5559dc177070 2024-02-21T07:49:21.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.221+0000 7f0a7c426740 10 client.0 _ll_register_callbacks cb 0x7f0a64001700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45584/0 (socket says 172.21.15.100:45584) 2024-02-21T07:49:21.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 -- 172.21.15.100:0/1937802951 learned_addr learned my addr 172.21.15.100:0/1937802951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 -- 172.21.15.100:0/1937802951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 msgr2=0x5559dc16dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc16dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 -- 172.21.15.100:0/1937802951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 msgr2=0x5559dc202920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc202920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.222+0000 7f0a72a00640 1 -- 172.21.15.100:0/1937802951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6003c040 con 0x5559dc13bf90 2024-02-21T07:49:21.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.225+0000 7f0a72a00640 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c093990 tx=0x7f0a6c0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ebaa76b65b9ea5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.225+0000 7f0a53e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.225+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c097300 con 0x5559dc13bf90 2024-02-21T07:49:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.226+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a6c0b6180 con 0x5559dc13bf90 2024-02-21T07:49:21.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.226+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559dc0c7d30 con 0x5559dc13bf90 2024-02-21T07:49:21.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c003e50 con 0x5559dc13bf90 2024-02-21T07:49:21.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a7c426740 10 client.5688 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:21.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5559dc0632c0 con 0x5559dc13bf90 2024-02-21T07:49:21.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559dc0c7d30 con 0x5559dc13bf90 2024-02-21T07:49:21.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0a6c012040 con 0x5559dc13bf90 2024-02-21T07:49:21.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.228+0000 7f0a7c426740 10 client.5688 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:21.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.229+0000 7f0a7c426740 10 client.5688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:21.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.229+0000 7f0a7c426740 20 client.5688 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:21.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.229+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1bdb60 0x5559dc1ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:21.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.229+0000 7f0a7c426740 4 client.5688 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:49:21.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.229+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5559dbda2600 con 0x5559dc1bdb60 2024-02-21T07:49:21.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.230+0000 7f0a72000640 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1bdb60 0x5559dc1ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:21.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.231+0000 7f0a72000640 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1bdb60 0x5559dc1ca7b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75be313d5c2e754c server_cookie=2dbeb5885006052e in_seq=0 out_seq=0 2024-02-21T07:49:21.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.231+0000 7f0a53e00640 10 client.5688 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.253+0000 7f0a53e00640 1 -- 172.21.15.100:0/1937802951 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5559dbda2600 con 0x5559dc1bdb60 2024-02-21T07:49:21.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.253+0000 7f0a53e00640 10 client.5688 handle_command_reply: tid=0 2024-02-21T07:49:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.253+0000 7f0a7c426740 1 client.5688 shutdown 2024-02-21T07:49:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.253+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 msgr2=0x5559dc199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.253+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c093990 tx=0x7f0a6c0017b0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 shutdown_connections 2024-02-21T07:49:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5559dc1bdb60 0x5559dc1ca7b0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a53e00640 0 client.5688 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:21.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5559dc1ab4d0 0x5559dc202920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5559dc177070 0x5559dc16dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 --2- 172.21.15.100:0/1937802951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5559dc13bf90 0x5559dc199e00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.254+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 >> 172.21.15.100:0/1937802951 conn(0x5559dc1034b0 msgr2=0x5559dc137b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.257+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 shutdown_connections 2024-02-21T07:49:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.258+0000 7f0a7c426740 1 -- 172.21.15.100:0/1937802951 wait complete. 2024-02-21T07:49:21.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.259+0000 7f0a7c426740 20 client.5688 trim_cache size 0 max 16384 2024-02-21T07:49:21.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:49:21.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:49:21.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:49:21.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:49:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.266+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 msgr2=0x7f0a540a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.266+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 0x7f0a540a1640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a7408dde0 tx=0x7f0a64022000 comp rx=0 tx=0).stop 2024-02-21T07:49:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.266+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 msgr2=0x7f0a740d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:21.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.266+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a740d1bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00fb10 tx=0x7f0a6c002090 comp rx=0 tx=0).stop 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 shutdown_connections 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0a740d2570 0x7f0a7422e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0a5409f180 0x7f0a540a1640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a740d20f0 0x7f0a7422e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 --2- 172.21.15.100:0/1293653286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a580047c0 0x7f0a740d1bb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:21.271 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.267+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 >> 172.21.15.100:0/1293653286 conn(0x7f0a740ce1b0 msgr2=0x7f0a740ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.268+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 shutdown_connections 2024-02-21T07:49:21.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:21.268+0000 7f0a79800640 1 -- 172.21.15.100:0/1293653286 wait complete. 2024-02-21T07:49:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.483+0000 7f6419400640 1 Processor -- start 2024-02-21T07:49:34.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.483+0000 7f6419400640 1 -- start start 2024-02-21T07:49:34.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.485+0000 7f6419400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f64140fac20 0x7f641406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.485+0000 7f6419400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f641406f190 0x7f64140fb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.491 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.485+0000 7f6419400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64140f7990 con 0x7f64140fb540 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.485+0000 7f6419400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6414162450 con 0x7f64140fac20 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.485+0000 7f6419400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64140f6aa0 con 0x7f641406f190 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.486+0000 7f6413400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f641406f190 0x7f64140fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.486+0000 7f6413400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f641406f190 0x7f64140fb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53528/0 (socket says 172.21.15.100:53528) 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.486+0000 7f6413400640 1 -- 172.21.15.100:0/580805451 learned_addr learned my addr 172.21.15.100:0/580805451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.487+0000 7f6413400640 1 -- 172.21.15.100:0/580805451 >> v2:172.21.15.156:3300/0 conn(0x7f64140fac20 msgr2=0x7f641406ec50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.487+0000 7f6412a00640 1 -- 172.21.15.100:0/580805451 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215094626 0 0) 0x7f64140f7990 con 0x7f64140fb540 2024-02-21T07:49:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.487+0000 7f6413400640 1 --2- 172.21.15.100:0/580805451 >> v2:172.21.15.156:3300/0 conn(0x7f64140fac20 0x7f641406ec50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.487+0000 7f6413400640 1 -- 172.21.15.100:0/580805451 >> v1:172.21.15.100:6789/0 conn(0x7f64140fb540 legacy=0x7f6414186340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.487+0000 7f6413400640 1 -- 172.21.15.100:0/580805451 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140f6d80 con 0x7f641406f190 2024-02-21T07:49:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.489+0000 7f6413400640 1 --2- 172.21.15.100:0/580805451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641406f190 0x7f64140fb000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64140f9890 tx=0x7f640002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55e033278cfd5e9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.489+0000 7f6412a00640 1 -- 172.21.15.100:0/580805451 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400030800 con 0x7f641406f190 2024-02-21T07:49:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.489+0000 7f6412a00640 1 -- 172.21.15.100:0/580805451 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400030960 con 0x7f641406f190 2024-02-21T07:49:34.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.489+0000 7f6412a00640 1 -- 172.21.15.100:0/580805451 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400030cf0 con 0x7f641406f190 2024-02-21T07:49:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.490+0000 7f6419400640 1 -- 172.21.15.100:0/580805451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641406f190 msgr2=0x7f64140fb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.490+0000 7f6419400640 1 --2- 172.21.15.100:0/580805451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641406f190 0x7f64140fb000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f64140f9890 tx=0x7f640002b940 comp rx=0 tx=0).stop 2024-02-21T07:49:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.491+0000 7f6419400640 1 -- 172.21.15.100:0/580805451 shutdown_connections 2024-02-21T07:49:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.491+0000 7f6419400640 1 --2- 172.21.15.100:0/580805451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f641406f190 0x7f64140fb000 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.491+0000 7f6419400640 1 --2- 172.21.15.100:0/580805451 >> v2:172.21.15.156:3300/0 conn(0x7f64140fac20 0x7f641406ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.496 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.491+0000 7f6419400640 1 -- 172.21.15.100:0/580805451 >> 172.21.15.100:0/580805451 conn(0x7f64140d01e0 msgr2=0x7f64140d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.492+0000 7f6419400640 1 -- 172.21.15.100:0/580805451 shutdown_connections 2024-02-21T07:49:34.497 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.492+0000 7f6419400640 1 -- 172.21.15.100:0/580805451 wait complete. 2024-02-21T07:49:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.495+0000 7f6419400640 1 Processor -- start 2024-02-21T07:49:34.500 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.496+0000 7f6419400640 1 -- start start 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64140fac20 0x7f6414157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64140fb540 0x7f641421c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641421ba50 con 0x7f641406f190 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6414185800 con 0x7f64140fb540 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.497+0000 7f6419400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6414185ae0 con 0x7f64140fac20 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.498+0000 7f6413e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.498+0000 7f6413e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39978/0 (socket says 172.21.15.100:39978) 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.498+0000 7f6413e00640 1 -- 172.21.15.100:0/1291511177 learned_addr learned my addr 172.21.15.100:0/1291511177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.498+0000 7f6418a00640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64140fb540 0x7f641421c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64140fac20 0x7f6414157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 -- 172.21.15.100:0/1291511177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64140fac20 msgr2=0x7f6414157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64140fac20 0x7f6414157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 -- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64140fb540 msgr2=0x7f641421c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64140fb540 0x7f641421c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 -- 172.21.15.100:0/1291511177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000094d0 con 0x7f641406f190 2024-02-21T07:49:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.499+0000 7f6413e00640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f640400b6d0 tx=0x7f640400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.500+0000 7f640be00640 1 -- 172.21.15.100:0/1291511177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640400c720 con 0x7f641406f190 2024-02-21T07:49:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.500+0000 7f640be00640 1 -- 172.21.15.100:0/1291511177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640400c880 con 0x7f641406f190 2024-02-21T07:49:34.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.500+0000 7f640be00640 1 -- 172.21.15.100:0/1291511177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640400c720 con 0x7f641406f190 2024-02-21T07:49:34.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.508+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641421bcf0 con 0x7f641406f190 2024-02-21T07:49:34.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.508+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641421e960 con 0x7f641406f190 2024-02-21T07:49:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.516+0000 7f640be00640 1 -- 172.21.15.100:0/1291511177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f640400ca30 con 0x7f641406f190 2024-02-21T07:49:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.520+0000 7f640be00640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 0x7f63f40a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.521+0000 7f640be00640 1 -- 172.21.15.100:0/1291511177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f64040c9040 con 0x7f641406f190 2024-02-21T07:49:34.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.521+0000 7f6413400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 0x7f63f40a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.522+0000 7f6413400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 0x7f63f40a1640 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6400036000 tx=0x7f640003b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.523+0000 7f641d7d3740 1 Processor -- start 2024-02-21T07:49:34.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.532+0000 7f641d7d3740 1 -- start start 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd843b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 0x563fd8440c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd83fc620 con 0x563fd84b06c0 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd83ae8c0 con 0x563fd847c260 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.534+0000 7f641d7d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd83abdf0 con 0x563fd8441180 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.535+0000 7f6418a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.535+0000 7f6418a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53550/0 (socket says 172.21.15.100:53550) 2024-02-21T07:49:34.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.535+0000 7f6418a00640 1 -- 172.21.15.100:0/159125442 learned_addr learned my addr 172.21.15.100:0/159125442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.535+0000 7f6413e00640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd843b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.536+0000 7f6413e00640 1 -- 172.21.15.100:0/159125442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 msgr2=0x563fd847c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.536+0000 7f6413e00640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.536+0000 7f6413e00640 1 -- 172.21.15.100:0/159125442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 msgr2=0x563fd8440c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.536+0000 7f6418a00640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.537+0000 7f6413400640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 0x563fd8440c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.537+0000 7f6413e00640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 0x563fd8440c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.537+0000 7f6413e00640 1 -- 172.21.15.100:0/159125442 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd8328b00 con 0x563fd847c260 2024-02-21T07:49:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.538+0000 7f6413400640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 0x563fd8440c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.543+0000 7f6413e00640 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd843b630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f64040c69b0 tx=0x7f6404097220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd46472eccc103a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.544+0000 7f63ffe00640 1 -- 172.21.15.100:0/159125442 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040c6ea0 con 0x563fd847c260 2024-02-21T07:49:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.544+0000 7f63ffe00640 1 -- 172.21.15.100:0/159125442 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640409ac70 con 0x563fd847c260 2024-02-21T07:49:34.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.544+0000 7f63ffe00640 1 -- 172.21.15.100:0/159125442 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640409f2c0 con 0x563fd847c260 2024-02-21T07:49:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.546+0000 7f641d7d3740 1 -- 172.21.15.100:0/159125442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 msgr2=0x563fd843b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.546+0000 7f641d7d3740 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd843b630 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f64040c69b0 tx=0x7f6404097220 comp rx=0 tx=0).stop 2024-02-21T07:49:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.548+0000 7f641d7d3740 1 -- 172.21.15.100:0/159125442 shutdown_connections 2024-02-21T07:49:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.549+0000 7f641d7d3740 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd847c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.549+0000 7f641d7d3740 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd84b06c0 0x563fd8440c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.549+0000 7f641d7d3740 1 --2- 172.21.15.100:0/159125442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd843b630 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.549+0000 7f641d7d3740 1 -- 172.21.15.100:0/159125442 >> 172.21.15.100:0/159125442 conn(0x563fd84084b0 msgr2=0x563fd843fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.550+0000 7f641d7d3740 1 -- 172.21.15.100:0/159125442 shutdown_connections 2024-02-21T07:49:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.550+0000 7f641d7d3740 1 -- 172.21.15.100:0/159125442 wait complete. 2024-02-21T07:49:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.552+0000 7f641d7d3740 1 -- start start 2024-02-21T07:49:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.553+0000 7f641d7d3740 1 Processor -- start 2024-02-21T07:49:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.556+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd84c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.556+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd84b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd843bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f641d7d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd83a75d0 con 0x563fd8441180 2024-02-21T07:49:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f6413400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd84b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f6413400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd84b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:51162/0 (socket says 172.21.15.100:51162) 2024-02-21T07:49:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f6413400640 1 -- 172.21.15.100:0/2825624305 learned_addr learned my addr 172.21.15.100:0/2825624305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd834cb50 con 0x563fd847c260 2024-02-21T07:49:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f6418a00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd843bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd834c7f0 con 0x563fd84b06c0 2024-02-21T07:49:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.557+0000 7f641d7d3740 10 client.0 _ll_register_callbacks cb 0x563fd8360550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.558+0000 7f6418a00640 1 -- 172.21.15.100:0/2825624305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 msgr2=0x563fd84b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.558+0000 7f6418a00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd84b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.558+0000 7f6418a00640 1 -- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 msgr2=0x563fd84c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.558+0000 7f6418a00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd84c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.558+0000 7f6418a00640 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641421e960 con 0x563fd84b06c0 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.559+0000 7f6418a00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd843bcd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x563fd84aa540 tx=0x7f640c001840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87cb736e5ce2fea1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.559+0000 7f63fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.559+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c0014a0 con 0x563fd84b06c0 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.559+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f640c002070 con 0x563fd84b06c0 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.559+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fd8379cd0 con 0x563fd84b06c0 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.560+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f640c013570 con 0x563fd84b06c0 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.560+0000 7f641d7d3740 10 client.5795 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.560+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563fd83a5c50 con 0x563fd84b06c0 2024-02-21T07:49:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.561+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fd8379cd0 con 0x563fd84b06c0 2024-02-21T07:49:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f640c0136d0 con 0x563fd84b06c0 2024-02-21T07:49:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 10 client.5795 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 10 client.5795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 20 client.5795 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:34.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c2dd0 0x563fd84a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 4 client.5795 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:34.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.562+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fd839dce0 con 0x563fd84c2dd0 2024-02-21T07:49:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.564+0000 7f6413e00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c2dd0 0x563fd84a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.565+0000 7f6413e00640 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c2dd0 0x563fd84a5f30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b0902706ce5ebf server_cookie=a07b701d0e0ff130 in_seq=0 out_seq=0 2024-02-21T07:49:34.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.565+0000 7f63fcc00640 10 client.5795 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.571+0000 7f63fcc00640 1 -- 172.21.15.100:0/2825624305 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563fd839dce0 con 0x563fd84c2dd0 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.571+0000 7f63fcc00640 10 client.5795 handle_command_reply: tid=0 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.571+0000 7f641d7d3740 1 client.5795 shutdown 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.571+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 msgr2=0x563fd843bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.571+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd843bcd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x563fd84aa540 tx=0x7f640c001840 comp rx=0 tx=0).stop 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 shutdown_connections 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c2dd0 0x563fd84a5f30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd843bcd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd84b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2825624305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd84c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f63fcc00640 0 client.5795 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 >> 172.21.15.100:0/2825624305 conn(0x563fd84084b0 msgr2=0x563fd84b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 shutdown_connections 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 1 -- 172.21.15.100:0/2825624305 wait complete. 2024-02-21T07:49:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.572+0000 7f641d7d3740 20 client.5795 trim_cache size 0 max 16384 2024-02-21T07:49:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.595+0000 7f641d7d3740 1 Processor -- start 2024-02-21T07:49:34.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.595+0000 7f641d7d3740 1 -- start start 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd847c260 0x563fd8476380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd84b06c0 0x563fd84b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd80efe60 con 0x563fd847c260 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd843e560 con 0x563fd84b06c0 2024-02-21T07:49:34.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.597+0000 7f641d7d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd84c3400 con 0x563fd8441180 2024-02-21T07:49:34.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.599+0000 7f6413e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.599+0000 7f6413e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53568/0 (socket says 172.21.15.100:53568) 2024-02-21T07:49:34.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.599+0000 7f6413e00640 1 -- 172.21.15.100:0/2394070333 learned_addr learned my addr 172.21.15.100:0/2394070333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.599+0000 7f6418a00640 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd84b06c0 0x563fd84b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.600+0000 7f6413e00640 1 -- 172.21.15.100:0/2394070333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd84b06c0 msgr2=0x563fd84b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:34.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.600+0000 7f6413e00640 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd84b06c0 0x563fd84b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.600+0000 7f6413e00640 1 -- 172.21.15.100:0/2394070333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd847c260 msgr2=0x563fd8476380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:34.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.600+0000 7f6413e00640 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd847c260 0x563fd8476380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.600+0000 7f6413e00640 1 -- 172.21.15.100:0/2394070333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd8476d50 con 0x563fd8441180 2024-02-21T07:49:34.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.601+0000 7f6413e00640 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f64040c6a30 tx=0x7f640401f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a4465a6d7cb9cef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.602+0000 7f63ff400640 1 -- 172.21.15.100:0/2394070333 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040b4040 con 0x563fd8441180 2024-02-21T07:49:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.602+0000 7f63ff400640 1 -- 172.21.15.100:0/2394070333 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640409f2c0 con 0x563fd8441180 2024-02-21T07:49:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.602+0000 7f63ff400640 1 -- 172.21.15.100:0/2394070333 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64040b41a0 con 0x563fd8441180 2024-02-21T07:49:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.603+0000 7f641d7d3740 1 -- 172.21.15.100:0/2394070333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 msgr2=0x563fd84c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.603+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f64040c6a30 tx=0x7f640401f000 comp rx=0 tx=0).stop 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 -- 172.21.15.100:0/2394070333 shutdown_connections 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd84b06c0 0x563fd84b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd847c260 0x563fd8476380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2394070333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd8441180 0x563fd84c8ca0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 -- 172.21.15.100:0/2394070333 >> 172.21.15.100:0/2394070333 conn(0x563fd84084b0 msgr2=0x563fd84468d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.604+0000 7f641d7d3740 1 -- 172.21.15.100:0/2394070333 shutdown_connections 2024-02-21T07:49:34.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.605+0000 7f641d7d3740 1 -- 172.21.15.100:0/2394070333 wait complete. 2024-02-21T07:49:34.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.607+0000 7f641d7d3740 1 -- start start 2024-02-21T07:49:34.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.607+0000 7f641d7d3740 1 Processor -- start 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.609+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd849fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.609+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd8478950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.609+0000 7f641d7d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.609+0000 7f641d7d3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd846fb50 con 0x563fd8441180 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.609+0000 7f641d7d3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd847f620 con 0x563fd847c260 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.610+0000 7f641d7d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd8478f20 con 0x563fd84b06c0 2024-02-21T07:49:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.610+0000 7f641d7d3740 10 client.0 _ll_register_callbacks cb 0x7f6404092db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.610+0000 7f6418a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.611+0000 7f6418a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53578/0 (socket says 172.21.15.100:53578) 2024-02-21T07:49:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.611+0000 7f6418a00640 1 -- 172.21.15.100:0/2222212288 learned_addr learned my addr 172.21.15.100:0/2222212288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:34.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.611+0000 7f6413e00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd849fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.612+0000 7f6418a00640 1 -- 172.21.15.100:0/2222212288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 msgr2=0x563fd8478950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:34.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.613+0000 7f6418a00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd8478950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.613+0000 7f6418a00640 1 -- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 msgr2=0x563fd849fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.613+0000 7f6418a00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd849fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.613+0000 7f6418a00640 1 -- 172.21.15.100:0/2222212288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fd8328b00 con 0x563fd84b06c0 2024-02-21T07:49:34.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.613+0000 7f6413e00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd849fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.614+0000 7f63fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.614+0000 7f6418a00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563fd8473ed0 tx=0x7f640c001300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a59e8a6e041d1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:34.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.615+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c0020f0 con 0x563fd84b06c0 2024-02-21T07:49:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.615+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f640c0052d0 con 0x563fd84b06c0 2024-02-21T07:49:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.615+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fd83ccd30 con 0x563fd84b06c0 2024-02-21T07:49:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.615+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f640c013570 con 0x563fd84b06c0 2024-02-21T07:49:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.616+0000 7f641d7d3740 10 client.5801 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.616+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563fd8342530 con 0x563fd84b06c0 2024-02-21T07:49:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.616+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c0020f0 con 0x563fd84b06c0 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.617+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f640c0136d0 con 0x563fd84b06c0 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 10 client.5801 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 10 client.5801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 20 client.5801 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c3890 0x563fd8474f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 4 client.5801 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:49:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.618+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563fd83ccd30 con 0x563fd84c3890 2024-02-21T07:49:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.619+0000 7f6413e00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c3890 0x563fd8474f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.620+0000 7f63fcc00640 10 client.5801 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.620+0000 7f6413e00640 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c3890 0x563fd8474f00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c100fe174c6b2c6 server_cookie=f8d2153b6d9b6710 in_seq=0 out_seq=0 2024-02-21T07:49:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.673+0000 7f63fcc00640 1 -- 172.21.15.100:0/2222212288 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563fd83ccd30 con 0x563fd84c3890 2024-02-21T07:49:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.674+0000 7f63fcc00640 10 client.5801 handle_command_reply: tid=0 2024-02-21T07:49:34.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.674+0000 7f641d7d3740 1 client.5801 shutdown 2024-02-21T07:49:34.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.683+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 msgr2=0x563fd846f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.683+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x563fd8473ed0 tx=0x7f640c001300 comp rx=0 tx=0).stop 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.684+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 shutdown_connections 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.684+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563fd84c3890 0x563fd8474f00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.684+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563fd84b06c0 0x563fd846f610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.684+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563fd847c260 0x563fd8478950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.685+0000 7f641d7d3740 1 --2- 172.21.15.100:0/2222212288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563fd8441180 0x563fd849fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.685+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 >> 172.21.15.100:0/2222212288 conn(0x563fd84084b0 msgr2=0x563fd84a5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.685+0000 7f63fcc00640 0 client.5801 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.685+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 shutdown_connections 2024-02-21T07:49:34.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.686+0000 7f641d7d3740 1 -- 172.21.15.100:0/2222212288 wait complete. 2024-02-21T07:49:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.690+0000 7f641d7d3740 20 client.5801 trim_cache size 0 max 16384 2024-02-21T07:49:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:49:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:49:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:49:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:49:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 msgr2=0x7f63f40a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 0x7f63f40a1640 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6400036000 tx=0x7f640003b040 comp rx=0 tx=0).stop 2024-02-21T07:49:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 msgr2=0x7f641421e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f640400b6d0 tx=0x7f640400bb90 comp rx=0 tx=0).stop 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 shutdown_connections 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f64140fb540 0x7f641421c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64140fac20 0x7f6414157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f63f409f180 0x7f63f40a1640 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 --2- 172.21.15.100:0/1291511177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f641406f190 0x7f641421e420 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f640400b6d0 tx=0x7f640400bb90 comp rx=0 tx=0).stop 2024-02-21T07:49:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.693+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 >> 172.21.15.100:0/1291511177 conn(0x7f64140d01e0 msgr2=0x7f64141898c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.696+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 shutdown_connections 2024-02-21T07:49:34.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:34.696+0000 7f6419400640 1 -- 172.21.15.100:0/1291511177 wait complete. 2024-02-21T07:49:43.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:43.420 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:43.422 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.956+0000 7fb75f200640 1 Processor -- start 2024-02-21T07:49:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.957+0000 7fb75f200640 1 -- start start 2024-02-21T07:49:47.964 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.960+0000 7fb75f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb75818a590 0x7fb7580cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.961+0000 7fb75f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7580cc0e0 con 0x7fb7580f61d0 2024-02-21T07:49:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.961+0000 7fb75f200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7580cc380 con 0x7fb7580cd960 2024-02-21T07:49:47.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.961+0000 7fb75f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7581911b0 con 0x7fb75818a590 2024-02-21T07:49:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.962+0000 7fb75d200640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb7580cd960 0x7fb75818d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:58010/0 (socket says 172.21.15.100:58010) 2024-02-21T07:49:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.962+0000 7fb75d200640 1 -- 172.21.15.100:0/681697919 learned_addr learned my addr 172.21.15.100:0/681697919 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.962+0000 7fb757e00640 1 --2- 172.21.15.100:0/681697919 >> v2:172.21.15.100:3300/0 conn(0x7fb75818a590 0x7fb7580cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:47.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.963+0000 7fb756a00640 1 -- 172.21.15.100:0/681697919 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497593246 0 0) 0x7fb7580cc380 con 0x7fb7580cd960 2024-02-21T07:49:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.964+0000 7fb757e00640 1 -- 172.21.15.100:0/681697919 >> v1:172.21.15.156:6789/0 conn(0x7fb7580cd960 legacy=0x7fb75818d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:47.967 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.964+0000 7fb757e00640 1 -- 172.21.15.100:0/681697919 >> v1:172.21.15.100:6789/0 conn(0x7fb7580f61d0 legacy=0x7fb75818cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:47.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.964+0000 7fb757e00640 1 -- 172.21.15.100:0/681697919 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580cc660 con 0x7fb75818a590 2024-02-21T07:49:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.968+0000 7fb757e00640 1 --2- 172.21.15.100:0/681697919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb7580cd420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb7480097a0 tx=0x7fb74802b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7658a64912b92dbd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.969+0000 7fb756a00640 1 -- 172.21.15.100:0/681697919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748030710 con 0x7fb75818a590 2024-02-21T07:49:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.970+0000 7fb756a00640 1 -- 172.21.15.100:0/681697919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74802e050 con 0x7fb75818a590 2024-02-21T07:49:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.970+0000 7fb756a00640 1 -- 172.21.15.100:0/681697919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748030a90 con 0x7fb75818a590 2024-02-21T07:49:47.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.971+0000 7fb75f200640 1 -- 172.21.15.100:0/681697919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 msgr2=0x7fb7580cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.971+0000 7fb75f200640 1 --2- 172.21.15.100:0/681697919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb7580cd420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb7480097a0 tx=0x7fb74802b680 comp rx=0 tx=0).stop 2024-02-21T07:49:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.977+0000 7fb75f200640 1 -- 172.21.15.100:0/681697919 shutdown_connections 2024-02-21T07:49:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.977+0000 7fb75f200640 1 --2- 172.21.15.100:0/681697919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb7580cd420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:47.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.977+0000 7fb75f200640 1 -- 172.21.15.100:0/681697919 >> 172.21.15.100:0/681697919 conn(0x7fb7580ce1b0 msgr2=0x7fb7580ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.978+0000 7fb75f200640 1 -- 172.21.15.100:0/681697919 shutdown_connections 2024-02-21T07:49:47.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.978+0000 7fb75f200640 1 -- 172.21.15.100:0/681697919 wait complete. 2024-02-21T07:49:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.982+0000 7fb75f200640 1 Processor -- start 2024-02-21T07:49:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.983+0000 7fb75f200640 1 -- start start 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 0x7fb75817be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 0x7fb75818ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb75818b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758224a50 con 0x7fb75818a590 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758224d30 con 0x7fb7580cd960 2024-02-21T07:49:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.985+0000 7fb75f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758225010 con 0x7fb7580f61d0 2024-02-21T07:49:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 0x7fb75817be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 0x7fb75817be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54018/0 (socket says 172.21.15.100:54018) 2024-02-21T07:49:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757e00640 1 -- 172.21.15.100:0/1281002729 learned_addr learned my addr 172.21.15.100:0/1281002729 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 0x7fb75818ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb75d200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb75818b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 -- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 msgr2=0x7fb75817be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 0x7fb75817be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 -- 172.21.15.100:0/1281002729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 msgr2=0x7fb75818b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb75818b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.986+0000 7fb757400640 1 -- 172.21.15.100:0/1281002729 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748009400 con 0x7fb7580f61d0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.987+0000 7fb757400640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 0x7fb75818ae20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c4a0 tx=0x7fb74400c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.988+0000 7fb74fe00640 1 -- 172.21.15.100:0/1281002729 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744005480 con 0x7fb7580f61d0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.988+0000 7fb74fe00640 1 -- 172.21.15.100:0/1281002729 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440035f0 con 0x7fb7580f61d0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.988+0000 7fb74fe00640 1 -- 172.21.15.100:0/1281002729 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440039a0 con 0x7fb7580f61d0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.988+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7582252f0 con 0x7fb7580f61d0 2024-02-21T07:49:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.988+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7582258b0 con 0x7fb7580f61d0 2024-02-21T07:49:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.993+0000 7fb74fe00640 1 -- 172.21.15.100:0/1281002729 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb744003b20 con 0x7fb7580f61d0 2024-02-21T07:49:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.996+0000 7fb74fe00640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 0x7fb7380a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.996+0000 7fb74fe00640 1 -- 172.21.15.100:0/1281002729 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb7440c92b0 con 0x7fb7580f61d0 2024-02-21T07:49:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:47.999+0000 7fb757e00640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 0x7fb7380a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.002+0000 7fb757e00640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 0x7fb7380a16b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb74802b6c0 tx=0x7fb748008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.002+0000 7fb761fab740 1 Processor -- start 2024-02-21T07:49:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.003+0000 7fb761fab740 1 -- start start 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa4e0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa521450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa4a1620 con 0x5583fa521070 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa4538c0 con 0x5583fa4e5f90 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.004+0000 7fb761fab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa450df0 con 0x5583fa5554d0 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.005+0000 7fb757400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.005+0000 7fb757e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa4e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.005+0000 7fb757400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41222/0 (socket says 172.21.15.100:41222) 2024-02-21T07:49:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.005+0000 7fb757400640 1 -- 172.21.15.100:0/1081319317 learned_addr learned my addr 172.21.15.100:0/1081319317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.006+0000 7fb757400640 1 -- 172.21.15.100:0/1081319317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 msgr2=0x5583fa521450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.006+0000 7fb757400640 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa521450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.006+0000 7fb757400640 1 -- 172.21.15.100:0/1081319317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 msgr2=0x5583fa4e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.006+0000 7fb757400640 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa4e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.006+0000 7fb757400640 1 -- 172.21.15.100:0/1081319317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583fa3cdb00 con 0x5583fa5554d0 2024-02-21T07:49:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.007+0000 7fb757400640 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb7440c6bf0 tx=0x7fb74400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ce9baa316131414 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.007+0000 7fb74cc00640 1 -- 172.21.15.100:0/1081319317 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74409aee0 con 0x5583fa5554d0 2024-02-21T07:49:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.007+0000 7fb74cc00640 1 -- 172.21.15.100:0/1081319317 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74409f530 con 0x5583fa5554d0 2024-02-21T07:49:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.007+0000 7fb74cc00640 1 -- 172.21.15.100:0/1081319317 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744093370 con 0x5583fa5554d0 2024-02-21T07:49:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.008+0000 7fb761fab740 1 -- 172.21.15.100:0/1081319317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 msgr2=0x5583fa4e5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.008+0000 7fb761fab740 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb7440c6bf0 tx=0x7fb74400cf90 comp rx=0 tx=0).stop 2024-02-21T07:49:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 -- 172.21.15.100:0/1081319317 shutdown_connections 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa521450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e5a50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 --2- 172.21.15.100:0/1081319317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa4e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 -- 172.21.15.100:0/1081319317 >> 172.21.15.100:0/1081319317 conn(0x5583fa4ad4b0 msgr2=0x5583fa4e4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 -- 172.21.15.100:0/1081319317 shutdown_connections 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.010+0000 7fb761fab740 1 -- 172.21.15.100:0/1081319317 wait complete. 2024-02-21T07:49:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.011+0000 7fb761fab740 1 -- start start 2024-02-21T07:49:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.011+0000 7fb761fab740 1 Processor -- start 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa54a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa521070 0x5583fa51b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa44c5d0 con 0x5583fa5554d0 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa3f1b50 con 0x5583fa4e5f90 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa3f17f0 con 0x5583fa521070 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.012+0000 7fb761fab740 10 client.0 _ll_register_callbacks cb 0x5583fa405550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55752/0 (socket says 172.21.15.100:55752) 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 -- 172.21.15.100:0/824346691 learned_addr learned my addr 172.21.15.100:0/824346691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:48.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb757400640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa521070 0x5583fa51b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 -- 172.21.15.100:0/824346691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa521070 msgr2=0x5583fa51b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa521070 0x5583fa51b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 -- 172.21.15.100:0/824346691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 msgr2=0x5583fa54a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa54a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.013+0000 7fb75d200640 1 -- 172.21.15.100:0/824346691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7582258b0 con 0x5583fa5554d0 2024-02-21T07:49:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb75d200640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb750001510 tx=0x7fb750007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bdcc5cf4735f08 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb741600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500020d0 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb750010450 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583fa41ecd0 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb750010630 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb761fab740 10 client.5712 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.014+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5583fa44ac50 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750021020 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb750010790 con 0x5583fa5554d0 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 10 client.5712 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 10 client.5712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 20 client.5712 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa548fc0 0x5583fa549850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 4 client.5712 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.015+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583fa442ce0 con 0x5583fa548fc0 2024-02-21T07:49:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.016+0000 7fb757e00640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa548fc0 0x5583fa549850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.016+0000 7fb757e00640 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa548fc0 0x5583fa549850 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748cf0c8cff634e6 server_cookie=1dd54c64c5c02473 in_seq=0 out_seq=0 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.016+0000 7fb741600640 10 client.5712 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb741600640 1 -- 172.21.15.100:0/824346691 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5583fa442ce0 con 0x5583fa548fc0 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb741600640 10 client.5712 handle_command_reply: tid=0 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 client.5712 shutdown 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 msgr2=0x5583fa51ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb750001510 tx=0x7fb750007b60 comp rx=0 tx=0).stop 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 shutdown_connections 2024-02-21T07:49:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa548fc0 0x5583fa549850 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa5554d0 0x5583fa51ac20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa521070 0x5583fa51b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 --2- 172.21.15.100:0/824346691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa54a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb741600640 0 client.5712 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.017+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 >> 172.21.15.100:0/824346691 conn(0x5583fa4ad4b0 msgr2=0x5583fa4ebe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.018+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 shutdown_connections 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.018+0000 7fb761fab740 1 -- 172.21.15.100:0/824346691 wait complete. 2024-02-21T07:49:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.018+0000 7fb761fab740 20 client.5712 trim_cache size 0 max 16384 2024-02-21T07:49:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.048+0000 7fb761fab740 1 Processor -- start 2024-02-21T07:49:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.048+0000 7fb761fab740 1 -- start start 2024-02-21T07:49:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa521070 0x5583fa542130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa194e60 con 0x5583fa4e5f90 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa4e3cc0 con 0x5583fa521070 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.050+0000 7fb761fab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa557590 con 0x5583fa5554d0 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.051+0000 7fb757e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.051+0000 7fb757e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55754/0 (socket says 172.21.15.100:55754) 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.051+0000 7fb757e00640 1 -- 172.21.15.100:0/3215666242 learned_addr learned my addr 172.21.15.100:0/3215666242 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.052+0000 7fb757e00640 1 -- 172.21.15.100:0/3215666242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 msgr2=0x5583fa4ec0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.052+0000 7fb757e00640 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4ec0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.052+0000 7fb757e00640 1 -- 172.21.15.100:0/3215666242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa521070 msgr2=0x5583fa542130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.052+0000 7fb757e00640 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa521070 0x5583fa542130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.052+0000 7fb757e00640 1 -- 172.21.15.100:0/3215666242 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583fa3e7530 con 0x5583fa4e5f90 2024-02-21T07:49:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.054+0000 7fb757e00640 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7480098c0 tx=0x7fb74802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a76d0711302c285 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:48.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.055+0000 7fb743e00640 1 -- 172.21.15.100:0/3215666242 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74804d040 con 0x5583fa4e5f90 2024-02-21T07:49:48.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.055+0000 7fb743e00640 1 -- 172.21.15.100:0/3215666242 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74804f040 con 0x5583fa4e5f90 2024-02-21T07:49:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.055+0000 7fb743e00640 1 -- 172.21.15.100:0/3215666242 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7480545c0 con 0x5583fa4e5f90 2024-02-21T07:49:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.056+0000 7fb761fab740 1 -- 172.21.15.100:0/3215666242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 msgr2=0x5583fa4dbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.056+0000 7fb761fab740 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb7480098c0 tx=0x7fb74802f000 comp rx=0 tx=0).stop 2024-02-21T07:49:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.057+0000 7fb761fab740 1 -- 172.21.15.100:0/3215666242 shutdown_connections 2024-02-21T07:49:48.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.057+0000 7fb761fab740 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4ec0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.057+0000 7fb761fab740 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa521070 0x5583fa542130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.057+0000 7fb761fab740 1 --2- 172.21.15.100:0/3215666242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa4e5f90 0x5583fa4dbd50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.057+0000 7fb761fab740 1 -- 172.21.15.100:0/3215666242 >> 172.21.15.100:0/3215666242 conn(0x5583fa4ad4b0 msgr2=0x5583fa553640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:48.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.058+0000 7fb761fab740 1 -- 172.21.15.100:0/3215666242 shutdown_connections 2024-02-21T07:49:48.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.059+0000 7fb761fab740 1 -- 172.21.15.100:0/3215666242 wait complete. 2024-02-21T07:49:48.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.060+0000 7fb761fab740 1 -- start start 2024-02-21T07:49:48.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.066+0000 7fb761fab740 1 Processor -- start 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa548550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa51cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa54a200 con 0x5583fa521070 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa5c47c0 con 0x5583fa4e5f90 2024-02-21T07:49:48.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583fa549d70 con 0x5583fa5554d0 2024-02-21T07:49:48.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.076+0000 7fb761fab740 10 client.0 _ll_register_callbacks cb 0x7fb744096b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:48.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41244/0 (socket says 172.21.15.100:41244) 2024-02-21T07:49:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 -- 172.21.15.100:0/3272812015 learned_addr learned my addr 172.21.15.100:0/3272812015 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 -- 172.21.15.100:0/3272812015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 msgr2=0x5583fa548550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:48.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa548550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.082+0000 7fb75d200640 1 -- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 msgr2=0x5583fa51cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:48.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.083+0000 7fb757400640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa51cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.083+0000 7fb75d200640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa51cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.083+0000 7fb75d200640 1 -- 172.21.15.100:0/3272812015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7580cc660 con 0x5583fa5554d0 2024-02-21T07:49:48.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.087+0000 7fb75d200640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb750005d90 tx=0x7fb750007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56728f3f9c6c4620 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.090+0000 7fb741600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750001e60 con 0x5583fa5554d0 2024-02-21T07:49:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb750022080 con 0x5583fa5554d0 2024-02-21T07:49:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583fa471d30 con 0x5583fa5554d0 2024-02-21T07:49:48.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb750007780 con 0x5583fa5554d0 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb761fab740 10 client.5813 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.091+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5583fa40d2c0 con 0x5583fa5554d0 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583fa471d30 con 0x5583fa5554d0 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb750004b60 con 0x5583fa5554d0 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 10 client.5813 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:48.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 10 client.5813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 20 client.5813 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa5b6940 0x5583fa553640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 4 client.5813 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:49:48.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5583fa14c600 con 0x5583fa5b6940 2024-02-21T07:49:48.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.093+0000 7fb757e00640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa5b6940 0x5583fa553640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:48.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.094+0000 7fb757e00640 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa5b6940 0x5583fa553640 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3457542bd15191b5 server_cookie=9c3b3c8d791e5533 in_seq=0 out_seq=0 2024-02-21T07:49:48.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.094+0000 7fb741600640 10 client.5813 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.119+0000 7fb741600640 1 -- 172.21.15.100:0/3272812015 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5583fa14c600 con 0x5583fa5b6940 2024-02-21T07:49:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.119+0000 7fb741600640 10 client.5813 handle_command_reply: tid=0 2024-02-21T07:49:48.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.119+0000 7fb761fab740 1 client.5813 shutdown 2024-02-21T07:49:48.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.123+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 msgr2=0x5583fa4e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.128 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.123+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb750005d90 tx=0x7fb750007ec0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.129 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 shutdown_connections 2024-02-21T07:49:48.129 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5583fa5b6940 0x5583fa553640 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.129 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5583fa5554d0 0x5583fa4e4c60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5583fa521070 0x5583fa51cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 --2- 172.21.15.100:0/3272812015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5583fa4e5f90 0x5583fa548550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.124+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 >> 172.21.15.100:0/3272812015 conn(0x5583fa4ad4b0 msgr2=0x5583fa4dbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.125+0000 7fb741600640 0 client.5813 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.125+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 shutdown_connections 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.125+0000 7fb761fab740 1 -- 172.21.15.100:0/3272812015 wait complete. 2024-02-21T07:49:48.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.126+0000 7fb761fab740 20 client.5813 trim_cache size 0 max 16384 2024-02-21T07:49:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:49:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:49:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:49:48.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 msgr2=0x7fb7380a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 0x7fb7380a16b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb74802b6c0 tx=0x7fb748008030 comp rx=0 tx=0).stop 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 msgr2=0x7fb75818ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 0x7fb75818ae20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb74400c4a0 tx=0x7fb74400c960 comp rx=0 tx=0).stop 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 shutdown_connections 2024-02-21T07:49:48.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb73809f1f0 0x7fb7380a16b0 secure :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb74802b6c0 tx=0x7fb748008030 comp rx=0 tx=0).stop 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb75818a590 0x7fb75818b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7580f61d0 0x7fb75818ae20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 --2- 172.21.15.100:0/1281002729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7580cd960 0x7fb75817be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.127+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 >> 172.21.15.100:0/1281002729 conn(0x7fb7580ce1b0 msgr2=0x7fb75818f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.129+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 shutdown_connections 2024-02-21T07:49:48.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:49:48.129+0000 7fb75f200640 1 -- 172.21.15.100:0/1281002729 wait complete. 2024-02-21T07:49:50.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:49:50.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:49:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.874+0000 7f50dac00640 1 Processor -- start 2024-02-21T07:49:50.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.877+0000 7f50dac00640 1 -- start start 2024-02-21T07:49:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.880+0000 7f50dac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d418dc80 con 0x7f50d406edc0 2024-02-21T07:49:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.880+0000 7f50dac00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40f55d0 con 0x7f50d4070a30 2024-02-21T07:49:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.880+0000 7f50dac00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40f58b0 con 0x7f50d4190260 2024-02-21T07:49:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.880+0000 7f50d3e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f50d4190260 0x7f50d40f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:57960/0 (socket says 172.21.15.100:57960) 2024-02-21T07:49:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.880+0000 7f50d3e00640 1 -- 172.21.15.100:0/3493854586 learned_addr learned my addr 172.21.15.100:0/3493854586 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:50.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033882692 0 0) 0x7f50d40f58b0 con 0x7f50d4190260 2024-02-21T07:49:50.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8003520 con 0x7f50d4190260 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291658005 0 0) 0x7f50d40f55d0 con 0x7f50d4070a30 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d40f58b0 con 0x7f50d4070a30 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698081622 0 0) 0x7f50d418dc80 con 0x7f50d406edc0 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d40f55d0 con 0x7f50d406edc0 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2961357588 0 0) 0x7f50b8003520 con 0x7f50d4190260 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 >> v1:172.21.15.156:6789/0 conn(0x7f50d4070a30 legacy=0x7f50d406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 >> v1:172.21.15.100:6789/0 conn(0x7f50d406edc0 legacy=0x7f50d4190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.881+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d406dbd0 con 0x7f50d4190260 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.882+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f50bc0015f0 con 0x7f50d4190260 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.882+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 >> v1:172.21.15.170:6789/0 conn(0x7f50d4190260 legacy=0x7f50d40f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.882+0000 7f50d2a00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b8003d30 0x7f50b8004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.882+0000 7f50d2a00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 0x7f50b8004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d2a00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8009970 0x7f50b800bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800c350 con 0x7f50b8009970 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800c490 con 0x7f50b8003d30 2024-02-21T07:49:50.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800c650 con 0x7f50b8004880 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b8003d30 0x7f50b8004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d3400640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 0x7f50b8004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.883+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8009970 0x7f50b800bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d3400640 1 -- 172.21.15.100:0/3493854586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b8003d30 msgr2=0x7f50b8004110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d3400640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50b8003d30 0x7f50b8004110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d3400640 1 -- 172.21.15.100:0/3493854586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8009970 msgr2=0x7f50b800bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d3400640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8009970 0x7f50b800bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d3400640 1 -- 172.21.15.100:0/3493854586 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8003520 con 0x7f50b8004880 2024-02-21T07:49:50.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.884+0000 7f50d8c00640 1 -- 172.21.15.100:0/3493854586 reap_dead start 2024-02-21T07:49:50.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.885+0000 7f50d3400640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 0x7f50b8004d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f50c4001fc0 tx=0x7f50b80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ba7f694f1d8de6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.886+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4006d50 con 0x7f50b8004880 2024-02-21T07:49:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.886+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4003970 con 0x7f50b8004880 2024-02-21T07:49:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.886+0000 7f50d2a00640 1 -- 172.21.15.100:0/3493854586 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4003da0 con 0x7f50b8004880 2024-02-21T07:49:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.887+0000 7f50dac00640 1 -- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 msgr2=0x7f50b8004d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.887+0000 7f50dac00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 0x7f50b8004d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f50c4001fc0 tx=0x7f50b80057f0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.888+0000 7f50dac00640 1 -- 172.21.15.100:0/3493854586 shutdown_connections 2024-02-21T07:49:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.888+0000 7f50dac00640 1 --2- 172.21.15.100:0/3493854586 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50b8004880 0x7f50b8004d00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.888+0000 7f50dac00640 1 -- 172.21.15.100:0/3493854586 >> 172.21.15.100:0/3493854586 conn(0x7f50d40668b0 msgr2=0x7f50d4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.888+0000 7f50dac00640 1 -- 172.21.15.100:0/3493854586 shutdown_connections 2024-02-21T07:49:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.888+0000 7f50dac00640 1 -- 172.21.15.100:0/3493854586 wait complete. 2024-02-21T07:49:50.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.893+0000 7f50dac00640 1 Processor -- start 2024-02-21T07:49:50.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.893+0000 7f50dac00640 1 -- start start 2024-02-21T07:49:50.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 0x7f50d4171130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 0x7f50d4167150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 0x7f50d40cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d4171670 con 0x7f50b8004880 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d416f6c0 con 0x7f50d4166cd0 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50dac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d416f9a0 con 0x7f50d40cbd90 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50d3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 0x7f50d4167150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50d8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 0x7f50d40cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50d3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 0x7f50d4167150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44668/0 (socket says 172.21.15.100:44668) 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50d3400640 1 -- 172.21.15.100:0/3914958457 learned_addr learned my addr 172.21.15.100:0/3914958457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.896+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 0x7f50d4171130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 -- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 msgr2=0x7f50d4167150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 0x7f50d4167150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 -- 172.21.15.100:0/3914958457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 msgr2=0x7f50d4171130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 0x7f50d4171130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 -- 172.21.15.100:0/3914958457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d416fc80 con 0x7f50d40cbd90 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 0x7f50d4171130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 0x7f50d40cc210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f50d408de90 tx=0x7f50cc00e820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50cbe00640 1 -- 172.21.15.100:0/3914958457 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0052e0 con 0x7f50d40cbd90 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50cbe00640 1 -- 172.21.15.100:0/3914958457 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc005460 con 0x7f50d40cbd90 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50cbe00640 1 -- 172.21.15.100:0/3914958457 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc003830 con 0x7f50d40cbd90 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.897+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d416ff60 con 0x7f50d40cbd90 2024-02-21T07:49:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.898+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d40cc750 con 0x7f50d40cbd90 2024-02-21T07:49:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.901+0000 7f50cbe00640 1 -- 172.21.15.100:0/3914958457 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f50cc003990 con 0x7f50d40cbd90 2024-02-21T07:49:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.903+0000 7f50dd82e740 1 Processor -- start 2024-02-21T07:49:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.903+0000 7f50dd82e740 1 -- start start 2024-02-21T07:49:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.903+0000 7f50cbe00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 0x7f50b00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.904+0000 7f50cbe00640 1 -- 172.21.15.100:0/3914958457 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f50cc0c8e80 con 0x7f50d40cbd90 2024-02-21T07:49:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.904+0000 7f50d3400640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 0x7f50b00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a45a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a103a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542947150 con 0x55e542a0ffc0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542944680 con 0x55e542a108e0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50dd82e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54293fe60 con 0x55e542a45f80 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d8c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d8c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44678/0 (socket says 172.21.15.100:44678) 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d8c00640 1 -- 172.21.15.100:0/1690711379 learned_addr learned my addr 172.21.15.100:0/1690711379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d3400640 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d3400640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 0x7f50b00a1560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50d4196d80 tx=0x7f50c4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.905+0000 7f50d3e00640 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a45a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 -- 172.21.15.100:0/1690711379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 msgr2=0x55e542a103a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a103a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 -- 172.21.15.100:0/1690711379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 msgr2=0x55e542a45a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a45a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 -- 172.21.15.100:0/1690711379 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5428f9060 con 0x55e542a108e0 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50d8c00640 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0c6760 tx=0x7f50cc096ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58378e36edd6a1fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50c3e00640 1 -- 172.21.15.100:0/1690711379 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc094d10 con 0x55e542a108e0 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50c3e00640 1 -- 172.21.15.100:0/1690711379 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc093080 con 0x55e542a108e0 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.906+0000 7f50c3e00640 1 -- 172.21.15.100:0/1690711379 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc003e60 con 0x55e542a108e0 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 -- 172.21.15.100:0/1690711379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 msgr2=0x55e5429d2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0c6760 tx=0x7f50cc096ad0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 -- 172.21.15.100:0/1690711379 shutdown_connections 2024-02-21T07:49:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e5429d2ef0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 --2- 172.21.15.100:0/1690711379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a45a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.907+0000 7f50dd82e740 1 -- 172.21.15.100:0/1690711379 >> 172.21.15.100:0/1690711379 conn(0x55e54299f5a0 msgr2=0x55e5429d6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.908+0000 7f50dd82e740 1 -- 172.21.15.100:0/1690711379 shutdown_connections 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.908+0000 7f50dd82e740 1 -- 172.21.15.100:0/1690711379 wait complete. 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.909+0000 7f50dd82e740 1 -- start start 2024-02-21T07:49:50.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.909+0000 7f50dd82e740 1 Processor -- start 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e5429ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e5429d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5428e4ec0 con 0x55e542a0ffc0 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5428e4b60 con 0x55e542a108e0 2024-02-21T07:49:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5426ae1c0 con 0x55e542a45f80 2024-02-21T07:49:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.911+0000 7f50dd82e740 10 client.0 _ll_register_callbacks cb 0x55e5428f8960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44680/0 (socket says 172.21.15.100:44680) 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 -- 172.21.15.100:0/3676600915 learned_addr learned my addr 172.21.15.100:0/3676600915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e5429d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e5429ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 -- 172.21.15.100:0/3676600915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 msgr2=0x55e5429d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e5429d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 -- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 msgr2=0x55e5429ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e5429ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.912+0000 7f50d3400640 1 -- 172.21.15.100:0/3676600915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d40cc750 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e5429ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50d3400640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50c402c1a0 tx=0x7f50c40016a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7246e0574d85d52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4051070 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f50c402c740 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.913+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e54263f7e0 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50c402c900 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 10 client.5878 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e54293e4e0 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e54263f7e0 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f50c4054020 con 0x55e542a108e0 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 10 client.5878 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:50.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 10 client.5878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 20 client.5878 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e5429d33a0 0x55e542a5b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 4 client.5878 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:50.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.914+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e54267c720 con 0x55e5429d33a0 2024-02-21T07:49:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.915+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e5429d33a0 0x55e542a5b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.915+0000 7f50d3e00640 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e5429d33a0 0x55e542a5b5d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888274d7378222b7 server_cookie=1c9b5ffec7099bb5 in_seq=0 out_seq=0 2024-02-21T07:49:50.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.915+0000 7f50c0c00640 10 client.5878 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50c0c00640 1 -- 172.21.15.100:0/3676600915 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e54267c720 con 0x55e5429d33a0 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50c0c00640 10 client.5878 handle_command_reply: tid=0 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 client.5878 shutdown 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 msgr2=0x55e542a1aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f50c402c1a0 tx=0x7f50c40016a0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 shutdown_connections 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e5429d33a0 0x55e542a5b5d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e5429d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a1aba0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3676600915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e5429ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 >> 172.21.15.100:0/3676600915 conn(0x55e54299f5a0 msgr2=0x55e542a47c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.916+0000 7f50c0c00640 0 client.5878 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.917+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 shutdown_connections 2024-02-21T07:49:50.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.917+0000 7f50dd82e740 1 -- 172.21.15.100:0/3676600915 wait complete. 2024-02-21T07:49:50.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.917+0000 7f50dd82e740 20 client.5878 trim_cache size 0 max 16384 2024-02-21T07:49:50.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.948+0000 7f50dd82e740 1 Processor -- start 2024-02-21T07:49:50.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.949+0000 7f50dd82e740 1 -- start start 2024-02-21T07:49:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.955+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.956+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 0x55e542a16cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.956+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a45f80 0x55e5429d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.956+0000 7f50dd82e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542a0bed0 con 0x55e542a0ffc0 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.956+0000 7f50dd82e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542a0c170 con 0x55e542a45f80 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.956+0000 7f50dd82e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542a19070 con 0x55e542a108e0 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48146/0 (socket says 172.21.15.100:48146) 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3e00640 1 -- 172.21.15.100:0/3590360126 learned_addr learned my addr 172.21.15.100:0/3590360126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:50.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3400640 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 0x55e542a16cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d8c00640 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a45f80 0x55e5429d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3400640 1 -- 172.21.15.100:0/3590360126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a45f80 msgr2=0x55e5429d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.957+0000 7f50d3400640 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a45f80 0x55e5429d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50d3400640 1 -- 172.21.15.100:0/3590360126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 msgr2=0x55e542a49c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50d3400640 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50d3400640 1 -- 172.21.15.100:0/3590360126 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5428da950 con 0x55e542a108e0 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50d3400640 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 0x55e542a16cf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f50c4001ee0 tx=0x7f50c404b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9509af6e8994a5dc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50c3400640 1 -- 172.21.15.100:0/3590360126 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4051040 con 0x55e542a108e0 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50c3400640 1 -- 172.21.15.100:0/3590360126 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4045070 con 0x55e542a108e0 2024-02-21T07:49:50.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.958+0000 7f50c3400640 1 -- 172.21.15.100:0/3590360126 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c402c980 con 0x55e542a108e0 2024-02-21T07:49:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 -- 172.21.15.100:0/3590360126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 msgr2=0x55e542a16cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 0x55e542a16cf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f50c4001ee0 tx=0x7f50c404b000 comp rx=0 tx=0).stop 2024-02-21T07:49:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 -- 172.21.15.100:0/3590360126 shutdown_connections 2024-02-21T07:49:50.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a45f80 0x55e5429d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a108e0 0x55e542a16cf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 --2- 172.21.15.100:0/3590360126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.962+0000 7f50dd82e740 1 -- 172.21.15.100:0/3590360126 >> 172.21.15.100:0/3590360126 conn(0x55e54299f5a0 msgr2=0x55e5429fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.963+0000 7f50dd82e740 1 -- 172.21.15.100:0/3590360126 shutdown_connections 2024-02-21T07:49:50.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.963+0000 7f50dd82e740 1 -- 172.21.15.100:0/3590360126 wait complete. 2024-02-21T07:49:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.964+0000 7f50dd82e740 1 -- start start 2024-02-21T07:49:50.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.965+0000 7f50dd82e740 1 Processor -- start 2024-02-21T07:49:50.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a5ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5429d7700 con 0x55e542a0ffc0 2024-02-21T07:49:50.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e542a46d50 con 0x55e542a108e0 2024-02-21T07:49:50.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5429f1010 con 0x55e542a45f80 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50dd82e740 10 client.0 _ll_register_callbacks cb 0x7f50b80039d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50d8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a5ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50d8c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a5ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41306/0 (socket says 172.21.15.100:41306) 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50d8c00640 1 -- 172.21.15.100:0/577239656 learned_addr learned my addr 172.21.15.100:0/577239656 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.967+0000 7f50d3400640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.968+0000 7f50d3e00640 1 -- 172.21.15.100:0/577239656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 msgr2=0x55e542a5ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.968+0000 7f50d3e00640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a5ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.968+0000 7f50d3e00640 1 -- 172.21.15.100:0/577239656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 msgr2=0x55e542a3cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:50.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.968+0000 7f50d3e00640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a3cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.968+0000 7f50d3e00640 1 -- 172.21.15.100:0/577239656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e54293e4e0 con 0x55e542a0ffc0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.973+0000 7f50d3e00640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55e5429d45f0 tx=0x7f50bc007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15f0fceea9441f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.973+0000 7f50c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.974+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc020040 con 0x55e542a0ffc0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.974+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f50bc0166f0 con 0x55e542a0ffc0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.974+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50cc093080 con 0x55e542a0ffc0 2024-02-21T07:49:50.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.974+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50bc0168b0 con 0x55e542a0ffc0 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.975+0000 7f50dd82e740 10 client.5730 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.975+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55e542900430 con 0x55e542a0ffc0 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.975+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc093080 con 0x55e542a0ffc0 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f50bc016a10 con 0x55e542a0ffc0 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 10 client.5730 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 10 client.5730 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 20 client.5730 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e542a68e10 0x55e5429d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 4 client.5730 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.976+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e5426cb890 con 0x55e542a68e10 2024-02-21T07:49:50.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.979+0000 7f50d3400640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e542a68e10 0x55e5429d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:50.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.988+0000 7f50d3400640 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e542a68e10 0x55e5429d25b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24463ea1ee5b67b0 server_cookie=a9761e526dabb65d in_seq=0 out_seq=0 2024-02-21T07:49:50.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.988+0000 7f50c0c00640 10 client.5730 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:50.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.988+0000 7f50c0c00640 1 -- 172.21.15.100:0/577239656 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e5426cb890 con 0x55e542a68e10 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.988+0000 7f50c0c00640 10 client.5730 handle_command_reply: tid=0 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.988+0000 7f50dd82e740 1 client.5730 shutdown 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 msgr2=0x55e542a49c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x55e5429d45f0 tx=0x7f50bc007490 comp rx=0 tx=0).stop 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 shutdown_connections 2024-02-21T07:49:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e542a68e10 0x55e5429d25b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50c0c00640 0 client.5730 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:50.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e542a45f80 0x55e542a5ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e542a108e0 0x55e542a3cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 --2- 172.21.15.100:0/577239656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e542a0ffc0 0x55e542a49c20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.989+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 >> 172.21.15.100:0/577239656 conn(0x55e54299f5a0 msgr2=0x55e542a441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.990+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 shutdown_connections 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.990+0000 7f50dd82e740 1 -- 172.21.15.100:0/577239656 wait complete. 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.990+0000 7f50dd82e740 20 client.5730 trim_cache size 0 max 16384 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:49:50.995 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:50.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 msgr2=0x7f50b00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 0x7f50b00a1560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50d4196d80 tx=0x7f50c4030000 comp rx=0 tx=0).stop 2024-02-21T07:49:50.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 msgr2=0x7f50d40cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:50.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 0x7f50d40cc210 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f50d408de90 tx=0x7f50cc00e820 comp rx=0 tx=0).stop 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 shutdown_connections 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50d40cbd90 0x7f50d40cc210 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f50d4166cd0 0x7f50d4167150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f50b009f0a0 0x7f50b00a1560 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 --2- 172.21.15.100:0/3914958457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50b8004880 0x7f50d4171130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 >> 172.21.15.100:0/3914958457 conn(0x7f50d40668b0 msgr2=0x7f50d406f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 shutdown_connections 2024-02-21T07:49:50.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:50.992+0000 7f50dac00640 1 -- 172.21.15.100:0/3914958457 wait complete. 2024-02-21T07:49:51.019 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:49:51.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:49:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.397+0000 7fd745e00640 1 Processor -- start 2024-02-21T07:49:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.398+0000 7fd745e00640 1 -- start start 2024-02-21T07:49:51.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.400+0000 7fd745e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7400cec50 0x7fd740188920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.409+0000 7fd745e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd740183380 0x7fd740070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.409+0000 7fd745e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7401824a0 con 0x7fd740182030 2024-02-21T07:49:51.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.409+0000 7fd745e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7401857a0 con 0x7fd7400cec50 2024-02-21T07:49:51.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.409+0000 7fd745e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7400f81f0 con 0x7fd740183380 2024-02-21T07:49:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.411+0000 7fd73ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7400cec50 0x7fd740188920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.411+0000 7fd73ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7400cec50 0x7fd740188920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48170/0 (socket says 172.21.15.100:48170) 2024-02-21T07:49:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.411+0000 7fd73ea00640 1 -- 172.21.15.100:0/3022480371 learned_addr learned my addr 172.21.15.100:0/3022480371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:51.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.411+0000 7fd73e000640 1 --1- 172.21.15.100:0/3022480371 >> v1:172.21.15.170:6789/0 conn(0x7fd740182030 0x7fd740182c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:57962/0 (socket says 172.21.15.100:57962) 2024-02-21T07:49:51.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.411+0000 7fd73f400640 1 --2- 172.21.15.100:0/3022480371 >> v2:172.21.15.156:3300/0 conn(0x7fd740183380 0x7fd740070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:51.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.412+0000 7fd73ea00640 1 -- 172.21.15.100:0/3022480371 >> v2:172.21.15.156:3300/0 conn(0x7fd740183380 msgr2=0x7fd740070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:51.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.412+0000 7fd73ea00640 1 --2- 172.21.15.100:0/3022480371 >> v2:172.21.15.156:3300/0 conn(0x7fd740183380 0x7fd740070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.412+0000 7fd73ea00640 1 -- 172.21.15.100:0/3022480371 >> v1:172.21.15.170:6789/0 conn(0x7fd740182030 legacy=0x7fd740182c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.412+0000 7fd73ea00640 1 -- 172.21.15.100:0/3022480371 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400f84d0 con 0x7fd7400cec50 2024-02-21T07:49:51.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.419+0000 7fd73ea00640 1 --2- 172.21.15.100:0/3022480371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd740188920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd740070370 tx=0x7fd73002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78b0b76b5130574 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.425+0000 7fd73d600640 1 -- 172.21.15.100:0/3022480371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730031870 con 0x7fd7400cec50 2024-02-21T07:49:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.425+0000 7fd73d600640 1 -- 172.21.15.100:0/3022480371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7300319d0 con 0x7fd7400cec50 2024-02-21T07:49:51.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.425+0000 7fd73d600640 1 -- 172.21.15.100:0/3022480371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730031d60 con 0x7fd7400cec50 2024-02-21T07:49:51.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.426+0000 7fd745e00640 1 -- 172.21.15.100:0/3022480371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 msgr2=0x7fd740188920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.426+0000 7fd745e00640 1 --2- 172.21.15.100:0/3022480371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd740188920 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd740070370 tx=0x7fd73002b910 comp rx=0 tx=0).stop 2024-02-21T07:49:51.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.429+0000 7fd745e00640 1 -- 172.21.15.100:0/3022480371 shutdown_connections 2024-02-21T07:49:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.429+0000 7fd745e00640 1 --2- 172.21.15.100:0/3022480371 >> v2:172.21.15.156:3300/0 conn(0x7fd740183380 0x7fd740070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.429+0000 7fd745e00640 1 --2- 172.21.15.100:0/3022480371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd740188920 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.429+0000 7fd745e00640 1 -- 172.21.15.100:0/3022480371 >> 172.21.15.100:0/3022480371 conn(0x7fd7400ce160 msgr2=0x7fd7400ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.429+0000 7fd745e00640 1 -- 172.21.15.100:0/3022480371 shutdown_connections 2024-02-21T07:49:51.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.430+0000 7fd745e00640 1 -- 172.21.15.100:0/3022480371 wait complete. 2024-02-21T07:49:51.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.436+0000 7fd745e00640 1 Processor -- start 2024-02-21T07:49:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.436+0000 7fd745e00640 1 -- start start 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.446+0000 7fd745e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd74021df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.446+0000 7fd745e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd740182030 0x7fd74016ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.446+0000 7fd745e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.446+0000 7fd745e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74021f620 con 0x7fd7400cec50 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd73e000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd740182030 0x7fd74016ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:51.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd745e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74021e460 con 0x7fd740183380 2024-02-21T07:49:51.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd745e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74021e730 con 0x7fd740182030 2024-02-21T07:49:51.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd73f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:51.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd73f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44722/0 (socket says 172.21.15.100:44722) 2024-02-21T07:49:51.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.447+0000 7fd73f400640 1 -- 172.21.15.100:0/2703916759 learned_addr learned my addr 172.21.15.100:0/2703916759 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:51.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.448+0000 7fd73f400640 1 -- 172.21.15.100:0/2703916759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd740182030 msgr2=0x7fd74016ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.448+0000 7fd73f400640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd740182030 0x7fd74016ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.448+0000 7fd73f400640 1 -- 172.21.15.100:0/2703916759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 msgr2=0x7fd74021df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.448+0000 7fd73f400640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd74021df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.448+0000 7fd73f400640 1 -- 172.21.15.100:0/2703916759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300094d0 con 0x7fd740183380 2024-02-21T07:49:51.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.451+0000 7fd73f400640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd73800efc0 tx=0x7fd73800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.454+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738009ba0 con 0x7fd740183380 2024-02-21T07:49:51.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.455+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74021ea10 con 0x7fd740183380 2024-02-21T07:49:51.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.455+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74021efd0 con 0x7fd740183380 2024-02-21T07:49:51.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.456+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73800f040 con 0x7fd740183380 2024-02-21T07:49:51.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.456+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738009ba0 con 0x7fd740183380 2024-02-21T07:49:51.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.463+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7180096a0 con 0x7fd740183380 2024-02-21T07:49:51.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.489+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd738014480 con 0x7fd740183380 2024-02-21T07:49:51.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.492+0000 7fd737400640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 0x7fd7200a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.493+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd7380ca460 con 0x7fd740183380 2024-02-21T07:49:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.493+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd7380ca8e0 con 0x7fd740183380 2024-02-21T07:49:51.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.493+0000 7fd73ea00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 0x7fd7200a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:51.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.496+0000 7fd73ea00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 0x7fd7200a1640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd730036000 tx=0x7fd730030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:51.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.957+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd718009d00 con 0x7fd740183380 2024-02-21T07:49:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.958+0000 7fd737400640 1 -- 172.21.15.100:0/2703916759 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11340 (secure 0 0 0) 0x7fd718009d00 con 0x7fd740183380 2024-02-21T07:49:51.964 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:49:51.964 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:46:21.282951+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:49:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-02-21T07:49:51.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 msgr2=0x7fd7200a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 0x7fd7200a1640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd730036000 tx=0x7fd730030000 comp rx=0 tx=0).stop 2024-02-21T07:49:51.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 msgr2=0x7fd74021aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:51.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd73800efc0 tx=0x7fd73800c490 comp rx=0 tx=0).stop 2024-02-21T07:49:51.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 shutdown_connections 2024-02-21T07:49:51.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.962+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd740183380 0x7fd74021aa20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.963+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd740182030 0x7fd74016ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.963+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd72009f180 0x7fd7200a1640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.963+0000 7fd745e00640 1 --2- 172.21.15.100:0/2703916759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7400cec50 0x7fd74021df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:51.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.963+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 >> 172.21.15.100:0/2703916759 conn(0x7fd7400ce160 msgr2=0x7fd7400ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:51.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.964+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 shutdown_connections 2024-02-21T07:49:51.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:51.964+0000 7fd745e00640 1 -- 172.21.15.100:0/2703916759 wait complete. 2024-02-21T07:49:52.010 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:52.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:49:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.387+0000 7fe57b000640 1 Processor -- start 2024-02-21T07:49:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.387+0000 7fe57b000640 1 -- start start 2024-02-21T07:49:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe57b000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe574071010 0x7fe5740713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe57b000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5740700c0 con 0x7fe574071930 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe57b000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5740703a0 con 0x7fe574071d70 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe57b000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57406ea40 con 0x7fe574071010 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe573400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe574071930 0x7fe57406f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:49156/0 (socket says 172.21.15.100:49156) 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.390+0000 7fe573400640 1 -- 172.21.15.100:0/1714567412 learned_addr learned my addr 172.21.15.100:0/1714567412 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe573e00640 1 --2- 172.21.15.100:0/1714567412 >> v2:172.21.15.100:3300/0 conn(0x7fe574071010 0x7fe5740713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1914022779 0 0) 0x7fe5740700c0 con 0x7fe574071930 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe558003520 con 0x7fe574071930 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3107883900 0 0) 0x7fe558003520 con 0x7fe574071930 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 >> v2:172.21.15.100:3300/0 conn(0x7fe574071010 msgr2=0x7fe5740713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 --2- 172.21.15.100:0/1714567412 >> v2:172.21.15.100:3300/0 conn(0x7fe574071010 0x7fe5740713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 >> v1:172.21.15.170:6789/0 conn(0x7fe574071d70 legacy=0x7fe574186920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574070680 con 0x7fe574071930 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fe560001690 con 0x7fe574071930 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe573e00640 1 --2- 172.21.15.100:0/1714567412 >> v2:172.21.15.100:3300/0 conn(0x7fe574071010 0x7fe5740713f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 >> v1:172.21.15.156:6789/0 conn(0x7fe574071930 legacy=0x7fe57406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe558003a10 0x7fe558003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5580047c0 0x7fe558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57406ea40 con 0x7fe5580047c0 2024-02-21T07:49:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55800c140 con 0x7fe5580052a0 2024-02-21T07:49:52.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.391+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55800c300 con 0x7fe558003a10 2024-02-21T07:49:52.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.395+0000 7fe579000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.400+0000 7fe579000640 1 -- 172.21.15.100:0/1714567412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe558003a10 msgr2=0x7fe558003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.396+0000 7fe573400640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5580047c0 0x7fe558004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.397+0000 7fe573e00640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe558003a10 0x7fe558003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.400+0000 7fe579000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe558003a10 0x7fe558003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.400+0000 7fe579000640 1 -- 172.21.15.100:0/1714567412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5580047c0 msgr2=0x7fe558004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.401+0000 7fe579000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5580047c0 0x7fe558004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.401+0000 7fe579000640 1 -- 172.21.15.100:0/1714567412 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558003520 con 0x7fe5580052a0 2024-02-21T07:49:52.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.401+0000 7fe573400640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5580047c0 0x7fe558004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:52.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.401+0000 7fe573e00640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe558003a10 0x7fe558003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:52.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.403+0000 7fe579000640 1 -- 172.21.15.100:0/1714567412 reap_dead start 2024-02-21T07:49:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.404+0000 7fe579000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe55800b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5740f0e60 tx=0x7fe5580057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2a8c32540e2382 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.405+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564032600 con 0x7fe5580052a0 2024-02-21T07:49:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.405+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56402e050 con 0x7fe5580052a0 2024-02-21T07:49:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.405+0000 7fe572a00640 1 -- 172.21.15.100:0/1714567412 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640329a0 con 0x7fe5580052a0 2024-02-21T07:49:52.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 -- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 msgr2=0x7fe55800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe55800b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe5740f0e60 tx=0x7fe5580057f0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 -- 172.21.15.100:0/1714567412 shutdown_connections 2024-02-21T07:49:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 --2- 172.21.15.100:0/1714567412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe55800b980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 -- 172.21.15.100:0/1714567412 >> 172.21.15.100:0/1714567412 conn(0x7fe5740668b0 msgr2=0x7fe574066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.406+0000 7fe57b000640 1 -- 172.21.15.100:0/1714567412 shutdown_connections 2024-02-21T07:49:52.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.407+0000 7fe57b000640 1 -- 172.21.15.100:0/1714567412 wait complete. 2024-02-21T07:49:52.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.410+0000 7fe57b000640 1 Processor -- start 2024-02-21T07:49:52.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.411+0000 7fe57b000640 1 -- start start 2024-02-21T07:49:52.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.412+0000 7fe57b000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe57b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5740f6160 0x7fe5740f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe57b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe57415b5f0 0x7fe574184120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe57b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57421aed0 con 0x7fe57415b5f0 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe57b000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574182e30 con 0x7fe5580052a0 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe57b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe574183c90 con 0x7fe5740f6160 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44738/0 (socket says 172.21.15.100:44738) 2024-02-21T07:49:52.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 -- 172.21.15.100:0/554380725 learned_addr learned my addr 172.21.15.100:0/554380725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 -- 172.21.15.100:0/554380725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5740f6160 msgr2=0x7fe5740f0eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5740f6160 0x7fe5740f0eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 -- 172.21.15.100:0/554380725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe57415b5f0 msgr2=0x7fe574184120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe57415b5f0 0x7fe574184120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.413+0000 7fe573e00640 1 -- 172.21.15.100:0/554380725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740f13f0 con 0x7fe5580052a0 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe573e00640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe56c007fa0 tx=0x7fe56c00e5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe56be00640 1 -- 172.21.15.100:0/554380725 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c015610 con 0x7fe5580052a0 2024-02-21T07:49:52.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe56be00640 1 -- 172.21.15.100:0/554380725 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c00f040 con 0x7fe5580052a0 2024-02-21T07:49:52.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe56be00640 1 -- 172.21.15.100:0/554380725 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c015970 con 0x7fe5580052a0 2024-02-21T07:49:52.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe574184660 con 0x7fe5580052a0 2024-02-21T07:49:52.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.414+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe574183360 con 0x7fe5580052a0 2024-02-21T07:49:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.419+0000 7fe56be00640 1 -- 172.21.15.100:0/554380725 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe56c015ad0 con 0x7fe5580052a0 2024-02-21T07:49:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.419+0000 7fe57dbd0740 1 Processor -- start 2024-02-21T07:49:52.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.420+0000 7fe57dbd0740 1 -- start start 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 0x55b87832eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878333950 0x55b8782fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87822c210 con 0x55b878333950 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b878229740 con 0x55b8782f9cb0 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b878224f20 con 0x55b878333dd0 2024-02-21T07:49:52.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe573400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe573400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41328/0 (socket says 172.21.15.100:41328) 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.422+0000 7fe573400640 1 -- 172.21.15.100:0/1003467950 learned_addr learned my addr 172.21.15.100:0/1003467950 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe579000640 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 0x55b87832eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 -- 172.21.15.100:0/1003467950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 msgr2=0x55b87832eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 0x55b87832eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 -- 172.21.15.100:0/1003467950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878333950 msgr2=0x55b8782fa090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878333950 0x55b8782fa090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 -- 172.21.15.100:0/1003467950 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8781e6df0 con 0x55b878333dd0 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe579000640 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 0x55b87832eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:52.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.423+0000 7fe573400640 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5740f43e0 tx=0x7fe560007ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480490d2a76ee4d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.424+0000 7fe568c00640 1 -- 172.21.15.100:0/1003467950 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560005d00 con 0x55b878333dd0 2024-02-21T07:49:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.424+0000 7fe568c00640 1 -- 172.21.15.100:0/1003467950 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560005e60 con 0x55b878333dd0 2024-02-21T07:49:52.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.424+0000 7fe568c00640 1 -- 172.21.15.100:0/1003467950 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600072f0 con 0x55b878333dd0 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe56be00640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 0x7fe5540a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1003467950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 msgr2=0x55b878330a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe5740f43e0 tx=0x7fe560007ce0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe56be00640 1 -- 172.21.15.100:0/554380725 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe56c0ca980 con 0x7fe5580052a0 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1003467950 shutdown_connections 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333dd0 0x55b878330a30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878333950 0x55b8782fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe579000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 0x7fe5540a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1003467950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b8782f9cb0 0x55b87832eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1003467950 >> 172.21.15.100:0/1003467950 conn(0x55b8782b9440 msgr2=0x55b8782c0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1003467950 shutdown_connections 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.425+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1003467950 wait complete. 2024-02-21T07:49:52.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.426+0000 7fe579000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 0x7fe5540a1610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c2d0 tx=0x7fe56402f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.427+0000 7fe57dbd0740 1 -- start start 2024-02-21T07:49:52.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.427+0000 7fe57dbd0740 1 Processor -- start 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782fed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b878349d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8781ca150 con 0x55b878349890 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8781c9df0 con 0x55b878333dd0 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b877f931c0 con 0x55b878333950 2024-02-21T07:49:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.429+0000 7fe57dbd0740 10 client.0 _ll_register_callbacks cb 0x55b8782192b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe579000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b878349d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44762/0 (socket says 172.21.15.100:44762) 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 -- 172.21.15.100:0/1909792789 learned_addr learned my addr 172.21.15.100:0/1909792789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 -- 172.21.15.100:0/1909792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 msgr2=0x55b8782fed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782fed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 -- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 msgr2=0x55b878349d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b878349d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.430+0000 7fe573400640 1 -- 172.21.15.100:0/1909792789 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe574070680 con 0x55b878333dd0 2024-02-21T07:49:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.431+0000 7fe573400640 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe5600017c0 tx=0x7fe560000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0cc2593d240ff72 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.431+0000 7fe55d600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560005030 con 0x55b878333dd0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe560005190 con 0x55b878333dd0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b877f247e0 con 0x55b878333dd0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe560005350 con 0x55b878333dd0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe57dbd0740 10 client.5902 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b8782235a0 con 0x55b878333dd0 2024-02-21T07:49:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.432+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b877f247e0 con 0x55b878333dd0 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe5600054b0 con 0x55b878333dd0 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 10 client.5902 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 10 client.5902 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 20 client.5902 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b87832c3e0 0x55b8782fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 4 client.5902 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.433+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b877f61720 con 0x55b87832c3e0 2024-02-21T07:49:52.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.435+0000 7fe573e00640 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b87832c3e0 0x55b8782fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.438+0000 7fe573e00640 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b87832c3e0 0x55b8782fd3a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22e8dcfdc06640e2 server_cookie=89de2ea78c1b8be1 in_seq=0 out_seq=0 2024-02-21T07:49:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.438+0000 7fe55d600640 10 client.5902 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:52.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.439+0000 7fe55d600640 1 -- 172.21.15.100:0/1909792789 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b877f61720 con 0x55b87832c3e0 2024-02-21T07:49:52.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.439+0000 7fe55d600640 10 client.5902 handle_command_reply: tid=0 2024-02-21T07:49:52.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.439+0000 7fe57dbd0740 1 client.5902 shutdown 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 msgr2=0x55b87832c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe5600017c0 tx=0x7fe560000f50 comp rx=0 tx=0).stop 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 shutdown_connections 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b87832c3e0 0x55b8782fd3a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b878349d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832c850 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/1909792789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 >> 172.21.15.100:0/1909792789 conn(0x55b8782f9cb0 msgr2=0x55b878331fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.440+0000 7fe55d600640 0 client.5902 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.441+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 shutdown_connections 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.441+0000 7fe57dbd0740 1 -- 172.21.15.100:0/1909792789 wait complete. 2024-02-21T07:49:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.441+0000 7fe57dbd0740 20 client.5902 trim_cache size 0 max 16384 2024-02-21T07:49:52.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.533+0000 7fe57dbd0740 1 Processor -- start 2024-02-21T07:49:52.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.542+0000 7fe57dbd0740 1 -- start start 2024-02-21T07:49:52.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.545+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.546+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b8783329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.546+0000 7fe573e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.548+0000 7fe573e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41332/0 (socket says 172.21.15.100:41332) 2024-02-21T07:49:52.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.549+0000 7fe573e00640 1 -- 172.21.15.100:0/792118358 learned_addr learned my addr 172.21.15.100:0/792118358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:52.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.553+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8782fa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.553+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b87833e670 con 0x55b878349890 2024-02-21T07:49:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.554+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8782fde70 con 0x55b878333dd0 2024-02-21T07:49:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.554+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8782c8550 con 0x55b878333950 2024-02-21T07:49:52.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.554+0000 7fe573400640 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b8783329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.555+0000 7fe579000640 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8782fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.556+0000 7fe573e00640 1 -- 172.21.15.100:0/792118358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 msgr2=0x55b8783329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.556+0000 7fe573e00640 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b8783329c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.556+0000 7fe573e00640 1 -- 172.21.15.100:0/792118358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 msgr2=0x55b8782fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.556+0000 7fe573e00640 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8782fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.556+0000 7fe573e00640 1 -- 172.21.15.100:0/792118358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8781bfab0 con 0x55b878333950 2024-02-21T07:49:52.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.557+0000 7fe573e00640 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0948c0 tx=0x7fe56c021040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddb92eba5a746555 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.561+0000 7fe55fe00640 1 -- 172.21.15.100:0/792118358 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0b0070 con 0x55b878333950 2024-02-21T07:49:52.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.561+0000 7fe55fe00640 1 -- 172.21.15.100:0/792118358 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b877f61720 con 0x55b878333950 2024-02-21T07:49:52.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.561+0000 7fe55fe00640 1 -- 172.21.15.100:0/792118358 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c098460 con 0x55b878333950 2024-02-21T07:49:52.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.562+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 msgr2=0x55b8782e92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.562+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0948c0 tx=0x7fe56c021040 comp rx=0 tx=0).stop 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.563+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 shutdown_connections 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.564+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8782fa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.564+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b8783329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.564+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/792118358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b8782e92c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.564+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 >> 172.21.15.100:0/792118358 conn(0x55b8782f9cb0 msgr2=0x55b8782f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.564+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 shutdown_connections 2024-02-21T07:49:52.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.565+0000 7fe57dbd0740 1 -- 172.21.15.100:0/792118358 wait complete. 2024-02-21T07:49:52.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.567+0000 7fe57dbd0740 1 -- start start 2024-02-21T07:49:52.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.567+0000 7fe57dbd0740 1 Processor -- start 2024-02-21T07:49:52.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.573+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b878326610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.574+0000 7fe573e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b878326610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.574+0000 7fe573e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b878326610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41344/0 (socket says 172.21.15.100:41344) 2024-02-21T07:49:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.574+0000 7fe57dbd0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.574+0000 7fe573e00640 1 -- 172.21.15.100:0/3440225924 learned_addr learned my addr 172.21.15.100:0/3440225924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:52.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.575+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8783998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.575+0000 7fe579000640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8783998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.576+0000 7fe573400640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.576+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8783a5480 con 0x55b878349890 2024-02-21T07:49:52.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.577+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8782e8790 con 0x55b878333dd0 2024-02-21T07:49:52.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.577+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8782e5b10 con 0x55b878333950 2024-02-21T07:49:52.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.579+0000 7fe57dbd0740 10 client.0 _ll_register_callbacks cb 0x7fe560001450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:52.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.580+0000 7fe579000640 1 -- 172.21.15.100:0/3440225924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 msgr2=0x55b878326610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.580+0000 7fe579000640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b878326610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.580+0000 7fe579000640 1 -- 172.21.15.100:0/3440225924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 msgr2=0x55b87832a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:52.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.580+0000 7fe579000640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.580+0000 7fe579000640 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe574183360 con 0x55b878349890 2024-02-21T07:49:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.581+0000 7fe55d600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:52.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.581+0000 7fe579000640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8783998b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe57408de90 tx=0x7fe564004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9656d77be597c2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:52.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.582+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56403db30 con 0x55b878349890 2024-02-21T07:49:52.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.582+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe560005e60 con 0x55b878349890 2024-02-21T07:49:52.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.582+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe56403dc90 con 0x55b878349890 2024-02-21T07:49:52.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.583+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe56403db30 con 0x55b878349890 2024-02-21T07:49:52.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.583+0000 7fe57dbd0740 10 client.5745 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:52.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.583+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b8781e5650 con 0x55b878349890 2024-02-21T07:49:52.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.584+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560005e60 con 0x55b878349890 2024-02-21T07:49:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe564045040 con 0x55b878349890 2024-02-21T07:49:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 10 client.5745 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 10 client.5745 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:49:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 20 client.5745 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b8782e8c20 0x55b8782f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 4 client.5745 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.586+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b877fb0890 con 0x55b8782e8c20 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.587+0000 7fe573e00640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b8782e8c20 0x55b8782f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.588+0000 7fe573e00640 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b8782e8c20 0x55b8782f5a00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7fced78a4a17f8e1 server_cookie=8919ebc2652505e6 in_seq=0 out_seq=0 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.588+0000 7fe55d600640 10 client.5745 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.590+0000 7fe55d600640 1 -- 172.21.15.100:0/3440225924 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b877fb0890 con 0x55b8782e8c20 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.590+0000 7fe55d600640 10 client.5745 handle_command_reply: tid=0 2024-02-21T07:49:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.590+0000 7fe57dbd0740 1 client.5745 shutdown 2024-02-21T07:49:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.592+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 msgr2=0x55b8783998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.592+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8783998b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe57408de90 tx=0x7fe564004770 comp rx=0 tx=0).stop 2024-02-21T07:49:52.598 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 shutdown_connections 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55b8782e8c20 0x55b8782f5a00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b878349890 0x55b8783998b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b878333dd0 0x55b87832a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 --2- 172.21.15.100:0/3440225924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b878333950 0x55b878326610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 >> 172.21.15.100:0/3440225924 conn(0x55b8782f9cb0 msgr2=0x55b8782fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.593+0000 7fe55d600640 0 client.5745 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.594+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 shutdown_connections 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.594+0000 7fe57dbd0740 1 -- 172.21.15.100:0/3440225924 wait complete. 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.594+0000 7fe57dbd0740 20 client.5745 trim_cache size 0 max 16384 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 msgr2=0x7fe5540a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 0x7fe5540a1610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c2d0 tx=0x7fe56402f000 comp rx=0 tx=0).stop 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 msgr2=0x7fe57421a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe56c007fa0 tx=0x7fe56c00e5d0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 shutdown_connections 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe55409f150 0x7fe5540a1610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe57415b5f0 0x7fe574184120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5740f6160 0x7fe5740f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 --2- 172.21.15.100:0/554380725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5580052a0 0x7fe57421a990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.595+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 >> 172.21.15.100:0/554380725 conn(0x7fe5740668b0 msgr2=0x7fe57406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.596+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 shutdown_connections 2024-02-21T07:49:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:52.596+0000 7fe57b000640 1 -- 172.21.15.100:0/554380725 wait complete. 2024-02-21T07:49:52.632 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:52.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:49:53.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.059+0000 7efd23600640 1 Processor -- start 2024-02-21T07:49:53.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.059+0000 7efd23600640 1 -- start start 2024-02-21T07:49:53.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.061+0000 7efd23600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd1c190260 0x7efd1c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.063+0000 7efd23600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd1c06edc0 0x7efd1c0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.063+0000 7efd23600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c18dc80 con 0x7efd1c0f4b20 2024-02-21T07:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.063+0000 7efd23600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0f5b90 con 0x7efd1c06edc0 2024-02-21T07:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.063+0000 7efd23600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0f55d0 con 0x7efd1c190260 2024-02-21T07:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.064+0000 7efd1be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efd1c0f4b20 0x7efd1c06e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58138/0 (socket says 172.21.15.100:58138) 2024-02-21T07:49:53.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.064+0000 7efd1be00640 1 -- 172.21.15.100:0/1922106696 learned_addr learned my addr 172.21.15.100:0/1922106696 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:49:53.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.067+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295051909 0 0) 0x7efd1c18dc80 con 0x7efd1c0f4b20 2024-02-21T07:49:53.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.067+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd00003520 con 0x7efd1c0f4b20 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100611367 0 0) 0x7efd00003520 con 0x7efd1c0f4b20 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 >> v2:172.21.15.156:3300/0 conn(0x7efd1c190260 msgr2=0x7efd1c070a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 --2- 172.21.15.100:0/1922106696 >> v2:172.21.15.156:3300/0 conn(0x7efd1c190260 0x7efd1c070a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 >> v2:172.21.15.100:3300/0 conn(0x7efd1c06edc0 msgr2=0x7efd1c0f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 --2- 172.21.15.100:0/1922106696 >> v2:172.21.15.100:3300/0 conn(0x7efd1c06edc0 0x7efd1c0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.068+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0f58b0 con 0x7efd1c0f4b20 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7efd140019f0 con 0x7efd1c0f4b20 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 >> v1:172.21.15.100:6789/0 conn(0x7efd1c0f4b20 legacy=0x7efd1c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd00003a90 0x7efd00003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd00009970 0x7efd0000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0f5b90 con 0x7efd00003a90 2024-02-21T07:49:53.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0f55d0 con 0x7efd00009970 2024-02-21T07:49:53.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.069+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0000c400 con 0x7efd000047c0 2024-02-21T07:49:53.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.074+0000 7efd1be00640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.075+0000 7efd1be00640 1 -- 172.21.15.100:0/1922106696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd00009970 msgr2=0x7efd0000bd60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.075+0000 7efd1be00640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd00009970 0x7efd0000bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.075+0000 7efd1be00640 1 -- 172.21.15.100:0/1922106696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd00003a90 msgr2=0x7efd00003e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.075+0000 7efd1be00640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd00003a90 0x7efd00003e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.075+0000 7efd1be00640 1 -- 172.21.15.100:0/1922106696 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00003520 con 0x7efd000047c0 2024-02-21T07:49:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.077+0000 7efd1be00640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd00004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efd14005a10 tx=0x7efd000057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd2e163084b2fdc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.078+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1402d750 con 0x7efd000047c0 2024-02-21T07:49:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.078+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1402d8b0 con 0x7efd000047c0 2024-02-21T07:49:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.079+0000 7efd1b400640 1 -- 172.21.15.100:0/1922106696 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1402dc80 con 0x7efd000047c0 2024-02-21T07:49:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.079+0000 7efd21600640 1 -- 172.21.15.100:0/1922106696 reap_dead start 2024-02-21T07:49:53.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.079+0000 7efd23600640 1 -- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 msgr2=0x7efd00004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.079+0000 7efd23600640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd00004c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efd14005a10 tx=0x7efd000057f0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.080+0000 7efd23600640 1 -- 172.21.15.100:0/1922106696 shutdown_connections 2024-02-21T07:49:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.080+0000 7efd23600640 1 --2- 172.21.15.100:0/1922106696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd00004c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.080+0000 7efd23600640 1 -- 172.21.15.100:0/1922106696 >> 172.21.15.100:0/1922106696 conn(0x7efd1c0668b0 msgr2=0x7efd1c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.095+0000 7efd23600640 1 -- 172.21.15.100:0/1922106696 shutdown_connections 2024-02-21T07:49:53.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.095+0000 7efd23600640 1 -- 172.21.15.100:0/1922106696 wait complete. 2024-02-21T07:49:53.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.101+0000 7efd23600640 1 Processor -- start 2024-02-21T07:49:53.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.101+0000 7efd23600640 1 -- start start 2024-02-21T07:49:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.109+0000 7efd23600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd1c23a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.109+0000 7efd23600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 0x7efd1c21cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.109+0000 7efd23600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c23e900 0x7efd1c23ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.109+0000 7efd23600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c23e470 con 0x7efd1c23e900 2024-02-21T07:49:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.110+0000 7efd23600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c23a760 con 0x7efd1c21cb80 2024-02-21T07:49:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.110+0000 7efd23600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c21d500 con 0x7efd000047c0 2024-02-21T07:49:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.114+0000 7efd20c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd1c23a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.114+0000 7efd20c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd1c23a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41362/0 (socket says 172.21.15.100:41362) 2024-02-21T07:49:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.114+0000 7efd20c00640 1 -- 172.21.15.100:0/4253329408 learned_addr learned my addr 172.21.15.100:0/4253329408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.114+0000 7efd1be00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 0x7efd1c21cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.115+0000 7efd1be00640 1 -- 172.21.15.100:0/4253329408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 msgr2=0x7efd1c23a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.115+0000 7efd1be00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd1c23a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.115+0000 7efd1be00640 1 -- 172.21.15.100:0/4253329408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c23e900 msgr2=0x7efd1c23ed80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:49:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.115+0000 7efd1be00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c23e900 0x7efd1c23ed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.115+0000 7efd1be00640 1 -- 172.21.15.100:0/4253329408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c21ecc0 con 0x7efd1c21cb80 2024-02-21T07:49:53.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.119+0000 7efd1be00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 0x7efd1c21cfc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efd14031000 tx=0x7efd14004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.120+0000 7efd18c00640 1 -- 172.21.15.100:0/4253329408 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14001930 con 0x7efd1c21cb80 2024-02-21T07:49:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.120+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c21efa0 con 0x7efd1c21cb80 2024-02-21T07:49:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.121+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c23e100 con 0x7efd1c21cb80 2024-02-21T07:49:53.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.122+0000 7efd18c00640 1 -- 172.21.15.100:0/4253329408 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14001c10 con 0x7efd1c21cb80 2024-02-21T07:49:53.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.123+0000 7efd18c00640 1 -- 172.21.15.100:0/4253329408 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1402dc40 con 0x7efd1c21cb80 2024-02-21T07:49:53.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.129+0000 7efd18c00640 1 -- 172.21.15.100:0/4253329408 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7efd14033070 con 0x7efd1c21cb80 2024-02-21T07:49:53.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.132+0000 7efd18c00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 0x7efcfc0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.132+0000 7efd18c00640 1 -- 172.21.15.100:0/4253329408 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efd140ebe60 con 0x7efd1c21cb80 2024-02-21T07:49:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.135+0000 7efd26221740 1 Processor -- start 2024-02-21T07:49:53.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.136+0000 7efd26221740 1 -- start start 2024-02-21T07:49:53.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.137+0000 7efd20c00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 0x7efcfc0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c7f3ec0 0x55a69c7f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 0x55a69c82f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c830320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c727210 con 0x55a69c7f3ec0 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c724740 con 0x55a69c82f590 2024-02-21T07:49:53.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd26221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c71ff20 con 0x55a69c7f47e0 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd21600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c830320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd21600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c830320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44792/0 (socket says 172.21.15.100:44792) 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.138+0000 7efd21600640 1 -- 172.21.15.100:0/1104849333 learned_addr learned my addr 172.21.15.100:0/1104849333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.139+0000 7efd1be00640 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 0x55a69c82f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.140+0000 7efd20c00640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 0x7efcfc0a15e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd08006fd0 tx=0x7efd08009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.140+0000 7efd20c00640 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c7f3ec0 0x55a69c7f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.141+0000 7efd1be00640 1 -- 172.21.15.100:0/1104849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 msgr2=0x55a69c830320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.141+0000 7efd1be00640 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c830320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.141+0000 7efd1be00640 1 -- 172.21.15.100:0/1104849333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c7f3ec0 msgr2=0x55a69c7f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.141+0000 7efd1be00640 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c7f3ec0 0x55a69c7f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.141+0000 7efd1be00640 1 -- 172.21.15.100:0/1104849333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69c6e1df0 con 0x55a69c7f47e0 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.143+0000 7efd1be00640 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 0x55a69c82f050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd140e97d0 tx=0x7efd140b5da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e42aae3dcba7fc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.144+0000 7efd11200640 1 -- 172.21.15.100:0/1104849333 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140d1070 con 0x55a69c7f47e0 2024-02-21T07:49:53.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.144+0000 7efd11200640 1 -- 172.21.15.100:0/1104849333 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140b7ba0 con 0x55a69c7f47e0 2024-02-21T07:49:53.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.144+0000 7efd11200640 1 -- 172.21.15.100:0/1104849333 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140ba160 con 0x55a69c7f47e0 2024-02-21T07:49:53.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.145+0000 7efd26221740 1 -- 172.21.15.100:0/1104849333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 msgr2=0x55a69c82f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.145+0000 7efd26221740 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 0x55a69c82f050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd140e97d0 tx=0x7efd140b5da0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.149+0000 7efd26221740 1 -- 172.21.15.100:0/1104849333 shutdown_connections 2024-02-21T07:49:53.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.149+0000 7efd26221740 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c830320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.149+0000 7efd26221740 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c7f47e0 0x55a69c82f050 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efd140e97d0 tx=0x7efd140b5da0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.149+0000 7efd26221740 1 --2- 172.21.15.100:0/1104849333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c7f3ec0 0x55a69c7f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.149+0000 7efd26221740 1 -- 172.21.15.100:0/1104849333 >> 172.21.15.100:0/1104849333 conn(0x55a69c7b6490 msgr2=0x55a69c7b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.151+0000 7efd26221740 1 -- 172.21.15.100:0/1104849333 shutdown_connections 2024-02-21T07:49:53.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.151+0000 7efd26221740 1 -- 172.21.15.100:0/1104849333 wait complete. 2024-02-21T07:49:53.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.153+0000 7efd26221740 1 -- start start 2024-02-21T07:49:53.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.153+0000 7efd26221740 1 Processor -- start 2024-02-21T07:49:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.155+0000 7efd26221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 0x55a69c7b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.155+0000 7efd26221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c83a490 0x55a69c7e2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.155+0000 7efd26221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 0x55a69c7b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd20c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 0x55a69c7b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd1be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c83a490 0x55a69c7e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd20c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 0x55a69c7b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48262/0 (socket says 172.21.15.100:48262) 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd20c00640 1 -- 172.21.15.100:0/3612882117 learned_addr learned my addr 172.21.15.100:0/3612882117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd21600640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 0x55a69c7b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c6c5150 con 0x55a69c82f590 2024-02-21T07:49:53.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c6c4df0 con 0x55a69c838600 2024-02-21T07:49:53.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.156+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c48e1c0 con 0x55a69c83a490 2024-02-21T07:49:53.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.157+0000 7efd26221740 10 client.0 _ll_register_callbacks cb 0x55a69c7142b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:53.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 -- 172.21.15.100:0/3612882117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c83a490 msgr2=0x55a69c7e2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c83a490 0x55a69c7e2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 -- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 msgr2=0x55a69c7b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 0x55a69c7b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c23e100 con 0x55a69c838600 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd21600640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 0x55a69c7b3550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0d2730 tx=0x7efd0c00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2614aadf994f35 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd05600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00fec0 con 0x55a69c838600 2024-02-21T07:49:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.158+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a69c41f7e0 con 0x55a69c838600 2024-02-21T07:49:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.161+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efd0c005950 con 0x55a69c838600 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.161+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0c005b10 con 0x55a69c838600 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.161+0000 7efd26221740 10 client.5917 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.161+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a69c71e5a0 con 0x55a69c838600 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.161+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a69c41f7e0 con 0x55a69c838600 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efd0c012070 con 0x55a69c838600 2024-02-21T07:49:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 10 client.5917 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 10 client.5917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:49:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 20 client.5917 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c838a80 0x55a69c83b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 4 client.5917 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a69c45c720 con 0x55a69c838a80 2024-02-21T07:49:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.162+0000 7efd20c00640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c838a80 0x55a69c83b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.164+0000 7efd20c00640 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c838a80 0x55a69c83b770 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15a12ec9bb893c3b server_cookie=f0b1783e63d88698 in_seq=0 out_seq=0 2024-02-21T07:49:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.164+0000 7efd05600640 10 client.5917 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:53.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.164+0000 7efd05600640 1 -- 172.21.15.100:0/3612882117 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a69c45c720 con 0x55a69c838a80 2024-02-21T07:49:53.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.164+0000 7efd05600640 10 client.5917 handle_command_reply: tid=0 2024-02-21T07:49:53.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 client.5917 shutdown 2024-02-21T07:49:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 msgr2=0x55a69c7b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 0x55a69c7b3550 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efd1c0d2730 tx=0x7efd0c00f5a0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 shutdown_connections 2024-02-21T07:49:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c838a80 0x55a69c83b770 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd05600640 0 client.5917 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838600 0x55a69c7b3550 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c83a490 0x55a69c7e2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 --2- 172.21.15.100:0/3612882117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c82f590 0x55a69c7b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 >> 172.21.15.100:0/3612882117 conn(0x55a69c7f3ec0 msgr2=0x55a69c7f9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.165+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 shutdown_connections 2024-02-21T07:49:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.166+0000 7efd26221740 1 -- 172.21.15.100:0/3612882117 wait complete. 2024-02-21T07:49:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.166+0000 7efd26221740 20 client.5917 trim_cache size 0 max 16384 2024-02-21T07:49:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.187+0000 7efd26221740 1 Processor -- start 2024-02-21T07:49:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.187+0000 7efd26221740 1 -- start start 2024-02-21T07:49:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.189+0000 7efd26221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c7b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd26221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd26221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd26221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c840350 con 0x55a69c838600 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd26221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c7b2cf0 con 0x55a69c82f590 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd26221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c7f0d50 con 0x55a69c838a80 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd21600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd20c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c7b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd21600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41388/0 (socket says 172.21.15.100:41388) 2024-02-21T07:49:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd21600640 1 -- 172.21.15.100:0/1673365393 learned_addr learned my addr 172.21.15.100:0/1673365393 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.190+0000 7efd1be00640 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 -- 172.21.15.100:0/1673365393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 msgr2=0x55a69c7b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c7b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 -- 172.21.15.100:0/1673365393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 msgr2=0x55a69c82b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 -- 172.21.15.100:0/1673365393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a69c7f91c0 con 0x55a69c838a80 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd1be00640 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.191+0000 7efd21600640 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00fb50 tx=0x7efd0c00c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68077b9466686961 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.192+0000 7efd07e00640 1 -- 172.21.15.100:0/1673365393 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00b030 con 0x55a69c838a80 2024-02-21T07:49:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.192+0000 7efd07e00640 1 -- 172.21.15.100:0/1673365393 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c005950 con 0x55a69c838a80 2024-02-21T07:49:53.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.192+0000 7efd07e00640 1 -- 172.21.15.100:0/1673365393 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00da80 con 0x55a69c838a80 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 -- 172.21.15.100:0/1673365393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 msgr2=0x55a69c83f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00fb50 tx=0x7efd0c00c000 comp rx=0 tx=0).stop 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 -- 172.21.15.100:0/1673365393 shutdown_connections 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c838a80 0x55a69c83f790 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 --2- 172.21.15.100:0/1673365393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c82f590 0x55a69c7b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 -- 172.21.15.100:0/1673365393 >> 172.21.15.100:0/1673365393 conn(0x55a69c7f3ec0 msgr2=0x55a69c7b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 -- 172.21.15.100:0/1673365393 shutdown_connections 2024-02-21T07:49:53.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.193+0000 7efd26221740 1 -- 172.21.15.100:0/1673365393 wait complete. 2024-02-21T07:49:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.194+0000 7efd26221740 1 -- start start 2024-02-21T07:49:53.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.195+0000 7efd26221740 1 Processor -- start 2024-02-21T07:49:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838a80 0x55a69c897430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c82bbb0 con 0x55a69c838600 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c82e6d0 con 0x55a69c838a80 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a69c897970 con 0x55a69c82f590 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd26221740 10 client.0 _ll_register_callbacks cb 0x7efd1402d0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.196+0000 7efd20c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.197+0000 7efd20c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41400/0 (socket says 172.21.15.100:41400) 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.197+0000 7efd20c00640 1 -- 172.21.15.100:0/2372785202 learned_addr learned my addr 172.21.15.100:0/2372785202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.197+0000 7efd1be00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.197+0000 7efd21600640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838a80 0x55a69c897430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.197+0000 7efd20c00640 1 -- 172.21.15.100:0/2372785202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838a80 msgr2=0x55a69c897430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd20c00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838a80 0x55a69c897430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd20c00640 1 -- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 msgr2=0x55a69c82b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd20c00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd20c00640 1 -- 172.21.15.100:0/2372785202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a69c6e1df0 con 0x55a69c82f590 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd20c00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd0800ee20 tx=0x7efd08011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93f988b77719cedf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd05600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08027040 con 0x55a69c82f590 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.198+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efd0800ee50 con 0x55a69c82f590 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.199+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd140b7ba0 con 0x55a69c82f590 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.199+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd08029d10 con 0x55a69c82f590 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.199+0000 7efd26221740 10 client.5861 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.199+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a69c71e5a0 con 0x55a69c82f590 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.199+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd140b7ba0 con 0x55a69c82f590 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7efd08011070 con 0x55a69c82f590 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 10 client.5861 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 10 client.5861 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 20 client.5861 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c83a490 0x55a69c887cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 4 client.5861 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.200+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a69c4ab890 con 0x55a69c83a490 2024-02-21T07:49:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.201+0000 7efd1be00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c83a490 0x55a69c887cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.202+0000 7efd05600640 10 client.5861 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.202+0000 7efd1be00640 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c83a490 0x55a69c887cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3586fc2a0c0f1c58 server_cookie=ec577368115958a0 in_seq=0 out_seq=0 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.202+0000 7efd05600640 1 -- 172.21.15.100:0/2372785202 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a69c4ab890 con 0x55a69c83a490 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.202+0000 7efd05600640 10 client.5861 handle_command_reply: tid=0 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.202+0000 7efd26221740 1 client.5861 shutdown 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 msgr2=0x55a69c847c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd0800ee20 tx=0x7efd08011000 comp rx=0 tx=0).stop 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 shutdown_connections 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55a69c83a490 0x55a69c887cf0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a69c838a80 0x55a69c897430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69c838600 0x55a69c82b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 --2- 172.21.15.100:0/2372785202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a69c82f590 0x55a69c847c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 >> 172.21.15.100:0/2372785202 conn(0x55a69c7f3ec0 msgr2=0x55a69c7f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.203+0000 7efd05600640 0 client.5861 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:49:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.204+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 shutdown_connections 2024-02-21T07:49:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.204+0000 7efd26221740 1 -- 172.21.15.100:0/2372785202 wait complete. 2024-02-21T07:49:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.204+0000 7efd26221740 20 client.5861 trim_cache size 0 max 16384 2024-02-21T07:49:53.208 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 msgr2=0x7efcfc0a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 0x7efcfc0a15e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd08006fd0 tx=0x7efd08009060 comp rx=0 tx=0).stop 2024-02-21T07:49:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 msgr2=0x7efd1c21cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 0x7efd1c21cfc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efd14031000 tx=0x7efd14004d00 comp rx=0 tx=0).stop 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 shutdown_connections 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efcfc09f120 0x7efcfc0a15e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c23e900 0x7efd1c23ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd1c21cb80 0x7efd1c21cfc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 --2- 172.21.15.100:0/4253329408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd000047c0 0x7efd1c23a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 >> 172.21.15.100:0/4253329408 conn(0x7efd1c0668b0 msgr2=0x7efd1c071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 shutdown_connections 2024-02-21T07:49:53.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.205+0000 7efd23600640 1 -- 172.21.15.100:0/4253329408 wait complete. 2024-02-21T07:49:53.232 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:49:53.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.634+0000 7fe7e6600640 1 Processor -- start 2024-02-21T07:49:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.634+0000 7fe7e6600640 1 -- start start 2024-02-21T07:49:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.639+0000 7fe7e6600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe7e0071010 0x7fe7e00713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.639+0000 7fe7e6600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.639+0000 7fe7e6600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00700c0 con 0x7fe7e0071930 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.640+0000 7fe7e6600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e006fed0 con 0x7fe7e0071d70 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.640+0000 7fe7e6600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e006ea40 con 0x7fe7e0071010 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.639+0000 7fe7dfe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.640+0000 7fe7dfe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44832/0 (socket says 172.21.15.100:44832) 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.640+0000 7fe7dfe00640 1 -- 172.21.15.100:0/2566832853 learned_addr learned my addr 172.21.15.100:0/2566832853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.640+0000 7fe7df400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe7e0071010 0x7fe7e00713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.641+0000 7fe7df400640 1 -- 172.21.15.100:0/2566832853 >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 msgr2=0x7fe7e006f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.641+0000 7fe7df400640 1 --2- 172.21.15.100:0/2566832853 >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.641+0000 7fe7df400640 1 -- 172.21.15.100:0/2566832853 >> v1:172.21.15.170:6789/0 conn(0x7fe7e0071930 legacy=0x7fe7e006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.641+0000 7fe7df400640 1 -- 172.21.15.100:0/2566832853 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00703a0 con 0x7fe7e0071010 2024-02-21T07:49:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.642+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/2566832853 >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:53.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.643+0000 7fe7df400640 1 --2- 172.21.15.100:0/2566832853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071010 0x7fe7e00713f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe7e008e020 tx=0x7fe7d002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95defff86f9d946 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.643+0000 7fe7de000640 1 -- 172.21.15.100:0/2566832853 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0031830 con 0x7fe7e0071010 2024-02-21T07:49:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.643+0000 7fe7de000640 1 -- 172.21.15.100:0/2566832853 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0031990 con 0x7fe7e0071010 2024-02-21T07:49:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.643+0000 7fe7de000640 1 -- 172.21.15.100:0/2566832853 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0031d00 con 0x7fe7e0071010 2024-02-21T07:49:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.644+0000 7fe7e6600640 1 -- 172.21.15.100:0/2566832853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071010 msgr2=0x7fe7e00713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.644+0000 7fe7e6600640 1 --2- 172.21.15.100:0/2566832853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071010 0x7fe7e00713f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe7e008e020 tx=0x7fe7d002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.646+0000 7fe7e6600640 1 -- 172.21.15.100:0/2566832853 shutdown_connections 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.646+0000 7fe7e6600640 1 --2- 172.21.15.100:0/2566832853 >> v2:172.21.15.156:3300/0 conn(0x7fe7e0071d70 0x7fe7e006f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.646+0000 7fe7e6600640 1 --2- 172.21.15.100:0/2566832853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071010 0x7fe7e00713f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.646+0000 7fe7e6600640 1 -- 172.21.15.100:0/2566832853 >> 172.21.15.100:0/2566832853 conn(0x7fe7e00668b0 msgr2=0x7fe7e0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.647+0000 7fe7e6600640 1 -- 172.21.15.100:0/2566832853 shutdown_connections 2024-02-21T07:49:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.647+0000 7fe7e6600640 1 -- 172.21.15.100:0/2566832853 wait complete. 2024-02-21T07:49:53.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.650+0000 7fe7e6600640 1 Processor -- start 2024-02-21T07:49:53.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.651+0000 7fe7e6600640 1 -- start start 2024-02-21T07:49:53.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.654+0000 7fe7e6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 0x7fe7e00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.654+0000 7fe7e6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071930 0x7fe7e00f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.654+0000 7fe7e6600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7e6600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00cd390 con 0x7fe7e0071010 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7e6600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00ca130 con 0x7fe7e0170390 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7e6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00ca410 con 0x7fe7e0071930 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 0x7fe7e00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44840/0 (socket says 172.21.15.100:44840) 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 -- 172.21.15.100:0/1337075099 learned_addr learned my addr 172.21.15.100:0/1337075099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 0x7fe7e00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48282/0 (socket says 172.21.15.100:48282) 2024-02-21T07:49:53.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dea00640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071930 0x7fe7e00f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 -- 172.21.15.100:0/1337075099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071930 msgr2=0x7fe7e00f0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071930 0x7fe7e00f0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 -- 172.21.15.100:0/1337075099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 msgr2=0x7fe7e00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 0x7fe7e00cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.655+0000 7fe7dfe00640 1 -- 172.21.15.100:0/1337075099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009b30 con 0x7fe7e0170390 2024-02-21T07:49:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800ef90 tx=0x7fe7d800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7d7400640 1 -- 172.21.15.100:0/1337075099 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8018070 con 0x7fe7e0170390 2024-02-21T07:49:53.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7d7400640 1 -- 172.21.15.100:0/1337075099 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800f040 con 0x7fe7e0170390 2024-02-21T07:49:53.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7d7400640 1 -- 172.21.15.100:0/1337075099 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800ce20 con 0x7fe7e0170390 2024-02-21T07:49:53.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d0009400 con 0x7fe7e0170390 2024-02-21T07:49:53.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.656+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00ca9d0 con 0x7fe7e0170390 2024-02-21T07:49:53.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.662+0000 7fe7d7400640 1 -- 172.21.15.100:0/1337075099 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe7d8014480 con 0x7fe7e0170390 2024-02-21T07:49:53.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.664+0000 7fe7d7400640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 0x7fe7c00a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.664+0000 7fe7d7400640 1 -- 172.21.15.100:0/1337075099 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7d80c9c60 con 0x7fe7e0170390 2024-02-21T07:49:53.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.666+0000 7fe7e91ef740 1 Processor -- start 2024-02-21T07:49:53.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.667+0000 7fe7e91ef740 1 -- start start 2024-02-21T07:49:53.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.668+0000 7fe7df400640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 0x7fe7c00a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 0x55bbcea5f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 0x55bbcea9b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce992210 con 0x55bbcea9a590 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce98f740 con 0x55bbcea5eec0 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce98af20 con 0x55bbcea5f7e0 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7dea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41426/0 (socket says 172.21.15.100:41426) 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7dea00640 1 -- 172.21.15.100:0/4013237509 learned_addr learned my addr 172.21.15.100:0/4013237509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 0x55bbcea9b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7df400640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 0x55bbcea5f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.669+0000 7fe7dea00640 1 -- 172.21.15.100:0/4013237509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 msgr2=0x55bbcea5f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dea00640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 0x55bbcea5f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dea00640 1 -- 172.21.15.100:0/4013237509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 msgr2=0x55bbcea9b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dea00640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 0x55bbcea9b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dea00640 1 -- 172.21.15.100:0/4013237509 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbce94cdf0 con 0x55bbcea5f7e0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 0x55bbcea9b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7dea00640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005030 tx=0x7fe7cc0054f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e884badba2001697 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7df400640 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 0x55bbcea5f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7df400640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 0x7fe7c00a15e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0036000 tx=0x7fe7d003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7cbe00640 1 -- 172.21.15.100:0/4013237509 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc003b50 con 0x55bbcea5f7e0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.670+0000 7fe7cbe00640 1 -- 172.21.15.100:0/4013237509 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc003cb0 con 0x55bbcea5f7e0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.671+0000 7fe7cbe00640 1 -- 172.21.15.100:0/4013237509 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00fac0 con 0x55bbcea5f7e0 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.672+0000 7fe7e91ef740 1 -- 172.21.15.100:0/4013237509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 msgr2=0x55bbcea9a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.672+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc005030 tx=0x7fe7cc0054f0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 -- 172.21.15.100:0/4013237509 shutdown_connections 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea9a590 0x55bbcea9b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a050 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/4013237509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea5eec0 0x55bbcea5f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 -- 172.21.15.100:0/4013237509 >> 172.21.15.100:0/4013237509 conn(0x55bbcea21490 msgr2=0x55bbcea22510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.674+0000 7fe7e91ef740 1 -- 172.21.15.100:0/4013237509 shutdown_connections 2024-02-21T07:49:53.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.677+0000 7fe7e91ef740 1 -- 172.21.15.100:0/4013237509 wait complete. 2024-02-21T07:49:53.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.680+0000 7fe7e91ef740 1 -- start start 2024-02-21T07:49:53.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.682+0000 7fe7e91ef740 1 Processor -- start 2024-02-21T07:49:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea58330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea9a590 0x55bbcea507e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce930150 con 0x55bbcea5f7e0 2024-02-21T07:49:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce92fdf0 con 0x55bbcea1ce50 2024-02-21T07:49:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbce6f91c0 con 0x55bbcea9a590 2024-02-21T07:49:53.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.688+0000 7fe7e91ef740 10 client.0 _ll_register_callbacks cb 0x55bbce97f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.689+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.689+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44864/0 (socket says 172.21.15.100:44864) 2024-02-21T07:49:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.689+0000 7fe7dfe00640 1 -- 172.21.15.100:0/2470731260 learned_addr learned my addr 172.21.15.100:0/2470731260 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.690+0000 7fe7dea00640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea9a590 0x55bbcea507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.691+0000 7fe7dfe00640 1 -- 172.21.15.100:0/2470731260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea9a590 msgr2=0x55bbcea507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.691+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea9a590 0x55bbcea507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.691+0000 7fe7dfe00640 1 -- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 msgr2=0x55bbcea58330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.691+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea58330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.691+0000 7fe7dfe00640 1 -- 172.21.15.100:0/2470731260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc004c00 con 0x55bbcea1ce50 2024-02-21T07:49:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.692+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80974d0 tx=0x7fe7d8097220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46743212d3373fb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.692+0000 7fe7c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:49:53.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.693+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80af370 con 0x55bbcea1ce50 2024-02-21T07:49:53.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.694+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7d809fee0 con 0x55bbcea1ce50 2024-02-21T07:49:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.694+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbce68a7e0 con 0x55bbcea1ce50 2024-02-21T07:49:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.695+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d80820c0 con 0x55bbcea1ce50 2024-02-21T07:49:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.695+0000 7fe7e91ef740 10 client.5935 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.695+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bbce9895a0 con 0x55bbcea1ce50 2024-02-21T07:49:53.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.695+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbce68a7e0 con 0x55bbcea1ce50 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe7d8082220 con 0x55bbcea1ce50 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 10 client.5935 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 10 client.5935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 20 client.5935 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea1d2d0 0x55bbcea67360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 4 client.5935 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:53.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.696+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbce6c7720 con 0x55bbcea1d2d0 2024-02-21T07:49:53.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.700+0000 7fe7df400640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea1d2d0 0x55bbcea67360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.702+0000 7fe7c8c00640 10 client.5935 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.702+0000 7fe7df400640 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea1d2d0 0x55bbcea67360 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f11c1b4316fb4b server_cookie=a16317c4dbd11f08 in_seq=0 out_seq=0 2024-02-21T07:49:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.703+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2470731260 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbce6c7720 con 0x55bbcea1d2d0 2024-02-21T07:49:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.703+0000 7fe7c8c00640 10 client.5935 handle_command_reply: tid=0 2024-02-21T07:49:53.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.704+0000 7fe7e91ef740 1 client.5935 shutdown 2024-02-21T07:49:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 msgr2=0x55bbcea63e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80974d0 tx=0x7fe7d8097220 comp rx=0 tx=0).stop 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 shutdown_connections 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea1d2d0 0x55bbcea67360 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea1ce50 0x55bbcea63e30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea9a590 0x55bbcea507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2470731260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea58330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.705+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 >> 172.21.15.100:0/2470731260 conn(0x55bbcea5eec0 msgr2=0x55bbcea22f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.706+0000 7fe7c8c00640 0 client.5935 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:53.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.708+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 shutdown_connections 2024-02-21T07:49:53.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.708+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2470731260 wait complete. 2024-02-21T07:49:53.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.708+0000 7fe7e91ef740 20 client.5935 trim_cache size 0 max 16384 2024-02-21T07:49:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.759+0000 7fe7e91ef740 1 Processor -- start 2024-02-21T07:49:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.760+0000 7fe7e91ef740 1 -- start start 2024-02-21T07:49:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea99e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbcea496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcea199f0 con 0x55bbcea5f7e0 2024-02-21T07:49:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcea67990 con 0x55bbcea9a590 2024-02-21T07:49:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.761+0000 7fe7e91ef740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcea196a0 con 0x55bbcea1ce50 2024-02-21T07:49:53.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.766+0000 7fe7df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.766+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbcea496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.766+0000 7fe7df400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41440/0 (socket says 172.21.15.100:41440) 2024-02-21T07:49:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.767+0000 7fe7df400640 1 -- 172.21.15.100:0/506824349 learned_addr learned my addr 172.21.15.100:0/506824349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.769+0000 7fe7df400640 1 -- 172.21.15.100:0/506824349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 msgr2=0x55bbcea496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.769+0000 7fe7df400640 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbcea496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.769+0000 7fe7df400640 1 -- 172.21.15.100:0/506824349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 msgr2=0x55bbcea99e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.769+0000 7fe7df400640 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea99e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.769+0000 7fe7df400640 1 -- 172.21.15.100:0/506824349 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbce925ab0 con 0x55bbcea1ce50 2024-02-21T07:49:53.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.775+0000 7fe7df400640 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009860 tx=0x7fe7d0030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=811c55bcd2128df7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.777+0000 7fe7cb400640 1 -- 172.21.15.100:0/506824349 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0040040 con 0x55bbcea1ce50 2024-02-21T07:49:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.777+0000 7fe7cb400640 1 -- 172.21.15.100:0/506824349 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbce6c7720 con 0x55bbcea1ce50 2024-02-21T07:49:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.777+0000 7fe7cb400640 1 -- 172.21.15.100:0/506824349 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0003c60 con 0x55bbcea1ce50 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 -- 172.21.15.100:0/506824349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 msgr2=0x55bbcea662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009860 tx=0x7fe7d0030000 comp rx=0 tx=0).stop 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 -- 172.21.15.100:0/506824349 shutdown_connections 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbcea496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea5f7e0 0x55bbcea99e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/506824349 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea1ce50 0x55bbcea662a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.778+0000 7fe7e91ef740 1 -- 172.21.15.100:0/506824349 >> 172.21.15.100:0/506824349 conn(0x55bbcea5eec0 msgr2=0x55bbcea22f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.779+0000 7fe7e91ef740 1 -- 172.21.15.100:0/506824349 shutdown_connections 2024-02-21T07:49:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.779+0000 7fe7e91ef740 1 -- 172.21.15.100:0/506824349 wait complete. 2024-02-21T07:49:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.780+0000 7fe7e91ef740 1 -- start start 2024-02-21T07:49:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.780+0000 7fe7e91ef740 1 Processor -- start 2024-02-21T07:49:53.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.782+0000 7fe7e91ef740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.783+0000 7fe7df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.783+0000 7fe7df400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48304/0 (socket says 172.21.15.100:48304) 2024-02-21T07:49:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.783+0000 7fe7df400640 1 -- 172.21.15.100:0/2171583415 learned_addr learned my addr 172.21.15.100:0/2171583415 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.783+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.783+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbceab41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.784+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcea4a540 con 0x55bbcea1ce50 2024-02-21T07:49:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.784+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbcea486d0 con 0x55bbcea9a590 2024-02-21T07:49:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.784+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbceafbd00 con 0x55bbcea5f7e0 2024-02-21T07:49:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.784+0000 7fe7e91ef740 10 client.0 _ll_register_callbacks cb 0x7fe7cc0049f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.784+0000 7fe7dfe00640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbceab41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.785+0000 7fe7df400640 1 -- 172.21.15.100:0/2171583415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 msgr2=0x55bbcea9a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.785+0000 7fe7df400640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.785+0000 7fe7df400640 1 -- 172.21.15.100:0/2171583415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 msgr2=0x55bbceab41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.785+0000 7fe7df400640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbceab41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.785+0000 7fe7df400640 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d004e040 con 0x55bbcea1ce50 2024-02-21T07:49:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.786+0000 7fe7df400640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7d002bee0 tx=0x7fe7d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a586e4de601e7926 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.786+0000 7fe7c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.787+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0040070 con 0x55bbcea1ce50 2024-02-21T07:49:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.788+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7d0003c70 con 0x55bbcea1ce50 2024-02-21T07:49:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.788+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7cc003cb0 con 0x55bbcea1ce50 2024-02-21T07:49:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.789+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7d0060070 con 0x55bbcea1ce50 2024-02-21T07:49:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.789+0000 7fe7e91ef740 10 client.5769 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:53.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.789+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bbce94b650 con 0x55bbcea1ce50 2024-02-21T07:49:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.790+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d006e020 con 0x55bbcea1ce50 2024-02-21T07:49:53.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.790+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe7d005a020 con 0x55bbcea1ce50 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 10 client.5769 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 10 client.5769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 20 client.5769 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea66d80 0x55bbcea49b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 4 client.5769 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:49:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.791+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bbce716890 con 0x55bbcea66d80 2024-02-21T07:49:53.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.792+0000 7fe7dea00640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea66d80 0x55bbcea49b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:53.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.794+0000 7fe7dea00640 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea66d80 0x55bbcea49b30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d619169ab9e08e7 server_cookie=8b3f46622150d8b4 in_seq=0 out_seq=0 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.794+0000 7fe7c8c00640 10 client.5769 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7c8c00640 1 -- 172.21.15.100:0/2171583415 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bbce716890 con 0x55bbcea66d80 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7c8c00640 10 client.5769 handle_command_reply: tid=0 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7e91ef740 1 client.5769 shutdown 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 msgr2=0x55bbcea98610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe7d002bee0 tx=0x7fe7d0004730 comp rx=0 tx=0).stop 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 shutdown_connections 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.795+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55bbcea66d80 0x55bbcea49b30 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.796+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbcea9a590 0x55bbceab41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.796+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bbcea5f7e0 0x55bbcea9a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.796+0000 7fe7e91ef740 1 --2- 172.21.15.100:0/2171583415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bbcea1ce50 0x55bbcea98610 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.796+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 >> 172.21.15.100:0/2171583415 conn(0x55bbcea5eec0 msgr2=0x55bbcea22f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.796+0000 7fe7c8c00640 0 client.5769 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.797+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 shutdown_connections 2024-02-21T07:49:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.797+0000 7fe7e91ef740 1 -- 172.21.15.100:0/2171583415 wait complete. 2024-02-21T07:49:53.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.797+0000 7fe7e91ef740 20 client.5769 trim_cache size 0 max 16384 2024-02-21T07:49:53.801 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:49:53.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.801+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 msgr2=0x7fe7c00a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.801+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 0x7fe7c00a15e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0036000 tx=0x7fe7d003d040 comp rx=0 tx=0).stop 2024-02-21T07:49:53.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.801+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 msgr2=0x7fe7e0170800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:53.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.801+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800ef90 tx=0x7fe7d800c490 comp rx=0 tx=0).stop 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 shutdown_connections 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7e0170390 0x7fe7e0170800 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7e0071930 0x7fe7e00f0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7c009f120 0x7fe7c00a15e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 --2- 172.21.15.100:0/1337075099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7e0071010 0x7fe7e00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.802+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 >> 172.21.15.100:0/1337075099 conn(0x7fe7e00668b0 msgr2=0x7fe7e00f8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:53.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.807+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 shutdown_connections 2024-02-21T07:49:53.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:53.807+0000 7fe7e6600640 1 -- 172.21.15.100:0/1337075099 wait complete. 2024-02-21T07:49:54.866 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:49:54.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:49:54.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:49:55.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.303+0000 7f7c44200640 1 Processor -- start 2024-02-21T07:49:55.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.303+0000 7f7c44200640 1 -- start start 2024-02-21T07:49:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.308+0000 7f7c44200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7c3c0713f0 0x7f7c3c0f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.308+0000 7f7c44200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 0x7f7c3c18a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.308+0000 7f7c44200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c3c0f6e10 con 0x7f7c3c15bae0 2024-02-21T07:49:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.308+0000 7f7c44200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c15bec0 con 0x7f7c3c189e00 2024-02-21T07:49:55.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.308+0000 7f7c44200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c3c0f7ef0 con 0x7f7c3c0713f0 2024-02-21T07:49:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.312+0000 7f7c42200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 0x7f7c3c18a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.312+0000 7f7c42200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 0x7f7c3c18a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48312/0 (socket says 172.21.15.100:48312) 2024-02-21T07:49:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.312+0000 7f7c42200640 1 -- 172.21.15.100:0/1265191365 learned_addr learned my addr 172.21.15.100:0/1265191365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.316+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1265191365 >> v2:172.21.15.170:3300/0 conn(0x7f7c3c0713f0 0x7f7c3c0f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.319+0000 7f7c40e00640 1 -- 172.21.15.100:0/1265191365 >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 msgr2=0x7f7c3c18a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.319+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1265191365 >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 0x7f7c3c18a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.319+0000 7f7c40e00640 1 -- 172.21.15.100:0/1265191365 >> v1:172.21.15.170:6789/0 conn(0x7f7c3c15bae0 legacy=0x7f7c3c0f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.319+0000 7f7c40e00640 1 -- 172.21.15.100:0/1265191365 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c071b50 con 0x7f7c3c0713f0 2024-02-21T07:49:55.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.322+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1265191365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0f79b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c184400 tx=0x7f7c2802b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b3756962f8aeda server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.322+0000 7f7c3be00640 1 -- 172.21.15.100:0/1265191365 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28030510 con 0x7f7c3c0713f0 2024-02-21T07:49:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.322+0000 7f7c3be00640 1 -- 172.21.15.100:0/1265191365 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2802e050 con 0x7f7c3c0713f0 2024-02-21T07:49:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.322+0000 7f7c3be00640 1 -- 172.21.15.100:0/1265191365 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28030890 con 0x7f7c3c0713f0 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 -- 172.21.15.100:0/1265191365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 msgr2=0x7f7c3c0f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 --2- 172.21.15.100:0/1265191365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0f79b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c184400 tx=0x7f7c2802b600 comp rx=0 tx=0).stop 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 -- 172.21.15.100:0/1265191365 shutdown_connections 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 --2- 172.21.15.100:0/1265191365 >> v2:172.21.15.100:3300/0 conn(0x7f7c3c189e00 0x7f7c3c18a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 --2- 172.21.15.100:0/1265191365 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0f79b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.325+0000 7f7c44200640 1 -- 172.21.15.100:0/1265191365 >> 172.21.15.100:0/1265191365 conn(0x7f7c3c0fbec0 msgr2=0x7f7c3c0fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.326+0000 7f7c44200640 1 -- 172.21.15.100:0/1265191365 shutdown_connections 2024-02-21T07:49:55.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.326+0000 7f7c44200640 1 -- 172.21.15.100:0/1265191365 wait complete. 2024-02-21T07:49:55.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.332+0000 7f7c44200640 1 Processor -- start 2024-02-21T07:49:55.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.332+0000 7f7c44200640 1 -- start start 2024-02-21T07:49:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 0x7f7c3c08e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c3c189e00 0x7f7c3c14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c0d00a0 con 0x7f7c3c189e00 2024-02-21T07:49:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c08d6d0 con 0x7f7c3c15bae0 2024-02-21T07:49:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.334+0000 7f7c44200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3c08d9b0 con 0x7f7c3c0713f0 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.335+0000 7f7c40e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 0x7f7c3c08e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.335+0000 7f7c40e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 0x7f7c3c08e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44888/0 (socket says 172.21.15.100:44888) 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.335+0000 7f7c40e00640 1 -- 172.21.15.100:0/1026471932 learned_addr learned my addr 172.21.15.100:0/1026471932 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.335+0000 7f7c41800640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.335+0000 7f7c42200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c3c189e00 0x7f7c3c14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 -- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 msgr2=0x7f7c3c08e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 0x7f7c3c08e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 -- 172.21.15.100:0/1026471932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c3c189e00 msgr2=0x7f7c3c14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c3c189e00 0x7f7c3c14e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 -- 172.21.15.100:0/1026471932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009400 con 0x7f7c3c0713f0 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c41800640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0cfb60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000c500 tx=0x7f7c3000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c39600640 1 -- 172.21.15.100:0/1026471932 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300035f0 con 0x7f7c3c0713f0 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c39600640 1 -- 172.21.15.100:0/1026471932 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30003750 con 0x7f7c3c0713f0 2024-02-21T07:49:55.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.336+0000 7f7c39600640 1 -- 172.21.15.100:0/1026471932 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30003b40 con 0x7f7c3c0713f0 2024-02-21T07:49:55.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.337+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3c08dc90 con 0x7f7c3c0713f0 2024-02-21T07:49:55.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.337+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c08e250 con 0x7f7c3c0713f0 2024-02-21T07:49:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.341+0000 7f7c39600640 1 -- 172.21.15.100:0/1026471932 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7c30003ca0 con 0x7f7c3c0713f0 2024-02-21T07:49:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.342+0000 7f7c46fea740 1 Processor -- start 2024-02-21T07:49:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.342+0000 7f7c46fea740 1 -- start start 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 0x55b58e2995a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e2d5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e219300 con 0x55b58e2991c0 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e1cbe50 con 0x55b58e299ae0 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.343+0000 7f7c46fea740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e1c9380 con 0x55b58e2d4890 2024-02-21T07:49:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c41800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c39600640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 0x7f7c1c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c41800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44900/0 (socket says 172.21.15.100:44900) 2024-02-21T07:49:55.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c41800640 1 -- 172.21.15.100:0/2128823081 learned_addr learned my addr 172.21.15.100:0/2128823081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 0x55b58e2995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c40e00640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e2d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c39600640 1 -- 172.21.15.100:0/1026471932 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c300c90a0 con 0x7f7c3c0713f0 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 -- 172.21.15.100:0/2128823081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 msgr2=0x55b58e2d5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e2d5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 -- 172.21.15.100:0/2128823081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 msgr2=0x55b58e2d4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.344+0000 7f7c42200640 1 -- 172.21.15.100:0/2128823081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b58e18dc80 con 0x55b58e2991c0 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.345+0000 7f7c41800640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.345+0000 7f7c40e00640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e2d5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.345+0000 7f7c42200640 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 0x55b58e2995a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c340115f0 tx=0x7f7c34009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c883bdb5e02c56c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.345+0000 7f7c42200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 0x7f7c1c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.345+0000 7f7c2e000640 1 -- 172.21.15.100:0/2128823081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3400e040 con 0x55b58e2991c0 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c2e000640 1 -- 172.21.15.100:0/2128823081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3400f040 con 0x55b58e2991c0 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c2e000640 1 -- 172.21.15.100:0/2128823081 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340158f0 con 0x55b58e2991c0 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 -- 172.21.15.100:0/2128823081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 msgr2=0x55b58e2995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c42200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 0x7f7c1c0a1560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c34020000 tx=0x7f7c34021000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 0x55b58e2995a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7c340115f0 tx=0x7f7c34009810 comp rx=0 tx=0).stop 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 -- 172.21.15.100:0/2128823081 shutdown_connections 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e2d5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e2d4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 --2- 172.21.15.100:0/2128823081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2991c0 0x55b58e2995a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.346+0000 7f7c46fea740 1 -- 172.21.15.100:0/2128823081 >> 172.21.15.100:0/2128823081 conn(0x55b58e25b790 msgr2=0x55b58e25c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.347+0000 7f7c46fea740 1 -- 172.21.15.100:0/2128823081 shutdown_connections 2024-02-21T07:49:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.347+0000 7f7c46fea740 1 -- 172.21.15.100:0/2128823081 wait complete. 2024-02-21T07:49:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.347+0000 7f7c46fea740 1 -- start start 2024-02-21T07:49:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.348+0000 7f7c46fea740 1 Processor -- start 2024-02-21T07:49:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e28a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e257920 0x55b58e284370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e1c4b60 con 0x55b58e2d4890 2024-02-21T07:49:55.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e169fd0 con 0x55b58e299ae0 2024-02-21T07:49:55.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e169c70 con 0x55b58e257920 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c46fea740 10 client.0 _ll_register_callbacks cb 0x55b58ded5c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c40e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c40e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48340/0 (socket says 172.21.15.100:48340) 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c40e00640 1 -- 172.21.15.100:0/1462755238 learned_addr learned my addr 172.21.15.100:0/1462755238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.349+0000 7f7c42200640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e257920 0x55b58e284370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c41800640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e28a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 -- 172.21.15.100:0/1462755238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e257920 msgr2=0x55b58e284370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e257920 0x55b58e284370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 -- 172.21.15.100:0/1462755238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 msgr2=0x55b58e28a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e28a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 -- 172.21.15.100:0/1462755238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c34009d70 con 0x55b58e2d4890 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c40e00640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c28030bd0 tx=0x7f7c28004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda4b0ea1825f301 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.350+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2802bec0 con 0x55b58e2d4890 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c28045480 con 0x55b58e2d4890 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b58dec4860 con 0x55b58e2d4890 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c28045640 con 0x55b58e2d4890 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 10 client.5781 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b58e1c31e0 con 0x55b58e2d4890 2024-02-21T07:49:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b58dec4860 con 0x55b58e2d4890 2024-02-21T07:49:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7c280457a0 con 0x55b58e2d4890 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 10 client.5781 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 10 client.5781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 20 client.5781 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e2e12a0 0x55b58e2e1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 4 client.5781 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.351+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b58df15410 con 0x55b58e2e12a0 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.352+0000 7f7c41800640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e2e12a0 0x55b58e2e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.352+0000 7f7c41800640 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e2e12a0 0x55b58e2e1680 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a878a764740084 server_cookie=d7b4a34f49cc513b in_seq=0 out_seq=0 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.352+0000 7f7c22a00640 10 client.5781 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c22a00640 1 -- 172.21.15.100:0/1462755238 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b58df15410 con 0x55b58e2e12a0 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c22a00640 10 client.5781 handle_command_reply: tid=0 2024-02-21T07:49:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 client.5781 shutdown 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 msgr2=0x55b58e288e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7c28030bd0 tx=0x7f7c28004730 comp rx=0 tx=0).stop 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 shutdown_connections 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e2e12a0 0x55b58e2e1680 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e257920 0x55b58e284370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e2d4890 0x55b58e288e50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 --2- 172.21.15.100:0/1462755238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e28a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 >> 172.21.15.100:0/1462755238 conn(0x55b58e2991c0 msgr2=0x55b58e25d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c22a00640 0 client.5781 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.353+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 shutdown_connections 2024-02-21T07:49:55.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.357+0000 7f7c46fea740 1 -- 172.21.15.100:0/1462755238 wait complete. 2024-02-21T07:49:55.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.357+0000 7f7c46fea740 20 client.5781 trim_cache size 0 max 16384 2024-02-21T07:49:55.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.395+0000 7f7c46fea740 1 Processor -- start 2024-02-21T07:49:55.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.396+0000 7f7c46fea740 1 -- start start 2024-02-21T07:49:55.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e289c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e28a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58df0d0c0 con 0x55b58e257920 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e25a220 con 0x55b58e299ae0 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c46fea740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e28f8b0 con 0x55b58e2d4890 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.401+0000 7f7c41800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48348/0 (socket says 172.21.15.100:48348) 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 -- 172.21.15.100:0/789910156 learned_addr learned my addr 172.21.15.100:0/789910156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 -- 172.21.15.100:0/789910156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 msgr2=0x55b58e28a180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e28a180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 -- 172.21.15.100:0/789910156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 msgr2=0x55b58e289c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e289c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.402+0000 7f7c41800640 1 -- 172.21.15.100:0/789910156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b58e15fa90 con 0x55b58e257920 2024-02-21T07:49:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.403+0000 7f7c41800640 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000c4d0 tx=0x7f7c3009d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c45bd427c0bea7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.403+0000 7f7c2d600640 1 -- 172.21.15.100:0/789910156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3009ad60 con 0x55b58e257920 2024-02-21T07:49:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.403+0000 7f7c2d600640 1 -- 172.21.15.100:0/789910156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3009f320 con 0x55b58e257920 2024-02-21T07:49:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.403+0000 7f7c2d600640 1 -- 172.21.15.100:0/789910156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300b4170 con 0x55b58e257920 2024-02-21T07:49:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.404+0000 7f7c46fea740 1 -- 172.21.15.100:0/789910156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 msgr2=0x55b58e288e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.404+0000 7f7c46fea740 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000c4d0 tx=0x7f7c3009d040 comp rx=0 tx=0).stop 2024-02-21T07:49:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.405+0000 7f7c46fea740 1 -- 172.21.15.100:0/789910156 shutdown_connections 2024-02-21T07:49:55.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.405+0000 7f7c46fea740 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e2d4890 0x55b58e28a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.406+0000 7f7c46fea740 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e299ae0 0x55b58e289c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.406+0000 7f7c46fea740 1 --2- 172.21.15.100:0/789910156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e288e30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.406+0000 7f7c46fea740 1 -- 172.21.15.100:0/789910156 >> 172.21.15.100:0/789910156 conn(0x55b58e2991c0 msgr2=0x55b58e27d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.407+0000 7f7c46fea740 1 -- 172.21.15.100:0/789910156 shutdown_connections 2024-02-21T07:49:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.407+0000 7f7c46fea740 1 -- 172.21.15.100:0/789910156 wait complete. 2024-02-21T07:49:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.409+0000 7f7c46fea740 1 -- start start 2024-02-21T07:49:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.409+0000 7f7c46fea740 1 Processor -- start 2024-02-21T07:49:55.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.414+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.414+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e299ae0 0x55b58e3356e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.414+0000 7f7c46fea740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e2d4890 0x55b58e262010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.417+0000 7f7c46fea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e2922a0 con 0x55b58e257920 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.417+0000 7f7c46fea740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e29e950 con 0x55b58e2d4890 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.417+0000 7f7c46fea740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b58e28a670 con 0x55b58e299ae0 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.417+0000 7f7c46fea740 10 client.0 _ll_register_callbacks cb 0x7f7c34009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:55.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.419+0000 7f7c41800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.419+0000 7f7c41800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48350/0 (socket says 172.21.15.100:48350) 2024-02-21T07:49:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.419+0000 7f7c41800640 1 -- 172.21.15.100:0/850139452 learned_addr learned my addr 172.21.15.100:0/850139452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.419+0000 7f7c40e00640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e299ae0 0x55b58e3356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.421+0000 7f7c41800640 1 -- 172.21.15.100:0/850139452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e299ae0 msgr2=0x55b58e3356e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.421+0000 7f7c41800640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e299ae0 0x55b58e3356e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.421+0000 7f7c41800640 1 -- 172.21.15.100:0/850139452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e2d4890 msgr2=0x55b58e262010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.421+0000 7f7c41800640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e2d4890 0x55b58e262010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.421+0000 7f7c41800640 1 -- 172.21.15.100:0/850139452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3c08e250 con 0x55b58e257920 2024-02-21T07:49:55.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.423+0000 7f7c41800640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c30007eb0 tx=0x7f7c300cb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb6cc71a178e2de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.424+0000 7f7c22a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.429+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c30093330 con 0x55b58e257920 2024-02-21T07:49:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.429+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c30093490 con 0x55b58e257920 2024-02-21T07:49:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.429+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c3400f040 con 0x55b58e257920 2024-02-21T07:49:55.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.430+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c300cb0e0 con 0x55b58e257920 2024-02-21T07:49:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.432+0000 7f7c46fea740 10 client.5787 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:55.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.432+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b58e1856a0 con 0x55b58e257920 2024-02-21T07:49:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.434+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c300c4070 con 0x55b58e257920 2024-02-21T07:49:55.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.434+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7c300aabd0 con 0x55b58e257920 2024-02-21T07:49:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.434+0000 7f7c46fea740 10 client.5787 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.435+0000 7f7c46fea740 10 client.5787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.435+0000 7f7c46fea740 20 client.5787 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.435+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e264320 0x55b58e262550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.435+0000 7f7c46fea740 4 client.5787 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:49:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.435+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b58df017b0 con 0x55b58e264320 2024-02-21T07:49:55.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.443+0000 7f7c40e00640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e264320 0x55b58e262550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.444+0000 7f7c40e00640 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e264320 0x55b58e262550 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21435e6916c9aac5 server_cookie=ca3fbaa492f180ff in_seq=0 out_seq=0 2024-02-21T07:49:55.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.444+0000 7f7c22a00640 10 client.5787 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.451+0000 7f7c22a00640 1 -- 172.21.15.100:0/850139452 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b58df017b0 con 0x55b58e264320 2024-02-21T07:49:55.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.451+0000 7f7c22a00640 10 client.5787 handle_command_reply: tid=0 2024-02-21T07:49:55.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.452+0000 7f7c46fea740 1 client.5787 shutdown 2024-02-21T07:49:55.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.463+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 msgr2=0x55b58e28a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.463+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7c30007eb0 tx=0x7f7c300cb070 comp rx=0 tx=0).stop 2024-02-21T07:49:55.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 shutdown_connections 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b58e264320 0x55b58e262550 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b58e2d4890 0x55b58e262010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b58e299ae0 0x55b58e3356e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 --2- 172.21.15.100:0/850139452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b58e257920 0x55b58e28a130 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 >> 172.21.15.100:0/850139452 conn(0x55b58e2991c0 msgr2=0x55b58e2d39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.464+0000 7f7c22a00640 0 client.5787 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.465+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 shutdown_connections 2024-02-21T07:49:55.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.465+0000 7f7c46fea740 1 -- 172.21.15.100:0/850139452 wait complete. 2024-02-21T07:49:55.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.465+0000 7f7c46fea740 20 client.5787 trim_cache size 0 max 16384 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "a0c400fb-cef8-4b28-a0a5-89d388b54c0a", 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:55.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.468+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 msgr2=0x7f7c1c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.468+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 0x7f7c1c0a1560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c34020000 tx=0x7f7c34021000 comp rx=0 tx=0).stop 2024-02-21T07:49:55.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.471+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 msgr2=0x7f7c3c0cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.471+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0cfb60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c3000c500 tx=0x7f7c3000c9c0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 shutdown_connections 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c1c09f0a0 0x7f7c1c0a1560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c3c189e00 0x7f7c3c14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c3c15bae0 0x7f7c3c08e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 --2- 172.21.15.100:0/1026471932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c3c0713f0 0x7f7c3c0cfb60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 >> 172.21.15.100:0/1026471932 conn(0x7f7c3c0fbec0 msgr2=0x7f7c3c188660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.473+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 shutdown_connections 2024-02-21T07:49:55.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.475+0000 7f7c44200640 1 -- 172.21.15.100:0/1026471932 wait complete. 2024-02-21T07:49:55.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:49:55.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:49:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.866+0000 7fe3c0800640 1 Processor -- start 2024-02-21T07:49:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.866+0000 7fe3c0800640 1 -- start start 2024-02-21T07:49:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3c0800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3b806fc80 0x7fe3b81856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3c0800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe3b8185c30 0x7fe3b80f5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3c0800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b81833b0 con 0x7fe3b8182fd0 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3c0800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b80700e0 con 0x7fe3b8185c30 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3c0800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b806ec50 con 0x7fe3b806fc80 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.868+0000 7fe3bd400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe3b806fc80 0x7fe3b81856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe3b8185c30 0x7fe3b80f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe3b8185c30 0x7fe3b80f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48358/0 (socket says 172.21.15.100:48358) 2024-02-21T07:49:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 -- 172.21.15.100:0/54210933 learned_addr learned my addr 172.21.15.100:0/54210933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 -- 172.21.15.100:0/54210933 >> v2:172.21.15.156:3300/0 conn(0x7fe3b806fc80 msgr2=0x7fe3b81856f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 --2- 172.21.15.100:0/54210933 >> v2:172.21.15.156:3300/0 conn(0x7fe3b806fc80 0x7fe3b81856f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 -- 172.21.15.100:0/54210933 >> v1:172.21.15.170:6789/0 conn(0x7fe3b8182fd0 legacy=0x7fe3b8186be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.869+0000 7fe3be800640 1 -- 172.21.15.100:0/54210933 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b806eec0 con 0x7fe3b8185c30 2024-02-21T07:49:55.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.872+0000 7fe3be800640 1 --2- 172.21.15.100:0/54210933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b8185c30 0x7fe3b80f5930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8188c40 tx=0x7fe3b402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74dc0ae0612dc682 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.872+0000 7fe3bca00640 1 -- 172.21.15.100:0/54210933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b402ec90 con 0x7fe3b8185c30 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.873+0000 7fe3bca00640 1 -- 172.21.15.100:0/54210933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b402edf0 con 0x7fe3b8185c30 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.873+0000 7fe3bca00640 1 -- 172.21.15.100:0/54210933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b402ec90 con 0x7fe3b8185c30 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 -- 172.21.15.100:0/54210933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b8185c30 msgr2=0x7fe3b80f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 --2- 172.21.15.100:0/54210933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b8185c30 0x7fe3b80f5930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe3b8188c40 tx=0x7fe3b402e0f0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 -- 172.21.15.100:0/54210933 shutdown_connections 2024-02-21T07:49:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 --2- 172.21.15.100:0/54210933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b8185c30 0x7fe3b80f5930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 --2- 172.21.15.100:0/54210933 >> v2:172.21.15.156:3300/0 conn(0x7fe3b806fc80 0x7fe3b81856f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.874+0000 7fe3c0800640 1 -- 172.21.15.100:0/54210933 >> 172.21.15.100:0/54210933 conn(0x7fe3b80cf410 msgr2=0x7fe3b80cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.876+0000 7fe3c0800640 1 -- 172.21.15.100:0/54210933 shutdown_connections 2024-02-21T07:49:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.876+0000 7fe3c0800640 1 -- 172.21.15.100:0/54210933 wait complete. 2024-02-21T07:49:55.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.893+0000 7fe3c0800640 1 Processor -- start 2024-02-21T07:49:55.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.895+0000 7fe3c0800640 1 -- start start 2024-02-21T07:49:55.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.908+0000 7fe3c0800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 0x7fe3b815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3c0800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 0x7fe3b82238f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3c0800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3c0800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b815f6c0 con 0x7fe3b806fc80 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3c0800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b82251b0 con 0x7fe3b8185c30 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3c0800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b820da50 con 0x7fe3b8182fd0 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44952/0 (socket says 172.21.15.100:44952) 2024-02-21T07:49:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.909+0000 7fe3be800640 1 -- 172.21.15.100:0/1589896042 learned_addr learned my addr 172.21.15.100:0/1589896042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.910+0000 7fe3bde00640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 0x7fe3b815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.912+0000 7fe3bde00640 1 -- 172.21.15.100:0/1589896042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 msgr2=0x7fe3b82238f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:49:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.912+0000 7fe3bd400640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 0x7fe3b82238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3bde00640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 0x7fe3b82238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3bde00640 1 -- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 msgr2=0x7fe3b82203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3bde00640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3bde00640 1 -- 172.21.15.100:0/1589896042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009b30 con 0x7fe3b806fc80 2024-02-21T07:49:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3be800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:55.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.913+0000 7fe3bd400640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 0x7fe3b82238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:49:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.914+0000 7fe3bde00640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 0x7fe3b815f180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c3c0 tx=0x7fe3a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.915+0000 7fe3b2000640 1 -- 172.21.15.100:0/1589896042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80052d0 con 0x7fe3b806fc80 2024-02-21T07:49:55.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.918+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b82242c0 con 0x7fe3b806fc80 2024-02-21T07:49:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.918+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b8224880 con 0x7fe3b806fc80 2024-02-21T07:49:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.921+0000 7fe3b2000640 1 -- 172.21.15.100:0/1589896042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a8005450 con 0x7fe3b806fc80 2024-02-21T07:49:55.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.921+0000 7fe3b2000640 1 -- 172.21.15.100:0/1589896042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8007260 con 0x7fe3b806fc80 2024-02-21T07:49:55.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.945+0000 7fe3b2000640 1 -- 172.21.15.100:0/1589896042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe3a80073c0 con 0x7fe3b806fc80 2024-02-21T07:49:55.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.950+0000 7fe3b2000640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 0x7fe39c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.950+0000 7fe3c3446740 1 Processor -- start 2024-02-21T07:49:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.951+0000 7fe3c3446740 1 -- start start 2024-02-21T07:49:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.951+0000 7fe3b2000640 1 -- 172.21.15.100:0/1589896042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe3a80c8c90 con 0x7fe3b806fc80 2024-02-21T07:49:55.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.951+0000 7fe3bd400640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 0x7fe39c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115ebfc0 0x564b11621a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ec8e0 0x564b115aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b11523150 con 0x564b115ec8e0 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b11520680 con 0x564b11621f80 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.953+0000 7fe3c3446740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b1151be60 con 0x564b115ebfc0 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.954+0000 7fe3bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.954+0000 7fe3bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44958/0 (socket says 172.21.15.100:44958) 2024-02-21T07:49:55.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.954+0000 7fe3bd400640 1 -- 172.21.15.100:0/4139831919 learned_addr learned my addr 172.21.15.100:0/4139831919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3be800640 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ec8e0 0x564b115aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bde00640 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115ebfc0 0x564b11621a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 0x7fe39c0a1560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3b817f800 tx=0x7fe3ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 -- 172.21.15.100:0/4139831919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115ebfc0 msgr2=0x564b11621a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115ebfc0 0x564b11621a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 -- 172.21.15.100:0/4139831919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ec8e0 msgr2=0x564b115aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ec8e0 0x564b115aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.956+0000 7fe3bd400640 1 -- 172.21.15.100:0/4139831919 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b114d5060 con 0x564b11621f80 2024-02-21T07:49:55.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.957+0000 7fe3bd400640 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00db50 tx=0x7fe3ac01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d4a9a69a4cf769 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.958+0000 7fe3a6600640 1 -- 172.21.15.100:0/4139831919 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac01a070 con 0x564b11621f80 2024-02-21T07:49:55.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.959+0000 7fe3a6600640 1 -- 172.21.15.100:0/4139831919 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00c040 con 0x564b11621f80 2024-02-21T07:49:55.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.959+0000 7fe3a6600640 1 -- 172.21.15.100:0/4139831919 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00b050 con 0x564b11621f80 2024-02-21T07:49:55.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 -- 172.21.15.100:0/4139831919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 msgr2=0x564b115ec3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00db50 tx=0x7fe3ac01a000 comp rx=0 tx=0).stop 2024-02-21T07:49:55.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 -- 172.21.15.100:0/4139831919 shutdown_connections 2024-02-21T07:49:55.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ec8e0 0x564b115aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b11621f80 0x564b115ec3a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 --2- 172.21.15.100:0/4139831919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115ebfc0 0x564b11621a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.960+0000 7fe3c3446740 1 -- 172.21.15.100:0/4139831919 >> 172.21.15.100:0/4139831919 conn(0x564b1157b5a0 msgr2=0x564b115b2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.961+0000 7fe3c3446740 1 -- 172.21.15.100:0/4139831919 shutdown_connections 2024-02-21T07:49:55.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.961+0000 7fe3c3446740 1 -- 172.21.15.100:0/4139831919 wait complete. 2024-02-21T07:49:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.962+0000 7fe3c3446740 1 -- start start 2024-02-21T07:49:55.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.963+0000 7fe3c3446740 1 Processor -- start 2024-02-21T07:49:55.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 0x564b115e4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b114c0ec0 con 0x564b115ebfc0 2024-02-21T07:49:55.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b114c0b60 con 0x564b115ec8e0 2024-02-21T07:49:55.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b1128a1c0 con 0x564b11621f80 2024-02-21T07:49:55.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.965+0000 7fe3c3446740 10 client.0 _ll_register_callbacks cb 0x564b114d4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.966+0000 7fe3be800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 0x564b115e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.966+0000 7fe3bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.966+0000 7fe3bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48386/0 (socket says 172.21.15.100:48386) 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.966+0000 7fe3be800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 0x564b115e4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41542/0 (socket says 172.21.15.100:41542) 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.966+0000 7fe3bde00640 1 -- 172.21.15.100:0/3554510361 learned_addr learned my addr 172.21.15.100:0/3554510361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.967+0000 7fe3bde00640 1 -- 172.21.15.100:0/3554510361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 msgr2=0x564b115e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.967+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 0x564b115e4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.967+0000 7fe3bde00640 1 -- 172.21.15.100:0/3554510361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 msgr2=0x564b115ba8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:49:55.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.967+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115ba8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.967+0000 7fe3bde00640 1 -- 172.21.15.100:0/3554510361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ac00d810 con 0x564b115ebfc0 2024-02-21T07:49:55.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.969+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c6690 tx=0x7fe3a8096910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78170b2c819fcc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:55.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.969+0000 7fe39aa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:49:55.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.970+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a80ae1b0 con 0x564b115ebfc0 2024-02-21T07:49:55.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.970+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe3a80ae310 con 0x564b115ebfc0 2024-02-21T07:49:55.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.970+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b1121b7e0 con 0x564b115ebfc0 2024-02-21T07:49:55.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.971+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3a80c6b50 con 0x564b115ebfc0 2024-02-21T07:49:55.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.971+0000 7fe3c3446740 10 client.5799 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:55.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.971+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b1151a4e0 con 0x564b115ebfc0 2024-02-21T07:49:55.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.971+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80b2070 con 0x564b115ebfc0 2024-02-21T07:49:55.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe3a80c6cb0 con 0x564b115ebfc0 2024-02-21T07:49:55.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 10 client.5799 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:55.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 10 client.5799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:55.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 20 client.5799 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:55.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b115e4f40 0x564b115b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:55.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 4 client.5799 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:49:55.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.972+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b11258720 con 0x564b115e4f40 2024-02-21T07:49:55.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.973+0000 7fe3bd400640 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b115e4f40 0x564b115b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.974+0000 7fe3bd400640 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b115e4f40 0x564b115b38a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9584cea3ae240c52 server_cookie=596b9fe46bef87df in_seq=0 out_seq=0 2024-02-21T07:49:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.974+0000 7fe39aa00640 10 client.5799 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe39aa00640 1 -- 172.21.15.100:0/3554510361 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b11258720 con 0x564b115e4f40 2024-02-21T07:49:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe39aa00640 10 client.5799 handle_command_reply: tid=0 2024-02-21T07:49:55.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 client.5799 shutdown 2024-02-21T07:49:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 msgr2=0x564b115e1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:55.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c6690 tx=0x7fe3a8096910 comp rx=0 tx=0).stop 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 shutdown_connections 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b115e4f40 0x564b115b38a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b11621f80 0x564b115e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3554510361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b115ebfc0 0x564b115e1860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 >> 172.21.15.100:0/3554510361 conn(0x564b1157b5a0 msgr2=0x564b116216a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.975+0000 7fe39aa00640 0 client.5799 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.976+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 shutdown_connections 2024-02-21T07:49:55.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.976+0000 7fe3c3446740 1 -- 172.21.15.100:0/3554510361 wait complete. 2024-02-21T07:49:55.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:55.976+0000 7fe3c3446740 20 client.5799 trim_cache size 0 max 16384 2024-02-21T07:49:56.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.001+0000 7fe3c3446740 1 Processor -- start 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.002+0000 7fe3c3446740 1 -- start start 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b1167e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b1167c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b115b2150 con 0x564b11621f80 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b1167e6c0 con 0x564b115ec8e0 2024-02-21T07:49:56.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3c3446740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b115eb580 con 0x564b115b9be0 2024-02-21T07:49:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44976/0 (socket says 172.21.15.100:44976) 2024-02-21T07:49:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 -- 172.21.15.100:0/504463318 learned_addr learned my addr 172.21.15.100:0/504463318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3be800640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b1167c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bd400640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b1167e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 -- 172.21.15.100:0/504463318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 msgr2=0x564b1167c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:56.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b1167c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.004+0000 7fe3bde00640 1 -- 172.21.15.100:0/504463318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 msgr2=0x564b1167e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:56.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.005+0000 7fe3bde00640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b1167e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.005+0000 7fe3bde00640 1 -- 172.21.15.100:0/504463318 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b114b6950 con 0x564b115ec8e0 2024-02-21T07:49:56.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.005+0000 7fe3bd400640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b1167e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:49:56.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.007+0000 7fe3bde00640 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe3a807ffd0 tx=0x7fe3a8081050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8bb466e7b30563e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:56.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.008+0000 7fe3a5c00640 1 -- 172.21.15.100:0/504463318 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8092e40 con 0x564b115ec8e0 2024-02-21T07:49:56.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.008+0000 7fe3a5c00640 1 -- 172.21.15.100:0/504463318 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a80b2040 con 0x564b115ec8e0 2024-02-21T07:49:56.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.010+0000 7fe3a5c00640 1 -- 172.21.15.100:0/504463318 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a8095ec0 con 0x564b115ec8e0 2024-02-21T07:49:56.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.012+0000 7fe3c3446740 1 -- 172.21.15.100:0/504463318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 msgr2=0x564b115eaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:56.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.012+0000 7fe3c3446740 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe3a807ffd0 tx=0x7fe3a8081050 comp rx=0 tx=0).stop 2024-02-21T07:49:56.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.014+0000 7fe3c3446740 1 -- 172.21.15.100:0/504463318 shutdown_connections 2024-02-21T07:49:56.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.014+0000 7fe3c3446740 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b1167c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.014+0000 7fe3c3446740 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b1167e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.014+0000 7fe3c3446740 1 --2- 172.21.15.100:0/504463318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b115eaf80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.014+0000 7fe3c3446740 1 -- 172.21.15.100:0/504463318 >> 172.21.15.100:0/504463318 conn(0x564b1157b5a0 msgr2=0x564b11625940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.015+0000 7fe3c3446740 1 -- 172.21.15.100:0/504463318 shutdown_connections 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.016+0000 7fe3c3446740 1 -- 172.21.15.100:0/504463318 wait complete. 2024-02-21T07:49:56.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.017+0000 7fe3c3446740 1 -- start start 2024-02-21T07:49:56.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.017+0000 7fe3c3446740 1 Processor -- start 2024-02-21T07:49:56.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.019+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b115e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.019+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b1161bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3c3446740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b11692730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b1161bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b1161bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44984/0 (socket says 172.21.15.100:44984) 2024-02-21T07:49:56.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3bd400640 1 -- 172.21.15.100:0/3527887069 learned_addr learned my addr 172.21.15.100:0/3527887069 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b1161c1a0 con 0x564b11621f80 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b1168ee10 con 0x564b115ec8e0 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b116922a0 con 0x564b115b9be0 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3c3446740 10 client.0 _ll_register_callbacks cb 0x7fe3a8096fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.020+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b115e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.021+0000 7fe3be800640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b11692730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.021+0000 7fe3bde00640 1 -- 172.21.15.100:0/3527887069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 msgr2=0x564b1161bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:56.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.021+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b1161bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.021+0000 7fe3bde00640 1 -- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 msgr2=0x564b11692730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:49:56.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.022+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b11692730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.022+0000 7fe3bde00640 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b114d5060 con 0x564b115b9be0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.022+0000 7fe3be800640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b11692730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.022+0000 7fe3bde00640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b115e1460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8001150 tx=0x7fe3a80c6560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=476f7de2b3a8667 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.022+0000 7fe39aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.023+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a809a920 con 0x564b115b9be0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.023+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe3a8092e40 con 0x564b115b9be0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.023+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3ac00c040 con 0x564b115b9be0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.024+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3a8093000 con 0x564b115b9be0 2024-02-21T07:49:56.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.024+0000 7fe3c3446740 10 client.5906 fetch_fsmap learned FSMap version 16 2024-02-21T07:49:56.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.024+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564b1151a4e0 con 0x564b115b9be0 2024-02-21T07:49:56.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.024+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac00c040 con 0x564b115b9be0 2024-02-21T07:49:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe3a80bd070 con 0x564b115b9be0 2024-02-21T07:49:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 10 client.5906 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:49:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 10 client.5906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:49:56.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 20 client.5906 populate_metadata read hostname 'smithi100' 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b116782f0 0x564b115ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 4 client.5906 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.025+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564b112a7890 con 0x564b116782f0 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.026+0000 7fe3bd400640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b116782f0 0x564b115ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3bd400640 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b116782f0 0x564b115ddeb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cca63a0037d6416 server_cookie=dcfff0e7da45ce3e in_seq=0 out_seq=0 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe39aa00640 10 client.5906 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe39aa00640 1 -- 172.21.15.100:0/3527887069 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564b112a7890 con 0x564b116782f0 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe39aa00640 10 client.5906 handle_command_reply: tid=0 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3c3446740 1 client.5906 shutdown 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 msgr2=0x564b115e1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b115e1460 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8001150 tx=0x7fe3a80c6560 comp rx=0 tx=0).stop 2024-02-21T07:49:56.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 shutdown_connections 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.027+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564b116782f0 0x564b115ddeb0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.028+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564b11621f80 0x564b11692730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.028+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564b115ec8e0 0x564b1161bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.028+0000 7fe3c3446740 1 --2- 172.21.15.100:0/3527887069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564b115b9be0 0x564b115e1460 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.028+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 >> 172.21.15.100:0/3527887069 conn(0x564b1157b5a0 msgr2=0x564b115eb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.028+0000 7fe39aa00640 0 client.5906 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.029+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 shutdown_connections 2024-02-21T07:49:56.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.029+0000 7fe3c3446740 1 -- 172.21.15.100:0/3527887069 wait complete. 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.029+0000 7fe3c3446740 20 client.5906 trim_cache size 0 max 16384 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "a0c400fb-cef8-4b28-a0a5-89d388b54c0a": { 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "a0c400fb-cef8-4b28-a0a5-89d388b54c0a", 2024-02-21T07:49:56.035 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:49:56.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:49:56.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:49:56.036 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:49:56.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 msgr2=0x7fe39c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:56.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 0x7fe39c0a1560 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3b817f800 tx=0x7fe3ac008040 comp rx=0 tx=0).stop 2024-02-21T07:49:56.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 msgr2=0x7fe3b815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:49:56.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 0x7fe3b815f180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe3a800c3c0 tx=0x7fe3a800c880 comp rx=0 tx=0).stop 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 shutdown_connections 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe3b8185c30 0x7fe3b82203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3b8182fd0 0x7fe3b82238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe39c09f0a0 0x7fe39c0a1560 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 --2- 172.21.15.100:0/1589896042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3b806fc80 0x7fe3b815f180 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 >> 172.21.15.100:0/1589896042 conn(0x7fe3b80cf410 msgr2=0x7fe3b820fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 shutdown_connections 2024-02-21T07:49:56.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:49:56.030+0000 7fe3c0800640 1 -- 172.21.15.100:0/1589896042 wait complete. 2024-02-21T07:49:56.054 INFO:tasks.cephfs.filesystem:scrub status for tag:a0c400fb-cef8-4b28-a0a5-89d388b54c0a - {'path': '/', 'tag': 'a0c400fb-cef8-4b28-a0a5-89d388b54c0a', 'options': 'recursive,force'} 2024-02-21T07:50:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.466+0000 7fb485e00640 1 Processor -- start 2024-02-21T07:50:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.466+0000 7fb485e00640 1 -- start start 2024-02-21T07:50:01.476 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.472+0000 7fb485e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4800d2140 0x7fb48018e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.473+0000 7fb484a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb48018a210 0x7fb4801650f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50854/0 (socket says 172.21.15.100:50854) 2024-02-21T07:50:01.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.473+0000 7fb47fe00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb4800f4b80 0x7fb4800f5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:46274/0 (socket says 172.21.15.100:46274) 2024-02-21T07:50:01.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.473+0000 7fb484a00640 1 -- 172.21.15.100:0/1822709474 learned_addr learned my addr 172.21.15.100:0/1822709474 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:01.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.473+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48018e170 con 0x7fb48018a210 2024-02-21T07:50:01.478 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.474+0000 7fb485400640 1 --2- 172.21.15.100:0/1822709474 >> v2:172.21.15.100:3300/0 conn(0x7fb4800d2140 0x7fb48018e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.475+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800f59f0 con 0x7fb4800f4b80 2024-02-21T07:50:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.475+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48018a5f0 con 0x7fb4800d2140 2024-02-21T07:50:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728028318 0 0) 0x7fb4800f59f0 con 0x7fb4800f4b80 2024-02-21T07:50:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb464003520 con 0x7fb4800f4b80 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497987403 0 0) 0x7fb464003520 con 0x7fb4800f4b80 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 >> v2:172.21.15.100:3300/0 conn(0x7fb4800d2140 msgr2=0x7fb48018e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 --2- 172.21.15.100:0/1822709474 >> v2:172.21.15.100:3300/0 conn(0x7fb4800d2140 0x7fb48018e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 >> v1:172.21.15.100:6789/0 conn(0x7fb48018a210 legacy=0x7fb4801650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800f5cd0 con 0x7fb4800f4b80 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fb46c001670 con 0x7fb4800f4b80 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 >> v1:172.21.15.156:6789/0 conn(0x7fb4800f4b80 legacy=0x7fb4800f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb464003970 0x7fb464003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 0x7fb464004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb464005180 0x7fb46400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48018a5f0 con 0x7fb464005180 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46400c0b0 con 0x7fb464003970 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.476+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46400c270 con 0x7fb4640047c0 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.477+0000 7fb47fe00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 0x7fb464004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb485400640 1 --2- 172.21.15.100:0/1822709474 >> v2:172.21.15.100:3300/0 conn(0x7fb4800d2140 0x7fb48018e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb47fe00640 1 -- 172.21.15.100:0/1822709474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb464003970 msgr2=0x7fb464003d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb47fe00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb464003970 0x7fb464003d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb47fe00640 1 -- 172.21.15.100:0/1822709474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb464005180 msgr2=0x7fb46400b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb47fe00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb464005180 0x7fb46400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb47fe00640 1 -- 172.21.15.100:0/1822709474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800f5cd0 con 0x7fb4640047c0 2024-02-21T07:50:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.478+0000 7fb485400640 1 -- 172.21.15.100:0/1822709474 reap_dead start 2024-02-21T07:50:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.481+0000 7fb47fe00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 0x7fb464004c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c160 tx=0x7fb4640057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5360d060249eb7df server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.482+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c005a10 con 0x7fb4640047c0 2024-02-21T07:50:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.482+0000 7fb47f400640 1 -- 172.21.15.100:0/1822709474 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c005b70 con 0x7fb4640047c0 2024-02-21T07:50:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.483+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 msgr2=0x7fb464004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.484+0000 7fb485e00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 0x7fb464004c40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00c160 tx=0x7fb4640057f0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.484+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 shutdown_connections 2024-02-21T07:50:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.484+0000 7fb485e00640 1 --2- 172.21.15.100:0/1822709474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640047c0 0x7fb464004c40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.484+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 >> 172.21.15.100:0/1822709474 conn(0x7fb4800f6630 msgr2=0x7fb4800f6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.485+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 shutdown_connections 2024-02-21T07:50:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.485+0000 7fb485e00640 1 -- 172.21.15.100:0/1822709474 wait complete. 2024-02-21T07:50:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.491+0000 7fb485e00640 1 Processor -- start 2024-02-21T07:50:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.491+0000 7fb485e00640 1 -- start start 2024-02-21T07:50:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.494+0000 7fb485e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 0x7fb480160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.494+0000 7fb485e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.495+0000 7fb485e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 0x7fb4802229a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb484a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 0x7fb480160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.495+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48548/0 (socket says 172.21.15.100:48548) 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb47fe00640 1 -- 172.21.15.100:0/3991095992 learned_addr learned my addr 172.21.15.100:0/3991095992 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4801613d0 con 0x7fb480222520 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800f0c80 con 0x7fb4640047c0 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800f0f60 con 0x7fb4800f7760 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb485400640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 0x7fb4802229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.496+0000 7fb47fe00640 1 -- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 msgr2=0x7fb480160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb47fe00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 0x7fb480160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb47fe00640 1 -- 172.21.15.100:0/3991095992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 msgr2=0x7fb4802229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb47fe00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 0x7fb4802229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb47fe00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800f8480 con 0x7fb4800f7760 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb485400640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 0x7fb4802229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.498+0000 7fb484a00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 0x7fb480160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:01.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.499+0000 7fb47fe00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb46c02c480 tx=0x7fb46c001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.499+0000 7fb47cc00640 1 -- 172.21.15.100:0/3991095992 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c007630 con 0x7fb4800f7760 2024-02-21T07:50:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.500+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4800f8760 con 0x7fb4800f7760 2024-02-21T07:50:01.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.500+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4800f8d20 con 0x7fb4800f7760 2024-02-21T07:50:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.501+0000 7fb47cc00640 1 -- 172.21.15.100:0/3991095992 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c03a070 con 0x7fb4800f7760 2024-02-21T07:50:01.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.501+0000 7fb47cc00640 1 -- 172.21.15.100:0/3991095992 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c004a20 con 0x7fb4800f7760 2024-02-21T07:50:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.505+0000 7fb47cc00640 1 -- 172.21.15.100:0/3991095992 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb46c032070 con 0x7fb4800f7760 2024-02-21T07:50:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.508+0000 7fb47cc00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 0x7fb4600a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.509+0000 7fb47cc00640 1 -- 172.21.15.100:0/3991095992 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb46c0eae50 con 0x7fb4800f7760 2024-02-21T07:50:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.509+0000 7fb484a00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 0x7fb4600a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.510+0000 7fb484a00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 0x7fb4600a16e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb478007fd0 tx=0x7fb478009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.511+0000 7fb48a1a2740 1 Processor -- start 2024-02-21T07:50:01.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.511+0000 7fb48a1a2740 1 -- start start 2024-02-21T07:50:01.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3540c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35411a0 0x5652f357c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f34fc620 con 0x5652f35b06e0 2024-02-21T07:50:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f34ae8c0 con 0x5652f35411a0 2024-02-21T07:50:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.513+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f34abdf0 con 0x5652f357c280 2024-02-21T07:50:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.514+0000 7fb484a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.514+0000 7fb484a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48550/0 (socket says 172.21.15.100:48550) 2024-02-21T07:50:01.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.514+0000 7fb485400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35411a0 0x5652f357c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 -- 172.21.15.100:0/2694963768 learned_addr learned my addr 172.21.15.100:0/2694963768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:01.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.514+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3540c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 -- 172.21.15.100:0/2694963768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35411a0 msgr2=0x5652f357c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35411a0 0x5652f357c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 -- 172.21.15.100:0/2694963768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 msgr2=0x5652f3540c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3540c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb484a00640 1 -- 172.21.15.100:0/2694963768 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652f3428b00 con 0x5652f357c280 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.516+0000 7fb47fe00640 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3540c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.517+0000 7fb484a00640 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb47800df50 tx=0x7fb478010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8fbd02c345471d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.517+0000 7fb475200640 1 -- 172.21.15.100:0/2694963768 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478007a60 con 0x5652f357c280 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.517+0000 7fb475200640 1 -- 172.21.15.100:0/2694963768 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4780020c0 con 0x5652f357c280 2024-02-21T07:50:01.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.517+0000 7fb475200640 1 -- 172.21.15.100:0/2694963768 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478020650 con 0x5652f357c280 2024-02-21T07:50:01.522 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.518+0000 7fb48a1a2740 1 -- 172.21.15.100:0/2694963768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 msgr2=0x5652f353b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.518+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb47800df50 tx=0x7fb478010000 comp rx=0 tx=0).stop 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 -- 172.21.15.100:0/2694963768 shutdown_connections 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35411a0 0x5652f357c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3540c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/2694963768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 -- 172.21.15.100:0/2694963768 >> 172.21.15.100:0/2694963768 conn(0x5652f35084b0 msgr2=0x5652f353feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 -- 172.21.15.100:0/2694963768 shutdown_connections 2024-02-21T07:50:01.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.519+0000 7fb48a1a2740 1 -- 172.21.15.100:0/2694963768 wait complete. 2024-02-21T07:50:01.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.520+0000 7fb48a1a2740 1 -- start start 2024-02-21T07:50:01.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.520+0000 7fb48a1a2740 1 Processor -- start 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35411a0 0x5652f353d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b06e0 0x5652f35a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f34a75d0 con 0x5652f35411a0 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f344cb50 con 0x5652f35b06e0 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f344c7f0 con 0x5652f357c280 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.525+0000 7fb48a1a2740 10 client.0 _ll_register_callbacks cb 0x5652f3460550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48554/0 (socket says 172.21.15.100:48554) 2024-02-21T07:50:01.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 -- 172.21.15.100:0/4105821736 learned_addr learned my addr 172.21.15.100:0/4105821736 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 -- 172.21.15.100:0/4105821736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b06e0 msgr2=0x5652f35a27c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b06e0 0x5652f35a27c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 -- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35411a0 msgr2=0x5652f353d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35411a0 0x5652f353d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.526+0000 7fb47fe00640 1 -- 172.21.15.100:0/4105821736 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47800dc30 con 0x5652f357c280 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.527+0000 7fb47fe00640 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0e8760 tx=0x7fb46c0b8560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca41fc36bb262b35 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.527+0000 7fb469600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.527+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0b8930 con 0x5652f357c280 2024-02-21T07:50:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.527+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb46c0d7040 con 0x5652f357c280 2024-02-21T07:50:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.528+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652f3479cd0 con 0x5652f357c280 2024-02-21T07:50:01.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.528+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb46c0bca80 con 0x5652f357c280 2024-02-21T07:50:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.529+0000 7fb48a1a2740 10 client.5915 fetch_fsmap learned FSMap version 16 2024-02-21T07:50:01.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.529+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5652f34a5c50 con 0x5652f357c280 2024-02-21T07:50:01.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.530+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652f3479cd0 con 0x5652f357c280 2024-02-21T07:50:01.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.530+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb46c004b80 con 0x5652f357c280 2024-02-21T07:50:01.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 10 client.5915 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:50:01.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 10 client.5915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 20 client.5915 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f356a590 0x5652f356ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 4 client.5915 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:01.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.535+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652f349dce0 con 0x5652f356a590 2024-02-21T07:50:01.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.538+0000 7fb484a00640 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f356a590 0x5652f356ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.538+0000 7fb484a00640 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f356a590 0x5652f356ec20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c26ab8b4d19273 server_cookie=8b3a89ecb3823e38 in_seq=0 out_seq=0 2024-02-21T07:50:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.538+0000 7fb469600640 10 client.5915 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.539+0000 7fb469600640 1 -- 172.21.15.100:0/4105821736 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5652f349dce0 con 0x5652f356a590 2024-02-21T07:50:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.539+0000 7fb469600640 10 client.5915 handle_command_reply: tid=0 2024-02-21T07:50:01.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.539+0000 7fb48a1a2740 1 client.5915 shutdown 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 msgr2=0x5652f353b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb46c0e8760 tx=0x7fb46c0b8560 comp rx=0 tx=0).stop 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 shutdown_connections 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f356a590 0x5652f356ec20 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b06e0 0x5652f35a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f357c280 0x5652f353b560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4105821736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35411a0 0x5652f353d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 >> 172.21.15.100:0/4105821736 conn(0x5652f35084b0 msgr2=0x5652f35b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb469600640 0 client.5915 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 shutdown_connections 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.540+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4105821736 wait complete. 2024-02-21T07:50:01.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.541+0000 7fb48a1a2740 20 client.5915 trim_cache size 0 max 16384 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.571+0000 7fb48a1a2740 1 Processor -- start 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.573+0000 7fb48a1a2740 1 -- start start 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f35818e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35a54d0 0x5652f35468f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f31efe60 con 0x5652f35b06e0 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f353ec40 con 0x5652f35a54d0 2024-02-21T07:50:01.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.575+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f35b2400 con 0x5652f35411a0 2024-02-21T07:50:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.580+0000 7fb484a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.580+0000 7fb484a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48570/0 (socket says 172.21.15.100:48570) 2024-02-21T07:50:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.580+0000 7fb484a00640 1 -- 172.21.15.100:0/894240977 learned_addr learned my addr 172.21.15.100:0/894240977 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb484a00640 1 -- 172.21.15.100:0/894240977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35a54d0 msgr2=0x5652f35468f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:01.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb484a00640 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35a54d0 0x5652f35468f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb47fe00640 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f35818e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb484a00640 1 -- 172.21.15.100:0/894240977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 msgr2=0x5652f35818e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb484a00640 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f35818e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb484a00640 1 -- 172.21.15.100:0/894240977 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652f3442530 con 0x5652f35411a0 2024-02-21T07:50:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.583+0000 7fb47fe00640 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f35818e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:01.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.585+0000 7fb484a00640 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb47800df20 tx=0x7fb478007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b4a28253628be0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.588+0000 7fb46be00640 1 -- 172.21.15.100:0/894240977 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478027040 con 0x5652f35411a0 2024-02-21T07:50:01.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.588+0000 7fb46be00640 1 -- 172.21.15.100:0/894240977 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478051030 con 0x5652f35411a0 2024-02-21T07:50:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.588+0000 7fb46be00640 1 -- 172.21.15.100:0/894240977 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478027040 con 0x5652f35411a0 2024-02-21T07:50:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.589+0000 7fb48a1a2740 1 -- 172.21.15.100:0/894240977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 msgr2=0x5652f35af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.589+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb47800df20 tx=0x7fb478007000 comp rx=0 tx=0).stop 2024-02-21T07:50:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.591+0000 7fb48a1a2740 1 -- 172.21.15.100:0/894240977 shutdown_connections 2024-02-21T07:50:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.591+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35a54d0 0x5652f35468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.591+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f35818e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.591+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/894240977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35411a0 0x5652f35af7e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.591+0000 7fb48a1a2740 1 -- 172.21.15.100:0/894240977 >> 172.21.15.100:0/894240977 conn(0x5652f35084b0 msgr2=0x5652f35a25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.592+0000 7fb48a1a2740 1 -- 172.21.15.100:0/894240977 shutdown_connections 2024-02-21T07:50:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.593+0000 7fb48a1a2740 1 -- 172.21.15.100:0/894240977 wait complete. 2024-02-21T07:50:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.594+0000 7fb48a1a2740 1 -- start start 2024-02-21T07:50:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.594+0000 7fb48a1a2740 1 Processor -- start 2024-02-21T07:50:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35a54d0 0x5652f35b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3615aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f356bba0 con 0x5652f35b06e0 2024-02-21T07:50:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f35d8d10 con 0x5652f35b2870 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652f35b89e0 con 0x5652f35a54d0 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb48a1a2740 10 client.0 _ll_register_callbacks cb 0x7fb478001790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb484a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35a54d0 0x5652f35b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.600+0000 7fb485400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb47fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3615aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41558/0 (socket says 172.21.15.100:41558) 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 -- 172.21.15.100:0/4273563499 learned_addr learned my addr 172.21.15.100:0/4273563499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 -- 172.21.15.100:0/4273563499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35a54d0 msgr2=0x5652f35b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35a54d0 0x5652f35b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 -- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 msgr2=0x5652f3615aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3615aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb485400640 1 -- 172.21.15.100:0/4273563499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652f3428b00 con 0x5652f35b2870 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.601+0000 7fb47fe00640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3615aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.602+0000 7fb485400640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb480169040 tx=0x7fb4700136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa48f5848ebc81a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.602+0000 7fb469600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.602+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470004230 con 0x5652f35b2870 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.602+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb470004390 con 0x5652f35b2870 2024-02-21T07:50:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.602+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652f34ccd30 con 0x5652f35b2870 2024-02-21T07:50:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.603+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb470003610 con 0x5652f35b2870 2024-02-21T07:50:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.603+0000 7fb48a1a2740 10 client.5971 fetch_fsmap learned FSMap version 16 2024-02-21T07:50:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.603+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5652f34682c0 con 0x5652f35b2870 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5652f34ccd30 con 0x5652f35b2870 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb470003770 con 0x5652f35b2870 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb48a1a2740 10 client.5971 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb48a1a2740 10 client.5971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb48a1a2740 20 client.5971 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.605+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f35b8560 0x5652f3610980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.606+0000 7fb48a1a2740 4 client.5971 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:50:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.606+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652f31a7600 con 0x5652f35b8560 2024-02-21T07:50:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.608+0000 7fb484a00640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f35b8560 0x5652f3610980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.610+0000 7fb484a00640 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f35b8560 0x5652f3610980 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d1de9c91949cb65 server_cookie=5d0903058128161e in_seq=0 out_seq=0 2024-02-21T07:50:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.611+0000 7fb469600640 10 client.5971 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb469600640 1 -- 172.21.15.100:0/4273563499 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652f31a7600 con 0x5652f35b8560 2024-02-21T07:50:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb469600640 10 client.5971 handle_command_reply: tid=0 2024-02-21T07:50:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 client.5971 shutdown 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 msgr2=0x5652f3610440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb480169040 tx=0x7fb4700136b0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 shutdown_connections 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5652f35b8560 0x5652f3610980 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652f35b2870 0x5652f3610440 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652f35b06e0 0x5652f3615aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 --2- 172.21.15.100:0/4273563499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5652f35a54d0 0x5652f35b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 >> 172.21.15.100:0/4273563499 conn(0x5652f35084b0 msgr2=0x5652f356ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.644+0000 7fb469600640 0 client.5971 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.650+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 shutdown_connections 2024-02-21T07:50:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.650+0000 7fb48a1a2740 1 -- 172.21.15.100:0/4273563499 wait complete. 2024-02-21T07:50:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.651+0000 7fb48a1a2740 20 client.5971 trim_cache size 0 max 16384 2024-02-21T07:50:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:50:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:50:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:50:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:50:01.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 msgr2=0x7fb4600a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 0x7fb4600a16e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb478007fd0 tx=0x7fb478009040 comp rx=0 tx=0).stop 2024-02-21T07:50:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 msgr2=0x7fb4800f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:01.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb46c02c480 tx=0x7fb46c001930 comp rx=0 tx=0).stop 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 shutdown_connections 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46009f220 0x7fb4600a16e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb480222520 0x7fb4802229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4800f7760 0x7fb4800f7be0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 --2- 172.21.15.100:0/3991095992 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4640047c0 0x7fb480160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.656+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 >> 172.21.15.100:0/3991095992 conn(0x7fb4800f6630 msgr2=0x7fb480187a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.657+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 shutdown_connections 2024-02-21T07:50:01.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:01.657+0000 7fb485e00640 1 -- 172.21.15.100:0/3991095992 wait complete. 2024-02-21T07:50:13.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:13.736 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:13.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:14.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.867+0000 7fe123c00640 1 Processor -- start 2024-02-21T07:50:14.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.867+0000 7fe123c00640 1 -- start start 2024-02-21T07:50:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe123c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe11c188aa0 0x7fe11c070c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe123c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe11c0711b0 0x7fe11c188e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe123c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c186490 con 0x7fe11c1893c0 2024-02-21T07:50:14.883 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe123c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c071640 con 0x7fe11c0711b0 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe123c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c08e040 con 0x7fe11c188aa0 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe121200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe11c188aa0 0x7fe11c070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe121200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe11c188aa0 0x7fe11c070c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:33398/0 (socket says 172.21.15.100:33398) 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.874+0000 7fe121200640 1 -- 172.21.15.100:0/3796213718 learned_addr learned my addr 172.21.15.100:0/3796213718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.876+0000 7fe121200640 1 -- 172.21.15.100:0/3796213718 >> v2:172.21.15.100:3300/0 conn(0x7fe11c0711b0 msgr2=0x7fe11c188e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.876+0000 7fe121200640 1 --2- 172.21.15.100:0/3796213718 >> v2:172.21.15.100:3300/0 conn(0x7fe11c0711b0 0x7fe11c188e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.876+0000 7fe121200640 1 -- 172.21.15.100:0/3796213718 >> v1:172.21.15.156:6789/0 conn(0x7fe11c1893c0 legacy=0x7fe11c06fb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:14.884 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.876+0000 7fe121200640 1 -- 172.21.15.100:0/3796213718 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c08d150 con 0x7fe11c188aa0 2024-02-21T07:50:14.885 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.878+0000 7fe121200640 1 --2- 172.21.15.100:0/3796213718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c188aa0 0x7fe11c070c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0d0420 tx=0x7fe11002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd62686f19e714c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.885 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.880+0000 7fe11b400640 1 -- 172.21.15.100:0/3796213718 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110031800 con 0x7fe11c188aa0 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.880+0000 7fe11b400640 1 -- 172.21.15.100:0/3796213718 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe110031960 con 0x7fe11c188aa0 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.880+0000 7fe11b400640 1 -- 172.21.15.100:0/3796213718 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe110031cf0 con 0x7fe11c188aa0 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.881+0000 7fe123c00640 1 -- 172.21.15.100:0/3796213718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c188aa0 msgr2=0x7fe11c070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.881+0000 7fe123c00640 1 --2- 172.21.15.100:0/3796213718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c188aa0 0x7fe11c070c70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0d0420 tx=0x7fe11002b8a0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.881+0000 7fe123c00640 1 -- 172.21.15.100:0/3796213718 shutdown_connections 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.881+0000 7fe123c00640 1 --2- 172.21.15.100:0/3796213718 >> v2:172.21.15.100:3300/0 conn(0x7fe11c0711b0 0x7fe11c188e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.881+0000 7fe123c00640 1 --2- 172.21.15.100:0/3796213718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c188aa0 0x7fe11c070c70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.887 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.882+0000 7fe123c00640 1 -- 172.21.15.100:0/3796213718 >> 172.21.15.100:0/3796213718 conn(0x7fe11c0cf300 msgr2=0x7fe11c0cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:14.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.890+0000 7fe123c00640 1 -- 172.21.15.100:0/3796213718 shutdown_connections 2024-02-21T07:50:14.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.890+0000 7fe123c00640 1 -- 172.21.15.100:0/3796213718 wait complete. 2024-02-21T07:50:14.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.894+0000 7fe123c00640 1 Processor -- start 2024-02-21T07:50:14.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.894+0000 7fe123c00640 1 -- start start 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe11c188aa0 0x7fe11c17afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 0x7fe11c17b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c217450 con 0x7fe11c1893c0 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c17bb30 con 0x7fe11c188aa0 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe123c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c17be10 con 0x7fe11c0711b0 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:33404/0 (socket says 172.21.15.100:33404) 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 -- 172.21.15.100:0/427212818 learned_addr learned my addr 172.21.15.100:0/427212818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe11be00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe11c188aa0 0x7fe11c17afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 -- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe11c188aa0 msgr2=0x7fe11c17afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe11c188aa0 0x7fe11c17afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.897+0000 7fe121200640 1 -- 172.21.15.100:0/427212818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 msgr2=0x7fe11c17b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.898+0000 7fe121c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 0x7fe11c17b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.898+0000 7fe121200640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 0x7fe11c17b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.898+0000 7fe121200640 1 -- 172.21.15.100:0/427212818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100094d0 con 0x7fe11c0711b0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.898+0000 7fe121c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 0x7fe11c17b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.898+0000 7fe121200640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1100090b0 tx=0x7fe1100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.899+0000 7fe118c00640 1 -- 172.21.15.100:0/427212818 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11003ad20 con 0x7fe11c0711b0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.899+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c17c0f0 con 0x7fe11c0711b0 2024-02-21T07:50:14.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.899+0000 7fe118c00640 1 -- 172.21.15.100:0/427212818 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11003ae80 con 0x7fe11c0711b0 2024-02-21T07:50:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.900+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c217070 con 0x7fe11c0711b0 2024-02-21T07:50:14.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.901+0000 7fe118c00640 1 -- 172.21.15.100:0/427212818 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11003ad20 con 0x7fe11c0711b0 2024-02-21T07:50:14.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.904+0000 7fe118c00640 1 -- 172.21.15.100:0/427212818 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe1100443f0 con 0x7fe11c0711b0 2024-02-21T07:50:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.908+0000 7fe126a0c740 1 Processor -- start 2024-02-21T07:50:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.908+0000 7fe126a0c740 1 -- start start 2024-02-21T07:50:14.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.908+0000 7fe118c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 0x7fe0fc0a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.909+0000 7fe121c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 0x7fe0fc0a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.909+0000 7fe118c00640 1 -- 172.21.15.100:0/427212818 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe11002e070 con 0x7fe11c0711b0 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 0x557c9247ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92438620 con 0x557c924ec4d0 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c923ea8c0 con 0x557c9247cf90 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe126a0c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c923e7df0 con 0x557c924b8070 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:33412/0 (socket says 172.21.15.100:33412) 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 -- 172.21.15.100:0/748652183 learned_addr learned my addr 172.21.15.100:0/748652183 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe11be00640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 0x557c9247ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121c00640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 -- 172.21.15.100:0/748652183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 msgr2=0x557c924b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 -- 172.21.15.100:0/748652183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 msgr2=0x557c9247ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 0x557c9247ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe121200640 1 -- 172.21.15.100:0/748652183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c92364b00 con 0x557c924b8070 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.910+0000 7fe11be00640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 0x557c9247ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe121c00640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe121c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 0x7fe0fc0a1640 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe114007e30 tx=0x7fe114007340 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe121200640 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b56c0 tx=0x7fe110009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31d562fe9957d13 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe10d600640 1 -- 172.21.15.100:0/748652183 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100bd3b0 con 0x557c924b8070 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe10d600640 1 -- 172.21.15.100:0/748652183 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100c1a00 con 0x557c924b8070 2024-02-21T07:50:14.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.911+0000 7fe10d600640 1 -- 172.21.15.100:0/748652183 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100e9110 con 0x557c924b8070 2024-02-21T07:50:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 -- 172.21.15.100:0/748652183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 msgr2=0x557c92477440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:14.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b56c0 tx=0x7fe110009240 comp rx=0 tx=0).stop 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 -- 172.21.15.100:0/748652183 shutdown_connections 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924ec4d0 0x557c9247ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 --2- 172.21.15.100:0/748652183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924b8070 0x557c92477440 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.912+0000 7fe126a0c740 1 -- 172.21.15.100:0/748652183 >> 172.21.15.100:0/748652183 conn(0x557c924444b0 msgr2=0x557c9247bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.913+0000 7fe126a0c740 1 -- 172.21.15.100:0/748652183 shutdown_connections 2024-02-21T07:50:14.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.913+0000 7fe126a0c740 1 -- 172.21.15.100:0/748652183 wait complete. 2024-02-21T07:50:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.915+0000 7fe126a0c740 1 -- start start 2024-02-21T07:50:14.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.916+0000 7fe126a0c740 1 Processor -- start 2024-02-21T07:50:14.923 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.918+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c924aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c923e35d0 con 0x557c924b8070 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92388b50 con 0x557c9247cf90 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c923887f0 con 0x557c924ec4d0 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.919+0000 7fe126a0c740 10 client.0 _ll_register_callbacks cb 0x557c9239c550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39150/0 (socket says 172.21.15.100:39150) 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 -- 172.21.15.100:0/841119440 learned_addr learned my addr 172.21.15.100:0/841119440 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121c00640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c924aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe11be00640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 -- 172.21.15.100:0/841119440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 msgr2=0x557c924aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c924aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 -- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 msgr2=0x557c924fe770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924fe770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.920+0000 7fe121200640 1 -- 172.21.15.100:0/841119440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c217070 con 0x557c9247cf90 2024-02-21T07:50:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.921+0000 7fe121200640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1100e9050 tx=0x7fe110046070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701ecb0a2ace8a24 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.926 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.921+0000 7fe102000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.921+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100bd3b0 con 0x557c9247cf90 2024-02-21T07:50:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.921+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe1100b58d0 con 0x557c9247cf90 2024-02-21T07:50:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.923+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c923b5cd0 con 0x557c9247cf90 2024-02-21T07:50:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.923+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1100b5a90 con 0x557c9247cf90 2024-02-21T07:50:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.923+0000 7fe126a0c740 10 client.5977 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.923+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557c923e1c50 con 0x557c9247cf90 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.923+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c923b5cd0 con 0x557c9247cf90 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe1100ce050 con 0x557c9247cf90 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 10 client.5977 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 10 client.5977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 20 client.5977 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924e0e40 0x557c924b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 4 client.5977 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c923d9ce0 con 0x557c924e0e40 2024-02-21T07:50:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.924+0000 7fe11be00640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924e0e40 0x557c924b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.930 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.925+0000 7fe11be00640 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924e0e40 0x557c924b8450 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32da4182e29db054 server_cookie=eb555e1eb5da93d8 in_seq=0 out_seq=0 2024-02-21T07:50:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.930+0000 7fe102000640 10 client.5977 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.930+0000 7fe102000640 1 -- 172.21.15.100:0/841119440 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c923d9ce0 con 0x557c924e0e40 2024-02-21T07:50:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.930+0000 7fe102000640 10 client.5977 handle_command_reply: tid=0 2024-02-21T07:50:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.931+0000 7fe126a0c740 1 client.5977 shutdown 2024-02-21T07:50:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 msgr2=0x557c924a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:14.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1100e9050 tx=0x7fe110046070 comp rx=0 tx=0).stop 2024-02-21T07:50:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 shutdown_connections 2024-02-21T07:50:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924e0e40 0x557c924b8450 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c924aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924fe770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 --2- 172.21.15.100:0/841119440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c9247cf90 0x557c924a9b30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.932+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 >> 172.21.15.100:0/841119440 conn(0x557c924444b0 msgr2=0x557c924b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.933+0000 7fe102000640 0 client.5977 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.933+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 shutdown_connections 2024-02-21T07:50:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.934+0000 7fe126a0c740 1 -- 172.21.15.100:0/841119440 wait complete. 2024-02-21T07:50:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.934+0000 7fe126a0c740 20 client.5977 trim_cache size 0 max 16384 2024-02-21T07:50:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.959+0000 7fe126a0c740 1 Processor -- start 2024-02-21T07:50:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.960+0000 7fe126a0c740 1 -- start start 2024-02-21T07:50:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c9247cf90 0x557c92482de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 0x557c9250d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c9212be60 con 0x557c924b8070 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c924ebcd0 con 0x557c924ec4d0 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.962+0000 7fe126a0c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c924e1220 con 0x557c9247cf90 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.963+0000 7fe121c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 0x557c9250d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.963+0000 7fe121c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 0x557c9250d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39162/0 (socket says 172.21.15.100:39162) 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.963+0000 7fe121c00640 1 -- 172.21.15.100:0/3527965028 learned_addr learned my addr 172.21.15.100:0/3527965028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.963+0000 7fe11be00640 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.964+0000 7fe11be00640 1 -- 172.21.15.100:0/3527965028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c9247cf90 msgr2=0x557c92482de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.964+0000 7fe11be00640 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c9247cf90 0x557c92482de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.964+0000 7fe11be00640 1 -- 172.21.15.100:0/3527965028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 msgr2=0x557c9250d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.964+0000 7fe11be00640 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 0x557c9250d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.964+0000 7fe11be00640 1 -- 172.21.15.100:0/3527965028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c9237e530 con 0x557c924b8070 2024-02-21T07:50:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.965+0000 7fe11be00640 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924aa8a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x557c9247afe0 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a880e984acda50b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.970+0000 7fe10cc00640 1 -- 172.21.15.100:0/3527965028 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108016890 con 0x557c924b8070 2024-02-21T07:50:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.970+0000 7fe10cc00640 1 -- 172.21.15.100:0/3527965028 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10800c030 con 0x557c924b8070 2024-02-21T07:50:14.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.970+0000 7fe10cc00640 1 -- 172.21.15.100:0/3527965028 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe108016a50 con 0x557c924b8070 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 -- 172.21.15.100:0/3527965028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 msgr2=0x557c924aa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924aa8a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x557c9247afe0 tx=0x7fe108008040 comp rx=0 tx=0).stop 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 -- 172.21.15.100:0/3527965028 shutdown_connections 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924ec4d0 0x557c9250d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c924b8070 0x557c924aa8a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3527965028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c9247cf90 0x557c92482de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.971+0000 7fe126a0c740 1 -- 172.21.15.100:0/3527965028 >> 172.21.15.100:0/3527965028 conn(0x557c924444b0 msgr2=0x557c924ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:14.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.973+0000 7fe126a0c740 1 -- 172.21.15.100:0/3527965028 shutdown_connections 2024-02-21T07:50:14.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.975+0000 7fe126a0c740 1 -- 172.21.15.100:0/3527965028 wait complete. 2024-02-21T07:50:14.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.977+0000 7fe126a0c740 1 -- start start 2024-02-21T07:50:14.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.977+0000 7fe126a0c740 1 Processor -- start 2024-02-21T07:50:14.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.980+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.985 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 0x557c9254fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c9247bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92503fe0 con 0x557c9247cf90 2024-02-21T07:50:14.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c9247bc60 con 0x557c924b8070 2024-02-21T07:50:14.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92559970 con 0x557c924ec4d0 2024-02-21T07:50:14.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.981+0000 7fe126a0c740 10 client.0 _ll_register_callbacks cb 0x7fe1100d2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:14.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.983+0000 7fe121200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.984+0000 7fe121200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46262/0 (socket says 172.21.15.100:46262) 2024-02-21T07:50:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.984+0000 7fe121200640 1 -- 172.21.15.100:0/3570830820 learned_addr learned my addr 172.21.15.100:0/3570830820 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.985+0000 7fe121c00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c9247bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.985+0000 7fe11be00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 0x557c9254fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.987+0000 7fe121200640 1 -- 172.21.15.100:0/3570830820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 msgr2=0x557c9247bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.987+0000 7fe121200640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c9247bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.987+0000 7fe121200640 1 -- 172.21.15.100:0/3570830820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 msgr2=0x557c9254fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.987+0000 7fe121200640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 0x557c9254fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.987+0000 7fe121200640 1 -- 172.21.15.100:0/3570830820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10800e040 con 0x557c9247cf90 2024-02-21T07:50:14.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.988+0000 7fe11be00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 0x557c9254fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:14.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.988+0000 7fe121c00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c9247bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:14.994 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.989+0000 7fe121200640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b56c0 tx=0x7fe1100eb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cf043fc50611c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:14.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.990+0000 7fe102000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.991+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100be6e0 con 0x557c9247cf90 2024-02-21T07:50:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.991+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe1100bd3b0 con 0x557c9247cf90 2024-02-21T07:50:15.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.991+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c92408d30 con 0x557c9247cf90 2024-02-21T07:50:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.994+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1100be2d0 con 0x557c9247cf90 2024-02-21T07:50:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.994+0000 7fe126a0c740 10 client.5823 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.994+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557c923a42c0 con 0x557c9247cf90 2024-02-21T07:50:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.996+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c92408d30 con 0x557c9247cf90 2024-02-21T07:50:15.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:14.996+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe1100ce040 con 0x557c9247cf90 2024-02-21T07:50:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.000+0000 7fe126a0c740 10 client.5823 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.000+0000 7fe126a0c740 10 client.5823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.000+0000 7fe126a0c740 20 client.5823 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.000+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924a9ec0 0x557c924b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.001+0000 7fe126a0c740 4 client.5823 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:50:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.001+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557c920e3600 con 0x557c924a9ec0 2024-02-21T07:50:15.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.004+0000 7fe11be00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924a9ec0 0x557c924b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.005+0000 7fe11be00640 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924a9ec0 0x557c924b74f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72cd45d03a456ad server_cookie=a4059eba49dbc533 in_seq=0 out_seq=0 2024-02-21T07:50:15.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.006+0000 7fe102000640 10 client.5823 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.105+0000 7fe102000640 1 -- 172.21.15.100:0/3570830820 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557c920e3600 con 0x557c924a9ec0 2024-02-21T07:50:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.105+0000 7fe102000640 10 client.5823 handle_command_reply: tid=0 2024-02-21T07:50:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.106+0000 7fe126a0c740 1 client.5823 shutdown 2024-02-21T07:50:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 msgr2=0x557c92504400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:15.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe1100b56c0 tx=0x7fe1100eb040 comp rx=0 tx=0).stop 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 shutdown_connections 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557c924a9ec0 0x557c924b74f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557c924ec4d0 0x557c9247bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c924b8070 0x557c9254fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 --2- 172.21.15.100:0/3570830820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c9247cf90 0x557c92504400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.109+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 >> 172.21.15.100:0/3570830820 conn(0x557c924444b0 msgr2=0x557c9250d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.110+0000 7fe102000640 0 client.5823 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:15.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.112+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 shutdown_connections 2024-02-21T07:50:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.112+0000 7fe126a0c740 1 -- 172.21.15.100:0/3570830820 wait complete. 2024-02-21T07:50:15.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.112+0000 7fe126a0c740 20 client.5823 trim_cache size 0 max 16384 2024-02-21T07:50:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:50:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:50:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:50:15.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:50:15.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 msgr2=0x7fe0fc0a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 0x7fe0fc0a1640 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe114007e30 tx=0x7fe114007340 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 msgr2=0x7fe11c1702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1100090b0 tx=0x7fe1100046c0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 shutdown_connections 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe0fc09f180 0x7fe0fc0a1640 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe11c1893c0 0x7fe11c17b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe11c188aa0 0x7fe11c17afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 --2- 172.21.15.100:0/427212818 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe11c0711b0 0x7fe11c1702a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.118+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 >> 172.21.15.100:0/427212818 conn(0x7fe11c0cf300 msgr2=0x7fe11c0f56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:15.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.119+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 shutdown_connections 2024-02-21T07:50:15.124 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:15.119+0000 7fe123c00640 1 -- 172.21.15.100:0/427212818 wait complete. 2024-02-21T07:50:26.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:50:26.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:50:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.375+0000 7f317f000640 1 Processor -- start 2024-02-21T07:50:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.375+0000 7f317f000640 1 -- start start 2024-02-21T07:50:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317f000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 0x7f3178071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317f000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3178071fe0 0x7f317818ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317f000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317818a7e0 con 0x7f317818a400 2024-02-21T07:50:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317f000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317818eea0 con 0x7f317818e990 2024-02-21T07:50:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317f000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317818f180 con 0x7f3178071fe0 2024-02-21T07:50:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317d000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3178071fe0 0x7f317818ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317d000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f3178071fe0 0x7f317818ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55128/0 (socket says 172.21.15.100:55128) 2024-02-21T07:50:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.379+0000 7f317d000640 1 -- 172.21.15.100:0/989342788 learned_addr learned my addr 172.21.15.100:0/989342788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f3177400640 1 --2- 172.21.15.100:0/989342788 >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 0x7f3178071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f317d000640 1 -- 172.21.15.100:0/989342788 >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 msgr2=0x7f3178071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f3176a00640 1 -- 172.21.15.100:0/989342788 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321027216 0 0) 0x7f317818a7e0 con 0x7f317818a400 2024-02-21T07:50:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f317d000640 1 --2- 172.21.15.100:0/989342788 >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 0x7f3178071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f317d000640 1 -- 172.21.15.100:0/989342788 >> v1:172.21.15.170:6789/0 conn(0x7f317818a400 legacy=0x7f317818e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f317d000640 1 -- 172.21.15.100:0/989342788 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317818f460 con 0x7f3178071fe0 2024-02-21T07:50:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.380+0000 7f3177400640 1 --2- 172.21.15.100:0/989342788 >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 0x7f3178071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.382+0000 7f317d000640 1 --2- 172.21.15.100:0/989342788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3178071fe0 0x7f317818ad00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31780f6620 tx=0x7f316002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea478d9c5654dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.382+0000 7f3176a00640 1 -- 172.21.15.100:0/989342788 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316002d040 con 0x7f3178071fe0 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.382+0000 7f3176a00640 1 -- 172.21.15.100:0/989342788 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160031810 con 0x7f3178071fe0 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.382+0000 7f3176a00640 1 -- 172.21.15.100:0/989342788 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160031be0 con 0x7f3178071fe0 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 -- 172.21.15.100:0/989342788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3178071fe0 msgr2=0x7f317818ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 --2- 172.21.15.100:0/989342788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3178071fe0 0x7f317818ad00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f31780f6620 tx=0x7f316002b8b0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 -- 172.21.15.100:0/989342788 shutdown_connections 2024-02-21T07:50:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 --2- 172.21.15.100:0/989342788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3178071fe0 0x7f317818ad00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 --2- 172.21.15.100:0/989342788 >> v2:172.21.15.100:3300/0 conn(0x7f317818e990 0x7f3178071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 -- 172.21.15.100:0/989342788 >> 172.21.15.100:0/989342788 conn(0x7f31780fc040 msgr2=0x7f31780fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.383+0000 7f317f000640 1 -- 172.21.15.100:0/989342788 shutdown_connections 2024-02-21T07:50:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.384+0000 7f317f000640 1 -- 172.21.15.100:0/989342788 wait complete. 2024-02-21T07:50:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.386+0000 7f317f000640 1 Processor -- start 2024-02-21T07:50:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.386+0000 7f317f000640 1 -- start start 2024-02-21T07:50:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f317818a400 0x7f3178189140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f317818e990 0x7f3178189680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178187dc0 con 0x7f317818e990 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31781880a0 con 0x7f3178071fe0 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317f000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178188380 con 0x7f317818a400 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f3177e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f3177e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49192/0 (socket says 172.21.15.100:49192) 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f3177e00640 1 -- 172.21.15.100:0/2341700609 learned_addr learned my addr 172.21.15.100:0/2341700609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f317d000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f317818e990 0x7f3178189680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.388+0000 7f3177400640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f317818a400 0x7f3178189140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 -- 172.21.15.100:0/2341700609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f317818a400 msgr2=0x7f3178189140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f317818a400 0x7f3178189140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 -- 172.21.15.100:0/2341700609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f317818e990 msgr2=0x7f3178189680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f317818e990 0x7f3178189680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 -- 172.21.15.100:0/2341700609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600094d0 con 0x7f3178071fe0 2024-02-21T07:50:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f3177e00640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f317000c3c0 tx=0x7f317000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f316fe00640 1 -- 172.21.15.100:0/2341700609 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700035f0 con 0x7f3178071fe0 2024-02-21T07:50:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f316fe00640 1 -- 172.21.15.100:0/2341700609 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170003770 con 0x7f3178071fe0 2024-02-21T07:50:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.389+0000 7f316fe00640 1 -- 172.21.15.100:0/2341700609 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170003b20 con 0x7f3178071fe0 2024-02-21T07:50:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.390+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3178188660 con 0x7f3178071fe0 2024-02-21T07:50:26.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.390+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3178188c20 con 0x7f3178071fe0 2024-02-21T07:50:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.399+0000 7f3181d9c740 1 Processor -- start 2024-02-21T07:50:26.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.399+0000 7f3181d9c740 1 -- start start 2024-02-21T07:50:26.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.402+0000 7f316fe00640 1 -- 172.21.15.100:0/2341700609 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3170003c80 con 0x7f3178071fe0 2024-02-21T07:50:26.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.404+0000 7f316fe00640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 0x7f31540a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f316fe00640 1 -- 172.21.15.100:0/2341700609 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3170093270 con 0x7f3178071fe0 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba520a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba4eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba422150 con 0x5645ba4eb8e0 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba41f680 con 0x5645ba520f80 2024-02-21T07:50:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f3181d9c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba41ae60 con 0x5645ba4eafc0 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.405+0000 7f317d000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 0x7f31540a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba4eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba4eb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49204/0 (socket says 172.21.15.100:49204) 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177400640 1 -- 172.21.15.100:0/1682572087 learned_addr learned my addr 172.21.15.100:0/1682572087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba520a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 -- 172.21.15.100:0/1682572087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 msgr2=0x5645ba4eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba4eb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 -- 172.21.15.100:0/1682572087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eb8e0 msgr2=0x5645ba4adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.406+0000 7f3177e00640 1 -- 172.21.15.100:0/1682572087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ba3d4060 con 0x5645ba4eafc0 2024-02-21T07:50:26.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.407+0000 7f3177e00640 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba520a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31700c6b20 tx=0x7f3170093520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc3e1fe03450e06 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.407+0000 7f317d000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 0x7f31540a1630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f3160008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.408+0000 7f316cc00640 1 -- 172.21.15.100:0/1682572087 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170094dd0 con 0x5645ba4eafc0 2024-02-21T07:50:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.408+0000 7f316cc00640 1 -- 172.21.15.100:0/1682572087 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170097390 con 0x5645ba4eafc0 2024-02-21T07:50:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.408+0000 7f316cc00640 1 -- 172.21.15.100:0/1682572087 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000ec80 con 0x5645ba4eafc0 2024-02-21T07:50:26.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 -- 172.21.15.100:0/1682572087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 msgr2=0x5645ba520a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba520a40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f31700c6b20 tx=0x7f3170093520 comp rx=0 tx=0).stop 2024-02-21T07:50:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 -- 172.21.15.100:0/1682572087 shutdown_connections 2024-02-21T07:50:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba4eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1682572087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba520a40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 -- 172.21.15.100:0/1682572087 >> 172.21.15.100:0/1682572087 conn(0x5645ba47a5a0 msgr2=0x5645ba4b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 -- 172.21.15.100:0/1682572087 shutdown_connections 2024-02-21T07:50:26.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.412+0000 7f3181d9c740 1 -- 172.21.15.100:0/1682572087 wait complete. 2024-02-21T07:50:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.414+0000 7f3181d9c740 1 -- start start 2024-02-21T07:50:26.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.414+0000 7f3181d9c740 1 Processor -- start 2024-02-21T07:50:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.417+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3177e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3177e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55156/0 (socket says 172.21.15.100:55156) 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3177e00640 1 -- 172.21.15.100:0/768694474 learned_addr learned my addr 172.21.15.100:0/768694474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 0x5645ba4e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba3bfec0 con 0x5645ba520f80 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba3bfb60 con 0x5645ba4eb8e0 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba1891c0 con 0x5645ba4eafc0 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.418+0000 7f317d000640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 0x5645ba4e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.419+0000 7f3177400640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.419+0000 7f3181d9c740 10 client.0 _ll_register_callbacks cb 0x5645ba3d3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 -- 172.21.15.100:0/768694474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 msgr2=0x5645ba4adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 -- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 msgr2=0x5645ba4e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 0x5645ba4e09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3178188c20 con 0x5645ba4eafc0 2024-02-21T07:50:26.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f317d000640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 0x5645ba4e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645ba11a7e0 con 0x5645ba4eafc0 2024-02-21T07:50:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177400640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3177e00640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3170096c20 tx=0x7f317000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1aba6c371f7a692 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.420+0000 7f3165600640 10 client.5951 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:26.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3165600640 1 -- 172.21.15.100:0/768694474 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170092b50 con 0x5645ba4eafc0 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3165600640 1 -- 172.21.15.100:0/768694474 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3170093270 con 0x5645ba4eafc0 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3165600640 1 -- 172.21.15.100:0/768694474 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3170092cb0 con 0x5645ba4eafc0 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 10 client.5951 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x5645ba4194e0 con 0x5645ba4eafc0 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3165600640 1 -- 172.21.15.100:0/768694474 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f31700aeab0 con 0x5645ba4eafc0 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 10 client.5951 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 10 client.5951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 20 client.5951 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba533540 0x5645ba524620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 4 client.5951 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:26.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.421+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645ba157720 con 0x5645ba533540 2024-02-21T07:50:26.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.422+0000 7f3177400640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba533540 0x5645ba524620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.423+0000 7f3177400640 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba533540 0x5645ba524620 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9768b47cd8a289fc server_cookie=452ccba1eb27cebc in_seq=0 out_seq=0 2024-02-21T07:50:26.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.423+0000 7f3165600640 10 client.5951 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3165600640 1 -- 172.21.15.100:0/768694474 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5645ba157720 con 0x5645ba533540 2024-02-21T07:50:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3165600640 10 client.5951 handle_command_reply: tid=0 2024-02-21T07:50:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 client.5951 shutdown 2024-02-21T07:50:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 msgr2=0x5645ba4f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3170096c20 tx=0x7f317000eeb0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 shutdown_connections 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba533540 0x5645ba524620 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba520f80 0x5645ba4e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba4adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3165600640 0 client.5951 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 --2- 172.21.15.100:0/768694474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eafc0 0x5645ba4f5a50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 >> 172.21.15.100:0/768694474 conn(0x5645ba47a5a0 msgr2=0x5645ba518460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.424+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 shutdown_connections 2024-02-21T07:50:26.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.425+0000 7f3181d9c740 1 -- 172.21.15.100:0/768694474 wait complete. 2024-02-21T07:50:26.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.426+0000 7f3181d9c740 20 client.5951 trim_cache size 0 max 16384 2024-02-21T07:50:26.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.454+0000 7f3181d9c740 1 Processor -- start 2024-02-21T07:50:26.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.454+0000 7f3181d9c740 1 -- start start 2024-02-21T07:50:26.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.456+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eb8e0 0x5645ba580e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba586ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58884/0 (socket says 172.21.15.100:58884) 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 -- 172.21.15.100:0/1972001990 learned_addr learned my addr 172.21.15.100:0/1972001990 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba4b2de0 con 0x5645ba4eafc0 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba5206a0 con 0x5645ba520f80 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba4b8890 con 0x5645ba4eb8e0 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177400640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eb8e0 0x5645ba580e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f317d000640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba586ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 -- 172.21.15.100:0/1972001990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eb8e0 msgr2=0x5645ba580e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eb8e0 0x5645ba580e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.457+0000 7f3177e00640 1 -- 172.21.15.100:0/1972001990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 msgr2=0x5645ba586ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.458+0000 7f3177e00640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba586ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.458+0000 7f3177e00640 1 -- 172.21.15.100:0/1972001990 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ba3b5950 con 0x5645ba4eafc0 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.458+0000 7f317d000640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba586ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.458+0000 7f3177e00640 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f317000cfd0 tx=0x7f31700b0070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebcd08a414beb30 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.458+0000 7f3167e00640 1 -- 172.21.15.100:0/1972001990 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317000e040 con 0x5645ba4eafc0 2024-02-21T07:50:26.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.459+0000 7f3167e00640 1 -- 172.21.15.100:0/1972001990 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5645ba11a7e0 con 0x5645ba4eafc0 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.459+0000 7f3167e00640 1 -- 172.21.15.100:0/1972001990 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3170093270 con 0x5645ba4eafc0 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.459+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 msgr2=0x5645ba4b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.459+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f317000cfd0 tx=0x7f31700b0070 comp rx=0 tx=0).stop 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 shutdown_connections 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba520f80 0x5645ba586ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba4eb8e0 0x5645ba580e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 --2- 172.21.15.100:0/1972001990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba4b28a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 >> 172.21.15.100:0/1972001990 conn(0x5645ba47a5a0 msgr2=0x5645ba4b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 shutdown_connections 2024-02-21T07:50:26.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.460+0000 7f3181d9c740 1 -- 172.21.15.100:0/1972001990 wait complete. 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.461+0000 7f3181d9c740 1 -- start start 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.461+0000 7f3181d9c740 1 Processor -- start 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba577d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba520f80 0x5645ba5423d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba57de90 con 0x5645ba4eafc0 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba521f80 con 0x5645ba4eb8e0 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ba521400 con 0x5645ba520f80 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.462+0000 7f3181d9c740 10 client.0 _ll_register_callbacks cb 0x7f31700ad070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba577d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49234/0 (socket says 172.21.15.100:49234) 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 -- 172.21.15.100:0/120103996 learned_addr learned my addr 172.21.15.100:0/120103996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f317d000640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba520f80 0x5645ba5423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 -- 172.21.15.100:0/120103996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba520f80 msgr2=0x5645ba5423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba520f80 0x5645ba5423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 -- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 msgr2=0x5645ba577d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba577d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.463+0000 7f3177400640 1 -- 172.21.15.100:0/120103996 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645ba4194e0 con 0x5645ba4eb8e0 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.464+0000 7f3177e00640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba577d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.464+0000 7f3177400640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3168003b20 tx=0x7f3168003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f347e1c01cdd87 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.464+0000 7f3165600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.464+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316801d130 con 0x5645ba4eb8e0 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3170097390 con 0x5645ba4eb8e0 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f316801d290 con 0x5645ba4eb8e0 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f316801d450 con 0x5645ba4eb8e0 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3181d9c740 10 client.5995 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:26.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5645ba3db430 con 0x5645ba4eb8e0 2024-02-21T07:50:26.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3170097390 con 0x5645ba4eb8e0 2024-02-21T07:50:26.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.465+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3168014040 con 0x5645ba4eb8e0 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 10 client.5995 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 10 client.5995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 20 client.5995 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba4dd620 0x5645ba4b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 4 client.5995 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:50:26.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5645ba1a6890 con 0x5645ba4dd620 2024-02-21T07:50:26.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.466+0000 7f3177e00640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba4dd620 0x5645ba4b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3165600640 10 client.5995 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3177e00640 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba4dd620 0x5645ba4b1e70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c01b61a98ae74d0a server_cookie=11efd3c668b21eee in_seq=0 out_seq=0 2024-02-21T07:50:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3165600640 1 -- 172.21.15.100:0/120103996 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5645ba1a6890 con 0x5645ba4dd620 2024-02-21T07:50:26.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3165600640 10 client.5995 handle_command_reply: tid=0 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3181d9c740 1 client.5995 shutdown 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 msgr2=0x5645ba57d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.467+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3168003b20 tx=0x7f3168003ce0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 shutdown_connections 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5645ba4dd620 0x5645ba4b1e70 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645ba520f80 0x5645ba5423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645ba4eb8e0 0x5645ba57d950 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 --2- 172.21.15.100:0/120103996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645ba4eafc0 0x5645ba577d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3165600640 0 client.5995 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 >> 172.21.15.100:0/120103996 conn(0x5645ba47a5a0 msgr2=0x5645ba4b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 shutdown_connections 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 1 -- 172.21.15.100:0/120103996 wait complete. 2024-02-21T07:50:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f3181d9c740 20 client.5995 trim_cache size 0 max 16384 2024-02-21T07:50:26.479 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:50:26.479 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:50:26.479 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:50:26.479 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.468+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 msgr2=0x7f31540a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 0x7f31540a1630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3160036000 tx=0x7f3160008030 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 msgr2=0x7f3178172d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f317000c3c0 tx=0x7f317000c880 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 shutdown_connections 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f315409f170 0x7f31540a1630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f317818e990 0x7f3178189680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f317818a400 0x7f3178189140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 --2- 172.21.15.100:0/2341700609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3178071fe0 0x7f3178172d60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 >> 172.21.15.100:0/2341700609 conn(0x7f31780fc040 msgr2=0x7f317806fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 shutdown_connections 2024-02-21T07:50:26.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.469+0000 7f317f000640 1 -- 172.21.15.100:0/2341700609 wait complete. 2024-02-21T07:50:26.497 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:50:26.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:50:26.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.871+0000 7efd34a00640 1 Processor -- start 2024-02-21T07:50:26.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.872+0000 7efd34a00640 1 -- start start 2024-02-21T07:50:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.877+0000 7efd34a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7efd300f8480 0x7efd300717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.877+0000 7efd34a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300f99d0 con 0x7efd30188a90 2024-02-21T07:50:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.877+0000 7efd34a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd30071d30 con 0x7efd30189580 2024-02-21T07:50:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.877+0000 7efd34a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd301899e0 con 0x7efd300f8480 2024-02-21T07:50:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.879+0000 7efd2de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efd30188a90 0x7efd30188e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35844/0 (socket says 172.21.15.100:35844) 2024-02-21T07:50:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.879+0000 7efd2de00640 1 -- 172.21.15.100:0/744001524 learned_addr learned my addr 172.21.15.100:0/744001524 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.881+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135085535 0 0) 0x7efd30071d30 con 0x7efd30189580 2024-02-21T07:50:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.881+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd14003520 con 0x7efd30189580 2024-02-21T07:50:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.881+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463311061 0 0) 0x7efd14003520 con 0x7efd30189580 2024-02-21T07:50:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.881+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 >> v2:172.21.15.156:3300/0 conn(0x7efd300f8480 msgr2=0x7efd300717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.881+0000 7efd2ca00640 1 --2- 172.21.15.100:0/744001524 >> v2:172.21.15.156:3300/0 conn(0x7efd300f8480 0x7efd300717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.882+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 >> v1:172.21.15.100:6789/0 conn(0x7efd30188a90 legacy=0x7efd30188e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300f8ae0 con 0x7efd30189580 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7efd280019f0 con 0x7efd30189580 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 >> v1:172.21.15.170:6789/0 conn(0x7efd30189580 legacy=0x7efd300710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 0x7efd14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140047c0 0x7efd14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd140053d0 0x7efd1400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400c2e0 con 0x7efd140047c0 2024-02-21T07:50:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400c450 con 0x7efd140053d0 2024-02-21T07:50:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.884+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400c610 con 0x7efd140039c0 2024-02-21T07:50:26.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.887+0000 7efd2d400640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140047c0 0x7efd14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.889+0000 7efd2de00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 0x7efd14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2e800640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd140053d0 0x7efd1400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2de00640 1 -- 172.21.15.100:0/744001524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd140053d0 msgr2=0x7efd1400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2de00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd140053d0 0x7efd1400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2de00640 1 -- 172.21.15.100:0/744001524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140047c0 msgr2=0x7efd14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2de00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140047c0 0x7efd14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.890+0000 7efd2de00640 1 -- 172.21.15.100:0/744001524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300f8ae0 con 0x7efd140039c0 2024-02-21T07:50:26.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.894+0000 7efd2de00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 0x7efd14003dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd20010a80 tx=0x7efd140057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=363f2f688386e8a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.895+0000 7efd2e800640 1 -- 172.21.15.100:0/744001524 reap_dead start 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.896+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20005ad0 con 0x7efd140039c0 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.896+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005c30 con 0x7efd140039c0 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.896+0000 7efd2ca00640 1 -- 172.21.15.100:0/744001524 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20007070 con 0x7efd140039c0 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.897+0000 7efd34a00640 1 -- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 msgr2=0x7efd14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.897+0000 7efd34a00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 0x7efd14003dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd20010a80 tx=0x7efd140057f0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.898+0000 7efd34a00640 1 -- 172.21.15.100:0/744001524 shutdown_connections 2024-02-21T07:50:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.898+0000 7efd34a00640 1 --2- 172.21.15.100:0/744001524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd140039c0 0x7efd14003dc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.898+0000 7efd34a00640 1 -- 172.21.15.100:0/744001524 >> 172.21.15.100:0/744001524 conn(0x7efd300ce160 msgr2=0x7efd300ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:26.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.898+0000 7efd34a00640 1 -- 172.21.15.100:0/744001524 shutdown_connections 2024-02-21T07:50:26.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.899+0000 7efd34a00640 1 -- 172.21.15.100:0/744001524 wait complete. 2024-02-21T07:50:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.919+0000 7efd34a00640 1 Processor -- start 2024-02-21T07:50:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.919+0000 7efd34a00640 1 -- start start 2024-02-21T07:50:26.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.929+0000 7efd34a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.929+0000 7efd34a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 0x7efd30168a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.930+0000 7efd2de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.930+0000 7efd2de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58916/0 (socket says 172.21.15.100:58916) 2024-02-21T07:50:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.930+0000 7efd2de00640 1 -- 172.21.15.100:0/1025614865 learned_addr learned my addr 172.21.15.100:0/1025614865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:26.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.931+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 0x7efd30169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.933+0000 7efd2d400640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 0x7efd30168a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.933+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3017a660 con 0x7efd140039c0 2024-02-21T07:50:26.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.933+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300cccf0 con 0x7efd30168f40 2024-02-21T07:50:26.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.933+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300ccfd0 con 0x7efd3017a1e0 2024-02-21T07:50:26.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.933+0000 7efd2e800640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 0x7efd30169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.935+0000 7efd2e800640 1 -- 172.21.15.100:0/1025614865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 msgr2=0x7efd30168a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.935+0000 7efd2e800640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 0x7efd30168a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.935+0000 7efd2e800640 1 -- 172.21.15.100:0/1025614865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 msgr2=0x7efd30179ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.935+0000 7efd2e800640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.935+0000 7efd2e800640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300cd2b0 con 0x7efd30168f40 2024-02-21T07:50:26.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.936+0000 7efd2d400640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 0x7efd30168a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.936+0000 7efd2de00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:26.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.936+0000 7efd2e800640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 0x7efd30169db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd30075540 tx=0x7efd1c00d8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:26.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.948+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c004030 con 0x7efd30168f40 2024-02-21T07:50:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.948+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c004190 con 0x7efd30168f40 2024-02-21T07:50:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.948+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300cd590 con 0x7efd30168f40 2024-02-21T07:50:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.948+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300f5140 con 0x7efd30168f40 2024-02-21T07:50:26.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.949+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0035f0 con 0x7efd30168f40 2024-02-21T07:50:26.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.953+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08005290 con 0x7efd30168f40 2024-02-21T07:50:26.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.964+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7efd1c003750 con 0x7efd30168f40 2024-02-21T07:50:26.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.969+0000 7efd26000640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 0x7efd100a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.969+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efd1c0c9810 con 0x7efd30168f40 2024-02-21T07:50:26.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.969+0000 7efd2de00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 0x7efd100a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:26.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.969+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd1c0f6960 con 0x7efd30168f40 2024-02-21T07:50:26.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:26.970+0000 7efd2de00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 0x7efd100a16b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efd20007bd0 tx=0x7efd20009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.490+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd08005100 con 0x7efd30168f40 2024-02-21T07:50:27.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.494+0000 7efd26000640 1 -- 172.21.15.100:0/1025614865 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7efd1c0936a0 con 0x7efd30168f40 2024-02-21T07:50:27.498 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:50:27.498 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:50:27.499 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:50:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.499+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 msgr2=0x7efd100a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.499+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 0x7efd100a16b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efd20007bd0 tx=0x7efd20009030 comp rx=0 tx=0).stop 2024-02-21T07:50:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.499+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 msgr2=0x7efd30169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.499+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 0x7efd30169db0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7efd30075540 tx=0x7efd1c00d8a0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 shutdown_connections 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efd30168f40 0x7efd30169db0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efd3017a1e0 0x7efd30168a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7efd1009f1f0 0x7efd100a16b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 --2- 172.21.15.100:0/1025614865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd140039c0 0x7efd30179ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 >> 172.21.15.100:0/1025614865 conn(0x7efd300ce160 msgr2=0x7efd30188e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.500+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 shutdown_connections 2024-02-21T07:50:27.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.501+0000 7efd34a00640 1 -- 172.21.15.100:0/1025614865 wait complete. 2024-02-21T07:50:27.565 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:50:27.565 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:50:27.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.929+0000 7fb28d000640 1 Processor -- start 2024-02-21T07:50:27.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.929+0000 7fb28d000640 1 -- start start 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb28010f3f0 0x7fb280112080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 0x7fb280110830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb280110d70 0x7fb280079290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb280112a20 con 0x7fb28010f3f0 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2801103a0 con 0x7fb2801125c0 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb28d000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb28007a650 con 0x7fb280110d70 2024-02-21T07:50:27.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb287400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb28010f3f0 0x7fb280112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb287400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb28010f3f0 0x7fb280112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58924/0 (socket says 172.21.15.100:58924) 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb287400640 1 -- 172.21.15.100:0/2111170147 learned_addr learned my addr 172.21.15.100:0/2111170147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.932+0000 7fb287e00640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.170:3300/0 conn(0x7fb280110d70 0x7fb280079290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb287400640 1 -- 172.21.15.100:0/2111170147 >> v2:172.21.15.170:3300/0 conn(0x7fb280110d70 msgr2=0x7fb280079290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb287400640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.170:3300/0 conn(0x7fb280110d70 0x7fb280079290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb287400640 1 -- 172.21.15.100:0/2111170147 >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 msgr2=0x7fb280110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb286a00640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 0x7fb280110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb287400640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 0x7fb280110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb287400640 1 -- 172.21.15.100:0/2111170147 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28007a370 con 0x7fb28010f3f0 2024-02-21T07:50:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.933+0000 7fb286a00640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 0x7fb280110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:27.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.935+0000 7fb287400640 1 --2- 172.21.15.100:0/2111170147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb280112080 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb280009120 tx=0x7fb27c02b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c91d5b142b3a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.935+0000 7fb286000640 1 -- 172.21.15.100:0/2111170147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0317f0 con 0x7fb28010f3f0 2024-02-21T07:50:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.935+0000 7fb286000640 1 -- 172.21.15.100:0/2111170147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c031950 con 0x7fb28010f3f0 2024-02-21T07:50:27.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.935+0000 7fb286000640 1 -- 172.21.15.100:0/2111170147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c031ce0 con 0x7fb28010f3f0 2024-02-21T07:50:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.937+0000 7fb28d000640 1 -- 172.21.15.100:0/2111170147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 msgr2=0x7fb280112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.937+0000 7fb28d000640 1 --2- 172.21.15.100:0/2111170147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb280112080 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb280009120 tx=0x7fb27c02b890 comp rx=0 tx=0).stop 2024-02-21T07:50:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.937+0000 7fb28d000640 1 -- 172.21.15.100:0/2111170147 shutdown_connections 2024-02-21T07:50:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.937+0000 7fb28d000640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.170:3300/0 conn(0x7fb280110d70 0x7fb280079290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.938+0000 7fb28d000640 1 --2- 172.21.15.100:0/2111170147 >> v2:172.21.15.156:3300/0 conn(0x7fb2801125c0 0x7fb280110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.938+0000 7fb28d000640 1 --2- 172.21.15.100:0/2111170147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb280112080 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.938+0000 7fb28d000640 1 -- 172.21.15.100:0/2111170147 >> 172.21.15.100:0/2111170147 conn(0x7fb280052de0 msgr2=0x7fb2800531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.938+0000 7fb28d000640 1 -- 172.21.15.100:0/2111170147 shutdown_connections 2024-02-21T07:50:27.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.938+0000 7fb28d000640 1 -- 172.21.15.100:0/2111170147 wait complete. 2024-02-21T07:50:27.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.946+0000 7fb28d000640 1 Processor -- start 2024-02-21T07:50:27.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.947+0000 7fb28d000640 1 -- start start 2024-02-21T07:50:27.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb2800f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 0x7fb2801a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801a6150 con 0x7fb28010f3f0 2024-02-21T07:50:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800f8400 con 0x7fb2801125c0 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.949+0000 7fb28d000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801aaa60 con 0x7fb280110d70 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb287400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb2800f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb286a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb286a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55216/0 (socket says 172.21.15.100:55216) 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb286a00640 1 -- 172.21.15.100:0/3910164253 learned_addr learned my addr 172.21.15.100:0/3910164253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:27.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb287e00640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 0x7fb2801a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb287e00640 1 -- 172.21.15.100:0/3910164253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 msgr2=0x7fb2801a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb287e00640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.950+0000 7fb287e00640 1 -- 172.21.15.100:0/3910164253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 msgr2=0x7fb2800f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.951+0000 7fb287e00640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb2800f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.951+0000 7fb287e00640 1 -- 172.21.15.100:0/3910164253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0094d0 con 0x7fb2801125c0 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.951+0000 7fb286a00640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.951+0000 7fb287400640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb2800f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:27.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.951+0000 7fb287e00640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 0x7fb2801a6ab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2880648e0 tx=0x7fb288068050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.952+0000 7fb27b400640 1 -- 172.21.15.100:0/3910164253 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288093630 con 0x7fb2801125c0 2024-02-21T07:50:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.952+0000 7fb27b400640 1 -- 172.21.15.100:0/3910164253 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb288093790 con 0x7fb2801125c0 2024-02-21T07:50:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.952+0000 7fb27b400640 1 -- 172.21.15.100:0/3910164253 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288093b00 con 0x7fb2801125c0 2024-02-21T07:50:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.952+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2801aa780 con 0x7fb2801125c0 2024-02-21T07:50:27.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.952+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2801a5a90 con 0x7fb2801125c0 2024-02-21T07:50:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.955+0000 7fb27b400640 1 -- 172.21.15.100:0/3910164253 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb288093c60 con 0x7fb2801125c0 2024-02-21T07:50:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.956+0000 7fb27b400640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 0x7fb2680a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.956+0000 7fb27b400640 1 -- 172.21.15.100:0/3910164253 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb288144880 con 0x7fb2801125c0 2024-02-21T07:50:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.956+0000 7fb287400640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 0x7fb2680a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.957+0000 7fb287400640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 0x7fb2680a16b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.958+0000 7fb29138c740 1 Processor -- start 2024-02-21T07:50:27.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.959+0000 7fb29138c740 1 -- start start 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.960+0000 7fb29138c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 0x55ed96a8c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.961+0000 7fb29138c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a8c990 0x55ed96ac7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.961+0000 7fb29138c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 0x55ed96ac84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.961+0000 7fb29138c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed969bf210 con 0x55ed96ac7740 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.961+0000 7fb29138c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed969bc740 con 0x55ed96a8c070 2024-02-21T07:50:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.961+0000 7fb29138c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed969b7f20 con 0x55ed96a8c990 2024-02-21T07:50:27.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.963+0000 7fb287e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 0x55ed96ac84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.963+0000 7fb287400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 0x55ed96a8c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.963+0000 7fb287400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 0x55ed96a8c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49274/0 (socket says 172.21.15.100:49274) 2024-02-21T07:50:27.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.963+0000 7fb287400640 1 -- 172.21.15.100:0/678746409 learned_addr learned my addr 172.21.15.100:0/678746409 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb286a00640 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a8c990 0x55ed96ac7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb287e00640 1 -- 172.21.15.100:0/678746409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a8c990 msgr2=0x55ed96ac7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb287e00640 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a8c990 0x55ed96ac7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb287e00640 1 -- 172.21.15.100:0/678746409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 msgr2=0x55ed96a8c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb287e00640 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 0x55ed96a8c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.964+0000 7fb287e00640 1 -- 172.21.15.100:0/678746409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed96979df0 con 0x55ed96ac7740 2024-02-21T07:50:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.965+0000 7fb287e00640 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 0x55ed96ac84d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb2881421f0 tx=0x7fb288093f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa3188e68b9d7eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.965+0000 7fb26fe00640 1 -- 172.21.15.100:0/678746409 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288116540 con 0x55ed96ac7740 2024-02-21T07:50:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.965+0000 7fb26fe00640 1 -- 172.21.15.100:0/678746409 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28811ab00 con 0x55ed96ac7740 2024-02-21T07:50:27.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.965+0000 7fb26fe00640 1 -- 172.21.15.100:0/678746409 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28810ea60 con 0x55ed96ac7740 2024-02-21T07:50:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.966+0000 7fb29138c740 1 -- 172.21.15.100:0/678746409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 msgr2=0x55ed96ac84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.966+0000 7fb29138c740 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 0x55ed96ac84d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb2881421f0 tx=0x7fb288093f90 comp rx=0 tx=0).stop 2024-02-21T07:50:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 -- 172.21.15.100:0/678746409 shutdown_connections 2024-02-21T07:50:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96ac7740 0x55ed96ac84d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a8c990 0x55ed96ac7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 --2- 172.21.15.100:0/678746409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c070 0x55ed96a8c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 -- 172.21.15.100:0/678746409 >> 172.21.15.100:0/678746409 conn(0x55ed96a4e640 msgr2=0x55ed96a4f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 -- 172.21.15.100:0/678746409 shutdown_connections 2024-02-21T07:50:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.968+0000 7fb29138c740 1 -- 172.21.15.100:0/678746409 wait complete. 2024-02-21T07:50:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.969+0000 7fb29138c740 1 -- start start 2024-02-21T07:50:27.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.970+0000 7fb29138c740 1 Processor -- start 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.975+0000 7fb29138c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96ad3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb29138c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a89e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb29138c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb29138c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9695d150 con 0x55ed96a8c990 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb287e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb287e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55242/0 (socket says 172.21.15.100:55242) 2024-02-21T07:50:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.976+0000 7fb287e00640 1 -- 172.21.15.100:0/656188288 learned_addr learned my addr 172.21.15.100:0/656188288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.977+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9695cdf0 con 0x55ed96ac7740 2024-02-21T07:50:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.977+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed967261c0 con 0x55ed96a76a90 2024-02-21T07:50:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.977+0000 7fb286a00640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a89e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.977+0000 7fb287400640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96ad3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.978+0000 7fb287e00640 1 -- 172.21.15.100:0/656188288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 msgr2=0x55ed96a89e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.978+0000 7fb287e00640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a89e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.978+0000 7fb287e00640 1 -- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 msgr2=0x55ed96ad3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.979+0000 7fb287e00640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96ad3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.979+0000 7fb287e00640 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2801a5a90 con 0x55ed96a76a90 2024-02-21T07:50:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.979+0000 7fb287400640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96ad3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.979+0000 7fb29138c740 10 client.0 _ll_register_callbacks cb 0x55ed969ac2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:27.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.979+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed966b77e0 con 0x55ed96a76a90 2024-02-21T07:50:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.980+0000 7fb287e00640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb288068a00 tx=0x7fb2881420f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb255042d116415 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.980+0000 7fb26cc00640 10 client.5972 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:27.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.981+0000 7fb26cc00640 1 -- 172.21.15.100:0/656188288 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288116370 con 0x55ed96a76a90 2024-02-21T07:50:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.981+0000 7fb26cc00640 1 -- 172.21.15.100:0/656188288 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb288116540 con 0x55ed96a76a90 2024-02-21T07:50:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.981+0000 7fb26cc00640 1 -- 172.21.15.100:0/656188288 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28812fbc0 con 0x55ed96a76a90 2024-02-21T07:50:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.981+0000 7fb29138c740 10 client.5972 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:27.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.981+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x55ed969b65a0 con 0x55ed96a76a90 2024-02-21T07:50:27.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb26cc00640 1 -- 172.21.15.100:0/656188288 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb28812d070 con 0x55ed96a76a90 2024-02-21T07:50:27.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 10 client.5972 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:27.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 10 client.5972 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:50:27.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 20 client.5972 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a8a5a0 0x55ed96a4b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 4 client.5972 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.983+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed966f4720 con 0x55ed96a8a5a0 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.984+0000 7fb287400640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a8a5a0 0x55ed96a4b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.985+0000 7fb287400640 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a8a5a0 0x55ed96a4b240 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=272f0b5fe66c153e server_cookie=28a54a4754ca7a83 in_seq=0 out_seq=0 2024-02-21T07:50:27.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.985+0000 7fb26cc00640 10 client.5972 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:50:27.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.988+0000 7fb26cc00640 1 -- 172.21.15.100:0/656188288 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed966f4720 con 0x55ed96a8a5a0 2024-02-21T07:50:27.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.988+0000 7fb26cc00640 10 client.5972 handle_command_reply: tid=0 2024-02-21T07:50:27.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 client.5972 shutdown 2024-02-21T07:50:27.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 msgr2=0x55ed96ad41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:27.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb288068a00 tx=0x7fb2881420f0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 shutdown_connections 2024-02-21T07:50:27.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a8a5a0 0x55ed96a4b240 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ad41b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a89e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 --2- 172.21.15.100:0/656188288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96ad3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:27.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb26cc00640 0 client.5972 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:50:27.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.989+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 >> 172.21.15.100:0/656188288 conn(0x55ed96a8c070 msgr2=0x55ed96a500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:27.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.990+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 shutdown_connections 2024-02-21T07:50:27.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.991+0000 7fb29138c740 1 -- 172.21.15.100:0/656188288 wait complete. 2024-02-21T07:50:27.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:27.991+0000 7fb29138c740 20 client.5972 trim_cache size 0 max 16384 2024-02-21T07:50:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.016+0000 7fb29138c740 1 Processor -- start 2024-02-21T07:50:28.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.017+0000 7fb29138c740 1 -- start start 2024-02-21T07:50:28.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.021+0000 7fb29138c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.021+0000 7fb29138c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96a69820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.021+0000 7fb29138c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.021+0000 7fb29138c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96a4a5e0 con 0x55ed96a8c990 2024-02-21T07:50:28.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.021+0000 7fb29138c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96ac04f0 con 0x55ed96ac7740 2024-02-21T07:50:28.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.022+0000 7fb29138c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96a81d00 con 0x55ed96a76a90 2024-02-21T07:50:28.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.023+0000 7fb287e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.023+0000 7fb287e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49288/0 (socket says 172.21.15.100:49288) 2024-02-21T07:50:28.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.023+0000 7fb287e00640 1 -- 172.21.15.100:0/2617340270 learned_addr learned my addr 172.21.15.100:0/2617340270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.027+0000 7fb287e00640 1 -- 172.21.15.100:0/2617340270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 msgr2=0x55ed96ac7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.028+0000 7fb286a00640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96a69820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.028+0000 7fb287400640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.029+0000 7fb287e00640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.029+0000 7fb287e00640 1 -- 172.21.15.100:0/2617340270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 msgr2=0x55ed96a69820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.029+0000 7fb287e00640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96a69820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.029+0000 7fb287e00640 1 -- 172.21.15.100:0/2617340270 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed96952ab0 con 0x55ed96ac7740 2024-02-21T07:50:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.030+0000 7fb286a00640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96a69820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:28.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.030+0000 7fb287400640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.031+0000 7fb287e00640 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb288112380 tx=0x7fb288114000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=411c8f94efbbc7cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.031+0000 7fb26f400640 1 -- 172.21.15.100:0/2617340270 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288116370 con 0x55ed96ac7740 2024-02-21T07:50:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.031+0000 7fb26f400640 1 -- 172.21.15.100:0/2617340270 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed966b77e0 con 0x55ed96ac7740 2024-02-21T07:50:28.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.032+0000 7fb26f400640 1 -- 172.21.15.100:0/2617340270 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28812fe40 con 0x55ed96ac7740 2024-02-21T07:50:28.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 -- 172.21.15.100:0/2617340270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 msgr2=0x55ed96a4b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb288112380 tx=0x7fb288114000 comp rx=0 tx=0).stop 2024-02-21T07:50:28.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 -- 172.21.15.100:0/2617340270 shutdown_connections 2024-02-21T07:50:28.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96ac7740 0x55ed96a4b620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a8c990 0x55ed96a69820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 --2- 172.21.15.100:0/2617340270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.033+0000 7fb29138c740 1 -- 172.21.15.100:0/2617340270 >> 172.21.15.100:0/2617340270 conn(0x55ed96a8c070 msgr2=0x55ed96a56b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.035+0000 7fb29138c740 1 -- 172.21.15.100:0/2617340270 shutdown_connections 2024-02-21T07:50:28.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.035+0000 7fb29138c740 1 -- 172.21.15.100:0/2617340270 wait complete. 2024-02-21T07:50:28.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.036+0000 7fb29138c740 1 -- start start 2024-02-21T07:50:28.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.036+0000 7fb29138c740 1 Processor -- start 2024-02-21T07:50:28.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.038+0000 7fb29138c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.038+0000 7fb29138c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c990 0x55ed96ac2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb29138c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 0x55ed96a4b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb29138c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96a8c630 con 0x55ed96a76a90 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb29138c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96ac36e0 con 0x55ed96a8c990 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb29138c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed96a8b390 con 0x55ed96ac7740 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb29138c740 10 client.0 _ll_register_callbacks cb 0x7fb28810e690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb287e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 0x55ed96a4b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb287400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb287400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58954/0 (socket says 172.21.15.100:58954) 2024-02-21T07:50:28.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.039+0000 7fb287400640 1 -- 172.21.15.100:0/3068562481 learned_addr learned my addr 172.21.15.100:0/3068562481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 -- 172.21.15.100:0/3068562481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c990 msgr2=0x55ed96ac2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:28.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c990 0x55ed96ac2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 -- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 msgr2=0x55ed96ac7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 -- 172.21.15.100:0/3068562481 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed969b65a0 con 0x55ed96ac7740 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.040+0000 7fb287e00640 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 0x55ed96a4b470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb288075540 tx=0x7fb288068da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8836f475fefd6360 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb26cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288111840 con 0x55ed96ac7740 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb2881119a0 con 0x55ed96ac7740 2024-02-21T07:50:28.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb28811ab00 con 0x55ed96ac7740 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb288111b80 con 0x55ed96ac7740 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb29138c740 10 client.5975 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ed96978650 con 0x55ed96ac7740 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.041+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28811ab00 con 0x55ed96ac7740 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb28812d050 con 0x55ed96ac7740 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 10 client.5975 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 10 client.5975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 20 client.5975 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a6ff10 0x55ed96b1e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 4 client.5975 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:50:28.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed96743890 con 0x55ed96a6ff10 2024-02-21T07:50:28.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.042+0000 7fb287400640 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a6ff10 0x55ed96b1e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.043+0000 7fb26cc00640 10 client.5975 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:50:28.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.043+0000 7fb287400640 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a6ff10 0x55ed96b1e800 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=554be1707c4d1a1c server_cookie=7a32a1edbb815e63 in_seq=0 out_seq=0 2024-02-21T07:50:28.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.047+0000 7fb26cc00640 1 -- 172.21.15.100:0/3068562481 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed96743890 con 0x55ed96a6ff10 2024-02-21T07:50:28.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.047+0000 7fb26cc00640 10 client.5975 handle_command_reply: tid=0 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.047+0000 7fb29138c740 1 client.5975 shutdown 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 msgr2=0x55ed96a4b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 0x55ed96a4b470 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb288075540 tx=0x7fb288068da0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 shutdown_connections 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55ed96a6ff10 0x55ed96b1e800 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ed96ac7740 0x55ed96a4b470 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed96a8c990 0x55ed96ac2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 --2- 172.21.15.100:0/3068562481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed96a76a90 0x55ed96ac7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 >> 172.21.15.100:0/3068562481 conn(0x55ed96a8c070 msgr2=0x55ed96a4f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.048+0000 7fb26cc00640 0 client.5975 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.049+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 shutdown_connections 2024-02-21T07:50:28.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.049+0000 7fb29138c740 1 -- 172.21.15.100:0/3068562481 wait complete. 2024-02-21T07:50:28.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.049+0000 7fb29138c740 20 client.5975 trim_cache size 0 max 16384 2024-02-21T07:50:28.054 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:50:28.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.050+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 msgr2=0x7fb2680a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.050+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 0x7fb2680a16b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb27c036000 tx=0x7fb27c03d040 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.050+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 msgr2=0x7fb2801a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.050+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 0x7fb2801a6ab0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb2880648e0 tx=0x7fb288068050 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 shutdown_connections 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb2801125c0 0x7fb2801a6ab0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb280110d70 0x7fb2801a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb26809f1f0 0x7fb2680a16b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 --2- 172.21.15.100:0/3910164253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb28010f3f0 0x7fb2800f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.051+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 >> 172.21.15.100:0/3910164253 conn(0x7fb280052de0 msgr2=0x7fb28007c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.052+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 shutdown_connections 2024-02-21T07:50:28.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.052+0000 7fb28d000640 1 -- 172.21.15.100:0/3910164253 wait complete. 2024-02-21T07:50:28.085 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:50:28.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:50:28.374 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.371+0000 7f9fd0a00640 1 Processor -- start 2024-02-21T07:50:28.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.371+0000 7f9fd0a00640 1 -- start start 2024-02-21T07:50:28.377 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.374+0000 7f9fd0a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9fcc0cbdc0 0x7f9fcc0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.374+0000 7f9fd0a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0d2490 con 0x7f9fcc0d2050 2024-02-21T07:50:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.374+0000 7f9fd0a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0f5770 con 0x7f9fcc18a520 2024-02-21T07:50:28.378 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.374+0000 7f9fd0a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc18da60 con 0x7f9fcc0cbdc0 2024-02-21T07:50:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.375+0000 7f9fca800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f9fcc18a520 0x7f9fcc18dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:58602/0 (socket says 172.21.15.100:58602) 2024-02-21T07:50:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.375+0000 7f9fca800640 1 -- 172.21.15.100:0/1965004286 learned_addr learned my addr 172.21.15.100:0/1965004286 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:28.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.375+0000 7f9fcb200640 1 --2- 172.21.15.100:0/1965004286 >> v2:172.21.15.170:3300/0 conn(0x7f9fcc0cbdc0 0x7f9fcc0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.377+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624719305 0 0) 0x7f9fcc0f5770 con 0x7f9fcc18a520 2024-02-21T07:50:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.377+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb0003520 con 0x7f9fcc18a520 2024-02-21T07:50:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.377+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856107521 0 0) 0x7f9fcc0d2490 con 0x7f9fcc0d2050 2024-02-21T07:50:28.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.378+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fcc0f5770 con 0x7f9fcc0d2050 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.378+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3415461345 0 0) 0x7f9fb0003520 con 0x7f9fcc18a520 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.378+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 >> v2:172.21.15.170:3300/0 conn(0x7f9fcc0cbdc0 msgr2=0x7f9fcc0cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.378+0000 7f9fc9400640 1 --2- 172.21.15.100:0/1965004286 >> v2:172.21.15.170:3300/0 conn(0x7f9fcc0cbdc0 0x7f9fcc0cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.378+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 >> v1:172.21.15.100:6789/0 conn(0x7f9fcc0d2050 legacy=0x7f9fcc18d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0cd140 con 0x7f9fcc18a520 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f9fbc001670 con 0x7f9fcc18a520 2024-02-21T07:50:28.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 >> v1:172.21.15.170:6789/0 conn(0x7f9fcc18a520 legacy=0x7f9fcc18dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 0x7f9fb0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb00047c0 0x7f9fb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fb00052d0 0x7f9fb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb80011b0 con 0x7f9fb00047c0 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc18da60 con 0x7f9fb00052d0 2024-02-21T07:50:28.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb000c290 con 0x7f9fb0003b50 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.379+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb00047c0 0x7f9fb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 0x7f9fb0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fcb200640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fb00052d0 0x7f9fb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 -- 172.21.15.100:0/1965004286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fb00052d0 msgr2=0x7f9fb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fb00052d0 0x7f9fb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 -- 172.21.15.100:0/1965004286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb00047c0 msgr2=0x7f9fb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb00047c0 0x7f9fb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fca800640 1 -- 172.21.15.100:0/1965004286 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0003520 con 0x7f9fb0003b50 2024-02-21T07:50:28.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.380+0000 7f9fcb200640 1 -- 172.21.15.100:0/1965004286 reap_dead start 2024-02-21T07:50:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.382+0000 7f9fca800640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 0x7f9fb0003f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007fa0 tx=0x7f9fb00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa11cc42c4adce5c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.383+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc005ad0 con 0x7f9fb0003b50 2024-02-21T07:50:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.383+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc005c30 con 0x7f9fb0003b50 2024-02-21T07:50:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fc9400640 1 -- 172.21.15.100:0/1965004286 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc005ad0 con 0x7f9fb0003b50 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fd0a00640 1 -- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 msgr2=0x7f9fb0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 0x7f9fb0003f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007fa0 tx=0x7f9fb00057f0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fd0a00640 1 -- 172.21.15.100:0/1965004286 shutdown_connections 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/1965004286 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fb0003b50 0x7f9fb0003f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.384+0000 7f9fd0a00640 1 -- 172.21.15.100:0/1965004286 >> 172.21.15.100:0/1965004286 conn(0x7f9fcc0cdfc0 msgr2=0x7f9fcc0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.385+0000 7f9fd0a00640 1 -- 172.21.15.100:0/1965004286 shutdown_connections 2024-02-21T07:50:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.385+0000 7f9fd0a00640 1 -- 172.21.15.100:0/1965004286 wait complete. 2024-02-21T07:50:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.387+0000 7f9fd0a00640 1 Processor -- start 2024-02-21T07:50:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.387+0000 7f9fd0a00640 1 -- start start 2024-02-21T07:50:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 0x7f9fcc16c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 0x7f9fcc188380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fcc17ce40 0x7f9fcc17d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc17c460 con 0x7f9fb0003b50 2024-02-21T07:50:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc17aeb0 con 0x7f9fcc17ce40 2024-02-21T07:50:28.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fd0a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc17b0e0 con 0x7f9fcc187f00 2024-02-21T07:50:28.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 0x7f9fcc188380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 0x7f9fcc188380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55298/0 (socket says 172.21.15.100:55298) 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fc9e00640 1 -- 172.21.15.100:0/2322714014 learned_addr learned my addr 172.21.15.100:0/2322714014 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 0x7f9fcc16c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.388+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fcc17ce40 0x7f9fcc17d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 -- 172.21.15.100:0/2322714014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 msgr2=0x7f9fcc188380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 0x7f9fcc188380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 -- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fcc17ce40 msgr2=0x7f9fcc17d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fcc17ce40 0x7f9fcc17d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 -- 172.21.15.100:0/2322714014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc17b3c0 con 0x7f9fb0003b50 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 0x7f9fcc16c360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc031000 tx=0x7f9fcc18cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fc2a00640 1 -- 172.21.15.100:0/2322714014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc03c070 con 0x7f9fb0003b50 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fc2a00640 1 -- 172.21.15.100:0/2322714014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc02c990 con 0x7f9fb0003b50 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.389+0000 7f9fc2a00640 1 -- 172.21.15.100:0/2322714014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc02cd40 con 0x7f9fb0003b50 2024-02-21T07:50:28.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.390+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc17b6a0 con 0x7f9fb0003b50 2024-02-21T07:50:28.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.390+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc17bc60 con 0x7f9fb0003b50 2024-02-21T07:50:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.395+0000 7f9fd403f740 1 Processor -- start 2024-02-21T07:50:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.397+0000 7f9fc2a00640 1 -- 172.21.15.100:0/2322714014 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f9fbc032070 con 0x7f9fb0003b50 2024-02-21T07:50:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.397+0000 7f9fd403f740 1 -- start start 2024-02-21T07:50:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27993ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b27993b1a0 0x55b279976660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2798f6620 con 0x55b2799aa6e0 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2798a88c0 con 0x55b27993b1a0 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.398+0000 7f9fd403f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2798a5df0 con 0x55b279976280 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55312/0 (socket says 172.21.15.100:55312) 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 -- 172.21.15.100:0/2842974692 learned_addr learned my addr 172.21.15.100:0/2842974692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 -- 172.21.15.100:0/2842974692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b27993b1a0 msgr2=0x55b279976660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b27993b1a0 0x55b279976660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 -- 172.21.15.100:0/2842974692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 msgr2=0x55b27993ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27993ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.399+0000 7f9fcb200640 1 -- 172.21.15.100:0/2842974692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b279822b00 con 0x55b279976280 2024-02-21T07:50:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.400+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4004280 tx=0x7f9fc4004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c1d70b8516db12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.400+0000 7f9fb7000640 1 -- 172.21.15.100:0/2842974692 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4016460 con 0x55b279976280 2024-02-21T07:50:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.400+0000 7f9fb7000640 1 -- 172.21.15.100:0/2842974692 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc400f040 con 0x55b279976280 2024-02-21T07:50:28.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.400+0000 7f9fb7000640 1 -- 172.21.15.100:0/2842974692 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40167c0 con 0x55b279976280 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.400+0000 7f9fc2a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 0x7f9fac0a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 -- 172.21.15.100:0/2842974692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 msgr2=0x55b279935650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4004280 tx=0x7f9fc4004740 comp rx=0 tx=0).stop 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 -- 172.21.15.100:0/2842974692 shutdown_connections 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b27993b1a0 0x55b279976660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27993ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2842974692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b279935650 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fd403f740 1 -- 172.21.15.100:0/2842974692 >> 172.21.15.100:0/2842974692 conn(0x55b2799024b0 msgr2=0x55b279939eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.401+0000 7f9fc2a00640 1 -- 172.21.15.100:0/2322714014 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9fbc0ea750 con 0x7f9fb0003b50 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.402+0000 7f9fd403f740 1 -- 172.21.15.100:0/2842974692 shutdown_connections 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.402+0000 7f9fd403f740 1 -- 172.21.15.100:0/2842974692 wait complete. 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.402+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 0x7f9fac0a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.402+0000 7f9fca800640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 0x7f9fac0a1610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0b7fe0 tx=0x7f9fbc039040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.403+0000 7f9fd403f740 1 -- start start 2024-02-21T07:50:28.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.403+0000 7f9fd403f740 1 Processor -- start 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b27999df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27996e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2798a15d0 con 0x55b2799aa6e0 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b279846b50 con 0x55b279976280 2024-02-21T07:50:28.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2798467f0 con 0x55b27993b1a0 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.405+0000 7f9fd403f740 10 client.0 _ll_register_callbacks cb 0x55b27985a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b27999df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49318/0 (socket says 172.21.15.100:49318) 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 -- 172.21.15.100:0/3976598762 learned_addr learned my addr 172.21.15.100:0/3976598762 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fcb200640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27996e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 -- 172.21.15.100:0/3976598762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 msgr2=0x55b27999df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b27999df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 -- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 msgr2=0x55b27996e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27996e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.406+0000 7f9fc9e00640 1 -- 172.21.15.100:0/3976598762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc4004040 con 0x55b279976280 2024-02-21T07:50:28.411 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fcb200640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b27999df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80128b0 tx=0x7f9fb8012d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212f55f150a9d000 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fab400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8012ea0 con 0x55b279976280 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9fb80052e0 con 0x55b279976280 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.407+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b279873cd0 con 0x55b279976280 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb8007e50 con 0x55b279976280 2024-02-21T07:50:28.413 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 10 client.6016 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b27989fc50 con 0x55b279976280 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b279873cd0 con 0x55b279976280 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9fb8010740 con 0x55b279976280 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 10 client.6016 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 10 client.6016 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 20 client.6016 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b279973120 0x55b279973500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 4 client.6016 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.408+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b279897ce0 con 0x55b279973120 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.409+0000 7f9fcb200640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b279973120 0x55b279973500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.409+0000 7f9fcb200640 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b279973120 0x55b279973500 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75021d2a678aee0d server_cookie=3ad22c148d4ffb0f in_seq=0 out_seq=0 2024-02-21T07:50:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.409+0000 7f9fab400640 10 client.6016 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.410+0000 7f9fab400640 1 -- 172.21.15.100:0/3976598762 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b279897ce0 con 0x55b279973120 2024-02-21T07:50:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.410+0000 7f9fab400640 10 client.6016 handle_command_reply: tid=0 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.410+0000 7f9fd403f740 1 client.6016 shutdown 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.410+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 msgr2=0x55b279968f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.410+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80128b0 tx=0x7f9fb8012d70 comp rx=0 tx=0).stop 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 shutdown_connections 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b279973120 0x55b279973500 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b2799aa6e0 0x55b27996e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b279976280 0x55b279968f70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 --2- 172.21.15.100:0/3976598762 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b27999df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fab400640 0 client.6016 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 >> 172.21.15.100:0/3976598762 conn(0x55b2799024b0 msgr2=0x55b279941090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 shutdown_connections 2024-02-21T07:50:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 1 -- 172.21.15.100:0/3976598762 wait complete. 2024-02-21T07:50:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.411+0000 7f9fd403f740 20 client.6016 trim_cache size 0 max 16384 2024-02-21T07:50:28.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.412+0000 7fa782600640 1 Processor -- start 2024-02-21T07:50:28.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.412+0000 7fa782600640 1 -- start start 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.414+0000 7fa782600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa77c072450 0x7fa77c186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.414+0000 7fa782600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c186670 con 0x7fa77c182f60 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa782600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c071010 con 0x7fa77c188c30 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa782600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c183340 con 0x7fa77c072450 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa77c182f60 0x7fa77c071d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35870/0 (socket says 172.21.15.100:35870) 2024-02-21T07:50:28.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa77c072450 0x7fa77c186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77b400640 1 -- 172.21.15.100:0/1476649043 learned_addr learned my addr 172.21.15.100:0/1476649043 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77a000640 1 -- 172.21.15.100:0/1476649043 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254271475 0 0) 0x7fa77c071010 con 0x7fa77c188c30 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77a000640 1 -- 172.21.15.100:0/1476649043 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760005730 con 0x7fa77c188c30 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77aa00640 1 -- 172.21.15.100:0/1476649043 >> v1:172.21.15.170:6789/0 conn(0x7fa77c188c30 legacy=0x7fa77c189060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77aa00640 1 -- 172.21.15.100:0/1476649043 >> v1:172.21.15.100:6789/0 conn(0x7fa77c182f60 legacy=0x7fa77c071d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.415+0000 7fa77aa00640 1 -- 172.21.15.100:0/1476649043 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c06eb10 con 0x7fa77c072450 2024-02-21T07:50:28.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.417+0000 7fa77aa00640 1 --2- 172.21.15.100:0/1476649043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c072450 0x7fa77c186130 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7680097a0 tx=0x7fa76802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377fd7fc767b60b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.418+0000 7fa77a000640 1 -- 172.21.15.100:0/1476649043 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031830 con 0x7fa77c072450 2024-02-21T07:50:28.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.418+0000 7fa77a000640 1 -- 172.21.15.100:0/1476649043 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768031990 con 0x7fa77c072450 2024-02-21T07:50:28.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.418+0000 7fa77a000640 1 -- 172.21.15.100:0/1476649043 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031d20 con 0x7fa77c072450 2024-02-21T07:50:28.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.419+0000 7fa782600640 1 -- 172.21.15.100:0/1476649043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c072450 msgr2=0x7fa77c186130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.419+0000 7fa782600640 1 --2- 172.21.15.100:0/1476649043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c072450 0x7fa77c186130 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7680097a0 tx=0x7fa76802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.419+0000 7fa782600640 1 -- 172.21.15.100:0/1476649043 shutdown_connections 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.419+0000 7fa782600640 1 --2- 172.21.15.100:0/1476649043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c072450 0x7fa77c186130 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.419+0000 7fa782600640 1 -- 172.21.15.100:0/1476649043 >> 172.21.15.100:0/1476649043 conn(0x7fa77c0668b0 msgr2=0x7fa77c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.420+0000 7fa782600640 1 -- 172.21.15.100:0/1476649043 shutdown_connections 2024-02-21T07:50:28.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.420+0000 7fa782600640 1 -- 172.21.15.100:0/1476649043 wait complete. 2024-02-21T07:50:28.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.423+0000 7fa782600640 1 Processor -- start 2024-02-21T07:50:28.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.423+0000 7fa782600640 1 -- start start 2024-02-21T07:50:28.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c188c30 0x7fa77c16b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa77c183ca0 0x7fa77c0f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1841d0 con 0x7fa77c188c30 2024-02-21T07:50:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1844b0 con 0x7fa77c183ca0 2024-02-21T07:50:28.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.426+0000 7fa782600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c184790 con 0x7fa77c182f60 2024-02-21T07:50:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.427+0000 7fa77b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.427+0000 7fa77b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55334/0 (socket says 172.21.15.100:55334) 2024-02-21T07:50:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.427+0000 7fa77b400640 1 -- 172.21.15.100:0/2896846474 learned_addr learned my addr 172.21.15.100:0/2896846474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.427+0000 7fa77be00640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa77c183ca0 0x7fa77c0f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.428+0000 7fa77b400640 1 -- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa77c183ca0 msgr2=0x7fa77c0f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.428+0000 7fa77b400640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa77c183ca0 0x7fa77c0f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.428+0000 7fa77b400640 1 -- 172.21.15.100:0/2896846474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c188c30 msgr2=0x7fa77c16b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.428+0000 7fa77b400640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c188c30 0x7fa77c16b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.428+0000 7fa77b400640 1 -- 172.21.15.100:0/2896846474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009400 con 0x7fa77c182f60 2024-02-21T07:50:28.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.429+0000 7fa77b400640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c3c0 tx=0x7fa76c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.433+0000 7fa773400640 1 -- 172.21.15.100:0/2896846474 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c005ce0 con 0x7fa77c182f60 2024-02-21T07:50:28.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.433+0000 7fa773400640 1 -- 172.21.15.100:0/2896846474 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c005e40 con 0x7fa77c182f60 2024-02-21T07:50:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.433+0000 7fa773400640 1 -- 172.21.15.100:0/2896846474 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0072d0 con 0x7fa77c182f60 2024-02-21T07:50:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.437+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c184a70 con 0x7fa77c182f60 2024-02-21T07:50:28.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.437+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c185030 con 0x7fa77c182f60 2024-02-21T07:50:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.437+0000 7f9fd403f740 1 Processor -- start 2024-02-21T07:50:28.441 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.437+0000 7f9fd403f740 1 -- start start 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.439+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 0x55b2799a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.439+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b279941090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fd403f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b279975f50 con 0x55b27993b1a0 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fd403f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2795e9e60 con 0x55b2799aa6e0 2024-02-21T07:50:28.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fd403f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27993a2f0 con 0x55b279976280 2024-02-21T07:50:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 0x55b2799a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55340/0 (socket says 172.21.15.100:55340) 2024-02-21T07:50:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.440+0000 7f9fc9e00640 1 -- 172.21.15.100:0/1280594443 learned_addr learned my addr 172.21.15.100:0/1280594443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 -- 172.21.15.100:0/1280594443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 msgr2=0x55b279941090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:28.445 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b279941090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 -- 172.21.15.100:0/1280594443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 msgr2=0x55b2799a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.446 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 0x55b2799a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.442+0000 7fa773400640 1 -- 172.21.15.100:0/2896846474 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa76c0074f0 con 0x7fa77c182f60 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 -- 172.21.15.100:0/1280594443 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27983c530 con 0x55b279976280 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fcb200640 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 0x55b2799a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8012590 tx=0x7f9fb800c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afdf71cc2dfafe9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.441+0000 7f9fb6600640 1 -- 172.21.15.100:0/1280594443 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8000fe0 con 0x55b279976280 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.442+0000 7f9fb6600640 1 -- 172.21.15.100:0/1280594443 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb8010c50 con 0x55b279976280 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.442+0000 7f9fd403f740 1 -- 172.21.15.100:0/1280594443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 msgr2=0x55b27996e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.447 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.442+0000 7f9fd403f740 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8012590 tx=0x7f9fb800c000 comp rx=0 tx=0).stop 2024-02-21T07:50:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 -- 172.21.15.100:0/1280594443 shutdown_connections 2024-02-21T07:50:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b279941090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.448 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b279976280 0x55b27996e1a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 --2- 172.21.15.100:0/1280594443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b27993b1a0 0x55b2799a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 -- 172.21.15.100:0/1280594443 >> 172.21.15.100:0/1280594443 conn(0x55b2799024b0 msgr2=0x55b27999dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.443+0000 7f9fd403f740 1 -- 172.21.15.100:0/1280594443 shutdown_connections 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.444+0000 7f9fd403f740 1 -- 172.21.15.100:0/1280594443 wait complete. 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.445+0000 7f9fd403f740 1 -- start start 2024-02-21T07:50:28.449 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.445+0000 7f9fd403f740 1 Processor -- start 2024-02-21T07:50:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.447+0000 7fa785221740 1 Processor -- start 2024-02-21T07:50:28.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.447+0000 7fa785221740 1 -- start start 2024-02-21T07:50:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b2799670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.451 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 0x55b2799c2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b27999de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2799aa060 con 0x55b279976280 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2799ad530 con 0x55b2799aa6e0 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2799a9850 con 0x55b27993b1a0 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.447+0000 7f9fd403f740 10 client.0 _ll_register_callbacks cb 0x7f9fc4003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:28.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.448+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 0x55b2799c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa773400640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 0x7fa75c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.449+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b27999de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.449+0000 7f9fcb200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b2799670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.449+0000 7f9fc9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 0x55b2799c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59006/0 (socket says 172.21.15.100:59006) 2024-02-21T07:50:28.453 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.449+0000 7f9fc9e00640 1 -- 172.21.15.100:0/2037057456 learned_addr learned my addr 172.21.15.100:0/2037057456 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f293a6d0 0x5575f293aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2975860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f2976b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2865210 con 0x5575f293aff0 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2862740 con 0x5575f2975da0 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.449+0000 7fa785221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f285df20 con 0x5575f293a6d0 2024-02-21T07:50:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa773400640 1 -- 172.21.15.100:0/2896846474 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa76c0c9070 con 0x7fa77c182f60 2024-02-21T07:50:28.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 -- 172.21.15.100:0/2037057456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 msgr2=0x55b27999de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b27999de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 -- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 msgr2=0x55b2799c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 0x55b2799c2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 -- 172.21.15.100:0/2037057456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b27989fc50 con 0x55b27993b1a0 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fab400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:28.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.450+0000 7f9fcb200640 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b2799670a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4004280 tx=0x7f9fc400b030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65181bd88f3c169 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa77aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2975860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa77be00640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 0x7fa75c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa77aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2975860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59014/0 (socket says 172.21.15.100:59014) 2024-02-21T07:50:28.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa77aa00640 1 -- 172.21.15.100:0/43361346 learned_addr learned my addr 172.21.15.100:0/43361346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.450+0000 7fa77be00640 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f2976b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 -- 172.21.15.100:0/43361346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f293a6d0 msgr2=0x5575f293aab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f293a6d0 0x5575f293aab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 -- 172.21.15.100:0/43361346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 msgr2=0x5575f2975860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.451+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4028060 con 0x55b27993b1a0 2024-02-21T07:50:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2975860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.451+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9fc4016880 con 0x55b27993b1a0 2024-02-21T07:50:28.458 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2798c6d30 con 0x55b27993b1a0 2024-02-21T07:50:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 -- 172.21.15.100:0/43361346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575f281fdf0 con 0x5575f2975da0 2024-02-21T07:50:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 0x7fa75c0a16b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e700 tx=0x7fa77400e950 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.451+0000 7fa77be00640 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f2976b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e850 tx=0x7fa7740021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ca1ead32231ebf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.459 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fc4028060 con 0x55b27993b1a0 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fd403f740 10 client.5999 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b2798622c0 con 0x55b27993b1a0 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc4032020 con 0x55b27993b1a0 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9fc4014040 con 0x55b27993b1a0 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fd403f740 10 client.5999 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.452+0000 7f9fd403f740 10 client.5999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.453+0000 7f9fd403f740 20 client.5999 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.453+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b2799acb70 0x55b279a073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.453+0000 7f9fd403f740 4 client.5999 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:50:28.460 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.453+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2798c6d30 con 0x55b2799acb70 2024-02-21T07:50:28.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.453+0000 7fa767e00640 1 -- 172.21.15.100:0/43361346 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774013050 con 0x5575f2975da0 2024-02-21T07:50:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.453+0000 7fa767e00640 1 -- 172.21.15.100:0/43361346 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774003970 con 0x5575f2975da0 2024-02-21T07:50:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.453+0000 7fa767e00640 1 -- 172.21.15.100:0/43361346 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774003ce0 con 0x5575f2975da0 2024-02-21T07:50:28.461 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.454+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b2799acb70 0x55b279a073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.454+0000 7fa785221740 1 -- 172.21.15.100:0/43361346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 msgr2=0x5575f2976b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.454+0000 7fa785221740 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f2976b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e850 tx=0x7fa7740021f0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 -- 172.21.15.100:0/43361346 shutdown_connections 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f2976b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2975860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 --2- 172.21.15.100:0/43361346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f293a6d0 0x5575f293aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 -- 172.21.15.100:0/43361346 >> 172.21.15.100:0/43361346 conn(0x5575f28fcca0 msgr2=0x5575f28fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.455+0000 7fa785221740 1 -- 172.21.15.100:0/43361346 shutdown_connections 2024-02-21T07:50:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.456+0000 7f9fab400640 10 client.5999 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:28.462 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.456+0000 7f9fc9e00640 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b2799acb70 0x55b279a073a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a8b244a3fef53a server_cookie=a1b1c19ab376b935 in_seq=0 out_seq=0 2024-02-21T07:50:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.456+0000 7fa785221740 1 -- 172.21.15.100:0/43361346 wait complete. 2024-02-21T07:50:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.457+0000 7fa785221740 1 -- start start 2024-02-21T07:50:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.457+0000 7fa785221740 1 Processor -- start 2024-02-21T07:50:28.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.461+0000 7fa785221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2981900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa785221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f28fa590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa785221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa785221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2803150 con 0x5575f293aff0 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa77be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa77be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55386/0 (socket says 172.21.15.100:55386) 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa77be00640 1 -- 172.21.15.100:0/79701079 learned_addr learned my addr 172.21.15.100:0/79701079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.462+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2802df0 con 0x5575f2975da0 2024-02-21T07:50:28.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f25cc1c0 con 0x5575f292bda0 2024-02-21T07:50:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77aa00640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f28fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 -- 172.21.15.100:0/79701079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 msgr2=0x5575f28fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f28fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 -- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 msgr2=0x5575f2981900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2981900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760005730 con 0x5575f292bda0 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.463+0000 7fa77be00640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7740052f0 tx=0x7fa77401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ab4a8a96ac379d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa764c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa764c00640 1 -- 172.21.15.100:0/79701079 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774013040 con 0x5575f292bda0 2024-02-21T07:50:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa764c00640 1 -- 172.21.15.100:0/79701079 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa774003e30 con 0x5575f292bda0 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa764c00640 10 client.0 inactive, discarding osd_map(30..30 src has 1..30) v4 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa785221740 10 client.0 _ll_register_callbacks cb 0x5575f28522b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.464+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575f255d7e0 con 0x5575f292bda0 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.465+0000 7fa764c00640 1 -- 172.21.15.100:0/79701079 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7740180c0 con 0x5575f292bda0 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.465+0000 7fa785221740 10 client.6002 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:28.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.465+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x5575f285c5a0 con 0x5575f292bda0 2024-02-21T07:50:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa764c00640 1 -- 172.21.15.100:0/79701079 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa77402b030 con 0x5575f292bda0 2024-02-21T07:50:28.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 10 client.6002 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:28.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 10 client.6002 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:50:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 20 client.6002 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f28f9920 0x5575f2982430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 4 client.6002 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.468+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575f259a720 con 0x5575f28f9920 2024-02-21T07:50:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.469+0000 7fa77b400640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f28f9920 0x5575f2982430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.470+0000 7fa77b400640 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f28f9920 0x5575f2982430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45fdc93a995668cd server_cookie=1d89a49179006682 in_seq=0 out_seq=0 2024-02-21T07:50:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.470+0000 7fa764c00640 10 client.6002 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:50:28.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.475+0000 7fa764c00640 1 -- 172.21.15.100:0/79701079 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575f259a720 con 0x5575f28f9920 2024-02-21T07:50:28.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.475+0000 7fa764c00640 10 client.6002 handle_command_reply: tid=0 2024-02-21T07:50:28.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.475+0000 7fa785221740 1 client.6002 shutdown 2024-02-21T07:50:28.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 msgr2=0x5575f292c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa7740052f0 tx=0x7fa77401b000 comp rx=0 tx=0).stop 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 shutdown_connections 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f292c220 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f28f9920 0x5575f2982430 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f2975da0 0x5575f28fa590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 --2- 172.21.15.100:0/79701079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f293aff0 0x5575f2981900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 >> 172.21.15.100:0/79701079 conn(0x5575f293a6d0 msgr2=0x5575f28fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.477+0000 7fa764c00640 0 client.6002 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:50:28.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.478+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 shutdown_connections 2024-02-21T07:50:28.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.478+0000 7fa785221740 1 -- 172.21.15.100:0/79701079 wait complete. 2024-02-21T07:50:28.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.478+0000 7fa785221740 20 client.6002 trim_cache size 0 max 16384 2024-02-21T07:50:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.487+0000 7f9fab400640 1 -- 172.21.15.100:0/2037057456 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2798c6d30 con 0x55b2799acb70 2024-02-21T07:50:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.487+0000 7f9fab400640 10 client.5999 handle_command_reply: tid=0 2024-02-21T07:50:28.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.487+0000 7f9fd403f740 1 client.5999 shutdown 2024-02-21T07:50:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.487+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 msgr2=0x55b2799670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.487+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b2799670a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4004280 tx=0x7f9fc400b030 comp rx=0 tx=0).stop 2024-02-21T07:50:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 shutdown_connections 2024-02-21T07:50:28.491 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b2799acb70 0x55b279a073a0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b2799aa6e0 0x55b27999de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b279976280 0x55b2799c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 --2- 172.21.15.100:0/2037057456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b27993b1a0 0x55b2799670a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 >> 172.21.15.100:0/2037057456 conn(0x55b2799024b0 msgr2=0x55b27993f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.488+0000 7f9fab400640 0 client.5999 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.489+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 shutdown_connections 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.489+0000 7f9fd403f740 1 -- 172.21.15.100:0/2037057456 wait complete. 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.489+0000 7f9fd403f740 20 client.5999 trim_cache size 0 max 16384 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:50:28.493 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:50:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:50:28.494 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.490+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 msgr2=0x7f9fac0a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.490+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 0x7f9fac0a1610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0b7fe0 tx=0x7f9fbc039040 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.490+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 msgr2=0x7f9fcc16c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.490+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 0x7f9fcc16c360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc031000 tx=0x7f9fcc18cb00 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 shutdown_connections 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9fcc17ce40 0x7f9fcc17d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9fcc187f00 0x7f9fcc188380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9fac09f150 0x7f9fac0a1610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 --2- 172.21.15.100:0/2322714014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb0003b50 0x7f9fcc16c360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 >> 172.21.15.100:0/2322714014 conn(0x7f9fcc0cdfc0 msgr2=0x7f9fcc18f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 shutdown_connections 2024-02-21T07:50:28.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:28.491+0000 7f9fd0a00640 1 -- 172.21.15.100:0/2322714014 wait complete. 2024-02-21T07:50:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.505+0000 7fa785221740 1 Processor -- start 2024-02-21T07:50:28.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.505+0000 7fa785221740 1 -- start start 2024-02-21T07:50:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f2976180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2940500 con 0x5575f2975da0 2024-02-21T07:50:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f298f330 con 0x5575f293aff0 2024-02-21T07:50:28.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.507+0000 7fa785221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f28fc100 con 0x5575f292bda0 2024-02-21T07:50:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.509+0000 7fa77be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.509+0000 7fa77be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59046/0 (socket says 172.21.15.100:59046) 2024-02-21T07:50:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.509+0000 7fa77be00640 1 -- 172.21.15.100:0/2026053897 learned_addr learned my addr 172.21.15.100:0/2026053897 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.509+0000 7fa77aa00640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.509+0000 7fa77b400640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f2976180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77aa00640 1 -- 172.21.15.100:0/2026053897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 msgr2=0x5575f2976180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77aa00640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f2976180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77aa00640 1 -- 172.21.15.100:0/2026053897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 msgr2=0x5575f29d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77aa00640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77aa00640 1 -- 172.21.15.100:0/2026053897 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575f27f8ab0 con 0x5575f293aff0 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.510+0000 7fa77be00640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:28.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.512+0000 7fa77aa00640 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29d0c60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5370e82665702ad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.513+0000 7fa767400640 1 -- 172.21.15.100:0/2026053897 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768040050 con 0x5575f293aff0 2024-02-21T07:50:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.513+0000 7fa767400640 1 -- 172.21.15.100:0/2026053897 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768041040 con 0x5575f293aff0 2024-02-21T07:50:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.513+0000 7fa767400640 1 -- 172.21.15.100:0/2026053897 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768004030 con 0x5575f293aff0 2024-02-21T07:50:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.513+0000 7fa785221740 1 -- 172.21.15.100:0/2026053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 msgr2=0x5575f29d0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.513+0000 7fa785221740 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29d0c60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768030000 comp rx=0 tx=0).stop 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 -- 172.21.15.100:0/2026053897 shutdown_connections 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f2975da0 0x5575f29d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29d0c60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 --2- 172.21.15.100:0/2026053897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f292bda0 0x5575f2976180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 -- 172.21.15.100:0/2026053897 >> 172.21.15.100:0/2026053897 conn(0x5575f293a6d0 msgr2=0x5575f28fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 -- 172.21.15.100:0/2026053897 shutdown_connections 2024-02-21T07:50:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.514+0000 7fa785221740 1 -- 172.21.15.100:0/2026053897 wait complete. 2024-02-21T07:50:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.515+0000 7fa785221740 1 -- start start 2024-02-21T07:50:28.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.516+0000 7fa785221740 1 Processor -- start 2024-02-21T07:50:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.518+0000 7fa785221740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f292bda0 0x5575f292b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29743a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f2986050 con 0x5575f292bda0 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f29738b0 con 0x5575f293aff0 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575f29864b0 con 0x5575f2975da0 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa785221740 10 client.0 _ll_register_callbacks cb 0x7fa77400edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.519+0000 7fa77be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55398/0 (socket says 172.21.15.100:55398) 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 -- 172.21.15.100:0/2348393060 learned_addr learned my addr 172.21.15.100:0/2348393060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77b400640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f292bda0 0x5575f292b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 -- 172.21.15.100:0/2348393060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 msgr2=0x5575f29743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 -- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f292bda0 msgr2=0x5575f292b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f292bda0 0x5575f292b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.520+0000 7fa77be00640 1 -- 172.21.15.100:0/2348393060 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575f285c5a0 con 0x5575f2975da0 2024-02-21T07:50:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.521+0000 7fa77be00640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa774005320 tx=0x7fa77400e470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5ee430f837815 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:28.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.522+0000 7fa764c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:28.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.522+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774013070 con 0x5575f2975da0 2024-02-21T07:50:28.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.522+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa7740056e0 con 0x5575f2975da0 2024-02-21T07:50:28.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.522+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa774003970 con 0x5575f2975da0 2024-02-21T07:50:28.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.523+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa77400ebe0 con 0x5575f2975da0 2024-02-21T07:50:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.523+0000 7fa785221740 10 client.6008 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.523+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fa77c06eb10 con 0x5575f2975da0 2024-02-21T07:50:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.523+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774003970 con 0x5575f2975da0 2024-02-21T07:50:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.523+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa77402b040 con 0x5575f2975da0 2024-02-21T07:50:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 10 client.6008 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 10 client.6008 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 20 client.6008 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f2987500 0x5575f2973150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 4 client.6008 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.524+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575f25e9890 con 0x5575f2987500 2024-02-21T07:50:28.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.525+0000 7fa77b400640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f2987500 0x5575f2973150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.525+0000 7fa77b400640 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f2987500 0x5575f2973150 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f060ffc91ef193ce server_cookie=3c388899d63f0b96 in_seq=0 out_seq=0 2024-02-21T07:50:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.525+0000 7fa764c00640 10 client.6008 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:50:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa764c00640 1 -- 172.21.15.100:0/2348393060 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575f25e9890 con 0x5575f2987500 2024-02-21T07:50:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa764c00640 10 client.6008 handle_command_reply: tid=0 2024-02-21T07:50:28.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 client.6008 shutdown 2024-02-21T07:50:28.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 msgr2=0x5575f297e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa774005320 tx=0x7fa77400e470 comp rx=0 tx=0).stop 2024-02-21T07:50:28.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 shutdown_connections 2024-02-21T07:50:28.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575f2975da0 0x5575f297e380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5575f2987500 0x5575f2973150 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5575f293aff0 0x5575f29743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 --2- 172.21.15.100:0/2348393060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575f292bda0 0x5575f292b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa764c00640 0 client.6008 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 >> 172.21.15.100:0/2348393060 conn(0x5575f293a6d0 msgr2=0x5575f292c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 shutdown_connections 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.526+0000 7fa785221740 1 -- 172.21.15.100:0/2348393060 wait complete. 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.527+0000 7fa785221740 20 client.6008 trim_cache size 0 max 16384 2024-02-21T07:50:28.531 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 msgr2=0x7fa75c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 0x7fa75c0a16b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa77400e700 tx=0x7fa77400e950 comp rx=0 tx=0).stop 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 msgr2=0x7fa77c1886d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c3c0 tx=0x7fa76c00c880 comp rx=0 tx=0).stop 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 shutdown_connections 2024-02-21T07:50:28.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa77c183ca0 0x7fa77c0f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa75c09f1f0 0x7fa75c0a16b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa77c188c30 0x7fa77c16b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 --2- 172.21.15.100:0/2896846474 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa77c182f60 0x7fa77c1886d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 >> 172.21.15.100:0/2896846474 conn(0x7fa77c0668b0 msgr2=0x7fa77c1792f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 shutdown_connections 2024-02-21T07:50:28.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:28.528+0000 7fa782600640 1 -- 172.21.15.100:0/2896846474 wait complete. 2024-02-21T07:50:28.553 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:50:28.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:50:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.004+0000 7fc9a4800640 1 Processor -- start 2024-02-21T07:50:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.005+0000 7fc9a4800640 1 -- start start 2024-02-21T07:50:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.007+0000 7fc9a4800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc99c185df0 0x7fc99c1862a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.007+0000 7fc9a4800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0f4760 con 0x7fc99c08e630 2024-02-21T07:50:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.007+0000 7fc9a4800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c070d80 con 0x7fc99c17e970 2024-02-21T07:50:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.007+0000 7fc9a4800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c185910 con 0x7fc99c185df0 2024-02-21T07:50:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.008+0000 7fc9a1e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fc99c17e970 0x7fc99c070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:58626/0 (socket says 172.21.15.100:58626) 2024-02-21T07:50:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.008+0000 7fc9a1e00640 1 -- 172.21.15.100:0/597750235 learned_addr learned my addr 172.21.15.100:0/597750235 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.009+0000 7fc9a1400640 1 --2- 172.21.15.100:0/597750235 >> v2:172.21.15.100:3300/0 conn(0x7fc99c185df0 0x7fc99c1862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299147863 0 0) 0x7fc99c0f4760 con 0x7fc99c08e630 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc984003520 con 0x7fc99c08e630 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342360487 0 0) 0x7fc99c070d80 con 0x7fc99c17e970 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc99c0f4760 con 0x7fc99c17e970 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a1400640 1 -- 172.21.15.100:0/597750235 >> v1:172.21.15.170:6789/0 conn(0x7fc99c17e970 legacy=0x7fc99c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a1400640 1 -- 172.21.15.100:0/597750235 >> v1:172.21.15.156:6789/0 conn(0x7fc99c08e630 legacy=0x7fc99c06e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.010+0000 7fc9a1400640 1 -- 172.21.15.100:0/597750235 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0f49b0 con 0x7fc99c185df0 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.012+0000 7fc9a1400640 1 --2- 172.21.15.100:0/597750235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c185df0 0x7fc99c1862a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc990010e00 tx=0x7fc99002bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610188fc538c3897 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.013+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99002c980 con 0x7fc99c185df0 2024-02-21T07:50:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.013+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990030070 con 0x7fc99c185df0 2024-02-21T07:50:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.017+0000 7fc9a4800640 1 -- 172.21.15.100:0/597750235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c185df0 msgr2=0x7fc99c1862a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.017+0000 7fc9a0a00640 1 -- 172.21.15.100:0/597750235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99002c980 con 0x7fc99c185df0 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.017+0000 7fc9a4800640 1 --2- 172.21.15.100:0/597750235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c185df0 0x7fc99c1862a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc990010e00 tx=0x7fc99002bde0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.018+0000 7fc9a4800640 1 -- 172.21.15.100:0/597750235 shutdown_connections 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.018+0000 7fc9a4800640 1 --2- 172.21.15.100:0/597750235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c185df0 0x7fc99c1862a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.018+0000 7fc9a4800640 1 -- 172.21.15.100:0/597750235 >> 172.21.15.100:0/597750235 conn(0x7fc99c0668b0 msgr2=0x7fc99c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.019+0000 7fc9a4800640 1 -- 172.21.15.100:0/597750235 shutdown_connections 2024-02-21T07:50:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.019+0000 7fc9a4800640 1 -- 172.21.15.100:0/597750235 wait complete. 2024-02-21T07:50:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.022+0000 7fc9a4800640 1 Processor -- start 2024-02-21T07:50:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.023+0000 7fc9a4800640 1 -- start start 2024-02-21T07:50:29.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.025+0000 7fc9a4800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a4800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 0x7fc99c218170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a4800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 0x7fc99c2186b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a4800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c17c750 con 0x7fc99c08e630 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a4800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c17ca30 con 0x7fc99c17e970 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a4800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c17cd10 con 0x7fc99c185df0 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59076/0 (socket says 172.21.15.100:59076) 2024-02-21T07:50:29.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.026+0000 7fc9a1e00640 1 -- 172.21.15.100:0/758660041 learned_addr learned my addr 172.21.15.100:0/758660041 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:29.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.027+0000 7fc9a1400640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 0x7fc99c218170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.027+0000 7fc9a2800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 0x7fc99c2186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.029+0000 7fc9a1400640 1 -- 172.21.15.100:0/758660041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 msgr2=0x7fc99c2186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.029+0000 7fc9a1400640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 0x7fc99c2186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.029+0000 7fc9a1400640 1 -- 172.21.15.100:0/758660041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 msgr2=0x7fc99c16cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.030+0000 7fc9a1400640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.030+0000 7fc9a1400640 1 -- 172.21.15.100:0/758660041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990010800 con 0x7fc99c17e970 2024-02-21T07:50:29.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.030+0000 7fc9a1e00640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:29.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.030+0000 7fc9a2800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 0x7fc99c2186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:29.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.031+0000 7fc9a1400640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 0x7fc99c218170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc990034000 tx=0x7fc9900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.032+0000 7fc996000640 1 -- 172.21.15.100:0/758660041 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990003a20 con 0x7fc99c17e970 2024-02-21T07:50:29.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.032+0000 7fc996000640 1 -- 172.21.15.100:0/758660041 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990003b80 con 0x7fc99c17e970 2024-02-21T07:50:29.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.032+0000 7fc996000640 1 -- 172.21.15.100:0/758660041 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990004500 con 0x7fc99c17e970 2024-02-21T07:50:29.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.032+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c17cff0 con 0x7fc99c17e970 2024-02-21T07:50:29.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.033+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c17d5b0 con 0x7fc99c17e970 2024-02-21T07:50:29.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.057+0000 7fc9a7404740 1 Processor -- start 2024-02-21T07:50:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.060+0000 7fc9a7404740 1 -- start start 2024-02-21T07:50:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.062+0000 7fc996000640 1 -- 172.21.15.100:0/758660041 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc990041470 con 0x7fc99c17e970 2024-02-21T07:50:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20deec0 0x5558d20df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d211a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d2012210 con 0x5558d20deec0 2024-02-21T07:50:29.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d200f740 con 0x5558d20df7e0 2024-02-21T07:50:29.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.072+0000 7fc9a7404740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d200af20 con 0x5558d211a590 2024-02-21T07:50:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.074+0000 7fc996000640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 0x7fc9800a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.074+0000 7fc996000640 1 -- 172.21.15.100:0/758660041 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc9900ec4b0 con 0x7fc99c17e970 2024-02-21T07:50:29.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.076+0000 7fc9a1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.076+0000 7fc9a1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55408/0 (socket says 172.21.15.100:55408) 2024-02-21T07:50:29.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.076+0000 7fc9a1400640 1 -- 172.21.15.100:0/3842096922 learned_addr learned my addr 172.21.15.100:0/3842096922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:29.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.078+0000 7fc9a1400640 1 -- 172.21.15.100:0/3842096922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 msgr2=0x5558d211a050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.078+0000 7fc9a1400640 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d211a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.078+0000 7fc9a1400640 1 -- 172.21.15.100:0/3842096922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20deec0 msgr2=0x5558d20df2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.078+0000 7fc9a1400640 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20deec0 0x5558d20df2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.078+0000 7fc9a1400640 1 -- 172.21.15.100:0/3842096922 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d1fccdf0 con 0x5558d211a590 2024-02-21T07:50:29.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.079+0000 7fc9a1400640 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9900e9dc0 tx=0x7fc9900b98f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60668dce5862ec9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.079+0000 7fc9a2800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 0x7fc9800a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.080+0000 7fc9a2800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 0x7fc9800a16b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5558d20a1210 tx=0x7fc98c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.081+0000 7fc98a600640 1 -- 172.21.15.100:0/3842096922 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900be0e0 con 0x5558d211a590 2024-02-21T07:50:29.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.081+0000 7fc98a600640 1 -- 172.21.15.100:0/3842096922 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900c2730 con 0x5558d211a590 2024-02-21T07:50:29.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.083+0000 7fc9a7404740 1 -- 172.21.15.100:0/3842096922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 msgr2=0x5558d211b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.083+0000 7fc9a7404740 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc9900e9dc0 tx=0x7fc9900b98f0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.089+0000 7fc9a7404740 1 -- 172.21.15.100:0/3842096922 shutdown_connections 2024-02-21T07:50:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.089+0000 7fc9a7404740 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d211b320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.089+0000 7fc9a7404740 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d211a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.089+0000 7fc9a7404740 1 --2- 172.21.15.100:0/3842096922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20deec0 0x5558d20df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.089+0000 7fc9a7404740 1 -- 172.21.15.100:0/3842096922 >> 172.21.15.100:0/3842096922 conn(0x5558d20a1490 msgr2=0x5558d20a2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.090+0000 7fc9a7404740 1 -- 172.21.15.100:0/3842096922 shutdown_connections 2024-02-21T07:50:29.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.090+0000 7fc9a7404740 1 -- 172.21.15.100:0/3842096922 wait complete. 2024-02-21T07:50:29.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.092+0000 7fc9a7404740 1 -- start start 2024-02-21T07:50:29.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.097+0000 7fc9a7404740 1 Processor -- start 2024-02-21T07:50:29.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20df7e0 0x5558d209efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d20d7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d1fb0150 con 0x5558d20df7e0 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d1fafdf0 con 0x5558d20d0300 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d1d791c0 con 0x5558d211a590 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a7404740 10 client.0 _ll_register_callbacks cb 0x5558d1fff2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49376/0 (socket says 172.21.15.100:49376) 2024-02-21T07:50:29.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.099+0000 7fc9a2800640 1 -- 172.21.15.100:0/1304623953 learned_addr learned my addr 172.21.15.100:0/1304623953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:29.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.100+0000 7fc9a2800640 1 -- 172.21.15.100:0/1304623953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 msgr2=0x5558d20d7910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.100+0000 7fc9a2800640 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d20d7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.100+0000 7fc9a2800640 1 -- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20df7e0 msgr2=0x5558d209efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:29.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.100+0000 7fc9a2800640 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20df7e0 0x5558d209efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.100+0000 7fc9a2800640 1 -- 172.21.15.100:0/1304623953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c17d5b0 con 0x5558d20d0300 2024-02-21T07:50:29.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.105+0000 7fc9a2800640 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc98c014800 tx=0x7fc98c000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dbfdb3de6a7d2be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.105+0000 7fc97ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:29.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c013930 con 0x5558d20d0300 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc98c01c040 con 0x5558d20d0300 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558d1d0a7e0 con 0x5558d20d0300 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc98c013a90 con 0x5558d20d0300 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc9a7404740 10 client.6043 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5558d20095a0 con 0x5558d20d0300 2024-02-21T07:50:29.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c02d020 con 0x5558d20d0300 2024-02-21T07:50:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc98c012070 con 0x5558d20d0300 2024-02-21T07:50:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc9a7404740 10 client.6043 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.107+0000 7fc9a7404740 10 client.6043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:29.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.108+0000 7fc9a7404740 20 client.6043 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.108+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d20d0780 0x5558d20d7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.108+0000 7fc9a7404740 4 client.6043 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.108+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558d1d47720 con 0x5558d20d0780 2024-02-21T07:50:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.108+0000 7fc9a1e00640 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d20d0780 0x5558d20d7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.109+0000 7fc97ea00640 10 client.6043 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:29.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.111+0000 7fc9a1e00640 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d20d0780 0x5558d20d7250 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78545ccc73e13c49 server_cookie=503e750ba7f410bb in_seq=0 out_seq=0 2024-02-21T07:50:29.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.112+0000 7fc97ea00640 1 -- 172.21.15.100:0/1304623953 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5558d1d47720 con 0x5558d20d0780 2024-02-21T07:50:29.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.112+0000 7fc97ea00640 10 client.6043 handle_command_reply: tid=0 2024-02-21T07:50:29.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.112+0000 7fc9a7404740 1 client.6043 shutdown 2024-02-21T07:50:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.113+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 msgr2=0x5558d20d6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.113+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc98c014800 tx=0x7fc98c000f50 comp rx=0 tx=0).stop 2024-02-21T07:50:29.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.113+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 shutdown_connections 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d20d0780 0x5558d20d7250 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20d0300 0x5558d20d6840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc97ea00640 0 client.6043 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d20d7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1304623953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d20df7e0 0x5558d209efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 >> 172.21.15.100:0/1304623953 conn(0x5558d20deec0 msgr2=0x5558d20e3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.114+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 shutdown_connections 2024-02-21T07:50:29.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.118+0000 7fc9a7404740 1 -- 172.21.15.100:0/1304623953 wait complete. 2024-02-21T07:50:29.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.121+0000 7fc9a7404740 20 client.6043 trim_cache size 0 max 16384 2024-02-21T07:50:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.162+0000 7fc9a7404740 1 Processor -- start 2024-02-21T07:50:29.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.162+0000 7fc9a7404740 1 -- start start 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d20d0300 0x5558d20d6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d2178a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d2117cd0 con 0x5558d211a590 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d20d6c40 con 0x5558d20df7e0 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.164+0000 7fc9a7404740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d209d660 con 0x5558d20d0300 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.165+0000 7fc9a2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.165+0000 7fc9a2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59090/0 (socket says 172.21.15.100:59090) 2024-02-21T07:50:29.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.165+0000 7fc9a2800640 1 -- 172.21.15.100:0/2325954408 learned_addr learned my addr 172.21.15.100:0/2325954408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.166+0000 7fc9a2800640 1 -- 172.21.15.100:0/2325954408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d20d0300 msgr2=0x5558d20d6700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.166+0000 7fc9a2800640 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d20d0300 0x5558d20d6700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.166+0000 7fc9a2800640 1 -- 172.21.15.100:0/2325954408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 msgr2=0x5558d2178a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.166+0000 7fc9a2800640 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d2178a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.166+0000 7fc9a2800640 1 -- 172.21.15.100:0/2325954408 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d2117470 con 0x5558d211a590 2024-02-21T07:50:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.167+0000 7fc9a2800640 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc98c000c00 tx=0x7fc98c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7944979aa769e871 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.167+0000 7fc989c00640 1 -- 172.21.15.100:0/2325954408 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c013c70 con 0x5558d211a590 2024-02-21T07:50:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.168+0000 7fc989c00640 1 -- 172.21.15.100:0/2325954408 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c02d070 con 0x5558d211a590 2024-02-21T07:50:29.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.168+0000 7fc989c00640 1 -- 172.21.15.100:0/2325954408 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0067d0 con 0x5558d211a590 2024-02-21T07:50:29.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.168+0000 7fc9a7404740 1 -- 172.21.15.100:0/2325954408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 msgr2=0x5558d2178f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.168+0000 7fc9a7404740 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc98c000c00 tx=0x7fc98c01e000 comp rx=0 tx=0).stop 2024-02-21T07:50:29.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.169+0000 7fc9a7404740 1 -- 172.21.15.100:0/2325954408 shutdown_connections 2024-02-21T07:50:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.169+0000 7fc9a7404740 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d211a590 0x5558d2178f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.169+0000 7fc9a7404740 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d20df7e0 0x5558d2178a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.169+0000 7fc9a7404740 1 --2- 172.21.15.100:0/2325954408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d20d0300 0x5558d20d6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.169+0000 7fc9a7404740 1 -- 172.21.15.100:0/2325954408 >> 172.21.15.100:0/2325954408 conn(0x5558d20deec0 msgr2=0x5558d20a2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.170+0000 7fc9a7404740 1 -- 172.21.15.100:0/2325954408 shutdown_connections 2024-02-21T07:50:29.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.170+0000 7fc9a7404740 1 -- 172.21.15.100:0/2325954408 wait complete. 2024-02-21T07:50:29.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.171+0000 7fc9a7404740 1 -- start start 2024-02-21T07:50:29.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.171+0000 7fc9a7404740 1 Processor -- start 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d212b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 0x5558d209cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d2119c90 0x5558d21759a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d209ed00 con 0x5558d2118240 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d209f2c0 con 0x5558d2119c90 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d20a0720 con 0x5558d211a590 2024-02-21T07:50:29.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.176+0000 7fc9a7404740 10 client.0 _ll_register_callbacks cb 0x7fc99002dec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.179+0000 7fc9a1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d212b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.179+0000 7fc9a1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d212b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55420/0 (socket says 172.21.15.100:55420) 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.179+0000 7fc9a1e00640 1 -- 172.21.15.100:0/1194299900 learned_addr learned my addr 172.21.15.100:0/1194299900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.179+0000 7fc9a1400640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 0x5558d209cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.180+0000 7fc9a1400640 1 -- 172.21.15.100:0/1194299900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 msgr2=0x5558d212b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.180+0000 7fc9a1400640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d212b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.180+0000 7fc9a1400640 1 -- 172.21.15.100:0/1194299900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d2119c90 msgr2=0x5558d21759a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:29.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.180+0000 7fc9a1400640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d2119c90 0x5558d21759a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.180+0000 7fc9a1400640 1 -- 172.21.15.100:0/1194299900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558d20095a0 con 0x5558d2118240 2024-02-21T07:50:29.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.181+0000 7fc9a1400640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 0x5558d209cdf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5558d20dfcb0 tx=0x7fc99000a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad8437d4d0fd9b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:29.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.181+0000 7fc97ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:29.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.181+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900b9ad0 con 0x5558d2118240 2024-02-21T07:50:29.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.182+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc9900c22a0 con 0x5558d2118240 2024-02-21T07:50:29.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.182+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9900c2730 con 0x5558d2118240 2024-02-21T07:50:29.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.182+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9900c2460 con 0x5558d2118240 2024-02-21T07:50:29.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.182+0000 7fc9a7404740 10 client.5898 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:29.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.183+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5558d1fa5ab0 con 0x5558d2118240 2024-02-21T07:50:29.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.183+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900c2730 con 0x5558d2118240 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.183+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc990051020 con 0x5558d2118240 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.184+0000 7fc9a7404740 10 client.5898 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.184+0000 7fc9a7404740 10 client.5898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.184+0000 7fc9a7404740 20 client.5898 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.185+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d2176030 0x5558d20e9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.185+0000 7fc9a7404740 4 client.5898 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:50:29.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.185+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5558d1d96890 con 0x5558d2176030 2024-02-21T07:50:29.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.185+0000 7fc9a1e00640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d2176030 0x5558d20e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:29.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.187+0000 7fc9a1e00640 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d2176030 0x5558d20e9810 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8e9a83364a0ba6f server_cookie=f4dec7dbc8af26e8 in_seq=0 out_seq=0 2024-02-21T07:50:29.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.187+0000 7fc97ea00640 10 client.5898 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.192+0000 7fc97ea00640 1 -- 172.21.15.100:0/1194299900 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5558d1d96890 con 0x5558d2176030 2024-02-21T07:50:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.192+0000 7fc97ea00640 10 client.5898 handle_command_reply: tid=0 2024-02-21T07:50:29.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.192+0000 7fc9a7404740 1 client.5898 shutdown 2024-02-21T07:50:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.193+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 msgr2=0x5558d209cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.193+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 0x5558d209cdf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x5558d20dfcb0 tx=0x7fc99000a0e0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 shutdown_connections 2024-02-21T07:50:29.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558d2176030 0x5558d20e9810 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558d2119c90 0x5558d21759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558d2118240 0x5558d209cdf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 --2- 172.21.15.100:0/1194299900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558d211a590 0x5558d212b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.194+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 >> 172.21.15.100:0/1194299900 conn(0x5558d20deec0 msgr2=0x5558d20d7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.199+0000 7fc97ea00640 0 client.5898 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:29.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.199+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 shutdown_connections 2024-02-21T07:50:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.199+0000 7fc9a7404740 1 -- 172.21.15.100:0/1194299900 wait complete. 2024-02-21T07:50:29.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.199+0000 7fc9a7404740 20 client.5898 trim_cache size 0 max 16384 2024-02-21T07:50:29.204 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:50:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.201+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 msgr2=0x7fc9800a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.202+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 0x7fc9800a16b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x5558d20a1210 tx=0x7fc98c009040 comp rx=0 tx=0).stop 2024-02-21T07:50:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.202+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 msgr2=0x7fc99c218170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:29.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.202+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 0x7fc99c218170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc990034000 tx=0x7fc9900046c0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 shutdown_connections 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc99c185df0 0x7fc99c2186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc99c17e970 0x7fc99c218170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc98009f1f0 0x7fc9800a16b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 --2- 172.21.15.100:0/758660041 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc99c08e630 0x7fc99c16cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 >> 172.21.15.100:0/758660041 conn(0x7fc99c0668b0 msgr2=0x7fc99c0f5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 shutdown_connections 2024-02-21T07:50:29.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:29.204+0000 7fc9a4800640 1 -- 172.21.15.100:0/758660041 wait complete. 2024-02-21T07:50:30.238 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:50:30.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:50:30.239 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:50:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.629+0000 7f682b400640 1 Processor -- start 2024-02-21T07:50:30.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.629+0000 7f682b400640 1 -- start start 2024-02-21T07:50:30.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.637+0000 7f682b400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68240673d0 0x7f68241820c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.641+0000 7f682b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 0x7f6824185150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.643+0000 7f6828a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68240673d0 0x7f68241820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.643+0000 7f6828a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f68240673d0 0x7f68241820c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35476/0 (socket says 172.21.15.100:35476) 2024-02-21T07:50:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.648+0000 7f682b400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6824183600 con 0x7f6824185cb0 2024-02-21T07:50:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.648+0000 7f682b400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6824187ab0 con 0x7f68241831c0 2024-02-21T07:50:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.648+0000 7f682b400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6824186bc0 con 0x7f68240673d0 2024-02-21T07:50:30.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.648+0000 7f6823e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 0x7f6824185150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.650+0000 7f6829400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6824185cb0 0x7f6824186110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:56292/0 (socket says 172.21.15.100:56292) 2024-02-21T07:50:30.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.651+0000 7f6829400640 1 -- 172.21.15.100:0/4218972330 learned_addr learned my addr 172.21.15.100:0/4218972330 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:30.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.652+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927284357 0 0) 0x7f6824183600 con 0x7f6824185cb0 2024-02-21T07:50:30.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.652+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6808003520 con 0x7f6824185cb0 2024-02-21T07:50:30.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.653+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361134391 0 0) 0x7f6808003520 con 0x7f6824185cb0 2024-02-21T07:50:30.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.653+0000 7f6828a00640 1 -- 172.21.15.100:0/4218972330 >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 msgr2=0x7f6824185150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:30.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.657+0000 7f6828a00640 1 --2- 172.21.15.100:0/4218972330 >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 0x7f6824185150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.657+0000 7f6828a00640 1 -- 172.21.15.100:0/4218972330 >> v1:172.21.15.156:6789/0 conn(0x7f6824185cb0 legacy=0x7f6824186110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.657+0000 7f6828a00640 1 -- 172.21.15.100:0/4218972330 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6824186ea0 con 0x7f68240673d0 2024-02-21T07:50:30.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.658+0000 7f6823e00640 1 --2- 172.21.15.100:0/4218972330 >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 0x7f6824185150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:30.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.668+0000 7f6828a00640 1 --2- 172.21.15.100:0/4218972330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68240673d0 0x7f68241820c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68240cf330 tx=0x7f681402cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ba2ebc99bda687 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.671+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c001a10 con 0x7f68240673d0 2024-02-21T07:50:30.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.671+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681402e6b0 con 0x7f68240673d0 2024-02-21T07:50:30.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.671+0000 7f6823400640 1 -- 172.21.15.100:0/4218972330 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c001a10 con 0x7f68240673d0 2024-02-21T07:50:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 -- 172.21.15.100:0/4218972330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68240673d0 msgr2=0x7f68241820c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 --2- 172.21.15.100:0/4218972330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68240673d0 0x7f68241820c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68240cf330 tx=0x7f681402cb70 comp rx=0 tx=0).stop 2024-02-21T07:50:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 -- 172.21.15.100:0/4218972330 shutdown_connections 2024-02-21T07:50:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 --2- 172.21.15.100:0/4218972330 >> v2:172.21.15.100:3300/0 conn(0x7f68241831c0 0x7f6824185150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 --2- 172.21.15.100:0/4218972330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68240673d0 0x7f68241820c0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68240cf330 tx=0x7f681402cb70 comp rx=0 tx=0).stop 2024-02-21T07:50:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.673+0000 7f682b400640 1 -- 172.21.15.100:0/4218972330 >> 172.21.15.100:0/4218972330 conn(0x7f68240668b0 msgr2=0x7f6824066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.676+0000 7f682b400640 1 -- 172.21.15.100:0/4218972330 shutdown_connections 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.676+0000 7f682b400640 1 -- 172.21.15.100:0/4218972330 wait complete. 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.685+0000 7f682b400640 1 Processor -- start 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.685+0000 7f682b400640 1 -- start start 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 0x7f6824183fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 0x7f6824228380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f6828a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 0x7f6824183fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f6828a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 0x7f6824183fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48552/0 (socket says 172.21.15.100:48552) 2024-02-21T07:50:30.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68242288c0 0x7f682422d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824184510 con 0x7f6824185cb0 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241793f0 con 0x7f68242288c0 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.687+0000 7f682b400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682422c490 con 0x7f68241831c0 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.688+0000 7f6828a00640 1 -- 172.21.15.100:0/522079229 learned_addr learned my addr 172.21.15.100:0/522079229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.688+0000 7f6823e00640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 0x7f6824228380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.688+0000 7f6829400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68242288c0 0x7f682422d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.689+0000 7f6823e00640 1 -- 172.21.15.100:0/522079229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 msgr2=0x7f6824183fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.689+0000 7f6823e00640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 0x7f6824183fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.689+0000 7f6823e00640 1 -- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68242288c0 msgr2=0x7f682422d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.689+0000 7f6823e00640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68242288c0 0x7f682422d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.689+0000 7f6823e00640 1 -- 172.21.15.100:0/522079229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681400a5a0 con 0x7f6824185cb0 2024-02-21T07:50:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.690+0000 7f6823e00640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 0x7f6824228380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6810014f70 tx=0x7f6810007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.691+0000 7f6820c00640 1 -- 172.21.15.100:0/522079229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6810017070 con 0x7f6824185cb0 2024-02-21T07:50:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.691+0000 7f6820c00640 1 -- 172.21.15.100:0/522079229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6810007cd0 con 0x7f6824185cb0 2024-02-21T07:50:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.691+0000 7f6820c00640 1 -- 172.21.15.100:0/522079229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6810012ea0 con 0x7f6824185cb0 2024-02-21T07:50:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.691+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682422c770 con 0x7f6824185cb0 2024-02-21T07:50:30.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.692+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682422cd30 con 0x7f6824185cb0 2024-02-21T07:50:30.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.702+0000 7f682e1e8740 1 Processor -- start 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.703+0000 7f682e1e8740 1 -- start start 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.703+0000 7f6820c00640 1 -- 172.21.15.100:0/522079229 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6810010ae0 con 0x7f6824185cb0 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.705+0000 7f6820c00640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 0x7f68040a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.706+0000 7f6829400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 0x7f68040a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.706+0000 7f6820c00640 1 -- 172.21.15.100:0/522079229 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68100d19b0 con 0x7f6824185cb0 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.706+0000 7f6829400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 0x7f68040a1610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f681c0012e0 tx=0x7f681c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.709+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 0x55ef011ff5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.709+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 0x55ef0123a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.709+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f682e1e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef0117f300 con 0x55ef011ffae0 2024-02-21T07:50:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f682e1e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef01131e50 con 0x55ef0123a890 2024-02-21T07:50:30.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f682e1e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef0112f380 con 0x55ef011ff1c0 2024-02-21T07:50:30.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f6829400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f6829400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35506/0 (socket says 172.21.15.100:35506) 2024-02-21T07:50:30.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.710+0000 7f6829400640 1 -- 172.21.15.100:0/3010723688 learned_addr learned my addr 172.21.15.100:0/3010723688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:30.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.711+0000 7f6829400640 1 -- 172.21.15.100:0/3010723688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 msgr2=0x55ef011ff5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:30.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.711+0000 7f6823e00640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 0x55ef0123a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.711+0000 7f6828a00640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 0x55ef011ff5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.714+0000 7f6829400640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 0x55ef011ff5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.714+0000 7f6829400640 1 -- 172.21.15.100:0/3010723688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 msgr2=0x55ef0123a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:30.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.714+0000 7f6829400640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 0x55ef0123a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.714+0000 7f6829400640 1 -- 172.21.15.100:0/3010723688 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef010f3c80 con 0x55ef0123a890 2024-02-21T07:50:30.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.715+0000 7f6829400640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f681c013580 tx=0x7f681c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bee00e17d415ca3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.717+0000 7f6828a00640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 0x55ef011ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:30.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.718+0000 7f6823e00640 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 0x55ef0123a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.721+0000 7f6819200640 1 -- 172.21.15.100:0/3010723688 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c012560 con 0x55ef0123a890 2024-02-21T07:50:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.721+0000 7f6819200640 1 -- 172.21.15.100:0/3010723688 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c0126c0 con 0x55ef0123a890 2024-02-21T07:50:30.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.721+0000 7f6819200640 1 -- 172.21.15.100:0/3010723688 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c012a30 con 0x55ef0123a890 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 -- 172.21.15.100:0/3010723688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 msgr2=0x55ef0123b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f681c013580 tx=0x7f681c013000 comp rx=0 tx=0).stop 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 -- 172.21.15.100:0/3010723688 shutdown_connections 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef0123b620 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef011ffae0 0x55ef0123a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3010723688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ff1c0 0x55ef011ff5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.724+0000 7f682e1e8740 1 -- 172.21.15.100:0/3010723688 >> 172.21.15.100:0/3010723688 conn(0x55ef011c1790 msgr2=0x55ef011c2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.725+0000 7f682e1e8740 1 -- 172.21.15.100:0/3010723688 shutdown_connections 2024-02-21T07:50:30.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.726+0000 7f682e1e8740 1 -- 172.21.15.100:0/3010723688 wait complete. 2024-02-21T07:50:30.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.727+0000 7f682e1e8740 1 -- start start 2024-02-21T07:50:30.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.727+0000 7f682e1e8740 1 Processor -- start 2024-02-21T07:50:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.731+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.731+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef011f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f682e1e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef0112ab60 con 0x55ef01243b20 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f682e1e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef010cffd0 con 0x55ef0123a890 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f682e1e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef010cfc70 con 0x55ef011ffae0 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f682e1e8740 10 client.0 _ll_register_callbacks cb 0x55ef00e3bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f6829400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f6829400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43604/0 (socket says 172.21.15.100:43604) 2024-02-21T07:50:30.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.732+0000 7f6829400640 1 -- 172.21.15.100:0/2720037401 learned_addr learned my addr 172.21.15.100:0/2720037401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6828a00640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 -- 172.21.15.100:0/2720037401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 msgr2=0x55ef011ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011ea270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 -- 172.21.15.100:0/2720037401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 msgr2=0x55ef011f5e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef011f5e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 -- 172.21.15.100:0/2720037401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c001e30 con 0x55ef01243b20 2024-02-21T07:50:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.733+0000 7f6829400640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f681c013d50 tx=0x7f681c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbacb1edbefb588f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.734+0000 7f680d600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.734+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c020630 con 0x55ef01243b20 2024-02-21T07:50:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.734+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f681c01b050 con 0x55ef01243b20 2024-02-21T07:50:30.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.735+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef00e2a860 con 0x55ef01243b20 2024-02-21T07:50:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.735+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f681c020790 con 0x55ef01243b20 2024-02-21T07:50:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.736+0000 7f682e1e8740 10 client.5904 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:30.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.736+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ef011291e0 con 0x55ef01243b20 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.736+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef00e2a860 con 0x55ef01243b20 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.737+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f681c012070 con 0x55ef01243b20 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.737+0000 7f682e1e8740 10 client.5904 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.737+0000 7f682e1e8740 10 client.5904 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.737+0000 7f682e1e8740 20 client.5904 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:30.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.737+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01241920 0x55ef011bd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.738+0000 7f682e1e8740 4 client.5904 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:30.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.738+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef00e7b410 con 0x55ef01241920 2024-02-21T07:50:30.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.738+0000 7f6828a00640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01241920 0x55ef011bd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.739+0000 7f6828a00640 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01241920 0x55ef011bd870 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61db1cb56934f52 server_cookie=6a5be73945e4b6d1 in_seq=0 out_seq=0 2024-02-21T07:50:30.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.739+0000 7f680d600640 10 client.5904 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:30.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.741+0000 7f680d600640 1 -- 172.21.15.100:0/2720037401 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ef00e7b410 con 0x55ef01241920 2024-02-21T07:50:30.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.741+0000 7f680d600640 10 client.5904 handle_command_reply: tid=0 2024-02-21T07:50:30.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.741+0000 7f682e1e8740 1 client.5904 shutdown 2024-02-21T07:50:30.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.744+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 msgr2=0x55ef011bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.744+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f681c013d50 tx=0x7f681c001250 comp rx=0 tx=0).stop 2024-02-21T07:50:30.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 shutdown_connections 2024-02-21T07:50:30.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01241920 0x55ef011bd870 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef01243b20 0x55ef011bce60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef0123a890 0x55ef011f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 --2- 172.21.15.100:0/2720037401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.748+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 >> 172.21.15.100:0/2720037401 conn(0x55ef011ff1c0 msgr2=0x55ef011c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.750+0000 7f680d600640 0 client.5904 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.751+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 shutdown_connections 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.751+0000 7f682e1e8740 1 -- 172.21.15.100:0/2720037401 wait complete. 2024-02-21T07:50:30.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.753+0000 7f682e1e8740 20 client.5904 trim_cache size 0 max 16384 2024-02-21T07:50:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.800+0000 7f682e1e8740 1 Processor -- start 2024-02-21T07:50:30.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.800+0000 7f682e1e8740 1 -- start start 2024-02-21T07:50:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.803+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef011ffae0 0x55ef01238810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.803+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.804+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef01243b20 0x55ef011f8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.804+0000 7f682e1e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef00e730c0 con 0x55ef0123a890 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.804+0000 7f682e1e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef01239330 con 0x55ef011ffae0 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.804+0000 7f682e1e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef01238d50 con 0x55ef01243b20 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.804+0000 7f6823e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.805+0000 7f6823e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43608/0 (socket says 172.21.15.100:43608) 2024-02-21T07:50:30.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.805+0000 7f6823e00640 1 -- 172.21.15.100:0/497172241 learned_addr learned my addr 172.21.15.100:0/497172241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.806+0000 7f6823e00640 1 -- 172.21.15.100:0/497172241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef01243b20 msgr2=0x55ef011f8390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.806+0000 7f6823e00640 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef01243b20 0x55ef011f8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.806+0000 7f6823e00640 1 -- 172.21.15.100:0/497172241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef011ffae0 msgr2=0x55ef01238810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:50:30.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.806+0000 7f6823e00640 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef011ffae0 0x55ef01238810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.806+0000 7f6823e00640 1 -- 172.21.15.100:0/497172241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef010c5a90 con 0x55ef0123a890 2024-02-21T07:50:30.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.807+0000 7f6823e00640 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e790ca1607604bf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.807+0000 7f680fe00640 1 -- 172.21.15.100:0/497172241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681009f490 con 0x55ef0123a890 2024-02-21T07:50:30.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.807+0000 7f680fe00640 1 -- 172.21.15.100:0/497172241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100a35e0 con 0x55ef0123a890 2024-02-21T07:50:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.808+0000 7f680fe00640 1 -- 172.21.15.100:0/497172241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681009f490 con 0x55ef0123a890 2024-02-21T07:50:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.808+0000 7f682e1e8740 1 -- 172.21.15.100:0/497172241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 msgr2=0x55ef011c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.808+0000 7f682e1e8740 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6810000c00 tx=0x7f6810007e40 comp rx=0 tx=0).stop 2024-02-21T07:50:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.809+0000 7f682e1e8740 1 -- 172.21.15.100:0/497172241 shutdown_connections 2024-02-21T07:50:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.809+0000 7f682e1e8740 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef01243b20 0x55ef011f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.809+0000 7f682e1e8740 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011c0bb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.809+0000 7f682e1e8740 1 --2- 172.21.15.100:0/497172241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef011ffae0 0x55ef01238810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.809+0000 7f682e1e8740 1 -- 172.21.15.100:0/497172241 >> 172.21.15.100:0/497172241 conn(0x55ef011ff1c0 msgr2=0x55ef011ea080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.810+0000 7f682e1e8740 1 -- 172.21.15.100:0/497172241 shutdown_connections 2024-02-21T07:50:30.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.810+0000 7f682e1e8740 1 -- 172.21.15.100:0/497172241 wait complete. 2024-02-21T07:50:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.811+0000 7f682e1e8740 1 -- start start 2024-02-21T07:50:30.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.812+0000 7f682e1e8740 1 Processor -- start 2024-02-21T07:50:30.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef01243b20 0x55ef011f8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef011c8000 con 0x55ef0123a890 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef011f85b0 con 0x55ef01243b20 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef01239690 con 0x55ef011ffae0 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.814+0000 7f682e1e8740 10 client.0 _ll_register_callbacks cb 0x7f681c007ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.816+0000 7f6823e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.816+0000 7f6823e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43618/0 (socket says 172.21.15.100:43618) 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.816+0000 7f6823e00640 1 -- 172.21.15.100:0/3846526523 learned_addr learned my addr 172.21.15.100:0/3846526523 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.817+0000 7f6823e00640 1 -- 172.21.15.100:0/3846526523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 msgr2=0x55ef011e9e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.817+0000 7f6823e00640 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011e9e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.817+0000 7f6823e00640 1 -- 172.21.15.100:0/3846526523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef01243b20 msgr2=0x55ef011f8070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.817+0000 7f6823e00640 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef01243b20 0x55ef011f8070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.817+0000 7f6823e00640 1 -- 172.21.15.100:0/3846526523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682422cd30 con 0x55ef0123a890 2024-02-21T07:50:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.818+0000 7f6823e00640 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f681009f190 tx=0x7f68100cf220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775ded6011a0806f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:30.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.818+0000 7f680d600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:30.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.826+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681009f510 con 0x55ef0123a890 2024-02-21T07:50:30.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.827+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68100cf460 con 0x55ef0123a890 2024-02-21T07:50:30.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.827+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f681c0126c0 con 0x55ef0123a890 2024-02-21T07:50:30.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.828+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f681009bb00 con 0x55ef0123a890 2024-02-21T07:50:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.830+0000 7f682e1e8740 10 client.5910 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:30.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.830+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ef010eb6a0 con 0x55ef0123a890 2024-02-21T07:50:30.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.831+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100cc080 con 0x55ef0123a890 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f68100b8060 con 0x55ef0123a890 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 10 client.5910 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 10 client.5910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 20 client.5910 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01239ea0 0x55ef011bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 4 client.5910 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:50:30.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.833+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ef00e677b0 con 0x55ef01239ea0 2024-02-21T07:50:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.835+0000 7f6828a00640 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01239ea0 0x55ef011bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.836+0000 7f680d600640 10 client.5910 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.836+0000 7f6828a00640 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01239ea0 0x55ef011bdf10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87933c9c8895f159 server_cookie=132907e088e47db3 in_seq=0 out_seq=0 2024-02-21T07:50:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.838+0000 7f680d600640 1 -- 172.21.15.100:0/3846526523 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ef00e677b0 con 0x55ef01239ea0 2024-02-21T07:50:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.838+0000 7f680d600640 10 client.5910 handle_command_reply: tid=0 2024-02-21T07:50:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.838+0000 7f682e1e8740 1 client.5910 shutdown 2024-02-21T07:50:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 msgr2=0x55ef011be6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f681009f190 tx=0x7f68100cf220 comp rx=0 tx=0).stop 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 shutdown_connections 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ef01239ea0 0x55ef011bdf10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef01243b20 0x55ef011f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ef0123a890 0x55ef011be6e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 --2- 172.21.15.100:0/3846526523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ef011ffae0 0x55ef011e9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 >> 172.21.15.100:0/3846526523 conn(0x55ef011ff1c0 msgr2=0x55ef011bff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f680d600640 0 client.5910 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 shutdown_connections 2024-02-21T07:50:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 1 -- 172.21.15.100:0/3846526523 wait complete. 2024-02-21T07:50:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.839+0000 7f682e1e8740 20 client.5910 trim_cache size 0 max 16384 2024-02-21T07:50:30.848 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:50:30.848 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:50:30.848 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "c3e29a95-fc2b-4569-844a-9b107c3006db", 2024-02-21T07:50:30.848 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:50:30.848 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.841+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 msgr2=0x7f68040a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.841+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 0x7f68040a1610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f681c0012e0 tx=0x7f681c007e30 comp rx=0 tx=0).stop 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.841+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 msgr2=0x7f6824228380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.841+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 0x7f6824228380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6810014f70 tx=0x7f6810007410 comp rx=0 tx=0).stop 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.841+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 shutdown_connections 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.842+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68242288c0 0x7f682422d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.842+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f680409f150 0x7f68040a1610 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.842+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6824185cb0 0x7f6824228380 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.842+0000 7f682b400640 1 --2- 172.21.15.100:0/522079229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68241831c0 0x7f6824183fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.842+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 >> 172.21.15.100:0/522079229 conn(0x7f68240668b0 msgr2=0x7f6824066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.844+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 shutdown_connections 2024-02-21T07:50:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:30.845+0000 7f682b400640 1 -- 172.21.15.100:0/522079229 wait complete. 2024-02-21T07:50:30.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:50:30.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.251+0000 7f2ae1e00640 1 Processor -- start 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.251+0000 7f2ae1e00640 1 -- start start 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.254+0000 7f2ae1e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2adc17e970 0x7f2adc070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.254+0000 7f2ae1e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0f4760 con 0x7f2adc070bb0 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.254+0000 7f2ae1e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0f49b0 con 0x7f2adc186500 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.254+0000 7f2ae1e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc185910 con 0x7f2adc17e970 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.255+0000 7f2adb400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f2adc186500 0x7f2adc06da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:39800/0 (socket says 172.21.15.100:39800) 2024-02-21T07:50:31.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.255+0000 7f2adb400640 1 -- 172.21.15.100:0/1162860550 learned_addr learned my addr 172.21.15.100:0/1162860550 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.255+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1162860550 >> v2:172.21.15.170:3300/0 conn(0x7f2adc17e970 0x7f2adc070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.255+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3450241208 0 0) 0x7f2adc0f49b0 con 0x7f2adc186500 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.256+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003520 con 0x7f2adc186500 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2843230609 0 0) 0x7f2ac0003520 con 0x7f2adc186500 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 >> v2:172.21.15.170:3300/0 conn(0x7f2adc17e970 msgr2=0x7f2adc070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 --2- 172.21.15.100:0/1162860550 >> v2:172.21.15.170:3300/0 conn(0x7f2adc17e970 0x7f2adc070670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 >> v1:172.21.15.156:6789/0 conn(0x7f2adc070bb0 legacy=0x7f2adc185df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0f4c90 con 0x7f2adc186500 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f2ad40019f0 con 0x7f2adc186500 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 >> v1:172.21.15.170:6789/0 conn(0x7f2adc186500 legacy=0x7f2adc06da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00039c0 0x7f2ac0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac00047c0 0x7f2ac0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 0x7f2ac000ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc185910 con 0x7f2ac00047c0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0010530 con 0x7f2ac00039c0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.257+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bb80 con 0x7f2ac00051d0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.258+0000 7f2adb400640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 0x7f2ac000ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00039c0 0x7f2ac0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adb400640 1 -- 172.21.15.100:0/1162860550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00039c0 msgr2=0x7f2ac0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2ada000640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac00047c0 0x7f2ac0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adb400640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00039c0 0x7f2ac0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adb400640 1 -- 172.21.15.100:0/1162860550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac00047c0 msgr2=0x7f2ac0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adb400640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac00047c0 0x7f2ac0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.259+0000 7f2adb400640 1 -- 172.21.15.100:0/1162860550 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0f4c90 con 0x7f2ac00051d0 2024-02-21T07:50:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.261+0000 7f2ada000640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac00047c0 0x7f2ac0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.261+0000 7f2adb400640 1 -- 172.21.15.100:0/1162860550 reap_dead start 2024-02-21T07:50:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.261+0000 7f2adb400640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 0x7f2ac000ff90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400a830 tx=0x7f2ac00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df1c439ff4c9e198 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.262+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4034630 con 0x7f2ac00051d0 2024-02-21T07:50:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.263+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad402f070 con 0x7f2ac00051d0 2024-02-21T07:50:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.263+0000 7f2ad9600640 1 -- 172.21.15.100:0/1162860550 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40349d0 con 0x7f2ac00051d0 2024-02-21T07:50:31.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.264+0000 7f2ae1e00640 1 -- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 msgr2=0x7f2ac000ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.265+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 0x7f2ac000ff90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400a830 tx=0x7f2ac00057f0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.265+0000 7f2ae1e00640 1 -- 172.21.15.100:0/1162860550 shutdown_connections 2024-02-21T07:50:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.265+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/1162860550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ac00051d0 0x7f2ac000ff90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.265+0000 7f2ae1e00640 1 -- 172.21.15.100:0/1162860550 >> 172.21.15.100:0/1162860550 conn(0x7f2adc0668b0 msgr2=0x7f2adc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.266+0000 7f2ae1e00640 1 -- 172.21.15.100:0/1162860550 shutdown_connections 2024-02-21T07:50:31.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.266+0000 7f2ae1e00640 1 -- 172.21.15.100:0/1162860550 wait complete. 2024-02-21T07:50:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.270+0000 7f2ae1e00640 1 Processor -- start 2024-02-21T07:50:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.270+0000 7f2ae1e00640 1 -- start start 2024-02-21T07:50:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00051d0 0x7f2adc15cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2adc0f8ea0 0x7f2adc0f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0f8a10 con 0x7f2adc0f8ea0 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc187890 con 0x7f2ac00051d0 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.272+0000 7f2ae1e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc187b70 con 0x7f2adc0f9860 2024-02-21T07:50:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48606/0 (socket says 172.21.15.100:48606) 2024-02-21T07:50:31.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 -- 172.21.15.100:0/465067035 learned_addr learned my addr 172.21.15.100:0/465067035 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 -- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00051d0 msgr2=0x7f2adc15cb50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:50:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00051d0 0x7f2adc15cb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 -- 172.21.15.100:0/465067035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2adc0f8ea0 msgr2=0x7f2adc0f9320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:50:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2adc0f8ea0 0x7f2adc0f9320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.273+0000 7f2adb400640 1 -- 172.21.15.100:0/465067035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0f83c0 con 0x7f2adc0f9860 2024-02-21T07:50:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2adb400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400a830 tx=0x7f2ad402e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2ad3400640 1 -- 172.21.15.100:0/465067035 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4034840 con 0x7f2adc0f9860 2024-02-21T07:50:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2ad3400640 1 -- 172.21.15.100:0/465067035 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad40019e0 con 0x7f2adc0f9860 2024-02-21T07:50:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0f86a0 con 0x7f2adc0f9860 2024-02-21T07:50:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2ad3400640 1 -- 172.21.15.100:0/465067035 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4034ba0 con 0x7f2adc0f9860 2024-02-21T07:50:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.274+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc15d090 con 0x7f2adc0f9860 2024-02-21T07:50:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.281+0000 7f2ae4a18740 1 Processor -- start 2024-02-21T07:50:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.284+0000 7f2ad3400640 1 -- 172.21.15.100:0/465067035 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2ad4031030 con 0x7f2adc0f9860 2024-02-21T07:50:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.285+0000 7f2ae4a18740 1 -- start start 2024-02-21T07:50:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.288+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.288+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa38e0 0x5625b0a65ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b09da150 con 0x5625b0aa38e0 2024-02-21T07:50:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b09d7680 con 0x5625b0aa2fc0 2024-02-21T07:50:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b09d2e60 con 0x5625b0ad8f80 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ada000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ada000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35566/0 (socket says 172.21.15.100:35566) 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48616/0 (socket says 172.21.15.100:48616) 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.289+0000 7f2ada000640 1 -- 172.21.15.100:0/1236651185 learned_addr learned my addr 172.21.15.100:0/1236651185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.290+0000 7f2ada000640 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa38e0 0x5625b0a65ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.291+0000 7f2ad3400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 0x7f2abc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.291+0000 7f2ad3400640 1 -- 172.21.15.100:0/465067035 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ad40eb5a0 con 0x7f2adc0f9860 2024-02-21T07:50:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adaa00640 1 -- 172.21.15.100:0/1236651185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 msgr2=0x5625b0ad8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adaa00640 1 -- 172.21.15.100:0/1236651185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa38e0 msgr2=0x5625b0a65ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa38e0 0x5625b0a65ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adaa00640 1 -- 172.21.15.100:0/1236651185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625b098c060 con 0x5625b0ad8f80 2024-02-21T07:50:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.293+0000 7f2adb400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 0x7f2abc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.294+0000 7f2adb400640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 0x7f2abc0a1560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40021f0 tx=0x7f2ad4001f60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.294+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098d0 tx=0x7f2acc009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=904eee1c9aabc94e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.294+0000 7f2ac7400640 1 -- 172.21.15.100:0/1236651185 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0042f0 con 0x5625b0ad8f80 2024-02-21T07:50:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.294+0000 7f2ac7400640 1 -- 172.21.15.100:0/1236651185 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc004450 con 0x5625b0ad8f80 2024-02-21T07:50:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.294+0000 7f2ac7400640 1 -- 172.21.15.100:0/1236651185 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc011a00 con 0x5625b0ad8f80 2024-02-21T07:50:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.296+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1236651185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 msgr2=0x5625b0aa33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.296+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0098d0 tx=0x7f2acc009190 comp rx=0 tx=0).stop 2024-02-21T07:50:31.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.297+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1236651185 shutdown_connections 2024-02-21T07:50:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.297+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa38e0 0x5625b0a65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.297+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0ad8f80 0x5625b0aa33a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.297+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1236651185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.297+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1236651185 >> 172.21.15.100:0/1236651185 conn(0x5625b0a325a0 msgr2=0x5625b0a69eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.298+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1236651185 shutdown_connections 2024-02-21T07:50:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.298+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1236651185 wait complete. 2024-02-21T07:50:31.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.299+0000 7f2ae4a18740 1 -- start start 2024-02-21T07:50:31.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.299+0000 7f2ae4a18740 1 Processor -- start 2024-02-21T07:50:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.301+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0a98d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.301+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a65e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a65e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a65e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35574/0 (socket says 172.21.15.100:35574) 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2ada000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2ada000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43642/0 (socket says 172.21.15.100:43642) 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2adaa00640 1 -- 172.21.15.100:0/1741822310 learned_addr learned my addr 172.21.15.100:0/1741822310 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.302+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0977ec0 con 0x5625b0ad8f80 2024-02-21T07:50:31.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.303+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0977b60 con 0x5625b0aa38e0 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.303+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b07411c0 con 0x5625b0aa2fc0 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.303+0000 7f2ae4a18740 10 client.0 _ll_register_callbacks cb 0x5625b098b960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.303+0000 7f2ada000640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0a98d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 -- 172.21.15.100:0/1741822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 msgr2=0x5625b0a98d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0a98d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 -- 172.21.15.100:0/1741822310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 msgr2=0x5625b0a65e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a65e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc009550 con 0x5625b0ad8f80 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.304+0000 7f2ada000640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2ac801bd60 tx=0x7f2ac8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8f1e4f11e4e643 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.305+0000 7f2abbe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.305+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8005080 con 0x5625b0ad8f80 2024-02-21T07:50:31.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.305+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ac80051e0 con 0x5625b0ad8f80 2024-02-21T07:50:31.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.306+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625b06d27e0 con 0x5625b0ad8f80 2024-02-21T07:50:31.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.311+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ac80053a0 con 0x5625b0ad8f80 2024-02-21T07:50:31.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.317+0000 7f2ae4a18740 10 client.5916 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:31.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.317+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5625b09d14e0 con 0x5625b0ad8f80 2024-02-21T07:50:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.320+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625b06d27e0 con 0x5625b0ad8f80 2024-02-21T07:50:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.322+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ac8007030 con 0x5625b0ad8f80 2024-02-21T07:50:31.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.322+0000 7f2ae4a18740 10 client.5916 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.323+0000 7f2ae4a18740 10 client.5916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:31.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.323+0000 7f2ae4a18740 20 client.5916 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.323+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0aa2890 0x5625b0aab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.323+0000 7f2ae4a18740 4 client.5916 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:31.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.323+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625b070f720 con 0x5625b0aa2890 2024-02-21T07:50:31.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.330+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0aa2890 0x5625b0aab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.331+0000 7f2adaa00640 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0aa2890 0x5625b0aab650 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68ca476f4d0826d1 server_cookie=9fbe1499f17f31ea in_seq=0 out_seq=0 2024-02-21T07:50:31.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.331+0000 7f2abbe00640 10 client.5916 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.333+0000 7f2abbe00640 1 -- 172.21.15.100:0/1741822310 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625b070f720 con 0x5625b0aa2890 2024-02-21T07:50:31.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.333+0000 7f2abbe00640 10 client.5916 handle_command_reply: tid=0 2024-02-21T07:50:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.333+0000 7f2ae4a18740 1 client.5916 shutdown 2024-02-21T07:50:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.333+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 msgr2=0x5625b0a66570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.334+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2ac801bd60 tx=0x7f2ac8001120 comp rx=0 tx=0).stop 2024-02-21T07:50:31.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 shutdown_connections 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0aa2890 0x5625b0aab650 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0a66570 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a65e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/1741822310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0a98d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 >> 172.21.15.100:0/1741822310 conn(0x5625b0a325a0 msgr2=0x5625b0a67b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2abbe00640 0 client.5916 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 shutdown_connections 2024-02-21T07:50:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.335+0000 7f2ae4a18740 1 -- 172.21.15.100:0/1741822310 wait complete. 2024-02-21T07:50:31.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.336+0000 7f2ae4a18740 20 client.5916 trim_cache size 0 max 16384 2024-02-21T07:50:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.360+0000 7f2ae4a18740 1 Processor -- start 2024-02-21T07:50:31.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.360+0000 7f2ae4a18740 1 -- start start 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0ad95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0a68c60 con 0x5625b0ad8f80 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0a02bb0 con 0x5625b0aa38e0 2024-02-21T07:50:31.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.362+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0a69370 con 0x5625b0aa2fc0 2024-02-21T07:50:31.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.363+0000 7f2ada000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.363+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.364+0000 7f2adaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35584/0 (socket says 172.21.15.100:35584) 2024-02-21T07:50:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.364+0000 7f2adaa00640 1 -- 172.21.15.100:0/377039155 learned_addr learned my addr 172.21.15.100:0/377039155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.364+0000 7f2ada000640 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0ad95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.364+0000 7f2adaa00640 1 -- 172.21.15.100:0/377039155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 msgr2=0x5625b0ad8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.365+0000 7f2adaa00640 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.365+0000 7f2adaa00640 1 -- 172.21.15.100:0/377039155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 msgr2=0x5625b0ad95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.365+0000 7f2adaa00640 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0ad95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.365+0000 7f2adaa00640 1 -- 172.21.15.100:0/377039155 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625b096d950 con 0x5625b0aa38e0 2024-02-21T07:50:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.365+0000 7f2ada000640 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0ad95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.367+0000 7f2adaa00640 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5625b0add670 tx=0x7f2acc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7953e031003a62 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.367+0000 7f2ac6a00640 1 -- 172.21.15.100:0/377039155 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc024040 con 0x5625b0aa38e0 2024-02-21T07:50:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.368+0000 7f2ac6a00640 1 -- 172.21.15.100:0/377039155 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc009110 con 0x5625b0aa38e0 2024-02-21T07:50:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.368+0000 7f2ac6a00640 1 -- 172.21.15.100:0/377039155 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc011bc0 con 0x5625b0aa38e0 2024-02-21T07:50:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.369+0000 7f2ae4a18740 1 -- 172.21.15.100:0/377039155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 msgr2=0x5625b0a68e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.369+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x5625b0add670 tx=0x7f2acc016000 comp rx=0 tx=0).stop 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 -- 172.21.15.100:0/377039155 shutdown_connections 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0ad8f80 0x5625b0ad95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0aa38e0 0x5625b0a68e30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/377039155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa2fc0 0x5625b0ad8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 -- 172.21.15.100:0/377039155 >> 172.21.15.100:0/377039155 conn(0x5625b0a325a0 msgr2=0x5625b0a98b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 -- 172.21.15.100:0/377039155 shutdown_connections 2024-02-21T07:50:31.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.370+0000 7f2ae4a18740 1 -- 172.21.15.100:0/377039155 wait complete. 2024-02-21T07:50:31.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.372+0000 7f2ae4a18740 1 -- start start 2024-02-21T07:50:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.372+0000 7f2ae4a18740 1 Processor -- start 2024-02-21T07:50:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa2fc0 0x5625b0a68e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 0x5625b0b46150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0b4a330 con 0x5625b0aa2fc0 2024-02-21T07:50:31.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0b494a0 con 0x5625b0ad8f80 2024-02-21T07:50:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625b0b46e20 con 0x5625b0aa38e0 2024-02-21T07:50:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.375+0000 7f2ae4a18740 10 client.0 _ll_register_callbacks cb 0x5625b0add5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.376+0000 7f2ada000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.377+0000 7f2ada000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35596/0 (socket says 172.21.15.100:35596) 2024-02-21T07:50:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.377+0000 7f2ada000640 1 -- 172.21.15.100:0/3565437339 learned_addr learned my addr 172.21.15.100:0/3565437339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.377+0000 7f2adaa00640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 0x5625b0b46150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.378+0000 7f2ada000640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa2fc0 0x5625b0a68e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.378+0000 7f2adaa00640 1 -- 172.21.15.100:0/3565437339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 msgr2=0x5625b0b2ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.378+0000 7f2adaa00640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.378+0000 7f2ada000640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.378+0000 7f2adaa00640 1 -- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa2fc0 msgr2=0x5625b0a68e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.379+0000 7f2adaa00640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa2fc0 0x5625b0a68e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.379+0000 7f2adaa00640 1 -- 172.21.15.100:0/3565437339 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625b098c060 con 0x5625b0aa38e0 2024-02-21T07:50:31.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.379+0000 7f2adaa00640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 0x5625b0b46150 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007000 tx=0x7f2acc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485054dd82a7314d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:31.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.380+0000 7f2abbe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:31.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.380+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc024070 con 0x5625b0aa38e0 2024-02-21T07:50:31.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.380+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2acc005ba0 con 0x5625b0aa38e0 2024-02-21T07:50:31.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.380+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2acc004450 con 0x5625b0aa38e0 2024-02-21T07:50:31.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.381+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2acc030070 con 0x5625b0aa38e0 2024-02-21T07:50:31.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.381+0000 7f2ae4a18740 10 client.6044 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:31.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.381+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5625b0993430 con 0x5625b0aa38e0 2024-02-21T07:50:31.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc02c8f0 con 0x5625b0aa38e0 2024-02-21T07:50:31.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2acc0116e0 con 0x5625b0aa38e0 2024-02-21T07:50:31.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 10 client.6044 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:31.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 10 client.6044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 20 client.6044 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0a65f20 0x5625b0acef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 4 client.6044 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:50:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.387+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f2acc004450 con 0x5625b0a65f20 2024-02-21T07:50:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.388+0000 7f2ada000640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0a65f20 0x5625b0acef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:31.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.391+0000 7f2ada000640 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0a65f20 0x5625b0acef10 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2459e0c27fff284f server_cookie=a343946b467e5c96 in_seq=0 out_seq=0 2024-02-21T07:50:31.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.393+0000 7f2abbe00640 10 client.6044 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:31.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.393+0000 7f2abbe00640 1 -- 172.21.15.100:0/3565437339 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f2acc004450 con 0x5625b0a65f20 2024-02-21T07:50:31.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.393+0000 7f2abbe00640 10 client.6044 handle_command_reply: tid=0 2024-02-21T07:50:31.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 client.6044 shutdown 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 msgr2=0x5625b0b46150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 0x5625b0b46150 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2acc007000 tx=0x7f2acc004730 comp rx=0 tx=0).stop 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 shutdown_connections 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5625b0a65f20 0x5625b0acef10 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625b0ad8f80 0x5625b0b2ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5625b0aa38e0 0x5625b0b46150 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 --2- 172.21.15.100:0/3565437339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5625b0aa2fc0 0x5625b0a68e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2abbe00640 0 client.6044 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.394+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 >> 172.21.15.100:0/3565437339 conn(0x5625b0a325a0 msgr2=0x5625b0ad82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.397+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 shutdown_connections 2024-02-21T07:50:31.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.397+0000 7f2ae4a18740 1 -- 172.21.15.100:0/3565437339 wait complete. 2024-02-21T07:50:31.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.398+0000 7f2ae4a18740 20 client.6044 trim_cache size 0 max 16384 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "c3e29a95-fc2b-4569-844a-9b107c3006db": { 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "c3e29a95-fc2b-4569-844a-9b107c3006db", 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:50:31.404 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:50:31.405 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:50:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.402+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 msgr2=0x7f2abc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.402+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 0x7f2abc0a1560 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40021f0 tx=0x7f2ad4001f60 comp rx=0 tx=0).stop 2024-02-21T07:50:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.402+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 msgr2=0x7f2adc186940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.402+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400a830 tx=0x7f2ad402e000 comp rx=0 tx=0).stop 2024-02-21T07:50:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 shutdown_connections 2024-02-21T07:50:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2adc0f9860 0x7f2adc186940 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2abc09f0a0 0x7f2abc0a1560 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2adc0f8ea0 0x7f2adc0f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 --2- 172.21.15.100:0/465067035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ac00051d0 0x7f2adc15cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.403+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 >> 172.21.15.100:0/465067035 conn(0x7f2adc0668b0 msgr2=0x7f2adc06f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:31.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.404+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 shutdown_connections 2024-02-21T07:50:31.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:50:31.405+0000 7f2ae1e00640 1 -- 172.21.15.100:0/465067035 wait complete. 2024-02-21T07:50:31.427 INFO:tasks.cephfs.filesystem:scrub status for tag:c3e29a95-fc2b-4569-844a-9b107c3006db - {'path': '/', 'tag': 'c3e29a95-fc2b-4569-844a-9b107c3006db', 'options': 'recursive,force'} 2024-02-21T07:50:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.741+0000 7fb48de00640 1 Processor -- start 2024-02-21T07:50:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.741+0000 7fb48de00640 1 -- start start 2024-02-21T07:50:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.745+0000 7fb48de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb488185440 0x7fb4880cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.748 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.745+0000 7fb48de00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb488185f30 0x7fb4880d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.749+0000 7fb48de00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880cd500 con 0x7fb4880cc4f0 2024-02-21T07:50:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.749+0000 7fb48de00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4881863a0 con 0x7fb488185440 2024-02-21T07:50:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.749+0000 7fb48de00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880cc980 con 0x7fb488185f30 2024-02-21T07:50:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.749+0000 7fb486000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb4880cc4f0 0x7fb488185820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37226/0 (socket says 172.21.15.100:37226) 2024-02-21T07:50:41.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.749+0000 7fb486000640 1 -- 172.21.15.100:0/1365192881 learned_addr learned my addr 172.21.15.100:0/1365192881 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.750+0000 7fb486a00640 1 --2- 172.21.15.100:0/1365192881 >> v2:172.21.15.156:3300/0 conn(0x7fb488185440 0x7fb4880cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.750+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283051228 0 0) 0x7fb4880cd500 con 0x7fb4880cc4f0 2024-02-21T07:50:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.750+0000 7fb487400640 1 --2- 172.21.15.100:0/1365192881 >> v2:172.21.15.170:3300/0 conn(0x7fb488185f30 0x7fb4880d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.750+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46c005730 con 0x7fb4880cc4f0 2024-02-21T07:50:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486645617 0 0) 0x7fb46c005730 con 0x7fb4880cc4f0 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 >> v2:172.21.15.170:3300/0 conn(0x7fb488185f30 msgr2=0x7fb4880d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 --2- 172.21.15.100:0/1365192881 >> v2:172.21.15.170:3300/0 conn(0x7fb488185f30 0x7fb4880d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 >> v2:172.21.15.156:3300/0 conn(0x7fb488185440 msgr2=0x7fb4880cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 --2- 172.21.15.100:0/1365192881 >> v2:172.21.15.156:3300/0 conn(0x7fb488185440 0x7fb4880cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880ccc60 con 0x7fb4880cc4f0 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fb4780019f0 con 0x7fb4880cc4f0 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 >> v1:172.21.15.170:6789/0 conn(0x7fb4880cc4f0 legacy=0x7fb488185820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.756 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb46c005bd0 0x7fb46c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb46c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb46c007390 0x7fb46c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881863a0 con 0x7fb46c005bd0 2024-02-21T07:50:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.752+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880cc980 con 0x7fb46c007390 2024-02-21T07:50:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.753+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c0035a0 con 0x7fb46c0069d0 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.753+0000 7fb486000640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb46c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.753+0000 7fb486a00640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb46c005bd0 0x7fb46c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.754+0000 7fb486000640 1 -- 172.21.15.100:0/1365192881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb46c007390 msgr2=0x7fb46c00db90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.754+0000 7fb486000640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb46c007390 0x7fb46c00db90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.754+0000 7fb486000640 1 -- 172.21.15.100:0/1365192881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb46c005bd0 msgr2=0x7fb46c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.754+0000 7fb486000640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb46c005bd0 0x7fb46c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.754+0000 7fb486000640 1 -- 172.21.15.100:0/1365192881 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880ccc60 con 0x7fb46c0069d0 2024-02-21T07:50:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.755+0000 7fb487400640 1 -- 172.21.15.100:0/1365192881 reap_dead start 2024-02-21T07:50:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.755+0000 7fb486a00640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb46c005bd0 0x7fb46c005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.756+0000 7fb486000640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb46c006e50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb47800a8a0 tx=0x7fb46c007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8aa91b849e2a582 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.756+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47802cea0 con 0x7fb46c0069d0 2024-02-21T07:50:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.756+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47802f070 con 0x7fb46c0069d0 2024-02-21T07:50:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.756+0000 7fb485600640 1 -- 172.21.15.100:0/1365192881 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780348d0 con 0x7fb46c0069d0 2024-02-21T07:50:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.757+0000 7fb48de00640 1 -- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 msgr2=0x7fb46c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.757+0000 7fb48de00640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb46c006e50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb47800a8a0 tx=0x7fb46c007a00 comp rx=0 tx=0).stop 2024-02-21T07:50:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.758+0000 7fb48de00640 1 -- 172.21.15.100:0/1365192881 shutdown_connections 2024-02-21T07:50:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.758+0000 7fb48de00640 1 --2- 172.21.15.100:0/1365192881 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb46c006e50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.758+0000 7fb48de00640 1 -- 172.21.15.100:0/1365192881 >> 172.21.15.100:0/1365192881 conn(0x7fb4880ce1b0 msgr2=0x7fb4880ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.758+0000 7fb48de00640 1 -- 172.21.15.100:0/1365192881 shutdown_connections 2024-02-21T07:50:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.759+0000 7fb48de00640 1 -- 172.21.15.100:0/1365192881 wait complete. 2024-02-21T07:50:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.763+0000 7fb48de00640 1 Processor -- start 2024-02-21T07:50:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.763+0000 7fb48de00640 1 -- start start 2024-02-21T07:50:41.770 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb48820f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 0x7fb48806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488210b70 con 0x7fb48820fb10 2024-02-21T07:50:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4882102d0 con 0x7fb48816a520 2024-02-21T07:50:41.771 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.767+0000 7fb48de00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4882105b0 con 0x7fb46c0069d0 2024-02-21T07:50:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.769+0000 7fb486000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.769+0000 7fb486000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44960/0 (socket says 172.21.15.100:44960) 2024-02-21T07:50:41.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.769+0000 7fb486000640 1 -- 172.21.15.100:0/2041753011 learned_addr learned my addr 172.21.15.100:0/2041753011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.769+0000 7fb487400640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 0x7fb48806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 -- 172.21.15.100:0/2041753011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 msgr2=0x7fb48820f5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:50:41.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb48820f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 -- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 msgr2=0x7fb48806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 0x7fb48806b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 -- 172.21.15.100:0/2041753011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488210890 con 0x7fb48820fb10 2024-02-21T07:50:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb487400640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 0x7fb48806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.770+0000 7fb486000640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb47802cc30 tx=0x7fb478001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.771+0000 7fb47f400640 1 -- 172.21.15.100:0/2041753011 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478004ea0 con 0x7fb48820fb10 2024-02-21T07:50:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.771+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48806abf0 con 0x7fb48820fb10 2024-02-21T07:50:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.771+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48816a9a0 con 0x7fb48820fb10 2024-02-21T07:50:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.771+0000 7fb47f400640 1 -- 172.21.15.100:0/2041753011 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478034430 con 0x7fb48820fb10 2024-02-21T07:50:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.772+0000 7fb47f400640 1 -- 172.21.15.100:0/2041753011 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4780347c0 con 0x7fb48820fb10 2024-02-21T07:50:41.783 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.780+0000 7fb47f400640 1 -- 172.21.15.100:0/2041753011 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb478031030 con 0x7fb48820fb10 2024-02-21T07:50:41.784 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.781+0000 7fb490c15740 1 Processor -- start 2024-02-21T07:50:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.785+0000 7fb47f400640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 0x7fb4680a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.788 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.785+0000 7fb47f400640 1 -- 172.21.15.100:0/2041753011 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb4780ebc10 con 0x7fb48820fb10 2024-02-21T07:50:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.787+0000 7fb490c15740 1 -- start start 2024-02-21T07:50:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb487400640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 0x7fb4680a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc3f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc44a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dc00620 con 0x55a77dc80070 2024-02-21T07:50:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dbb28c0 con 0x55a77dc44f90 2024-02-21T07:50:41.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.789+0000 7fb490c15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dbafdf0 con 0x55a77dcb44d0 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 0x7fb4680a1610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb48808e040 tx=0x7fb474009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49344/0 (socket says 172.21.15.100:49344) 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 -- 172.21.15.100:0/2941624248 learned_addr learned my addr 172.21.15.100:0/2941624248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb486a00640 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc3f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 -- 172.21.15.100:0/2941624248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 msgr2=0x55a77dc44a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc44a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 -- 172.21.15.100:0/2941624248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 msgr2=0x55a77dc3f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc3f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.790+0000 7fb487400640 1 -- 172.21.15.100:0/2941624248 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77db2cb00 con 0x55a77dc44f90 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.791+0000 7fb487400640 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb474011eb0 tx=0x7fb474014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59596a921562e673 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.791+0000 7fb473400640 1 -- 172.21.15.100:0/2941624248 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474014c90 con 0x55a77dc44f90 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.791+0000 7fb473400640 1 -- 172.21.15.100:0/2941624248 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb474014df0 con 0x55a77dc44f90 2024-02-21T07:50:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.791+0000 7fb473400640 1 -- 172.21.15.100:0/2941624248 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740215f0 con 0x55a77dc44f90 2024-02-21T07:50:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 -- 172.21.15.100:0/2941624248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 msgr2=0x55a77dc80450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb474011eb0 tx=0x7fb474014000 comp rx=0 tx=0).stop 2024-02-21T07:50:41.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 -- 172.21.15.100:0/2941624248 shutdown_connections 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc44f90 0x55a77dc80450 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc44a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 --2- 172.21.15.100:0/2941624248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc3f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 -- 172.21.15.100:0/2941624248 >> 172.21.15.100:0/2941624248 conn(0x55a77dc0c4b0 msgr2=0x55a77dc43ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.792+0000 7fb490c15740 1 -- 172.21.15.100:0/2941624248 shutdown_connections 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.793+0000 7fb490c15740 1 -- 172.21.15.100:0/2941624248 wait complete. 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.793+0000 7fb490c15740 1 -- start start 2024-02-21T07:50:41.797 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.794+0000 7fb490c15740 1 Processor -- start 2024-02-21T07:50:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 0x55a77dc756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc73610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dbab5d0 con 0x55a77dc44f90 2024-02-21T07:50:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77db50b50 con 0x55a77dc80070 2024-02-21T07:50:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77db507f0 con 0x55a77dcb44d0 2024-02-21T07:50:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.796+0000 7fb490c15740 10 client.0 _ll_register_callbacks cb 0x55a77db64550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.797+0000 7fb486a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.797+0000 7fb486a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44968/0 (socket says 172.21.15.100:44968) 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.797+0000 7fb486a00640 1 -- 172.21.15.100:0/1426661529 learned_addr learned my addr 172.21.15.100:0/1426661529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.797+0000 7fb487400640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc73610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.797+0000 7fb486000640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 0x55a77dc756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486a00640 1 -- 172.21.15.100:0/1426661529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 msgr2=0x55a77dc73610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486a00640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc73610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486a00640 1 -- 172.21.15.100:0/1426661529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 msgr2=0x55a77dc756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.802 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486a00640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 0x55a77dc756f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486a00640 1 -- 172.21.15.100:0/1426661529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb474011bf0 con 0x55a77dc44f90 2024-02-21T07:50:41.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.798+0000 7fb486000640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 0x55a77dc756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.801+0000 7fb486a00640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb4800149e0 tx=0x7fb480014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6dc545d9ae987e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.805+0000 7fb467e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.805+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480004300 con 0x55a77dc44f90 2024-02-21T07:50:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.805+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb480004460 con 0x55a77dc44f90 2024-02-21T07:50:41.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.806+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a77db7dcd0 con 0x55a77dc44f90 2024-02-21T07:50:41.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.806+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb480012860 con 0x55a77dc44f90 2024-02-21T07:50:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.806+0000 7fb490c15740 10 client.5928 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.806+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a77dba9c50 con 0x55a77dc44f90 2024-02-21T07:50:41.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.807+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a77db7dcd0 con 0x55a77dc44f90 2024-02-21T07:50:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.807+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb480011040 con 0x55a77dc44f90 2024-02-21T07:50:41.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.807+0000 7fb490c15740 10 client.5928 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.807+0000 7fb490c15740 10 client.5928 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.808+0000 7fb490c15740 20 client.5928 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.808+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dcc4550 0x55a77dcc4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.808+0000 7fb490c15740 4 client.5928 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.808+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a77dba1ce0 con 0x55a77dcc4550 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.808+0000 7fb486000640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dcc4550 0x55a77dcc4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.813 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.809+0000 7fb467e00640 10 client.5928 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.810+0000 7fb486000640 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dcc4550 0x55a77dcc4930 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47badc825adb93c0 server_cookie=82b95c7ca3eac31f in_seq=0 out_seq=0 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb467e00640 1 -- 172.21.15.100:0/1426661529 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a77dba1ce0 con 0x55a77dcc4550 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb467e00640 10 client.5928 handle_command_reply: tid=0 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 client.5928 shutdown 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 msgr2=0x55a77dcaa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb4800149e0 tx=0x7fb480014ea0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 shutdown_connections 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dcc4550 0x55a77dcc4930 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc73610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.816 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dc80070 0x55a77dc756f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb467e00640 0 client.5928 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 --2- 172.21.15.100:0/1426661529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc44f90 0x55a77dcaa470 secure :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb4800149e0 tx=0x7fb480014ea0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.811+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 >> 172.21.15.100:0/1426661529 conn(0x55a77dc0c4b0 msgr2=0x55a77dcb4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.813+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 shutdown_connections 2024-02-21T07:50:41.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.814+0000 7fb490c15740 1 -- 172.21.15.100:0/1426661529 wait complete. 2024-02-21T07:50:41.818 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.814+0000 7fb490c15740 20 client.5928 trim_cache size 0 max 16384 2024-02-21T07:50:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.846+0000 7fb490c15740 1 Processor -- start 2024-02-21T07:50:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.846+0000 7fb490c15740 1 -- start start 2024-02-21T07:50:41.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.848+0000 7fb490c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb486a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb490c15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb490c15740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb486a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44980/0 (socket says 172.21.15.100:44980) 2024-02-21T07:50:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb486a00640 1 -- 172.21.15.100:0/4185926473 learned_addr learned my addr 172.21.15.100:0/4185926473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77d8f3e60 con 0x55a77dc80070 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dc4b4e0 con 0x55a77dca08b0 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.849+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dcb2bc0 con 0x55a77dcb44d0 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb487400640 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 -- 172.21.15.100:0/4185926473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 msgr2=0x55a77dc756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 -- 172.21.15.100:0/4185926473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 msgr2=0x55a77dc493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 -- 172.21.15.100:0/4185926473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77db46530 con 0x55a77dc80070 2024-02-21T07:50:41.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb486a00640 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb480015010 tx=0x7fb480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986dc753bcbe022e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.850+0000 7fb472a00640 1 -- 172.21.15.100:0/4185926473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480009810 con 0x55a77dc80070 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.851+0000 7fb472a00640 1 -- 172.21.15.100:0/4185926473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480012ab0 con 0x55a77dc80070 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.851+0000 7fb472a00640 1 -- 172.21.15.100:0/4185926473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480004540 con 0x55a77dc80070 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.851+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 msgr2=0x55a77dc84520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb480015010 tx=0x7fb480017000 comp rx=0 tx=0).stop 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 shutdown_connections 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dcb44d0 0x55a77dc756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 --2- 172.21.15.100:0/4185926473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dc80070 0x55a77dc84520 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 >> 172.21.15.100:0/4185926473 conn(0x55a77dc0c4b0 msgr2=0x55a77dcaa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 shutdown_connections 2024-02-21T07:50:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.852+0000 7fb490c15740 1 -- 172.21.15.100:0/4185926473 wait complete. 2024-02-21T07:50:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.853+0000 7fb490c15740 1 -- start start 2024-02-21T07:50:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.853+0000 7fb490c15740 1 Processor -- start 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.855+0000 7fb490c15740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 0x55a77dd22e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc77750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dc76050 con 0x55a77dcb44d0 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dd1fd60 con 0x55a77dca08b0 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77dccb7b0 con 0x55a77dc80070 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb490c15740 10 client.0 _ll_register_callbacks cb 0x7fb474009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb487400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb487400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44996/0 (socket says 172.21.15.100:44996) 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb487400640 1 -- 172.21.15.100:0/582057154 learned_addr learned my addr 172.21.15.100:0/582057154 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 0x55a77dd22e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486000640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc77750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 -- 172.21.15.100:0/582057154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 msgr2=0x55a77dc77750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc77750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 -- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 msgr2=0x55a77dc764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486a00640 1 -- 172.21.15.100:0/582057154 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a77dba9c50 con 0x55a77dc80070 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb486000640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc77750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.856+0000 7fb487400640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb486a00640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 0x55a77dd22e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb480007000 tx=0x7fb480004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f16ca2b0624a91 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480012e20 con 0x55a77dc80070 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a77dbd0d30 con 0x55a77dc80070 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb48002c030 con 0x55a77dc80070 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb480004510 con 0x55a77dc80070 2024-02-21T07:50:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 10 client.6056 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a77db6c2c0 con 0x55a77dc80070 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48003f020 con 0x55a77dc80070 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb480039070 con 0x55a77dc80070 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 10 client.6056 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 10 client.6056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 20 client.6056 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.857+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dc3aec0 0x55a77dd222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.858+0000 7fb490c15740 4 client.6056 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.858+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a77d8ab600 con 0x55a77dc3aec0 2024-02-21T07:50:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.858+0000 7fb486000640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dc3aec0 0x55a77dd222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.859+0000 7fb486000640 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dc3aec0 0x55a77dd222f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ef270c381e0ddc server_cookie=1d65b8828cd2bead in_seq=0 out_seq=0 2024-02-21T07:50:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.859+0000 7fb467e00640 10 client.6056 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.885+0000 7fb467e00640 1 -- 172.21.15.100:0/582057154 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a77d8ab600 con 0x55a77dc3aec0 2024-02-21T07:50:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.885+0000 7fb467e00640 10 client.6056 handle_command_reply: tid=0 2024-02-21T07:50:41.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.886+0000 7fb490c15740 1 client.6056 shutdown 2024-02-21T07:50:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.887+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 msgr2=0x55a77dd22e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.887+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 0x55a77dd22e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb480007000 tx=0x7fb480004730 comp rx=0 tx=0).stop 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 shutdown_connections 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a77dc3aec0 0x55a77dd222f0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a77dcb44d0 0x55a77dc764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb467e00640 0 client.6056 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a77dca08b0 0x55a77dc77750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 --2- 172.21.15.100:0/582057154 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a77dc80070 0x55a77dd22e90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.889+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 >> 172.21.15.100:0/582057154 conn(0x55a77dc0c4b0 msgr2=0x55a77dc74390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.891+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 shutdown_connections 2024-02-21T07:50:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.893+0000 7fb490c15740 1 -- 172.21.15.100:0/582057154 wait complete. 2024-02-21T07:50:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.894+0000 7fb490c15740 20 client.6056 trim_cache size 0 max 16384 2024-02-21T07:50:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:50:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:50:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:50:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:50:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.896+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 msgr2=0x7fb4680a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.896+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 0x7fb4680a1610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb48808e040 tx=0x7fb474009190 comp rx=0 tx=0).stop 2024-02-21T07:50:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 msgr2=0x7fb488169fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb47802cc30 tx=0x7fb478001360 comp rx=0 tx=0).stop 2024-02-21T07:50:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 shutdown_connections 2024-02-21T07:50:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb48816a520 0x7fb48806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb46809f150 0x7fb4680a1610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb48820fb10 0x7fb488169fe0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 --2- 172.21.15.100:0/2041753011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb46c0069d0 0x7fb48820f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.901+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 >> 172.21.15.100:0/2041753011 conn(0x7fb4880ce1b0 msgr2=0x7fb4880ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.902+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 shutdown_connections 2024-02-21T07:50:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:41.902+0000 7fb48de00640 1 -- 172.21.15.100:0/2041753011 wait complete. 2024-02-21T07:50:44.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:44.111 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:44.114 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:55.185 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.182+0000 7f794ea00640 1 Processor -- start 2024-02-21T07:50:55.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.182+0000 7f794ea00640 1 -- start start 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.185+0000 7f794ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f79481860b0 0x7f79481870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.185+0000 7f794ea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7948187620 con 0x7f7948183b10 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.185+0000 7f794ea00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7948184620 con 0x7f7948183ef0 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.185+0000 7f794ea00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79480f4660 con 0x7f79481860b0 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.185+0000 7f7947e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7948183b10 0x7f79481859a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58950/0 (socket says 172.21.15.100:58950) 2024-02-21T07:50:55.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.186+0000 7f7947e00640 1 -- 172.21.15.100:0/1082504929 learned_addr learned my addr 172.21.15.100:0/1082504929 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:50:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.186+0000 7f794ca00640 1 --2- 172.21.15.100:0/1082504929 >> v2:172.21.15.156:3300/0 conn(0x7f79481860b0 0x7f79481870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.186+0000 7f7946a00640 1 -- 172.21.15.100:0/1082504929 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637670166 0 0) 0x7f7948187620 con 0x7f7948183b10 2024-02-21T07:50:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.187+0000 7f7946a00640 1 -- 172.21.15.100:0/1082504929 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f792c003520 con 0x7f7948183b10 2024-02-21T07:50:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.188+0000 7f794ca00640 1 -- 172.21.15.100:0/1082504929 >> v1:172.21.15.170:6789/0 conn(0x7f7948183ef0 legacy=0x7f79481869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.188+0000 7f794ca00640 1 -- 172.21.15.100:0/1082504929 >> v1:172.21.15.100:6789/0 conn(0x7f7948183b10 legacy=0x7f79481859a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.188+0000 7f794ca00640 1 -- 172.21.15.100:0/1082504929 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948184900 con 0x7f79481860b0 2024-02-21T07:50:55.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.190+0000 7f794ca00640 1 --2- 172.21.15.100:0/1082504929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f79481870e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7940009d90 tx=0x7f794002bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfeb087d5f4c128a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.191+0000 7f7946a00640 1 -- 172.21.15.100:0/1082504929 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794002cb60 con 0x7f79481860b0 2024-02-21T07:50:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.191+0000 7f7946a00640 1 -- 172.21.15.100:0/1082504929 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794002ccc0 con 0x7f79481860b0 2024-02-21T07:50:55.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.191+0000 7f7946a00640 1 -- 172.21.15.100:0/1082504929 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940034660 con 0x7f79481860b0 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.193+0000 7f794ea00640 1 -- 172.21.15.100:0/1082504929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 msgr2=0x7f79481870e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.193+0000 7f794ea00640 1 --2- 172.21.15.100:0/1082504929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f79481870e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7940009d90 tx=0x7f794002bdb0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.193+0000 7f794ea00640 1 -- 172.21.15.100:0/1082504929 shutdown_connections 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.194+0000 7f794ea00640 1 --2- 172.21.15.100:0/1082504929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f79481870e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.194+0000 7f794ea00640 1 -- 172.21.15.100:0/1082504929 >> 172.21.15.100:0/1082504929 conn(0x7f79480ce1b0 msgr2=0x7f79480ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.194+0000 7f794ea00640 1 -- 172.21.15.100:0/1082504929 shutdown_connections 2024-02-21T07:50:55.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.194+0000 7f794ea00640 1 -- 172.21.15.100:0/1082504929 wait complete. 2024-02-21T07:50:55.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.196+0000 7f794ea00640 1 Processor -- start 2024-02-21T07:50:55.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.197+0000 7f794ea00640 1 -- start start 2024-02-21T07:50:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 0x7f794821b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 0x7f79481680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948168600 con 0x7f7948183b10 2024-02-21T07:50:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794816c5c0 con 0x7f79481860b0 2024-02-21T07:50:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.198+0000 7f794ea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794816c8a0 con 0x7f7948183ef0 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.199+0000 7f794ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.199+0000 7f7947e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 0x7f794821b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.199+0000 7f794ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33620/0 (socket says 172.21.15.100:33620) 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.199+0000 7f794ca00640 1 -- 172.21.15.100:0/2455746181 learned_addr learned my addr 172.21.15.100:0/2455746181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.199+0000 7f7947400640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 0x7f79481680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 -- 172.21.15.100:0/2455746181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 msgr2=0x7f79481680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 0x7f79481680c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 -- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 msgr2=0x7f794816d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 -- 172.21.15.100:0/2455746181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009a70 con 0x7f7948183b10 2024-02-21T07:50:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f794ca00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947e00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 0x7f794821b640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f793800c750 tx=0x7f793800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.200+0000 7f7947400640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 0x7f79481680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.201+0000 7f793fe00640 1 -- 172.21.15.100:0/2455746181 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380070d0 con 0x7f7948183b10 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.201+0000 7f793fe00640 1 -- 172.21.15.100:0/2455746181 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938007230 con 0x7f7948183b10 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.201+0000 7f793fe00640 1 -- 172.21.15.100:0/2455746181 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380075c0 con 0x7f7948183b10 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.202+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794816cb80 con 0x7f7948183b10 2024-02-21T07:50:55.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.202+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794816d140 con 0x7f7948183b10 2024-02-21T07:50:55.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.209+0000 7f793fe00640 1 -- 172.21.15.100:0/2455746181 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f79380047e0 con 0x7f7948183b10 2024-02-21T07:50:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.211+0000 7f793fe00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 0x7f79280a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.211+0000 7f793fe00640 1 -- 172.21.15.100:0/2455746181 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f79380c9090 con 0x7f7948183b10 2024-02-21T07:50:55.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.213+0000 7f7947400640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 0x7f79280a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.213+0000 7f7951322740 1 Processor -- start 2024-02-21T07:50:55.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.213+0000 7f7951322740 1 -- start start 2024-02-21T07:50:55.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.217+0000 7f7947400640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 0x7f79280a1630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f79480f66e0 tx=0x7f7934009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.221+0000 7f7951322740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 0x565284f53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.221+0000 7f7951322740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f58a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f7951322740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565284f94450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f7951322740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284f14620 con 0x565284fc84d0 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f7951322740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284ec68c0 con 0x565284f58f90 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f7951322740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284ec3df0 con 0x565284f94070 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f794ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565284f94450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f794ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565284f94450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33634/0 (socket says 172.21.15.100:33634) 2024-02-21T07:50:55.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.223+0000 7f794ca00640 1 -- 172.21.15.100:0/998503442 learned_addr learned my addr 172.21.15.100:0/998503442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 0x565284f53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947400640 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f58a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 -- 172.21.15.100:0/998503442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 msgr2=0x565284f94450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565284f94450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 -- 172.21.15.100:0/998503442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 msgr2=0x565284f58a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f58a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.224+0000 7f7947e00640 1 -- 172.21.15.100:0/998503442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565284e40b00 con 0x565284f94070 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.225+0000 7f7947e00640 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 0x565284f53440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79380c6a60 tx=0x7f79380077a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23fd69979449b482 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.228+0000 7f7933e00640 1 -- 172.21.15.100:0/998503442 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938096bd0 con 0x565284f94070 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.228+0000 7f7933e00640 1 -- 172.21.15.100:0/998503442 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793809ad20 con 0x565284f94070 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.228+0000 7f7933e00640 1 -- 172.21.15.100:0/998503442 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793809f370 con 0x565284f94070 2024-02-21T07:50:55.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.230+0000 7f7951322740 1 -- 172.21.15.100:0/998503442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 msgr2=0x565284f53440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.230+0000 7f7951322740 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 0x565284f53440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79380c6a60 tx=0x7f79380077a0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.231+0000 7f7951322740 1 -- 172.21.15.100:0/998503442 shutdown_connections 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.231+0000 7f7951322740 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565284f94450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.231+0000 7f7951322740 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f58a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.231+0000 7f7951322740 1 --2- 172.21.15.100:0/998503442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f94070 0x565284f53440 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79380c6a60 tx=0x7f79380077a0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.231+0000 7f7951322740 1 -- 172.21.15.100:0/998503442 >> 172.21.15.100:0/998503442 conn(0x565284f204b0 msgr2=0x565284f57ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.233+0000 7f7951322740 1 -- 172.21.15.100:0/998503442 shutdown_connections 2024-02-21T07:50:55.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.234+0000 7f7951322740 1 -- 172.21.15.100:0/998503442 wait complete. 2024-02-21T07:50:55.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.238+0000 7f7951322740 1 -- start start 2024-02-21T07:50:55.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.239+0000 7f7951322740 1 Processor -- start 2024-02-21T07:50:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.242+0000 7f7951322740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 0x565284fbd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.243+0000 7f7951322740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284f889e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.243+0000 7f7947e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 0x565284fbd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.243+0000 7f7947e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 0x565284fbd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38268/0 (socket says 172.21.15.100:38268) 2024-02-21T07:50:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f7947e00640 1 -- 172.21.15.100:0/3882897187 learned_addr learned my addr 172.21.15.100:0/3882897187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284fc98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284ebf5d0 con 0x565284f58f90 2024-02-21T07:50:55.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f7947400640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284f889e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284e64b50 con 0x565284fbf500 2024-02-21T07:50:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.244+0000 7f794ca00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284fc98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.245+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284e647f0 con 0x565284fc84d0 2024-02-21T07:50:55.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.245+0000 7f7951322740 10 client.0 _ll_register_callbacks cb 0x565284e78550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:55.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 -- 172.21.15.100:0/3882897187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 msgr2=0x565284f889e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284f889e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 -- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 msgr2=0x565284fbd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 0x565284fbd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794816d140 con 0x565284fbf500 2024-02-21T07:50:55.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f7947400640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284f889e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f794ca00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284fc98c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x565284f569a0 tx=0x7f7940004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d676853aaaefe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f7930c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.247+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940044070 con 0x565284fbf500 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f794003f600 con 0x565284fbf500 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565284e91cd0 con 0x565284fbf500 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f794003f7c0 con 0x565284fbf500 2024-02-21T07:50:55.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 10 client.6097 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x565284ebdc50 con 0x565284fbf500 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565284e91cd0 con 0x565284fbf500 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f794003f920 con 0x565284fbf500 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 10 client.6097 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 10 client.6097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 20 client.6097 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284fbf980 0x565284f879e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 4 client.6097 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.248+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565284eb5ce0 con 0x565284fbf980 2024-02-21T07:50:55.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.249+0000 7f7947e00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284fbf980 0x565284f879e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.250+0000 7f7947e00640 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284fbf980 0x565284f879e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66fe4aec65da5fc1 server_cookie=cf68baf40bf44bc5 in_seq=0 out_seq=0 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.250+0000 7f7930c00640 10 client.6097 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.250+0000 7f7930c00640 1 -- 172.21.15.100:0/3882897187 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565284eb5ce0 con 0x565284fbf980 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.250+0000 7f7930c00640 10 client.6097 handle_command_reply: tid=0 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 client.6097 shutdown 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 msgr2=0x565284fc98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284fc98c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x565284f569a0 tx=0x7f7940004ab0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 shutdown_connections 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284fbf980 0x565284f879e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284fc98c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7930c00640 0 client.6097 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:55.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284f889e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 --2- 172.21.15.100:0/3882897187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284f58f90 0x565284fbd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 >> 172.21.15.100:0/3882897187 conn(0x565284f204b0 msgr2=0x565284fc8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 shutdown_connections 2024-02-21T07:50:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.251+0000 7f7951322740 1 -- 172.21.15.100:0/3882897187 wait complete. 2024-02-21T07:50:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.252+0000 7f7951322740 20 client.6097 trim_cache size 0 max 16384 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.274+0000 7f7951322740 1 Processor -- start 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.275+0000 7f7951322740 1 -- start start 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 0x565284fb6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284f4ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284c07e60 con 0x565284fc84d0 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284fcb090 con 0x565284fbf500 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7951322740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284f58510 con 0x565284f58f90 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7947400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284f4ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7947e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 0x565284fb6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f794ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f794ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38282/0 (socket says 172.21.15.100:38282) 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f794ca00640 1 -- 172.21.15.100:0/1879416091 learned_addr learned my addr 172.21.15.100:0/1879416091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.276+0000 7f7947e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 0x565284fb6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:46316/0 (socket says 172.21.15.100:46316) 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 -- 172.21.15.100:0/1879416091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 msgr2=0x565284fb6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 0x565284fb6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 -- 172.21.15.100:0/1879416091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 msgr2=0x565284f4ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284f4ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 -- 172.21.15.100:0/1879416091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565284e5a530 con 0x565284fc84d0 2024-02-21T07:50:55.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.277+0000 7f794ca00640 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7940002230 tx=0x7f7940044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd47391568e4367 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.278+0000 7f7933400640 1 -- 172.21.15.100:0/1879416091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794002c430 con 0x565284fc84d0 2024-02-21T07:50:55.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.278+0000 7f7933400640 1 -- 172.21.15.100:0/1879416091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794003f600 con 0x565284fc84d0 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.278+0000 7f7933400640 1 -- 172.21.15.100:0/1879416091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794003f9b0 con 0x565284fc84d0 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 -- 172.21.15.100:0/1879416091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 msgr2=0x565284f57fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7940002230 tx=0x7f7940044000 comp rx=0 tx=0).stop 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 -- 172.21.15.100:0/1879416091 shutdown_connections 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fc84d0 0x565284f57fd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284fbf500 0x565284f4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 --2- 172.21.15.100:0/1879416091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284f58f90 0x565284fb6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 -- 172.21.15.100:0/1879416091 >> 172.21.15.100:0/1879416091 conn(0x565284f204b0 msgr2=0x565284fbd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 -- 172.21.15.100:0/1879416091 shutdown_connections 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.279+0000 7f7951322740 1 -- 172.21.15.100:0/1879416091 wait complete. 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.280+0000 7f7951322740 1 -- start start 2024-02-21T07:50:55.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.280+0000 7f7951322740 1 Processor -- start 2024-02-21T07:50:55.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.281+0000 7f7951322740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565285027430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.281+0000 7f7951322740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7951322740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284fb9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7951322740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284f88eb0 con 0x565284fbf500 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7951322740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565284fba130 con 0x565284f58f90 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7951322740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565285032a00 con 0x565284fc84d0 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7951322740 10 client.0 _ll_register_callbacks cb 0x7f79380c6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38294/0 (socket says 172.21.15.100:38294) 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 -- 172.21.15.100:0/955529206 learned_addr learned my addr 172.21.15.100:0/955529206 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947e00640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565285027430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f794ca00640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284fb9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 -- 172.21.15.100:0/955529206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 msgr2=0x565284fb9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284fb9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 -- 172.21.15.100:0/955529206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 msgr2=0x565285027430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565285027430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.282+0000 7f7947400640 1 -- 172.21.15.100:0/955529206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565284ebdc50 con 0x565284fbf500 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7947400640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7934000f60 tx=0x7f7934000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f74a84c69e5106 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7930c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:50:55.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793400de90 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565284ee4d30 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7934007030 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.283+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79340071f0 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 10 client.5952 fetch_fsmap learned FSMap version 17 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x565284e802c0 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565284ee4d30 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7934007350 con 0x565284fbf500 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 10 client.5952 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 10 client.5952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 20 client.5952 populate_metadata read hostname 'smithi100' 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284f99820 0x565285036330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 4 client.5952 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:50:55.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.284+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565284bbf600 con 0x565284f99820 2024-02-21T07:50:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.285+0000 7f7947e00640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284f99820 0x565285036330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:50:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.285+0000 7f7947e00640 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284f99820 0x565285036330 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa83ed0d6c744181 server_cookie=cd0024325493b0de in_seq=0 out_seq=0 2024-02-21T07:50:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.285+0000 7f7930c00640 10 client.5952 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.318+0000 7f7930c00640 1 -- 172.21.15.100:0/955529206 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565284bbf600 con 0x565284f99820 2024-02-21T07:50:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.318+0000 7f7930c00640 10 client.5952 handle_command_reply: tid=0 2024-02-21T07:50:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.318+0000 7f7951322740 1 client.5952 shutdown 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.318+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 msgr2=0x565284f88970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.318+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7934000f60 tx=0x7f7934000ed0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 shutdown_connections 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x565284f99820 0x565285036330 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565284fc84d0 0x565284fb9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565284fbf500 0x565284f88970 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 --2- 172.21.15.100:0/955529206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x565284f58f90 0x565285027430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 >> 172.21.15.100:0/955529206 conn(0x565284f204b0 msgr2=0x565284f8aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7930c00640 0 client.5952 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:50:55.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.319+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 shutdown_connections 2024-02-21T07:50:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.322+0000 7f7951322740 1 -- 172.21.15.100:0/955529206 wait complete. 2024-02-21T07:50:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.324+0000 7f7951322740 20 client.5952 trim_cache size 0 max 16384 2024-02-21T07:50:55.329 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:50:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:50:55.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:50:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.329+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 msgr2=0x7f79280a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.329+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 0x7f79280a1630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f79480f66e0 tx=0x7f7934009040 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.329+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 msgr2=0x7f794821b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.329+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 0x7f794821b640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f793800c750 tx=0x7f793800cc10 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 shutdown_connections 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79481860b0 0x7f794816d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7948183ef0 0x7f79481680c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f792809f170 0x7f79280a1630 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f79480f66e0 tx=0x7f7934009040 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 --2- 172.21.15.100:0/2455746181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7948183b10 0x7f794821b640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.331+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 >> 172.21.15.100:0/2455746181 conn(0x7f79480ce1b0 msgr2=0x7f79481768d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:50:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.334+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 shutdown_connections 2024-02-21T07:50:55.337 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:50:55.334+0000 7f794ea00640 1 -- 172.21.15.100:0/2455746181 wait complete. 2024-02-21T07:51:01.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:51:01.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:51:01.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.815+0000 7f5ef0800640 1 Processor -- start 2024-02-21T07:51:01.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.816+0000 7f5ef0800640 1 -- start start 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.819+0000 7f5ef0800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ee8189ca0 0x7f5ee806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.819+0000 7f5ef0800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ee81871c0 0x7f5ee80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.819+0000 7f5ef0800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80ca6a0 con 0x7f5ee818a080 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.819+0000 7f5ef0800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee818abe0 con 0x7f5ee8189ca0 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.819+0000 7f5ef0800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80f6200 con 0x7f5ee81871c0 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ee81871c0 0x7f5ee80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5ee81871c0 0x7f5ee80cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45548/0 (socket says 172.21.15.100:45548) 2024-02-21T07:51:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 -- 172.21.15.100:0/2937065764 learned_addr learned my addr 172.21.15.100:0/2937065764 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 -- 172.21.15.100:0/2937065764 >> v2:172.21.15.100:3300/0 conn(0x7f5ee8189ca0 msgr2=0x7f5ee806ab60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 --2- 172.21.15.100:0/2937065764 >> v2:172.21.15.100:3300/0 conn(0x7f5ee8189ca0 0x7f5ee806ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 -- 172.21.15.100:0/2937065764 >> v1:172.21.15.170:6789/0 conn(0x7f5ee818a080 legacy=0x7f5ee818a4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.820+0000 7f5eed400640 1 -- 172.21.15.100:0/2937065764 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80f6450 con 0x7f5ee81871c0 2024-02-21T07:51:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.822+0000 7f5eed400640 1 --2- 172.21.15.100:0/2937065764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee81871c0 0x7f5ee80cb690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8067a70 tx=0x7f5ee402bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c917b478c2373317 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.822+0000 7f5eeca00640 1 -- 172.21.15.100:0/2937065764 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee402caa0 con 0x7f5ee81871c0 2024-02-21T07:51:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.822+0000 7f5eeca00640 1 -- 172.21.15.100:0/2937065764 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee402cc00 con 0x7f5ee81871c0 2024-02-21T07:51:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.822+0000 7f5eeca00640 1 -- 172.21.15.100:0/2937065764 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40343f0 con 0x7f5ee81871c0 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.823+0000 7f5ef0800640 1 -- 172.21.15.100:0/2937065764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee81871c0 msgr2=0x7f5ee80cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.823+0000 7f5ef0800640 1 --2- 172.21.15.100:0/2937065764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee81871c0 0x7f5ee80cb690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8067a70 tx=0x7f5ee402bf00 comp rx=0 tx=0).stop 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 -- 172.21.15.100:0/2937065764 shutdown_connections 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 --2- 172.21.15.100:0/2937065764 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee81871c0 0x7f5ee80cb690 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 --2- 172.21.15.100:0/2937065764 >> v2:172.21.15.100:3300/0 conn(0x7f5ee8189ca0 0x7f5ee806ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 -- 172.21.15.100:0/2937065764 >> 172.21.15.100:0/2937065764 conn(0x7f5ee80668b0 msgr2=0x7f5ee8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 -- 172.21.15.100:0/2937065764 shutdown_connections 2024-02-21T07:51:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.824+0000 7f5ef0800640 1 -- 172.21.15.100:0/2937065764 wait complete. 2024-02-21T07:51:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.827+0000 7f5ef0800640 1 Processor -- start 2024-02-21T07:51:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.828+0000 7f5ef0800640 1 -- start start 2024-02-21T07:51:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ee81871c0 0x7f5ee81701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 0x7f5ee8224370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8224cb0 con 0x7f5ee8189ca0 2024-02-21T07:51:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8224f90 con 0x7f5ee818a080 2024-02-21T07:51:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5ef0800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8225270 con 0x7f5ee81871c0 2024-02-21T07:51:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.830+0000 7f5eee800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.831+0000 7f5eee800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45558/0 (socket says 172.21.15.100:45558) 2024-02-21T07:51:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.831+0000 7f5eee800640 1 -- 172.21.15.100:0/3491774420 learned_addr learned my addr 172.21.15.100:0/3491774420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.831+0000 7f5eed400640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 0x7f5ee8224370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.831+0000 7f5eede00640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ee81871c0 0x7f5ee81701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eee800640 1 -- 172.21.15.100:0/3491774420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ee81871c0 msgr2=0x7f5ee81701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eee800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ee81871c0 0x7f5ee81701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eee800640 1 -- 172.21.15.100:0/3491774420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 msgr2=0x7f5ee8224370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eee800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 0x7f5ee8224370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eee800640 1 -- 172.21.15.100:0/3491774420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4009b30 con 0x7f5ee818a080 2024-02-21T07:51:01.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.832+0000 7f5eed400640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 0x7f5ee8224370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:01.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.833+0000 7f5eee800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00b410 tx=0x7f5edc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.834+0000 7f5ee2000640 1 -- 172.21.15.100:0/3491774420 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc011830 con 0x7f5ee818a080 2024-02-21T07:51:01.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.834+0000 7f5ee2000640 1 -- 172.21.15.100:0/3491774420 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc011990 con 0x7f5ee818a080 2024-02-21T07:51:01.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.834+0000 7f5ee2000640 1 -- 172.21.15.100:0/3491774420 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc011d40 con 0x7f5ee818a080 2024-02-21T07:51:01.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.834+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee8225550 con 0x7f5ee818a080 2024-02-21T07:51:01.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.835+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee8225b10 con 0x7f5ee818a080 2024-02-21T07:51:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.841+0000 7f5ef35ec740 1 Processor -- start 2024-02-21T07:51:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.841+0000 7f5ee2000640 1 -- 172.21.15.100:0/3491774420 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5edc01a400 con 0x7f5ee818a080 2024-02-21T07:51:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.841+0000 7f5ef35ec740 1 -- start start 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 0x561fe971ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e68e0 0x561fe96a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe961d150 con 0x561fe971bf80 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe961a680 con 0x561fe96e68e0 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9615e60 con 0x561fe96e5fc0 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ee2000640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 0x7f5ecc0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5eed400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 0x561fe971ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5ee2000640 1 -- 172.21.15.100:0/3491774420 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5edc0c9b60 con 0x7f5ee818a080 2024-02-21T07:51:01.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.842+0000 7f5eed400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 0x561fe971ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44254/0 (socket says 172.21.15.100:44254) 2024-02-21T07:51:01.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eed400640 1 -- 172.21.15.100:0/3435904617 learned_addr learned my addr 172.21.15.100:0/3435904617 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eed400640 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e68e0 0x561fe96a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eee800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 0x7f5ecc0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 -- 172.21.15.100:0/3435904617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 msgr2=0x561fe971ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 0x561fe971ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 -- 172.21.15.100:0/3435904617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e68e0 msgr2=0x561fe96a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e68e0 0x561fe96a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.843+0000 7f5eede00640 1 -- 172.21.15.100:0/3435904617 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe95cf060 con 0x561fe971bf80 2024-02-21T07:51:01.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.844+0000 7f5eede00640 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e63a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800b760 tx=0x7f5ed800bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7edd17f1d42e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.844+0000 7f5eee800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 0x7f5ecc0a1630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5edc093b00 tx=0x7f5edc009f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.844+0000 7f5ed6600640 1 -- 172.21.15.100:0/3435904617 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800d740 con 0x561fe971bf80 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.844+0000 7f5ed6600640 1 -- 172.21.15.100:0/3435904617 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800d8a0 con 0x561fe971bf80 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.844+0000 7f5ed6600640 1 -- 172.21.15.100:0/3435904617 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800dc10 con 0x561fe971bf80 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 -- 172.21.15.100:0/3435904617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 msgr2=0x561fe96e63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e63a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800b760 tx=0x7f5ed800bb60 comp rx=0 tx=0).stop 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 -- 172.21.15.100:0/3435904617 shutdown_connections 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e68e0 0x561fe96a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e63a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/3435904617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e5fc0 0x561fe971ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 -- 172.21.15.100:0/3435904617 >> 172.21.15.100:0/3435904617 conn(0x561fe96755a0 msgr2=0x561fe96aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 -- 172.21.15.100:0/3435904617 shutdown_connections 2024-02-21T07:51:01.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.845+0000 7f5ef35ec740 1 -- 172.21.15.100:0/3435904617 wait complete. 2024-02-21T07:51:01.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.846+0000 7f5ef35ec740 1 -- start start 2024-02-21T07:51:01.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.846+0000 7f5ef35ec740 1 Processor -- start 2024-02-21T07:51:01.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe9719af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe95baec0 con 0x561fe971bf80 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe95bab60 con 0x561fe96e5fc0 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe93841c0 con 0x561fe96e68e0 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5ef35ec740 10 client.0 _ll_register_callbacks cb 0x561fe95ce960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5eed400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5eed400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96dbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45570/0 (socket says 172.21.15.100:45570) 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5eed400640 1 -- 172.21.15.100:0/1344443539 learned_addr learned my addr 172.21.15.100:0/1344443539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5eed400640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.848+0000 7f5eede00640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe9719af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.849+0000 7f5eed400640 1 -- 172.21.15.100:0/1344443539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 msgr2=0x561fe9719af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.849+0000 7f5eed400640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe9719af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.849+0000 7f5eed400640 1 -- 172.21.15.100:0/1344443539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 msgr2=0x561fe96dbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.849+0000 7f5eed400640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96dbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.849+0000 7f5eed400640 1 -- 172.21.15.100:0/1344443539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed800e040 con 0x561fe971bf80 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.850+0000 7f5eed400640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e4210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5ee402c510 tx=0x7f5ee4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce31d22998f5607d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.850+0000 7f5ecaa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.851+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4048030 con 0x561fe971bf80 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.851+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5ee4007b60 con 0x561fe971bf80 2024-02-21T07:51:01.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.851+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fe93157e0 con 0x561fe971bf80 2024-02-21T07:51:01.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.852+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ee4007d20 con 0x561fe971bf80 2024-02-21T07:51:01.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.852+0000 7f5ef35ec740 10 client.5961 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.852+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561fe96144e0 con 0x561fe971bf80 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561fe93157e0 con 0x561fe971bf80 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ee404c020 con 0x561fe971bf80 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 10 client.5961 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 10 client.5961 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 20 client.5961 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe971a240 0x561fe96e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 4 client.5961 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:01.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.853+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fe9352720 con 0x561fe971a240 2024-02-21T07:51:01.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.854+0000 7f5eede00640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe971a240 0x561fe96e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.854+0000 7f5ecaa00640 10 client.5961 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:01.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.854+0000 7f5eede00640 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe971a240 0x561fe96e3b20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25da3188186b9370 server_cookie=ac06c338afdd157a in_seq=0 out_seq=0 2024-02-21T07:51:01.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.855+0000 7f5ecaa00640 1 -- 172.21.15.100:0/1344443539 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561fe9352720 con 0x561fe971a240 2024-02-21T07:51:01.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.855+0000 7f5ecaa00640 10 client.5961 handle_command_reply: tid=0 2024-02-21T07:51:01.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.855+0000 7f5ef35ec740 1 client.5961 shutdown 2024-02-21T07:51:01.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.856+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 msgr2=0x561fe96e4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.856+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e4210 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5ee402c510 tx=0x7f5ee4030000 comp rx=0 tx=0).stop 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 shutdown_connections 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe971a240 0x561fe96e3b20 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ecaa00640 0 client.5961 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe971bf80 0x561fe96e4210 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe9719af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1344443539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 >> 172.21.15.100:0/1344443539 conn(0x561fe96755a0 msgr2=0x561fe971dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 shutdown_connections 2024-02-21T07:51:01.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.858+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1344443539 wait complete. 2024-02-21T07:51:01.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.859+0000 7f5ef35ec740 20 client.5961 trim_cache size 0 max 16384 2024-02-21T07:51:01.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.895+0000 7f5ef35ec740 1 Processor -- start 2024-02-21T07:51:01.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.896+0000 7f5ef35ec740 1 -- start start 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 0x561fe96dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe971bf80 0x561fe972e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe973e720 con 0x561fe96e5fc0 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe96ae2b0 con 0x561fe971bf80 2024-02-21T07:51:01.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.897+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe96eceb0 con 0x561fe96e68e0 2024-02-21T07:51:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.898+0000 7f5eede00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.898+0000 7f5eede00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44274/0 (socket says 172.21.15.100:44274) 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.898+0000 7f5eede00640 1 -- 172.21.15.100:0/1987482776 learned_addr learned my addr 172.21.15.100:0/1987482776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.898+0000 7f5eed400640 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 0x561fe96dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 -- 172.21.15.100:0/1987482776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 msgr2=0x561fe96a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 -- 172.21.15.100:0/1987482776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe971bf80 msgr2=0x561fe972e290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe971bf80 0x561fe972e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 -- 172.21.15.100:0/1987482776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fe95b0950 con 0x561fe96e5fc0 2024-02-21T07:51:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eede00640 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:01.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.899+0000 7f5eed400640 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 0x561fe96dbd00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097e0 tx=0x7f5ee4045040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7424be0fdfe2e001 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.900+0000 7f5ed5c00640 1 -- 172.21.15.100:0/1987482776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4048040 con 0x561fe96e5fc0 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.900+0000 7f5ed5c00640 1 -- 172.21.15.100:0/1987482776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4049040 con 0x561fe96e5fc0 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.900+0000 7f5ed5c00640 1 -- 172.21.15.100:0/1987482776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4003b90 con 0x561fe96e5fc0 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1987482776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 msgr2=0x561fe96dbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 0x561fe96dbd00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40097e0 tx=0x7f5ee4045040 comp rx=0 tx=0).stop 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1987482776 shutdown_connections 2024-02-21T07:51:01.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe971bf80 0x561fe972e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe96e68e0 0x561fe96a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/1987482776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e5fc0 0x561fe96dbd00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.901+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1987482776 >> 172.21.15.100:0/1987482776 conn(0x561fe96755a0 msgr2=0x561fe96d5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.902+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1987482776 shutdown_connections 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.902+0000 7f5ef35ec740 1 -- 172.21.15.100:0/1987482776 wait complete. 2024-02-21T07:51:01.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.902+0000 7f5ef35ec740 1 -- start start 2024-02-21T07:51:01.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.903+0000 7f5ef35ec740 1 Processor -- start 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe971bf80 0x561fe972a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9787b00 con 0x561fe96e68e0 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe9712820 con 0x561fe96e5fc0 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fe978b8e0 con 0x561fe971bf80 2024-02-21T07:51:01.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.905+0000 7f5ef35ec740 10 client.0 _ll_register_callbacks cb 0x7f5ee4008af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.906+0000 7f5eede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.906+0000 7f5eede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49060/0 (socket says 172.21.15.100:49060) 2024-02-21T07:51:01.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.906+0000 7f5eede00640 1 -- 172.21.15.100:0/106822467 learned_addr learned my addr 172.21.15.100:0/106822467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.906+0000 7f5eed400640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 -- 172.21.15.100:0/106822467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe971bf80 msgr2=0x561fe972a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eed400640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe971bf80 0x561fe972a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe971bf80 0x561fe972a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 -- 172.21.15.100:0/106822467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 msgr2=0x561fe96ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 -- 172.21.15.100:0/106822467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fe96144e0 con 0x561fe96e68e0 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eed400640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:01.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.907+0000 7f5eede00640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006fd0 tx=0x7f5ed8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e251ec6957cd63a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.910+0000 7f5ecaa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.910+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8027d90 con 0x561fe96e68e0 2024-02-21T07:51:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.910+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5ed800db10 con 0x561fe96e68e0 2024-02-21T07:51:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.918+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ed800d8a0 con 0x561fe96e68e0 2024-02-21T07:51:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.926+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed800dcd0 con 0x561fe96e68e0 2024-02-21T07:51:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.926+0000 7f5ef35ec740 10 client.5967 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.926+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561fe95d6430 con 0x561fe96e68e0 2024-02-21T07:51:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.935+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800d8a0 con 0x561fe96e68e0 2024-02-21T07:51:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.935+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5ed80272d0 con 0x561fe96e68e0 2024-02-21T07:51:01.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 10 client.5967 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 10 client.5967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 20 client.5967 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe96e5980 0x561fe96adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 4 client.5967 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:51:01.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.936+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561fe93a1890 con 0x561fe96e5980 2024-02-21T07:51:01.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.942+0000 7f5eed400640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe96e5980 0x561fe96adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.944+0000 7f5eed400640 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe96e5980 0x561fe96adae0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5439a793de5e6 server_cookie=5f2390abb3513de8 in_seq=0 out_seq=0 2024-02-21T07:51:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.945+0000 7f5ecaa00640 10 client.5967 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.945+0000 7f5ecaa00640 1 -- 172.21.15.100:0/106822467 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561fe93a1890 con 0x561fe96e5980 2024-02-21T07:51:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.945+0000 7f5ecaa00640 10 client.5967 handle_command_reply: tid=0 2024-02-21T07:51:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.946+0000 7f5ef35ec740 1 client.5967 shutdown 2024-02-21T07:51:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.948+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 msgr2=0x561fe978b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.948+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006fd0 tx=0x7f5ed8010000 comp rx=0 tx=0).stop 2024-02-21T07:51:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 shutdown_connections 2024-02-21T07:51:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561fe96e5980 0x561fe96adae0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561fe971bf80 0x561fe972a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fe96e68e0 0x561fe978b3a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 --2- 172.21.15.100:0/106822467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fe96e5fc0 0x561fe96ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.949+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 >> 172.21.15.100:0/106822467 conn(0x561fe96755a0 msgr2=0x561fe96a7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.950+0000 7f5ecaa00640 0 client.5967 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.954+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 shutdown_connections 2024-02-21T07:51:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.954+0000 7f5ef35ec740 1 -- 172.21.15.100:0/106822467 wait complete. 2024-02-21T07:51:01.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.956+0000 7f5ef35ec740 20 client.5967 trim_cache size 0 max 16384 2024-02-21T07:51:01.968 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:01.968 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:51:01.968 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:51:01.968 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 msgr2=0x7f5ecc0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 0x7f5ecc0a1630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5edc093b00 tx=0x7f5edc009f90 comp rx=0 tx=0).stop 2024-02-21T07:51:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 msgr2=0x7f5ee8220e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00b410 tx=0x7f5edc00b8d0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 shutdown_connections 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ee818a080 0x7f5ee8220e70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5ecc09f170 0x7f5ecc0a1630 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ee8189ca0 0x7f5ee8224370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 --2- 172.21.15.100:0/3491774420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ee81871c0 0x7f5ee81701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:01.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.968+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 >> 172.21.15.100:0/3491774420 conn(0x7f5ee80668b0 msgr2=0x7f5ee818a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.971+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 shutdown_connections 2024-02-21T07:51:01.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:01.971+0000 7f5ef0800640 1 -- 172.21.15.100:0/3491774420 wait complete. 2024-02-21T07:51:02.023 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:51:02.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:51:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.394+0000 7fb9b2a00640 1 Processor -- start 2024-02-21T07:51:02.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.394+0000 7fb9b2a00640 1 -- start start 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9ac1829c0 0x7fb9ac189dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9ac18a300 0x7fb9ac1888d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b2a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac18a780 con 0x7fb9ac188e10 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b2a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac182da0 con 0x7fb9ac18a300 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b2a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac189840 con 0x7fb9ac1829c0 2024-02-21T07:51:02.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9ab400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9ac18a300 0x7fb9ac1888d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b0a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fb9ac188e10 0x7fb9ac0f9b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:59702/0 (socket says 172.21.15.100:59702) 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9b0a00640 1 -- 172.21.15.100:0/4024413999 learned_addr learned my addr 172.21.15.100:0/4024413999 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.397+0000 7fb9abe00640 1 --2- 172.21.15.100:0/4024413999 >> v2:172.21.15.156:3300/0 conn(0x7fb9ac1829c0 0x7fb9ac189dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9aaa00640 1 -- 172.21.15.100:0/4024413999 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924581009 0 0) 0x7fb9ac18a780 con 0x7fb9ac188e10 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9aaa00640 1 -- 172.21.15.100:0/4024413999 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb990003520 con 0x7fb9ac188e10 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9ab400640 1 -- 172.21.15.100:0/4024413999 >> v2:172.21.15.156:3300/0 conn(0x7fb9ac1829c0 msgr2=0x7fb9ac189dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9ab400640 1 --2- 172.21.15.100:0/4024413999 >> v2:172.21.15.156:3300/0 conn(0x7fb9ac1829c0 0x7fb9ac189dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9ab400640 1 -- 172.21.15.100:0/4024413999 >> v1:172.21.15.156:6789/0 conn(0x7fb9ac188e10 legacy=0x7fb9ac0f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.398+0000 7fb9ab400640 1 -- 172.21.15.100:0/4024413999 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac189560 con 0x7fb9ac18a300 2024-02-21T07:51:02.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.399+0000 7fb9ab400640 1 --2- 172.21.15.100:0/4024413999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac1888d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0fbb60 tx=0x7fb99802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b62385e8d5e4a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:02.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.400+0000 7fb9aaa00640 1 -- 172.21.15.100:0/4024413999 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99802e070 con 0x7fb9ac18a300 2024-02-21T07:51:02.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.400+0000 7fb9aaa00640 1 -- 172.21.15.100:0/4024413999 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980315a0 con 0x7fb9ac18a300 2024-02-21T07:51:02.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.400+0000 7fb9aaa00640 1 -- 172.21.15.100:0/4024413999 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998031930 con 0x7fb9ac18a300 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 -- 172.21.15.100:0/4024413999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 msgr2=0x7fb9ac1888d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/4024413999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac1888d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0fbb60 tx=0x7fb99802b840 comp rx=0 tx=0).stop 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 -- 172.21.15.100:0/4024413999 shutdown_connections 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/4024413999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac1888d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/4024413999 >> v2:172.21.15.156:3300/0 conn(0x7fb9ac1829c0 0x7fb9ac189dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.401+0000 7fb9b2a00640 1 -- 172.21.15.100:0/4024413999 >> 172.21.15.100:0/4024413999 conn(0x7fb9ac0fe0a0 msgr2=0x7fb9ac0fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:02.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.403+0000 7fb9b2a00640 1 -- 172.21.15.100:0/4024413999 shutdown_connections 2024-02-21T07:51:02.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.403+0000 7fb9b2a00640 1 -- 172.21.15.100:0/4024413999 wait complete. 2024-02-21T07:51:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.407+0000 7fb9b2a00640 1 Processor -- start 2024-02-21T07:51:02.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.411+0000 7fb9b2a00640 1 -- start start 2024-02-21T07:51:02.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9ac1829c0 0x7fb9ac18af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac16a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac224070 con 0x7fb9ac18a300 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac174840 con 0x7fb9ac188e10 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.413+0000 7fb9b2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac174b10 con 0x7fb9ac1829c0 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.414+0000 7fb9ab400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.414+0000 7fb9ab400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45594/0 (socket says 172.21.15.100:45594) 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.414+0000 7fb9ab400640 1 -- 172.21.15.100:0/2729262685 learned_addr learned my addr 172.21.15.100:0/2729262685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.415+0000 7fb9ab400640 1 -- 172.21.15.100:0/2729262685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9ac1829c0 msgr2=0x7fb9ac18af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.415+0000 7fb9abe00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9ac1829c0 0x7fb9ac18af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.415+0000 7fb9b0a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac16a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.415+0000 7fb9ab400640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9ac1829c0 0x7fb9ac18af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.415+0000 7fb9ab400640 1 -- 172.21.15.100:0/2729262685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 msgr2=0x7fb9ac16a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.417+0000 7fb9ab400640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac16a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.417+0000 7fb9ab400640 1 -- 172.21.15.100:0/2729262685 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009400 con 0x7fb9ac188e10 2024-02-21T07:51:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.417+0000 7fb9b0a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac16a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.418+0000 7fb9ab400640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb998009890 tx=0x7fb9980046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.418+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998032840 con 0x7fb9ac188e10 2024-02-21T07:51:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.419+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980329c0 con 0x7fb9ac188e10 2024-02-21T07:51:02.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.419+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998032d70 con 0x7fb9ac188e10 2024-02-21T07:51:02.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.419+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac174df0 con 0x7fb9ac188e10 2024-02-21T07:51:02.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.419+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac223a20 con 0x7fb9ac188e10 2024-02-21T07:51:02.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.422+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb984005290 con 0x7fb9ac188e10 2024-02-21T07:51:02.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.425+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb99803b3f0 con 0x7fb9ac188e10 2024-02-21T07:51:02.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.429+0000 7fb9a3e00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 0x7fb98c0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.430+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb9980eb9c0 con 0x7fb9ac188e10 2024-02-21T07:51:02.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.433+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9980b57a0 con 0x7fb9ac188e10 2024-02-21T07:51:02.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.442+0000 7fb9abe00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 0x7fb98c0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.446+0000 7fb9abe00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 0x7fb98c0a1630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0cf3e0 tx=0x7fb99c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.906+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb984005ac0 con 0x7fb9ac188e10 2024-02-21T07:51:02.911 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:51:02.911 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:51:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.907+0000 7fb9a3e00640 1 -- 172.21.15.100:0/2729262685 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7fb9980b8e60 con 0x7fb9ac188e10 2024-02-21T07:51:02.911 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:51:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.910+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 msgr2=0x7fb98c0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.910+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 0x7fb98c0a1630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0cf3e0 tx=0x7fb99c008040 comp rx=0 tx=0).stop 2024-02-21T07:51:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.910+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 msgr2=0x7fb9ac174300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.910+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb998009890 tx=0x7fb9980046c0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 shutdown_connections 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb98c09f170 0x7fb98c0a1630 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9ac18a300 0x7fb9ac16a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9ac188e10 0x7fb9ac174300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 --2- 172.21.15.100:0/2729262685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9ac1829c0 0x7fb9ac18af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.911+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 >> 172.21.15.100:0/2729262685 conn(0x7fb9ac0fe0a0 msgr2=0x7fb9ac189b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.916+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 shutdown_connections 2024-02-21T07:51:02.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:02.916+0000 7fb9b2a00640 1 -- 172.21.15.100:0/2729262685 wait complete. 2024-02-21T07:51:02.952 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:02.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:51:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.366+0000 7f7dc7e00640 1 Processor -- start 2024-02-21T07:51:03.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.366+0000 7f7dc7e00640 1 -- start start 2024-02-21T07:51:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.374+0000 7f7dc7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 0x7f7dc8070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dc818b280 0x7f7dc806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc7e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc806ddb0 con 0x7f7dc8071450 2024-02-21T07:51:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc7e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc806ed10 con 0x7f7dc818a4a0 2024-02-21T07:51:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc7e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc818db30 con 0x7f7dc818b280 2024-02-21T07:51:03.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc7400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dc818b280 0x7f7dc806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.376+0000 7f7dc7400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7dc818b280 0x7f7dc806f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45598/0 (socket says 172.21.15.100:45598) 2024-02-21T07:51:03.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.376+0000 7f7dc7400640 1 -- 172.21.15.100:0/3154987577 learned_addr learned my addr 172.21.15.100:0/3154987577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc6000640 1 --1- 172.21.15.100:0/3154987577 >> v1:172.21.15.170:6789/0 conn(0x7f7dc8071450 0x7f7dc818ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32774/0 (socket says 172.21.15.100:32774) 2024-02-21T07:51:03.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.376+0000 7f7dc7400640 1 -- 172.21.15.100:0/3154987577 >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 msgr2=0x7f7dc8070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.376+0000 7f7dc5600640 1 -- 172.21.15.100:0/3154987577 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713244339 0 0) 0x7f7dc806ddb0 con 0x7f7dc8071450 2024-02-21T07:51:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.375+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/3154987577 >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 0x7f7dc8070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.377+0000 7f7dc7400640 1 --2- 172.21.15.100:0/3154987577 >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 0x7f7dc8070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.377+0000 7f7dc7400640 1 -- 172.21.15.100:0/3154987577 >> v1:172.21.15.170:6789/0 conn(0x7f7dc8071450 legacy=0x7f7dc818ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.377+0000 7f7dc7400640 1 -- 172.21.15.100:0/3154987577 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc806e090 con 0x7f7dc818b280 2024-02-21T07:51:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.378+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/3154987577 >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 0x7f7dc8070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:03.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.387+0000 7f7dc7400640 1 --2- 172.21.15.100:0/3154987577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc818b280 0x7f7dc806f180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ce000 tx=0x7f7dc002be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b90772204f5ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.388+0000 7f7dc5600640 1 -- 172.21.15.100:0/3154987577 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc002c9f0 con 0x7f7dc818b280 2024-02-21T07:51:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.388+0000 7f7dc5600640 1 -- 172.21.15.100:0/3154987577 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc002cb50 con 0x7f7dc818b280 2024-02-21T07:51:03.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.389+0000 7f7dc7e00640 1 -- 172.21.15.100:0/3154987577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc818b280 msgr2=0x7f7dc806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.390+0000 7f7dc5600640 1 -- 172.21.15.100:0/3154987577 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc002c9f0 con 0x7f7dc818b280 2024-02-21T07:51:03.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.390+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/3154987577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc818b280 0x7f7dc806f180 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ce000 tx=0x7f7dc002be50 comp rx=0 tx=0).stop 2024-02-21T07:51:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.390+0000 7f7dc7e00640 1 -- 172.21.15.100:0/3154987577 shutdown_connections 2024-02-21T07:51:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.390+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/3154987577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc818b280 0x7f7dc806f180 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.391+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/3154987577 >> v2:172.21.15.100:3300/0 conn(0x7f7dc818a4a0 0x7f7dc8070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.391+0000 7f7dc7e00640 1 -- 172.21.15.100:0/3154987577 >> 172.21.15.100:0/3154987577 conn(0x7f7dc80ce150 msgr2=0x7f7dc80ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.391+0000 7f7dc7e00640 1 -- 172.21.15.100:0/3154987577 shutdown_connections 2024-02-21T07:51:03.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.391+0000 7f7dc7e00640 1 -- 172.21.15.100:0/3154987577 wait complete. 2024-02-21T07:51:03.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.395+0000 7f7dc7e00640 1 Processor -- start 2024-02-21T07:51:03.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.395+0000 7f7dc7e00640 1 -- start start 2024-02-21T07:51:03.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.398+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc8071450 0x7f7dc815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.398+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 0x7f7dc8176f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.398+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8177d40 con 0x7f7dc818a4a0 2024-02-21T07:51:03.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8178020 con 0x7f7dc8071450 2024-02-21T07:51:03.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8178300 con 0x7f7dc818b280 2024-02-21T07:51:03.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44284/0 (socket says 172.21.15.100:44284) 2024-02-21T07:51:03.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.399+0000 7f7dc7400640 1 -- 172.21.15.100:0/4015154059 learned_addr learned my addr 172.21.15.100:0/4015154059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc7400640 1 -- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc8071450 msgr2=0x7f7dc815b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc7400640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc8071450 0x7f7dc815b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc7400640 1 -- 172.21.15.100:0/4015154059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 msgr2=0x7f7dc8176f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 0x7f7dc8176f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc7400640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 0x7f7dc8176f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.400+0000 7f7dc7400640 1 -- 172.21.15.100:0/4015154059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc0009b30 con 0x7f7dc818b280 2024-02-21T07:51:03.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.401+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 0x7f7dc8176f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:03.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.401+0000 7f7dc7400640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0036040 tx=0x7f7dc0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.403+0000 7f7dbea00640 1 -- 172.21.15.100:0/4015154059 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0004250 con 0x7f7dc818b280 2024-02-21T07:51:03.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.403+0000 7f7dbea00640 1 -- 172.21.15.100:0/4015154059 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc00043b0 con 0x7f7dc818b280 2024-02-21T07:51:03.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.403+0000 7f7dbea00640 1 -- 172.21.15.100:0/4015154059 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0004760 con 0x7f7dc818b280 2024-02-21T07:51:03.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.403+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc8223880 con 0x7f7dc818b280 2024-02-21T07:51:03.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.403+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc81785e0 con 0x7f7dc818b280 2024-02-21T07:51:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.412+0000 7f7dd042c740 1 Processor -- start 2024-02-21T07:51:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.412+0000 7f7dbea00640 1 -- 172.21.15.100:0/4015154059 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7dc003e450 con 0x7f7dc818b280 2024-02-21T07:51:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.418+0000 7f7dbea00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 0x7f7da80a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.418+0000 7f7dbea00640 1 -- 172.21.15.100:0/4015154059 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7dc00ecc90 con 0x7f7dc818b280 2024-02-21T07:51:03.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.420+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 0x7f7da80a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.423+0000 7f7dd042c740 1 -- start start 2024-02-21T07:51:03.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3070 0x55d1679d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d167a0f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d167906210 con 0x55d1679d3990 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d167903740 con 0x55d1679d3070 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.425+0000 7f7dd042c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1678fef20 con 0x55d167a0e740 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.426+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.426+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49102/0 (socket says 172.21.15.100:49102) 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.426+0000 7f7dc6000640 1 -- 172.21.15.100:0/4014396914 learned_addr learned my addr 172.21.15.100:0/4014396914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 -- 172.21.15.100:0/4014396914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 msgr2=0x55d167a0f4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d167a0f4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 -- 172.21.15.100:0/4014396914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3070 msgr2=0x55d1679d3450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3070 0x55d1679d3450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 -- 172.21.15.100:0/4014396914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1678c0df0 con 0x55d1679d3990 2024-02-21T07:51:03.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.427+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7db40014b0 tx=0x7f7db4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a02a0c77d0a4527 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.428+0000 7f7dc6000640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 0x7f7da80a16b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ed630 tx=0x7f7db4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.428+0000 7f7db3000640 1 -- 172.21.15.100:0/4014396914 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4007370 con 0x55d1679d3990 2024-02-21T07:51:03.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.428+0000 7f7db3000640 1 -- 172.21.15.100:0/4014396914 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db402a070 con 0x55d1679d3990 2024-02-21T07:51:03.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.428+0000 7f7db3000640 1 -- 172.21.15.100:0/4014396914 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40076d0 con 0x55d1679d3990 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.429+0000 7f7dd042c740 1 -- 172.21.15.100:0/4014396914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 msgr2=0x55d167a0e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.429+0000 7f7dd042c740 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7db40014b0 tx=0x7f7db4000ed0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 -- 172.21.15.100:0/4014396914 shutdown_connections 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d167a0f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1679d3990 0x55d167a0e200 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 --2- 172.21.15.100:0/4014396914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3070 0x55d1679d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 -- 172.21.15.100:0/4014396914 >> 172.21.15.100:0/4014396914 conn(0x55d167995640 msgr2=0x55d1679966c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 -- 172.21.15.100:0/4014396914 shutdown_connections 2024-02-21T07:51:03.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.430+0000 7f7dd042c740 1 -- 172.21.15.100:0/4014396914 wait complete. 2024-02-21T07:51:03.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.432+0000 7f7dd042c740 1 -- start start 2024-02-21T07:51:03.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.432+0000 7f7dd042c740 1 Processor -- start 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679d86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d1679c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1678a4150 con 0x55d167a15a20 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1678a3df0 con 0x55d1679d3990 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d16766d1c0 con 0x55d167a0e740 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dd042c740 10 client.0 _ll_register_callbacks cb 0x55d1678f32b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44286/0 (socket says 172.21.15.100:44286) 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.434+0000 7f7dc6000640 1 -- 172.21.15.100:0/3290013548 learned_addr learned my addr 172.21.15.100:0/3290013548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679d86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc7400640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d1679c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 -- 172.21.15.100:0/3290013548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 msgr2=0x55d1679d86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679d86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 -- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 msgr2=0x55d1679c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d1679c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 -- 172.21.15.100:0/3290013548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db4001c80 con 0x55d167a0e740 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc7400640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d1679c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.435+0000 7f7dc6000640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7db400dfd0 tx=0x7f7db4010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eec176d003c5059 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7da7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4014940 con 0x55d167a0e740 2024-02-21T07:51:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7db4014aa0 con 0x55d167a0e740 2024-02-21T07:51:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1675fe7e0 con 0x55d167a0e740 2024-02-21T07:51:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7db40047e0 con 0x55d167a0e740 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7dd042c740 10 client.6092 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1678fd5a0 con 0x55d167a0e740 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.436+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d1675fe7e0 con 0x55d167a0e740 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7db4004940 con 0x55d167a0e740 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 10 client.6092 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 10 client.6092 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 20 client.6092 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d1679c92a0 0x55d167a1b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 4 client.6092 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.437+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d16763b720 con 0x55d1679c92a0 2024-02-21T07:51:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.442+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d1679c92a0 0x55d167a1b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.443+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d1679c92a0 0x55d167a1b020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44b7f6a28063bf8f server_cookie=a19c04368d43ce37 in_seq=0 out_seq=0 2024-02-21T07:51:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.443+0000 7f7da7400640 10 client.6092 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.444+0000 7f7da7400640 1 -- 172.21.15.100:0/3290013548 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d16763b720 con 0x55d1679c92a0 2024-02-21T07:51:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.444+0000 7f7da7400640 10 client.6092 handle_command_reply: tid=0 2024-02-21T07:51:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.444+0000 7f7dd042c740 1 client.6092 shutdown 2024-02-21T07:51:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.445+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 msgr2=0x55d1679be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.445+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7db400dfd0 tx=0x7f7db4010000 comp rx=0 tx=0).stop 2024-02-21T07:51:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 shutdown_connections 2024-02-21T07:51:03.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d1679c92a0 0x55d167a1b020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d1679c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a0e740 0x55d1679be350 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 --2- 172.21.15.100:0/3290013548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679d86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 >> 172.21.15.100:0/3290013548 conn(0x55d1679d3070 msgr2=0x55d1679970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.447+0000 7f7da7400640 0 client.6092 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.448+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 shutdown_connections 2024-02-21T07:51:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.448+0000 7f7dd042c740 1 -- 172.21.15.100:0/3290013548 wait complete. 2024-02-21T07:51:03.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.448+0000 7f7dd042c740 20 client.6092 trim_cache size 0 max 16384 2024-02-21T07:51:03.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.483+0000 7f7dd042c740 1 Processor -- start 2024-02-21T07:51:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.485+0000 7f7dd042c740 1 -- start start 2024-02-21T07:51:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.488+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.488+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a0e740 0x55d167a0e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.491+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.491+0000 7f7dd042c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1679ca6c0 con 0x55d167a0e740 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.491+0000 7f7dd042c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d167993970 con 0x55d1679d3990 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.491+0000 7f7dd042c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1679ca400 con 0x55d167a15a20 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.492+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.492+0000 7f7dc7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44296/0 (socket says 172.21.15.100:44296) 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.492+0000 7f7dc7400640 1 -- 172.21.15.100:0/824826804 learned_addr learned my addr 172.21.15.100:0/824826804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 -- 172.21.15.100:0/824826804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 msgr2=0x55d1679cfa30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679cfa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 -- 172.21.15.100:0/824826804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a0e740 msgr2=0x55d167a0e100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a0e740 0x55d167a0e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 -- 172.21.15.100:0/824826804 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d167899ab0 con 0x55d167a15a20 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7dc7400640 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00ba700 tx=0x7f7dc00d9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b1da064600277 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.493+0000 7f7db2600640 1 -- 172.21.15.100:0/824826804 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00be8c0 con 0x55d167a15a20 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.494+0000 7f7db2600640 1 -- 172.21.15.100:0/824826804 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc00c2f10 con 0x55d167a15a20 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.494+0000 7f7db2600640 1 -- 172.21.15.100:0/824826804 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc00b6de0 con 0x55d167a15a20 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 -- 172.21.15.100:0/824826804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 msgr2=0x55d1679970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00ba700 tx=0x7f7dc00d9040 comp rx=0 tx=0).stop 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 -- 172.21.15.100:0/824826804 shutdown_connections 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d167a15a20 0x55d1679970b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a0e740 0x55d167a0e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 --2- 172.21.15.100:0/824826804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d1679d3990 0x55d1679cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 -- 172.21.15.100:0/824826804 >> 172.21.15.100:0/824826804 conn(0x55d1679d3070 msgr2=0x55d167a0d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 -- 172.21.15.100:0/824826804 shutdown_connections 2024-02-21T07:51:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.495+0000 7f7dd042c740 1 -- 172.21.15.100:0/824826804 wait complete. 2024-02-21T07:51:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.496+0000 7f7dd042c740 1 -- start start 2024-02-21T07:51:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.496+0000 7f7dd042c740 1 Processor -- start 2024-02-21T07:51:03.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1679d3990 0x55d1679c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d167a28670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1679c40e0 con 0x55d167a15a20 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1679ce260 con 0x55d167a0e740 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1679cec30 con 0x55d1679d3990 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.498+0000 7f7dd042c740 10 client.0 _ll_register_callbacks cb 0x7f7db4001300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.499+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.499+0000 7f7dc6000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45618/0 (socket says 172.21.15.100:45618) 2024-02-21T07:51:03.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.499+0000 7f7dc6000640 1 -- 172.21.15.100:0/540838276 learned_addr learned my addr 172.21.15.100:0/540838276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.500+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1679d3990 0x55d1679c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.502+0000 7f7dc7400640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d167a28670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.505+0000 7f7dc6000640 1 -- 172.21.15.100:0/540838276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1679d3990 msgr2=0x55d1679c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.505+0000 7f7dc6000640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1679d3990 0x55d1679c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.505+0000 7f7dc6000640 1 -- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 msgr2=0x55d167a28670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.505+0000 7f7dc6000640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d167a28670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.506+0000 7f7dc6000640 1 -- 172.21.15.100:0/540838276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc81785e0 con 0x55d167a0e740 2024-02-21T07:51:03.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.506+0000 7f7dc7400640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d167a28670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:03.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.510+0000 7f7dc6000640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007820 tx=0x7f7db4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca8e27274b5e1e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.510+0000 7f7da7400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:03.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.512+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4000f40 con 0x55d167a0e740 2024-02-21T07:51:03.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.514+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7db40049f0 con 0x55d167a0e740 2024-02-21T07:51:03.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.514+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7db402a070 con 0x55d167a0e740 2024-02-21T07:51:03.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.514+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7db4000f40 con 0x55d167a0e740 2024-02-21T07:51:03.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.515+0000 7f7dd042c740 10 client.6136 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:03.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.515+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d1678bf650 con 0x55d167a0e740 2024-02-21T07:51:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.516+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db405b080 con 0x55d167a0e740 2024-02-21T07:51:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7db400d520 con 0x55d167a0e740 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 10 client.6136 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 10 client.6136 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 20 client.6136 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d167996b90 0x55d1679d3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 4 client.6136 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.517+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f7db402a070 con 0x55d167996b90 2024-02-21T07:51:03.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.518+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d167996b90 0x55d1679d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.519+0000 7f7dc6a00640 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d167996b90 0x55d1679d3450 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d2aac362477c5f4 server_cookie=54e0cb87936c9 in_seq=0 out_seq=0 2024-02-21T07:51:03.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.519+0000 7f7da7400640 10 client.6136 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:03.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7da7400640 1 -- 172.21.15.100:0/540838276 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f7db402a070 con 0x55d167996b90 2024-02-21T07:51:03.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7da7400640 10 client.6136 handle_command_reply: tid=0 2024-02-21T07:51:03.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 client.6136 shutdown 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 msgr2=0x55d1679ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007820 tx=0x7f7db4000ed0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 shutdown_connections 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55d167996b90 0x55d1679d3450 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7da7400640 0 client.6136 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d167a15a20 0x55d167a28670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d167a0e740 0x55d1679ce6f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 --2- 172.21.15.100:0/540838276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d1679d3990 0x55d1679c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.520+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 >> 172.21.15.100:0/540838276 conn(0x55d1679d3070 msgr2=0x55d1679bdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.521+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 shutdown_connections 2024-02-21T07:51:03.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.521+0000 7f7dd042c740 1 -- 172.21.15.100:0/540838276 wait complete. 2024-02-21T07:51:03.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.523+0000 7f7dd042c740 20 client.6136 trim_cache size 0 max 16384 2024-02-21T07:51:03.526 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:03.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.524+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 msgr2=0x7f7da80a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.524+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 0x7f7da80a16b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80ed630 tx=0x7f7db4009040 comp rx=0 tx=0).stop 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.524+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 msgr2=0x7f7dc8177440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.524+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0036040 tx=0x7f7dc0004a40 comp rx=0 tx=0).stop 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 shutdown_connections 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7dc818b280 0x7f7dc8177440 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7da809f1f0 0x7f7da80a16b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dc818a4a0 0x7f7dc8176f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 --2- 172.21.15.100:0/4015154059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7dc8071450 0x7f7dc815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.525+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 >> 172.21.15.100:0/4015154059 conn(0x7f7dc80ce150 msgr2=0x7f7dc8186de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.526+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 shutdown_connections 2024-02-21T07:51:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.526+0000 7f7dc7e00640 1 -- 172.21.15.100:0/4015154059 wait complete. 2024-02-21T07:51:03.582 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:03.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:51:03.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.944+0000 7f7e76400640 1 Processor -- start 2024-02-21T07:51:03.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.944+0000 7f7e76400640 1 -- start start 2024-02-21T07:51:03.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.947+0000 7f7e76400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7e6810fa00 0x7f7e68006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.947+0000 7f7e76400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7e68115080 0x7f7e68115480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.947+0000 7f7e76400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6810fe80 con 0x7f7e6810bc40 2024-02-21T07:51:03.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.947+0000 7f7e76400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e68110160 con 0x7f7e6810fa00 2024-02-21T07:51:03.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.947+0000 7f7e76400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e68110440 con 0x7f7e68115080 2024-02-21T07:51:03.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.948+0000 7f7e75000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7e6810bc40 0x7f7e68056c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32790/0 (socket says 172.21.15.100:32790) 2024-02-21T07:51:03.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.948+0000 7f7e75000640 1 -- 172.21.15.100:0/875223431 learned_addr learned my addr 172.21.15.100:0/875223431 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:03.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.948+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/875223431 >> v2:172.21.15.156:3300/0 conn(0x7f7e6810fa00 0x7f7e68006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.949+0000 7f7e75a00640 1 --2- 172.21.15.100:0/875223431 >> v2:172.21.15.170:3300/0 conn(0x7f7e68115080 0x7f7e68115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.949+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420012649 0 0) 0x7f7e6810fe80 con 0x7f7e6810bc40 2024-02-21T07:51:03.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e58003520 con 0x7f7e6810bc40 2024-02-21T07:51:03.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1869655697 0 0) 0x7f7e58003520 con 0x7f7e6810bc40 2024-02-21T07:51:03.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 >> v2:172.21.15.170:3300/0 conn(0x7f7e68115080 msgr2=0x7f7e68115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 --2- 172.21.15.100:0/875223431 >> v2:172.21.15.170:3300/0 conn(0x7f7e68115080 0x7f7e68115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 >> v2:172.21.15.156:3300/0 conn(0x7f7e6810fa00 msgr2=0x7f7e68006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 --2- 172.21.15.100:0/875223431 >> v2:172.21.15.156:3300/0 conn(0x7f7e6810fa00 0x7f7e68006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68110720 con 0x7f7e6810bc40 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f7e64001670 con 0x7f7e6810bc40 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 >> v1:172.21.15.170:6789/0 conn(0x7f7e6810bc40 legacy=0x7f7e68056c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580039c0 0x7f7e58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580047c0 0x7f7e58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 0x7f7e5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68110160 con 0x7f7e580047c0 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68110440 con 0x7f7e580051d0 2024-02-21T07:51:03.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.950+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5800c180 con 0x7f7e580039c0 2024-02-21T07:51:03.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.951+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/875223431 >> v2:172.21.15.156:3300/0 conn(0x7f7e6810fa00 0x7f7e68006060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:03.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.952+0000 7f7e75a00640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 0x7f7e5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.952+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580047c0 0x7f7e58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.953+0000 7f7e75a00640 1 -- 172.21.15.100:0/875223431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580039c0 msgr2=0x7f7e58003de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.953+0000 7f7e75a00640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580039c0 0x7f7e58003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.953+0000 7f7e75a00640 1 -- 172.21.15.100:0/875223431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580047c0 msgr2=0x7f7e58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.953+0000 7f7e75a00640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580047c0 0x7f7e58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.953+0000 7f7e75a00640 1 -- 172.21.15.100:0/875223431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68110720 con 0x7f7e580051d0 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.954+0000 7f7e75a00640 1 -- 172.21.15.100:0/875223431 reap_dead start 2024-02-21T07:51:03.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.954+0000 7f7e75a00640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 0x7f7e5800b980 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e7004fc90 tx=0x7f7e580057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fca44d199af66ccd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.956+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700a7b20 con 0x7f7e580051d0 2024-02-21T07:51:03.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.956+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700ab070 con 0x7f7e580051d0 2024-02-21T07:51:03.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.957+0000 7f7e6f400640 1 -- 172.21.15.100:0/875223431 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700a7e80 con 0x7f7e580051d0 2024-02-21T07:51:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.958+0000 7f7e76400640 1 -- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 msgr2=0x7f7e5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.958+0000 7f7e76400640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 0x7f7e5800b980 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7e7004fc90 tx=0x7f7e580057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.959+0000 7f7e76400640 1 -- 172.21.15.100:0/875223431 shutdown_connections 2024-02-21T07:51:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.959+0000 7f7e76400640 1 --2- 172.21.15.100:0/875223431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e580051d0 0x7f7e5800b980 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.959+0000 7f7e76400640 1 -- 172.21.15.100:0/875223431 >> 172.21.15.100:0/875223431 conn(0x7f7e68052de0 msgr2=0x7f7e680531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.959+0000 7f7e76400640 1 -- 172.21.15.100:0/875223431 shutdown_connections 2024-02-21T07:51:03.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.961+0000 7f7e76400640 1 -- 172.21.15.100:0/875223431 wait complete. 2024-02-21T07:51:03.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.964+0000 7f7e76400640 1 Processor -- start 2024-02-21T07:51:03.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.965+0000 7f7e76400640 1 -- start start 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580051d0 0x7f7e680f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e681a87c0 0x7f7e681a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68007330 con 0x7f7e681a87c0 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68007750 con 0x7f7e681a7350 2024-02-21T07:51:03.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.967+0000 7f7e76400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681a8280 con 0x7f7e580051d0 2024-02-21T07:51:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.968+0000 7f7e75a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.968+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e681a87c0 0x7f7e681a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.968+0000 7f7e75a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45650/0 (socket says 172.21.15.100:45650) 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.968+0000 7f7e75a00640 1 -- 172.21.15.100:0/685544532 learned_addr learned my addr 172.21.15.100:0/685544532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.969+0000 7f7e75a00640 1 -- 172.21.15.100:0/685544532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580051d0 msgr2=0x7f7e680f58e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.969+0000 7f7e75a00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580051d0 0x7f7e680f58e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.969+0000 7f7e75a00640 1 -- 172.21.15.100:0/685544532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e681a87c0 msgr2=0x7f7e681a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.969+0000 7f7e75a00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e681a87c0 0x7f7e681a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.969+0000 7f7e75a00640 1 -- 172.21.15.100:0/685544532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680066b0 con 0x7f7e681a7350 2024-02-21T07:51:03.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.970+0000 7f7e75a00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e70075540 tx=0x7f7e70067a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.970+0000 7f7e6cc00640 1 -- 172.21.15.100:0/685544532 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700b1c00 con 0x7f7e681a7350 2024-02-21T07:51:03.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.970+0000 7f7e6cc00640 1 -- 172.21.15.100:0/685544532 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700b1d60 con 0x7f7e681a7350 2024-02-21T07:51:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.970+0000 7f7e6cc00640 1 -- 172.21.15.100:0/685544532 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700bc6b0 con 0x7f7e681a7350 2024-02-21T07:51:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.971+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68006990 con 0x7f7e681a7350 2024-02-21T07:51:03.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.971+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68006f50 con 0x7f7e681a7350 2024-02-21T07:51:03.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.977+0000 7f7e7a60b740 1 Processor -- start 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.979+0000 7f7e6cc00640 1 -- 172.21.15.100:0/685544532 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7e700bc810 con 0x7f7e681a7350 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.980+0000 7f7e7a60b740 1 -- start start 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018070 0x55fe1e018450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1df4b210 con 0x55fe1e018070 2024-02-21T07:51:03.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1df48740 con 0x55fe1e053740 2024-02-21T07:51:03.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1df43f20 con 0x55fe1e018990 2024-02-21T07:51:03.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.982+0000 7f7e6cc00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 0x7f7e500a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.983+0000 7f7e6cc00640 1 -- 172.21.15.100:0/685544532 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7e701670a0 con 0x7f7e681a7350 2024-02-21T07:51:03.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44336/0 (socket says 172.21.15.100:44336) 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 -- 172.21.15.100:0/925031270 learned_addr learned my addr 172.21.15.100:0/925031270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018070 0x55fe1e018450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75a00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 0x7f7e500a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 -- 172.21.15.100:0/925031270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 msgr2=0x55fe1e0544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 -- 172.21.15.100:0/925031270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018070 msgr2=0x55fe1e018450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018070 0x55fe1e018450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e75000640 1 -- 172.21.15.100:0/925031270 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe1df05df0 con 0x55fe1e018990 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.984+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.985+0000 7f7e75000640 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7e64007a60 tx=0x7f7e64007f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d107bb0f63534c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.985+0000 7f7e75a00640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 0x7f7e500a16b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e70134b10 tx=0x7f7e700b3040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.985+0000 7f7e61600640 1 -- 172.21.15.100:0/925031270 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640074e0 con 0x55fe1e018990 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.985+0000 7f7e61600640 1 -- 172.21.15.100:0/925031270 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64007640 con 0x55fe1e018990 2024-02-21T07:51:03.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.985+0000 7f7e61600640 1 -- 172.21.15.100:0/925031270 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ca60 con 0x55fe1e018990 2024-02-21T07:51:03.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.986+0000 7f7e7a60b740 1 -- 172.21.15.100:0/925031270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 msgr2=0x55fe1e053200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:03.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.986+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7e64007a60 tx=0x7f7e64007f20 comp rx=0 tx=0).stop 2024-02-21T07:51:03.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 -- 172.21.15.100:0/925031270 shutdown_connections 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1e053200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/925031270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018070 0x55fe1e018450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 -- 172.21.15.100:0/925031270 >> 172.21.15.100:0/925031270 conn(0x55fe1dfda640 msgr2=0x55fe1dfdb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 -- 172.21.15.100:0/925031270 shutdown_connections 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.987+0000 7f7e7a60b740 1 -- 172.21.15.100:0/925031270 wait complete. 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.988+0000 7f7e7a60b740 1 -- start start 2024-02-21T07:51:03.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.989+0000 7f7e7a60b740 1 Processor -- start 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018990 0x55fe1e003020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1dee9150 con 0x55fe1e018990 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1dee8df0 con 0x55fe1e05d140 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1dcb21c0 con 0x55fe1e053740 2024-02-21T07:51:03.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.991+0000 7f7e7a60b740 10 client.0 _ll_register_callbacks cb 0x55fe1df382b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.993+0000 7f7e75000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.993+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.993+0000 7f7e75000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44352/0 (socket says 172.21.15.100:44352) 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.993+0000 7f7e75000640 1 -- 172.21.15.100:0/2676326942 learned_addr learned my addr 172.21.15.100:0/2676326942 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.993+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45666/0 (socket says 172.21.15.100:45666) 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 -- 172.21.15.100:0/2676326942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 msgr2=0x55fe1e05c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 -- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018990 msgr2=0x55fe1e003020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018990 0x55fe1e003020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:03.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 -- 172.21.15.100:0/2676326942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64001d30 con 0x55fe1e053740 2024-02-21T07:51:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e75000640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7e64001420 tx=0x7f7e64000f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f96313124969cccb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e56000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ce70 con 0x55fe1e053740 2024-02-21T07:51:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.994+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7e640047e0 con 0x55fe1e053740 2024-02-21T07:51:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.995+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:04.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.997+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe1dc437e0 con 0x55fe1e053740 2024-02-21T07:51:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.998+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e640049a0 con 0x55fe1e053740 2024-02-21T07:51:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.998+0000 7f7e7a60b740 10 client.6107 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.998+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fe1df425a0 con 0x55fe1e053740 2024-02-21T07:51:04.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.998+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe1dc437e0 con 0x55fe1e053740 2024-02-21T07:51:04.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.998+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e64004b00 con 0x55fe1e053740 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 10 client.6107 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 10 client.6107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 20 client.6107 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e01b580 0x55fe1e01b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 4 client.6107 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:03.999+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe1dc80720 con 0x55fe1e01b580 2024-02-21T07:51:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.000+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e01b580 0x55fe1e01b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.001+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e01b580 0x55fe1e01b960 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79cfcf188d0fbc5 server_cookie=fc01bff53dbff219 in_seq=0 out_seq=0 2024-02-21T07:51:04.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.006+0000 7f7e56000640 10 client.6107 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:04.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.006+0000 7f7e56000640 1 -- 172.21.15.100:0/2676326942 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fe1dc80720 con 0x55fe1e01b580 2024-02-21T07:51:04.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.006+0000 7f7e56000640 10 client.6107 handle_command_reply: tid=0 2024-02-21T07:51:04.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.007+0000 7f7e7a60b740 1 client.6107 shutdown 2024-02-21T07:51:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.008+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 msgr2=0x55fe1e0170b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.008+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7e64001420 tx=0x7f7e64000f50 comp rx=0 tx=0).stop 2024-02-21T07:51:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.008+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 shutdown_connections 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.008+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e01b580 0x55fe1e01b960 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.009+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e05c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.009+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e053740 0x55fe1e0170b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.009+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2676326942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e018990 0x55fe1e003020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.009+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 >> 172.21.15.100:0/2676326942 conn(0x55fe1e018070 msgr2=0x55fe1dfdc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.009+0000 7f7e56000640 0 client.6107 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.010+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 shutdown_connections 2024-02-21T07:51:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.010+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2676326942 wait complete. 2024-02-21T07:51:04.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.011+0000 7f7e7a60b740 20 client.6107 trim_cache size 0 max 16384 2024-02-21T07:51:04.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.035+0000 7f7e7a60b740 1 Processor -- start 2024-02-21T07:51:04.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.036+0000 7f7e7a60b740 1 -- start start 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e053740 0x55fe1e052980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e002e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1e016eb0 con 0x55fe1e053740 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1e064290 con 0x55fe1e05d140 2024-02-21T07:51:04.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.037+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1e003750 con 0x55fe1e018990 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44358/0 (socket says 172.21.15.100:44358) 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e6fe00640 1 -- 172.21.15.100:0/2190263145 learned_addr learned my addr 172.21.15.100:0/2190263145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e75000640 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e053740 0x55fe1e052980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e002e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.038+0000 7f7e6fe00640 1 -- 172.21.15.100:0/2190263145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 msgr2=0x55fe1e002e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e002e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e6fe00640 1 -- 172.21.15.100:0/2190263145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e053740 msgr2=0x55fe1e052980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e053740 0x55fe1e052980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e6fe00640 1 -- 172.21.15.100:0/2190263145 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe1dedeab0 con 0x55fe1e018990 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7e680fb850 tx=0x7f7e5c009600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb689218af00da3f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.039+0000 7f7e60c00640 1 -- 172.21.15.100:0/2190263145 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0040f0 con 0x55fe1e018990 2024-02-21T07:51:04.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.040+0000 7f7e60c00640 1 -- 172.21.15.100:0/2190263145 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c01e070 con 0x55fe1e018990 2024-02-21T07:51:04.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.040+0000 7f7e60c00640 1 -- 172.21.15.100:0/2190263145 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c004450 con 0x55fe1e018990 2024-02-21T07:51:04.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.042+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2190263145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 msgr2=0x55fe1dfdc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.042+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7e680fb850 tx=0x7f7e5c009600 comp rx=0 tx=0).stop 2024-02-21T07:51:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2190263145 shutdown_connections 2024-02-21T07:51:04.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e05d140 0x55fe1e002e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e053740 0x55fe1e052980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2190263145 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e018990 0x55fe1dfdc1b0 secure :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7e680fb850 tx=0x7f7e5c009600 comp rx=0 tx=0).stop 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2190263145 >> 172.21.15.100:0/2190263145 conn(0x55fe1e018070 msgr2=0x55fe1e06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2190263145 shutdown_connections 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.043+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2190263145 wait complete. 2024-02-21T07:51:04.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.044+0000 7f7e7a60b740 1 -- start start 2024-02-21T07:51:04.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.044+0000 7f7e7a60b740 1 Processor -- start 2024-02-21T07:51:04.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.045+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.045+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 0x55fe1dfd7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e7a60b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 0x55fe1e014fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1dfd6670 con 0x55fe1e05d140 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1dfe1210 con 0x55fe1e053740 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e7a60b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe1e015650 con 0x55fe1e05c600 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e7a60b740 10 client.0 _ll_register_callbacks cb 0x7f7e64001930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e6fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45682/0 (socket says 172.21.15.100:45682) 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e6fe00640 1 -- 172.21.15.100:0/2223830877 learned_addr learned my addr 172.21.15.100:0/2223830877 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e75000640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 0x55fe1dfd7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.046+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 0x55fe1e014fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 -- 172.21.15.100:0/2223830877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 msgr2=0x55fe1e014fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 0x55fe1e014fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 -- 172.21.15.100:0/2223830877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 msgr2=0x55fe1e0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0b4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 -- 172.21.15.100:0/2223830877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c027040 con 0x55fe1e05d140 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 0x55fe1e014fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e75000640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 0x55fe1dfd7d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f90 tx=0x7f7e64001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dd89e0e79a0d25 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e56000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400c570 con 0x55fe1e05d140 2024-02-21T07:51:04.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7e6401f590 con 0x55fe1e05d140 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.047+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe1e051f90 con 0x55fe1e05d140 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e64001bb0 con 0x55fe1e05d140 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 10 client.5988 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fe1df04650 con 0x55fe1e05d140 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6403e020 con 0x55fe1e05d140 2024-02-21T07:51:04.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7e64030070 con 0x55fe1e05d140 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 10 client.5988 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 10 client.5988 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 20 client.5988 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e00c250 0x55fe1dfdc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 4 client.5988 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.049+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f7e64007640 con 0x55fe1e00c250 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.050+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e00c250 0x55fe1dfdc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.050+0000 7f7e6fe00640 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e00c250 0x55fe1dfdc0b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2fe37767bddb2ed6 server_cookie=e5504e87e169c705 in_seq=0 out_seq=0 2024-02-21T07:51:04.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.050+0000 7f7e56000640 10 client.5988 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:04.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e56000640 1 -- 172.21.15.100:0/2223830877 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f7e64007640 con 0x55fe1e00c250 2024-02-21T07:51:04.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e56000640 10 client.5988 handle_command_reply: tid=0 2024-02-21T07:51:04.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 client.5988 shutdown 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 msgr2=0x55fe1dfd7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 0x55fe1dfd7d90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000f90 tx=0x7f7e64001a60 comp rx=0 tx=0).stop 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 shutdown_connections 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fe1e05c600 0x55fe1e014fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fe1e05d140 0x55fe1dfd7d90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55fe1e00c250 0x55fe1dfdc0b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 --2- 172.21.15.100:0/2223830877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe1e053740 0x55fe1e0b4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 >> 172.21.15.100:0/2223830877 conn(0x55fe1e018070 msgr2=0x55fe1dfd8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e56000640 0 client.5988 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:04.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.051+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 shutdown_connections 2024-02-21T07:51:04.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.052+0000 7f7e7a60b740 1 -- 172.21.15.100:0/2223830877 wait complete. 2024-02-21T07:51:04.057 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.052+0000 7f7e7a60b740 20 client.5988 trim_cache size 0 max 16384 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.053+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 msgr2=0x7f7e500a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.053+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 0x7f7e500a16b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7e70134b10 tx=0x7f7e700b3040 comp rx=0 tx=0).stop 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.053+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 msgr2=0x7f7e681a77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.053+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e70075540 tx=0x7f7e70067a30 comp rx=0 tx=0).stop 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 shutdown_connections 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e681a7350 0x7f7e681a77d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7e5009f1f0 0x7f7e500a16b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e681a87c0 0x7f7e681a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 --2- 172.21.15.100:0/685544532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7e580051d0 0x7f7e680f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 >> 172.21.15.100:0/685544532 conn(0x7f7e68052de0 msgr2=0x7f7e68051430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.054+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 shutdown_connections 2024-02-21T07:51:04.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.055+0000 7f7e76400640 1 -- 172.21.15.100:0/685544532 wait complete. 2024-02-21T07:51:04.091 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:04.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:51:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.428+0000 7f734ee00640 1 Processor -- start 2024-02-21T07:51:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.428+0000 7f734ee00640 1 -- start start 2024-02-21T07:51:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.431+0000 7f734ee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f734818a4a0 0x7f7348070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.431+0000 7f734ee00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f734818b280 0x7f734806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.431+0000 7f734da00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f734818a4a0 0x7f7348070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.433+0000 7f734d000640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7348071450 0x7f734818ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:59710/0 (socket says 172.21.15.100:59710) 2024-02-21T07:51:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.433+0000 7f734d000640 1 -- 172.21.15.100:0/2150531482 learned_addr learned my addr 172.21.15.100:0/2150531482 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.433+0000 7f734ee00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734806ddb0 con 0x7f7348071450 2024-02-21T07:51:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.433+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734806ed10 con 0x7f734818b280 2024-02-21T07:51:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.433+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734818db30 con 0x7f734818a4a0 2024-02-21T07:51:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.434+0000 7f734e400640 1 --2- 172.21.15.100:0/2150531482 >> v2:172.21.15.156:3300/0 conn(0x7f734818b280 0x7f734806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.435+0000 7f7347e00640 1 -- 172.21.15.100:0/2150531482 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466756922 0 0) 0x7f734806ddb0 con 0x7f7348071450 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.435+0000 7f7347e00640 1 -- 172.21.15.100:0/2150531482 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7330003520 con 0x7f7348071450 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.436+0000 7f734e400640 1 -- 172.21.15.100:0/2150531482 >> v2:172.21.15.170:3300/0 conn(0x7f734818a4a0 msgr2=0x7f7348070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.436+0000 7f734e400640 1 --2- 172.21.15.100:0/2150531482 >> v2:172.21.15.170:3300/0 conn(0x7f734818a4a0 0x7f7348070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.436+0000 7f734e400640 1 -- 172.21.15.100:0/2150531482 >> v1:172.21.15.156:6789/0 conn(0x7f7348071450 legacy=0x7f734818ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.436+0000 7f734e400640 1 -- 172.21.15.100:0/2150531482 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734806e090 con 0x7f734818b280 2024-02-21T07:51:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.439+0000 7f734e400640 1 --2- 172.21.15.100:0/2150531482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f734818b280 0x7f734806f180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f734808d5e0 tx=0x7f734002bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e8316e8a69fa45e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.439+0000 7f7347e00640 1 -- 172.21.15.100:0/2150531482 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734002cb50 con 0x7f734818b280 2024-02-21T07:51:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.439+0000 7f7347e00640 1 -- 172.21.15.100:0/2150531482 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734002ccb0 con 0x7f734818b280 2024-02-21T07:51:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.439+0000 7f7347e00640 1 -- 172.21.15.100:0/2150531482 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340034660 con 0x7f734818b280 2024-02-21T07:51:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f734818b280 msgr2=0x7f734806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 --2- 172.21.15.100:0/2150531482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f734818b280 0x7f734806f180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f734808d5e0 tx=0x7f734002bda0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 shutdown_connections 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 --2- 172.21.15.100:0/2150531482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f734818b280 0x7f734806f180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 --2- 172.21.15.100:0/2150531482 >> v2:172.21.15.170:3300/0 conn(0x7f734818a4a0 0x7f7348070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.440+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 >> 172.21.15.100:0/2150531482 conn(0x7f73480ce150 msgr2=0x7f73480ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.442+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 shutdown_connections 2024-02-21T07:51:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.444+0000 7f734ee00640 1 -- 172.21.15.100:0/2150531482 wait complete. 2024-02-21T07:51:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.449+0000 7f734ee00640 1 Processor -- start 2024-02-21T07:51:04.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.449+0000 7f734ee00640 1 -- start start 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 0x7f7348226b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734817ba80 con 0x7f734818b280 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348227040 con 0x7f7348071450 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.453+0000 7f734ee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7348227310 con 0x7f734818a4a0 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 0x7f7348226b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44374/0 (socket says 172.21.15.100:44374) 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45698/0 (socket says 172.21.15.100:45698) 2024-02-21T07:51:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 -- 172.21.15.100:0/2223748857 learned_addr learned my addr 172.21.15.100:0/2223748857 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 -- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 msgr2=0x7f73482240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 -- 172.21.15.100:0/2223748857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 msgr2=0x7f7348226b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 0x7f7348226b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 -- 172.21.15.100:0/2223748857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009a70 con 0x7f734818a4a0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734e400640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 0x7f7348226b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734da00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.454+0000 7f734d000640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c430 tx=0x7f733c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.455+0000 7f7345600640 1 -- 172.21.15.100:0/2223748857 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c005ce0 con 0x7f734818a4a0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.455+0000 7f7345600640 1 -- 172.21.15.100:0/2223748857 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c005e40 con 0x7f734818a4a0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.455+0000 7f7345600640 1 -- 172.21.15.100:0/2223748857 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0072d0 con 0x7f734818a4a0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.455+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73482275f0 con 0x7f734818a4a0 2024-02-21T07:51:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.455+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73482238a0 con 0x7f734818a4a0 2024-02-21T07:51:04.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.460+0000 7f7345600640 1 -- 172.21.15.100:0/2223748857 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f733c007430 con 0x7f734818a4a0 2024-02-21T07:51:04.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.460+0000 7f7353030740 1 Processor -- start 2024-02-21T07:51:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.461+0000 7f7353030740 1 -- start start 2024-02-21T07:51:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.463+0000 7f7345600640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 0x7f73280a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.463+0000 7f7345600640 1 -- 172.21.15.100:0/2223748857 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f733c0c90f0 con 0x7f734818a4a0 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f734e400640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 0x7f73280a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9070 0x55d3830e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d3831254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d38301c210 con 0x55d3830e9990 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d383019740 con 0x55d3830e9070 2024-02-21T07:51:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.464+0000 7f7353030740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d383014f20 con 0x55d383124740 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49222/0 (socket says 172.21.15.100:49222) 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 -- 172.21.15.100:0/3183147648 learned_addr learned my addr 172.21.15.100:0/3183147648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734da00640 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9070 0x55d3830e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 -- 172.21.15.100:0/3183147648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 msgr2=0x55d3831254d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d3831254d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 -- 172.21.15.100:0/3183147648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9070 msgr2=0x55d3830e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9070 0x55d3830e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.465+0000 7f734d000640 1 -- 172.21.15.100:0/3183147648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d382fd6df0 con 0x55d3830e9990 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.466+0000 7f734d000640 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f733c0070a0 tx=0x7f733c097460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9db6fd263a9c5c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.466+0000 7f734e400640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 0x7f73280a1590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7340036000 tx=0x7f7340030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.466+0000 7f733a000640 1 -- 172.21.15.100:0/3183147648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c094f30 con 0x55d3830e9990 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.466+0000 7f733a000640 1 -- 172.21.15.100:0/3183147648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0932a0 con 0x55d3830e9990 2024-02-21T07:51:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.466+0000 7f733a000640 1 -- 172.21.15.100:0/3183147648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c094f30 con 0x55d3830e9990 2024-02-21T07:51:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.467+0000 7f7353030740 1 -- 172.21.15.100:0/3183147648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 msgr2=0x55d383124200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.467+0000 7f7353030740 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f733c0070a0 tx=0x7f733c097460 comp rx=0 tx=0).stop 2024-02-21T07:51:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.468+0000 7f7353030740 1 -- 172.21.15.100:0/3183147648 shutdown_connections 2024-02-21T07:51:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.468+0000 7f7353030740 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d3831254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.468+0000 7f7353030740 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383124200 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.468+0000 7f7353030740 1 --2- 172.21.15.100:0/3183147648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9070 0x55d3830e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.468+0000 7f7353030740 1 -- 172.21.15.100:0/3183147648 >> 172.21.15.100:0/3183147648 conn(0x55d3830ab640 msgr2=0x55d3830ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.469+0000 7f7353030740 1 -- 172.21.15.100:0/3183147648 shutdown_connections 2024-02-21T07:51:04.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.469+0000 7f7353030740 1 -- 172.21.15.100:0/3183147648 wait complete. 2024-02-21T07:51:04.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.470+0000 7f7353030740 1 -- start start 2024-02-21T07:51:04.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.471+0000 7f7353030740 1 Processor -- start 2024-02-21T07:51:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.475+0000 7f7353030740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383112450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f734da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383112450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d382fba150 con 0x55d383124740 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d382fb9df0 con 0x55d3830e9990 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d382d831c0 con 0x55d3830dbc10 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f7353030740 10 client.0 _ll_register_callbacks cb 0x55d3830092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.476+0000 7f734d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.477+0000 7f734d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49226/0 (socket says 172.21.15.100:49226) 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.477+0000 7f734d000640 1 -- 172.21.15.100:0/3495610075 learned_addr learned my addr 172.21.15.100:0/3495610075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.477+0000 7f734d000640 1 -- 172.21.15.100:0/3495610075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 msgr2=0x55d3830dc6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:04.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.477+0000 7f734d000640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830dc6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.477+0000 7f734d000640 1 -- 172.21.15.100:0/3495610075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 msgr2=0x55d383112450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f734d000640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383112450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f734d000640 1 -- 172.21.15.100:0/3495610075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73482238a0 con 0x55d383124740 2024-02-21T07:51:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f734d000640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f733c0c93d0 tx=0x7f733c0c8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae421a2e32a7c21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f732ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c092ed0 con 0x55d383124740 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f733c093410 con 0x55d383124740 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.478+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d382d147e0 con 0x55d383124740 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.479+0000 7f734da00640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.479+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f733c076b70 con 0x55d383124740 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.479+0000 7f7353030740 10 client.5997 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:04.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.479+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d3830135a0 con 0x55d383124740 2024-02-21T07:51:04.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c07d020 con 0x55d383124740 2024-02-21T07:51:04.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f733c076cd0 con 0x55d383124740 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 10 client.5997 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 10 client.5997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 20 client.5997 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383130d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 4 client.5997 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:04.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.480+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d382d51720 con 0x55d38312e570 2024-02-21T07:51:04.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.481+0000 7f734da00640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383130d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.483+0000 7f734da00640 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383130d60 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6103f73f92aca29d server_cookie=d879b334d9e55adc in_seq=0 out_seq=0 2024-02-21T07:51:04.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.483+0000 7f732ea00640 10 client.5997 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:04.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.485+0000 7f732ea00640 1 -- 172.21.15.100:0/3495610075 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d382d51720 con 0x55d38312e570 2024-02-21T07:51:04.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.485+0000 7f732ea00640 10 client.5997 handle_command_reply: tid=0 2024-02-21T07:51:04.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.485+0000 7f7353030740 1 client.5997 shutdown 2024-02-21T07:51:04.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.486+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 msgr2=0x55d38312f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.486+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f733c0c93d0 tx=0x7f733c0c8040 comp rx=0 tx=0).stop 2024-02-21T07:51:04.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 shutdown_connections 2024-02-21T07:51:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383130d60 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f732ea00640 0 client.5997 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830dc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d383124740 0x55d38312f500 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 --2- 172.21.15.100:0/3495610075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.487+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 >> 172.21.15.100:0/3495610075 conn(0x55d3830e9070 msgr2=0x55d3830ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.488+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 shutdown_connections 2024-02-21T07:51:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.488+0000 7f7353030740 1 -- 172.21.15.100:0/3495610075 wait complete. 2024-02-21T07:51:04.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.488+0000 7f7353030740 20 client.5997 trim_cache size 0 max 16384 2024-02-21T07:51:04.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.519+0000 7f7353030740 1 Processor -- start 2024-02-21T07:51:04.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.519+0000 7f7353030740 1 -- start start 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.520+0000 7f7353030740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830dbc10 0x55d383116410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.520+0000 7f7353030740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383124d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.520+0000 7f7353030740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.521+0000 7f7353030740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3831357c0 con 0x55d3830dbc10 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.521+0000 7f7353030740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d38312b3e0 con 0x55d3830e9990 2024-02-21T07:51:04.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.521+0000 7f7353030740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d383120830 con 0x55d383124740 2024-02-21T07:51:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.524+0000 7f734e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.524+0000 7f734e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44394/0 (socket says 172.21.15.100:44394) 2024-02-21T07:51:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.524+0000 7f734e400640 1 -- 172.21.15.100:0/1405526831 learned_addr learned my addr 172.21.15.100:0/1405526831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.524+0000 7f734d000640 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383124d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734da00640 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830dbc10 0x55d383116410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734e400640 1 -- 172.21.15.100:0/1405526831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 msgr2=0x55d383124d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734e400640 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383124d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734e400640 1 -- 172.21.15.100:0/1405526831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830dbc10 msgr2=0x55d383116410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734e400640 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830dbc10 0x55d383116410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.527+0000 7f734e400640 1 -- 172.21.15.100:0/1405526831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348178f80 con 0x55d383124740 2024-02-21T07:51:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.532+0000 7f734e400640 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f734002bde0 tx=0x7f734002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56af8f06e52726c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.533+0000 7f7339600640 1 -- 172.21.15.100:0/1405526831 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734004b640 con 0x55d383124740 2024-02-21T07:51:04.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.533+0000 7f7339600640 1 -- 172.21.15.100:0/1405526831 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734004b7a0 con 0x55d383124740 2024-02-21T07:51:04.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.533+0000 7f7339600640 1 -- 172.21.15.100:0/1405526831 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734004bb10 con 0x55d383124740 2024-02-21T07:51:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 -- 172.21.15.100:0/1405526831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 msgr2=0x55d383182f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f734002bde0 tx=0x7f734002e000 comp rx=0 tx=0).stop 2024-02-21T07:51:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 -- 172.21.15.100:0/1405526831 shutdown_connections 2024-02-21T07:51:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d383124740 0x55d383182f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d3830e9990 0x55d383124d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.534+0000 7f7353030740 1 --2- 172.21.15.100:0/1405526831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830dbc10 0x55d383116410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.535+0000 7f7353030740 1 -- 172.21.15.100:0/1405526831 >> 172.21.15.100:0/1405526831 conn(0x55d3830e9070 msgr2=0x55d3830ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.535+0000 7f7353030740 1 -- 172.21.15.100:0/1405526831 shutdown_connections 2024-02-21T07:51:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.535+0000 7f7353030740 1 -- 172.21.15.100:0/1405526831 wait complete. 2024-02-21T07:51:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.536+0000 7f7353030740 1 -- start start 2024-02-21T07:51:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.537+0000 7f7353030740 1 Processor -- start 2024-02-21T07:51:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.539+0000 7f7353030740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.539+0000 7f7353030740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383108000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f7353030740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d383124740 0x55d383181660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f734da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f734da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44400/0 (socket says 172.21.15.100:44400) 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d383121c00 con 0x55d3830e9990 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3830a7540 con 0x55d383124740 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d383121730 con 0x55d3830dbc10 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f7353030740 10 client.0 _ll_register_callbacks cb 0x7f733c096a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f734d000640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383108000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f734da00640 1 -- 172.21.15.100:0/983305027 learned_addr learned my addr 172.21.15.100:0/983305027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.540+0000 7f734e400640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d383124740 0x55d383181660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.541+0000 7f734d000640 1 -- 172.21.15.100:0/983305027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 msgr2=0x55d3830a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.541+0000 7f734d000640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.541+0000 7f734d000640 1 -- 172.21.15.100:0/983305027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d383124740 msgr2=0x55d383181660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.541+0000 7f734d000640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d383124740 0x55d383181660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.541+0000 7f734d000640 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734806e090 con 0x55d3830e9990 2024-02-21T07:51:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.542+0000 7f734da00640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.542+0000 7f734d000640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383108000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f733c094ee0 tx=0x7f733c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6381b084a0d2821d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f732ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c092b80 con 0x55d3830e9990 2024-02-21T07:51:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f733c07e080 con 0x55d3830e9990 2024-02-21T07:51:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f733c0932a0 con 0x55d3830e9990 2024-02-21T07:51:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f733c09ae00 con 0x55d3830e9990 2024-02-21T07:51:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f7353030740 10 client.6000 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.544+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d382fafab0 con 0x55d3830e9990 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c0932a0 con 0x55d3830e9990 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f733c080020 con 0x55d3830e9990 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 10 client.6000 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 10 client.6000 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 20 client.6000 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383181ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 4 client.6000 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:04.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.545+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d382da0890 con 0x55d38312e570 2024-02-21T07:51:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.546+0000 7f734da00640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383181ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.548+0000 7f732ea00640 10 client.6000 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.548+0000 7f734da00640 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383181ba0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff91f0dd8e8df26 server_cookie=c59bcce158e3b739 in_seq=0 out_seq=0 2024-02-21T07:51:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.549+0000 7f732ea00640 1 -- 172.21.15.100:0/983305027 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d382da0890 con 0x55d38312e570 2024-02-21T07:51:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.549+0000 7f732ea00640 10 client.6000 handle_command_reply: tid=0 2024-02-21T07:51:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.549+0000 7f7353030740 1 client.6000 shutdown 2024-02-21T07:51:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.550+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 msgr2=0x55d383108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.550+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383108000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f733c094ee0 tx=0x7f733c000ed0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 shutdown_connections 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d38312e570 0x55d383181ba0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d383124740 0x55d383181660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d3830e9990 0x55d383108000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 --2- 172.21.15.100:0/983305027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d3830dbc10 0x55d3830a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 >> 172.21.15.100:0/983305027 conn(0x55d3830e9070 msgr2=0x55d3830a6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f732ea00640 0 client.6000 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 shutdown_connections 2024-02-21T07:51:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.551+0000 7f7353030740 1 -- 172.21.15.100:0/983305027 wait complete. 2024-02-21T07:51:04.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.552+0000 7f7353030740 20 client.6000 trim_cache size 0 max 16384 2024-02-21T07:51:04.556 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 msgr2=0x7f73280a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 0x7f73280a1590 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7340036000 tx=0x7f7340030000 comp rx=0 tx=0).stop 2024-02-21T07:51:04.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 msgr2=0x7f734817b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c430 tx=0x7f733c00c8f0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 shutdown_connections 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f732809f0d0 0x7f73280a1590 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f734818b280 0x7f7348226b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f734818a4a0 0x7f734817b540 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 --2- 172.21.15.100:0/2223748857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7348071450 0x7f73482240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 >> 172.21.15.100:0/2223748857 conn(0x7f73480ce150 msgr2=0x7f734817c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 shutdown_connections 2024-02-21T07:51:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:04.553+0000 7f734ee00640 1 -- 172.21.15.100:0/2223748857 wait complete. 2024-02-21T07:51:05.592 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:51:05.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:51:05.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:51:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.006+0000 7fd296600640 1 Processor -- start 2024-02-21T07:51:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.007+0000 7fd296600640 1 -- start start 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd29018a3b0 0x7fd2900cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2900cc8c0 0x7fd29018f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd29018f880 0x7fd29006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29018ef20 con 0x7fd29018f880 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29006e960 con 0x7fd2900cc8c0 2024-02-21T07:51:06.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.010+0000 7fd296600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29018e2a0 con 0x7fd29018a3b0 2024-02-21T07:51:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.011+0000 7fd28fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2900cc8c0 0x7fd29018f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.011+0000 7fd28fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd2900cc8c0 0x7fd29018f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45730/0 (socket says 172.21.15.100:45730) 2024-02-21T07:51:06.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.011+0000 7fd28fe00640 1 -- 172.21.15.100:0/3980147287 learned_addr learned my addr 172.21.15.100:0/3980147287 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.012+0000 7fd28fe00640 1 -- 172.21.15.100:0/3980147287 >> v2:172.21.15.170:3300/0 conn(0x7fd29018a3b0 msgr2=0x7fd2900cc380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.012+0000 7fd28fe00640 1 --2- 172.21.15.100:0/3980147287 >> v2:172.21.15.170:3300/0 conn(0x7fd29018a3b0 0x7fd2900cc380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.012+0000 7fd28fe00640 1 -- 172.21.15.100:0/3980147287 >> v2:172.21.15.100:3300/0 conn(0x7fd29018f880 msgr2=0x7fd29006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.012+0000 7fd28fe00640 1 --2- 172.21.15.100:0/3980147287 >> v2:172.21.15.100:3300/0 conn(0x7fd29018f880 0x7fd29006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.012+0000 7fd28fe00640 1 -- 172.21.15.100:0/3980147287 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29018e580 con 0x7fd2900cc8c0 2024-02-21T07:51:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.015+0000 7fd28fe00640 1 --2- 172.21.15.100:0/3980147287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2900cc8c0 0x7fd29018f340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd29008d110 tx=0x7fd27c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8363c5f10923dcfb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.015+0000 7fd28f400640 1 -- 172.21.15.100:0/3980147287 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c02e070 con 0x7fd2900cc8c0 2024-02-21T07:51:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.015+0000 7fd28f400640 1 -- 172.21.15.100:0/3980147287 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0315a0 con 0x7fd2900cc8c0 2024-02-21T07:51:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.015+0000 7fd28f400640 1 -- 172.21.15.100:0/3980147287 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c031930 con 0x7fd2900cc8c0 2024-02-21T07:51:06.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.017+0000 7fd296600640 1 -- 172.21.15.100:0/3980147287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2900cc8c0 msgr2=0x7fd29018f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.017+0000 7fd296600640 1 --2- 172.21.15.100:0/3980147287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2900cc8c0 0x7fd29018f340 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd29008d110 tx=0x7fd27c02b840 comp rx=0 tx=0).stop 2024-02-21T07:51:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 -- 172.21.15.100:0/3980147287 shutdown_connections 2024-02-21T07:51:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 --2- 172.21.15.100:0/3980147287 >> v2:172.21.15.100:3300/0 conn(0x7fd29018f880 0x7fd29006d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 --2- 172.21.15.100:0/3980147287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd2900cc8c0 0x7fd29018f340 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 --2- 172.21.15.100:0/3980147287 >> v2:172.21.15.170:3300/0 conn(0x7fd29018a3b0 0x7fd2900cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 -- 172.21.15.100:0/3980147287 >> 172.21.15.100:0/3980147287 conn(0x7fd2900f6580 msgr2=0x7fd2900f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 -- 172.21.15.100:0/3980147287 shutdown_connections 2024-02-21T07:51:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.024+0000 7fd296600640 1 -- 172.21.15.100:0/3980147287 wait complete. 2024-02-21T07:51:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.027+0000 7fd296600640 1 Processor -- start 2024-02-21T07:51:06.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.030+0000 7fd296600640 1 -- start start 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 0x7fd290223f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd29018f880 0x7fd290220a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290225500 con 0x7fd2900cc8c0 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290224610 con 0x7fd29018f880 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.032+0000 7fd296600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2902248f0 con 0x7fd29018a3b0 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44420/0 (socket says 172.21.15.100:44420) 2024-02-21T07:51:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 -- 172.21.15.100:0/188199529 learned_addr learned my addr 172.21.15.100:0/188199529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd295c00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd29018f880 0x7fd290220a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 -- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd29018f880 msgr2=0x7fd290220a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd29018f880 0x7fd290220a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.033+0000 7fd28fe00640 1 -- 172.21.15.100:0/188199529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 msgr2=0x7fd290223f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd295200640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 0x7fd290223f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd28fe00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 0x7fd290223f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd28fe00640 1 -- 172.21.15.100:0/188199529 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0094d0 con 0x7fd29018a3b0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd295200640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 0x7fd290223f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd28fe00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000c00 tx=0x7fd27c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.034+0000 7fd28cc00640 1 -- 172.21.15.100:0/188199529 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c032840 con 0x7fd29018a3b0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.035+0000 7fd28cc00640 1 -- 172.21.15.100:0/188199529 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0329a0 con 0x7fd29018a3b0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.035+0000 7fd28cc00640 1 -- 172.21.15.100:0/188199529 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c032d50 con 0x7fd29018a3b0 2024-02-21T07:51:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.035+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd290224bd0 con 0x7fd29018a3b0 2024-02-21T07:51:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.035+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290225190 con 0x7fd29018a3b0 2024-02-21T07:51:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.039+0000 7fd28cc00640 1 -- 172.21.15.100:0/188199529 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd27c03b3f0 con 0x7fd29018a3b0 2024-02-21T07:51:06.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.040+0000 7fd29a9b3740 1 Processor -- start 2024-02-21T07:51:06.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.040+0000 7fd29a9b3740 1 -- start start 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.042+0000 7fd28cc00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 0x7fd2700a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.042+0000 7fd28cc00640 1 -- 172.21.15.100:0/188199529 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd27c0ebc10 con 0x7fd29018a3b0 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bff93390 0x55c9bff93770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bffcf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bff13300 con 0x55c9bff93390 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfec5e50 con 0x55c9bffcea60 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.043+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfec3380 con 0x55c9bff93cb0 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.044+0000 7fd295c00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 0x7fd2700a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.044+0000 7fd28fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44434/0 (socket says 172.21.15.100:44434) 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 -- 172.21.15.100:0/1878359677 learned_addr learned my addr 172.21.15.100:0/1878359677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd295c00640 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bffcf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 -- 172.21.15.100:0/1878359677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 msgr2=0x55c9bffcf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bffcf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 -- 172.21.15.100:0/1878359677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bff93390 msgr2=0x55c9bff93770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bff93390 0x55c9bff93770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.045+0000 7fd28fe00640 1 -- 172.21.15.100:0/1878359677 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9bfe87c80 con 0x55c9bff93cb0 2024-02-21T07:51:06.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.046+0000 7fd295c00640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 0x7fd2700a1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd288009900 tx=0x7fd288009ea0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.047+0000 7fd28fe00640 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0b9680 tx=0x7fd27c009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7cadb64aeeb8809 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.048+0000 7fd281600640 1 -- 172.21.15.100:0/1878359677 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0b9df0 con 0x55c9bff93cb0 2024-02-21T07:51:06.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.048+0000 7fd281600640 1 -- 172.21.15.100:0/1878359677 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0b96f0 con 0x55c9bff93cb0 2024-02-21T07:51:06.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.048+0000 7fd281600640 1 -- 172.21.15.100:0/1878359677 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0bd840 con 0x55c9bff93cb0 2024-02-21T07:51:06.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.050+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1878359677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 msgr2=0x55c9bffce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.050+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0b9680 tx=0x7fd27c009240 comp rx=0 tx=0).stop 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1878359677 shutdown_connections 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bffcf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bffce520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1878359677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bff93390 0x55c9bff93770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1878359677 >> 172.21.15.100:0/1878359677 conn(0x55c9bff55960 msgr2=0x55c9bff569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1878359677 shutdown_connections 2024-02-21T07:51:06.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.051+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1878359677 wait complete. 2024-02-21T07:51:06.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.052+0000 7fd29a9b3740 1 -- start start 2024-02-21T07:51:06.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.053+0000 7fd29a9b3740 1 Processor -- start 2024-02-21T07:51:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.055+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 0x55c9bff859e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.055+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9bff91130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.055+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 0x55c9bff85f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.055+0000 7fd295200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 0x55c9bff859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd295200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 0x55c9bff859e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45754/0 (socket says 172.21.15.100:45754) 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfebeb60 con 0x55c9bffcea60 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfe63fd0 con 0x55c9bff93cb0 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfe63c70 con 0x55c9bffcbdb0 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd29a9b3740 10 client.0 _ll_register_callbacks cb 0x55c9bfbcfc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd295200640 1 -- 172.21.15.100:0/3588289654 learned_addr learned my addr 172.21.15.100:0/3588289654 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd295c00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 0x55c9bff85f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.056+0000 7fd28fe00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9bff91130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd295c00640 1 -- 172.21.15.100:0/3588289654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 msgr2=0x55c9bff859e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd295c00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 0x55c9bff859e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd295c00640 1 -- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 msgr2=0x55c9bff91130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd295c00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9bff91130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd295c00640 1 -- 172.21.15.100:0/3588289654 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290225190 con 0x55c9bffcbdb0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.057+0000 7fd28fe00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9bff91130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd295c00640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 0x55c9bff85f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd288019640 tx=0x7fd288004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c29063fa20e92c54 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd276000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288010040 con 0x55c9bffcbdb0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd28801b810 con 0x55c9bffcbdb0 2024-02-21T07:51:06.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9bfbbe860 con 0x55c9bffcbdb0 2024-02-21T07:51:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd288009990 con 0x55c9bffcbdb0 2024-02-21T07:51:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd29a9b3740 10 client.6134 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:06.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.058+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c9bfebd1e0 con 0x55c9bffcbdb0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9bfbbe860 con 0x55c9bffcbdb0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd288021030 con 0x55c9bffcbdb0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 10 client.6134 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 10 client.6134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 20 client.6134 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bff54530 0x55c9bff97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 4 client.6134 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.059+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9bfc0f410 con 0x55c9bff54530 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.061+0000 7fd295200640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bff54530 0x55c9bff97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.061+0000 7fd295200640 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bff54530 0x55c9bff97eb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6abc54d93a16fa6 server_cookie=7c75a0372afe7e74 in_seq=0 out_seq=0 2024-02-21T07:51:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.061+0000 7fd276000640 10 client.6134 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.062+0000 7fd276000640 1 -- 172.21.15.100:0/3588289654 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c9bfc0f410 con 0x55c9bff54530 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.062+0000 7fd276000640 10 client.6134 handle_command_reply: tid=0 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.062+0000 7fd29a9b3740 1 client.6134 shutdown 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 msgr2=0x55c9bff85f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 0x55c9bff85f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd288019640 tx=0x7fd288004a40 comp rx=0 tx=0).stop 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 shutdown_connections 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bff54530 0x55c9bff97eb0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bffcbdb0 0x55c9bff85f60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9bff91130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/3588289654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bff93cb0 0x55c9bff859e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 >> 172.21.15.100:0/3588289654 conn(0x55c9bff93390 msgr2=0x55c9bff573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.063+0000 7fd276000640 0 client.6134 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.064+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 shutdown_connections 2024-02-21T07:51:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.064+0000 7fd29a9b3740 1 -- 172.21.15.100:0/3588289654 wait complete. 2024-02-21T07:51:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.065+0000 7fd29a9b3740 20 client.6134 trim_cache size 0 max 16384 2024-02-21T07:51:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.098+0000 7fd29a9b3740 1 Processor -- start 2024-02-21T07:51:06.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.098+0000 7fd29a9b3740 1 -- start start 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcbdb0 0x55c9bff816c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9c002cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bfc070c0 con 0x55c9bffcea60 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bffbca60 con 0x55c9bffcbdb0 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.099+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bffcd030 con 0x55c9bff93cb0 2024-02-21T07:51:06.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.100+0000 7fd295200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.100+0000 7fd295200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44458/0 (socket says 172.21.15.100:44458) 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.100+0000 7fd295200640 1 -- 172.21.15.100:0/1826514408 learned_addr learned my addr 172.21.15.100:0/1826514408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.100+0000 7fd295200640 1 -- 172.21.15.100:0/1826514408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcbdb0 msgr2=0x55c9bff816c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.100+0000 7fd295200640 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcbdb0 0x55c9bff816c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.101+0000 7fd295200640 1 -- 172.21.15.100:0/1826514408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 msgr2=0x55c9c002cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.101+0000 7fd295200640 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9c002cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.101+0000 7fd295200640 1 -- 172.21.15.100:0/1826514408 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9bfe59a90 con 0x55c9bff93cb0 2024-02-21T07:51:06.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.103+0000 7fd295200640 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c230 tx=0x7fd284008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4c6d6ae017bc5c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.103+0000 7fd280c00640 1 -- 172.21.15.100:0/1826514408 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284018290 con 0x55c9bff93cb0 2024-02-21T07:51:06.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.103+0000 7fd280c00640 1 -- 172.21.15.100:0/1826514408 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9bfc0f410 con 0x55c9bff93cb0 2024-02-21T07:51:06.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.103+0000 7fd280c00640 1 -- 172.21.15.100:0/1826514408 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284018610 con 0x55c9bff93cb0 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.104+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1826514408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 msgr2=0x55c9bff569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.104+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd28400c230 tx=0x7fd284008040 comp rx=0 tx=0).stop 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1826514408 shutdown_connections 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcea60 0x55c9c002cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcbdb0 0x55c9bff816c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/1826514408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff569a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1826514408 >> 172.21.15.100:0/1826514408 conn(0x55c9bff93390 msgr2=0x55c9bffcd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1826514408 shutdown_connections 2024-02-21T07:51:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.105+0000 7fd29a9b3740 1 -- 172.21.15.100:0/1826514408 wait complete. 2024-02-21T07:51:06.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.106+0000 7fd29a9b3740 1 -- start start 2024-02-21T07:51:06.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.107+0000 7fd29a9b3740 1 Processor -- start 2024-02-21T07:51:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 0x55c9bff56cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bff5d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bff57230 con 0x55c9bffcbdb0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bff96410 con 0x55c9bffcea60 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9bff5d630 con 0x55c9bff93cb0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd29a9b3740 10 client.0 _ll_register_callbacks cb 0x7fd27c0d6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd295200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd295200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44460/0 (socket says 172.21.15.100:44460) 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd295200640 1 -- 172.21.15.100:0/2689025671 learned_addr learned my addr 172.21.15.100:0/2689025671 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.109+0000 7fd295c00640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bff5d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 -- 172.21.15.100:0/2689025671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 msgr2=0x55c9bff5d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bff5d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 -- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 msgr2=0x55c9bff56cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd28fe00640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 0x55c9bff56cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 0x55c9bff56cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 -- 172.21.15.100:0/2689025671 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28400c540 con 0x55c9bff93cb0 2024-02-21T07:51:06.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd28fe00640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 0x55c9bff56cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:06.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd295200640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd284018510 tx=0x7fd284004640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c716913f18dc95ea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.110+0000 7fd276000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:06.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2840164a0 con 0x55c9bff93cb0 2024-02-21T07:51:06.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd284016600 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd27c0b96f0 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd284016800 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd29a9b3740 10 client.6140 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c9bfe7f6a0 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27c0b96f0 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.111+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd284029020 con 0x55c9bff93cb0 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 10 client.6140 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 10 client.6140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 20 client.6140 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bffbc3f0 0x55c9bff968a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 4 client.6140 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:51:06.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.112+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c9bfbfb7b0 con 0x55c9bffbc3f0 2024-02-21T07:51:06.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.114+0000 7fd28fe00640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bffbc3f0 0x55c9bff968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.115+0000 7fd28fe00640 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bffbc3f0 0x55c9bff968a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c10f9d224bef2859 server_cookie=eedc998aee5a4a54 in_seq=0 out_seq=0 2024-02-21T07:51:06.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.115+0000 7fd276000640 10 client.6140 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd276000640 1 -- 172.21.15.100:0/2689025671 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c9bfbfb7b0 con 0x55c9bffbc3f0 2024-02-21T07:51:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd276000640 10 client.6140 handle_command_reply: tid=0 2024-02-21T07:51:06.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd29a9b3740 1 client.6140 shutdown 2024-02-21T07:51:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 msgr2=0x55c9bff8d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd284018510 tx=0x7fd284004640 comp rx=0 tx=0).stop 2024-02-21T07:51:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 shutdown_connections 2024-02-21T07:51:06.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.119+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c9bffbc3f0 0x55c9bff968a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.123+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9bffcea60 0x55c9bff5d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.123+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c9bffcbdb0 0x55c9bff56cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.123+0000 7fd276000640 0 client.6140 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.123+0000 7fd29a9b3740 1 --2- 172.21.15.100:0/2689025671 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c9bff93cb0 0x55c9bff8d010 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.123+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 >> 172.21.15.100:0/2689025671 conn(0x55c9bff93390 msgr2=0x55c9bffcd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.124+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 shutdown_connections 2024-02-21T07:51:06.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.124+0000 7fd29a9b3740 1 -- 172.21.15.100:0/2689025671 wait complete. 2024-02-21T07:51:06.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.124+0000 7fd29a9b3740 20 client.6140 trim_cache size 0 max 16384 2024-02-21T07:51:06.137 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:06.137 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:51:06.137 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "14e3ac05-be4d-4672-9105-8c05a1aa060d", 2024-02-21T07:51:06.137 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:51:06.137 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:06.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.137+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 msgr2=0x7fd2700a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.137+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 0x7fd2700a1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd288009900 tx=0x7fd288009ea0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.137+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 msgr2=0x7fd290225990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.138+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd27c000c00 tx=0x7fd27c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 shutdown_connections 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd29018f880 0x7fd290220a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd29018a3b0 0x7fd290225990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd27009f150 0x7fd2700a1610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 --2- 172.21.15.100:0/188199529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2900cc8c0 0x7fd290223f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 >> 172.21.15.100:0/188199529 conn(0x7fd2900f6580 msgr2=0x7fd29017b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 shutdown_connections 2024-02-21T07:51:06.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.140+0000 7fd296600640 1 -- 172.21.15.100:0/188199529 wait complete. 2024-02-21T07:51:06.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:51:06.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:51:06.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.551+0000 7f101bc00640 1 Processor -- start 2024-02-21T07:51:06.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.552+0000 7f101bc00640 1 -- start start 2024-02-21T07:51:06.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.554+0000 7f101bc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f101418a450 0x7f10140f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.556+0000 7f101bc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f10140f6080 0x7f1014190370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.556+0000 7f101bc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10141911e0 con 0x7f10141908b0 2024-02-21T07:51:06.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.556+0000 7f101bc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101418dd50 con 0x7f101418a450 2024-02-21T07:51:06.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.556+0000 7f101bc00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101418d0d0 con 0x7f10140f6080 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.557+0000 7f1019c00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f10141908b0 0x7f10140cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:32802/0 (socket says 172.21.15.100:32802) 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.557+0000 7f1019c00640 1 -- 172.21.15.100:0/4293911767 learned_addr learned my addr 172.21.15.100:0/4293911767 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.557+0000 7f1013e00640 1 --2- 172.21.15.100:0/4293911767 >> v2:172.21.15.156:3300/0 conn(0x7f10140f6080 0x7f1014190370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.558+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716568373 0 0) 0x7f10141911e0 con 0x7f10141908b0 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.558+0000 7f1019200640 1 --2- 172.21.15.100:0/4293911767 >> v2:172.21.15.100:3300/0 conn(0x7f101418a450 0x7f10140f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.558+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8003520 con 0x7f10141908b0 2024-02-21T07:51:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.558+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4137981776 0 0) 0x7f0ff8003520 con 0x7f10141908b0 2024-02-21T07:51:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 >> v2:172.21.15.156:3300/0 conn(0x7f10140f6080 msgr2=0x7f1014190370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 --2- 172.21.15.100:0/4293911767 >> v2:172.21.15.156:3300/0 conn(0x7f10140f6080 0x7f1014190370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 >> v2:172.21.15.100:3300/0 conn(0x7f101418a450 msgr2=0x7f10140f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 --2- 172.21.15.100:0/4293911767 >> v2:172.21.15.100:3300/0 conn(0x7f101418a450 0x7f10140f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101418d3b0 con 0x7f10141908b0 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f1004001670 con 0x7f10141908b0 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 >> v1:172.21.15.170:6789/0 conn(0x7f10141908b0 legacy=0x7f10140cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f0ff8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff80047c0 0x7f0ff8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.559+0000 7f1013400640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff8005180 0x7f0ff800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.560+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101418dd50 con 0x7f0ff80039c0 2024-02-21T07:51:06.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.560+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101418d0d0 con 0x7f0ff8005180 2024-02-21T07:51:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.560+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff800c020 con 0x7f0ff80047c0 2024-02-21T07:51:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.560+0000 7f1013e00640 1 --2- 172.21.15.100:0/4293911767 >> v2:172.21.15.156:3300/0 conn(0x7f10140f6080 0x7f1014190370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.560+0000 7f1013e00640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff80047c0 0x7f0ff8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f0ff8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 -- 172.21.15.100:0/4293911767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff80047c0 msgr2=0x7f0ff8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ff80047c0 0x7f0ff8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 -- 172.21.15.100:0/4293911767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff8005180 msgr2=0x7f0ff800b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ff8005180 0x7f0ff800b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.561+0000 7f1019200640 1 -- 172.21.15.100:0/4293911767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101418d3b0 con 0x7f0ff80039c0 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.563+0000 7f1019c00640 1 -- 172.21.15.100:0/4293911767 reap_dead start 2024-02-21T07:51:06.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.563+0000 7f1019200640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f0ff8003de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e3a0 tx=0x7f0ff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a48de1362f35ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.564+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ce80 con 0x7f0ff80039c0 2024-02-21T07:51:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.564+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00f040 con 0x7f0ff80039c0 2024-02-21T07:51:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.564+0000 7f1013400640 1 -- 172.21.15.100:0/4293911767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ce80 con 0x7f0ff80039c0 2024-02-21T07:51:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.565+0000 7f101bc00640 1 -- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 msgr2=0x7f0ff8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.565+0000 7f101bc00640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f0ff8003de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e3a0 tx=0x7f0ff80057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.570+0000 7f101bc00640 1 -- 172.21.15.100:0/4293911767 shutdown_connections 2024-02-21T07:51:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.571+0000 7f101bc00640 1 --2- 172.21.15.100:0/4293911767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f0ff8003de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.571+0000 7f101bc00640 1 -- 172.21.15.100:0/4293911767 >> 172.21.15.100:0/4293911767 conn(0x7f10140cf3e0 msgr2=0x7f10140cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.571+0000 7f101bc00640 1 -- 172.21.15.100:0/4293911767 shutdown_connections 2024-02-21T07:51:06.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.571+0000 7f101bc00640 1 -- 172.21.15.100:0/4293911767 wait complete. 2024-02-21T07:51:06.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.579+0000 7f101bc00640 1 Processor -- start 2024-02-21T07:51:06.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.580+0000 7f101bc00640 1 -- start start 2024-02-21T07:51:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.583+0000 7f101bc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.584+0000 7f1019200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.584+0000 7f1019200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49318/0 (socket says 172.21.15.100:49318) 2024-02-21T07:51:06.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.584+0000 7f101bc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 0x7f101417b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.584+0000 7f1019200640 1 -- 172.21.15.100:0/292566447 learned_addr learned my addr 172.21.15.100:0/292566447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.585+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 0x7f1014176140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.585+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101417ad10 con 0x7f0ff80039c0 2024-02-21T07:51:06.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.585+0000 7f1019c00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 0x7f1014176140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.585+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140f9800 con 0x7f10140f9250 2024-02-21T07:51:06.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.586+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140f9ae0 con 0x7f101417b6e0 2024-02-21T07:51:06.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.586+0000 7f1013e00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 0x7f101417b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.594+0000 7f1019c00640 1 -- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 msgr2=0x7f101417b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.594+0000 7f1019c00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 0x7f101417b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.594+0000 7f1019c00640 1 -- 172.21.15.100:0/292566447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 msgr2=0x7f10140f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.595+0000 7f1019c00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.595+0000 7f1019c00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140f9dc0 con 0x7f101417b6e0 2024-02-21T07:51:06.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.595+0000 7f1013e00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 0x7f101417b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:06.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.595+0000 7f1019200640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:06.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.596+0000 7f1019c00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 0x7f1014176140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f10140fbf60 tx=0x7f100400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.597+0000 7f1010c00640 1 -- 172.21.15.100:0/292566447 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004007440 con 0x7f101417b6e0 2024-02-21T07:51:06.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.597+0000 7f1010c00640 1 -- 172.21.15.100:0/292566447 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10040075a0 con 0x7f101417b6e0 2024-02-21T07:51:06.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.597+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101417a6c0 con 0x7f101417b6e0 2024-02-21T07:51:06.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.597+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140fac40 con 0x7f101417b6e0 2024-02-21T07:51:06.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.598+0000 7f1010c00640 1 -- 172.21.15.100:0/292566447 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1004004a00 con 0x7f101417b6e0 2024-02-21T07:51:06.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.603+0000 7f1010c00640 1 -- 172.21.15.100:0/292566447 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1004004b60 con 0x7f101417b6e0 2024-02-21T07:51:06.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.605+0000 7f1010c00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 0x7f0ff40a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.606+0000 7f1010c00640 1 -- 172.21.15.100:0/292566447 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f10040975f0 con 0x7f101417b6e0 2024-02-21T07:51:06.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.606+0000 7f1019200640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 0x7f0ff40a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.609+0000 7f1019200640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 0x7f0ff40a1630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f100c0095c0 tx=0x7f100c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.611+0000 7f101e9a8740 1 Processor -- start 2024-02-21T07:51:06.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.611+0000 7f101e9a8740 1 -- start start 2024-02-21T07:51:06.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd725da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd72283a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd715f150 con 0x558cd7227fc0 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd715c680 con 0x558cd725df80 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f101e9a8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd7157e60 con 0x558cd72288e0 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.613+0000 7f1019200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd725da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71eaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:44474/0 (socket says 172.21.15.100:44474) 2024-02-21T07:51:06.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019c00640 1 -- 172.21.15.100:0/2191701212 learned_addr learned my addr 172.21.15.100:0/2191701212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019200640 1 -- 172.21.15.100:0/2191701212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 msgr2=0x558cd71eaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019200640 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71eaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019200640 1 -- 172.21.15.100:0/2191701212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 msgr2=0x558cd72283a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:06.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019200640 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd72283a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.614+0000 7f1019200640 1 -- 172.21.15.100:0/2191701212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cd7111060 con 0x558cd7227fc0 2024-02-21T07:51:06.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.615+0000 7f1019200640 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd725da40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e3a0 tx=0x7f100c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9503c49600b1f9c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.615+0000 7f1009600640 1 -- 172.21.15.100:0/2191701212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00e040 con 0x558cd7227fc0 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.615+0000 7f1009600640 1 -- 172.21.15.100:0/2191701212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c043070 con 0x558cd7227fc0 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.615+0000 7f1009600640 1 -- 172.21.15.100:0/2191701212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ce80 con 0x558cd7227fc0 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 -- 172.21.15.100:0/2191701212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 msgr2=0x558cd725da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd725da40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f100c00e3a0 tx=0x7f100c02e070 comp rx=0 tx=0).stop 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 -- 172.21.15.100:0/2191701212 shutdown_connections 2024-02-21T07:51:06.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71eaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd72283a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 --2- 172.21.15.100:0/2191701212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd725da40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.616+0000 7f101e9a8740 1 -- 172.21.15.100:0/2191701212 >> 172.21.15.100:0/2191701212 conn(0x558cd71b75a0 msgr2=0x558cd71eeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.617+0000 7f101e9a8740 1 -- 172.21.15.100:0/2191701212 shutdown_connections 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.617+0000 7f101e9a8740 1 -- 172.21.15.100:0/2191701212 wait complete. 2024-02-21T07:51:06.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.618+0000 7f101e9a8740 1 -- start start 2024-02-21T07:51:06.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.618+0000 7f101e9a8740 1 Processor -- start 2024-02-21T07:51:06.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd7227fc0 0x558cd72589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 0x558cd7225ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd70fcec0 con 0x558cd72288e0 2024-02-21T07:51:06.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd70fcb60 con 0x558cd725df80 2024-02-21T07:51:06.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd6ec61c0 con 0x558cd7227fc0 2024-02-21T07:51:06.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.620+0000 7f101e9a8740 10 client.0 _ll_register_callbacks cb 0x558cd7110960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1013e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 0x558cd7225ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45808/0 (socket says 172.21.15.100:45808) 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 -- 172.21.15.100:0/293875163 learned_addr learned my addr 172.21.15.100:0/293875163 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019200640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd7227fc0 0x558cd72589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 -- 172.21.15.100:0/293875163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd7227fc0 msgr2=0x558cd72589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd7227fc0 0x558cd72589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 -- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 msgr2=0x558cd7225ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 0x558cd7225ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1019c00640 1 -- 172.21.15.100:0/293875163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101418d3b0 con 0x558cd725df80 2024-02-21T07:51:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.621+0000 7f1013e00640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 0x558cd7225ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.622+0000 7f1019c00640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10040c6d50 tx=0x7f100409f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b99c0d3082010bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.622+0000 7f0ffe000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:06.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.624+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040b2070 con 0x558cd725df80 2024-02-21T07:51:06.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.624+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1004096cc0 con 0x558cd725df80 2024-02-21T07:51:06.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.624+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cd6e577e0 con 0x558cd725df80 2024-02-21T07:51:06.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.624+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1004001930 con 0x558cd725df80 2024-02-21T07:51:06.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.624+0000 7f101e9a8740 10 client.6190 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:06.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.625+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558cd71564e0 con 0x558cd725df80 2024-02-21T07:51:06.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.625+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cd6e577e0 con 0x558cd725df80 2024-02-21T07:51:06.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1004096850 con 0x558cd725df80 2024-02-21T07:51:06.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 10 client.6190 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 10 client.6190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 20 client.6190 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd72278f0 0x558cd71ef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 4 client.6190 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.626+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cd6e94720 con 0x558cd72278f0 2024-02-21T07:51:06.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.627+0000 7f1019200640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd72278f0 0x558cd71ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.628+0000 7f1019200640 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd72278f0 0x558cd71ef910 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29bf0274cfb1ada server_cookie=9af2f6961e6cb57d in_seq=0 out_seq=0 2024-02-21T07:51:06.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.628+0000 7f0ffe000640 10 client.6190 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f0ffe000640 1 -- 172.21.15.100:0/293875163 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558cd6e94720 con 0x558cd72278f0 2024-02-21T07:51:06.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f0ffe000640 10 client.6190 handle_command_reply: tid=0 2024-02-21T07:51:06.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 client.6190 shutdown 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 msgr2=0x558cd721daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10040c6d50 tx=0x7f100409f190 comp rx=0 tx=0).stop 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 shutdown_connections 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd72278f0 0x558cd71ef910 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd721daf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd72288e0 0x558cd7225ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 --2- 172.21.15.100:0/293875163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd7227fc0 0x558cd72589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 >> 172.21.15.100:0/293875163 conn(0x558cd71b75a0 msgr2=0x558cd725d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.629+0000 7f0ffe000640 0 client.6190 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.630+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 shutdown_connections 2024-02-21T07:51:06.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.630+0000 7f101e9a8740 1 -- 172.21.15.100:0/293875163 wait complete. 2024-02-21T07:51:06.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.630+0000 7f101e9a8740 20 client.6190 trim_cache size 0 max 16384 2024-02-21T07:51:06.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.665+0000 7f101e9a8740 1 Processor -- start 2024-02-21T07:51:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.665+0000 7f101e9a8740 1 -- start start 2024-02-21T07:51:06.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.666+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd725df80 0x558cd725f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f101e9a8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd726d7c0 con 0x558cd725df80 2024-02-21T07:51:06.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f101e9a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd72283a0 con 0x558cd7227fc0 2024-02-21T07:51:06.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f101e9a8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd7228680 con 0x558cd72288e0 2024-02-21T07:51:06.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f1013e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f1019200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f1019200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45810/0 (socket says 172.21.15.100:45810) 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.667+0000 7f1019200640 1 -- 172.21.15.100:0/1385681857 learned_addr learned my addr 172.21.15.100:0/1385681857 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 -- 172.21.15.100:0/1385681857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 msgr2=0x558cd71ed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 -- 172.21.15.100:0/1385681857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd725df80 msgr2=0x558cd725f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd725df80 0x558cd725f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 -- 172.21.15.100:0/1385681857 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cd70f2950 con 0x558cd7227fc0 2024-02-21T07:51:06.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.668+0000 7f1019200640 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f100c02c8f0 tx=0x7f100c041070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4502c6eede9ad9d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.671+0000 7f1008c00640 1 -- 172.21.15.100:0/1385681857 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c05a040 con 0x558cd7227fc0 2024-02-21T07:51:06.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.671+0000 7f1008c00640 1 -- 172.21.15.100:0/1385681857 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00e040 con 0x558cd7227fc0 2024-02-21T07:51:06.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.671+0000 7f1008c00640 1 -- 172.21.15.100:0/1385681857 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c05f680 con 0x558cd7227fc0 2024-02-21T07:51:06.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.672+0000 7f101e9a8740 1 -- 172.21.15.100:0/1385681857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 msgr2=0x558cd72589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.672+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f100c02c8f0 tx=0x7f100c041070 comp rx=0 tx=0).stop 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 -- 172.21.15.100:0/1385681857 shutdown_connections 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd725df80 0x558cd725f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1385681857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd7227fc0 0x558cd72589a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 -- 172.21.15.100:0/1385681857 >> 172.21.15.100:0/1385681857 conn(0x558cd71b75a0 msgr2=0x558cd7256560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 -- 172.21.15.100:0/1385681857 shutdown_connections 2024-02-21T07:51:06.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.673+0000 7f101e9a8740 1 -- 172.21.15.100:0/1385681857 wait complete. 2024-02-21T07:51:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.674+0000 7f101e9a8740 1 -- start start 2024-02-21T07:51:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.675+0000 7f101e9a8740 1 Processor -- start 2024-02-21T07:51:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.676+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd725d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd7216850 con 0x558cd7227fc0 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd72143e0 con 0x558cd725df80 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd7277f70 con 0x558cd72288e0 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f101e9a8740 10 client.0 _ll_register_callbacks cb 0x558cd725f500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f1019200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.677+0000 7f1013e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49364/0 (socket says 172.21.15.100:49364) 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019200640 1 -- 172.21.15.100:0/1762053382 learned_addr learned my addr 172.21.15.100:0/1762053382 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019c00640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd725d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019c00640 1 -- 172.21.15.100:0/1762053382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 msgr2=0x558cd71ed7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019c00640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019c00640 1 -- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 msgr2=0x558cd721d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:06.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.678+0000 7f1019c00640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.679+0000 7f1019c00640 1 -- 172.21.15.100:0/1762053382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cd7111060 con 0x558cd725df80 2024-02-21T07:51:06.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.679+0000 7f1019200640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.680+0000 7f1019c00640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd725d9f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x558cd7255090 tx=0x7f10040c6c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97fa78d81a3fdddf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.680+0000 7f0ffe000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.680+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040b2030 con 0x558cd725df80 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.680+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f10040b3070 con 0x558cd725df80 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.681+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cd71f5e80 con 0x558cd725df80 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.681+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1004001930 con 0x558cd725df80 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.681+0000 7f101e9a8740 10 client.6196 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:06.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.681+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558cd7118430 con 0x558cd725df80 2024-02-21T07:51:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.682+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558cd71f5e80 con 0x558cd725df80 2024-02-21T07:51:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f10040b5040 con 0x558cd725df80 2024-02-21T07:51:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 10 client.6196 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 10 client.6196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 20 client.6196 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd726d5b0 0x558cd72340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 4 client.6196 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:51:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.683+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f100c043070 con 0x558cd726d5b0 2024-02-21T07:51:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.685+0000 7f1019200640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd726d5b0 0x558cd72340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.686+0000 7f1019200640 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd726d5b0 0x558cd72340f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b049b268abbe6c5 server_cookie=12cd12175f89963b in_seq=0 out_seq=0 2024-02-21T07:51:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.686+0000 7f0ffe000640 10 client.6196 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.687+0000 7f0ffe000640 1 -- 172.21.15.100:0/1762053382 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f100c043070 con 0x558cd726d5b0 2024-02-21T07:51:06.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.687+0000 7f0ffe000640 10 client.6196 handle_command_reply: tid=0 2024-02-21T07:51:06.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.687+0000 7f101e9a8740 1 client.6196 shutdown 2024-02-21T07:51:06.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.692+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 msgr2=0x558cd725d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.692+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd725d9f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x558cd7255090 tx=0x7f10040c6c80 comp rx=0 tx=0).stop 2024-02-21T07:51:06.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 shutdown_connections 2024-02-21T07:51:06.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558cd726d5b0 0x558cd72340f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cd725df80 0x558cd725d9f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cd72288e0 0x558cd71ed7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 --2- 172.21.15.100:0/1762053382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558cd7227fc0 0x558cd721d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.693+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 >> 172.21.15.100:0/1762053382 conn(0x558cd71b75a0 msgr2=0x558cd7256500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.695+0000 7f0ffe000640 0 client.6196 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:06.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.696+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 shutdown_connections 2024-02-21T07:51:06.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.696+0000 7f101e9a8740 1 -- 172.21.15.100:0/1762053382 wait complete. 2024-02-21T07:51:06.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.701+0000 7f101e9a8740 20 client.6196 trim_cache size 0 max 16384 2024-02-21T07:51:06.705 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:06.705 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:51:06.705 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:51:06.705 INFO:teuthology.orchestra.run.smithi100.stdout: "14e3ac05-be4d-4672-9105-8c05a1aa060d": { 2024-02-21T07:51:06.705 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:51:06.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "14e3ac05-be4d-4672-9105-8c05a1aa060d", 2024-02-21T07:51:06.706 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:51:06.706 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:51:06.706 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:51:06.706 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:06.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 msgr2=0x7f0ff40a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 0x7f0ff40a1630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f100c0095c0 tx=0x7f100c02e000 comp rx=0 tx=0).stop 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 msgr2=0x7f1014176140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 0x7f1014176140 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f10140fbf60 tx=0x7f100400c820 comp rx=0 tx=0).stop 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 shutdown_connections 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f101417b6e0 0x7f1014176140 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10140f9250 0x7f101417b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ff409f170 0x7f0ff40a1630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 --2- 172.21.15.100:0/292566447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ff80039c0 0x7f10140f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.702+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 >> 172.21.15.100:0/292566447 conn(0x7f10140cf3e0 msgr2=0x7f1014187e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.703+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 shutdown_connections 2024-02-21T07:51:06.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:06.704+0000 7f101bc00640 1 -- 172.21.15.100:0/292566447 wait complete. 2024-02-21T07:51:06.737 INFO:tasks.cephfs.filesystem:scrub status for tag:14e3ac05-be4d-4672-9105-8c05a1aa060d - {'path': '/', 'tag': '14e3ac05-be4d-4672-9105-8c05a1aa060d', 'options': 'recursive,force'} 2024-02-21T07:51:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.529+0000 7f3dafa00640 1 Processor -- start 2024-02-21T07:51:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.529+0000 7f3dafa00640 1 -- start start 2024-02-21T07:51:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dafa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 0x7f3da80d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dafa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f3da8185480 0x7f3da81858b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dafa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80cf530 con 0x7f3da8186970 2024-02-21T07:51:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dafa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80cf780 con 0x7f3da81829d0 2024-02-21T07:51:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dafa00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80cfa60 con 0x7f3da8185480 2024-02-21T07:51:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3da7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3da8186970 0x7f3da8186df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53898/0 (socket says 172.21.15.100:53898) 2024-02-21T07:51:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dad000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 0x7f3da80d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3da7e00640 1 -- 172.21.15.100:0/237346315 learned_addr learned my addr 172.21.15.100:0/237346315 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.531+0000 7f3dada00640 1 --2- 172.21.15.100:0/237346315 >> v2:172.21.15.156:3300/0 conn(0x7f3da8185480 0x7f3da81858b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3dada00640 1 -- 172.21.15.100:0/237346315 >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 msgr2=0x7f3da80d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3dada00640 1 --2- 172.21.15.100:0/237346315 >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 0x7f3da80d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3dada00640 1 -- 172.21.15.100:0/237346315 >> v1:172.21.15.100:6789/0 conn(0x7f3da8186970 legacy=0x7f3da8186df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3dada00640 1 -- 172.21.15.100:0/237346315 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80cfd40 con 0x7f3da8185480 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3da7400640 1 -- 172.21.15.100:0/237346315 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622139257 0 0) 0x7f3da80cf530 con 0x7f3da8186970 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.532+0000 7f3dad000640 1 --2- 172.21.15.100:0/237346315 >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 0x7f3da80d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:08.536 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.533+0000 7f3dada00640 1 --2- 172.21.15.100:0/237346315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da8185480 0x7f3da81858b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3da808dd90 tx=0x7f3da002bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef6e6d4f37decd91 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.533+0000 7f3da7400640 1 -- 172.21.15.100:0/237346315 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da002cb50 con 0x7f3da8185480 2024-02-21T07:51:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.533+0000 7f3da7400640 1 -- 172.21.15.100:0/237346315 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da002ccb0 con 0x7f3da8185480 2024-02-21T07:51:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.533+0000 7f3da7400640 1 -- 172.21.15.100:0/237346315 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0034660 con 0x7f3da8185480 2024-02-21T07:51:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 -- 172.21.15.100:0/237346315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da8185480 msgr2=0x7f3da81858b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 --2- 172.21.15.100:0/237346315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da8185480 0x7f3da81858b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3da808dd90 tx=0x7f3da002bda0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 -- 172.21.15.100:0/237346315 shutdown_connections 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 --2- 172.21.15.100:0/237346315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da8185480 0x7f3da81858b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 --2- 172.21.15.100:0/237346315 >> v2:172.21.15.100:3300/0 conn(0x7f3da81829d0 0x7f3da80d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.534+0000 7f3dafa00640 1 -- 172.21.15.100:0/237346315 >> 172.21.15.100:0/237346315 conn(0x7f3da80ce1b0 msgr2=0x7f3da80ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.535+0000 7f3dafa00640 1 -- 172.21.15.100:0/237346315 shutdown_connections 2024-02-21T07:51:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.537+0000 7f3dafa00640 1 -- 172.21.15.100:0/237346315 wait complete. 2024-02-21T07:51:08.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.540+0000 7f3dafa00640 1 Processor -- start 2024-02-21T07:51:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.541+0000 7f3dafa00640 1 -- start start 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 0x7f3da816c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da8186970 0x7f3da80f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80f2d80 con 0x7f3da8185480 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8222cc0 con 0x7f3da81829d0 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.542+0000 7f3dafa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8222fa0 con 0x7f3da8186970 2024-02-21T07:51:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3da7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 0x7f3da816c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45832/0 (socket says 172.21.15.100:45832) 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 -- 172.21.15.100:0/2280141290 learned_addr learned my addr 172.21.15.100:0/2280141290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dada00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da8186970 0x7f3da80f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 -- 172.21.15.100:0/2280141290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da8186970 msgr2=0x7f3da80f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da8186970 0x7f3da80f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 -- 172.21.15.100:0/2280141290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 msgr2=0x7f3da816c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 0x7f3da816c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3dad000640 1 -- 172.21.15.100:0/2280141290 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009400 con 0x7f3da81829d0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.543+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 0x7f3da816c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3dad000640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00e990 tx=0x7f3d9c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3da4c00640 1 -- 172.21.15.100:0/2280141290 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00c9e0 con 0x7f3da81829d0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3da4c00640 1 -- 172.21.15.100:0/2280141290 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c00cb40 con 0x7f3da81829d0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3da4c00640 1 -- 172.21.15.100:0/2280141290 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c00ced0 con 0x7f3da81829d0 2024-02-21T07:51:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0009a70 con 0x7f3da81829d0 2024-02-21T07:51:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.544+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da816ee40 con 0x7f3da81829d0 2024-02-21T07:51:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.549+0000 7f3da4c00640 1 -- 172.21.15.100:0/2280141290 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3d9c013470 con 0x7f3da81829d0 2024-02-21T07:51:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.550+0000 7f3db2787740 1 Processor -- start 2024-02-21T07:51:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.550+0000 7f3db2787740 1 -- start start 2024-02-21T07:51:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.551+0000 7f3da4c00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 0x7f3d880a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.551+0000 7f3da4c00640 1 -- 172.21.15.100:0/2280141290 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3d9c0c9d20 con 0x7f3da81829d0 2024-02-21T07:51:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.551+0000 7f3dada00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 0x7f3d880a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 0x55ecc8332440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc8337a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc8373450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc82f3620 con 0x55ecc8337f90 2024-02-21T07:51:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc82a58c0 con 0x55ecc8373070 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3db2787740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc82a2df0 con 0x55ecc83a74d0 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 0x55ecc8332440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3dada00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc8373450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 0x55ecc8332440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45848/0 (socket says 172.21.15.100:45848) 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3dad000640 1 -- 172.21.15.100:0/4138661708 learned_addr learned my addr 172.21.15.100:0/4138661708 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.552+0000 7f3da7e00640 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc8337a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 -- 172.21.15.100:0/4138661708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 msgr2=0x55ecc8337a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc8337a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 -- 172.21.15.100:0/4138661708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 msgr2=0x55ecc8332440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 0x55ecc8332440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 -- 172.21.15.100:0/4138661708 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecc821fb00 con 0x55ecc8337f90 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 0x7f3d880a16b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3da0036000 tx=0x7f3da002e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3dada00640 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc8373450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3da81889d0 tx=0x7f3da0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38992076b812415 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3da7e00640 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc8337a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.553+0000 7f3d99600640 1 -- 172.21.15.100:0/4138661708 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da004f070 con 0x55ecc8337f90 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.554+0000 7f3d99600640 1 -- 172.21.15.100:0/4138661708 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0034d60 con 0x55ecc8337f90 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.554+0000 7f3d99600640 1 -- 172.21.15.100:0/4138661708 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da003f670 con 0x55ecc8337f90 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.555+0000 7f3db2787740 1 -- 172.21.15.100:0/4138661708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 msgr2=0x55ecc8373450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.555+0000 7f3db2787740 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc8373450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3da81889d0 tx=0x7f3da0041000 comp rx=0 tx=0).stop 2024-02-21T07:51:08.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 -- 172.21.15.100:0/4138661708 shutdown_connections 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc8373450 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc8337a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 --2- 172.21.15.100:0/4138661708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8373070 0x55ecc8332440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 -- 172.21.15.100:0/4138661708 >> 172.21.15.100:0/4138661708 conn(0x55ecc82ff4b0 msgr2=0x55ecc8336ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 -- 172.21.15.100:0/4138661708 shutdown_connections 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.556+0000 7f3db2787740 1 -- 172.21.15.100:0/4138661708 wait complete. 2024-02-21T07:51:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.557+0000 7f3db2787740 1 -- start start 2024-02-21T07:51:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.558+0000 7f3db2787740 1 Processor -- start 2024-02-21T07:51:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc8373070 0x55ecc8367d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc83a74d0 0x55ecc839d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc829e5d0 con 0x55ecc8337f90 2024-02-21T07:51:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc8243b50 con 0x55ecc83a74d0 2024-02-21T07:51:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc82437f0 con 0x55ecc8373070 2024-02-21T07:51:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.560+0000 7f3db2787740 10 client.0 _ll_register_callbacks cb 0x55ecc8257550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3da7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc8373070 0x55ecc8367d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49398/0 (socket says 172.21.15.100:49398) 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 -- 172.21.15.100:0/2710817273 learned_addr learned my addr 172.21.15.100:0/2710817273 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dada00640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc83a74d0 0x55ecc839d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 -- 172.21.15.100:0/2710817273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc8373070 msgr2=0x55ecc8367d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc8373070 0x55ecc8367d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 -- 172.21.15.100:0/2710817273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc83a74d0 msgr2=0x55ecc839d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc83a74d0 0x55ecc839d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.561+0000 7f3dad000640 1 -- 172.21.15.100:0/2710817273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80cfd40 con 0x55ecc8337f90 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.562+0000 7f3dad000640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c097790 tx=0x7f3d9c097800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a85b66e1702aae5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.562+0000 7f3d8e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.562+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0af380 con 0x55ecc8337f90 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.562+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3d9c0c7b80 con 0x55ecc8337f90 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.563+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecc8270cd0 con 0x55ecc8337f90 2024-02-21T07:51:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.563+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d9c0c7d40 con 0x55ecc8337f90 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.563+0000 7f3db2787740 10 client.6033 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.563+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ecc829cc50 con 0x55ecc8337f90 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ecc8270cd0 con 0x55ecc8337f90 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d9c011070 con 0x55ecc8337f90 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 10 client.6033 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:08.567 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 10 client.6033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 20 client.6033 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc83a51d0 0x55ecc83a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 4 client.6033 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecc8294ce0 con 0x55ecc83a51d0 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.564+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc83a51d0 0x55ecc83a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.565+0000 7f3d8e000640 10 client.6033 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:08.569 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.565+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc83a51d0 0x55ecc83a55b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b0109cdb658fc5 server_cookie=35593e7c16c63ddd in_seq=0 out_seq=0 2024-02-21T07:51:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.566+0000 7f3d8e000640 1 -- 172.21.15.100:0/2710817273 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ecc8294ce0 con 0x55ecc83a51d0 2024-02-21T07:51:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.566+0000 7f3d8e000640 10 client.6033 handle_command_reply: tid=0 2024-02-21T07:51:08.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.567+0000 7f3db2787740 1 client.6033 shutdown 2024-02-21T07:51:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 msgr2=0x55ecc83446c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c097790 tx=0x7f3d9c097800 comp rx=0 tx=0).stop 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 shutdown_connections 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc83a51d0 0x55ecc83a55b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3d8e000640 0 client.6033 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc83a74d0 0x55ecc839d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc8373070 0x55ecc8367d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.568+0000 7f3db2787740 1 --2- 172.21.15.100:0/2710817273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8337f90 0x55ecc83446c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.569+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 >> 172.21.15.100:0/2710817273 conn(0x55ecc82ff4b0 msgr2=0x55ecc83a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.569+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 shutdown_connections 2024-02-21T07:51:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.569+0000 7f3db2787740 1 -- 172.21.15.100:0/2710817273 wait complete. 2024-02-21T07:51:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.570+0000 7f3db2787740 20 client.6033 trim_cache size 0 max 16384 2024-02-21T07:51:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.610+0000 7f3db2787740 1 Processor -- start 2024-02-21T07:51:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.610+0000 7f3db2787740 1 -- start start 2024-02-21T07:51:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc83af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc83af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc7fe6e60 con 0x55ecc8373070 2024-02-21T07:51:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc8365ee0 con 0x55ecc8337f90 2024-02-21T07:51:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3db2787740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc8373d20 con 0x55ecc83a74d0 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3da7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc83af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45872/0 (socket says 172.21.15.100:45872) 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3dada00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc83af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.611+0000 7f3dad000640 1 -- 172.21.15.100:0/2047877280 learned_addr learned my addr 172.21.15.100:0/2047877280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 -- 172.21.15.100:0/2047877280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 msgr2=0x55ecc83af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc83af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 -- 172.21.15.100:0/2047877280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 msgr2=0x55ecc83af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc83af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 -- 172.21.15.100:0/2047877280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecc8239530 con 0x55ecc8337f90 2024-02-21T07:51:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3dad000640 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c095ab0 tx=0x7f3d9c01e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e476dc88dd45a49 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3d98c00640 1 -- 172.21.15.100:0/2047877280 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0c7650 con 0x55ecc8337f90 2024-02-21T07:51:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3d98c00640 1 -- 172.21.15.100:0/2047877280 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0b63d0 con 0x55ecc8337f90 2024-02-21T07:51:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.612+0000 7f3d98c00640 1 -- 172.21.15.100:0/2047877280 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0c7dc0 con 0x55ecc8337f90 2024-02-21T07:51:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 -- 172.21.15.100:0/2047877280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 msgr2=0x55ecc83737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c095ab0 tx=0x7f3d9c01e000 comp rx=0 tx=0).stop 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 -- 172.21.15.100:0/2047877280 shutdown_connections 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc83af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc83af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 --2- 172.21.15.100:0/2047877280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83737e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 -- 172.21.15.100:0/2047877280 >> 172.21.15.100:0/2047877280 conn(0x55ecc82ff4b0 msgr2=0x55ecc83a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 -- 172.21.15.100:0/2047877280 shutdown_connections 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.613+0000 7f3db2787740 1 -- 172.21.15.100:0/2047877280 wait complete. 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.615+0000 7f3db2787740 1 -- start start 2024-02-21T07:51:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.615+0000 7f3db2787740 1 Processor -- start 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc839d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc840b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc840c020 con 0x55ecc8373070 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc83af960 con 0x55ecc8337f90 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecc83a6940 con 0x55ecc83a74d0 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3db2787740 10 client.0 _ll_register_callbacks cb 0x7f3da0044050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.617+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45888/0 (socket says 172.21.15.100:45888) 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 -- 172.21.15.100:0/2500331815 learned_addr learned my addr 172.21.15.100:0/2500331815 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc839d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dada00640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc840b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 -- 172.21.15.100:0/2500331815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 msgr2=0x55ecc840b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc840b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 -- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 msgr2=0x55ecc839d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc839d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 -- 172.21.15.100:0/2500331815 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecc829cc50 con 0x55ecc8337f90 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3dad000640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c520 tx=0x7f3d9c0c7590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b476d4a6fa6920 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.618+0000 7f3d8e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0af380 con 0x55ecc8337f90 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3d9c098b30 con 0x55ecc8337f90 2024-02-21T07:51:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecc82c3d30 con 0x55ecc8337f90 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d9c0b6540 con 0x55ecc8337f90 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3db2787740 10 client.6214 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ecc825f2c0 con 0x55ecc8337f90 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.619+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0be020 con 0x55ecc8337f90 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d9c011070 con 0x55ecc8337f90 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 10 client.6214 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 10 client.6214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 20 client.6214 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc836a630 0x55ecc840b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 4 client.6214 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:51:08.624 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ecc7f9e600 con 0x55ecc836a630 2024-02-21T07:51:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.620+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc836a630 0x55ecc840b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.621+0000 7f3da7e00640 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc836a630 0x55ecc840b8c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3455c21f0351ef8 server_cookie=224c707387a4425e in_seq=0 out_seq=0 2024-02-21T07:51:08.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.621+0000 7f3d8e000640 10 client.6214 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3d8e000640 1 -- 172.21.15.100:0/2500331815 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ecc7f9e600 con 0x55ecc836a630 2024-02-21T07:51:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3d8e000640 10 client.6214 handle_command_reply: tid=0 2024-02-21T07:51:08.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 client.6214 shutdown 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 msgr2=0x55ecc83a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00c520 tx=0x7f3d9c0c7590 comp rx=0 tx=0).stop 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 shutdown_connections 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ecc836a630 0x55ecc840b8c0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecc83a74d0 0x55ecc840b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ecc8373070 0x55ecc839d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 --2- 172.21.15.100:0/2500331815 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecc8337f90 0x55ecc83a3670 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 >> 172.21.15.100:0/2500331815 conn(0x55ecc82ff4b0 msgr2=0x55ecc83c6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.645+0000 7f3d8e000640 0 client.6214 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.647+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 shutdown_connections 2024-02-21T07:51:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.647+0000 7f3db2787740 1 -- 172.21.15.100:0/2500331815 wait complete. 2024-02-21T07:51:08.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.647+0000 7f3db2787740 20 client.6214 trim_cache size 0 max 16384 2024-02-21T07:51:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:51:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:51:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:51:08.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 msgr2=0x7f3d880a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 0x7f3d880a16b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3da0036000 tx=0x7f3da002e000 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 msgr2=0x7f3da816f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00e990 tx=0x7f3d9c00ee50 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 shutdown_connections 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3da8186970 0x7f3da80f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3d8809f1f0 0x7f3d880a16b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3da8185480 0x7f3da816c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 --2- 172.21.15.100:0/2280141290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3da81829d0 0x7f3da816f920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.648+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 >> 172.21.15.100:0/2280141290 conn(0x7f3da80ce1b0 msgr2=0x7f3da8188a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:08.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.649+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 shutdown_connections 2024-02-21T07:51:08.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:08.649+0000 7f3dafa00640 1 -- 172.21.15.100:0/2280141290 wait complete. 2024-02-21T07:51:14.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:14.338 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:14.340 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:21.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.882+0000 7f522be00640 1 Processor -- start 2024-02-21T07:51:21.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.883+0000 7f522be00640 1 -- start start 2024-02-21T07:51:21.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.890+0000 7f522be00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f522410f3f0 0x7f5224112080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5224110f40 0x7f5224114fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522be00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52241103a0 con 0x7f52241125c0 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5224112a20 con 0x7f5224110f40 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522be00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522407a650 con 0x7f522410f3f0 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.891+0000 7f522aa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f522410f3f0 0x7f5224112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f522410f3f0 0x7f5224112080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34684/0 (socket says 172.21.15.100:34684) 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 -- 172.21.15.100:0/391480532 learned_addr learned my addr 172.21.15.100:0/391480532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 -- 172.21.15.100:0/391480532 >> v2:172.21.15.100:3300/0 conn(0x7f5224110f40 msgr2=0x7f5224114fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 --2- 172.21.15.100:0/391480532 >> v2:172.21.15.100:3300/0 conn(0x7f5224110f40 0x7f5224114fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 -- 172.21.15.100:0/391480532 >> v1:172.21.15.170:6789/0 conn(0x7f52241125c0 legacy=0x7f5224110830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:21.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.893+0000 7f522aa00640 1 -- 172.21.15.100:0/391480532 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522407a370 con 0x7f522410f3f0 2024-02-21T07:51:21.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.901+0000 7f522aa00640 1 --2- 172.21.15.100:0/391480532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f5224112080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5224011ee0 tx=0x7f521c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d525d49ff8e31e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.903+0000 7f5229600640 1 -- 172.21.15.100:0/391480532 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0317e0 con 0x7f522410f3f0 2024-02-21T07:51:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.903+0000 7f5229600640 1 -- 172.21.15.100:0/391480532 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c031940 con 0x7f522410f3f0 2024-02-21T07:51:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.903+0000 7f5229600640 1 -- 172.21.15.100:0/391480532 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c031cd0 con 0x7f522410f3f0 2024-02-21T07:51:21.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 -- 172.21.15.100:0/391480532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 msgr2=0x7f5224112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 --2- 172.21.15.100:0/391480532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f5224112080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5224011ee0 tx=0x7f521c02b880 comp rx=0 tx=0).stop 2024-02-21T07:51:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 -- 172.21.15.100:0/391480532 shutdown_connections 2024-02-21T07:51:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 --2- 172.21.15.100:0/391480532 >> v2:172.21.15.100:3300/0 conn(0x7f5224110f40 0x7f5224114fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 --2- 172.21.15.100:0/391480532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f5224112080 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.904+0000 7f522be00640 1 -- 172.21.15.100:0/391480532 >> 172.21.15.100:0/391480532 conn(0x7f5224052de0 msgr2=0x7f52240531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.905+0000 7f522be00640 1 -- 172.21.15.100:0/391480532 shutdown_connections 2024-02-21T07:51:21.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.905+0000 7f522be00640 1 -- 172.21.15.100:0/391480532 wait complete. 2024-02-21T07:51:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.908+0000 7f522be00640 1 Processor -- start 2024-02-21T07:51:21.911 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.908+0000 7f522be00640 1 -- start start 2024-02-21T07:51:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.910+0000 7f522be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f52241a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.910+0000 7f522be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 0x7f522410a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.910+0000 7f522be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 0x7f52240f1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.911+0000 7f522be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52241a8ae0 con 0x7f5224110f40 2024-02-21T07:51:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.911+0000 7f522be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5224109610 con 0x7f522410f3f0 2024-02-21T07:51:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.911+0000 7f522be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52241098f0 con 0x7f52241125c0 2024-02-21T07:51:21.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.911+0000 7f522aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f52241a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.912+0000 7f522aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f52241a9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34698/0 (socket says 172.21.15.100:34698) 2024-02-21T07:51:21.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.912+0000 7f522aa00640 1 -- 172.21.15.100:0/4158534459 learned_addr learned my addr 172.21.15.100:0/4158534459 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.915+0000 7f522b400640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 0x7f52240f1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.915+0000 7f522a000640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 0x7f522410a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522b400640 1 -- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 msgr2=0x7f52241a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522b400640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f52241a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522b400640 1 -- 172.21.15.100:0/4158534459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 msgr2=0x7f522410a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522b400640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 0x7f522410a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522b400640 1 -- 172.21.15.100:0/4158534459 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0094d0 con 0x7f52241125c0 2024-02-21T07:51:21.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.916+0000 7f522a000640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 0x7f522410a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:21.924 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.921+0000 7f522b400640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 0x7f52240f1300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f522c0507e0 tx=0x7f522c06bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.922+0000 7f5222a00640 1 -- 172.21.15.100:0/4158534459 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c069080 con 0x7f52241125c0 2024-02-21T07:51:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.922+0000 7f5222a00640 1 -- 172.21.15.100:0/4158534459 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c069220 con 0x7f52241125c0 2024-02-21T07:51:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.922+0000 7f5222a00640 1 -- 172.21.15.100:0/4158534459 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0734a0 con 0x7f52241125c0 2024-02-21T07:51:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.922+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5224109bd0 con 0x7f52241125c0 2024-02-21T07:51:21.925 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.922+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522410a190 con 0x7f52241125c0 2024-02-21T07:51:21.929 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.926+0000 7f5222a00640 1 -- 172.21.15.100:0/4158534459 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f522c073600 con 0x7f52241125c0 2024-02-21T07:51:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.927+0000 7f5222a00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 0x7f520c0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.928+0000 7f5222a00640 1 -- 172.21.15.100:0/4158534459 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f522c1446a0 con 0x7f52241125c0 2024-02-21T07:51:21.931 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.928+0000 7f522aa00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 0x7f520c0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.928+0000 7f522aa00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 0x7f520c0a1630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f521c02b8c0 tx=0x7f521c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.929+0000 7f523478f740 1 Processor -- start 2024-02-21T07:51:21.932 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.929+0000 7f523478f740 1 -- start start 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f972c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f9ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f92e620 con 0x55650f9ae230 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f8e08c0 con 0x55650f9e2690 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f523478f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f8dddf0 con 0x55650f973150 2024-02-21T07:51:21.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f972c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f972c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34700/0 (socket says 172.21.15.100:34700) 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522a000640 1 -- 172.21.15.100:0/3826252490 learned_addr learned my addr 172.21.15.100:0/3826252490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522aa00640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38690/0 (socket says 172.21.15.100:38690) 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522b400640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f9ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522b400640 1 -- 172.21.15.100:0/3826252490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 msgr2=0x55650f972c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522b400640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f972c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.931+0000 7f522b400640 1 -- 172.21.15.100:0/3826252490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 msgr2=0x55650f96d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f522b400640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f522b400640 1 -- 172.21.15.100:0/3826252490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55650f85ab00 con 0x55650f973150 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f522aa00640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f522b400640 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f9ae610 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f522c142070 tx=0x7f522c1121b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1200a679899c1e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f5217400640 1 -- 172.21.15.100:0/3826252490 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c1163c0 con 0x55650f973150 2024-02-21T07:51:21.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.932+0000 7f5217400640 1 -- 172.21.15.100:0/3826252490 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c11a980 con 0x55650f973150 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 -- 172.21.15.100:0/3826252490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 msgr2=0x55650f9ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f9ae610 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f522c142070 tx=0x7f522c1121b0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 -- 172.21.15.100:0/3826252490 shutdown_connections 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f9ae610 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f972c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 --2- 172.21.15.100:0/3826252490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9ae230 0x55650f96d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 -- 172.21.15.100:0/3826252490 >> 172.21.15.100:0/3826252490 conn(0x55650f93a4b0 msgr2=0x55650f971e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.933+0000 7f523478f740 1 -- 172.21.15.100:0/3826252490 shutdown_connections 2024-02-21T07:51:21.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.934+0000 7f523478f740 1 -- 172.21.15.100:0/3826252490 wait complete. 2024-02-21T07:51:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.935+0000 7f523478f740 1 -- start start 2024-02-21T07:51:21.941 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.935+0000 7f523478f740 1 Processor -- start 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.937+0000 7f523478f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.937+0000 7f523478f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f9d7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.937+0000 7f523478f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650f9a6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.937+0000 7f523478f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f8d95d0 con 0x55650f9e2690 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f523478f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f87eb50 con 0x55650f973150 2024-02-21T07:51:21.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f523478f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f87e7f0 con 0x55650f9ae230 2024-02-21T07:51:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f523478f740 10 client.0 _ll_register_callbacks cb 0x55650f892550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34716/0 (socket says 172.21.15.100:34716) 2024-02-21T07:51:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 -- 172.21.15.100:0/3137807708 learned_addr learned my addr 172.21.15.100:0/3137807708 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522a000640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f9d7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522b400640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650f9a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 -- 172.21.15.100:0/3137807708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 msgr2=0x55650f9d7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f9d7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 -- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 msgr2=0x55650f9a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650f9a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522aa00640 1 -- 172.21.15.100:0/3137807708 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522410a190 con 0x55650f973150 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.938+0000 7f522b400640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650f9a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f522aa00640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f521c009960 tx=0x7f521c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101c6e18348e6d1d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.945 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f520be00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c04b040 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f521c040040 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55650f8abcd0 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f521c032a80 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f523478f740 10 client.6226 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55650f8d7c50 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.939+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55650f8abcd0 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f521c044050 con 0x55650f973150 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 10 client.6226 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 10 client.6226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 20 client.6226 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99f240 0x55650f9a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 4 client.6226 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:21.947 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.940+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55650f8cfce0 con 0x55650f99f240 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.941+0000 7f522a000640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99f240 0x55650f9a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.941+0000 7f522a000640 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99f240 0x55650f9a5d20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16d399bee0d78747 server_cookie=db8ba4aaeba48c1e in_seq=0 out_seq=0 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.941+0000 7f520be00640 10 client.6226 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.942+0000 7f520be00640 1 -- 172.21.15.100:0/3137807708 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55650f8cfce0 con 0x55650f99f240 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.942+0000 7f520be00640 10 client.6226 handle_command_reply: tid=0 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 client.6226 shutdown 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 msgr2=0x55650f9a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f521c009960 tx=0x7f521c004730 comp rx=0 tx=0).stop 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 shutdown_connections 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99f240 0x55650f9a5d20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650f9a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f9d7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f520be00640 0 client.6226 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 --2- 172.21.15.100:0/3137807708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f973150 0x55650f9a7ff0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 >> 172.21.15.100:0/3137807708 conn(0x55650f93a4b0 msgr2=0x55650f9e2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 shutdown_connections 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.943+0000 7f523478f740 1 -- 172.21.15.100:0/3137807708 wait complete. 2024-02-21T07:51:21.950 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.944+0000 7f523478f740 20 client.6226 trim_cache size 0 max 16384 2024-02-21T07:51:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.972+0000 7f523478f740 1 Processor -- start 2024-02-21T07:51:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.972+0000 7f523478f740 1 -- start start 2024-02-21T07:51:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9ae230 0x55650f9e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650fa41580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f621e60 con 0x55650f9e2690 2024-02-21T07:51:21.977 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f9a6330 con 0x55650f9ae230 2024-02-21T07:51:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f523478f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f88d970 con 0x55650f973150 2024-02-21T07:51:21.978 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f522aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f522a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9ae230 0x55650f9e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f522aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53104/0 (socket says 172.21.15.100:53104) 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f522b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650fa41580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.974+0000 7f522aa00640 1 -- 172.21.15.100:0/310431996 learned_addr learned my addr 172.21.15.100:0/310431996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 -- 172.21.15.100:0/310431996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9ae230 msgr2=0x55650f9e1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9ae230 0x55650f9e1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 -- 172.21.15.100:0/310431996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 msgr2=0x55650fa41580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650fa41580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 -- 172.21.15.100:0/310431996 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55650f874530 con 0x55650f973150 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f522aa00640 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f521c009380 tx=0x7f521c04f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9210f51366523382 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f5216a00640 1 -- 172.21.15.100:0/310431996 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c04b070 con 0x55650f973150 2024-02-21T07:51:21.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f5216a00640 1 -- 172.21.15.100:0/310431996 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c046e90 con 0x55650f973150 2024-02-21T07:51:21.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.975+0000 7f5216a00640 1 -- 172.21.15.100:0/310431996 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c032a80 con 0x55650f973150 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 -- 172.21.15.100:0/310431996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 msgr2=0x55650f96eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f521c009380 tx=0x7f521c04f000 comp rx=0 tx=0).stop 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 -- 172.21.15.100:0/310431996 shutdown_connections 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f9e2690 0x55650fa41580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9ae230 0x55650f9e1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 --2- 172.21.15.100:0/310431996 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f973150 0x55650f96eae0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 -- 172.21.15.100:0/310431996 >> 172.21.15.100:0/310431996 conn(0x55650f93a4b0 msgr2=0x55650f9705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 -- 172.21.15.100:0/310431996 shutdown_connections 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.976+0000 7f523478f740 1 -- 172.21.15.100:0/310431996 wait complete. 2024-02-21T07:51:21.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.977+0000 7f523478f740 1 -- start start 2024-02-21T07:51:21.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.978+0000 7f523478f740 1 Processor -- start 2024-02-21T07:51:21.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f9e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f979600 con 0x55650f973150 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650fa3e810 con 0x55650f9e2690 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f9a5100 con 0x55650f9ae230 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f523478f740 10 client.0 _ll_register_callbacks cb 0x7f522c0693d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f522a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f522aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f522a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53110/0 (socket says 172.21.15.100:53110) 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f522aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38734/0 (socket says 172.21.15.100:38734) 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.980+0000 7f522a000640 1 -- 172.21.15.100:0/3964290522 learned_addr learned my addr 172.21.15.100:0/3964290522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522b400640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f9e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522a000640 1 -- 172.21.15.100:0/3964290522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 msgr2=0x55650f9e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522a000640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f9e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522a000640 1 -- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 msgr2=0x55650f9a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522a000640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522a000640 1 -- 172.21.15.100:0/3964290522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55650f8d7c50 con 0x55650f9ae230 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522aa00640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.981+0000 7f522b400640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f9e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.982+0000 7f522a000640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55650f99f8b0 tx=0x7f5218005d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e36f0d6992ae9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.982+0000 7f520be00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:21.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.982+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218005f50 con 0x55650f9ae230 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.982+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f52180060b0 con 0x55650f9ae230 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.982+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55650f8fed30 con 0x55650f9ae230 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5218004020 con 0x55650f9ae230 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 10 client.6185 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55650f89a2c0 con 0x55650f9ae230 2024-02-21T07:51:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55650f8fed30 con 0x55650f9ae230 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5218011040 con 0x55650f9ae230 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 10 client.6185 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 10 client.6185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 20 client.6185 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99b350 0x55650fa3db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 4 client.6185 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.983+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55650f5d9600 con 0x55650f99b350 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.984+0000 7f522aa00640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99b350 0x55650fa3db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.984+0000 7f522aa00640 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99b350 0x55650fa3db70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=202cbe3ab24790b6 server_cookie=8bb89ecddca3ac69 in_seq=0 out_seq=0 2024-02-21T07:51:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.984+0000 7f520be00640 10 client.6185 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.999+0000 7f520be00640 1 -- 172.21.15.100:0/3964290522 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55650f5d9600 con 0x55650f99b350 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.999+0000 7f520be00640 10 client.6185 handle_command_reply: tid=0 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:21.999+0000 7f523478f740 1 client.6185 shutdown 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 msgr2=0x55650f978fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55650f99f8b0 tx=0x7f5218005d60 comp rx=0 tx=0).stop 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 shutdown_connections 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55650f99b350 0x55650fa3db70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55650f9e2690 0x55650f9e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55650f9ae230 0x55650f978fa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f520be00640 0 client.6185 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 --2- 172.21.15.100:0/3964290522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55650f973150 0x55650f9a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 >> 172.21.15.100:0/3964290522 conn(0x55650f93a4b0 msgr2=0x55650f9deff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:22.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 shutdown_connections 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 1 -- 172.21.15.100:0/3964290522 wait complete. 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.000+0000 7f523478f740 20 client.6185 trim_cache size 0 max 16384 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:51:22.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:51:22.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 msgr2=0x7f520c0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 0x7f520c0a1630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f521c02b8c0 tx=0x7f521c03d040 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 msgr2=0x7f52240f1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 0x7f52240f1300 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f522c0507e0 tx=0x7f522c06bf30 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 shutdown_connections 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f52241125c0 0x7f52240f1300 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f520c09f170 0x7f520c0a1630 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5224110f40 0x7f522410a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 --2- 172.21.15.100:0/4158534459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f522410f3f0 0x7f52241a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:22.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 >> 172.21.15.100:0/4158534459 conn(0x7f5224052de0 msgr2=0x7f5224056020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.001+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 shutdown_connections 2024-02-21T07:51:22.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:22.002+0000 7f522be00640 1 -- 172.21.15.100:0/4158534459 wait complete. 2024-02-21T07:51:35.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.225+0000 7f0738a00640 1 Processor -- start 2024-02-21T07:51:35.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.227+0000 7f0738a00640 1 -- start start 2024-02-21T07:51:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.229+0000 7f0738a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07340f61d0 0x7f07341901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.229+0000 7f0738a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340cc0e0 con 0x7f073418a590 2024-02-21T07:51:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.229+0000 7f0738a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340cc380 con 0x7f07341906e0 2024-02-21T07:51:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.229+0000 7f0738a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07340cc660 con 0x7f07340f61d0 2024-02-21T07:51:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f073418a590 0x7f07340cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60522/0 (socket says 172.21.15.100:60522) 2024-02-21T07:51:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f07340f61d0 0x7f07341901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731e00640 1 -- 172.21.15.100:0/1801136322 learned_addr learned my addr 172.21.15.100:0/1801136322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731400640 1 -- 172.21.15.100:0/1801136322 >> v1:172.21.15.170:6789/0 conn(0x7f07341906e0 legacy=0x7f0734190b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731400640 1 -- 172.21.15.100:0/1801136322 >> v1:172.21.15.100:6789/0 conn(0x7f073418a590 legacy=0x7f07340cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.230+0000 7f0731400640 1 -- 172.21.15.100:0/1801136322 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07340cc940 con 0x7f07340f61d0 2024-02-21T07:51:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.233+0000 7f0731400640 1 --2- 172.21.15.100:0/1801136322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07340f61d0 0x7f07341901a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f07200097a0 tx=0x7f072002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b3a50c5d6326178 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.237+0000 7f0730a00640 1 -- 172.21.15.100:0/1801136322 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072002f050 con 0x7f07340f61d0 2024-02-21T07:51:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.237+0000 7f0730a00640 1 -- 172.21.15.100:0/1801136322 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720031700 con 0x7f07340f61d0 2024-02-21T07:51:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.237+0000 7f0730a00640 1 -- 172.21.15.100:0/1801136322 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720031a90 con 0x7f07340f61d0 2024-02-21T07:51:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.238+0000 7f0738a00640 1 -- 172.21.15.100:0/1801136322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07340f61d0 msgr2=0x7f07341901a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.238+0000 7f0738a00640 1 --2- 172.21.15.100:0/1801136322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07340f61d0 0x7f07341901a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f07200097a0 tx=0x7f072002b7a0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.239+0000 7f0738a00640 1 -- 172.21.15.100:0/1801136322 shutdown_connections 2024-02-21T07:51:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.239+0000 7f0738a00640 1 --2- 172.21.15.100:0/1801136322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f07340f61d0 0x7f07341901a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.239+0000 7f0738a00640 1 -- 172.21.15.100:0/1801136322 >> 172.21.15.100:0/1801136322 conn(0x7f07340ce1b0 msgr2=0x7f07340ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.239+0000 7f0738a00640 1 -- 172.21.15.100:0/1801136322 shutdown_connections 2024-02-21T07:51:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.239+0000 7f0738a00640 1 -- 172.21.15.100:0/1801136322 wait complete. 2024-02-21T07:51:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.242+0000 7f0738a00640 1 Processor -- start 2024-02-21T07:51:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.242+0000 7f0738a00640 1 -- start start 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 0x7f0734171c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 0x7f0734172190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 0x7f07342247a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734172b50 con 0x7f07341906e0 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734172870 con 0x7f073418a590 2024-02-21T07:51:35.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0738a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0734170870 con 0x7f07340f61d0 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0731e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 0x7f0734171c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0731e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 0x7f0734171c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41176/0 (socket says 172.21.15.100:41176) 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0731e00640 1 -- 172.21.15.100:0/3026063867 learned_addr learned my addr 172.21.15.100:0/3026063867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0731400640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 0x7f0734172190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.244+0000 7f0732800640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 0x7f07342247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0731400640 1 -- 172.21.15.100:0/3026063867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 msgr2=0x7f0734171c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0731400640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 0x7f0734171c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0731400640 1 -- 172.21.15.100:0/3026063867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 msgr2=0x7f07342247a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0731400640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 0x7f07342247a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0731400640 1 -- 172.21.15.100:0/3026063867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720009400 con 0x7f073418a590 2024-02-21T07:51:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.245+0000 7f0732800640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 0x7f07342247a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.246+0000 7f0731400640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 0x7f0734172190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0720033000 tx=0x7f07200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.247+0000 7f072a000640 1 -- 172.21.15.100:0/3026063867 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0720033bf0 con 0x7f073418a590 2024-02-21T07:51:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.247+0000 7f072a000640 1 -- 172.21.15.100:0/3026063867 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720033d50 con 0x7f073418a590 2024-02-21T07:51:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.247+0000 7f072a000640 1 -- 172.21.15.100:0/3026063867 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072003e6a0 con 0x7f073418a590 2024-02-21T07:51:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.247+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0734170b50 con 0x7f073418a590 2024-02-21T07:51:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.248+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734171110 con 0x7f073418a590 2024-02-21T07:51:35.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.254+0000 7f072a000640 1 -- 172.21.15.100:0/3026063867 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f072003a040 con 0x7f073418a590 2024-02-21T07:51:35.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.254+0000 7f073b608740 1 Processor -- start 2024-02-21T07:51:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.255+0000 7f073b608740 1 -- start start 2024-02-21T07:51:35.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.256+0000 7f072a000640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 0x7f07140a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.257+0000 7f072a000640 1 -- 172.21.15.100:0/3026063867 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f07200ebab0 con 0x7f073418a590 2024-02-21T07:51:35.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.257+0000 7f0732800640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 0x7f07140a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.258+0000 7f0732800640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 0x7f07140a1630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0734188160 tx=0x7f072c00d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be2cf90 0x55af2be68450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bde8620 con 0x55af2be9c4d0 2024-02-21T07:51:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bd9a8c0 con 0x55af2be68070 2024-02-21T07:51:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.263+0000 7f073b608740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bd97df0 con 0x55af2be2cf90 2024-02-21T07:51:35.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.264+0000 7f0731400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.265+0000 7f0731400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41554/0 (socket says 172.21.15.100:41554) 2024-02-21T07:51:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.265+0000 7f0731400640 1 -- 172.21.15.100:0/1721621772 learned_addr learned my addr 172.21.15.100:0/1721621772 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:35.268 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.265+0000 7f0732800640 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be2cf90 0x55af2be68450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.266+0000 7f0731400640 1 -- 172.21.15.100:0/1721621772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be2cf90 msgr2=0x55af2be68450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.266+0000 7f0731400640 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be2cf90 0x55af2be68450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.266+0000 7f0731400640 1 -- 172.21.15.100:0/1721621772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 msgr2=0x55af2be27440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.266+0000 7f0731400640 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be27440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.266+0000 7f0731400640 1 -- 172.21.15.100:0/1721621772 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af2bd14b00 con 0x55af2be9c4d0 2024-02-21T07:51:35.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.268+0000 7f0731400640 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07200b95c0 tx=0x7f07200b9230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57405a8aa6f0ad47 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.269+0000 7f071e600640 1 -- 172.21.15.100:0/1721621772 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072002f020 con 0x55af2be9c4d0 2024-02-21T07:51:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.269+0000 7f071e600640 1 -- 172.21.15.100:0/1721621772 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07200b9630 con 0x55af2be9c4d0 2024-02-21T07:51:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.269+0000 7f071e600640 1 -- 172.21.15.100:0/1721621772 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200bd780 con 0x55af2be9c4d0 2024-02-21T07:51:35.274 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.270+0000 7f073b608740 1 -- 172.21.15.100:0/1721621772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 msgr2=0x55af2be2ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.270+0000 7f073b608740 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f07200b95c0 tx=0x7f07200b9230 comp rx=0 tx=0).stop 2024-02-21T07:51:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.271+0000 7f073b608740 1 -- 172.21.15.100:0/1721621772 shutdown_connections 2024-02-21T07:51:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.271+0000 7f073b608740 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be2cf90 0x55af2be68450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.271+0000 7f073b608740 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be9c4d0 0x55af2be2ca50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.271+0000 7f073b608740 1 --2- 172.21.15.100:0/1721621772 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.271+0000 7f073b608740 1 -- 172.21.15.100:0/1721621772 >> 172.21.15.100:0/1721621772 conn(0x55af2bdf44b0 msgr2=0x55af2be2bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.273+0000 7f073b608740 1 -- 172.21.15.100:0/1721621772 shutdown_connections 2024-02-21T07:51:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.273+0000 7f073b608740 1 -- 172.21.15.100:0/1721621772 wait complete. 2024-02-21T07:51:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.274+0000 7f073b608740 1 -- start start 2024-02-21T07:51:35.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.275+0000 7f073b608740 1 Processor -- start 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.277+0000 7f073b608740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2beab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.277+0000 7f073b608740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be8ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.277+0000 7f073b608740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f073b608740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bd935d0 con 0x55af2be2cf90 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f073b608740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bd38b50 con 0x55af2be68070 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f073b608740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2bd387f0 con 0x55af2be9c4d0 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41194/0 (socket says 172.21.15.100:41194) 2024-02-21T07:51:35.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 -- 172.21.15.100:0/2449162258 learned_addr learned my addr 172.21.15.100:0/2449162258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0731e00640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2beab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0731400640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be8ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 -- 172.21.15.100:0/2449162258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 msgr2=0x55af2be8ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be8ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f0732800640 1 -- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 msgr2=0x55af2beab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.278+0000 7f073b608740 10 client.0 _ll_register_callbacks cb 0x55af2bd4c550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f0732800640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2beab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f0732800640 1 -- 172.21.15.100:0/2449162258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0734171110 con 0x55af2be9c4d0 2024-02-21T07:51:35.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f0731e00640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2beab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:35.284 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af2bd65cd0 con 0x55af2be9c4d0 2024-02-21T07:51:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f0732800640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f072c016440 tx=0x7f072c004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84eac2d60d9227be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.279+0000 7f0712a00640 10 client.6194 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:35.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.280+0000 7f0712a00640 1 -- 172.21.15.100:0/2449162258 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c010040 con 0x55af2be9c4d0 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.280+0000 7f0712a00640 1 -- 172.21.15.100:0/2449162258 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f072c0217e0 con 0x55af2be9c4d0 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.280+0000 7f0712a00640 1 -- 172.21.15.100:0/2449162258 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f072c021a00 con 0x55af2be9c4d0 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.281+0000 7f073b608740 10 client.6194 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.281+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x55af2bd91c50 con 0x55af2be9c4d0 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f0712a00640 1 -- 172.21.15.100:0/2449162258 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f072c021b60 con 0x55af2be9c4d0 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 10 client.6194 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 10 client.6194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 20 client.6194 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2beab760 0x55af2beafc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 4 client.6194 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:35.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.282+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af2bd89ce0 con 0x55af2beab760 2024-02-21T07:51:35.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.285+0000 7f0731e00640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2beab760 0x55af2beafc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.289+0000 7f0731e00640 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2beab760 0x55af2beafc10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e5ae5e909eebbda server_cookie=3b88d751bbbdf412 in_seq=0 out_seq=0 2024-02-21T07:51:35.293 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.290+0000 7f0712a00640 10 client.6194 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.290+0000 7f0712a00640 1 -- 172.21.15.100:0/2449162258 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55af2bd89ce0 con 0x55af2beab760 2024-02-21T07:51:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.290+0000 7f0712a00640 10 client.6194 handle_command_reply: tid=0 2024-02-21T07:51:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.290+0000 7f073b608740 1 client.6194 shutdown 2024-02-21T07:51:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 msgr2=0x55af2be5d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f072c016440 tx=0x7f072c004a60 comp rx=0 tx=0).stop 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 shutdown_connections 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2beab760 0x55af2beafc10 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2be5d7c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be68070 0x55af2be8ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 --2- 172.21.15.100:0/2449162258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2beab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.291+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 >> 172.21.15.100:0/2449162258 conn(0x55af2bdf44b0 msgr2=0x55af2be32e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.292+0000 7f0712a00640 0 client.6194 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.292+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 shutdown_connections 2024-02-21T07:51:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.292+0000 7f073b608740 1 -- 172.21.15.100:0/2449162258 wait complete. 2024-02-21T07:51:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.293+0000 7f073b608740 20 client.6194 trim_cache size 0 max 16384 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.316+0000 7f073b608740 1 Processor -- start 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.316+0000 7f073b608740 1 -- start start 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.318+0000 7f073b608740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2be586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.318+0000 7f073b608740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.318+0000 7f073b608740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 0x55af2bea9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f073b608740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2badbe60 con 0x55af2be2cf90 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f073b608740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2be2a930 con 0x55af2be9c4d0 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f073b608740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2be8fd10 con 0x55af2be68070 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41196/0 (socket says 172.21.15.100:41196) 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 -- 172.21.15.100:0/1567502574 learned_addr learned my addr 172.21.15.100:0/1567502574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0732800640 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 0x55af2bea9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 -- 172.21.15.100:0/1567502574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 msgr2=0x55af2bea9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 0x55af2bea9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 -- 172.21.15.100:0/1567502574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 msgr2=0x55af2be586f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2be586f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.319+0000 7f0731400640 1 -- 172.21.15.100:0/1567502574 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af2bd2e530 con 0x55af2be68070 2024-02-21T07:51:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.320+0000 7f0732800640 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 0x55af2bea9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.321+0000 7f0731400640 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0720000c00 tx=0x7f072004b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15cb901c779695bf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.322+0000 7f071dc00640 1 -- 172.21.15.100:0/1567502574 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200d1040 con 0x55af2be68070 2024-02-21T07:51:35.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.322+0000 7f071dc00640 1 -- 172.21.15.100:0/1567502574 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07200c1dd0 con 0x55af2be68070 2024-02-21T07:51:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.322+0000 7f071dc00640 1 -- 172.21.15.100:0/1567502574 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200d1040 con 0x55af2be68070 2024-02-21T07:51:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 -- 172.21.15.100:0/1567502574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 msgr2=0x55af2be68af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0720000c00 tx=0x7f072004b000 comp rx=0 tx=0).stop 2024-02-21T07:51:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 -- 172.21.15.100:0/1567502574 shutdown_connections 2024-02-21T07:51:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be9c4d0 0x55af2bea9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be68070 0x55af2be68af0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 --2- 172.21.15.100:0/1567502574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be2cf90 0x55af2be586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.323+0000 7f073b608740 1 -- 172.21.15.100:0/1567502574 >> 172.21.15.100:0/1567502574 conn(0x55af2bdf44b0 msgr2=0x55af2be22bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.324+0000 7f073b608740 1 -- 172.21.15.100:0/1567502574 shutdown_connections 2024-02-21T07:51:35.328 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.324+0000 7f073b608740 1 -- 172.21.15.100:0/1567502574 wait complete. 2024-02-21T07:51:35.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.327+0000 7f073b608740 1 -- start start 2024-02-21T07:51:35.332 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.329+0000 7f073b608740 1 Processor -- start 2024-02-21T07:51:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.331+0000 7f073b608740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.331+0000 7f073b608740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 0x55af2beac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.331+0000 7f073b608740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2bf047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.331+0000 7f073b608740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2be58310 con 0x55af2be68070 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.331+0000 7f073b608740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2be31c30 con 0x55af2be2cf90 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f073b608740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af2beacda0 con 0x55af2be9c4d0 2024-02-21T07:51:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f073b608740 10 client.0 _ll_register_callbacks cb 0x7f072002bcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f0731e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f0731e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55424/0 (socket says 172.21.15.100:55424) 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f0731e00640 1 -- 172.21.15.100:0/1960138661 learned_addr learned my addr 172.21.15.100:0/1960138661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.332+0000 7f0731400640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 0x55af2beac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0732800640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2bf047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731400640 1 -- 172.21.15.100:0/1960138661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 msgr2=0x55af2bf047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731400640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2bf047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731400640 1 -- 172.21.15.100:0/1960138661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 msgr2=0x55af2be29270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731400640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731400640 1 -- 172.21.15.100:0/1960138661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af2bd14b00 con 0x55af2be68070 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.333+0000 7f0731e00640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.334+0000 7f0731400640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 0x55af2beac740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07200e9820 tx=0x7f072002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f134faf255be6b27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.334+0000 7f0712a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.334+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07200d1040 con 0x55af2be68070 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.334+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f07200b9630 con 0x55af2be68070 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.334+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af2be9ed80 con 0x55af2be68070 2024-02-21T07:51:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f072002f040 con 0x55af2be68070 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 10 client.6066 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55af2bd542c0 con 0x55af2be68070 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af2be9ed80 con 0x55af2be68070 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0720050020 con 0x55af2be68070 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 10 client.6066 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 10 client.6066 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 20 client.6066 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2be9ac30 0x55af2be6b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 4 client.6066 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:51:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.335+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55af2bdb8d30 con 0x55af2be9ac30 2024-02-21T07:51:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.339+0000 7f0731e00640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2be9ac30 0x55af2be6b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.349+0000 7f0731e00640 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2be9ac30 0x55af2be6b1b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b4f20fdc2d9aa0 server_cookie=20fb58e12723792b in_seq=0 out_seq=0 2024-02-21T07:51:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.349+0000 7f0712a00640 10 client.6066 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.406+0000 7f0712a00640 1 -- 172.21.15.100:0/1960138661 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55af2bdb8d30 con 0x55af2be9ac30 2024-02-21T07:51:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.406+0000 7f0712a00640 10 client.6066 handle_command_reply: tid=0 2024-02-21T07:51:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.406+0000 7f073b608740 1 client.6066 shutdown 2024-02-21T07:51:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.407+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 msgr2=0x55af2beac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.407+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 0x55af2beac740 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f07200e9820 tx=0x7f072002d070 comp rx=0 tx=0).stop 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 shutdown_connections 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55af2be9ac30 0x55af2be6b1b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55af2be9c4d0 0x55af2bf047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55af2be68070 0x55af2beac740 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 --2- 172.21.15.100:0/1960138661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55af2be2cf90 0x55af2be29270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.414 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 >> 172.21.15.100:0/1960138661 conn(0x55af2bdf44b0 msgr2=0x55af2be5f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f0712a00640 0 client.6066 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 shutdown_connections 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.411+0000 7f073b608740 1 -- 172.21.15.100:0/1960138661 wait complete. 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.412+0000 7f073b608740 20 client.6066 trim_cache size 0 max 16384 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:51:35.415 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:51:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:51:35.416 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:51:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.414+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 msgr2=0x7f07140a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.414+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 0x7f07140a1630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0734188160 tx=0x7f072c00d040 comp rx=0 tx=0).stop 2024-02-21T07:51:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.414+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 msgr2=0x7f0734172190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:35.417 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.414+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 0x7f0734172190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0720033000 tx=0x7f07200046c0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 shutdown_connections 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f071409f170 0x7f07140a1630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07341906e0 0x7f07342247a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073418a590 0x7f0734172190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 --2- 172.21.15.100:0/3026063867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f07340f61d0 0x7f0734171c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:35.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.422+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 >> 172.21.15.100:0/3026063867 conn(0x7f07340ce1b0 msgr2=0x7f07340ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.424+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 shutdown_connections 2024-02-21T07:51:35.427 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:35.424+0000 7f0738a00640 1 -- 172.21.15.100:0/3026063867 wait complete. 2024-02-21T07:51:36.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:51:36.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:51:37.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.175+0000 7f3fb9800640 1 Processor -- start 2024-02-21T07:51:37.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.177+0000 7f3fb9800640 1 -- start start 2024-02-21T07:51:37.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.182+0000 7f3fb1600640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f3fb406da30 0x7f3fb4186400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:45820/0 (socket says 172.21.15.100:45820) 2024-02-21T07:51:37.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.182+0000 7f3fb1600640 1 -- 172.21.15.100:0/3390919859 learned_addr learned my addr 172.21.15.100:0/3390919859 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:37.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.184+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb41822c0 con 0x7f3fb40cec80 2024-02-21T07:51:37.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.184+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb406dff0 con 0x7f3fb406da30 2024-02-21T07:51:37.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.185+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886585623 0 0) 0x7f3fb406dff0 con 0x7f3fb406da30 2024-02-21T07:51:37.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.186+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb406e2d0 con 0x7f3fb4181ee0 2024-02-21T07:51:37.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.187+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f98003520 con 0x7f3fb406da30 2024-02-21T07:51:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293788086 0 0) 0x7f3fb406e2d0 con 0x7f3fb4181ee0 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fb406dff0 con 0x7f3fb4181ee0 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454773336 0 0) 0x7f3f98003520 con 0x7f3fb406da30 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 >> v1:172.21.15.170:6789/0 conn(0x7f3fb4181ee0 legacy=0x7f3fb4185cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 >> v1:172.21.15.100:6789/0 conn(0x7f3fb40cec80 legacy=0x7f3fb406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb406e5b0 con 0x7f3fb406da30 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f3fa0000ed0 con 0x7f3fb406da30 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 >> v1:172.21.15.156:6789/0 conn(0x7f3fb406da30 legacy=0x7f3fb4186400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f98003b80 0x7f3f98003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f980047c0 0x7f3f98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 0x7f3f9800df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9800e560 con 0x7f3f98003b80 2024-02-21T07:51:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9800e6a0 con 0x7f3f9800bb80 2024-02-21T07:51:37.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.190+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9800e860 con 0x7f3f980047c0 2024-02-21T07:51:37.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.196+0000 7f3fb2000640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f98003b80 0x7f3f98003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.196+0000 7f3fb1600640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f980047c0 0x7f3f98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.196+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 0x7f3f9800df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.197+0000 7f3fb2a00640 1 -- 172.21.15.100:0/3390919859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f980047c0 msgr2=0x7f3f98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.197+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f980047c0 0x7f3f98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.197+0000 7f3fb2a00640 1 -- 172.21.15.100:0/3390919859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f98003b80 msgr2=0x7f3f98003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.197+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f98003b80 0x7f3f98003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.197+0000 7f3fb2a00640 1 -- 172.21.15.100:0/3390919859 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb406e5b0 con 0x7f3f9800bb80 2024-02-21T07:51:37.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.199+0000 7f3fb2a00640 1 -- 172.21.15.100:0/3390919859 reap_dead start 2024-02-21T07:51:37.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.203+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 0x7f3f9800df70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001e40 tx=0x7f3f980057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d9132b638ed20c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.204+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4003b70 con 0x7f3f9800bb80 2024-02-21T07:51:37.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.205+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4003cd0 con 0x7f3f9800bb80 2024-02-21T07:51:37.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.205+0000 7f3fb3e00640 1 -- 172.21.15.100:0/3390919859 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4005310 con 0x7f3f9800bb80 2024-02-21T07:51:37.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.208+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 msgr2=0x7f3f9800df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.208+0000 7f3fb9800640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 0x7f3f9800df70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001e40 tx=0x7f3f980057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.209+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 shutdown_connections 2024-02-21T07:51:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.209+0000 7f3fb9800640 1 --2- 172.21.15.100:0/3390919859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f9800bb80 0x7f3f9800df70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.209+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 >> 172.21.15.100:0/3390919859 conn(0x7f3fb40ce160 msgr2=0x7f3fb40ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.210+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 shutdown_connections 2024-02-21T07:51:37.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.210+0000 7f3fb9800640 1 -- 172.21.15.100:0/3390919859 wait complete. 2024-02-21T07:51:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.219+0000 7f3fb9800640 1 Processor -- start 2024-02-21T07:51:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.219+0000 7f3fb9800640 1 -- start start 2024-02-21T07:51:37.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.221+0000 7f3fb9800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.221+0000 7f3fb9800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 0x7f3fb4178250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 0x7f3fb4224e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb9800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb42239c0 con 0x7f3fb4224a00 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb9800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41874e0 con 0x7f3fb4177dd0 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb9800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41877c0 con 0x7f3f9800bb80 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41216/0 (socket says 172.21.15.100:41216) 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb2000640 1 -- 172.21.15.100:0/88511945 learned_addr learned my addr 172.21.15.100:0/88511945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb1600640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 0x7f3fb4178250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.222+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 0x7f3fb4224e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2000640 1 -- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 msgr2=0x7f3fb4178250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2000640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 0x7f3fb4178250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2000640 1 -- 172.21.15.100:0/88511945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 msgr2=0x7f3fb4224e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2000640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 0x7f3fb4224e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2000640 1 -- 172.21.15.100:0/88511945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4187aa0 con 0x7f3f9800bb80 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.223+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 0x7f3fb4224e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.224+0000 7f3fb1600640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 0x7f3fb4178250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:37.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.225+0000 7f3fb2000640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0079d0 tx=0x7f3fac00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.226+0000 7f3faaa00640 1 -- 172.21.15.100:0/88511945 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00ee90 con 0x7f3f9800bb80 2024-02-21T07:51:37.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.226+0000 7f3faaa00640 1 -- 172.21.15.100:0/88511945 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac014070 con 0x7f3f9800bb80 2024-02-21T07:51:37.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.226+0000 7f3faaa00640 1 -- 172.21.15.100:0/88511945 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac005310 con 0x7f3f9800bb80 2024-02-21T07:51:37.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.227+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4223f20 con 0x7f3f9800bb80 2024-02-21T07:51:37.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.227+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb42244e0 con 0x7f3f9800bb80 2024-02-21T07:51:37.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.246+0000 7f3fbc621740 1 Processor -- start 2024-02-21T07:51:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.247+0000 7f3fbc621740 1 -- start start 2024-02-21T07:51:37.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.247+0000 7f3faaa00640 1 -- 172.21.15.100:0/88511945 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3fac018030 con 0x7f3f9800bb80 2024-02-21T07:51:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.250+0000 7f3faaa00640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 0x7f3f940a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.250+0000 7f3faaa00640 1 -- 172.21.15.100:0/88511945 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fac016070 con 0x7f3f9800bb80 2024-02-21T07:51:37.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.251+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 0x7f3f940a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.251+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.255+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c65580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.255+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.255+0000 7f3fbc621740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1b9c150 con 0x5576b1c9b160 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41218/0 (socket says 172.21.15.100:41218) 2024-02-21T07:51:37.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb2000640 1 -- 172.21.15.100:0/3728596626 learned_addr learned my addr 172.21.15.100:0/3728596626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb1600640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c65580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 0x7f3f940a1630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800e830 tx=0x7f3fa4009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1b99680 con 0x5576b1c65ac0 2024-02-21T07:51:37.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.256+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1b94e60 con 0x5576b1c651a0 2024-02-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.262+0000 7f3fb2000640 1 -- 172.21.15.100:0/3728596626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 msgr2=0x5576b1c280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.262+0000 7f3fb2000640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.262+0000 7f3fb2000640 1 -- 172.21.15.100:0/3728596626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 msgr2=0x5576b1c65580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.263+0000 7f3fb2000640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c65580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.263+0000 7f3fb2000640 1 -- 172.21.15.100:0/3728596626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576b1b4e060 con 0x5576b1c651a0 2024-02-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.263+0000 7f3fb1600640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c65580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.264+0000 7f3fb2000640 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0013b0 tx=0x7f3fac097720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204edfb033445d50 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.266+0000 7f3f9f400640 1 -- 172.21.15.100:0/3728596626 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac09f700 con 0x5576b1c651a0 2024-02-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.266+0000 7f3f9f400640 1 -- 172.21.15.100:0/3728596626 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac095260 con 0x5576b1c651a0 2024-02-21T07:51:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.266+0000 7f3f9f400640 1 -- 172.21.15.100:0/3728596626 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac09f270 con 0x5576b1c651a0 2024-02-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.267+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 msgr2=0x5576b1c9ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.267+0000 7f3fbc621740 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0013b0 tx=0x7f3fac097720 comp rx=0 tx=0).stop 2024-02-21T07:51:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.268+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 shutdown_connections 2024-02-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.268+0000 7f3fbc621740 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.268+0000 7f3fbc621740 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c65580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.268+0000 7f3fbc621740 1 --2- 172.21.15.100:0/3728596626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c9ac20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.268+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 >> 172.21.15.100:0/3728596626 conn(0x5576b1bf45a0 msgr2=0x5576b1c2c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.269+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 shutdown_connections 2024-02-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.269+0000 7f3fbc621740 1 -- 172.21.15.100:0/3728596626 wait complete. 2024-02-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.270+0000 7f3fbc621740 1 -- start start 2024-02-21T07:51:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.271+0000 7f3fbc621740 1 Processor -- start 2024-02-21T07:51:37.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.274+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c26fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 0x5576b1cad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fb2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 0x5576b1cad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fb2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 0x5576b1cad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55440/0 (socket says 172.21.15.100:55440) 2024-02-21T07:51:37.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.275+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41588/0 (socket says 172.21.15.100:41588) 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1959451986 learned_addr learned my addr 172.21.15.100:0/1959451986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1b39ec0 con 0x5576b1c651a0 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1b39b60 con 0x5576b1c9b160 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b19031c0 con 0x5576b1c65ac0 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c26fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 -- 172.21.15.100:0/1959451986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 msgr2=0x5576b1cad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 0x5576b1cad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 -- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 msgr2=0x5576b1c26700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb1600640 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb42244e0 con 0x5576b1c65ac0 2024-02-21T07:51:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.276+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.277+0000 7f3fbc621740 10 client.0 _ll_register_callbacks cb 0x5576b1b4d960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.277+0000 7f3fb1600640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c26fb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5576b1c71b00 tx=0x7f3fa0013ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c29448c82037db7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.277+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576b18947e0 con 0x5576b1c65ac0 2024-02-21T07:51:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.277+0000 7f3f93e00640 10 client.6212 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.278+0000 7f3f93e00640 1 -- 172.21.15.100:0/1959451986 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0018070 con 0x5576b1c65ac0 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.278+0000 7f3f93e00640 1 -- 172.21.15.100:0/1959451986 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fa0011a00 con 0x5576b1c65ac0 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.279+0000 7f3f93e00640 1 -- 172.21.15.100:0/1959451986 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fa0009040 con 0x5576b1c65ac0 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.279+0000 7f3fbc621740 10 client.6212 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.279+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x5576b1b934e0 con 0x5576b1c65ac0 2024-02-21T07:51:37.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3f93e00640 1 -- 172.21.15.100:0/1959451986 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3fa000f040 con 0x5576b1c65ac0 2024-02-21T07:51:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 10 client.6212 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 10 client.6212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 20 client.6212 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c5ec20 0x5576b1c640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 4 client.6212 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:37.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.280+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576b18d1720 con 0x5576b1c5ec20 2024-02-21T07:51:37.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.282+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c5ec20 0x5576b1c640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.284+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c5ec20 0x5576b1c640d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81170d2e1c6aa941 server_cookie=f7400616bba35767 in_seq=0 out_seq=0 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.284+0000 7f3f93e00640 10 client.6212 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.285+0000 7f3f93e00640 1 -- 172.21.15.100:0/1959451986 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576b18d1720 con 0x5576b1c5ec20 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.285+0000 7f3f93e00640 10 client.6212 handle_command_reply: tid=0 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.285+0000 7f3fbc621740 1 client.6212 shutdown 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.286+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 msgr2=0x5576b1c26fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.286+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c26fb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5576b1c71b00 tx=0x7f3fa0013ed0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.286+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 shutdown_connections 2024-02-21T07:51:37.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.286+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c5ec20 0x5576b1c640d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.287+0000 7f3f93e00640 0 client.6212 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.287+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c9b160 0x5576b1cad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.287+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c26fb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.287+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1959451986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c651a0 0x5576b1c26700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.287+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 >> 172.21.15.100:0/1959451986 conn(0x5576b1bf45a0 msgr2=0x5576b1c92640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.288+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 shutdown_connections 2024-02-21T07:51:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.288+0000 7f3fbc621740 1 -- 172.21.15.100:0/1959451986 wait complete. 2024-02-21T07:51:37.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.288+0000 7f3fbc621740 20 client.6212 trim_cache size 0 max 16384 2024-02-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.321+0000 7f3fbc621740 1 Processor -- start 2024-02-21T07:51:37.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.322+0000 7f3fbc621740 1 -- start start 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c651a0 0x5576b1c2c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1c269e0 con 0x5576b1c5ec20 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1c946d0 con 0x5576b1c651a0 2024-02-21T07:51:37.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.323+0000 7f3fbc621740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1cac8c0 con 0x5576b1c65ac0 2024-02-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.325+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.326+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41602/0 (socket says 172.21.15.100:41602) 2024-02-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.326+0000 7f3fb2000640 1 -- 172.21.15.100:0/2633684808 learned_addr learned my addr 172.21.15.100:0/2633684808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.326+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.326+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c651a0 0x5576b1c2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.327+0000 7f3fb2000640 1 -- 172.21.15.100:0/2633684808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 msgr2=0x5576b1c275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.327+0000 7f3fb2000640 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c275d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.327+0000 7f3fb2000640 1 -- 172.21.15.100:0/2633684808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c651a0 msgr2=0x5576b1c2c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.327+0000 7f3fb2000640 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c651a0 0x5576b1c2c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.327+0000 7f3fb2000640 1 -- 172.21.15.100:0/2633684808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576b1b2f950 con 0x5576b1c5ec20 2024-02-21T07:51:37.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.329+0000 7f3fb2000640 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000b60 tx=0x7f3fac0c9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3fcec6dd445659 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.329+0000 7f3f9ea00640 1 -- 172.21.15.100:0/2633684808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0b9070 con 0x5576b1c5ec20 2024-02-21T07:51:37.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.329+0000 7f3f9ea00640 1 -- 172.21.15.100:0/2633684808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac095000 con 0x5576b1c5ec20 2024-02-21T07:51:37.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.329+0000 7f3f9ea00640 1 -- 172.21.15.100:0/2633684808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac09f270 con 0x5576b1c5ec20 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.332+0000 7f3fbc621740 1 -- 172.21.15.100:0/2633684808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 msgr2=0x5576b1c9f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.332+0000 7f3fbc621740 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3fac000b60 tx=0x7f3fac0c9000 comp rx=0 tx=0).stop 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.336+0000 7f3fbc621740 1 -- 172.21.15.100:0/2633684808 shutdown_connections 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.336+0000 7f3fbc621740 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c65ac0 0x5576b1c275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.336+0000 7f3fbc621740 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c651a0 0x5576b1c2c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.336+0000 7f3fbc621740 1 --2- 172.21.15.100:0/2633684808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c5ec20 0x5576b1c9f3e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.336+0000 7f3fbc621740 1 -- 172.21.15.100:0/2633684808 >> 172.21.15.100:0/2633684808 conn(0x5576b1bf45a0 msgr2=0x5576b1c289a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.337+0000 7f3fbc621740 1 -- 172.21.15.100:0/2633684808 shutdown_connections 2024-02-21T07:51:37.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.341+0000 7f3fbc621740 1 -- 172.21.15.100:0/2633684808 wait complete. 2024-02-21T07:51:37.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.343+0000 7f3fbc621740 1 -- start start 2024-02-21T07:51:37.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.343+0000 7f3fbc621740 1 Processor -- start 2024-02-21T07:51:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.352+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.352+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.352+0000 7f3fbc621740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.353+0000 7f3fb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.353+0000 7f3fb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41618/0 (socket says 172.21.15.100:41618) 2024-02-21T07:51:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.354+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.354+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.354+0000 7f3fb2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41228/0 (socket says 172.21.15.100:41228) 2024-02-21T07:51:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.354+0000 7f3fb1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55458/0 (socket says 172.21.15.100:55458) 2024-02-21T07:51:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.355+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1381237108 learned_addr learned my addr 172.21.15.100:0/1381237108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.355+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1cb0890 con 0x5576b1c9b160 2024-02-21T07:51:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.355+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1cfac50 con 0x5576b1c65ac0 2024-02-21T07:51:37.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.355+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576b1cfb870 con 0x5576b1c651a0 2024-02-21T07:51:37.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.356+0000 7f3fbc621740 10 client.0 _ll_register_callbacks cb 0x5576b1ca07e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:37.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.362+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1381237108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 msgr2=0x5576b1c5b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.364+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.365+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1381237108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 msgr2=0x5576b1c6d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.365+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.366+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576b1b4e060 con 0x5576b1c9b160 2024-02-21T07:51:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.367+0000 7f3fb1600640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:37.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.367+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:37.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.387+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001f30 tx=0x7f3fa4001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e2a4108d7bac9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.387+0000 7f3f93e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:37.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.387+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa404c040 con 0x5576b1c9b160 2024-02-21T07:51:37.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.388+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3fa4037430 con 0x5576b1c9b160 2024-02-21T07:51:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.392+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fac095260 con 0x5576b1c9b160 2024-02-21T07:51:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.395+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fa404c040 con 0x5576b1c9b160 2024-02-21T07:51:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.395+0000 7f3fbc621740 10 client.6081 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:37.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.395+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5576b1b55430 con 0x5576b1c9b160 2024-02-21T07:51:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.396+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac095260 con 0x5576b1c9b160 2024-02-21T07:51:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3fa4058020 con 0x5576b1c9b160 2024-02-21T07:51:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 10 client.6081 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 10 client.6081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 20 client.6081 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c28cd0 0x5576b1c27570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 4 client.6081 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:51:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.397+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5576b1920890 con 0x5576b1c28cd0 2024-02-21T07:51:37.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.405+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c28cd0 0x5576b1c27570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.406+0000 7f3fb2000640 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c28cd0 0x5576b1c27570 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c7d647506cf9af server_cookie=2292a42808649253 in_seq=0 out_seq=0 2024-02-21T07:51:37.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.406+0000 7f3f93e00640 10 client.6081 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:37.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.410+0000 7f3f93e00640 1 -- 172.21.15.100:0/1381237108 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5576b1920890 con 0x5576b1c28cd0 2024-02-21T07:51:37.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.411+0000 7f3f93e00640 10 client.6081 handle_command_reply: tid=0 2024-02-21T07:51:37.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.411+0000 7f3fbc621740 1 client.6081 shutdown 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.416+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 msgr2=0x5576b1c28790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.416+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4001f30 tx=0x7f3fa4001510 comp rx=0 tx=0).stop 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.416+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 shutdown_connections 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.416+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5576b1c28cd0 0x5576b1c27570 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.416+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576b1c9b160 0x5576b1c28790 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.417+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5576b1c65ac0 0x5576b1c6d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.417+0000 7f3fbc621740 1 --2- 172.21.15.100:0/1381237108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576b1c651a0 0x5576b1c5b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.417+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 >> 172.21.15.100:0/1381237108 conn(0x5576b1bf45a0 msgr2=0x5576b1c994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.421+0000 7f3f93e00640 0 client.6081 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:37.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.424+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 shutdown_connections 2024-02-21T07:51:37.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.424+0000 7f3fbc621740 1 -- 172.21.15.100:0/1381237108 wait complete. 2024-02-21T07:51:37.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.425+0000 7f3fbc621740 20 client.6081 trim_cache size 0 max 16384 2024-02-21T07:51:37.432 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:37.432 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:51:37.432 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:51:37.432 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:37.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.429+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 msgr2=0x7f3f940a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.429+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 0x7f3f940a1630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800e830 tx=0x7f3fa4009030 comp rx=0 tx=0).stop 2024-02-21T07:51:37.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.429+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 msgr2=0x7f3fb4223480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.429+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0079d0 tx=0x7f3fac00eb50 comp rx=0 tx=0).stop 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 shutdown_connections 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3f9409f170 0x7f3f940a1630 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb4224a00 0x7f3fb4224e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fb4177dd0 0x7f3fb4178250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 --2- 172.21.15.100:0/88511945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3f9800bb80 0x7f3fb4223480 secure :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0079d0 tx=0x7f3fac00eb50 comp rx=0 tx=0).stop 2024-02-21T07:51:37.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.430+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 >> 172.21.15.100:0/88511945 conn(0x7f3fb40ce160 msgr2=0x7f3fb40ecf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.434+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 shutdown_connections 2024-02-21T07:51:37.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.435+0000 7f3fb9800640 1 -- 172.21.15.100:0/88511945 wait complete. 2024-02-21T07:51:37.506 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:51:37.506 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:51:37.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.825+0000 7f533dc00640 1 Processor -- start 2024-02-21T07:51:37.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.825+0000 7f533dc00640 1 -- start start 2024-02-21T07:51:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.831+0000 7f533dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5338186050 0x7f533818aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.831+0000 7f533dc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5338186430 0x7f533818af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.831+0000 7f533dc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53380d5aa0 con 0x7f533818b4a0 2024-02-21T07:51:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.831+0000 7f533dc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533818a600 con 0x7f5338186050 2024-02-21T07:51:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.831+0000 7f533dc00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380d69b0 con 0x7f5338186430 2024-02-21T07:51:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.832+0000 7f5337400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f533818b4a0 0x7f533818bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:60018/0 (socket says 172.21.15.100:60018) 2024-02-21T07:51:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.832+0000 7f5337400640 1 -- 172.21.15.100:0/3876482220 learned_addr learned my addr 172.21.15.100:0/3876482220 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.832+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167973893 0 0) 0x7f53380d5aa0 con 0x7f533818b4a0 2024-02-21T07:51:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.833+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f531c003520 con 0x7f533818b4a0 2024-02-21T07:51:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5336a00640 1 --2- 172.21.15.100:0/3876482220 >> v2:172.21.15.100:3300/0 conn(0x7f5338186050 0x7f533818aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553036795 0 0) 0x7f531c003520 con 0x7f533818b4a0 2024-02-21T07:51:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 >> v2:172.21.15.156:3300/0 conn(0x7f5338186430 msgr2=0x7f533818af60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 --2- 172.21.15.100:0/3876482220 >> v2:172.21.15.156:3300/0 conn(0x7f5338186430 0x7f533818af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 >> v2:172.21.15.100:3300/0 conn(0x7f5338186050 msgr2=0x7f533818aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 --2- 172.21.15.100:0/3876482220 >> v2:172.21.15.100:3300/0 conn(0x7f5338186050 0x7f533818aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380d54e0 con 0x7f533818b4a0 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f53300019f0 con 0x7f533818b4a0 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 >> v1:172.21.15.170:6789/0 conn(0x7f533818b4a0 legacy=0x7f533818bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c003a10 0x7f531c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f531c0047c0 0x7f531c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f531c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533818a600 con 0x7f531c003a10 2024-02-21T07:51:37.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c014a50 con 0x7f531c005380 2024-02-21T07:51:37.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.835+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c014c10 con 0x7f531c0047c0 2024-02-21T07:51:37.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.836+0000 7f5336a00640 1 --2- 172.21.15.100:0/3876482220 >> v2:172.21.15.100:3300/0 conn(0x7f5338186050 0x7f533818aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.837+0000 7f5337400640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f531c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.838+0000 7f5336a00640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c003a10 0x7f531c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.840+0000 7f5337400640 1 -- 172.21.15.100:0/3876482220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f531c0047c0 msgr2=0x7f531c004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.840+0000 7f5337400640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f531c0047c0 0x7f531c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.840+0000 7f5337400640 1 -- 172.21.15.100:0/3876482220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c003a10 msgr2=0x7f531c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:37.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.843+0000 7f5337400640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c003a10 0x7f531c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.843+0000 7f5337400640 1 -- 172.21.15.100:0/3876482220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c003520 con 0x7f531c005380 2024-02-21T07:51:37.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.843+0000 7f5336a00640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f531c003a10 0x7f531c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:37.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.847+0000 7f5337400640 1 -- 172.21.15.100:0/3876482220 reap_dead start 2024-02-21T07:51:37.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.848+0000 7f5337400640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f531c014190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f533000a7b0 tx=0x7f531c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6fd7263d6cfa9ec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.850+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330034630 con 0x7f531c005380 2024-02-21T07:51:37.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.850+0000 7f5335600640 1 -- 172.21.15.100:0/3876482220 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533002f070 con 0x7f531c005380 2024-02-21T07:51:37.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.851+0000 7f533dc00640 1 -- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 msgr2=0x7f531c014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:37.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.851+0000 7f533dc00640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f531c014190 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f533000a7b0 tx=0x7f531c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.853+0000 7f533dc00640 1 -- 172.21.15.100:0/3876482220 shutdown_connections 2024-02-21T07:51:37.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.853+0000 7f533dc00640 1 --2- 172.21.15.100:0/3876482220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f531c014190 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.853+0000 7f533dc00640 1 -- 172.21.15.100:0/3876482220 >> 172.21.15.100:0/3876482220 conn(0x7f53380d2540 msgr2=0x7f53380d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:37.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.853+0000 7f533dc00640 1 -- 172.21.15.100:0/3876482220 shutdown_connections 2024-02-21T07:51:37.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.853+0000 7f533dc00640 1 -- 172.21.15.100:0/3876482220 wait complete. 2024-02-21T07:51:37.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.857+0000 7f533dc00640 1 Processor -- start 2024-02-21T07:51:37.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.857+0000 7f533dc00640 1 -- start start 2024-02-21T07:51:37.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.859+0000 7f533dc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f533806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.859+0000 7f533dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533816cc90 0x7f533821a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.860+0000 7f533dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.860+0000 7f533dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338173f40 con 0x7f533821a6a0 2024-02-21T07:51:37.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.860+0000 7f533dc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338218de0 con 0x7f531c005380 2024-02-21T07:51:37.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.860+0000 7f533dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53382190c0 con 0x7f533816cc90 2024-02-21T07:51:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.861+0000 7f5337400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.861+0000 7f5337400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41662/0 (socket says 172.21.15.100:41662) 2024-02-21T07:51:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.861+0000 7f5337400640 1 -- 172.21.15.100:0/3301069829 learned_addr learned my addr 172.21.15.100:0/3301069829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:37.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.862+0000 7f5337400640 1 -- 172.21.15.100:0/3301069829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533816cc90 msgr2=0x7f533821a160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:51:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.862+0000 7f5337400640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533816cc90 0x7f533821a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.862+0000 7f5337400640 1 -- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 msgr2=0x7f533806b9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:51:37.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.862+0000 7f5337400640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f533806b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:37.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.862+0000 7f5337400640 1 -- 172.21.15.100:0/3301069829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53382193a0 con 0x7f533821a6a0 2024-02-21T07:51:37.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.865+0000 7f5337400640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f533000a8d0 tx=0x7f5330001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:37.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.866+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300019b0 con 0x7f533821a6a0 2024-02-21T07:51:37.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.866+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330034bb0 con 0x7f533821a6a0 2024-02-21T07:51:37.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.866+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330004b60 con 0x7f533821a6a0 2024-02-21T07:51:37.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.868+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338219680 con 0x7f533821a6a0 2024-02-21T07:51:37.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.868+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5338219c40 con 0x7f533821a6a0 2024-02-21T07:51:37.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.870+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5338091c00 con 0x7f533821a6a0 2024-02-21T07:51:37.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.881+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5330031030 con 0x7f533821a6a0 2024-02-21T07:51:37.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.883+0000 7f532ea00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 0x7f53180a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.886+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f53300b9720 con 0x7f533821a6a0 2024-02-21T07:51:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.886+0000 7f5336a00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 0x7f53180a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.886+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f53300b5230 con 0x7f533821a6a0 2024-02-21T07:51:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:37.889+0000 7f5336a00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 0x7f53180a1660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5324006b10 tx=0x7f5324008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.368+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53380d6a10 con 0x7f533821a6a0 2024-02-21T07:51:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.382+0000 7f532ea00640 1 -- 172.21.15.100:0/3301069829 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f5330043070 con 0x7f533821a6a0 2024-02-21T07:51:38.387 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:51:38.387 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:51:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:51:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.387+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 msgr2=0x7f53180a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 0x7f53180a1660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5324006b10 tx=0x7f5324008040 comp rx=0 tx=0).stop 2024-02-21T07:51:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 msgr2=0x7f5338176c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f533000a8d0 tx=0x7f5330001cb0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 shutdown_connections 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f531809f1a0 0x7f53180a1660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f533821a6a0 0x7f5338176c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f533816cc90 0x7f533821a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 --2- 172.21.15.100:0/3301069829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f531c005380 0x7f533806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.388+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 >> 172.21.15.100:0/3301069829 conn(0x7f53380d2540 msgr2=0x7f5338179f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.390+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 shutdown_connections 2024-02-21T07:51:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.393+0000 7f533dc00640 1 -- 172.21.15.100:0/3301069829 wait complete. 2024-02-21T07:51:38.448 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:38.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:51:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.857+0000 7fbdffe00640 1 Processor -- start 2024-02-21T07:51:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.857+0000 7fbdffe00640 1 -- start start 2024-02-21T07:51:38.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.861+0000 7fbdffe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbdf8071010 0x7fbdf80713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.861+0000 7fbdffe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbdf8071d70 0x7fbdf806f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.861+0000 7fbdffe00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80700c0 con 0x7fbdf8071930 2024-02-21T07:51:38.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.862+0000 7fbdffe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf806fed0 con 0x7fbdf8071d70 2024-02-21T07:51:38.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.862+0000 7fbdffe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf806ea40 con 0x7fbdf8071010 2024-02-21T07:51:38.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.862+0000 7fbdfd400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbdf8071010 0x7fbdf80713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.862+0000 7fbdfd400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbdf8071010 0x7fbdf80713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41252/0 (socket says 172.21.15.100:41252) 2024-02-21T07:51:38.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.862+0000 7fbdfd400640 1 -- 172.21.15.100:0/2287723512 learned_addr learned my addr 172.21.15.100:0/2287723512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:38.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.872+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208330804 0 0) 0x7fbdf80700c0 con 0x7fbdf8071930 2024-02-21T07:51:38.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.872+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2287723512 >> v2:172.21.15.156:3300/0 conn(0x7fbdf8071d70 0x7fbdf806f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.872+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde0003520 con 0x7fbdf8071930 2024-02-21T07:51:38.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3161831083 0 0) 0x7fbde0003520 con 0x7fbdf8071930 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 >> v2:172.21.15.170:3300/0 conn(0x7fbdf8071010 msgr2=0x7fbdf80713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/2287723512 >> v2:172.21.15.170:3300/0 conn(0x7fbdf8071010 0x7fbdf80713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 >> v2:172.21.15.156:3300/0 conn(0x7fbdf8071d70 msgr2=0x7fbdf806f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/2287723512 >> v2:172.21.15.156:3300/0 conn(0x7fbdf8071d70 0x7fbdf806f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80703a0 con 0x7fbdf8071930 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fbde4001690 con 0x7fbdf8071930 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 >> v1:172.21.15.170:6789/0 conn(0x7fbdf8071930 legacy=0x7fbdf806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbde0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00047c0 0x7fbde0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbde0005180 0x7fbde000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf806ea40 con 0x7fbde00047c0 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000bf80 con 0x7fbde00039c0 2024-02-21T07:51:38.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.877+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde000c140 con 0x7fbde0005180 2024-02-21T07:51:38.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.878+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbde0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.881+0000 7fbdfd400640 1 -- 172.21.15.100:0/2287723512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbde0005180 msgr2=0x7fbde000b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.881+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbde0005180 0x7fbde000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.881+0000 7fbdfd400640 1 -- 172.21.15.100:0/2287723512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00047c0 msgr2=0x7fbde0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.881+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00047c0 0x7fbde0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.886+0000 7fbdfde00640 1 -- 172.21.15.100:0/2287723512 reap_dead start 2024-02-21T07:51:38.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.886+0000 7fbdfd400640 1 -- 172.21.15.100:0/2287723512 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80703a0 con 0x7fbde00039c0 2024-02-21T07:51:38.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.891+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbde0003de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8068330 tx=0x7fbde00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61771e6ba10179cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:38.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.893+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec007ad0 con 0x7fbde00039c0 2024-02-21T07:51:38.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.893+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec007c30 con 0x7fbde00039c0 2024-02-21T07:51:38.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.894+0000 7fbdf7e00640 1 -- 172.21.15.100:0/2287723512 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0090d0 con 0x7fbde00039c0 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 -- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 msgr2=0x7fbde0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbde0003de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8068330 tx=0x7fbde00057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 -- 172.21.15.100:0/2287723512 shutdown_connections 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2287723512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbde0003de0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 -- 172.21.15.100:0/2287723512 >> 172.21.15.100:0/2287723512 conn(0x7fbdf80668b0 msgr2=0x7fbdf8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:38.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 -- 172.21.15.100:0/2287723512 shutdown_connections 2024-02-21T07:51:38.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.898+0000 7fbdffe00640 1 -- 172.21.15.100:0/2287723512 wait complete. 2024-02-21T07:51:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.907+0000 7fbdffe00640 1 Processor -- start 2024-02-21T07:51:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.908+0000 7fbdffe00640 1 -- start start 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbdf821af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 0x7fbdf815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf815b4c0 0x7fbdf8218440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8176dd0 con 0x7fbdf815b4c0 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8175ee0 con 0x7fbde00039c0 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdffe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf81761c0 con 0x7fbdf8177260 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbdf821af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbdf821af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55484/0 (socket says 172.21.15.100:55484) 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdfd400640 1 -- 172.21.15.100:0/2786540492 learned_addr learned my addr 172.21.15.100:0/2786540492 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.914+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 0x7fbdf815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.916+0000 7fbdfca00640 1 -- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 msgr2=0x7fbdf821af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.916+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbdf821af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.916+0000 7fbdfca00640 1 -- 172.21.15.100:0/2786540492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf815b4c0 msgr2=0x7fbdf8218440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.916+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf815b4c0 0x7fbdf8218440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.916+0000 7fbdfca00640 1 -- 172.21.15.100:0/2786540492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf81764a0 con 0x7fbdf8177260 2024-02-21T07:51:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.917+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 0x7fbdf815af80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbde4001200 tx=0x7fbde4010420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:38.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.923+0000 7fbdf5600640 1 -- 172.21.15.100:0/2786540492 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4013070 con 0x7fbdf8177260 2024-02-21T07:51:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.923+0000 7fbdf5600640 1 -- 172.21.15.100:0/2786540492 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400ee40 con 0x7fbdf8177260 2024-02-21T07:51:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.923+0000 7fbdf5600640 1 -- 172.21.15.100:0/2786540492 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4010d40 con 0x7fbdf8177260 2024-02-21T07:51:38.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.926+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf8176780 con 0x7fbdf8177260 2024-02-21T07:51:38.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.926+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8218980 con 0x7fbdf8177260 2024-02-21T07:51:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.933+0000 7fbdf5600640 1 -- 172.21.15.100:0/2786540492 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbde40050d0 con 0x7fbdf8177260 2024-02-21T07:51:38.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.935+0000 7fbdf5600640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 0x7fbdd80a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.936+0000 7fbdf5600640 1 -- 172.21.15.100:0/2786540492 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbde40cd990 con 0x7fbdf8177260 2024-02-21T07:51:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.939+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 0x7fbdd80a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.942+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 0x7fbdd80a16b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0124a0 tx=0x7fbdec030070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:38.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.959+0000 7fbe02a54740 1 Processor -- start 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.962+0000 7fbe02a54740 1 -- start start 2024-02-21T07:51:38.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee4076d0 0x5628ee407ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee442860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee332210 con 0x5628ee442da0 2024-02-21T07:51:38.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee32f740 con 0x5628ee407ff0 2024-02-21T07:51:38.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.966+0000 7fbe02a54740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee32af20 con 0x5628ee4076d0 2024-02-21T07:51:38.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.969+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee4076d0 0x5628ee407ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.969+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:38.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.969+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41694/0 (socket says 172.21.15.100:41694) 2024-02-21T07:51:38.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.969+0000 7fbdfde00640 1 -- 172.21.15.100:0/2311016693 learned_addr learned my addr 172.21.15.100:0/2311016693 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:38.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 -- 172.21.15.100:0/2311016693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee4076d0 msgr2=0x5628ee407ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:38.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee4076d0 0x5628ee407ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 -- 172.21.15.100:0/2311016693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 msgr2=0x5628ee442860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:38.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee442860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 -- 172.21.15.100:0/2311016693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ee2ecdf0 con 0x5628ee442da0 2024-02-21T07:51:38.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.970+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf808de90 tx=0x7fbdf00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81683825bcdd386 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:38.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.972+0000 7fbde9c00640 1 -- 172.21.15.100:0/2311016693 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0003990 con 0x5628ee442da0 2024-02-21T07:51:38.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.972+0000 7fbde9c00640 1 -- 172.21.15.100:0/2311016693 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000f040 con 0x5628ee442da0 2024-02-21T07:51:38.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.972+0000 7fbde9c00640 1 -- 172.21.15.100:0/2311016693 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0003d70 con 0x5628ee442da0 2024-02-21T07:51:38.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.973+0000 7fbe02a54740 1 -- 172.21.15.100:0/2311016693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 msgr2=0x5628ee443b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:38.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.973+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbdf808de90 tx=0x7fbdf00075c0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.989+0000 7fbe02a54740 1 -- 172.21.15.100:0/2311016693 shutdown_connections 2024-02-21T07:51:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.989+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee442da0 0x5628ee443b30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.989+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee442860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.989+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2311016693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee4076d0 0x5628ee407ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.989+0000 7fbe02a54740 1 -- 172.21.15.100:0/2311016693 >> 172.21.15.100:0/2311016693 conn(0x5628ee3c9ca0 msgr2=0x5628ee3cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:38.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.990+0000 7fbe02a54740 1 -- 172.21.15.100:0/2311016693 shutdown_connections 2024-02-21T07:51:38.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.991+0000 7fbe02a54740 1 -- 172.21.15.100:0/2311016693 wait complete. 2024-02-21T07:51:38.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.992+0000 7fbe02a54740 1 -- start start 2024-02-21T07:51:38.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:38.993+0000 7fbe02a54740 1 Processor -- start 2024-02-21T07:51:39.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.003+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.006+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 0x5628ee3fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.006+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.006+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41710/0 (socket says 172.21.15.100:41710) 2024-02-21T07:51:39.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.006+0000 7fbdfd400640 1 -- 172.21.15.100:0/3008956480 learned_addr learned my addr 172.21.15.100:0/3008956480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.007+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 0x5628ee3bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.007+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee2d0150 con 0x5628ee407ff0 2024-02-21T07:51:39.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.007+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee2cfdf0 con 0x5628ee442da0 2024-02-21T07:51:39.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.007+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee0991c0 con 0x5628ee3fc2e0 2024-02-21T07:51:39.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.009+0000 7fbdfde00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 0x5628ee3bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.009+0000 7fbdfca00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 0x5628ee3fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbe02a54740 10 client.0 _ll_register_callbacks cb 0x5628ee31f2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfd400640 1 -- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 msgr2=0x5628ee3bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfd400640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 0x5628ee3bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfd400640 1 -- 172.21.15.100:0/3008956480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 msgr2=0x5628ee3fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfd400640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 0x5628ee3fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfd400640 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0009a60 con 0x5628ee407ff0 2024-02-21T07:51:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfde00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 0x5628ee3bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbdfca00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 0x5628ee3fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.010+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ee02a7e0 con 0x5628ee407ff0 2024-02-21T07:51:39.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.014+0000 7fbdde000640 10 client.6090 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.014+0000 7fbdfd400640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdec02e2d0 tx=0x7fbde4001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79625d596c358d20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.015+0000 7fbdde000640 1 -- 172.21.15.100:0/3008956480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec047050 con 0x5628ee407ff0 2024-02-21T07:51:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.016+0000 7fbdde000640 1 -- 172.21.15.100:0/3008956480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbdec0096e0 con 0x5628ee407ff0 2024-02-21T07:51:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.016+0000 7fbdde000640 1 -- 172.21.15.100:0/3008956480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdec02e660 con 0x5628ee407ff0 2024-02-21T07:51:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.016+0000 7fbe02a54740 10 client.6090 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.020+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x5628ee3295a0 con 0x5628ee407ff0 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.025+0000 7fbdde000640 1 -- 172.21.15.100:0/3008956480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbdec02e7c0 con 0x5628ee407ff0 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.025+0000 7fbe02a54740 10 client.6090 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.025+0000 7fbe02a54740 10 client.6090 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.025+0000 7fbe02a54740 20 client.6090 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.025+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee3fb180 0x5628ee3f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.026+0000 7fbdfca00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee3fb180 0x5628ee3f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.027+0000 7fbe02a54740 4 client.6090 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.027+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628ee067720 con 0x5628ee3fb180 2024-02-21T07:51:39.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.027+0000 7fbdfca00640 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee3fb180 0x5628ee3f2430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55a8c3471eb725fc server_cookie=3ee72b427a1555 in_seq=0 out_seq=0 2024-02-21T07:51:39.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.027+0000 7fbdde000640 10 client.6090 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:39.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.028+0000 7fbdde000640 1 -- 172.21.15.100:0/3008956480 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628ee067720 con 0x5628ee3fb180 2024-02-21T07:51:39.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.028+0000 7fbdde000640 10 client.6090 handle_command_reply: tid=0 2024-02-21T07:51:39.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.029+0000 7fbe02a54740 1 client.6090 shutdown 2024-02-21T07:51:39.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.029+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 msgr2=0x5628ee3fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.029+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdec02e2d0 tx=0x7fbde4001950 comp rx=0 tx=0).stop 2024-02-21T07:51:39.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.031+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 shutdown_connections 2024-02-21T07:51:39.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.031+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee3fb180 0x5628ee3f2430 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.032+0000 7fbdde000640 0 client.6090 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.032+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fc2e0 0x5628ee3bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.032+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee442da0 0x5628ee3fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.032+0000 7fbe02a54740 1 --2- 172.21.15.100:0/3008956480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3fc710 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.032+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 >> 172.21.15.100:0/3008956480 conn(0x5628ee4076d0 msgr2=0x5628ee3cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.033+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 shutdown_connections 2024-02-21T07:51:39.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.033+0000 7fbe02a54740 1 -- 172.21.15.100:0/3008956480 wait complete. 2024-02-21T07:51:39.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.034+0000 7fbe02a54740 20 client.6090 trim_cache size 0 max 16384 2024-02-21T07:51:39.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.072+0000 7fbe02a54740 1 Processor -- start 2024-02-21T07:51:39.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.072+0000 7fbe02a54740 1 -- start start 2024-02-21T07:51:39.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 0x5628ee440c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee442a00 con 0x5628ee407ff0 2024-02-21T07:51:39.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee3fa750 con 0x5628ee3fc2e0 2024-02-21T07:51:39.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.074+0000 7fbe02a54740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee401c00 con 0x5628ee3fb180 2024-02-21T07:51:39.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.077+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.077+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41720/0 (socket says 172.21.15.100:41720) 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.077+0000 7fbdfde00640 1 -- 172.21.15.100:0/541156860 learned_addr learned my addr 172.21.15.100:0/541156860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.077+0000 7fbdfd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.077+0000 7fbdfca00640 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 0x5628ee440c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfca00640 1 -- 172.21.15.100:0/541156860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 msgr2=0x5628ee3cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfca00640 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfca00640 1 -- 172.21.15.100:0/541156860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 msgr2=0x5628ee3cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfca00640 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfca00640 1 -- 172.21.15.100:0/541156860 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ee2c5ab0 con 0x5628ee3fc2e0 2024-02-21T07:51:39.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.078+0000 7fbdfde00640 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:39.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.080+0000 7fbdfca00640 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 0x5628ee440c50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbde40cb300 tx=0x7fbde40cb200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4899e61fbe3fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.080+0000 7fbde9200640 1 -- 172.21.15.100:0/541156860 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4018e10 con 0x5628ee3fc2e0 2024-02-21T07:51:39.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.080+0000 7fbde9200640 1 -- 172.21.15.100:0/541156860 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde409b470 con 0x5628ee3fc2e0 2024-02-21T07:51:39.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.080+0000 7fbde9200640 1 -- 172.21.15.100:0/541156860 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde409f5c0 con 0x5628ee3fc2e0 2024-02-21T07:51:39.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.081+0000 7fbe02a54740 1 -- 172.21.15.100:0/541156860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 msgr2=0x5628ee440c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.081+0000 7fbe02a54740 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 0x5628ee440c50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbde40cb300 tx=0x7fbde40cb200 comp rx=0 tx=0).stop 2024-02-21T07:51:39.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 -- 172.21.15.100:0/541156860 shutdown_connections 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee407ff0 0x5628ee3cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee3fc2e0 0x5628ee440c50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 --2- 172.21.15.100:0/541156860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 -- 172.21.15.100:0/541156860 >> 172.21.15.100:0/541156860 conn(0x5628ee4076d0 msgr2=0x5628ee3f9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.082+0000 7fbe02a54740 1 -- 172.21.15.100:0/541156860 shutdown_connections 2024-02-21T07:51:39.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.084+0000 7fbe02a54740 1 -- 172.21.15.100:0/541156860 wait complete. 2024-02-21T07:51:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.085+0000 7fbe02a54740 1 -- start start 2024-02-21T07:51:39.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.085+0000 7fbe02a54740 1 Processor -- start 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 0x5628ee3cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee3c75b0 con 0x5628ee3fc2e0 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee3cb220 con 0x5628ee407ff0 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ee4a6850 con 0x5628ee3fb180 2024-02-21T07:51:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.094+0000 7fbe02a54740 10 client.0 _ll_register_callbacks cb 0x7fbdf00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.098+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.098+0000 7fbdfde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55526/0 (socket says 172.21.15.100:55526) 2024-02-21T07:51:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.098+0000 7fbdfde00640 1 -- 172.21.15.100:0/2200570639 learned_addr learned my addr 172.21.15.100:0/2200570639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.100+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 0x5628ee3cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.101+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.102+0000 7fbdfde00640 1 -- 172.21.15.100:0/2200570639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 msgr2=0x5628ee3fac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.102+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3fac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.102+0000 7fbdfde00640 1 -- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 msgr2=0x5628ee3cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.107+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 0x5628ee3cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.107+0000 7fbdfde00640 1 -- 172.21.15.100:0/2200570639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8218980 con 0x5628ee407ff0 2024-02-21T07:51:39.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.110+0000 7fbdfca00640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 0x5628ee3cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:39.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.113+0000 7fbdfde00640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0013a50 tx=0x7fbdf0009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a683a96f81d97fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.113+0000 7fbdde000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:39.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.114+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0007e70 con 0x5628ee407ff0 2024-02-21T07:51:39.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.114+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbdf0003990 con 0x5628ee407ff0 2024-02-21T07:51:39.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.118+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ee4422c0 con 0x5628ee407ff0 2024-02-21T07:51:39.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.119+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdf0003b50 con 0x5628ee407ff0 2024-02-21T07:51:39.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.119+0000 7fbe02a54740 10 client.6277 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:39.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.119+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5628ee2eb650 con 0x5628ee407ff0 2024-02-21T07:51:39.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.120+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf002d020 con 0x5628ee407ff0 2024-02-21T07:51:39.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.120+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbdf0026060 con 0x5628ee407ff0 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 10 client.6277 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 10 client.6277 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 20 client.6277 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee442da0 0x5628ee3fb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 4 client.6277 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fbdf000f040 con 0x5628ee442da0 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.121+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee442da0 0x5628ee3fb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.122+0000 7fbdde000640 10 client.6277 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:39.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.122+0000 7fbdfd400640 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee442da0 0x5628ee3fb940 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33154c60aa3e2d17 server_cookie=c8eb357cf05fcbb7 in_seq=0 out_seq=0 2024-02-21T07:51:39.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.122+0000 7fbdde000640 1 -- 172.21.15.100:0/2200570639 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fbdf000f040 con 0x5628ee442da0 2024-02-21T07:51:39.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.123+0000 7fbdde000640 10 client.6277 handle_command_reply: tid=0 2024-02-21T07:51:39.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.123+0000 7fbe02a54740 1 client.6277 shutdown 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 msgr2=0x5628ee4379b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0013a50 tx=0x7fbdf0009450 comp rx=0 tx=0).stop 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 shutdown_connections 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5628ee442da0 0x5628ee3fb940 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5628ee407ff0 0x5628ee4379b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628ee3fc2e0 0x5628ee3cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 --2- 172.21.15.100:0/2200570639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5628ee3fb180 0x5628ee3fac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 >> 172.21.15.100:0/2200570639 conn(0x5628ee4076d0 msgr2=0x5628ee45ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbdde000640 0 client.6277 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 shutdown_connections 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.124+0000 7fbe02a54740 1 -- 172.21.15.100:0/2200570639 wait complete. 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.125+0000 7fbe02a54740 20 client.6277 trim_cache size 0 max 16384 2024-02-21T07:51:39.130 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.126+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 msgr2=0x7fbdd80a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.126+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 0x7fbdd80a16b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0124a0 tx=0x7fbdec030070 comp rx=0 tx=0).stop 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.126+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 msgr2=0x7fbdf815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.126+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 0x7fbdf815af80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbde4001200 tx=0x7fbde4010420 comp rx=0 tx=0).stop 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 shutdown_connections 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbdd809f1f0 0x7fbdd80a16b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbdf815b4c0 0x7fbdf8218440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbdf8177260 0x7fbdf815af80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 --2- 172.21.15.100:0/2786540492 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbde00039c0 0x7fbdf821af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 >> 172.21.15.100:0/2786540492 conn(0x7fbdf80668b0 msgr2=0x7fbdf8179660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 shutdown_connections 2024-02-21T07:51:39.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.127+0000 7fbdffe00640 1 -- 172.21.15.100:0/2786540492 wait complete. 2024-02-21T07:51:39.170 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:39.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:51:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.595+0000 7f9e07a00640 1 Processor -- start 2024-02-21T07:51:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.596+0000 7f9e07a00640 1 -- start start 2024-02-21T07:51:39.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e07a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9e0008e630 0x7f9e0017e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e07a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9e00070670 0x7f9e00185df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e07a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000f4760 con 0x7f9e00070b20 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e07a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0018b260 con 0x7f9e00070670 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e07a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e00186a40 con 0x7f9e0008e630 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9dffe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9e00070670 0x7f9e00185df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9dffe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9e00070670 0x7f9e00185df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55530/0 (socket says 172.21.15.100:55530) 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9dffe00640 1 -- 172.21.15.100:0/122829035 learned_addr learned my addr 172.21.15.100:0/122829035 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.600+0000 7f9e05000640 1 --2- 172.21.15.100:0/122829035 >> v2:172.21.15.170:3300/0 conn(0x7f9e0008e630 0x7f9e0017e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.601+0000 7f9dffe00640 1 -- 172.21.15.100:0/122829035 >> v2:172.21.15.170:3300/0 conn(0x7f9e0008e630 msgr2=0x7f9e0017e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.601+0000 7f9dffe00640 1 --2- 172.21.15.100:0/122829035 >> v2:172.21.15.170:3300/0 conn(0x7f9e0008e630 0x7f9e0017e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.601+0000 7f9dffe00640 1 -- 172.21.15.100:0/122829035 >> v1:172.21.15.156:6789/0 conn(0x7f9e00070b20 legacy=0x7f9e00186330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.601+0000 7f9dffe00640 1 -- 172.21.15.100:0/122829035 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000f4c90 con 0x7f9e00070670 2024-02-21T07:51:39.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.603+0000 7f9dffe00640 1 --2- 172.21.15.100:0/122829035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e00185df0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e00074b10 tx=0x7f9df002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40cd6182d445404a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.603+0000 7f9dff400640 1 -- 172.21.15.100:0/122829035 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00317e0 con 0x7f9e00070670 2024-02-21T07:51:39.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.604+0000 7f9dff400640 1 -- 172.21.15.100:0/122829035 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0031940 con 0x7f9e00070670 2024-02-21T07:51:39.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.604+0000 7f9dff400640 1 -- 172.21.15.100:0/122829035 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00317e0 con 0x7f9e00070670 2024-02-21T07:51:39.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.604+0000 7f9e07a00640 1 -- 172.21.15.100:0/122829035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 msgr2=0x7f9e00185df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.604+0000 7f9e07a00640 1 --2- 172.21.15.100:0/122829035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e00185df0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e00074b10 tx=0x7f9df002b880 comp rx=0 tx=0).stop 2024-02-21T07:51:39.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.605+0000 7f9e07a00640 1 -- 172.21.15.100:0/122829035 shutdown_connections 2024-02-21T07:51:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.605+0000 7f9e07a00640 1 --2- 172.21.15.100:0/122829035 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e00185df0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.605+0000 7f9e07a00640 1 --2- 172.21.15.100:0/122829035 >> v2:172.21.15.170:3300/0 conn(0x7f9e0008e630 0x7f9e0017e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.605+0000 7f9e07a00640 1 -- 172.21.15.100:0/122829035 >> 172.21.15.100:0/122829035 conn(0x7f9e000668b0 msgr2=0x7f9e00066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.606+0000 7f9e07a00640 1 -- 172.21.15.100:0/122829035 shutdown_connections 2024-02-21T07:51:39.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.608+0000 7f9e07a00640 1 -- 172.21.15.100:0/122829035 wait complete. 2024-02-21T07:51:39.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.611+0000 7f9e07a00640 1 Processor -- start 2024-02-21T07:51:39.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.612+0000 7f9e07a00640 1 -- start start 2024-02-21T07:51:39.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.615+0000 7f9e07a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e002285d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.615+0000 7f9e07a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e00070b20 0x7f9e000f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.615+0000 7f9e07a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e07a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0022c4b0 con 0x7f9e00070b20 2024-02-21T07:51:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e07a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0022d5f0 con 0x7f9e00070670 2024-02-21T07:51:39.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e07a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0022c700 con 0x7f9e0008e630 2024-02-21T07:51:39.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41316/0 (socket says 172.21.15.100:41316) 2024-02-21T07:51:39.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9e05a00640 1 -- 172.21.15.100:0/3704363257 learned_addr learned my addr 172.21.15.100:0/3704363257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.616+0000 7f9dffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e00070b20 0x7f9e000f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.617+0000 7f9e05a00640 1 -- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 msgr2=0x7f9e002285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.617+0000 7f9e05a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e002285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.617+0000 7f9e05a00640 1 -- 172.21.15.100:0/3704363257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e00070b20 msgr2=0x7f9e000f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.617+0000 7f9e05a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e00070b20 0x7f9e000f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.617+0000 7f9e05a00640 1 -- 172.21.15.100:0/3704363257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00094d0 con 0x7f9e0008e630 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9e05a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b440 tx=0x7f9dec00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9dfcc00640 1 -- 172.21.15.100:0/3704363257 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011830 con 0x7f9e0008e630 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0022c9e0 con 0x7f9e0008e630 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9dfcc00640 1 -- 172.21.15.100:0/3704363257 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec011990 con 0x7f9e0008e630 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9dfcc00640 1 -- 172.21.15.100:0/3704363257 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec011830 con 0x7f9e0008e630 2024-02-21T07:51:39.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.618+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0022cfa0 con 0x7f9e0008e630 2024-02-21T07:51:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.626+0000 7f9dfcc00640 1 -- 172.21.15.100:0/3704363257 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f9dec011b00 con 0x7f9e0008e630 2024-02-21T07:51:39.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.630+0000 7f9dfcc00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 0x7f9de00a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.630+0000 7f9dfcc00640 1 -- 172.21.15.100:0/3704363257 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9dec0c97f0 con 0x7f9e0008e630 2024-02-21T07:51:39.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.631+0000 7f9e05000640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 0x7f9de00a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.632+0000 7f9e05000640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 0x7f9de00a1670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e190 tx=0x7f9df800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.635+0000 7f9e0a797740 1 Processor -- start 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.638+0000 7f9e0a797740 1 -- start start 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.640+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d4850ec0 0x55d7d48512a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.640+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d488c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.640+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e0a797740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4784210 con 0x55d7d4850ec0 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e0a797740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4781740 con 0x55d7d48517e0 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e0a797740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d477cf20 con 0x55d7d488c590 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e05a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41318/0 (socket says 172.21.15.100:41318) 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.642+0000 7f9e05a00640 1 -- 172.21.15.100:0/1897553857 learned_addr learned my addr 172.21.15.100:0/1897553857 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 -- 172.21.15.100:0/1897553857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 msgr2=0x55d7d488c050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d488c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 -- 172.21.15.100:0/1897553857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d4850ec0 msgr2=0x55d7d48512a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d4850ec0 0x55d7d48512a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 -- 172.21.15.100:0/1897553857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7d473edf0 con 0x55d7d488c590 2024-02-21T07:51:39.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.645+0000 7f9e05a00640 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009280 tx=0x7f9dec0092b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12c50dde434c3b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.646+0000 7f9df5600640 1 -- 172.21.15.100:0/1897553857 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec09fa70 con 0x55d7d488c590 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.646+0000 7f9df5600640 1 -- 172.21.15.100:0/1897553857 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec09b170 con 0x55d7d488c590 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.646+0000 7f9df5600640 1 -- 172.21.15.100:0/1897553857 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec0c72a0 con 0x55d7d488c590 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.649+0000 7f9e0a797740 1 -- 172.21.15.100:0/1897553857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 msgr2=0x55d7d488d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.649+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009280 tx=0x7f9dec0092b0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.652+0000 7f9e0a797740 1 -- 172.21.15.100:0/1897553857 shutdown_connections 2024-02-21T07:51:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.652+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d488d320 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.652+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d488c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.652+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1897553857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d4850ec0 0x55d7d48512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.652+0000 7f9e0a797740 1 -- 172.21.15.100:0/1897553857 >> 172.21.15.100:0/1897553857 conn(0x55d7d4813490 msgr2=0x55d7d4814510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.653+0000 7f9e0a797740 1 -- 172.21.15.100:0/1897553857 shutdown_connections 2024-02-21T07:51:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.655+0000 7f9e0a797740 1 -- 172.21.15.100:0/1897553857 wait complete. 2024-02-21T07:51:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.671+0000 7f9e0a797740 1 -- start start 2024-02-21T07:51:39.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.672+0000 7f9e0a797740 1 Processor -- start 2024-02-21T07:51:39.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.681+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.681+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d48937d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e05000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e05000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55544/0 (socket says 172.21.15.100:55544) 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e05000640 1 -- 172.21.15.100:0/4272853296 learned_addr learned my addr 172.21.15.100:0/4272853296 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4722150 con 0x55d7d488c590 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4721df0 con 0x55d7d48517e0 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d44eb1c0 con 0x55d7d483bcc0 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e0a797740 10 client.0 _ll_register_callbacks cb 0x55d7d47712b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.682+0000 7f9dffe00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d48937d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05a00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05000640 1 -- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 msgr2=0x55d7d4847090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05000640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05000640 1 -- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 msgr2=0x55d7d48937d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05000640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d48937d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05000640 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0022cfa0 con 0x55d7d48517e0 2024-02-21T07:51:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9dffe00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d48937d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.683+0000 7f9e05a00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.684+0000 7f9e05000640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015b80 tx=0x7f9df8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd70585a7fd982f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.685+0000 7f9dea000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.685+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8013c40 con 0x55d7d48517e0 2024-02-21T07:51:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.685+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7d447c7e0 con 0x55d7d48517e0 2024-02-21T07:51:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.685+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9df8013da0 con 0x55d7d48517e0 2024-02-21T07:51:39.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.686+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df80283f0 con 0x55d7d48517e0 2024-02-21T07:51:39.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.687+0000 7f9e0a797740 10 client.6283 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:39.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.687+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d7d477b5a0 con 0x55d7d48517e0 2024-02-21T07:51:39.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.687+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7d447c7e0 con 0x55d7d48517e0 2024-02-21T07:51:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.688+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9df8028550 con 0x55d7d48517e0 2024-02-21T07:51:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 10 client.6283 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 10 client.6283 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 20 client.6283 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d480f1d0 0x55d7d4898c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 4 client.6283 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7d44b9720 con 0x55d7d480f1d0 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.689+0000 7f9dffe00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d480f1d0 0x55d7d4898c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.690+0000 7f9dffe00640 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d480f1d0 0x55d7d4898c20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aeb8dbf69a01792a server_cookie=c9e99ae267cc0c93 in_seq=0 out_seq=0 2024-02-21T07:51:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.690+0000 7f9dea000640 10 client.6283 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.691+0000 7f9dea000640 1 -- 172.21.15.100:0/4272853296 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d7d44b9720 con 0x55d7d480f1d0 2024-02-21T07:51:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.691+0000 7f9dea000640 10 client.6283 handle_command_reply: tid=0 2024-02-21T07:51:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.691+0000 7f9e0a797740 1 client.6283 shutdown 2024-02-21T07:51:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 msgr2=0x55d7d4846a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015b80 tx=0x7f9df8004a40 comp rx=0 tx=0).stop 2024-02-21T07:51:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 shutdown_connections 2024-02-21T07:51:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d48937d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d480f1d0 0x55d7d4898c20 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 --2- 172.21.15.100:0/4272853296 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d48517e0 0x55d7d4846a50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 >> 172.21.15.100:0/4272853296 conn(0x55d7d4850ec0 msgr2=0x55d7d4814f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.692+0000 7f9dea000640 0 client.6283 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.693+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 shutdown_connections 2024-02-21T07:51:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.693+0000 7f9e0a797740 1 -- 172.21.15.100:0/4272853296 wait complete. 2024-02-21T07:51:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.693+0000 7f9e0a797740 20 client.6283 trim_cache size 0 max 16384 2024-02-21T07:51:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.712+0000 7f9e0a797740 1 Processor -- start 2024-02-21T07:51:39.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.713+0000 7f9e0a797740 1 -- start start 2024-02-21T07:51:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d48e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4855380 con 0x55d7d48517e0 2024-02-21T07:51:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d4855660 con 0x55d7d483bcc0 2024-02-21T07:51:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.714+0000 7f9e0a797740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d48475d0 con 0x55d7d488c590 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.715+0000 7f9dffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.715+0000 7f9dffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41752/0 (socket says 172.21.15.100:41752) 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.715+0000 7f9dffe00640 1 -- 172.21.15.100:0/2371962558 learned_addr learned my addr 172.21.15.100:0/2371962558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.715+0000 7f9e05000640 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 -- 172.21.15.100:0/2371962558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 msgr2=0x55d7d48e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d48e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 -- 172.21.15.100:0/2371962558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 msgr2=0x55d7d4847090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 -- 172.21.15.100:0/2371962558 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7d4717ab0 con 0x55d7d48517e0 2024-02-21T07:51:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.716+0000 7f9dffe00640 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9df0031910 tx=0x7f9df0030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdff81c52b6bd46 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.717+0000 7f9df4c00640 1 -- 172.21.15.100:0/2371962558 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0031cb0 con 0x55d7d48517e0 2024-02-21T07:51:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.717+0000 7f9df4c00640 1 -- 172.21.15.100:0/2371962558 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7d44b9720 con 0x55d7d48517e0 2024-02-21T07:51:39.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.717+0000 7f9df4c00640 1 -- 172.21.15.100:0/2371962558 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0004040 con 0x55d7d48517e0 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 -- 172.21.15.100:0/2371962558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 msgr2=0x55d7d4814f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9df0031910 tx=0x7f9df0030000 comp rx=0 tx=0).stop 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 -- 172.21.15.100:0/2371962558 shutdown_connections 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d488c590 0x55d7d48e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d48517e0 0x55d7d4814f00 secure :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9df0031910 tx=0x7f9df0030000 comp rx=0 tx=0).stop 2024-02-21T07:51:39.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 --2- 172.21.15.100:0/2371962558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d4847090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 -- 172.21.15.100:0/2371962558 >> 172.21.15.100:0/2371962558 conn(0x55d7d4850ec0 msgr2=0x55d7d488be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 -- 172.21.15.100:0/2371962558 shutdown_connections 2024-02-21T07:51:39.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.718+0000 7f9e0a797740 1 -- 172.21.15.100:0/2371962558 wait complete. 2024-02-21T07:51:39.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.720+0000 7f9e0a797740 1 -- start start 2024-02-21T07:51:39.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.721+0000 7f9e0a797740 1 Processor -- start 2024-02-21T07:51:39.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.723+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.723+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d481b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e0a797740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 0x55d7d481bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e05000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e05000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55556/0 (socket says 172.21.15.100:55556) 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e0a797740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d481c080 con 0x55d7d488c590 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e0a797740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d48f4ba0 con 0x55d7d483bcc0 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e0a797740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7d481c1f0 con 0x55d7d4819cc0 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e0a797740 10 client.0 _ll_register_callbacks cb 0x7f9dec0970a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:39.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.724+0000 7f9e05000640 1 -- 172.21.15.100:0/1251785269 learned_addr learned my addr 172.21.15.100:0/1251785269 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05a00640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 0x55d7d481bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9dffe00640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d481b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05000640 1 -- 172.21.15.100:0/1251785269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 msgr2=0x55d7d481bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05000640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 0x55d7d481bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05000640 1 -- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 msgr2=0x55d7d481b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05000640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d481b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05000640 1 -- 172.21.15.100:0/1251785269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000f4c90 con 0x55d7d483bcc0 2024-02-21T07:51:39.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.725+0000 7f9e05a00640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 0x55d7d481bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.727+0000 7f9e05000640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015a90 tx=0x7f9df801d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=387be77dbb4721a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:39.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.727+0000 7f9dea000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:39.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.729+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8013a40 con 0x55d7d483bcc0 2024-02-21T07:51:39.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.729+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9df8036070 con 0x55d7d483bcc0 2024-02-21T07:51:39.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.729+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9dec09b170 con 0x55d7d483bcc0 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.730+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df8013ba0 con 0x55d7d483bcc0 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.731+0000 7f9e0a797740 10 client.6289 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.731+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d7d473d650 con 0x55d7d483bcc0 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.732+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec09b170 con 0x55d7d483bcc0 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.732+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9df8013d00 con 0x55d7d483bcc0 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.732+0000 7f9e0a797740 10 client.6289 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.732+0000 7f9e0a797740 10 client.6289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.732+0000 7f9e0a797740 20 client.6289 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.733+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d488b960 0x55d7d48e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.733+0000 7f9e0a797740 4 client.6289 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.733+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d7d4508890 con 0x55d7d488b960 2024-02-21T07:51:39.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.733+0000 7f9dffe00640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d488b960 0x55d7d48e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:39.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.734+0000 7f9dffe00640 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d488b960 0x55d7d48e0e80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd67f4fc326d7a16 server_cookie=7f25490a55294733 in_seq=0 out_seq=0 2024-02-21T07:51:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.734+0000 7f9dea000640 10 client.6289 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.735+0000 7f9dea000640 1 -- 172.21.15.100:0/1251785269 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d7d4508890 con 0x55d7d488b960 2024-02-21T07:51:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.735+0000 7f9dea000640 10 client.6289 handle_command_reply: tid=0 2024-02-21T07:51:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.735+0000 7f9e0a797740 1 client.6289 shutdown 2024-02-21T07:51:39.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 msgr2=0x55d7d48de610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9df8015a90 tx=0x7f9df801d000 comp rx=0 tx=0).stop 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 shutdown_connections 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d7d4819cc0 0x55d7d481bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d7d488c590 0x55d7d481b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d7d488b960 0x55d7d48e0e80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 --2- 172.21.15.100:0/1251785269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d7d483bcc0 0x55d7d48de610 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 >> 172.21.15.100:0/1251785269 conn(0x55d7d4850ec0 msgr2=0x55d7d4814f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9dea000640 0 client.6289 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:51:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.736+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 shutdown_connections 2024-02-21T07:51:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.737+0000 7f9e0a797740 1 -- 172.21.15.100:0/1251785269 wait complete. 2024-02-21T07:51:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.737+0000 7f9e0a797740 20 client.6289 trim_cache size 0 max 16384 2024-02-21T07:51:39.743 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 msgr2=0x7f9de00a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 0x7f9de00a1670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9df800e190 tx=0x7f9df800b040 comp rx=0 tx=0).stop 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 msgr2=0x7f9e0022da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9dec00b440 tx=0x7f9dec00b900 comp rx=0 tx=0).stop 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 shutdown_connections 2024-02-21T07:51:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e0008e630 0x7f9e0022da80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9de009f1b0 0x7f9de00a1670 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e00070b20 0x7f9e000f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 --2- 172.21.15.100:0/3704363257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e00070670 0x7f9e002285d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 >> 172.21.15.100:0/3704363257 conn(0x7f9e000668b0 msgr2=0x7f9e00067090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 shutdown_connections 2024-02-21T07:51:39.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:39.738+0000 7f9e07a00640 1 -- 172.21.15.100:0/3704363257 wait complete. 2024-02-21T07:51:39.764 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:51:39.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:51:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.136+0000 7f5cde600640 1 Processor -- start 2024-02-21T07:51:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.136+0000 7f5cde600640 1 -- start start 2024-02-21T07:51:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.143+0000 7f5cde600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 0x7f5cd808cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.143+0000 7f5cde600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5cd808d140 0x7f5cd8161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.143+0000 7f5cde600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd806b330 con 0x7f5cd815daa0 2024-02-21T07:51:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cd7400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5cd815daa0 0x7f5cd806ab60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:45528/0 (socket says 172.21.15.100:45528) 2024-02-21T07:51:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cde600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd806c6b0 con 0x7f5cd808c7e0 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cde600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd806b610 con 0x7f5cd808d140 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cd7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5cd808d140 0x7f5cd8161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cd7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5cd808d140 0x7f5cd8161a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45334/0 (socket says 172.21.15.100:45334) 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cd7e00640 1 -- 172.21.15.100:0/373676437 learned_addr learned my addr 172.21.15.100:0/373676437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.145+0000 7f5cd6a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 0x7f5cd808cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.146+0000 7f5cd7e00640 1 -- 172.21.15.100:0/373676437 >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 msgr2=0x7f5cd808cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.147+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/373676437 >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 0x7f5cd808cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.148+0000 7f5cd7e00640 1 -- 172.21.15.100:0/373676437 >> v1:172.21.15.170:6789/0 conn(0x7f5cd815daa0 legacy=0x7f5cd806ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.148+0000 7f5cd7e00640 1 -- 172.21.15.100:0/373676437 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd806b8f0 con 0x7f5cd808d140 2024-02-21T07:51:40.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.148+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/373676437 >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 0x7f5cd808cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:40.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.169+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/373676437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd808d140 0x7f5cd8161a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80fbca0 tx=0x7f5cd002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e096deb41fb121a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.170+0000 7f5cd6000640 1 -- 172.21.15.100:0/373676437 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd002ca80 con 0x7f5cd808d140 2024-02-21T07:51:40.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.171+0000 7f5cd6000640 1 -- 172.21.15.100:0/373676437 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd002cbe0 con 0x7f5cd808d140 2024-02-21T07:51:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.173+0000 7f5cde600640 1 -- 172.21.15.100:0/373676437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd808d140 msgr2=0x7f5cd8161a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.173+0000 7f5cde600640 1 --2- 172.21.15.100:0/373676437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd808d140 0x7f5cd8161a40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80fbca0 tx=0x7f5cd002bee0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.177+0000 7f5cd6000640 1 -- 172.21.15.100:0/373676437 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00343f0 con 0x7f5cd808d140 2024-02-21T07:51:40.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.178+0000 7f5cde600640 1 -- 172.21.15.100:0/373676437 shutdown_connections 2024-02-21T07:51:40.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.178+0000 7f5cde600640 1 --2- 172.21.15.100:0/373676437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd808d140 0x7f5cd8161a40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.179+0000 7f5cde600640 1 --2- 172.21.15.100:0/373676437 >> v2:172.21.15.156:3300/0 conn(0x7f5cd808c7e0 0x7f5cd808cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.179+0000 7f5cde600640 1 -- 172.21.15.100:0/373676437 >> 172.21.15.100:0/373676437 conn(0x7f5cd80fe210 msgr2=0x7f5cd80fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.183+0000 7f5cde600640 1 -- 172.21.15.100:0/373676437 shutdown_connections 2024-02-21T07:51:40.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.183+0000 7f5cde600640 1 -- 172.21.15.100:0/373676437 wait complete. 2024-02-21T07:51:40.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.193+0000 7f5cde600640 1 Processor -- start 2024-02-21T07:51:40.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.193+0000 7f5cde600640 1 -- start start 2024-02-21T07:51:40.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.199+0000 7f5cde600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 0x7f5cd8182f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.200+0000 7f5cde600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5cd815daa0 0x7f5cd815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.202+0000 7f5cde600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.202+0000 7f5cde600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8183470 con 0x7f5cd808c7e0 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.202+0000 7f5cde600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8183740 con 0x7f5cd815daa0 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.202+0000 7f5cde600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8183a20 con 0x7f5cd8153a90 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.203+0000 7f5cd7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 0x7f5cd8182f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.203+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.203+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45344/0 (socket says 172.21.15.100:45344) 2024-02-21T07:51:40.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.203+0000 7f5cd7e00640 1 -- 172.21.15.100:0/1665650886 learned_addr learned my addr 172.21.15.100:0/1665650886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.203+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5cd815daa0 0x7f5cd815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.204+0000 7f5cd7e00640 1 -- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5cd815daa0 msgr2=0x7f5cd815cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.204+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5cd815daa0 0x7f5cd815cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.204+0000 7f5cd7e00640 1 -- 172.21.15.100:0/1665650886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 msgr2=0x7f5cd8182f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.205+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 0x7f5cd8182f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.205+0000 7f5cd7e00640 1 -- 172.21.15.100:0/1665650886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009400 con 0x7f5cd8153a90 2024-02-21T07:51:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.205+0000 7f5cd7400640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 0x7f5cd8182f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:40.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.205+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0036040 tx=0x7f5cd0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.210+0000 7f5ccf400640 1 -- 172.21.15.100:0/1665650886 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0009510 con 0x7f5cd8153a90 2024-02-21T07:51:40.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.210+0000 7f5ccf400640 1 -- 172.21.15.100:0/1665650886 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd003e450 con 0x7f5cd8153a90 2024-02-21T07:51:40.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.210+0000 7f5ccf400640 1 -- 172.21.15.100:0/1665650886 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd003e800 con 0x7f5cd8153a90 2024-02-21T07:51:40.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.214+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd0009b30 con 0x7f5cd8153a90 2024-02-21T07:51:40.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.214+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd8183fe0 con 0x7f5cd8153a90 2024-02-21T07:51:40.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.220+0000 7f5ccf400640 1 -- 172.21.15.100:0/1665650886 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5cd002cd50 con 0x7f5cd8153a90 2024-02-21T07:51:40.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.223+0000 7f5ccf400640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 0x7f5cb80a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.223+0000 7f5ccf400640 1 -- 172.21.15.100:0/1665650886 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5cd00ec290 con 0x7f5cd8153a90 2024-02-21T07:51:40.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.224+0000 7f5cd7400640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 0x7f5cb80a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.238+0000 7f5ce1276740 1 Processor -- start 2024-02-21T07:51:40.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.239+0000 7f5ce1276740 1 -- start start 2024-02-21T07:51:40.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.241+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 0x560bb1c642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.241+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5ce1276740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1b97210 con 0x560bb1c647e0 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5ce1276740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1b94740 con 0x560bb1c9f590 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5ce1276740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1b8ff20 con 0x560bb1c63ec0 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5cd7400640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 0x7f5cb80a1660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8005090 tx=0x7f5cc8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41224/0 (socket says 172.21.15.100:41224) 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.242+0000 7f5cd6a00640 1 -- 172.21.15.100:0/2526165552 learned_addr learned my addr 172.21.15.100:0/2526165552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.243+0000 7f5cd7400640 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 0x560bb1c642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.243+0000 7f5cd7400640 1 -- 172.21.15.100:0/2526165552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 msgr2=0x560bb1ca0320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.243+0000 7f5cd7400640 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca0320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.243+0000 7f5cd7400640 1 -- 172.21.15.100:0/2526165552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 msgr2=0x560bb1c9f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.249+0000 7f5cd7400640 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.249+0000 7f5cd7400640 1 -- 172.21.15.100:0/2526165552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bb1b51df0 con 0x560bb1c63ec0 2024-02-21T07:51:40.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.249+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:40.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.252+0000 7f5cd7400640 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 0x560bb1c642a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8007270 tx=0x7f5cc8011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d2232f98c33507 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.253+0000 7f5cc3e00640 1 -- 172.21.15.100:0/2526165552 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8023960 con 0x560bb1c63ec0 2024-02-21T07:51:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.253+0000 7f5cc3e00640 1 -- 172.21.15.100:0/2526165552 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8023ac0 con 0x560bb1c63ec0 2024-02-21T07:51:40.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.253+0000 7f5cc3e00640 1 -- 172.21.15.100:0/2526165552 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8023c30 con 0x560bb1c63ec0 2024-02-21T07:51:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.254+0000 7f5ce1276740 1 -- 172.21.15.100:0/2526165552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 msgr2=0x560bb1c642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.254+0000 7f5ce1276740 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 0x560bb1c642a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8007270 tx=0x7f5cc8011000 comp rx=0 tx=0).stop 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.261+0000 7f5ce1276740 1 -- 172.21.15.100:0/2526165552 shutdown_connections 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.261+0000 7f5ce1276740 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.261+0000 7f5ce1276740 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.261+0000 7f5ce1276740 1 --2- 172.21.15.100:0/2526165552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c63ec0 0x560bb1c642a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.261+0000 7f5ce1276740 1 -- 172.21.15.100:0/2526165552 >> 172.21.15.100:0/2526165552 conn(0x560bb1c26490 msgr2=0x560bb1c27510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.262+0000 7f5ce1276740 1 -- 172.21.15.100:0/2526165552 shutdown_connections 2024-02-21T07:51:40.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.262+0000 7f5ce1276740 1 -- 172.21.15.100:0/2526165552 wait complete. 2024-02-21T07:51:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.263+0000 7f5ce1276740 1 -- start start 2024-02-21T07:51:40.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.263+0000 7f5ce1276740 1 Processor -- start 2024-02-21T07:51:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.266+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c56510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.266+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 0x560bb1c522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44028/0 (socket says 172.21.15.100:44028) 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5cd7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c56510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5ce1276740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1b35150 con 0x560bb1c647e0 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5ce1276740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1b34df0 con 0x560bb1c9f590 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5ce1276740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb18fe1c0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 0x560bb1c522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.267+0000 7f5cd6a00640 1 -- 172.21.15.100:0/651379110 learned_addr learned my addr 172.21.15.100:0/651379110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.268+0000 7f5ce1276740 10 client.0 _ll_register_callbacks cb 0x560bb1b842b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:40.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.268+0000 7f5cd7e00640 1 -- 172.21.15.100:0/651379110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 msgr2=0x560bb1ca6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.270+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.270+0000 7f5cd7e00640 1 -- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 msgr2=0x560bb1c56510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.270+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c56510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.271+0000 7f5cd7e00640 1 -- 172.21.15.100:0/651379110 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc800f040 con 0x560bb1c9d1c0 2024-02-21T07:51:40.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.274+0000 7f5cc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:40.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.275+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 0x560bb1c522d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00e9cf0 tx=0x7f5cd00b9a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a2e4195bcef13de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.278+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00b9ef0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.278+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bb188f7e0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.279+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5cd00be040 con 0x560bb1c9d1c0 2024-02-21T07:51:40.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.282+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cd00b9ef0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.283+0000 7f5ce1276740 10 client.6257 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:40.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.283+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560bb1b8e5a0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.285+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560bb188f7e0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.285+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5cd003c070 con 0x560bb1c9d1c0 2024-02-21T07:51:40.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.285+0000 7f5ce1276740 10 client.6257 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:40.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.285+0000 7f5ce1276740 10 client.6257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:40.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.285+0000 7f5ce1276740 20 client.6257 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:40.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.286+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c23090 0x560bb1c234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.290+0000 7f5ce1276740 4 client.6257 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:40.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.290+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bb18cc720 con 0x560bb1c23090 2024-02-21T07:51:40.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.291+0000 7f5cd7400640 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c23090 0x560bb1c234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.294+0000 7f5cd7400640 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c23090 0x560bb1c234a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d61fd8dfb132bce1 server_cookie=68074a334d153eb1 in_seq=0 out_seq=0 2024-02-21T07:51:40.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.295+0000 7f5cc0c00640 10 client.6257 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:40.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.297+0000 7f5cc0c00640 1 -- 172.21.15.100:0/651379110 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560bb18cc720 con 0x560bb1c23090 2024-02-21T07:51:40.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.297+0000 7f5cc0c00640 10 client.6257 handle_command_reply: tid=0 2024-02-21T07:51:40.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.298+0000 7f5ce1276740 1 client.6257 shutdown 2024-02-21T07:51:40.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.298+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 msgr2=0x560bb1c522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.298+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 0x560bb1c522d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00e9cf0 tx=0x7f5cd00b9a30 comp rx=0 tx=0).stop 2024-02-21T07:51:40.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 shutdown_connections 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c23090 0x560bb1c234a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9d1c0 0x560bb1c522d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1ca6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 --2- 172.21.15.100:0/651379110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c647e0 0x560bb1c56510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 >> 172.21.15.100:0/651379110 conn(0x560bb1c63ec0 msgr2=0x560bb1c68380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.299+0000 7f5cc0c00640 0 client.6257 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:40.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.302+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 shutdown_connections 2024-02-21T07:51:40.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.302+0000 7f5ce1276740 1 -- 172.21.15.100:0/651379110 wait complete. 2024-02-21T07:51:40.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.302+0000 7f5ce1276740 20 client.6257 trim_cache size 0 max 16384 2024-02-21T07:51:40.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.356+0000 7f5ce1276740 1 Processor -- start 2024-02-21T07:51:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.356+0000 7f5ce1276740 1 -- start start 2024-02-21T07:51:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.359+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.359+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1c21dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.360+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1c22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.360+0000 7f5ce1276740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1c644d0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.360+0000 7f5ce1276740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1c4b730 con 0x560bb1c9f590 2024-02-21T07:51:40.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.360+0000 7f5ce1276740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1c24740 con 0x560bb1c647e0 2024-02-21T07:51:40.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.363+0000 7f5cd7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.363+0000 7f5cd6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1c21dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.363+0000 7f5cd7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45368/0 (socket says 172.21.15.100:45368) 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.363+0000 7f5cd7400640 1 -- 172.21.15.100:0/3183034825 learned_addr learned my addr 172.21.15.100:0/3183034825 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.364+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1c22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7400640 1 -- 172.21.15.100:0/3183034825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 msgr2=0x560bb1c22310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7400640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1c22310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7400640 1 -- 172.21.15.100:0/3183034825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 msgr2=0x560bb1c21dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7400640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1c21dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7400640 1 -- 172.21.15.100:0/3183034825 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bb1b2aab0 con 0x560bb1c647e0 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd7e00640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1c22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.366+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1c21dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.367+0000 7f5cd7400640 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8029040 tx=0x7f5cc8007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d4e3d4142013d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.368+0000 7f5cc3400640 1 -- 172.21.15.100:0/3183034825 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8033070 con 0x560bb1c647e0 2024-02-21T07:51:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.368+0000 7f5cc3400640 1 -- 172.21.15.100:0/3183034825 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8035b00 con 0x560bb1c647e0 2024-02-21T07:51:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.368+0000 7f5cc3400640 1 -- 172.21.15.100:0/3183034825 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8035c70 con 0x560bb1c647e0 2024-02-21T07:51:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.370+0000 7f5ce1276740 1 -- 172.21.15.100:0/3183034825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 msgr2=0x560bb1ca6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.370+0000 7f5ce1276740 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8029040 tx=0x7f5cc8007000 comp rx=0 tx=0).stop 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 -- 172.21.15.100:0/3183034825 shutdown_connections 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c9f590 0x560bb1c22310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1c21dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 --2- 172.21.15.100:0/3183034825 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c647e0 0x560bb1ca6a80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 -- 172.21.15.100:0/3183034825 >> 172.21.15.100:0/3183034825 conn(0x560bb1c63ec0 msgr2=0x560bb1c56410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 -- 172.21.15.100:0/3183034825 shutdown_connections 2024-02-21T07:51:40.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.371+0000 7f5ce1276740 1 -- 172.21.15.100:0/3183034825 wait complete. 2024-02-21T07:51:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.374+0000 7f5ce1276740 1 -- start start 2024-02-21T07:51:40.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.376+0000 7f5ce1276740 1 Processor -- start 2024-02-21T07:51:40.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c647e0 0x560bb1c60d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1cb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 0x560bb1c93dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1cb0e00 con 0x560bb1c9d1c0 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1c57b30 con 0x560bb1c647e0 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bb1c57f90 con 0x560bb1c9f590 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.378+0000 7f5ce1276740 10 client.0 _ll_register_callbacks cb 0x7f5cc8004cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.379+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 0x560bb1c93dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.379+0000 7f5cd7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 0x560bb1c93dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45374/0 (socket says 172.21.15.100:45374) 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.379+0000 7f5cd7e00640 1 -- 172.21.15.100:0/4179181388 learned_addr learned my addr 172.21.15.100:0/4179181388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:40.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.379+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1cb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.382+0000 7f5cd7400640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c647e0 0x560bb1c60d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.383+0000 7f5cd6a00640 1 -- 172.21.15.100:0/4179181388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 msgr2=0x560bb1c93dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.383+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 0x560bb1c93dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.383+0000 7f5cd6a00640 1 -- 172.21.15.100:0/4179181388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c647e0 msgr2=0x560bb1c60d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.383+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c647e0 0x560bb1c60d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.383+0000 7f5cd6a00640 1 -- 172.21.15.100:0/4179181388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4009960 con 0x560bb1c9d1c0 2024-02-21T07:51:40.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.387+0000 7f5cc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:51:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.387+0000 7f5cd6a00640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1cb06b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x560bb1cb0ff0 tx=0x7f5cc4018b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d34e54d82a35db3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:40.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.389+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4016d40 con 0x560bb1c9d1c0 2024-02-21T07:51:40.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.390+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5cc40203e0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.393+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5cc8023ac0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.394+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cc4016ea0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.394+0000 7f5ce1276740 10 client.6117 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:40.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.394+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560bb1b51df0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.396+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8023ac0 con 0x560bb1c9d1c0 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5cc4004020 con 0x560bb1c9d1c0 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 10 client.6117 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 10 client.6117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 20 client.6117 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c4f2b0 0x560bb1c94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 4 client.6117 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:51:40.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.398+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560bb191b890 con 0x560bb1c4f2b0 2024-02-21T07:51:40.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.399+0000 7f5cd7400640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c4f2b0 0x560bb1c94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.402+0000 7f5cd7400640 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c4f2b0 0x560bb1c94300 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43fb042d19b38856 server_cookie=3ee317e6e2e0e194 in_seq=0 out_seq=0 2024-02-21T07:51:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.403+0000 7f5cc0c00640 10 client.6117 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:40.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.403+0000 7f5cc0c00640 1 -- 172.21.15.100:0/4179181388 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560bb191b890 con 0x560bb1c4f2b0 2024-02-21T07:51:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.403+0000 7f5cc0c00640 10 client.6117 handle_command_reply: tid=0 2024-02-21T07:51:40.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.404+0000 7f5ce1276740 1 client.6117 shutdown 2024-02-21T07:51:40.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.405+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 msgr2=0x560bb1cb06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.405+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1cb06b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x560bb1cb0ff0 tx=0x7f5cc4018b60 comp rx=0 tx=0).stop 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.406+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 shutdown_connections 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x560bb1c4f2b0 0x560bb1c94300 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560bb1c9f590 0x560bb1c93dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560bb1c9d1c0 0x560bb1cb06b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5ce1276740 1 --2- 172.21.15.100:0/4179181388 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560bb1c647e0 0x560bb1c60d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 >> 172.21.15.100:0/4179181388 conn(0x560bb1c63ec0 msgr2=0x560bb1c9f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.407+0000 7f5cc0c00640 0 client.6117 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:40.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.410+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 shutdown_connections 2024-02-21T07:51:40.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.410+0000 7f5ce1276740 1 -- 172.21.15.100:0/4179181388 wait complete. 2024-02-21T07:51:40.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.411+0000 7f5ce1276740 20 client.6117 trim_cache size 0 max 16384 2024-02-21T07:51:40.415 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:51:40.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.418+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 msgr2=0x7f5cb80a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.419+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 0x7f5cb80a1660 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8005090 tx=0x7f5cc8009040 comp rx=0 tx=0).stop 2024-02-21T07:51:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.419+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 msgr2=0x7f5cd815b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.419+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0036040 tx=0x7f5cd0004a40 comp rx=0 tx=0).stop 2024-02-21T07:51:40.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.419+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 shutdown_connections 2024-02-21T07:51:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.420+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cd8153a90 0x7f5cd815b3a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.420+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5cd815daa0 0x7f5cd815cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.420+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5cb809f1a0 0x7f5cb80a1660 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.420+0000 7f5cde600640 1 --2- 172.21.15.100:0/1665650886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd808c7e0 0x7f5cd8182f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.420+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 >> 172.21.15.100:0/1665650886 conn(0x7f5cd80fe210 msgr2=0x7f5cd80ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:40.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.440+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 shutdown_connections 2024-02-21T07:51:40.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:40.441+0000 7f5cde600640 1 -- 172.21.15.100:0/1665650886 wait complete. 2024-02-21T07:51:41.484 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:51:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:51:41.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:51:41.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.951+0000 7fc001600640 1 Processor -- start 2024-02-21T07:51:41.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.951+0000 7fc001600640 1 -- start start 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.954+0000 7fc001600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbffc0f8380 0x7fbffc182c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.955+0000 7fc001600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc1842a0 con 0x7fbffc182790 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.955+0000 7fc001600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc183160 con 0x7fbffc08e5c0 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.955+0000 7fc001600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc1833b0 con 0x7fbffc0f8380 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.955+0000 7fbffaa00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fbffc08e5c0 0x7fbffc181f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:45530/0 (socket says 172.21.15.100:45530) 2024-02-21T07:51:41.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.955+0000 7fbffaa00640 1 -- 172.21.15.100:0/1419777597 learned_addr learned my addr 172.21.15.100:0/1419777597 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:51:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.958+0000 7fbffb400640 1 --2- 172.21.15.100:0/1419777597 >> v2:172.21.15.100:3300/0 conn(0x7fbffc0f8380 0x7fbffc182c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.958+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059382031 0 0) 0x7fbffc183160 con 0x7fbffc08e5c0 2024-02-21T07:51:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.958+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe0003520 con 0x7fbffc08e5c0 2024-02-21T07:51:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.961+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627417158 0 0) 0x7fbfe0003520 con 0x7fbffc08e5c0 2024-02-21T07:51:41.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.961+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 >> v2:172.21.15.100:3300/0 conn(0x7fbffc0f8380 msgr2=0x7fbffc182c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.964+0000 7fbff9600640 1 --2- 172.21.15.100:0/1419777597 >> v2:172.21.15.100:3300/0 conn(0x7fbffc0f8380 0x7fbffc182c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.964+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 >> v1:172.21.15.100:6789/0 conn(0x7fbffc182790 legacy=0x7fbffc0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.964+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc183690 con 0x7fbffc08e5c0 2024-02-21T07:51:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fbfec001650 con 0x7fbffc08e5c0 2024-02-21T07:51:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 >> v1:172.21.15.170:6789/0 conn(0x7fbffc08e5c0 legacy=0x7fbffc181f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfe0003a10 0x7fbfe0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 0x7fbfe0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:41.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00052d0 0x7fbfe000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc1833b0 con 0x7fbfe00052d0 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe000c210 con 0x7fbfe00047c0 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.971+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe000c3d0 con 0x7fbfe0003a10 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.974+0000 7fbffaa00640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfe0003a10 0x7fbfe0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.975+0000 7fbffb400640 1 --2- 172.21.15.100:0/1419777597 >> v2:172.21.15.100:3300/0 conn(0x7fbffc0f8380 0x7fbffc182c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.976+0000 7fbffb400640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00052d0 0x7fbfe000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:41.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.976+0000 7fbffa000640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 0x7fbfe0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:41.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.977+0000 7fbffa000640 1 -- 172.21.15.100:0/1419777597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfe0003a10 msgr2=0x7fbfe0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:41.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.977+0000 7fbffa000640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbfe0003a10 0x7fbfe0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.977+0000 7fbffa000640 1 -- 172.21.15.100:0/1419777597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00052d0 msgr2=0x7fbfe000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:41.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.977+0000 7fbffa000640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00052d0 0x7fbfe000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.977+0000 7fbffa000640 1 -- 172.21.15.100:0/1419777597 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0003520 con 0x7fbfe00047c0 2024-02-21T07:51:41.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.985+0000 7fbffb400640 1 -- 172.21.15.100:0/1419777597 reap_dead start 2024-02-21T07:51:41.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.988+0000 7fbffa000640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 0x7fbfe0004c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4003db0 tx=0x7fbfe00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb677a635fb996b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.989+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4007220 con 0x7fbfe00047c0 2024-02-21T07:51:41.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.989+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe402e050 con 0x7fbfe00047c0 2024-02-21T07:51:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.989+0000 7fbff9600640 1 -- 172.21.15.100:0/1419777597 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4007680 con 0x7fbfe00047c0 2024-02-21T07:51:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.990+0000 7fc001600640 1 -- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 msgr2=0x7fbfe0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:41.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.990+0000 7fc001600640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 0x7fbfe0004c40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4003db0 tx=0x7fbfe00057f0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.994+0000 7fc001600640 1 -- 172.21.15.100:0/1419777597 shutdown_connections 2024-02-21T07:51:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.994+0000 7fc001600640 1 --2- 172.21.15.100:0/1419777597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbfe00047c0 0x7fbfe0004c40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.994+0000 7fc001600640 1 -- 172.21.15.100:0/1419777597 >> 172.21.15.100:0/1419777597 conn(0x7fbffc0668b0 msgr2=0x7fbffc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:41.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.994+0000 7fc001600640 1 -- 172.21.15.100:0/1419777597 shutdown_connections 2024-02-21T07:51:41.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:41.994+0000 7fc001600640 1 -- 172.21.15.100:0/1419777597 wait complete. 2024-02-21T07:51:42.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.002+0000 7fc001600640 1 Processor -- start 2024-02-21T07:51:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.002+0000 7fc001600640 1 -- start start 2024-02-21T07:51:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.005+0000 7fc001600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 0x7fbffc16d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.006+0000 7fc001600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 0x7fbffc171300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.006+0000 7fc001600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbffc224210 0x7fbffc2246c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.007+0000 7fc001600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc223df0 con 0x7fbfe00047c0 2024-02-21T07:51:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fbffaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 0x7fbffc16d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fc001600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc171c80 con 0x7fbffc224210 2024-02-21T07:51:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fbffa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 0x7fbffc171300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fbffa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 0x7fbffc171300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45398/0 (socket says 172.21.15.100:45398) 2024-02-21T07:51:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fbffa000640 1 -- 172.21.15.100:0/2775397581 learned_addr learned my addr 172.21.15.100:0/2775397581 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.008+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc171f60 con 0x7fbffc170e80 2024-02-21T07:51:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.009+0000 7fbffb400640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbffc224210 0x7fbffc2246c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.010+0000 7fbffaa00640 1 -- 172.21.15.100:0/2775397581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 msgr2=0x7fbffc171300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.010+0000 7fbffaa00640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 0x7fbffc171300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.010+0000 7fbffaa00640 1 -- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbffc224210 msgr2=0x7fbffc2246c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.010+0000 7fbffaa00640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbffc224210 0x7fbffc2246c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.010+0000 7fbffaa00640 1 -- 172.21.15.100:0/2775397581 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc172240 con 0x7fbfe00047c0 2024-02-21T07:51:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.012+0000 7fbffaa00640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 0x7fbffc16d780 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbfec001050 tx=0x7fbfec00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.017+0000 7fbff2a00640 1 -- 172.21.15.100:0/2775397581 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00ee90 con 0x7fbfe00047c0 2024-02-21T07:51:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.017+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc223a10 con 0x7fbfe00047c0 2024-02-21T07:51:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.017+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc16dcc0 con 0x7fbfe00047c0 2024-02-21T07:51:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.017+0000 7fbff2a00640 1 -- 172.21.15.100:0/2775397581 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00ee90 con 0x7fbfe00047c0 2024-02-21T07:51:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.017+0000 7fbff2a00640 1 -- 172.21.15.100:0/2775397581 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00c660 con 0x7fbfe00047c0 2024-02-21T07:51:42.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.025+0000 7fbff2a00640 1 -- 172.21.15.100:0/2775397581 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbfec00c7c0 con 0x7fbfe00047c0 2024-02-21T07:51:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.028+0000 7fbff2a00640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 0x7fbfd80a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.028+0000 7fbff2a00640 1 -- 172.21.15.100:0/2775397581 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbfec0c93b0 con 0x7fbfe00047c0 2024-02-21T07:51:42.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.029+0000 7fbffa000640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 0x7fbfd80a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.032+0000 7fbffa000640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 0x7fbfd80a15c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4003910 tx=0x7fbfe4009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.049+0000 7fc004395740 1 Processor -- start 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.049+0000 7fc004395740 1 -- start start 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.051+0000 7fc004395740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fba21c0 0x556d2fba25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.051+0000 7fc004395740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fba2ae0 0x556d2fbdd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.051+0000 7fc004395740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.052+0000 7fc004395740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fb22300 con 0x556d2fbdd890 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fc004395740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fad4e50 con 0x556d2fba2ae0 2024-02-21T07:51:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fc004395740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fad2380 con 0x556d2fba21c0 2024-02-21T07:51:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fbffb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fbffb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41262/0 (socket says 172.21.15.100:41262) 2024-02-21T07:51:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fbffb400640 1 -- 172.21.15.100:0/3297204661 learned_addr learned my addr 172.21.15.100:0/3297204661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fbffa000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fba2ae0 0x556d2fbdd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.053+0000 7fbffaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fba21c0 0x556d2fba25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.054+0000 7fbffb400640 1 -- 172.21.15.100:0/3297204661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fba21c0 msgr2=0x556d2fba25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.054+0000 7fbffb400640 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fba21c0 0x556d2fba25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.054+0000 7fbffb400640 1 -- 172.21.15.100:0/3297204661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fba2ae0 msgr2=0x556d2fbdd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.055+0000 7fbffb400640 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fba2ae0 0x556d2fbdd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.055+0000 7fbffb400640 1 -- 172.21.15.100:0/3297204661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d2fa96c80 con 0x556d2fbdd890 2024-02-21T07:51:42.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.055+0000 7fbffb400640 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ed870 tx=0x7fbff400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fad264f42c4175 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.057+0000 7fbfeb000640 1 -- 172.21.15.100:0/3297204661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4012040 con 0x556d2fbdd890 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.057+0000 7fbfeb000640 1 -- 172.21.15.100:0/3297204661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4013040 con 0x556d2fbdd890 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.057+0000 7fbfeb000640 1 -- 172.21.15.100:0/3297204661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400bea0 con 0x556d2fbdd890 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.058+0000 7fc004395740 1 -- 172.21.15.100:0/3297204661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 msgr2=0x556d2fbde620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.058+0000 7fc004395740 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0ed870 tx=0x7fbff400db60 comp rx=0 tx=0).stop 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.059+0000 7fc004395740 1 -- 172.21.15.100:0/3297204661 shutdown_connections 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.059+0000 7fc004395740 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fbdd890 0x556d2fbde620 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.059+0000 7fc004395740 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fba2ae0 0x556d2fbdd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.059+0000 7fc004395740 1 --2- 172.21.15.100:0/3297204661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fba21c0 0x556d2fba25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.059+0000 7fc004395740 1 -- 172.21.15.100:0/3297204661 >> 172.21.15.100:0/3297204661 conn(0x556d2fb64790 msgr2=0x556d2fb65810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.062+0000 7fc004395740 1 -- 172.21.15.100:0/3297204661 shutdown_connections 2024-02-21T07:51:42.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.062+0000 7fc004395740 1 -- 172.21.15.100:0/3297204661 wait complete. 2024-02-21T07:51:42.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.064+0000 7fc004395740 1 -- start start 2024-02-21T07:51:42.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.064+0000 7fc004395740 1 Processor -- start 2024-02-21T07:51:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fbd0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb60ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2facdb60 con 0x556d2fba2ae0 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fa72fd0 con 0x556d2fbdd890 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fa72c70 con 0x556d2fbcaf20 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.066+0000 7fc004395740 10 client.0 _ll_register_callbacks cb 0x556d2f7dec60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45422/0 (socket says 172.21.15.100:45422) 2024-02-21T07:51:42.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 -- 172.21.15.100:0/3382484612 learned_addr learned my addr 172.21.15.100:0/3382484612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 -- 172.21.15.100:0/3382484612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 msgr2=0x556d2fb60ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:42.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb60ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 -- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 msgr2=0x556d2fbd0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fbd0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 -- 172.21.15.100:0/3382484612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff400f050 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.067+0000 7fbffb400640 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbff400bb10 tx=0x7fbff4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01f572792ad891 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fbfdf400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4012070 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbff400d600 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d2f7cd860 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff4019bb0 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fc004395740 10 client.6275 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556d2facc1e0 con 0x556d2fbcaf20 2024-02-21T07:51:42.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.068+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556d2f7cd860 con 0x556d2fbcaf20 2024-02-21T07:51:42.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.087+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbff4019d10 con 0x556d2fbcaf20 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 10 client.6275 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 10 client.6275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 20 client.6275 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb91bc0 0x556d2fb91fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 4 client.6275 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:42.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.090+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d2f81e410 con 0x556d2fb91bc0 2024-02-21T07:51:42.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.098+0000 7fbffaa00640 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb91bc0 0x556d2fb91fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.106+0000 7fbffaa00640 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb91bc0 0x556d2fb91fd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ab2af9647ba63 server_cookie=e8ebb326f0d27f54 in_seq=0 out_seq=0 2024-02-21T07:51:42.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.107+0000 7fbfdf400640 10 client.6275 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.114+0000 7fbfdf400640 1 -- 172.21.15.100:0/3382484612 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d2f81e410 con 0x556d2fb91bc0 2024-02-21T07:51:42.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.114+0000 7fbfdf400640 10 client.6275 handle_command_reply: tid=0 2024-02-21T07:51:42.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.114+0000 7fc004395740 1 client.6275 shutdown 2024-02-21T07:51:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.116+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 msgr2=0x556d2fbcb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.116+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbff400bb10 tx=0x7fbff4004a40 comp rx=0 tx=0).stop 2024-02-21T07:51:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 shutdown_connections 2024-02-21T07:51:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb91bc0 0x556d2fb91fd0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fbfdf400640 0 client.6275 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fbcb3a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb60ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 --2- 172.21.15.100:0/3382484612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fbd0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.121+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 >> 172.21.15.100:0/3382484612 conn(0x556d2fba21c0 msgr2=0x556d2fb9e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.122+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 shutdown_connections 2024-02-21T07:51:42.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.122+0000 7fc004395740 1 -- 172.21.15.100:0/3382484612 wait complete. 2024-02-21T07:51:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.122+0000 7fc004395740 20 client.6275 trim_cache size 0 max 16384 2024-02-21T07:51:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.166+0000 7fc004395740 1 Processor -- start 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.167+0000 7fc004395740 1 -- start start 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fb61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fba19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fbd5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2f8160c0 con 0x556d2fba2ae0 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fbc4d70 con 0x556d2fbdd890 2024-02-21T07:51:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.169+0000 7fc004395740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fb88a20 con 0x556d2fbcaf20 2024-02-21T07:51:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.170+0000 7fbffb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fbd5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.170+0000 7fbffb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fbd5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44074/0 (socket says 172.21.15.100:44074) 2024-02-21T07:51:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.170+0000 7fbffb400640 1 -- 172.21.15.100:0/1055547161 learned_addr learned my addr 172.21.15.100:0/1055547161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.170+0000 7fbffa000640 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fba19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.170+0000 7fbffaa00640 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fb61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.171+0000 7fbffaa00640 1 -- 172.21.15.100:0/1055547161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 msgr2=0x556d2fba19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.171+0000 7fbffaa00640 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fba19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.171+0000 7fbffaa00640 1 -- 172.21.15.100:0/1055547161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 msgr2=0x556d2fbd5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.171+0000 7fbffaa00640 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fbd5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.171+0000 7fbffaa00640 1 -- 172.21.15.100:0/1055547161 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d2fa68a90 con 0x556d2fba2ae0 2024-02-21T07:51:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.173+0000 7fbffaa00640 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fb61170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbfec096c80 tx=0x7fbfec0c6c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde747cf7e9d6496 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.173+0000 7fbfea600640 1 -- 172.21.15.100:0/1055547161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec09f690 con 0x556d2fba2ae0 2024-02-21T07:51:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.173+0000 7fbfea600640 1 -- 172.21.15.100:0/1055547161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec095020 con 0x556d2fba2ae0 2024-02-21T07:51:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.173+0000 7fbfea600640 1 -- 172.21.15.100:0/1055547161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec09f690 con 0x556d2fba2ae0 2024-02-21T07:51:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.175+0000 7fc004395740 1 -- 172.21.15.100:0/1055547161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 msgr2=0x556d2fb61170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.175+0000 7fc004395740 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fb61170 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbfec096c80 tx=0x7fbfec0c6c80 comp rx=0 tx=0).stop 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 -- 172.21.15.100:0/1055547161 shutdown_connections 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fbd5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fba19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 --2- 172.21.15.100:0/1055547161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fb61170 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 -- 172.21.15.100:0/1055547161 >> 172.21.15.100:0/1055547161 conn(0x556d2fba21c0 msgr2=0x556d2fb66200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 -- 172.21.15.100:0/1055547161 shutdown_connections 2024-02-21T07:51:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.177+0000 7fc004395740 1 -- 172.21.15.100:0/1055547161 wait complete. 2024-02-21T07:51:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.179+0000 7fc004395740 1 -- start start 2024-02-21T07:51:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.179+0000 7fc004395740 1 Processor -- start 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fba25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fb61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fc49e10 con 0x556d2fba2ae0 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fc07a30 con 0x556d2fbdd890 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.181+0000 7fc004395740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d2fc07750 con 0x556d2fbcaf20 2024-02-21T07:51:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.182+0000 7fc004395740 10 client.0 _ll_register_callbacks cb 0x7fbff400b2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.183+0000 7fbffb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.183+0000 7fbffb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44078/0 (socket says 172.21.15.100:44078) 2024-02-21T07:51:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.184+0000 7fbffb400640 1 -- 172.21.15.100:0/4150483850 learned_addr learned my addr 172.21.15.100:0/4150483850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.184+0000 7fbffa000640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fb61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.184+0000 7fbffaa00640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fba25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.185+0000 7fbffb400640 1 -- 172.21.15.100:0/4150483850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 msgr2=0x556d2fb61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffb400640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fb61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffb400640 1 -- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 msgr2=0x556d2fba25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffb400640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fba25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffb400640 1 -- 172.21.15.100:0/4150483850 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc16dcc0 con 0x556d2fbdd890 2024-02-21T07:51:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffa000640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fb61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:42.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.186+0000 7fbffaa00640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fba25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:42.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.189+0000 7fbffb400640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbff4023600 tx=0x7fbff400d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa62e2df5ab0af12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.189+0000 7fbfdf400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:42.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.190+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4019640 con 0x556d2fbdd890 2024-02-21T07:51:42.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.191+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbff40199b0 con 0x556d2fbdd890 2024-02-21T07:51:42.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.192+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbff4013040 con 0x556d2fbdd890 2024-02-21T07:51:42.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.193+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff4019b70 con 0x556d2fbdd890 2024-02-21T07:51:42.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.193+0000 7fc004395740 10 client.6313 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:42.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.193+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556d2fa8e6a0 con 0x556d2fbdd890 2024-02-21T07:51:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.194+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4048020 con 0x556d2fbdd890 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbff4019cd0 con 0x556d2fbdd890 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 10 client.6313 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 10 client.6313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 20 client.6313 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb63870 0x556d2fbd2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 4 client.6313 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:51:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.196+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556d2f80a7b0 con 0x556d2fb63870 2024-02-21T07:51:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.197+0000 7fbffaa00640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb63870 0x556d2fbd2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.201+0000 7fbffaa00640 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb63870 0x556d2fbd2eb0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bb0f03b2c1558c3 server_cookie=80fb4898decb556d in_seq=0 out_seq=0 2024-02-21T07:51:42.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.202+0000 7fbfdf400640 10 client.6313 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.204+0000 7fbfdf400640 1 -- 172.21.15.100:0/4150483850 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556d2f80a7b0 con 0x556d2fb63870 2024-02-21T07:51:42.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.204+0000 7fbfdf400640 10 client.6313 handle_command_reply: tid=0 2024-02-21T07:51:42.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.204+0000 7fc004395740 1 client.6313 shutdown 2024-02-21T07:51:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.205+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 msgr2=0x556d2fb658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.205+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbff4023600 tx=0x7fbff400d040 comp rx=0 tx=0).stop 2024-02-21T07:51:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 shutdown_connections 2024-02-21T07:51:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556d2fb63870 0x556d2fbd2eb0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d2fbdd890 0x556d2fb658d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556d2fbcaf20 0x556d2fb61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 --2- 172.21.15.100:0/4150483850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556d2fba2ae0 0x556d2fba25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.206+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 >> 172.21.15.100:0/4150483850 conn(0x556d2fba21c0 msgr2=0x556d2fbddc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.209+0000 7fbfdf400640 0 client.6313 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.209+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 shutdown_connections 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "2cdbb18e-bcfa-478f-b5c5-cb6861d28953", 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.210+0000 7fc004395740 1 -- 172.21.15.100:0/4150483850 wait complete. 2024-02-21T07:51:42.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.210+0000 7fc004395740 20 client.6313 trim_cache size 0 max 16384 2024-02-21T07:51:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.225+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 msgr2=0x7fbfd80a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.225+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 0x7fbfd80a15c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4003910 tx=0x7fbfe4009030 comp rx=0 tx=0).stop 2024-02-21T07:51:42.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.225+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 msgr2=0x7fbffc16d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.225+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 0x7fbffc16d780 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbfec001050 tx=0x7fbfec00eb50 comp rx=0 tx=0).stop 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 shutdown_connections 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbffc224210 0x7fbffc2246c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbffc170e80 0x7fbffc171300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbfd809f100 0x7fbfd80a15c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 --2- 172.21.15.100:0/2775397581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfe00047c0 0x7fbffc16d780 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 >> 172.21.15.100:0/2775397581 conn(0x7fbffc0668b0 msgr2=0x7fbffc181f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.226+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 shutdown_connections 2024-02-21T07:51:42.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.227+0000 7fc001600640 1 -- 172.21.15.100:0/2775397581 wait complete. 2024-02-21T07:51:42.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:51:42.284 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:51:42.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.576+0000 7f867ce00640 1 Processor -- start 2024-02-21T07:51:42.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.577+0000 7f867ce00640 1 -- start start 2024-02-21T07:51:42.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.579+0000 7f867ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8678071010 0x7f86780713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.580+0000 7f867ce00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780700c0 con 0x7f8678071930 2024-02-21T07:51:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.580+0000 7f867ce00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86780703a0 con 0x7f8678071d70 2024-02-21T07:51:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.580+0000 7f867ce00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867806ea40 con 0x7f8678071010 2024-02-21T07:51:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.581+0000 7f8675e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8678071010 0x7f86780713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.581+0000 7f8675e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8678071010 0x7f86780713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41296/0 (socket says 172.21.15.100:41296) 2024-02-21T07:51:42.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.581+0000 7f8675e00640 1 -- 172.21.15.100:0/2815431098 learned_addr learned my addr 172.21.15.100:0/2815431098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.582+0000 7f8675e00640 1 -- 172.21.15.100:0/2815431098 >> v1:172.21.15.170:6789/0 conn(0x7f8678071d70 legacy=0x7f8678186920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.582+0000 7f8675e00640 1 -- 172.21.15.100:0/2815431098 >> v1:172.21.15.156:6789/0 conn(0x7f8678071930 legacy=0x7f867806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.582+0000 7f8675e00640 1 -- 172.21.15.100:0/2815431098 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678070680 con 0x7f8678071010 2024-02-21T07:51:42.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.584+0000 7f8675e00640 1 --2- 172.21.15.100:0/2815431098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071010 0x7f86780713f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f867808e020 tx=0x7f866002ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7649e89e039efbb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.585+0000 7f8674a00640 1 -- 172.21.15.100:0/2815431098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866002da70 con 0x7f8678071010 2024-02-21T07:51:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.585+0000 7f8674a00640 1 -- 172.21.15.100:0/2815431098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866002dbd0 con 0x7f8678071010 2024-02-21T07:51:42.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.585+0000 7f8674a00640 1 -- 172.21.15.100:0/2815431098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660035440 con 0x7f8678071010 2024-02-21T07:51:42.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 -- 172.21.15.100:0/2815431098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071010 msgr2=0x7f86780713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 --2- 172.21.15.100:0/2815431098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071010 0x7f86780713f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f867808e020 tx=0x7f866002ccc0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 -- 172.21.15.100:0/2815431098 shutdown_connections 2024-02-21T07:51:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 --2- 172.21.15.100:0/2815431098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071010 0x7f86780713f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 -- 172.21.15.100:0/2815431098 >> 172.21.15.100:0/2815431098 conn(0x7f86780668b0 msgr2=0x7f8678066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 -- 172.21.15.100:0/2815431098 shutdown_connections 2024-02-21T07:51:42.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.587+0000 7f867ce00640 1 -- 172.21.15.100:0/2815431098 wait complete. 2024-02-21T07:51:42.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.590+0000 7f867ce00640 1 Processor -- start 2024-02-21T07:51:42.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.590+0000 7f867ce00640 1 -- start start 2024-02-21T07:51:42.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.592+0000 7f867ce00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.592+0000 7f867ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 0x7f86780cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.592+0000 7f867ce00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86780f7be0 0x7f8678154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45446/0 (socket says 172.21.15.100:45446) 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 -- 172.21.15.100:0/3452012438 learned_addr learned my addr 172.21.15.100:0/3452012438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780cc600 con 0x7f8678071930 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780f8be0 con 0x7f86780f7be0 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86780f8620 con 0x7f8678071010 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675400640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 0x7f86780cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 -- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86780f7be0 msgr2=0x7f8678154050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86780f7be0 0x7f8678154050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.593+0000 7f8675e00640 1 -- 172.21.15.100:0/3452012438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 msgr2=0x7f86780cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.594+0000 7f8675e00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 0x7f86780cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.594+0000 7f8675e00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009d60 con 0x7f8678071010 2024-02-21T07:51:42.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.594+0000 7f8675400640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 0x7f86780cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:42.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.595+0000 7f8675e00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86600090b0 tx=0x7f86600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.599+0000 7f866e000640 1 -- 172.21.15.100:0/3452012438 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660040650 con 0x7f8678071010 2024-02-21T07:51:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.600+0000 7f866e000640 1 -- 172.21.15.100:0/3452012438 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866000c040 con 0x7f8678071010 2024-02-21T07:51:42.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.600+0000 7f866e000640 1 -- 172.21.15.100:0/3452012438 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600409f0 con 0x7f8678071010 2024-02-21T07:51:42.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.600+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86780f8900 con 0x7f8678071010 2024-02-21T07:51:42.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.600+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780cc290 con 0x7f8678071010 2024-02-21T07:51:42.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.608+0000 7f866e000640 1 -- 172.21.15.100:0/3452012438 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f866003c070 con 0x7f8678071010 2024-02-21T07:51:42.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.612+0000 7f866e000640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 0x7f86540a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.612+0000 7f866e000640 1 -- 172.21.15.100:0/3452012438 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f86600ec490 con 0x7f8678071010 2024-02-21T07:51:42.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.616+0000 7f8675400640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 0x7f86540a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.617+0000 7f867fb7a740 1 Processor -- start 2024-02-21T07:51:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.617+0000 7f8675400640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 0x7f86540a16e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8668007fd0 tx=0x7f8668009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.618+0000 7f867fb7a740 1 -- start start 2024-02-21T07:51:42.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.620+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.620+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.628+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.621+0000 7f8675e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.628+0000 7f8675e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44102/0 (socket says 172.21.15.100:44102) 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.629+0000 7f867fb7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcf1b150 con 0x5616bcfe48e0 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.629+0000 7f867fb7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcf18680 con 0x5616bcfe3fc0 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.629+0000 7f867fb7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcf13e60 con 0x5616bd019f80 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.629+0000 7f8676800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.630+0000 7f8676800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41308/0 (socket says 172.21.15.100:41308) 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.630+0000 7f8676800640 1 -- 172.21.15.100:0/826736052 learned_addr learned my addr 172.21.15.100:0/826736052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.631+0000 7f8676800640 1 -- 172.21.15.100:0/826736052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd019f80 msgr2=0x5616bcfe43a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:51:42.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.631+0000 7f8676800640 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.631+0000 7f8676800640 1 -- 172.21.15.100:0/826736052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 msgr2=0x5616bd019a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.631+0000 7f8676800640 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.631+0000 7f8676800640 1 -- 172.21.15.100:0/826736052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616bcecd060 con 0x5616bcfe48e0 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.632+0000 7f8675e00640 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.633+0000 7f8676800640 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8670009d70 tx=0x7f8670013c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92025dd4eab57fe2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.633+0000 7f8666a00640 1 -- 172.21.15.100:0/826736052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670014820 con 0x5616bcfe48e0 2024-02-21T07:51:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.633+0000 7f8666a00640 1 -- 172.21.15.100:0/826736052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86700149a0 con 0x5616bcfe48e0 2024-02-21T07:51:42.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.633+0000 7f8666a00640 1 -- 172.21.15.100:0/826736052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670014d50 con 0x5616bcfe48e0 2024-02-21T07:51:42.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.634+0000 7f867fb7a740 1 -- 172.21.15.100:0/826736052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 msgr2=0x5616bcfa6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.634+0000 7f867fb7a740 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8670009d70 tx=0x7f8670013c30 comp rx=0 tx=0).stop 2024-02-21T07:51:42.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.640+0000 7f867fb7a740 1 -- 172.21.15.100:0/826736052 shutdown_connections 2024-02-21T07:51:42.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.640+0000 7f867fb7a740 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6ef0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.640+0000 7f867fb7a740 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.640+0000 7f867fb7a740 1 --2- 172.21.15.100:0/826736052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bd019a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.640+0000 7f867fb7a740 1 -- 172.21.15.100:0/826736052 >> 172.21.15.100:0/826736052 conn(0x5616bcf735a0 msgr2=0x5616bcfaaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.645+0000 7f867fb7a740 1 -- 172.21.15.100:0/826736052 shutdown_connections 2024-02-21T07:51:42.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.645+0000 7f867fb7a740 1 -- 172.21.15.100:0/826736052 wait complete. 2024-02-21T07:51:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.648+0000 7f867fb7a740 1 -- start start 2024-02-21T07:51:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.649+0000 7f867fb7a740 1 Processor -- start 2024-02-21T07:51:42.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.652+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd019f80 0x5616bcfda1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bceb8ec0 con 0x5616bd019f80 2024-02-21T07:51:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bceb8b60 con 0x5616bcfe3fc0 2024-02-21T07:51:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcc821c0 con 0x5616bcfe48e0 2024-02-21T07:51:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f867fb7a740 10 client.0 _ll_register_callbacks cb 0x5616bcecc960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f8675e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f8675e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44104/0 (socket says 172.21.15.100:44104) 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f8675e00640 1 -- 172.21.15.100:0/2547139865 learned_addr learned my addr 172.21.15.100:0/2547139865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f8675400640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.653+0000 7f8676800640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd019f80 0x5616bcfda1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675e00640 1 -- 172.21.15.100:0/2547139865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 msgr2=0x5616bcfa6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675e00640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675e00640 1 -- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd019f80 msgr2=0x5616bcfda1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675e00640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd019f80 0x5616bcfda1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675e00640 1 -- 172.21.15.100:0/2547139865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86700099a0 con 0x5616bcfe3fc0 2024-02-21T07:51:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.654+0000 7f8675400640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.655+0000 7f865b400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.655+0000 7f8675e00640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86600c2270 tx=0x7f86600ba150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ea6abd32639894 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.655+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600c27a0 con 0x5616bcfe3fc0 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.656+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616bcc137e0 con 0x5616bcfe3fc0 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.656+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f86600c2310 con 0x5616bcfe3fc0 2024-02-21T07:51:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.656+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86600c27a0 con 0x5616bcfe3fc0 2024-02-21T07:51:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.659+0000 7f867fb7a740 10 client.6316 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.659+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5616bcf124e0 con 0x5616bcfe3fc0 2024-02-21T07:51:42.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.660+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600d6020 con 0x5616bcfe3fc0 2024-02-21T07:51:42.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8660050020 con 0x5616bcfe3fc0 2024-02-21T07:51:42.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 10 client.6316 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:42.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 10 client.6316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 20 client.6316 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa57d0 0x5616bcfa5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 4 client.6316 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:42.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.663+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616bcc50720 con 0x5616bcfa57d0 2024-02-21T07:51:42.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.665+0000 7f8675400640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa57d0 0x5616bcfa5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.666+0000 7f8675400640 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa57d0 0x5616bcfa5bb0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff7d37acedbd778 server_cookie=b2c2e81a691f6bb7 in_seq=0 out_seq=0 2024-02-21T07:51:42.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.666+0000 7f865b400640 10 client.6316 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.669+0000 7f865b400640 1 -- 172.21.15.100:0/2547139865 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5616bcc50720 con 0x5616bcfa57d0 2024-02-21T07:51:42.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.669+0000 7f865b400640 10 client.6316 handle_command_reply: tid=0 2024-02-21T07:51:42.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 client.6316 shutdown 2024-02-21T07:51:42.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 msgr2=0x5616bcfe3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86600c2270 tx=0x7f86600ba150 comp rx=0 tx=0).stop 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 shutdown_connections 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa57d0 0x5616bcfa5bb0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd019f80 0x5616bcfda1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 --2- 172.21.15.100:0/2547139865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bcfe3fc0 0x5616bcfe3730 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f86600c2270 tx=0x7f86600ba150 comp rx=0 tx=0).stop 2024-02-21T07:51:42.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 >> 172.21.15.100:0/2547139865 conn(0x5616bcf735a0 msgr2=0x5616bcfb22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.670+0000 7f865b400640 0 client.6316 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.671+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 shutdown_connections 2024-02-21T07:51:42.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.671+0000 7f867fb7a740 1 -- 172.21.15.100:0/2547139865 wait complete. 2024-02-21T07:51:42.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.671+0000 7f867fb7a740 20 client.6316 trim_cache size 0 max 16384 2024-02-21T07:51:42.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.704+0000 7f867fb7a740 1 Processor -- start 2024-02-21T07:51:42.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.704+0000 7f867fb7a740 1 -- start start 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bd0112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 0x5616bd07e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcfab060 con 0x5616bcfe48e0 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcfa5bb0 con 0x5616bd019f80 2024-02-21T07:51:42.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.706+0000 7f867fb7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bd025870 con 0x5616bd029260 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.707+0000 7f8675e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.707+0000 7f8676800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 0x5616bd07e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.707+0000 7f8676800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 0x5616bd07e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45466/0 (socket says 172.21.15.100:45466) 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.707+0000 7f8676800640 1 -- 172.21.15.100:0/75287787 learned_addr learned my addr 172.21.15.100:0/75287787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.707+0000 7f8675400640 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bd0112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.708+0000 7f8675e00640 1 -- 172.21.15.100:0/75287787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 msgr2=0x5616bd07e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.708+0000 7f8675e00640 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 0x5616bd07e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.708+0000 7f8675e00640 1 -- 172.21.15.100:0/75287787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 msgr2=0x5616bd0112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.708+0000 7f8675e00640 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bd0112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.708+0000 7f8675e00640 1 -- 172.21.15.100:0/75287787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616bceae950 con 0x5616bcfe48e0 2024-02-21T07:51:42.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.709+0000 7f8675e00640 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86600ba020 tx=0x7f86600b6460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93cb4b11c06e19a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.709+0000 7f8666000640 1 -- 172.21.15.100:0/75287787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600c27a0 con 0x5616bcfe48e0 2024-02-21T07:51:42.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.709+0000 7f8666000640 1 -- 172.21.15.100:0/75287787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600d6070 con 0x5616bcfe48e0 2024-02-21T07:51:42.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.710+0000 7f8666000640 1 -- 172.21.15.100:0/75287787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600b9700 con 0x5616bcfe48e0 2024-02-21T07:51:42.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.711+0000 7f867fb7a740 1 -- 172.21.15.100:0/75287787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 msgr2=0x5616bcfa81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.711+0000 7f867fb7a740 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86600ba020 tx=0x7f86600b6460 comp rx=0 tx=0).stop 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 -- 172.21.15.100:0/75287787 shutdown_connections 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bd029260 0x5616bd07e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bd0112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 --2- 172.21.15.100:0/75287787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 -- 172.21.15.100:0/75287787 >> 172.21.15.100:0/75287787 conn(0x5616bcf735a0 msgr2=0x5616bcfd9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 -- 172.21.15.100:0/75287787 shutdown_connections 2024-02-21T07:51:42.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.712+0000 7f867fb7a740 1 -- 172.21.15.100:0/75287787 wait complete. 2024-02-21T07:51:42.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.713+0000 7f867fb7a740 1 -- start start 2024-02-21T07:51:42.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.714+0000 7f867fb7a740 1 Processor -- start 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bd018110 con 0x5616bd029260 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcfd3400 con 0x5616bd019f80 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616bcfeb7c0 con 0x5616bcfe48e0 2024-02-21T07:51:42.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.716+0000 7f867fb7a740 10 client.0 _ll_register_callbacks cb 0x5616bd01f600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:42.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.717+0000 7f8676800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.717+0000 7f8676800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41328/0 (socket says 172.21.15.100:41328) 2024-02-21T07:51:42.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.717+0000 7f8676800640 1 -- 172.21.15.100:0/42636358 learned_addr learned my addr 172.21.15.100:0/42636358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:42.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.719+0000 7f8675e00640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675400640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675e00640 1 -- 172.21.15.100:0/42636358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 msgr2=0x5616bcfe43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675e00640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675e00640 1 -- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 msgr2=0x5616bd07b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675e00640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8675e00640 1 -- 172.21.15.100:0/42636358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86780cc290 con 0x5616bcfe48e0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.720+0000 7f8676800640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.721+0000 7f8675e00640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86600b9fd0 tx=0x7f8660006bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02da552a8ceb96f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.721+0000 7f865b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.721+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600c27a0 con 0x5616bcfe48e0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.721+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f86600d7080 con 0x5616bcfe48e0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.721+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86700149a0 con 0x5616bcfe48e0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.722+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86600b9e60 con 0x5616bcfe48e0 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.724+0000 7f867fb7a740 10 client.6290 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:42.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.724+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5616bced4430 con 0x5616bcfe48e0 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.725+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600dc080 con 0x5616bcfe48e0 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.725+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8660050070 con 0x5616bcfe48e0 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.725+0000 7f867fb7a740 10 client.6290 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.725+0000 7f867fb7a740 10 client.6290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.725+0000 7f867fb7a740 20 client.6290 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.726+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa5c20 0x5616bcfa6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.726+0000 7f867fb7a740 4 client.6290 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:51:42.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.726+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5616bcc9f890 con 0x5616bcfa5c20 2024-02-21T07:51:42.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.726+0000 7f8675400640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa5c20 0x5616bcfa6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:42.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.727+0000 7f865b400640 10 client.6290 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.731+0000 7f8675400640 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa5c20 0x5616bcfa6d00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd8279f30c536a5 server_cookie=41fb273097a86fcc in_seq=0 out_seq=0 2024-02-21T07:51:42.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.731+0000 7f865b400640 1 -- 172.21.15.100:0/42636358 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5616bcc9f890 con 0x5616bcfa5c20 2024-02-21T07:51:42.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.731+0000 7f865b400640 10 client.6290 handle_command_reply: tid=0 2024-02-21T07:51:42.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 client.6290 shutdown 2024-02-21T07:51:42.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 msgr2=0x5616bcfa81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86600b9fd0 tx=0x7f8660006bf0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 shutdown_connections 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5616bcfa5c20 0x5616bcfa6d00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5616bd029260 0x5616bd07b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616bd019f80 0x5616bcfe43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 --2- 172.21.15.100:0/42636358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5616bcfe48e0 0x5616bcfa81d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f865b400640 0 client.6290 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:42.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 >> 172.21.15.100:0/42636358 conn(0x5616bcf735a0 msgr2=0x5616bcfda0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.732+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 shutdown_connections 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.733+0000 7f867fb7a740 1 -- 172.21.15.100:0/42636358 wait complete. 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.733+0000 7f867fb7a740 20 client.6290 trim_cache size 0 max 16384 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout: "2cdbb18e-bcfa-478f-b5c5-cb6861d28953": { 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:51:42.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "2cdbb18e-bcfa-478f-b5c5-cb6861d28953", 2024-02-21T07:51:42.738 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:51:42.738 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:51:42.738 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:51:42.738 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 msgr2=0x7f86540a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 0x7f86540a16e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8668007fd0 tx=0x7f8668009040 comp rx=0 tx=0).stop 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 msgr2=0x7f867821b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86600090b0 tx=0x7f86600046c0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 shutdown_connections 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f86780f7be0 0x7f8678154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f865409f220 0x7f86540a16e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8678071930 0x7f86780cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 --2- 172.21.15.100:0/3452012438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8678071010 0x7f867821b910 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:42.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.734+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 >> 172.21.15.100:0/3452012438 conn(0x7f86780668b0 msgr2=0x7f867806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:42.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.735+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 shutdown_connections 2024-02-21T07:51:42.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:51:42.736+0000 7f867ce00640 1 -- 172.21.15.100:0/3452012438 wait complete. 2024-02-21T07:51:42.792 INFO:tasks.cephfs.filesystem:scrub status for tag:2cdbb18e-bcfa-478f-b5c5-cb6861d28953 - {'path': '/', 'tag': '2cdbb18e-bcfa-478f-b5c5-cb6861d28953', 'options': 'recursive,force'} 2024-02-21T07:51:44.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:44.613 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:44.615 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.702+0000 7ff561400640 1 Processor -- start 2024-02-21T07:51:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.702+0000 7ff561400640 1 -- start start 2024-02-21T07:51:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.712+0000 7ff561400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 0x7ff55c0f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.712+0000 7ff561400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff55c18a180 0x7ff55c160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.712+0000 7ff561400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55c0fa360 con 0x7ff55c189cd0 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.712+0000 7ff561400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c18cde0 con 0x7ff55c15d940 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.712+0000 7ff561400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55c0f9250 con 0x7ff55c18a180 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.713+0000 7ff55b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff55c18a180 0x7ff55c160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.713+0000 7ff55b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff55c18a180 0x7ff55c160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45472/0 (socket says 172.21.15.100:45472) 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.713+0000 7ff55b200640 1 -- 172.21.15.100:0/4249511648 learned_addr learned my addr 172.21.15.100:0/4249511648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.713+0000 7ff55a800640 1 --2- 172.21.15.100:0/4249511648 >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 0x7ff55c0f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff55b200640 1 -- 172.21.15.100:0/4249511648 >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 msgr2=0x7ff55c0f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff55b200640 1 --2- 172.21.15.100:0/4249511648 >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 0x7ff55c0f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff55b200640 1 -- 172.21.15.100:0/4249511648 >> v1:172.21.15.156:6789/0 conn(0x7ff55c189cd0 legacy=0x7ff55c160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff559400640 1 -- 172.21.15.100:0/4249511648 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524481930 0 0) 0x7ff55c0fa360 con 0x7ff55c189cd0 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff55b200640 1 -- 172.21.15.100:0/4249511648 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c18a5f0 con 0x7ff55c18a180 2024-02-21T07:51:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.714+0000 7ff55a800640 1 --2- 172.21.15.100:0/4249511648 >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 0x7ff55c0f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:51:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.716+0000 7ff55b200640 1 --2- 172.21.15.100:0/4249511648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c18a180 0x7ff55c160b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff55c1863b0 tx=0x7ff54c034150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d623c552356f0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.716+0000 7ff559400640 1 -- 172.21.15.100:0/4249511648 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c03c440 con 0x7ff55c18a180 2024-02-21T07:51:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.716+0000 7ff559400640 1 -- 172.21.15.100:0/4249511648 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54c03c5a0 con 0x7ff55c18a180 2024-02-21T07:51:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.716+0000 7ff559400640 1 -- 172.21.15.100:0/4249511648 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c03c930 con 0x7ff55c18a180 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.717+0000 7ff561400640 1 -- 172.21.15.100:0/4249511648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c18a180 msgr2=0x7ff55c160b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.717+0000 7ff561400640 1 --2- 172.21.15.100:0/4249511648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c18a180 0x7ff55c160b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff55c1863b0 tx=0x7ff54c034150 comp rx=0 tx=0).stop 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 -- 172.21.15.100:0/4249511648 shutdown_connections 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 --2- 172.21.15.100:0/4249511648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c18a180 0x7ff55c160b50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 --2- 172.21.15.100:0/4249511648 >> v2:172.21.15.100:3300/0 conn(0x7ff55c15d940 0x7ff55c0f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 -- 172.21.15.100:0/4249511648 >> 172.21.15.100:0/4249511648 conn(0x7ff55c08cfd0 msgr2=0x7ff55c08d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 -- 172.21.15.100:0/4249511648 shutdown_connections 2024-02-21T07:51:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.718+0000 7ff561400640 1 -- 172.21.15.100:0/4249511648 wait complete. 2024-02-21T07:51:48.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.722+0000 7ff561400640 1 Processor -- start 2024-02-21T07:51:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.723+0000 7ff561400640 1 -- start start 2024-02-21T07:51:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.726+0000 7ff561400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 0x7ff55c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.726+0000 7ff561400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 0x7ff55c18c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.727+0000 7ff561400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.727+0000 7ff561400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1603d0 con 0x7ff55c15d940 2024-02-21T07:51:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.727+0000 7ff561400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c17df90 con 0x7ff55c18a180 2024-02-21T07:51:48.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.728+0000 7ff561400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c1605e0 con 0x7ff55c189cd0 2024-02-21T07:51:48.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.728+0000 7ff55b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.728+0000 7ff55b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44138/0 (socket says 172.21.15.100:44138) 2024-02-21T07:51:48.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.728+0000 7ff55b200640 1 -- 172.21.15.100:0/3633049843 learned_addr learned my addr 172.21.15.100:0/3633049843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.728+0000 7ff55a800640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 0x7ff55c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.729+0000 7ff559e00640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 0x7ff55c18c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.730+0000 7ff55a800640 1 -- 172.21.15.100:0/3633049843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 msgr2=0x7ff55c18c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.731+0000 7ff55a800640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 0x7ff55c18c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.731+0000 7ff55a800640 1 -- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 msgr2=0x7ff55c182570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.731+0000 7ff55a800640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.731+0000 7ff55a800640 1 -- 172.21.15.100:0/3633049843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c0094d0 con 0x7ff55c15d940 2024-02-21T07:51:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.731+0000 7ff55b200640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.732+0000 7ff559e00640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 0x7ff55c18c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.732+0000 7ff55a800640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 0x7ff55c158d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff55400cdb0 tx=0x7ff55400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.733+0000 7ff552a00640 1 -- 172.21.15.100:0/3633049843 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400f680 con 0x7ff55c15d940 2024-02-21T07:51:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.734+0000 7ff552a00640 1 -- 172.21.15.100:0/3633049843 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55400f7e0 con 0x7ff55c15d940 2024-02-21T07:51:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.734+0000 7ff552a00640 1 -- 172.21.15.100:0/3633049843 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55400fb70 con 0x7ff55c15d940 2024-02-21T07:51:48.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.735+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c1608c0 con 0x7ff55c15d940 2024-02-21T07:51:48.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.736+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c160e80 con 0x7ff55c15d940 2024-02-21T07:51:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.747+0000 7ff552a00640 1 -- 172.21.15.100:0/3633049843 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff55400b040 con 0x7ff55c15d940 2024-02-21T07:51:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.756+0000 7ff552a00640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 0x7ff53c0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.758+0000 7ff559e00640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 0x7ff53c0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.759+0000 7ff552a00640 1 -- 172.21.15.100:0/3633049843 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff5540ca630 con 0x7ff55c15d940 2024-02-21T07:51:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.762+0000 7ff5641e0740 1 Processor -- start 2024-02-21T07:51:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.763+0000 7ff5641e0740 1 -- start start 2024-02-21T07:51:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.763+0000 7ff559e00640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 0x7ff53c0a15e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff55c181230 tx=0x7ff548009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.771+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b3ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.771+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.772+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b42e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.772+0000 7ff559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.772+0000 7ff559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45490/0 (socket says 172.21.15.100:45490) 2024-02-21T07:51:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.776+0000 7ff559e00640 1 -- 172.21.15.100:0/2060511189 learned_addr learned my addr 172.21.15.100:0/2060511189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.776+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b3ae620 con 0x563f0b42e070 2024-02-21T07:51:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.776+0000 7ff55a800640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b3ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.776+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b3608c0 con 0x563f0b3f2f90 2024-02-21T07:51:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.776+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b35ddf0 con 0x563f0b4624d0 2024-02-21T07:51:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.778+0000 7ff55b200640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b42e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.784+0000 7ff559e00640 1 -- 172.21.15.100:0/2060511189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 msgr2=0x563f0b42e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.787+0000 7ff559e00640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b42e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.787+0000 7ff559e00640 1 -- 172.21.15.100:0/2060511189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 msgr2=0x563f0b3ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.789+0000 7ff559e00640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b3ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.790+0000 7ff559e00640 1 -- 172.21.15.100:0/2060511189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0b2dab00 con 0x563f0b4624d0 2024-02-21T07:51:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.790+0000 7ff55b200640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b42e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:51:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.790+0000 7ff55a800640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b3ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.795+0000 7ff559e00640 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff548005130 tx=0x7ff548011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9732bd52ab8e99a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.796+0000 7ff547000640 1 -- 172.21.15.100:0/2060511189 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480035f0 con 0x563f0b4624d0 2024-02-21T07:51:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.797+0000 7ff547000640 1 -- 172.21.15.100:0/2060511189 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548003750 con 0x563f0b4624d0 2024-02-21T07:51:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.798+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 msgr2=0x563f0b3f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.798+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff548005130 tx=0x7ff548011000 comp rx=0 tx=0).stop 2024-02-21T07:51:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.801+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 shutdown_connections 2024-02-21T07:51:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.801+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b42e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.802+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b4624d0 0x563f0b3f2a50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.802+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2060511189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b3ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.802+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 >> 172.21.15.100:0/2060511189 conn(0x563f0b3ba4b0 msgr2=0x563f0b3f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.805+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 shutdown_connections 2024-02-21T07:51:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.806+0000 7ff5641e0740 1 -- 172.21.15.100:0/2060511189 wait complete. 2024-02-21T07:51:48.815 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.811+0000 7ff5641e0740 1 -- start start 2024-02-21T07:51:48.819 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.816+0000 7ff5641e0740 1 Processor -- start 2024-02-21T07:51:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 0x563f0b3ec7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b461430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 0x563f0b3ed880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b3595d0 con 0x563f0b42e070 2024-02-21T07:51:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b2feb50 con 0x563f0b4624d0 2024-02-21T07:51:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b2fe7f0 con 0x563f0b3f2f90 2024-02-21T07:51:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.826+0000 7ff5641e0740 10 client.0 _ll_register_callbacks cb 0x563f0b312550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.827+0000 7ff55a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 0x563f0b3ec7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.827+0000 7ff55a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 0x563f0b3ec7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45492/0 (socket says 172.21.15.100:45492) 2024-02-21T07:51:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.827+0000 7ff55a800640 1 -- 172.21.15.100:0/584848915 learned_addr learned my addr 172.21.15.100:0/584848915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.828+0000 7ff559e00640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b461430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.828+0000 7ff55b200640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 0x563f0b3ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.832+0000 7ff55b200640 1 -- 172.21.15.100:0/584848915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 msgr2=0x563f0b3ec7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.832+0000 7ff55b200640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 0x563f0b3ec7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.832+0000 7ff55b200640 1 -- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 msgr2=0x563f0b461430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.832+0000 7ff55b200640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b461430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.832+0000 7ff55b200640 1 -- 172.21.15.100:0/584848915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54800f040 con 0x563f0b4624d0 2024-02-21T07:51:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.833+0000 7ff559e00640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b461430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:51:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.836+0000 7ff53b400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:51:48.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.836+0000 7ff55b200640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 0x563f0b3ed880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff55c17cb20 tx=0x7ff54c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a9fba240e6df005 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.837+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54c046850 con 0x563f0b4624d0 2024-02-21T07:51:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.837+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff54c0469b0 con 0x563f0b4624d0 2024-02-21T07:51:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.838+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f0b32bcd0 con 0x563f0b4624d0 2024-02-21T07:51:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.842+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff54c046b70 con 0x563f0b4624d0 2024-02-21T07:51:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.842+0000 7ff5641e0740 10 client.6334 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.842+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563f0b357c50 con 0x563f0b4624d0 2024-02-21T07:51:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.843+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f0b32bcd0 con 0x563f0b4624d0 2024-02-21T07:51:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.843+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff54c046cd0 con 0x563f0b4624d0 2024-02-21T07:51:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 10 client.6334 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 10 client.6334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 20 client.6334 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b457d60 0x563f0b475eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 4 client.6334 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:51:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.845+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f0b34fce0 con 0x563f0b457d60 2024-02-21T07:51:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.846+0000 7ff55a800640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b457d60 0x563f0b475eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.849+0000 7ff55a800640 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b457d60 0x563f0b475eb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc572d7c2d7cfbef server_cookie=98608eb074eff85d in_seq=0 out_seq=0 2024-02-21T07:51:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff53b400640 10 client.6334 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff53b400640 1 -- 172.21.15.100:0/584848915 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f0b34fce0 con 0x563f0b457d60 2024-02-21T07:51:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff53b400640 10 client.6334 handle_command_reply: tid=0 2024-02-21T07:51:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff5641e0740 1 client.6334 shutdown 2024-02-21T07:51:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 msgr2=0x563f0b3ed880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.850+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 0x563f0b3ed880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff55c17cb20 tx=0x7ff54c004730 comp rx=0 tx=0).stop 2024-02-21T07:51:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 shutdown_connections 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b457d60 0x563f0b475eb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b4624d0 0x563f0b3ed880 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b42e070 0x563f0b461430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 --2- 172.21.15.100:0/584848915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b3f2f90 0x563f0b3ec7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.851+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 >> 172.21.15.100:0/584848915 conn(0x563f0b3ba4b0 msgr2=0x563f0b4628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.852+0000 7ff53b400640 0 client.6334 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.852+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 shutdown_connections 2024-02-21T07:51:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.852+0000 7ff5641e0740 1 -- 172.21.15.100:0/584848915 wait complete. 2024-02-21T07:51:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.852+0000 7ff5641e0740 20 client.6334 trim_cache size 0 max 16384 2024-02-21T07:51:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.883+0000 7ff5641e0740 1 Processor -- start 2024-02-21T07:51:48.886 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.883+0000 7ff5641e0740 1 -- start start 2024-02-21T07:51:48.888 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.885+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.885+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.885+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b42e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.886+0000 7ff5641e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b0a1e60 con 0x563f0b4624d0 2024-02-21T07:51:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.886+0000 7ff5641e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b42ed40 con 0x563f0b3f2f90 2024-02-21T07:51:48.889 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.886+0000 7ff5641e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b3eca00 con 0x563f0b42e070 2024-02-21T07:51:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.887+0000 7ff55a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.887+0000 7ff559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.887+0000 7ff559e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45504/0 (socket says 172.21.15.100:45504) 2024-02-21T07:51:48.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.887+0000 7ff559e00640 1 -- 172.21.15.100:0/2787299308 learned_addr learned my addr 172.21.15.100:0/2787299308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.891 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.888+0000 7ff559e00640 1 -- 172.21.15.100:0/2787299308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 msgr2=0x563f0b3f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.888+0000 7ff559e00640 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.888+0000 7ff559e00640 1 -- 172.21.15.100:0/2787299308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 msgr2=0x563f0b42e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.892 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.888+0000 7ff559e00640 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b42e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.888+0000 7ff559e00640 1 -- 172.21.15.100:0/2787299308 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0b2f4530 con 0x563f0b42e070 2024-02-21T07:51:48.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.890+0000 7ff559e00640 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff548005100 tx=0x7ff548005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91db487cdf7d4c4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.890+0000 7ff546600640 1 -- 172.21.15.100:0/2787299308 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548003750 con 0x563f0b42e070 2024-02-21T07:51:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.891+0000 7ff546600640 1 -- 172.21.15.100:0/2787299308 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff548026070 con 0x563f0b42e070 2024-02-21T07:51:48.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.891+0000 7ff546600640 1 -- 172.21.15.100:0/2787299308 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff548003750 con 0x563f0b42e070 2024-02-21T07:51:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.892+0000 7ff5641e0740 1 -- 172.21.15.100:0/2787299308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 msgr2=0x563f0b425300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.895 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.892+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff548005100 tx=0x7ff548005000 comp rx=0 tx=0).stop 2024-02-21T07:51:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.894+0000 7ff5641e0740 1 -- 172.21.15.100:0/2787299308 shutdown_connections 2024-02-21T07:51:48.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.894+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b42e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.894+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b425300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.894+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2787299308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3f86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.894+0000 7ff5641e0740 1 -- 172.21.15.100:0/2787299308 >> 172.21.15.100:0/2787299308 conn(0x563f0b3ba4b0 msgr2=0x563f0b41ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.896+0000 7ff5641e0740 1 -- 172.21.15.100:0/2787299308 shutdown_connections 2024-02-21T07:51:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.896+0000 7ff5641e0740 1 -- 172.21.15.100:0/2787299308 wait complete. 2024-02-21T07:51:48.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.897+0000 7ff5641e0740 1 -- start start 2024-02-21T07:51:48.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.898+0000 7ff5641e0740 1 Processor -- start 2024-02-21T07:51:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b42e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b472cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b42ebc0 con 0x563f0b4624d0 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b473720 con 0x563f0b3f2f90 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0b45e070 con 0x563f0b42e070 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.900+0000 7ff5641e0740 10 client.0 _ll_register_callbacks cb 0x7ff548001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.901+0000 7ff55a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.901+0000 7ff55a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3ee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:44190/0 (socket says 172.21.15.100:44190) 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.901+0000 7ff55a800640 1 -- 172.21.15.100:0/2928468930 learned_addr learned my addr 172.21.15.100:0/2928468930 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.901+0000 7ff559e00640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b42e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.901+0000 7ff55b200640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b472cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.902+0000 7ff559e00640 1 -- 172.21.15.100:0/2928468930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 msgr2=0x563f0b3ee5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.902+0000 7ff559e00640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3ee5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.902+0000 7ff559e00640 1 -- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 msgr2=0x563f0b472cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:51:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.902+0000 7ff559e00640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b472cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.902+0000 7ff559e00640 1 -- 172.21.15.100:0/2928468930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f0b2dab00 con 0x563f0b42e070 2024-02-21T07:51:48.907 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.903+0000 7ff559e00640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b42e680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff548001560 tx=0x7ff548007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6154661c52dea6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:51:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.903+0000 7ff53b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:51:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.903+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802d860 con 0x563f0b42e070 2024-02-21T07:51:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.903+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f0b37ed30 con 0x563f0b42e070 2024-02-21T07:51:48.908 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.903+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff54802d9c0 con 0x563f0b42e070 2024-02-21T07:51:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.905+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff54802db80 con 0x563f0b42e070 2024-02-21T07:51:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.905+0000 7ff5641e0740 10 client.6308 fetch_fsmap learned FSMap version 17 2024-02-21T07:51:48.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.905+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563f0b31a2c0 con 0x563f0b42e070 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.908+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f0b37ed30 con 0x563f0b42e070 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff54802b070 con 0x563f0b42e070 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 10 client.6308 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 10 client.6308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 20 client.6308 populate_metadata read hostname 'smithi100' 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b463ba0 0x563f0b41ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 4 client.6308 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:51:48.912 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563f0b059600 con 0x563f0b463ba0 2024-02-21T07:51:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.909+0000 7ff55a800640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b463ba0 0x563f0b41ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:51:48.913 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.910+0000 7ff55a800640 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b463ba0 0x563f0b41ea90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20036cf481bf4050 server_cookie=ff88f964753a5ccd in_seq=0 out_seq=0 2024-02-21T07:51:48.914 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.910+0000 7ff53b400640 10 client.6308 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.933+0000 7ff53b400640 1 -- 172.21.15.100:0/2928468930 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563f0b059600 con 0x563f0b463ba0 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.933+0000 7ff53b400640 10 client.6308 handle_command_reply: tid=0 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.933+0000 7ff5641e0740 1 client.6308 shutdown 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 msgr2=0x563f0b42e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b42e680 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff548001560 tx=0x7ff548007a00 comp rx=0 tx=0).stop 2024-02-21T07:51:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 shutdown_connections 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x563f0b463ba0 0x563f0b41ea90 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563f0b4624d0 0x563f0b472cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f0b42e070 0x563f0b42e680 secure :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff548001560 tx=0x7ff548007a00 comp rx=0 tx=0).stop 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 --2- 172.21.15.100:0/2928468930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f0b3f2f90 0x563f0b3ee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 >> 172.21.15.100:0/2928468930 conn(0x563f0b3ba4b0 msgr2=0x563f0b433960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff53b400640 0 client.6308 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 shutdown_connections 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 1 -- 172.21.15.100:0/2928468930 wait complete. 2024-02-21T07:51:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.934+0000 7ff5641e0740 20 client.6308 trim_cache size 0 max 16384 2024-02-21T07:51:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:51:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:51:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:51:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 msgr2=0x7ff53c0a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 0x7ff53c0a15e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff55c181230 tx=0x7ff548009040 comp rx=0 tx=0).stop 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 msgr2=0x7ff55c158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 0x7ff55c158d80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff55400cdb0 tx=0x7ff55400a650 comp rx=0 tx=0).stop 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 shutdown_connections 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff55c18a180 0x7ff55c182570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff55c189cd0 0x7ff55c18c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff53c09f120 0x7ff53c0a15e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 --2- 172.21.15.100:0/3633049843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff55c15d940 0x7ff55c158d80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 >> 172.21.15.100:0/3633049843 conn(0x7ff55c08cfd0 msgr2=0x7ff55c1865c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:51:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 shutdown_connections 2024-02-21T07:51:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:51:48.936+0000 7ff561400640 1 -- 172.21.15.100:0/3633049843 wait complete. 2024-02-21T07:52:02.128 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.124+0000 7fc73f400640 1 Processor -- start 2024-02-21T07:52:02.128 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.124+0000 7fc73f400640 1 -- start start 2024-02-21T07:52:02.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73f400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc7380f61d0 0x7fc7381901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc7381906e0 0x7fc738190b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73f400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380cc0e0 con 0x7fc73818a590 2024-02-21T07:52:02.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73f400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380cc380 con 0x7fc7381906e0 2024-02-21T07:52:02.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73f400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380cc660 con 0x7fc7380f61d0 2024-02-21T07:52:02.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc7381906e0 0x7fc738190b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc7381906e0 0x7fc738190b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54884/0 (socket says 172.21.15.100:54884) 2024-02-21T07:52:02.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.127+0000 7fc73d400640 1 -- 172.21.15.100:0/2050436028 learned_addr learned my addr 172.21.15.100:0/2050436028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.128+0000 7fc737e00640 1 --2- 172.21.15.100:0/2050436028 >> v2:172.21.15.156:3300/0 conn(0x7fc7380f61d0 0x7fc7381901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.129+0000 7fc73d400640 1 -- 172.21.15.100:0/2050436028 >> v2:172.21.15.156:3300/0 conn(0x7fc7380f61d0 msgr2=0x7fc7381901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.129+0000 7fc73d400640 1 --2- 172.21.15.100:0/2050436028 >> v2:172.21.15.156:3300/0 conn(0x7fc7380f61d0 0x7fc7381901a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.129+0000 7fc73d400640 1 -- 172.21.15.100:0/2050436028 >> v1:172.21.15.170:6789/0 conn(0x7fc73818a590 legacy=0x7fc7380cd420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.129+0000 7fc73d400640 1 -- 172.21.15.100:0/2050436028 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380cc940 con 0x7fc7381906e0 2024-02-21T07:52:02.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.130+0000 7fc73d400640 1 --2- 172.21.15.100:0/2050436028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738190b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc7380fad10 tx=0x7fc73002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6cf046cc7444e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.130+0000 7fc737400640 1 -- 172.21.15.100:0/2050436028 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730031750 con 0x7fc7381906e0 2024-02-21T07:52:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.130+0000 7fc737400640 1 -- 172.21.15.100:0/2050436028 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300318b0 con 0x7fc7381906e0 2024-02-21T07:52:02.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.130+0000 7fc737400640 1 -- 172.21.15.100:0/2050436028 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730031c40 con 0x7fc7381906e0 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 -- 172.21.15.100:0/2050436028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 msgr2=0x7fc738190b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 --2- 172.21.15.100:0/2050436028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738190b10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc7380fad10 tx=0x7fc73002b7f0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 -- 172.21.15.100:0/2050436028 shutdown_connections 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 --2- 172.21.15.100:0/2050436028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738190b10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 --2- 172.21.15.100:0/2050436028 >> v2:172.21.15.156:3300/0 conn(0x7fc7380f61d0 0x7fc7381901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 -- 172.21.15.100:0/2050436028 >> 172.21.15.100:0/2050436028 conn(0x7fc7380ce1b0 msgr2=0x7fc7380ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.131+0000 7fc73f400640 1 -- 172.21.15.100:0/2050436028 shutdown_connections 2024-02-21T07:52:02.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.132+0000 7fc73f400640 1 -- 172.21.15.100:0/2050436028 wait complete. 2024-02-21T07:52:02.137 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.134+0000 7fc73f400640 1 Processor -- start 2024-02-21T07:52:02.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.136+0000 7fc73f400640 1 -- start start 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 0x7fc73817aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73818a590 0x7fc738223cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73817a810 con 0x7fc7381906e0 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738179c40 con 0x7fc7380f61d0 2024-02-21T07:52:02.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.137+0000 7fc73f400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc738188c60 con 0x7fc73818a590 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.138+0000 7fc73d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.138+0000 7fc73d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54888/0 (socket says 172.21.15.100:54888) 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.138+0000 7fc73d400640 1 -- 172.21.15.100:0/3911939651 learned_addr learned my addr 172.21.15.100:0/3911939651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.139+0000 7fc73ca00640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 0x7fc73817aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.139+0000 7fc73d400640 1 -- 172.21.15.100:0/3911939651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73818a590 msgr2=0x7fc738223cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.139+0000 7fc73d400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73818a590 0x7fc738223cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.140+0000 7fc73d400640 1 -- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 msgr2=0x7fc73817aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.140+0000 7fc73d400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 0x7fc73817aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.140+0000 7fc73d400640 1 -- 172.21.15.100:0/3911939651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300094d0 con 0x7fc7381906e0 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.140+0000 7fc73ca00640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 0x7fc73817aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:02.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.141+0000 7fc73d400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc73002b830 tx=0x7fc7300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.141+0000 7fc734c00640 1 -- 172.21.15.100:0/3911939651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730033a70 con 0x7fc7381906e0 2024-02-21T07:52:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.141+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc738179ee0 con 0x7fc7381906e0 2024-02-21T07:52:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.141+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73817a4a0 con 0x7fc7381906e0 2024-02-21T07:52:02.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.141+0000 7fc734c00640 1 -- 172.21.15.100:0/3911939651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730033bd0 con 0x7fc7381906e0 2024-02-21T07:52:02.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.144+0000 7fc734c00640 1 -- 172.21.15.100:0/3911939651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73003c400 con 0x7fc7381906e0 2024-02-21T07:52:02.149 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.147+0000 7fc7421e0740 1 Processor -- start 2024-02-21T07:52:02.150 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.148+0000 7fc734c00640 1 -- 172.21.15.100:0/3911939651 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc73003a040 con 0x7fc7381906e0 2024-02-21T07:52:02.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.149+0000 7fc7421e0740 1 -- start start 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc734c00640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 0x7fc7180a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b153c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc734c00640 1 -- 172.21.15.100:0/3911939651 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc7300eb6b0 con 0x7fc7381906e0 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1541a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b14fd620 con 0x5639b157d070 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b14af8c0 con 0x5639b1541f90 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc7421e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b14acdf0 con 0x5639b15b14d0 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc73d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc73d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:57978/0 (socket says 172.21.15.100:57978) 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc73d400640 1 -- 172.21.15.100:0/2595178843 learned_addr learned my addr 172.21.15.100:0/2595178843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.150+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b153c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc737e00640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 0x7fc7180a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc737e00640 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1541a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc73d400640 1 -- 172.21.15.100:0/2595178843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 msgr2=0x5639b1541a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc73d400640 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1541a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc73d400640 1 -- 172.21.15.100:0/2595178843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 msgr2=0x5639b153c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc73d400640 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b153c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.152+0000 7fc73d400640 1 -- 172.21.15.100:0/2595178843 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639b1429b00 con 0x5639b1541f90 2024-02-21T07:52:02.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.153+0000 7fc73d400640 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc730036040 tx=0x7fc7300b8af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fcaf28b2ac8f818 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.153+0000 7fc737e00640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 0x7fc7180a1560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5639b153ffe0 tx=0x7fc724009550 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.154+0000 7fc729200640 1 -- 172.21.15.100:0/2595178843 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300bd120 con 0x5639b1541f90 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.154+0000 7fc729200640 1 -- 172.21.15.100:0/2595178843 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730033bd0 con 0x5639b1541f90 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.154+0000 7fc729200640 1 -- 172.21.15.100:0/2595178843 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300bd2e0 con 0x5639b1541f90 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.154+0000 7fc7421e0740 1 -- 172.21.15.100:0/2595178843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 msgr2=0x5639b157d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.154+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc730036040 tx=0x7fc7300b8af0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 -- 172.21.15.100:0/2595178843 shutdown_connections 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b157d450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1541a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2595178843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b153c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 -- 172.21.15.100:0/2595178843 >> 172.21.15.100:0/2595178843 conn(0x5639b15094b0 msgr2=0x5639b1540ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 -- 172.21.15.100:0/2595178843 shutdown_connections 2024-02-21T07:52:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.155+0000 7fc7421e0740 1 -- 172.21.15.100:0/2595178843 wait complete. 2024-02-21T07:52:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.156+0000 7fc7421e0740 1 -- start start 2024-02-21T07:52:02.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.156+0000 7fc7421e0740 1 Processor -- start 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b15820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b156ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1572e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b14a85d0 con 0x5639b157d070 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b144db50 con 0x5639b1541f90 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b144d7f0 con 0x5639b15b14d0 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc7421e0740 10 client.0 _ll_register_callbacks cb 0x5639b1461550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc737e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b156ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc73ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b15820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc737e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b156ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54904/0 (socket says 172.21.15.100:54904) 2024-02-21T07:52:02.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc737e00640 1 -- 172.21.15.100:0/3284600497 learned_addr learned my addr 172.21.15.100:0/3284600497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.158+0000 7fc73d400640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1572e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 -- 172.21.15.100:0/3284600497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 msgr2=0x5639b1572e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1572e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 -- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 msgr2=0x5639b156ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b156ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 -- 172.21.15.100:0/3284600497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73817a4a0 con 0x5639b1541f90 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc73ca00640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b15820d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00ce20 tx=0x7fc72c007680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07ceeefb2650613 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.159+0000 7fc71d600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.160+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c013040 con 0x5639b1541f90 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.160+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc72c017420 con 0x5639b1541f90 2024-02-21T07:52:02.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.160+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639b147acd0 con 0x5639b1541f90 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc72c009e60 con 0x5639b1541f90 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 10 client.6352 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5639b14a6c50 con 0x5639b1541f90 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639b147acd0 con 0x5639b1541f90 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc72c008040 con 0x5639b1541f90 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 10 client.6352 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:02.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 10 client.6352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 20 client.6352 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b15a67e0 0x5639b156e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 4 client.6352 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.161+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639b149ece0 con 0x5639b15a67e0 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.162+0000 7fc737e00640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b15a67e0 0x5639b156e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.163+0000 7fc71d600640 10 client.6352 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:02.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.163+0000 7fc737e00640 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b15a67e0 0x5639b156e340 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0285422eee693 server_cookie=6e8a0ccd98769588 in_seq=0 out_seq=0 2024-02-21T07:52:02.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.165+0000 7fc71d600640 1 -- 172.21.15.100:0/3284600497 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5639b149ece0 con 0x5639b15a67e0 2024-02-21T07:52:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.165+0000 7fc71d600640 10 client.6352 handle_command_reply: tid=0 2024-02-21T07:52:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.165+0000 7fc7421e0740 1 client.6352 shutdown 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 msgr2=0x5639b15820d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b15820d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00ce20 tx=0x7fc72c007680 comp rx=0 tx=0).stop 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 shutdown_connections 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b15a67e0 0x5639b156e340 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1572e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b157d070 0x5639b156ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 --2- 172.21.15.100:0/3284600497 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b1541f90 0x5639b15820d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc71d600640 0 client.6352 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 >> 172.21.15.100:0/3284600497 conn(0x5639b15094b0 msgr2=0x5639b15b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 shutdown_connections 2024-02-21T07:52:02.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 1 -- 172.21.15.100:0/3284600497 wait complete. 2024-02-21T07:52:02.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.166+0000 7fc7421e0740 20 client.6352 trim_cache size 0 max 16384 2024-02-21T07:52:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.183+0000 7fc7421e0740 1 Processor -- start 2024-02-21T07:52:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.183+0000 7fc7421e0740 1 -- start start 2024-02-21T07:52:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 0x5639b153dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b153d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b11f0e60 con 0x5639b1541f90 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b153ec60 con 0x5639b157d070 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.185+0000 7fc7421e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b15afe60 con 0x5639b15b14d0 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc73d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc73d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:51066/0 (socket says 172.21.15.100:51066) 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc73d400640 1 -- 172.21.15.100:0/2805559884 learned_addr learned my addr 172.21.15.100:0/2805559884 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc737e00640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b153d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 0x5639b153dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.186+0000 7fc73d400640 1 -- 172.21.15.100:0/2805559884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 msgr2=0x5639b153d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73d400640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b153d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73d400640 1 -- 172.21.15.100:0/2805559884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 msgr2=0x5639b153dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73d400640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 0x5639b153dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73d400640 1 -- 172.21.15.100:0/2805559884 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639b1443530 con 0x5639b15b14d0 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 0x5639b153dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.187+0000 7fc73d400640 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b55a0 tx=0x7fc7300d7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae55f2fc604881f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.189+0000 7fc71fe00640 1 -- 172.21.15.100:0/2805559884 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300bd120 con 0x5639b15b14d0 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.189+0000 7fc71fe00640 1 -- 172.21.15.100:0/2805559884 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730033bd0 con 0x5639b15b14d0 2024-02-21T07:52:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.189+0000 7fc71fe00640 1 -- 172.21.15.100:0/2805559884 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300c1930 con 0x5639b15b14d0 2024-02-21T07:52:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 -- 172.21.15.100:0/2805559884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 msgr2=0x5639b1581e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b55a0 tx=0x7fc7300d7000 comp rx=0 tx=0).stop 2024-02-21T07:52:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 -- 172.21.15.100:0/2805559884 shutdown_connections 2024-02-21T07:52:02.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b15b14d0 0x5639b1581e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b153d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2805559884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b1541f90 0x5639b153dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 -- 172.21.15.100:0/2805559884 >> 172.21.15.100:0/2805559884 conn(0x5639b15094b0 msgr2=0x5639b1541690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 -- 172.21.15.100:0/2805559884 shutdown_connections 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.190+0000 7fc7421e0740 1 -- 172.21.15.100:0/2805559884 wait complete. 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.191+0000 7fc7421e0740 1 -- start start 2024-02-21T07:52:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.191+0000 7fc7421e0740 1 Processor -- start 2024-02-21T07:52:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 0x5639b15af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b15b14d0 0x5639b1540f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b160d140 con 0x5639b15b14d0 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b161c6e0 con 0x5639b157d070 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639b1611c00 con 0x5639b1541f90 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc7421e0740 10 client.0 _ll_register_callbacks cb 0x7fc72c009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc737e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc73ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 0x5639b15af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc737e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:58004/0 (socket says 172.21.15.100:58004) 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc737e00640 1 -- 172.21.15.100:0/2284311165 learned_addr learned my addr 172.21.15.100:0/2284311165 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.193+0000 7fc73d400640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b15b14d0 0x5639b1540f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 -- 172.21.15.100:0/2284311165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 msgr2=0x5639b15af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 0x5639b15af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 -- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b15b14d0 msgr2=0x5639b1540f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b15b14d0 0x5639b1540f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 -- 172.21.15.100:0/2284311165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639b14a6c50 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 0x5639b15af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc737e00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5639b1572a00 tx=0x7fc724009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0a89df359a9d17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc71d600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.194+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724017900 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639b14cdd30 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc724027e40 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc724017a60 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc7421e0740 10 client.6358 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5639b1429b00 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639b14cdd30 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.195+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc724017bc0 con 0x5639b157d070 2024-02-21T07:52:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 10 client.6358 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 10 client.6358 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 20 client.6358 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b1581830 0x5639b1604530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 4 client.6358 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.196+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639b11a8600 con 0x5639b1581830 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.197+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b1581830 0x5639b1604530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.197+0000 7fc73ca00640 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b1581830 0x5639b1604530 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd86aea474501cc5 server_cookie=afd6c48abaaa7117 in_seq=0 out_seq=0 2024-02-21T07:52:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.197+0000 7fc71d600640 10 client.6358 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.217+0000 7fc71d600640 1 -- 172.21.15.100:0/2284311165 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639b11a8600 con 0x5639b1581830 2024-02-21T07:52:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.217+0000 7fc71d600640 10 client.6358 handle_command_reply: tid=0 2024-02-21T07:52:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.217+0000 7fc7421e0740 1 client.6358 shutdown 2024-02-21T07:52:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 msgr2=0x5639b160cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5639b1572a00 tx=0x7fc724009190 comp rx=0 tx=0).stop 2024-02-21T07:52:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 shutdown_connections 2024-02-21T07:52:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5639b1581830 0x5639b1604530 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639b15b14d0 0x5639b1540f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639b157d070 0x5639b160cc00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 --2- 172.21.15.100:0/2284311165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639b1541f90 0x5639b15af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 >> 172.21.15.100:0/2284311165 conn(0x5639b15094b0 msgr2=0x5639b15d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc71d600640 0 client.6358 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 shutdown_connections 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 1 -- 172.21.15.100:0/2284311165 wait complete. 2024-02-21T07:52:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.221+0000 7fc7421e0740 20 client.6358 trim_cache size 0 max 16384 2024-02-21T07:52:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:52:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:52:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:52:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 msgr2=0x7fc7180a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 0x7fc7180a1560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x5639b153ffe0 tx=0x7fc724009550 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 msgr2=0x7fc738222e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc73002b830 tx=0x7fc7300046c0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 shutdown_connections 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc71809f0a0 0x7fc7180a1560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7381906e0 0x7fc738222e20 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc73818a590 0x7fc738223cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 --2- 172.21.15.100:0/3911939651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7380f61d0 0x7fc73817aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.222+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 >> 172.21.15.100:0/3911939651 conn(0x7fc7380ce1b0 msgr2=0x7fc7380d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.223+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 shutdown_connections 2024-02-21T07:52:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:02.223+0000 7fc73f400640 1 -- 172.21.15.100:0/3911939651 wait complete. 2024-02-21T07:52:12.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:52:12.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:52:13.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.084+0000 7f1c69600640 1 Processor -- start 2024-02-21T07:52:13.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.085+0000 7f1c69600640 1 -- start start 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c69600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c641829b0 0x7f1c64188fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c69600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c641894f0 0x7f1c64070490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c69600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6408d920 con 0x7f1c640709d0 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c69600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6406bb70 con 0x7f1c641894f0 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c69600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6408d080 con 0x7f1c641829b0 2024-02-21T07:52:13.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c62a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1c641829b0 0x7f1c64188fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.086+0000 7f1c62000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c641894f0 0x7f1c64070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c63400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1c640709d0 0x7f1c6408bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:45276/0 (socket says 172.21.15.100:45276) 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c63400640 1 -- 172.21.15.100:0/3637765853 learned_addr learned my addr 172.21.15.100:0/3637765853 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c61600640 1 -- 172.21.15.100:0/3637765853 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671449186 0 0) 0x7f1c6408d920 con 0x7f1c640709d0 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c62000640 1 -- 172.21.15.100:0/3637765853 >> v2:172.21.15.156:3300/0 conn(0x7f1c641829b0 msgr2=0x7f1c64188fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c62000640 1 --2- 172.21.15.100:0/3637765853 >> v2:172.21.15.156:3300/0 conn(0x7f1c641829b0 0x7f1c64188fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c62000640 1 -- 172.21.15.100:0/3637765853 >> v1:172.21.15.156:6789/0 conn(0x7f1c640709d0 legacy=0x7f1c6408bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.087+0000 7f1c62000640 1 -- 172.21.15.100:0/3637765853 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6408d360 con 0x7f1c641894f0 2024-02-21T07:52:13.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.088+0000 7f1c62000640 1 --2- 172.21.15.100:0/3637765853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c641894f0 0x7f1c64070490 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c5002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e5d68b7b3c2f9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.088+0000 7f1c61600640 1 -- 172.21.15.100:0/3637765853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002f050 con 0x7f1c641894f0 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.088+0000 7f1c61600640 1 -- 172.21.15.100:0/3637765853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50031700 con 0x7f1c641894f0 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.088+0000 7f1c61600640 1 -- 172.21.15.100:0/3637765853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50031a90 con 0x7f1c641894f0 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 -- 172.21.15.100:0/3637765853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c641894f0 msgr2=0x7f1c64070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 --2- 172.21.15.100:0/3637765853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c641894f0 0x7f1c64070490 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c5002b7a0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 -- 172.21.15.100:0/3637765853 shutdown_connections 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 --2- 172.21.15.100:0/3637765853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c641894f0 0x7f1c64070490 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 --2- 172.21.15.100:0/3637765853 >> v2:172.21.15.156:3300/0 conn(0x7f1c641829b0 0x7f1c64188fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 -- 172.21.15.100:0/3637765853 >> 172.21.15.100:0/3637765853 conn(0x7f1c6406e380 msgr2=0x7f1c6406e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 -- 172.21.15.100:0/3637765853 shutdown_connections 2024-02-21T07:52:13.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.089+0000 7f1c69600640 1 -- 172.21.15.100:0/3637765853 wait complete. 2024-02-21T07:52:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.091+0000 7f1c69600640 1 Processor -- start 2024-02-21T07:52:13.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.091+0000 7f1c69600640 1 -- start start 2024-02-21T07:52:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c640709d0 0x7f1c64172340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 0x7f1c64186c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641874b0 con 0x7f1c640709d0 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64187790 con 0x7f1c641894f0 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.092+0000 7f1c69600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64187a70 con 0x7f1c641829b0 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c640709d0 0x7f1c64172340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58494/0 (socket says 172.21.15.100:58494) 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 -- 172.21.15.100:0/2870046889 learned_addr learned my addr 172.21.15.100:0/2870046889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c63400640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 0x7f1c64186c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 -- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 msgr2=0x7f1c64186c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 0x7f1c64186c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 -- 172.21.15.100:0/2870046889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c640709d0 msgr2=0x7f1c64172340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c640709d0 0x7f1c64172340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 -- 172.21.15.100:0/2870046889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009400 con 0x7f1c641829b0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c63400640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 0x7f1c64186c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.093+0000 7f1c62000640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.094+0000 7f1c5aa00640 1 -- 172.21.15.100:0/2870046889 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50004030 con 0x7f1c641829b0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.094+0000 7f1c5aa00640 1 -- 172.21.15.100:0/2870046889 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50004190 con 0x7f1c641829b0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.094+0000 7f1c5aa00640 1 -- 172.21.15.100:0/2870046889 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c500339b0 con 0x7f1c641829b0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.094+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64187d50 con 0x7f1c641829b0 2024-02-21T07:52:13.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.094+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64188310 con 0x7f1c641829b0 2024-02-21T07:52:13.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.097+0000 7f1c5aa00640 1 -- 172.21.15.100:0/2870046889 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1c5003a050 con 0x7f1c641829b0 2024-02-21T07:52:13.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.098+0000 7f1c6c38c740 1 Processor -- start 2024-02-21T07:52:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.099+0000 7f1c6c38c740 1 -- start start 2024-02-21T07:52:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.099+0000 7f1c5aa00640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 0x7f1c440a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.099+0000 7f1c5aa00640 1 -- 172.21.15.100:0/2870046889 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1c500eb4f0 con 0x7f1c641829b0 2024-02-21T07:52:13.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c63400640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 0x7f1c440a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 0x555b1112cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b110a1150 con 0x555b11169fc0 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1109e680 con 0x555b1116a8e0 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.100+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b11099e60 con 0x555b1119ff80 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c63400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 0x555b1112cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58496/0 (socket says 172.21.15.100:58496) 2024-02-21T07:52:13.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c63400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 0x555b1112cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45530/0 (socket says 172.21.15.100:45530) 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 -- 172.21.15.100:0/1712745833 learned_addr learned my addr 172.21.15.100:0/1712745833 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c63400640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 0x7f1c440a1590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007f30 tx=0x7f1c5c007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 -- 172.21.15.100:0/1712745833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 msgr2=0x555b1112cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 0x555b1112cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 -- 172.21.15.100:0/1712745833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 msgr2=0x555b1119fa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62a00640 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62000640 1 -- 172.21.15.100:0/1712745833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b11053060 con 0x555b1119ff80 2024-02-21T07:52:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.101+0000 7f1c62a00640 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:13.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.102+0000 7f1c62000640 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c500e8dd0 tx=0x7f1c500b8930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd5dedad0e052d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.102+0000 7f1c4f000640 1 -- 172.21.15.100:0/1712745833 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002f020 con 0x555b1119ff80 2024-02-21T07:52:13.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.102+0000 7f1c4f000640 1 -- 172.21.15.100:0/1712745833 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500bd120 con 0x555b1119ff80 2024-02-21T07:52:13.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.102+0000 7f1c4f000640 1 -- 172.21.15.100:0/1712745833 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c500c1770 con 0x555b1119ff80 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 -- 172.21.15.100:0/1712745833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 msgr2=0x555b1116a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c500e8dd0 tx=0x7f1c500b8930 comp rx=0 tx=0).stop 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 -- 172.21.15.100:0/1712745833 shutdown_connections 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1116a8e0 0x555b1112cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1119ff80 0x555b1116a3a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/1712745833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 -- 172.21.15.100:0/1712745833 >> 172.21.15.100:0/1712745833 conn(0x555b110f95a0 msgr2=0x555b11130eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 -- 172.21.15.100:0/1712745833 shutdown_connections 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.103+0000 7f1c6c38c740 1 -- 172.21.15.100:0/1712745833 wait complete. 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.104+0000 7f1c6c38c740 1 -- start start 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.104+0000 7f1c6c38c740 1 Processor -- start 2024-02-21T07:52:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b1116a8e0 0x555b11161940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b11196690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1103eec0 con 0x555b1116a8e0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1103eb60 con 0x555b1119ff80 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b10e081c0 con 0x555b11169fc0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c6c38c740 10 client.0 _ll_register_callbacks cb 0x555b11052960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58498/0 (socket says 172.21.15.100:58498) 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 -- 172.21.15.100:0/3158851661 learned_addr learned my addr 172.21.15.100:0/3158851661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62000640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b1116a8e0 0x555b11161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c63400640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b11196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 -- 172.21.15.100:0/3158851661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 msgr2=0x555b11196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b11196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 -- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b1116a8e0 msgr2=0x555b11161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b1116a8e0 0x555b11161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.106+0000 7f1c62a00640 1 -- 172.21.15.100:0/3158851661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64188310 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fb0 tx=0x7f1c54013770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbf49a3f7fa5e2d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54016670 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b10d997e0 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1c540167d0 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c54016990 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c6c38c740 10 client.6326 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555b110984e0 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555b10d997e0 con 0x555b11169fc0 2024-02-21T07:52:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.107+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1c54016af0 con 0x555b11169fc0 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 10 client.6326 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 10 client.6326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 20 client.6326 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b111b4d60 0x555b111b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 4 client.6326 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b10dd6720 con 0x555b111b4d60 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c62000640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b111b4d60 0x555b111b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c62000640 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b111b4d60 0x555b111b5170 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb8ad03b7ed8ce5 server_cookie=b44b170c0a829398 in_seq=0 out_seq=0 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.108+0000 7f1c43400640 10 client.6326 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c43400640 1 -- 172.21.15.100:0/3158851661 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555b10dd6720 con 0x555b111b4d60 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c43400640 10 client.6326 handle_command_reply: tid=0 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 client.6326 shutdown 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 msgr2=0x555b111af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009fb0 tx=0x7f1c54013770 comp rx=0 tx=0).stop 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 shutdown_connections 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b111b4d60 0x555b111b5170 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b11196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b1116a8e0 0x555b11161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3158851661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b11169fc0 0x555b111af850 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c43400640 0 client.6326 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 >> 172.21.15.100:0/3158851661 conn(0x555b110f95a0 msgr2=0x555b111a1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 shutdown_connections 2024-02-21T07:52:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3158851661 wait complete. 2024-02-21T07:52:13.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.109+0000 7f1c6c38c740 20 client.6326 trim_cache size 0 max 16384 2024-02-21T07:52:13.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.131+0000 7f1c6c38c740 1 Processor -- start 2024-02-21T07:52:13.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.131+0000 7f1c6c38c740 1 -- start start 2024-02-21T07:52:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b1115f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b1112bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b11053eb0 con 0x555b11169fc0 2024-02-21T07:52:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b111975f0 con 0x555b1119ff80 2024-02-21T07:52:13.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.134+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b111b0c00 con 0x555b1116a8e0 2024-02-21T07:52:13.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.135+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.135+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55880/0 (socket says 172.21.15.100:55880) 2024-02-21T07:52:13.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.135+0000 7f1c62a00640 1 -- 172.21.15.100:0/3312684539 learned_addr learned my addr 172.21.15.100:0/3312684539 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.136+0000 7f1c62000640 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b1115f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.137+0000 7f1c62a00640 1 -- 172.21.15.100:0/3312684539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 msgr2=0x555b1115f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.137+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b1115f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.137+0000 7f1c62a00640 1 -- 172.21.15.100:0/3312684539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 msgr2=0x555b1112bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.137+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b1112bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.137+0000 7f1c62a00640 1 -- 172.21.15.100:0/3312684539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b11034950 con 0x555b11169fc0 2024-02-21T07:52:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.139+0000 7f1c62a00640 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c54025040 tx=0x7f1c54018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3292301d6f2c33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.140+0000 7f1c4e600640 1 -- 172.21.15.100:0/3312684539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54004230 con 0x555b11169fc0 2024-02-21T07:52:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.140+0000 7f1c4e600640 1 -- 172.21.15.100:0/3312684539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54004390 con 0x555b11169fc0 2024-02-21T07:52:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.140+0000 7f1c4e600640 1 -- 172.21.15.100:0/3312684539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54004230 con 0x555b11169fc0 2024-02-21T07:52:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3312684539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 msgr2=0x555b1119da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c54025040 tx=0x7f1c54018000 comp rx=0 tx=0).stop 2024-02-21T07:52:13.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3312684539 shutdown_connections 2024-02-21T07:52:13.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b1112bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b1115f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/3312684539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11169fc0 0x555b1119da90 secure :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c54025040 tx=0x7f1c54018000 comp rx=0 tx=0).stop 2024-02-21T07:52:13.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.141+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3312684539 >> 172.21.15.100:0/3312684539 conn(0x555b110f95a0 msgr2=0x555b11161800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.142+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3312684539 shutdown_connections 2024-02-21T07:52:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.142+0000 7f1c6c38c740 1 -- 172.21.15.100:0/3312684539 wait complete. 2024-02-21T07:52:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.143+0000 7f1c6c38c740 1 -- start start 2024-02-21T07:52:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.143+0000 7f1c6c38c740 1 Processor -- start 2024-02-21T07:52:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b111c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b111b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b111a10b0 con 0x555b11197b70 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b1115efd0 con 0x555b1119ff80 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b11203dd0 con 0x555b1116a8e0 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.145+0000 7f1c6c38c740 10 client.0 _ll_register_callbacks cb 0x7f1c54009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c62a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b111c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55884/0 (socket says 172.21.15.100:55884) 2024-02-21T07:52:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 -- 172.21.15.100:0/2704597002 learned_addr learned my addr 172.21.15.100:0/2704597002 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 -- 172.21.15.100:0/2704597002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 msgr2=0x555b111c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b111c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 -- 172.21.15.100:0/2704597002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 msgr2=0x555b111b0e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b111b0e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.146+0000 7f1c63400640 1 -- 172.21.15.100:0/2704597002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b110984e0 con 0x555b11197b70 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.147+0000 7f1c63400640 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c004d70 tx=0x7f1c5c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3098d804431501 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.147+0000 7f1c43400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.148+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c014e40 con 0x555b11197b70 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.148+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1c5c01ed00 con 0x555b11197b70 2024-02-21T07:52:13.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.148+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c500bd120 con 0x555b11197b70 2024-02-21T07:52:13.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.149+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5c01eec0 con 0x555b11197b70 2024-02-21T07:52:13.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.149+0000 7f1c6c38c740 10 client.6192 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:13.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.149+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555b1105a430 con 0x555b11197b70 2024-02-21T07:52:13.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.149+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500bd120 con 0x555b11197b70 2024-02-21T07:52:13.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.150+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1c5c026020 con 0x555b11197b70 2024-02-21T07:52:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.150+0000 7f1c6c38c740 10 client.6192 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c6c38c740 10 client.6192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c6c38c740 20 client.6192 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:13.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b11167300 0x555b11210100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c6c38c740 4 client.6192 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555b10e25890 con 0x555b11167300 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.151+0000 7f1c62a00640 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b11167300 0x555b11210100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.152+0000 7f1c62a00640 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b11167300 0x555b11210100 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db1978035dd4f3a server_cookie=8bd054aa058dd219 in_seq=0 out_seq=0 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.152+0000 7f1c43400640 10 client.6192 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:13.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.152+0000 7f1c43400640 1 -- 172.21.15.100:0/2704597002 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555b10e25890 con 0x555b11167300 2024-02-21T07:52:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.152+0000 7f1c43400640 10 client.6192 handle_command_reply: tid=0 2024-02-21T07:52:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.152+0000 7f1c6c38c740 1 client.6192 shutdown 2024-02-21T07:52:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.153+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 msgr2=0x555b11203890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.153+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c004d70 tx=0x7f1c5c001250 comp rx=0 tx=0).stop 2024-02-21T07:52:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 shutdown_connections 2024-02-21T07:52:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555b11167300 0x555b11210100 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555b11197b70 0x555b11203890 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b1119ff80 0x555b111b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 --2- 172.21.15.100:0/2704597002 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555b1116a8e0 0x555b111c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 >> 172.21.15.100:0/2704597002 conn(0x555b110f95a0 msgr2=0x555b11166120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c43400640 0 client.6192 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 shutdown_connections 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 1 -- 172.21.15.100:0/2704597002 wait complete. 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.155+0000 7f1c6c38c740 20 client.6192 trim_cache size 0 max 16384 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:52:13.159 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 msgr2=0x7f1c440a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 0x7f1c440a1590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007f30 tx=0x7f1c5c007e80 comp rx=0 tx=0).stop 2024-02-21T07:52:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 msgr2=0x7f1c64186700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c500097a0 tx=0x7f1c500046c0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 shutdown_connections 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1c641894f0 0x7f1c64186c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1c641829b0 0x7f1c64186700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1c4409f0d0 0x7f1c440a1590 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 --2- 172.21.15.100:0/2870046889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c640709d0 0x7f1c64172340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 >> 172.21.15.100:0/2870046889 conn(0x7f1c6406e380 msgr2=0x7f1c64188a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 shutdown_connections 2024-02-21T07:52:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.156+0000 7f1c69600640 1 -- 172.21.15.100:0/2870046889 wait complete. 2024-02-21T07:52:13.175 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:52:13.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:52:13.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.463+0000 7f5d43e00640 1 Processor -- start 2024-02-21T07:52:13.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.463+0000 7f5d43e00640 1 -- start start 2024-02-21T07:52:13.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.476+0000 7f5d42000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5d4406c920 0x7f5d4418ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:46038/0 (socket says 172.21.15.100:46038) 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.477+0000 7f5d42a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5d44186bd0 0x7f5d4418e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53984/0 (socket says 172.21.15.100:53984) 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.477+0000 7f5d42a00640 1 -- 172.21.15.100:0/1019434936 learned_addr learned my addr 172.21.15.100:0/1019434936 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.477+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d440d6990 con 0x7f5d44186bd0 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.477+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4406b880 con 0x7f5d4418d5a0 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.477+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4406bb60 con 0x7f5d4406c920 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1851392216 0 0) 0x7f5d440d6990 con 0x7f5d44186bd0 2024-02-21T07:52:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d28003520 con 0x7f5d44186bd0 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925536288 0 0) 0x7f5d28003520 con 0x7f5d44186bd0 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 >> v1:172.21.15.170:6789/0 conn(0x7f5d4406c920 legacy=0x7f5d4418ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 >> v1:172.21.15.156:6789/0 conn(0x7f5d4418d5a0 legacy=0x7f5d440d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4406be40 con 0x7f5d44186bd0 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f5d3c0019f0 con 0x7f5d44186bd0 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 >> v1:172.21.15.100:6789/0 conn(0x7f5d44186bd0 legacy=0x7f5d4418e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d28003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d280047c0 0x7f5d28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d28009970 0x7f5d2800bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2800c350 con 0x7f5d28003ab0 2024-02-21T07:52:13.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2800c490 con 0x7f5d28009970 2024-02-21T07:52:13.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.478+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2800c650 con 0x7f5d280047c0 2024-02-21T07:52:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.479+0000 7f5d43400640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d28009970 0x7f5d2800bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.479+0000 7f5d42000640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d280047c0 0x7f5d28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.480+0000 7f5d42a00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d28003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d42a00640 1 -- 172.21.15.100:0/1019434936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d280047c0 msgr2=0x7f5d28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d42a00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d280047c0 0x7f5d28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d42a00640 1 -- 172.21.15.100:0/1019434936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d28009970 msgr2=0x7f5d2800bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d42a00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d28009970 0x7f5d2800bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d42a00640 1 -- 172.21.15.100:0/1019434936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28003520 con 0x7f5d28003ab0 2024-02-21T07:52:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.481+0000 7f5d43400640 1 -- 172.21.15.100:0/1019434936 reap_dead start 2024-02-21T07:52:13.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.483+0000 7f5d42a00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d28003e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00a370 tx=0x7f5d280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3707c7a6e397029 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.483+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c045620 con 0x7f5d28003ab0 2024-02-21T07:52:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.483+0000 7f5d41600640 1 -- 172.21.15.100:0/1019434936 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c045780 con 0x7f5d28003ab0 2024-02-21T07:52:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.485+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 msgr2=0x7f5d28003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.485+0000 7f5d43e00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d28003e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00a370 tx=0x7f5d280057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.487+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 shutdown_connections 2024-02-21T07:52:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.487+0000 7f5d43e00640 1 --2- 172.21.15.100:0/1019434936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d28003e90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.487+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 >> 172.21.15.100:0/1019434936 conn(0x7f5d440fdf30 msgr2=0x7f5d440fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:13.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.488+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 shutdown_connections 2024-02-21T07:52:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.489+0000 7f5d43e00640 1 -- 172.21.15.100:0/1019434936 wait complete. 2024-02-21T07:52:13.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.500+0000 7f5d43e00640 1 Processor -- start 2024-02-21T07:52:13.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.501+0000 7f5d43e00640 1 -- start start 2024-02-21T07:52:13.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.514+0000 7f5d43e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.520+0000 7f5d42a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.520+0000 7f5d42a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55908/0 (socket says 172.21.15.100:55908) 2024-02-21T07:52:13.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.520+0000 7f5d42a00640 1 -- 172.21.15.100:0/3971369575 learned_addr learned my addr 172.21.15.100:0/3971369575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.523+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d440f70d0 0x7f5d44166760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.523+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d44166ca0 0x7f5d4421a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.523+0000 7f5d42000640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d440f70d0 0x7f5d44166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.523+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440f7710 con 0x7f5d28003ab0 2024-02-21T07:52:13.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.525+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440f79f0 con 0x7f5d440f70d0 2024-02-21T07:52:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.525+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d440f7cd0 con 0x7f5d44166ca0 2024-02-21T07:52:13.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.525+0000 7f5d43400640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d44166ca0 0x7f5d4421a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.537+0000 7f5d42a00640 1 -- 172.21.15.100:0/3971369575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d44166ca0 msgr2=0x7f5d4421a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.537+0000 7f5d42a00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d44166ca0 0x7f5d4421a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.537+0000 7f5d42a00640 1 -- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d440f70d0 msgr2=0x7f5d44166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.537+0000 7f5d42a00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d440f70d0 0x7f5d44166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:13.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.537+0000 7f5d42a00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440f7fb0 con 0x7f5d28003ab0 2024-02-21T07:52:13.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.544+0000 7f5d42a00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c03de10 tx=0x7f5d4406c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.548+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c001970 con 0x7f5d28003ab0 2024-02-21T07:52:13.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.549+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0458f0 con 0x7f5d28003ab0 2024-02-21T07:52:13.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.549+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c045c60 con 0x7f5d28003ab0 2024-02-21T07:52:13.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.551+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4416ec00 con 0x7f5d28003ab0 2024-02-21T07:52:13.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.551+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d44167120 con 0x7f5d28003ab0 2024-02-21T07:52:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.569+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c005290 con 0x7f5d28003ab0 2024-02-21T07:52:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.572+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5d3c045420 con 0x7f5d28003ab0 2024-02-21T07:52:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.575+0000 7f5d3aa00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 0x7f5d240a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.575+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5d3c041070 con 0x7f5d28003ab0 2024-02-21T07:52:13.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.578+0000 7f5d42000640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 0x7f5d240a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:13.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.580+0000 7f5d42000640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 0x7f5d240a16b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d4418d570 tx=0x7f5d30007cf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:13.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:13.587+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d3c0c7630 con 0x7f5d28003ab0 2024-02-21T07:52:14.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.145+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d1c005ac0 con 0x7f5d28003ab0 2024-02-21T07:52:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.150+0000 7f5d3aa00640 1 -- 172.21.15.100:0/3971369575 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f5d3c00a3b0 con 0x7f5d28003ab0 2024-02-21T07:52:14.153 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:52:14.153 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:52:14.153 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:52:14.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.155+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 msgr2=0x7f5d240a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.155+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 0x7f5d240a16b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5d4418d570 tx=0x7f5d30007cf0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.158+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 msgr2=0x7f5d440f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.158+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c03de10 tx=0x7f5d4406c400 comp rx=0 tx=0).stop 2024-02-21T07:52:14.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.158+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 shutdown_connections 2024-02-21T07:52:14.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.158+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d44166ca0 0x7f5d4421a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.159+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d440f70d0 0x7f5d44166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.159+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d2409f1f0 0x7f5d240a16b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.159+0000 7f5d43e00640 1 --2- 172.21.15.100:0/3971369575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d28003ab0 0x7f5d440f6b90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.159+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 >> 172.21.15.100:0/3971369575 conn(0x7f5d440fdf30 msgr2=0x7f5d44175510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.159+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 shutdown_connections 2024-02-21T07:52:14.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.160+0000 7f5d43e00640 1 -- 172.21.15.100:0/3971369575 wait complete. 2024-02-21T07:52:14.192 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:14.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:52:14.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.563+0000 7f3539c00640 1 Processor -- start 2024-02-21T07:52:14.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.564+0000 7f3539c00640 1 -- start start 2024-02-21T07:52:14.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.566+0000 7f3539c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f353418c740 0x7f3534072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.566+0000 7f3539c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353418aa60 con 0x7f35341685e0 2024-02-21T07:52:14.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.566+0000 7f3539c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353418acb0 con 0x7f35341689c0 2024-02-21T07:52:14.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.566+0000 7f3539c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353418af90 con 0x7f353418c740 2024-02-21T07:52:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.567+0000 7f3533400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f353418c740 0x7f3534072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.567+0000 7f3539200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f35341689c0 0x7f3534193450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:46044/0 (socket says 172.21.15.100:46044) 2024-02-21T07:52:14.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.567+0000 7f3539200640 1 -- 172.21.15.100:0/1175152814 learned_addr learned my addr 172.21.15.100:0/1175152814 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:14.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.567+0000 7f3533e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f35341685e0 0x7f353418c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54000/0 (socket says 172.21.15.100:54000) 2024-02-21T07:52:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.569+0000 7f3532a00640 1 -- 172.21.15.100:0/1175152814 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202966060 0 0) 0x7f353418aa60 con 0x7f35341685e0 2024-02-21T07:52:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.569+0000 7f3533400640 1 -- 172.21.15.100:0/1175152814 >> v1:172.21.15.170:6789/0 conn(0x7f35341689c0 legacy=0x7f3534193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.569+0000 7f3533400640 1 -- 172.21.15.100:0/1175152814 >> v1:172.21.15.100:6789/0 conn(0x7f35341685e0 legacy=0x7f353418c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.569+0000 7f3533400640 1 -- 172.21.15.100:0/1175152814 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353418b270 con 0x7f353418c740 2024-02-21T07:52:14.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.571+0000 7f3533400640 1 --2- 172.21.15.100:0/1175152814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353418c740 0x7f3534072400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3520009720 tx=0x7f352002b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6d3441ed52b831 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.571+0000 7f3532a00640 1 -- 172.21.15.100:0/1175152814 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352002bea0 con 0x7f353418c740 2024-02-21T07:52:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.571+0000 7f3532a00640 1 -- 172.21.15.100:0/1175152814 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352002e050 con 0x7f353418c740 2024-02-21T07:52:14.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.571+0000 7f3532a00640 1 -- 172.21.15.100:0/1175152814 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520030930 con 0x7f353418c740 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 -- 172.21.15.100:0/1175152814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353418c740 msgr2=0x7f3534072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 --2- 172.21.15.100:0/1175152814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353418c740 0x7f3534072400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3520009720 tx=0x7f352002b620 comp rx=0 tx=0).stop 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 -- 172.21.15.100:0/1175152814 shutdown_connections 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 --2- 172.21.15.100:0/1175152814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f353418c740 0x7f3534072400 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 -- 172.21.15.100:0/1175152814 >> 172.21.15.100:0/1175152814 conn(0x7f35340d0900 msgr2=0x7f35340d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 -- 172.21.15.100:0/1175152814 shutdown_connections 2024-02-21T07:52:14.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.572+0000 7f3539c00640 1 -- 172.21.15.100:0/1175152814 wait complete. 2024-02-21T07:52:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.574+0000 7f3539c00640 1 Processor -- start 2024-02-21T07:52:14.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.574+0000 7f3539c00640 1 -- start start 2024-02-21T07:52:14.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35341685e0 0x7f3534223fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 0x7f3534224520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 0x7f3534183750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353408d4c0 con 0x7f35341689c0 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534224a60 con 0x7f35341685e0 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.575+0000 7f3539c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353408d8e0 con 0x7f353418c740 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.576+0000 7f3533400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 0x7f3534224520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.576+0000 7f3539200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 0x7f3534183750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.576+0000 7f3539200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 0x7f3534183750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58552/0 (socket says 172.21.15.100:58552) 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.576+0000 7f3539200640 1 -- 172.21.15.100:0/776600315 learned_addr learned my addr 172.21.15.100:0/776600315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:14.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.576+0000 7f3533e00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35341685e0 0x7f3534223fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 -- 172.21.15.100:0/776600315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 msgr2=0x7f3534183750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 0x7f3534183750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 -- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35341685e0 msgr2=0x7f3534223fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35341685e0 0x7f3534223fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 -- 172.21.15.100:0/776600315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009400 con 0x7f35341689c0 2024-02-21T07:52:14.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.577+0000 7f3533400640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 0x7f3534224520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3520032000 tx=0x7f35200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.578+0000 7f352be00640 1 -- 172.21.15.100:0/776600315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520032950 con 0x7f35341689c0 2024-02-21T07:52:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.578+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353408c560 con 0x7f35341689c0 2024-02-21T07:52:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.578+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353408cb20 con 0x7f35341689c0 2024-02-21T07:52:14.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.579+0000 7f352be00640 1 -- 172.21.15.100:0/776600315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3520032ab0 con 0x7f35341689c0 2024-02-21T07:52:14.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.579+0000 7f352be00640 1 -- 172.21.15.100:0/776600315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520032e60 con 0x7f35341689c0 2024-02-21T07:52:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.584+0000 7f352be00640 1 -- 172.21.15.100:0/776600315 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3520039040 con 0x7f35341689c0 2024-02-21T07:52:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.586+0000 7f352be00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 0x7f35140a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.586+0000 7f352be00640 1 -- 172.21.15.100:0/776600315 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f35200eb1a0 con 0x7f35341689c0 2024-02-21T07:52:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.589+0000 7f3533e00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 0x7f35140a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.592+0000 7f3533e00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 0x7f35140a1590 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3524007b50 tx=0x7f3524007aa0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.597+0000 7f353de65740 1 Processor -- start 2024-02-21T07:52:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.597+0000 7f353de65740 1 -- start start 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 0x564daee0a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee45200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 0x564daee464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daed3d210 con 0x564daee0a990 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daed3a740 con 0x564daee45740 2024-02-21T07:52:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f353de65740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daed35f20 con 0x564daee0a070 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f3533e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 0x564daee0a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f3533e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 0x564daee0a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58566/0 (socket says 172.21.15.100:58566) 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.600+0000 7f3533e00640 1 -- 172.21.15.100:0/1271872009 learned_addr learned my addr 172.21.15.100:0/1271872009 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 0x564daee464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 -- 172.21.15.100:0/1271872009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 msgr2=0x564daee0a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 0x564daee0a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 -- 172.21.15.100:0/1271872009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 msgr2=0x564daee45200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee45200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.601+0000 7f3539200640 1 -- 172.21.15.100:0/1271872009 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564daecf7df0 con 0x564daee45740 2024-02-21T07:52:14.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.602+0000 7f3539200640 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 0x564daee464d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f352c001bb0 tx=0x7f352c002070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7bcc49bb5307959 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.603+0000 7f3528c00640 1 -- 172.21.15.100:0/1271872009 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c007910 con 0x564daee45740 2024-02-21T07:52:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.604+0000 7f3528c00640 1 -- 172.21.15.100:0/1271872009 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0133f0 con 0x564daee45740 2024-02-21T07:52:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.606+0000 7f353de65740 1 -- 172.21.15.100:0/1271872009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 msgr2=0x564daee464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.606+0000 7f3528c00640 1 -- 172.21.15.100:0/1271872009 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c007910 con 0x564daee45740 2024-02-21T07:52:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.606+0000 7f353de65740 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 0x564daee464d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f352c001bb0 tx=0x7f352c002070 comp rx=0 tx=0).stop 2024-02-21T07:52:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.607+0000 7f353de65740 1 -- 172.21.15.100:0/1271872009 shutdown_connections 2024-02-21T07:52:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.607+0000 7f353de65740 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee45740 0x564daee464d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.607+0000 7f353de65740 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee45200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.607+0000 7f353de65740 1 --2- 172.21.15.100:0/1271872009 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a070 0x564daee0a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.607+0000 7f353de65740 1 -- 172.21.15.100:0/1271872009 >> 172.21.15.100:0/1271872009 conn(0x564daedcc640 msgr2=0x564daedcd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.608+0000 7f353de65740 1 -- 172.21.15.100:0/1271872009 shutdown_connections 2024-02-21T07:52:14.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.608+0000 7f353de65740 1 -- 172.21.15.100:0/1271872009 wait complete. 2024-02-21T07:52:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.610+0000 7f353de65740 1 -- start start 2024-02-21T07:52:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.611+0000 7f353de65740 1 Processor -- start 2024-02-21T07:52:14.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.614+0000 7f353de65740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee07bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.614+0000 7f353de65740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daedf7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.615+0000 7f353de65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.615+0000 7f353de65740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daecdb150 con 0x564daee45740 2024-02-21T07:52:14.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.615+0000 7f353de65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daecdadf0 con 0x564daee4fd30 2024-02-21T07:52:14.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.617+0000 7f3533400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daedf7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.617+0000 7f353de65740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daeaa41c0 con 0x564daee0a990 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.617+0000 7f3533e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee07bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f353de65740 10 client.0 _ll_register_callbacks cb 0x564daed2a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45606/0 (socket says 172.21.15.100:45606) 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 -- 172.21.15.100:0/753425969 learned_addr learned my addr 172.21.15.100:0/753425969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 -- 172.21.15.100:0/753425969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 msgr2=0x564daee07bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee07bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 -- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 msgr2=0x564daedf7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daedf7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.618+0000 7f3539200640 1 -- 172.21.15.100:0/753425969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564daed345a0 con 0x564daee4fd30 2024-02-21T07:52:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.619+0000 7f3539200640 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f352c013c40 tx=0x7f352c001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2b47934825ec1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.619+0000 7f351d600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.620+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c026620 con 0x564daee4fd30 2024-02-21T07:52:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.620+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f352c013e20 con 0x564daee4fd30 2024-02-21T07:52:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.623+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564daea357e0 con 0x564daee4fd30 2024-02-21T07:52:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.624+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f352c026780 con 0x564daee4fd30 2024-02-21T07:52:14.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.624+0000 7f353de65740 10 client.6385 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:14.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.624+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564daecd0ab0 con 0x564daee4fd30 2024-02-21T07:52:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.625+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564daea357e0 con 0x564daee4fd30 2024-02-21T07:52:14.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.625+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f352c012070 con 0x564daee4fd30 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 10 client.6385 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 10 client.6385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 20 client.6385 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daee501b0 0x564daee524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 4 client.6385 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564daea72720 con 0x564daee501b0 2024-02-21T07:52:14.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.626+0000 7f3533e00640 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daee501b0 0x564daee524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.627+0000 7f351d600640 10 client.6385 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:14.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.629+0000 7f3533e00640 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daee501b0 0x564daee524d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd05955d7f0fdb33 server_cookie=af126ae688099ae6 in_seq=0 out_seq=0 2024-02-21T07:52:14.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.630+0000 7f351d600640 1 -- 172.21.15.100:0/753425969 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564daea72720 con 0x564daee501b0 2024-02-21T07:52:14.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.630+0000 7f351d600640 10 client.6385 handle_command_reply: tid=0 2024-02-21T07:52:14.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.631+0000 7f353de65740 1 client.6385 shutdown 2024-02-21T07:52:14.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.636+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 msgr2=0x564daee51ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.636+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f352c013c40 tx=0x7f352c001750 comp rx=0 tx=0).stop 2024-02-21T07:52:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.636+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 shutdown_connections 2024-02-21T07:52:14.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daee501b0 0x564daee524d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daee51ac0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daedf7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f353de65740 1 --2- 172.21.15.100:0/753425969 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee07bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 >> 172.21.15.100:0/753425969 conn(0x564daee0a070 msgr2=0x564daee45b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.637+0000 7f351d600640 0 client.6385 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:14.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.639+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 shutdown_connections 2024-02-21T07:52:14.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.641+0000 7f353de65740 1 -- 172.21.15.100:0/753425969 wait complete. 2024-02-21T07:52:14.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.641+0000 7f353de65740 20 client.6385 trim_cache size 0 max 16384 2024-02-21T07:52:14.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.683+0000 7f353de65740 1 Processor -- start 2024-02-21T07:52:14.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.683+0000 7f353de65740 1 -- start start 2024-02-21T07:52:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daee039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedcba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daee086d0 con 0x564daee45740 2024-02-21T07:52:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daee3e4f0 con 0x564daee4fd30 2024-02-21T07:52:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.685+0000 7f353de65740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daee37cf0 con 0x564daee0a990 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daee039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58578/0 (socket says 172.21.15.100:58578) 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533e00640 1 -- 172.21.15.100:0/501396487 learned_addr learned my addr 172.21.15.100:0/501396487 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3539200640 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedcba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533e00640 1 -- 172.21.15.100:0/501396487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 msgr2=0x564daedcba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.686+0000 7f3533e00640 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedcba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.687+0000 7f3533e00640 1 -- 172.21.15.100:0/501396487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 msgr2=0x564daee039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.687+0000 7f3533e00640 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daee039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.687+0000 7f3533e00640 1 -- 172.21.15.100:0/501396487 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564daee42be0 con 0x564daee0a990 2024-02-21T07:52:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.687+0000 7f3533400640 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daee039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:14.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.688+0000 7f3533e00640 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3524004fd0 tx=0x7f3524013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94bc8bc57a3473f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.688+0000 7f351fe00640 1 -- 172.21.15.100:0/501396487 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524024110 con 0x564daee0a990 2024-02-21T07:52:14.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.689+0000 7f351fe00640 1 -- 172.21.15.100:0/501396487 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524024270 con 0x564daee0a990 2024-02-21T07:52:14.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.689+0000 7f351fe00640 1 -- 172.21.15.100:0/501396487 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524001bb0 con 0x564daee0a990 2024-02-21T07:52:14.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.695+0000 7f353de65740 1 -- 172.21.15.100:0/501396487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 msgr2=0x564daee436e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.698+0000 7f353de65740 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3524004fd0 tx=0x7f3524013000 comp rx=0 tx=0).stop 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.699+0000 7f353de65740 1 -- 172.21.15.100:0/501396487 shutdown_connections 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.699+0000 7f353de65740 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedcba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.699+0000 7f353de65740 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee45740 0x564daee039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.699+0000 7f353de65740 1 --2- 172.21.15.100:0/501396487 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee0a990 0x564daee436e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.699+0000 7f353de65740 1 -- 172.21.15.100:0/501396487 >> 172.21.15.100:0/501396487 conn(0x564daee0a070 msgr2=0x564daedcb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.700+0000 7f353de65740 1 -- 172.21.15.100:0/501396487 shutdown_connections 2024-02-21T07:52:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.701+0000 7f353de65740 1 -- 172.21.15.100:0/501396487 wait complete. 2024-02-21T07:52:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.702+0000 7f353de65740 1 -- start start 2024-02-21T07:52:14.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.702+0000 7f353de65740 1 Processor -- start 2024-02-21T07:52:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.705+0000 7f353de65740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f353de65740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee45740 0x564daeeac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f353de65740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f3533e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f353de65740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daeeac840 con 0x564daee0a990 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f353de65740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daedd2b00 con 0x564daee4fd30 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.706+0000 7f353de65740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564daedd2de0 con 0x564daee45740 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.707+0000 7f353de65740 10 client.0 _ll_register_callbacks cb 0x7f352c004c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.707+0000 7f3539200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.707+0000 7f3539200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45618/0 (socket says 172.21.15.100:45618) 2024-02-21T07:52:14.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.707+0000 7f3539200640 1 -- 172.21.15.100:0/610365548 learned_addr learned my addr 172.21.15.100:0/610365548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:14.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.707+0000 7f3533400640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee45740 0x564daeeac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.708+0000 7f3539200640 1 -- 172.21.15.100:0/610365548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee45740 msgr2=0x564daeeac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.708+0000 7f3539200640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee45740 0x564daeeac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.708+0000 7f3539200640 1 -- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 msgr2=0x564daee969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.708+0000 7f3539200640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.708+0000 7f3539200640 1 -- 172.21.15.100:0/610365548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353408cb20 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.709+0000 7f351d600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.709+0000 7f3539200640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f352c002220 tx=0x7f352c004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38e560abd2f458d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.710+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c007430 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.710+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f352c0133f0 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.710+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f352c01c8c0 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.710+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f352c007430 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.711+0000 7f353de65740 10 client.6391 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.711+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f35240017b0 con 0x564daee4fd30 2024-02-21T07:52:14.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.711+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0133f0 con 0x564daee4fd30 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.712+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f352c012070 con 0x564daee4fd30 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 10 client.6391 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 10 client.6391 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 20 client.6391 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daedc4550 0x564daee960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 4 client.6391 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564daeac1890 con 0x564daedc4550 2024-02-21T07:52:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.713+0000 7f3533e00640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daedc4550 0x564daee960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.714+0000 7f3533e00640 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daedc4550 0x564daee960c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=79bcbc4b44ead571 server_cookie=a85cb7b09ccf2468 in_seq=0 out_seq=0 2024-02-21T07:52:14.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.714+0000 7f351d600640 10 client.6391 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.714+0000 7f351d600640 1 -- 172.21.15.100:0/610365548 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564daeac1890 con 0x564daedc4550 2024-02-21T07:52:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.715+0000 7f351d600640 10 client.6391 handle_command_reply: tid=0 2024-02-21T07:52:14.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.715+0000 7f353de65740 1 client.6391 shutdown 2024-02-21T07:52:14.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.721+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 msgr2=0x564daedfbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.721+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f352c002220 tx=0x7f352c004cf0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 shutdown_connections 2024-02-21T07:52:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564daedc4550 0x564daee960c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564daee4fd30 0x564daedfbd40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564daee45740 0x564daeeac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 --2- 172.21.15.100:0/610365548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564daee0a990 0x564daee969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 >> 172.21.15.100:0/610365548 conn(0x564daee0a070 msgr2=0x564daedf1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.722+0000 7f351d600640 0 client.6391 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:14.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.723+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 shutdown_connections 2024-02-21T07:52:14.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.723+0000 7f353de65740 1 -- 172.21.15.100:0/610365548 wait complete. 2024-02-21T07:52:14.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.724+0000 7f353de65740 20 client.6391 trim_cache size 0 max 16384 2024-02-21T07:52:14.727 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.725+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 msgr2=0x7f35140a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.725+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 0x7f35140a1590 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3524007b50 tx=0x7f3524007aa0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.726+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 msgr2=0x7f3534224520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:14.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.726+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 0x7f3534224520 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3520032000 tx=0x7f35200046c0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 shutdown_connections 2024-02-21T07:52:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f353418c740 0x7f3534183750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f351409f0d0 0x7f35140a1590 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35341689c0 0x7f3534224520 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 --2- 172.21.15.100:0/776600315 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f35341685e0 0x7f3534223fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 >> 172.21.15.100:0/776600315 conn(0x7f35340d0900 msgr2=0x7f35340d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.729+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 shutdown_connections 2024-02-21T07:52:14.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:14.730+0000 7f3539c00640 1 -- 172.21.15.100:0/776600315 wait complete. 2024-02-21T07:52:14.782 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:14.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:52:14.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:14.837 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:14.839 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.057+0000 7faedee00640 1 Processor -- start 2024-02-21T07:52:15.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.057+0000 7faedee00640 1 -- start start 2024-02-21T07:52:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faedee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faed8186170 0x7faed8189e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faedee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed806bb90 con 0x7faed806ce80 2024-02-21T07:52:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faedee00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed806c9f0 con 0x7faed818a3d0 2024-02-21T07:52:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faedee00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed81899b0 con 0x7faed8186170 2024-02-21T07:52:15.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faed7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faed806ce80 0x7faed80d3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54014/0 (socket says 172.21.15.100:54014) 2024-02-21T07:52:15.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.060+0000 7faed7400640 1 -- 172.21.15.100:0/3840152238 learned_addr learned my addr 172.21.15.100:0/3840152238 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:15.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325727412 0 0) 0x7faed806c9f0 con 0x7faed818a3d0 2024-02-21T07:52:15.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc003520 con 0x7faed818a3d0 2024-02-21T07:52:15.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278179966 0 0) 0x7faed806bb90 con 0x7faed806ce80 2024-02-21T07:52:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed806c9f0 con 0x7faed806ce80 2024-02-21T07:52:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717991542 0 0) 0x7faebc003520 con 0x7faed818a3d0 2024-02-21T07:52:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 >> v2:172.21.15.170:3300/0 conn(0x7faed8186170 msgr2=0x7faed8189e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 --2- 172.21.15.100:0/3840152238 >> v2:172.21.15.170:3300/0 conn(0x7faed8186170 0x7faed8189e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 >> v1:172.21.15.100:6789/0 conn(0x7faed806ce80 legacy=0x7faed80d3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed806bde0 con 0x7faed818a3d0 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7faed00019f0 con 0x7faed818a3d0 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 >> v1:172.21.15.156:6789/0 conn(0x7faed818a3d0 legacy=0x7faed818bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faebc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc0047c0 0x7faebc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faebc005330 0x7faebc00b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed81899b0 con 0x7faebc005330 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc00c280 con 0x7faebc0047c0 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.061+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc00c440 con 0x7faebc003b50 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faebc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faedce00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faebc005330 0x7faebc00b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 -- 172.21.15.100:0/3840152238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc0047c0 msgr2=0x7faebc004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faebc0047c0 0x7faebc004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 -- 172.21.15.100:0/3840152238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faebc005330 msgr2=0x7faebc00b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faebc005330 0x7faebc00b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faed7e00640 1 -- 172.21.15.100:0/3840152238 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed806bde0 con 0x7faebc003b50 2024-02-21T07:52:15.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.062+0000 7faedce00640 1 -- 172.21.15.100:0/3840152238 reap_dead start 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.064+0000 7faed7e00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faebc003f50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faec8009860 tx=0x7faebc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc63dcf24ef16827 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.064+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8032600 con 0x7faebc003b50 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.064+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec802e050 con 0x7faebc003b50 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.064+0000 7faed6a00640 1 -- 172.21.15.100:0/3840152238 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80329c0 con 0x7faebc003b50 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 -- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 msgr2=0x7faebc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faebc003f50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faec8009860 tx=0x7faebc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 -- 172.21.15.100:0/3840152238 shutdown_connections 2024-02-21T07:52:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 --2- 172.21.15.100:0/3840152238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faebc003f50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 -- 172.21.15.100:0/3840152238 >> 172.21.15.100:0/3840152238 conn(0x7faed80fe210 msgr2=0x7faed80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 -- 172.21.15.100:0/3840152238 shutdown_connections 2024-02-21T07:52:15.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.065+0000 7faedee00640 1 -- 172.21.15.100:0/3840152238 wait complete. 2024-02-21T07:52:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.069+0000 7faedee00640 1 Processor -- start 2024-02-21T07:52:15.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.069+0000 7faedee00640 1 -- start start 2024-02-21T07:52:15.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed80ce170 0x7faed8175c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faed81761b0 0x7faed821ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80cf260 con 0x7faed80ce170 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80ce6e0 con 0x7faed81761b0 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faedee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed80ce9c0 con 0x7faebc003b50 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58608/0 (socket says 172.21.15.100:58608) 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 -- 172.21.15.100:0/1680901305 learned_addr learned my addr 172.21.15.100:0/1680901305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7400640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed80ce170 0x7faed8175c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 -- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faed81761b0 msgr2=0x7faed821ecb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faed81761b0 0x7faed821ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 -- 172.21.15.100:0/1680901305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed80ce170 msgr2=0x7faed8175c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed80ce170 0x7faed8175c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.071+0000 7faed7e00640 1 -- 172.21.15.100:0/1680901305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80ceca0 con 0x7faebc003b50 2024-02-21T07:52:15.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faed7e00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faec8009860 tx=0x7faec80047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faecfe00640 1 -- 172.21.15.100:0/1680901305 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec803c880 con 0x7faebc003b50 2024-02-21T07:52:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faecfe00640 1 -- 172.21.15.100:0/1680901305 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec803c9e0 con 0x7faebc003b50 2024-02-21T07:52:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faecfe00640 1 -- 172.21.15.100:0/1680901305 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec803cd50 con 0x7faebc003b50 2024-02-21T07:52:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed80cef80 con 0x7faebc003b50 2024-02-21T07:52:15.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.072+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed821f1f0 con 0x7faebc003b50 2024-02-21T07:52:15.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.077+0000 7faecfe00640 1 -- 172.21.15.100:0/1680901305 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7faec8039040 con 0x7faebc003b50 2024-02-21T07:52:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.078+0000 7faee1a55740 1 Processor -- start 2024-02-21T07:52:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.078+0000 7faee1a55740 1 -- start start 2024-02-21T07:52:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faecfe00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 0x7faeb80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faecfe00640 1 -- 172.21.15.100:0/1680901305 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faec80eb510 con 0x7faebc003b50 2024-02-21T07:52:15.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 0x55ab765cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 0x55ab7660a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab76502210 con 0x55ab7660a590 2024-02-21T07:52:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab764ff740 con 0x55ab765ceec0 2024-02-21T07:52:15.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.079+0000 7faee1a55740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab764faf20 con 0x55ab765cf7e0 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.080+0000 7faed7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 0x55ab765cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.080+0000 7faedce00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 0x7faeb80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.080+0000 7faedce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.080+0000 7faedce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55974/0 (socket says 172.21.15.100:55974) 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.080+0000 7faedce00640 1 -- 172.21.15.100:0/4103861018 learned_addr learned my addr 172.21.15.100:0/4103861018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faed7400640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 0x55ab7660a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faedce00640 1 -- 172.21.15.100:0/4103861018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 msgr2=0x55ab7660a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faedce00640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 0x55ab7660a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faedce00640 1 -- 172.21.15.100:0/4103861018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 msgr2=0x55ab765cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faedce00640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 0x55ab765cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faedce00640 1 -- 172.21.15.100:0/4103861018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab764bcdf0 con 0x55ab7660a590 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faed7400640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 0x55ab7660a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.081+0000 7faed7e00640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 0x55ab765cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.082+0000 7faedce00640 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faed0001370 tx=0x7faed001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33280134422eee73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.082+0000 7faedce00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 0x7faeb80a1560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faed0007e60 tx=0x7faed0001a80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.082+0000 7faeccc00640 1 -- 172.21.15.100:0/4103861018 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0015e60 con 0x55ab7660a590 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.082+0000 7faeccc00640 1 -- 172.21.15.100:0/4103861018 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0017d80 con 0x55ab7660a590 2024-02-21T07:52:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.082+0000 7faeccc00640 1 -- 172.21.15.100:0/4103861018 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0015e60 con 0x55ab7660a590 2024-02-21T07:52:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 -- 172.21.15.100:0/4103861018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 msgr2=0x55ab7660b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faed0001370 tx=0x7faed001a000 comp rx=0 tx=0).stop 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 -- 172.21.15.100:0/4103861018 shutdown_connections 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab7660b320 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab765cf7e0 0x55ab7660a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 --2- 172.21.15.100:0/4103861018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765ceec0 0x55ab765cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.083+0000 7faee1a55740 1 -- 172.21.15.100:0/4103861018 >> 172.21.15.100:0/4103861018 conn(0x55ab76591490 msgr2=0x55ab76592510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.084+0000 7faee1a55740 1 -- 172.21.15.100:0/4103861018 shutdown_connections 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.084+0000 7faee1a55740 1 -- 172.21.15.100:0/4103861018 wait complete. 2024-02-21T07:52:15.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.085+0000 7faee1a55740 1 -- start start 2024-02-21T07:52:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.085+0000 7faee1a55740 1 Processor -- start 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.086+0000 7faee1a55740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.086+0000 7faee1a55740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab7660a590 0x55ab765c1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faee1a55740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab765f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faee1a55740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab764a0150 con 0x55ab765cf7e0 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faee1a55740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab7649fdf0 con 0x55ab7660a590 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faee1a55740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab762691c0 con 0x55ab7658e750 2024-02-21T07:52:15.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faee1a55740 10 client.0 _ll_register_callbacks cb 0x55ab764ef2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faed7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faed7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55980/0 (socket says 172.21.15.100:55980) 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.087+0000 7faed7e00640 1 -- 172.21.15.100:0/1036614173 learned_addr learned my addr 172.21.15.100:0/1036614173 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 -- 172.21.15.100:0/1036614173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 msgr2=0x55ab765f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faedce00640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab765f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab765f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 -- 172.21.15.100:0/1036614173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab7660a590 msgr2=0x55ab765c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab7660a590 0x55ab765c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 -- 172.21.15.100:0/1036614173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed000f040 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faed7e00640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faec802bc40 tx=0x7faec80b9230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5894af8fb2d3b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faec1600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80bd0d0 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.088+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faec80c1480 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.089+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab761fa7e0 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.089+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7faec80c1640 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.089+0000 7faee1a55740 10 client.6225 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.089+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ab764f95a0 con 0x55ab765cf7e0 2024-02-21T07:52:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.089+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ab761fa7e0 con 0x55ab765cf7e0 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faec80eb070 con 0x55ab765cf7e0 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 10 client.6225 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 10 client.6225 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 20 client.6225 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab765c5060 0x55ab76616d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 4 client.6225 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.090+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab76237720 con 0x55ab765c5060 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.091+0000 7faed7400640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab765c5060 0x55ab76616d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.091+0000 7faec1600640 10 client.6225 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.091+0000 7faed7400640 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab765c5060 0x55ab76616d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=de4aa8aa75e7754a server_cookie=4c0d11cd2be460dd in_seq=0 out_seq=0 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.092+0000 7faec1600640 1 -- 172.21.15.100:0/1036614173 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ab76237720 con 0x55ab765c5060 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.092+0000 7faec1600640 10 client.6225 handle_command_reply: tid=0 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.092+0000 7faee1a55740 1 client.6225 shutdown 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.092+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 msgr2=0x55ab76611f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.092+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faec802bc40 tx=0x7faec80b9230 comp rx=0 tx=0).stop 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 shutdown_connections 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab765f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab765c5060 0x55ab76616d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faec1600640 0 client.6225 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab7660a590 0x55ab765c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 --2- 172.21.15.100:0/1036614173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab765cf7e0 0x55ab76611f30 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.093+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 >> 172.21.15.100:0/1036614173 conn(0x55ab765ceec0 msgr2=0x55ab76592f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.094+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 shutdown_connections 2024-02-21T07:52:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.094+0000 7faee1a55740 1 -- 172.21.15.100:0/1036614173 wait complete. 2024-02-21T07:52:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.094+0000 7faee1a55740 20 client.6225 trim_cache size 0 max 16384 2024-02-21T07:52:15.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.107+0000 7faee1a55740 1 Processor -- start 2024-02-21T07:52:15.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.107+0000 7faee1a55740 1 -- start start 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab76592f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab7658e590 con 0x55ab7660a590 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab765928b0 con 0x55ab765cf7e0 2024-02-21T07:52:15.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faee1a55740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab765fff70 con 0x55ab7658e750 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faedce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faed7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faedce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55994/0 (socket says 172.21.15.100:55994) 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faedce00640 1 -- 172.21.15.100:0/1391507090 learned_addr learned my addr 172.21.15.100:0/1391507090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faed7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45660/0 (socket says 172.21.15.100:45660) 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.108+0000 7faed7e00640 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab76592f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 -- 172.21.15.100:0/1391507090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 msgr2=0x55ab76592f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab76592f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 -- 172.21.15.100:0/1391507090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 msgr2=0x55ab765fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 -- 172.21.15.100:0/1391507090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab76495ab0 con 0x55ab7660a590 2024-02-21T07:52:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faed7400640 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faedce00640 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faed80fded0 tx=0x7faed0007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bcfe5a74cc9c3e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faec3e00640 1 -- 172.21.15.100:0/1391507090 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0026040 con 0x55ab7660a590 2024-02-21T07:52:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faec3e00640 1 -- 172.21.15.100:0/1391507090 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0015e60 con 0x55ab7660a590 2024-02-21T07:52:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.109+0000 7faec3e00640 1 -- 172.21.15.100:0/1391507090 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0003bb0 con 0x55ab7660a590 2024-02-21T07:52:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 -- 172.21.15.100:0/1391507090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 msgr2=0x55ab76602550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faed80fded0 tx=0x7faed0007b60 comp rx=0 tx=0).stop 2024-02-21T07:52:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 -- 172.21.15.100:0/1391507090 shutdown_connections 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7660a590 0x55ab76602550 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab765fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 --2- 172.21.15.100:0/1391507090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7658e750 0x55ab76592f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 -- 172.21.15.100:0/1391507090 >> 172.21.15.100:0/1391507090 conn(0x55ab765ceec0 msgr2=0x55ab76599920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 -- 172.21.15.100:0/1391507090 shutdown_connections 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.110+0000 7faee1a55740 1 -- 172.21.15.100:0/1391507090 wait complete. 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.112+0000 7faee1a55740 1 -- start start 2024-02-21T07:52:15.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.112+0000 7faee1a55740 1 Processor -- start 2024-02-21T07:52:15.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab76599920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7660a590 0x55ab765d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab76599e60 con 0x55ab7658e750 2024-02-21T07:52:15.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab7658cf30 con 0x55ab765cf7e0 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab765d9920 con 0x55ab7660a590 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faee1a55740 10 client.0 _ll_register_callbacks cb 0x7faed0015370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab76599920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56002/0 (socket says 172.21.15.100:56002) 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 -- 172.21.15.100:0/1164990915 learned_addr learned my addr 172.21.15.100:0/1164990915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 -- 172.21.15.100:0/1164990915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7660a590 msgr2=0x55ab765d9db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7660a590 0x55ab765d9db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.114+0000 7faed7e00640 1 -- 172.21.15.100:0/1164990915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 msgr2=0x55ab76599920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faed7e00640 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab76599920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faed7e00640 1 -- 172.21.15.100:0/1164990915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec400f040 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faed7e00640 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faec80e9280 tx=0x7faec80eb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310d89201b19500 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faec1600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80c1640 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faec80c1480 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faed0017d80 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7faec80bd340 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faee1a55740 10 client.6231 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.115+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ab764bcdf0 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec80c7080 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faec80eb070 con 0x55ab7658e750 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 10 client.6231 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 10 client.6231 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:52:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 20 client.6231 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab76612d40 0x55ab7666b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 4 client.6231 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab76286890 con 0x55ab76612d40 2024-02-21T07:52:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.116+0000 7faed7400640 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab76612d40 0x55ab7666b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faed7400640 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab76612d40 0x55ab7666b8e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d195b9143320730 server_cookie=d37b1b2e2081ceb6 in_seq=0 out_seq=0 2024-02-21T07:52:15.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faec1600640 10 client.6231 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:15.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faec1600640 1 -- 172.21.15.100:0/1164990915 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab76286890 con 0x55ab76612d40 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faec1600640 10 client.6231 handle_command_reply: tid=0 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 client.6231 shutdown 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 msgr2=0x55ab765c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faec80e9280 tx=0x7faec80eb000 comp rx=0 tx=0).stop 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 shutdown_connections 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ab7660a590 0x55ab765d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55ab76612d40 0x55ab7666b8e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ab765cf7e0 0x55ab76599920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 --2- 172.21.15.100:0/1164990915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ab7658e750 0x55ab765c44d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 >> 172.21.15.100:0/1164990915 conn(0x55ab765ceec0 msgr2=0x55ab76609e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.117+0000 7faec1600640 0 client.6231 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 shutdown_connections 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faee1a55740 1 -- 172.21.15.100:0/1164990915 wait complete. 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faee1a55740 20 client.6231 trim_cache size 0 max 16384 2024-02-21T07:52:15.125 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 msgr2=0x7faeb80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 0x7faeb80a1560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faed0007e60 tx=0x7faed0001a80 comp rx=0 tx=0).stop 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 msgr2=0x7faed80cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.118+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faec8009860 tx=0x7faec80047d0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 shutdown_connections 2024-02-21T07:52:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faed81761b0 0x7faed821ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faeb809f0a0 0x7faeb80a1560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faed80ce170 0x7faed8175c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 --2- 172.21.15.100:0/1680901305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faebc003b50 0x7faed80cdc30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 >> 172.21.15.100:0/1680901305 conn(0x7faed80fe210 msgr2=0x7faed8189c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 shutdown_connections 2024-02-21T07:52:15.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.119+0000 7faedee00640 1 -- 172.21.15.100:0/1680901305 wait complete. 2024-02-21T07:52:15.140 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:15.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:52:15.425 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.423+0000 7f2128c00640 1 Processor -- start 2024-02-21T07:52:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.423+0000 7f2128c00640 1 -- start start 2024-02-21T07:52:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.429+0000 7f2128c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f212415d910 0x7f21240fc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.429+0000 7f2128c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21240fc550 0x7f21240fdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.430+0000 7f2128c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21240fda70 con 0x7f21240fe440 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.430+0000 7f2128c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212418cd10 con 0x7f212415d910 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.430+0000 7f2128c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240d39a0 con 0x7f21240fc550 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.430+0000 7f2121400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21240fc550 0x7f21240fdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.431+0000 7f2121400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f21240fc550 0x7f21240fdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45674/0 (socket says 172.21.15.100:45674) 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.431+0000 7f2121400640 1 -- 172.21.15.100:0/2618562083 learned_addr learned my addr 172.21.15.100:0/2618562083 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.432+0000 7f2121400640 1 -- 172.21.15.100:0/2618562083 >> v2:172.21.15.100:3300/0 conn(0x7f212415d910 msgr2=0x7f21240fc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.433+0000 7f2121400640 1 --2- 172.21.15.100:0/2618562083 >> v2:172.21.15.100:3300/0 conn(0x7f212415d910 0x7f21240fc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.433+0000 7f2121400640 1 -- 172.21.15.100:0/2618562083 >> v1:172.21.15.100:6789/0 conn(0x7f21240fe440 legacy=0x7f21241603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.433+0000 7f2121400640 1 -- 172.21.15.100:0/2618562083 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124189720 con 0x7f21240fc550 2024-02-21T07:52:15.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.437+0000 7f2121400640 1 --2- 172.21.15.100:0/2618562083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21240fc550 0x7f21240fdf00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f212406de40 tx=0x7f211c02bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15a7fc9f390c609 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.438+0000 7f2120a00640 1 -- 172.21.15.100:0/2618562083 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c02c960 con 0x7f21240fc550 2024-02-21T07:52:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.438+0000 7f2120a00640 1 -- 172.21.15.100:0/2618562083 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c02cac0 con 0x7f21240fc550 2024-02-21T07:52:15.442 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.438+0000 7f2120a00640 1 -- 172.21.15.100:0/2618562083 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c02ce50 con 0x7f21240fc550 2024-02-21T07:52:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.439+0000 7f2128c00640 1 -- 172.21.15.100:0/2618562083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21240fc550 msgr2=0x7f21240fdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.443 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.439+0000 7f2128c00640 1 --2- 172.21.15.100:0/2618562083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21240fc550 0x7f21240fdf00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f212406de40 tx=0x7f211c02bdc0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.441+0000 7f2128c00640 1 -- 172.21.15.100:0/2618562083 shutdown_connections 2024-02-21T07:52:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.441+0000 7f2128c00640 1 --2- 172.21.15.100:0/2618562083 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f21240fc550 0x7f21240fdf00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.441+0000 7f2128c00640 1 --2- 172.21.15.100:0/2618562083 >> v2:172.21.15.100:3300/0 conn(0x7f212415d910 0x7f21240fc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.441+0000 7f2128c00640 1 -- 172.21.15.100:0/2618562083 >> 172.21.15.100:0/2618562083 conn(0x7f212408cfd0 msgr2=0x7f212408d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.444 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.442+0000 7f2128c00640 1 -- 172.21.15.100:0/2618562083 shutdown_connections 2024-02-21T07:52:15.446 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.442+0000 7f2128c00640 1 -- 172.21.15.100:0/2618562083 wait complete. 2024-02-21T07:52:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.447+0000 7f2128c00640 1 Processor -- start 2024-02-21T07:52:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.447+0000 7f2128c00640 1 -- start start 2024-02-21T07:52:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.450+0000 7f2128c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 0x7f2124156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.451+0000 7f2128c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 0x7f2124223fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.451+0000 7f2128c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f212415d910 0x7f21242244f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.451+0000 7f2128c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124224bd0 con 0x7f21240fc550 2024-02-21T07:52:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.451+0000 7f2128c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124224eb0 con 0x7f212415d910 2024-02-21T07:52:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2128c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124225190 con 0x7f21240fe440 2024-02-21T07:52:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2121e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 0x7f2124156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2121400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 0x7f2124223fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2122800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f212415d910 0x7f21242244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.455 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2121e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 0x7f2124156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56028/0 (socket says 172.21.15.100:56028) 2024-02-21T07:52:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.452+0000 7f2121e00640 1 -- 172.21.15.100:0/313739578 learned_addr learned my addr 172.21.15.100:0/313739578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.453+0000 7f2121400640 1 -- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f212415d910 msgr2=0x7f21242244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.453+0000 7f2121400640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f212415d910 0x7f21242244f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.456 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.453+0000 7f2121400640 1 -- 172.21.15.100:0/313739578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 msgr2=0x7f2124156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.453+0000 7f2121400640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 0x7f2124156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.457 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.453+0000 7f2121400640 1 -- 172.21.15.100:0/313739578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c009b30 con 0x7f21240fe440 2024-02-21T07:52:15.461 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.458+0000 7f2121400640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 0x7f2124223fb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2124092880 tx=0x7f211c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.462+0000 7f211a000640 1 -- 172.21.15.100:0/313739578 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c03e450 con 0x7f21240fe440 2024-02-21T07:52:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.462+0000 7f211a000640 1 -- 172.21.15.100:0/313739578 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c03e5b0 con 0x7f21240fe440 2024-02-21T07:52:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.462+0000 7f211a000640 1 -- 172.21.15.100:0/313739578 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c03e960 con 0x7f21240fe440 2024-02-21T07:52:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.462+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2124225470 con 0x7f21240fe440 2024-02-21T07:52:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.462+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2124225a30 con 0x7f21240fe440 2024-02-21T07:52:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.469+0000 7f212b854740 1 Processor -- start 2024-02-21T07:52:15.475 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.469+0000 7f211a000640 1 -- 172.21.15.100:0/313739578 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f211c03eac0 con 0x7f21240fe440 2024-02-21T07:52:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.473+0000 7f212b854740 1 -- start start 2024-02-21T07:52:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.474+0000 7f211a000640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 0x7f21040a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.474+0000 7f211a000640 1 -- 172.21.15.100:0/313739578 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f211c0ec920 con 0x7f21240fe440 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d95dd070 0x5555d959c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d96114d0 0x5555d95a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d955d620 con 0x5555d95a1f90 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d950f8c0 con 0x5555d96114d0 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.476+0000 7f212b854740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d950cdf0 con 0x5555d95dd070 2024-02-21T07:52:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.477+0000 7f2122800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56038/0 (socket says 172.21.15.100:56038) 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 -- 172.21.15.100:0/153482724 learned_addr learned my addr 172.21.15.100:0/153482724 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 -- 172.21.15.100:0/153482724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d95dd070 msgr2=0x5555d959c440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d95dd070 0x5555d959c440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 -- 172.21.15.100:0/153482724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d96114d0 msgr2=0x5555d95a1a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.481 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d96114d0 0x5555d95a1a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 -- 172.21.15.100:0/153482724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d9489b00 con 0x5555d95a1f90 2024-02-21T07:52:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.478+0000 7f2122800640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 0x7f21040a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.479+0000 7f2122800640 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2114009ab0 tx=0x7f2114009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4813630bc14ad45a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.480+0000 7f210e600640 1 -- 172.21.15.100:0/153482724 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114017cc0 con 0x5555d95a1f90 2024-02-21T07:52:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.480+0000 7f210e600640 1 -- 172.21.15.100:0/153482724 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2114017e20 con 0x5555d95a1f90 2024-02-21T07:52:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.480+0000 7f210e600640 1 -- 172.21.15.100:0/153482724 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114017cc0 con 0x5555d95a1f90 2024-02-21T07:52:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.482+0000 7f212b854740 1 -- 172.21.15.100:0/153482724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 msgr2=0x5555d95dd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.482+0000 7f212b854740 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2114009ab0 tx=0x7f2114009f70 comp rx=0 tx=0).stop 2024-02-21T07:52:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.482+0000 7f2122800640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 0x7f21040a16b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2114020000 tx=0x7f211401c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.483+0000 7f212b854740 1 -- 172.21.15.100:0/153482724 shutdown_connections 2024-02-21T07:52:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.483+0000 7f212b854740 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd450 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.483+0000 7f212b854740 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d96114d0 0x5555d95a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.483+0000 7f212b854740 1 --2- 172.21.15.100:0/153482724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d95dd070 0x5555d959c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.483+0000 7f212b854740 1 -- 172.21.15.100:0/153482724 >> 172.21.15.100:0/153482724 conn(0x5555d95694b0 msgr2=0x5555d95a0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.495+0000 7f212b854740 1 -- 172.21.15.100:0/153482724 shutdown_connections 2024-02-21T07:52:15.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.496+0000 7f212b854740 1 -- 172.21.15.100:0/153482724 wait complete. 2024-02-21T07:52:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.498+0000 7f212b854740 1 -- start start 2024-02-21T07:52:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.498+0000 7f212b854740 1 Processor -- start 2024-02-21T07:52:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.504+0000 7f212b854740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d9603f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.504+0000 7f212b854740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d961f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.504+0000 7f212b854740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.504+0000 7f212b854740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d95085d0 con 0x5555d95dd070 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f212b854740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d94adb50 con 0x5555d95a1f90 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f212b854740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d94ad7f0 con 0x5555d96114d0 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f212b854740 10 client.0 _ll_register_callbacks cb 0x5555d94c1550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f2122800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f2122800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58676/0 (socket says 172.21.15.100:58676) 2024-02-21T07:52:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.505+0000 7f2122800640 1 -- 172.21.15.100:0/636776522 learned_addr learned my addr 172.21.15.100:0/636776522 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.506+0000 7f2122800640 1 -- 172.21.15.100:0/636776522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 msgr2=0x5555d9603f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.506+0000 7f2122800640 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d9603f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.506+0000 7f2122800640 1 -- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 msgr2=0x5555d961f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.506+0000 7f2122800640 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d961f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.506+0000 7f2122800640 1 -- 172.21.15.100:0/636776522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21140096b0 con 0x5555d96114d0 2024-02-21T07:52:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.511+0000 7f2102a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.511+0000 7f2122800640 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f211401f620 tx=0x7f2114019050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed97fb49f389473d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.511+0000 7f622a000640 1 Processor -- start 2024-02-21T07:52:15.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.511+0000 7f622a000640 1 -- start start 2024-02-21T07:52:15.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.515+0000 7f622a000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622418fff0 con 0x7f62241838e0 2024-02-21T07:52:15.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.515+0000 7f622a000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622418dbc0 con 0x7f62240709f0 2024-02-21T07:52:15.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.515+0000 7f622a000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622418e7e0 con 0x7f622418fb60 2024-02-21T07:52:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.516+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114010ad0 con 0x5555d96114d0 2024-02-21T07:52:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.516+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555d94dacd0 con 0x5555d96114d0 2024-02-21T07:52:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.516+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2114005ce0 con 0x5555d96114d0 2024-02-21T07:52:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.516+0000 7f6222a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f62240709f0 0x7f62241901f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:45296/0 (socket says 172.21.15.100:45296) 2024-02-21T07:52:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.516+0000 7f6222a00640 1 -- 172.21.15.100:0/3741350654 learned_addr learned my addr 172.21.15.100:0/3741350654 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2114010ad0 con 0x5555d96114d0 2024-02-21T07:52:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f212b854740 10 client.6368 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5555d9506c50 con 0x5555d96114d0 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362844559 0 0) 0x7f622418dbc0 con 0x7f62240709f0 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6208003520 con 0x7f62240709f0 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657323151 0 0) 0x7f622418e7e0 con 0x7f622418fb60 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f622418dbc0 con 0x7f622418fb60 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 759872629 0 0) 0x7f6208003520 con 0x7f62240709f0 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 >> v1:172.21.15.170:6789/0 conn(0x7f622418fb60 legacy=0x7f6224190900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 >> v1:172.21.15.100:6789/0 conn(0x7f62241838e0 legacy=0x7f622418ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.522 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555d94dacd0 con 0x5555d96114d0 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622418eac0 con 0x7f62240709f0 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f6210001670 con 0x7f62240709f0 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 >> v1:172.21.15.156:6789/0 conn(0x7f62240709f0 legacy=0x7f62241901f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208003b80 0x7f6208003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62080047c0 0x7f6208004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 0x7f620800bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620800c350 con 0x7f6208003b80 2024-02-21T07:52:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620800c490 con 0x7f6208009970 2024-02-21T07:52:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.517+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620800c650 con 0x7f62080047c0 2024-02-21T07:52:15.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f211401f800 con 0x5555d96114d0 2024-02-21T07:52:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.518+0000 7f6223e00640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 0x7f620800bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.518+0000 7f6222a00640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62080047c0 0x7f6208004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 10 client.6368 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 10 client.6368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 20 client.6368 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bef0 0x5555d9620010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 4 client.6368 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:15.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555d94fece0 con 0x5555d959bef0 2024-02-21T07:52:15.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f6223e00640 1 -- 172.21.15.100:0/3741350654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62080047c0 msgr2=0x7f6208004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f6223e00640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62080047c0 0x7f6208004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f6223e00640 1 -- 172.21.15.100:0/3741350654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208003b80 msgr2=0x7f6208003f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:15.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f6223e00640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6208003b80 0x7f6208003f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.519+0000 7f6223e00640 1 -- 172.21.15.100:0/3741350654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622418eac0 con 0x7f6208009970 2024-02-21T07:52:15.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.520+0000 7f6223e00640 1 -- 172.21.15.100:0/3741350654 reap_dead start 2024-02-21T07:52:15.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.521+0000 7f6223e00640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 0x7f620800bd60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f621c001fe0 tx=0x7f62080057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e055976ca561e9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.521+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c003b70 con 0x7f6208009970 2024-02-21T07:52:15.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.521+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c003cd0 con 0x7f6208009970 2024-02-21T07:52:15.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.522+0000 7f2121e00640 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bef0 0x5555d9620010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.521+0000 7f6222000640 1 -- 172.21.15.100:0/3741350654 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0052d0 con 0x7f6208009970 2024-02-21T07:52:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.523+0000 7f622a000640 1 -- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 msgr2=0x7f620800bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.523+0000 7f622a000640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 0x7f620800bd60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f621c001fe0 tx=0x7f62080057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.523+0000 7f2121e00640 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bef0 0x5555d9620010 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb32b09d8d0f10f server_cookie=3e27b938cb447888 in_seq=0 out_seq=0 2024-02-21T07:52:15.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.523+0000 7f2102a00640 10 client.6368 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.523+0000 7f622a000640 1 -- 172.21.15.100:0/3741350654 shutdown_connections 2024-02-21T07:52:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.524+0000 7f622a000640 1 --2- 172.21.15.100:0/3741350654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6208009970 0x7f620800bd60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.524+0000 7f622a000640 1 -- 172.21.15.100:0/3741350654 >> 172.21.15.100:0/3741350654 conn(0x7f62240668b0 msgr2=0x7f6224066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.524+0000 7f622a000640 1 -- 172.21.15.100:0/3741350654 shutdown_connections 2024-02-21T07:52:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.524+0000 7f622a000640 1 -- 172.21.15.100:0/3741350654 wait complete. 2024-02-21T07:52:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.533+0000 7f622a000640 1 Processor -- start 2024-02-21T07:52:15.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.533+0000 7f622a000640 1 -- start start 2024-02-21T07:52:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.535+0000 7f2102a00640 1 -- 172.21.15.100:0/636776522 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5555d94fece0 con 0x5555d959bef0 2024-02-21T07:52:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.535+0000 7f2102a00640 10 client.6368 handle_command_reply: tid=0 2024-02-21T07:52:15.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.535+0000 7f212b854740 1 client.6368 shutdown 2024-02-21T07:52:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.535+0000 7f622a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6208009970 0x7f6224170e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f622a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 msgr2=0x5555d959b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f211401f620 tx=0x7f2114019050 comp rx=0 tx=0).stop 2024-02-21T07:52:15.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f622a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62242172e0 0x7f6224225d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f622a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240f55f0 con 0x7f6224182d00 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f622a000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224171350 con 0x7f62242172e0 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.536+0000 7f622a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240f4700 con 0x7f6208009970 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.537+0000 7f6223400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6208009970 0x7f6224170e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.537+0000 7f6222a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.537+0000 7f6222a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56046/0 (socket says 172.21.15.100:56046) 2024-02-21T07:52:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.537+0000 7f6222a00640 1 -- 172.21.15.100:0/56239267 learned_addr learned my addr 172.21.15.100:0/56239267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.537+0000 7f6223e00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62242172e0 0x7f6224225d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.538+0000 7f6222a00640 1 -- 172.21.15.100:0/56239267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6208009970 msgr2=0x7f6224170e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.538+0000 7f6222a00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6208009970 0x7f6224170e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.538+0000 7f6222a00640 1 -- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62242172e0 msgr2=0x7f6224225d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.538+0000 7f6222a00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62242172e0 0x7f6224225d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.538+0000 7f6222a00640 1 -- 172.21.15.100:0/56239267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240f49e0 con 0x7f6224182d00 2024-02-21T07:52:15.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f6222a00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6210007680 tx=0x7f621000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 shutdown_connections 2024-02-21T07:52:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bef0 0x5555d9620010 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d959b4b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d961f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 --2- 172.21.15.100:0/636776522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d9603f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.540+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 >> 172.21.15.100:0/636776522 conn(0x5555d95694b0 msgr2=0x5555d9611930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f2102a00640 0 client.6368 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 shutdown_connections 2024-02-21T07:52:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f212b854740 1 -- 172.21.15.100:0/636776522 wait complete. 2024-02-21T07:52:15.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f621b400640 1 -- 172.21.15.100:0/56239267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6210007770 con 0x7f6224182d00 2024-02-21T07:52:15.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f212b854740 20 client.6368 trim_cache size 0 max 16384 2024-02-21T07:52:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240f4cc0 con 0x7f6224182d00 2024-02-21T07:52:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.541+0000 7f621b400640 1 -- 172.21.15.100:0/56239267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6210001600 con 0x7f6224182d00 2024-02-21T07:52:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.542+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240f5280 con 0x7f6224182d00 2024-02-21T07:52:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.542+0000 7f621b400640 1 -- 172.21.15.100:0/56239267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621000fdd0 con 0x7f6224182d00 2024-02-21T07:52:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.558+0000 7f622cc33740 1 Processor -- start 2024-02-21T07:52:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.558+0000 7f622cc33740 1 -- start start 2024-02-21T07:52:15.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.558+0000 7f621b400640 1 -- 172.21.15.100:0/56239267 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f621001e3b0 con 0x7f6224182d00 2024-02-21T07:52:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.566+0000 7f621b400640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 0x7f62040a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.566+0000 7f621b400640 1 -- 172.21.15.100:0/56239267 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f62100c9830 con 0x7f6224182d00 2024-02-21T07:52:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.567+0000 7f6223e00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 0x7f62040a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.570+0000 7f6223e00640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 0x7f62040a16b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f620800c620 tx=0x7f621c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.574+0000 7f622cc33740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.575+0000 7f212b854740 1 Processor -- start 2024-02-21T07:52:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.580+0000 7f212b854740 1 -- start start 2024-02-21T07:52:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 0x5555d959f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9250e60 con 0x5555d95a1f90 2024-02-21T07:52:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d94a9f10 con 0x5555d95dd070 2024-02-21T07:52:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f212b854740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d959c3e0 con 0x5555d96114d0 2024-02-21T07:52:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.579+0000 7f622cc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.579+0000 7f622cc33740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591919320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.579+0000 7f622cc33740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d591810210 con 0x55d591918590 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.579+0000 7f622cc33740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59180d740 con 0x55d5918dcec0 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.579+0000 7f622cc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d591808f20 con 0x55d5918dd7e0 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.581+0000 7f6223400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.582+0000 7f6223400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45722/0 (socket says 172.21.15.100:45722) 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.583+0000 7f6222a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.585+0000 7f6222a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58710/0 (socket says 172.21.15.100:58710) 2024-02-21T07:52:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.585+0000 7f6222a00640 1 -- 172.21.15.100:0/1245918275 learned_addr learned my addr 172.21.15.100:0/1245918275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.583+0000 7f2122800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.583+0000 7f2122800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58726/0 (socket says 172.21.15.100:58726) 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.583+0000 7f2122800640 1 -- 172.21.15.100:0/1108078895 learned_addr learned my addr 172.21.15.100:0/1108078895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.583+0000 7f2121400640 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 0x5555d959f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2122800640 1 -- 172.21.15.100:0/1108078895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 msgr2=0x5555d959f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2122800640 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 0x5555d959f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2122800640 1 -- 172.21.15.100:0/1108078895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 msgr2=0x5555d95dd7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2122800640 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2122800640 1 -- 172.21.15.100:0/1108078895 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d94a3530 con 0x5555d96114d0 2024-02-21T07:52:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f2121400640 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 0x5555d959f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.584+0000 7f6223e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591919320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.586+0000 7f2122800640 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f211403c980 tx=0x7f211402c070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a1014eda3624a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.586+0000 7f210dc00640 1 -- 172.21.15.100:0/1108078895 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114010ad0 con 0x5555d96114d0 2024-02-21T07:52:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.586+0000 7f210dc00640 1 -- 172.21.15.100:0/1108078895 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555d94dacd0 con 0x5555d96114d0 2024-02-21T07:52:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.586+0000 7f210dc00640 1 -- 172.21.15.100:0/1108078895 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2114010ad0 con 0x5555d96114d0 2024-02-21T07:52:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.587+0000 7f212b854740 1 -- 172.21.15.100:0/1108078895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 msgr2=0x5555d95d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.587+0000 7f212b854740 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f211403c980 tx=0x7f211402c070 comp rx=0 tx=0).stop 2024-02-21T07:52:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.589+0000 7f212b854740 1 -- 172.21.15.100:0/1108078895 shutdown_connections 2024-02-21T07:52:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.589+0000 7f212b854740 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d95d0c70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.589+0000 7f212b854740 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95dd070 0x5555d959f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.589+0000 7f212b854740 1 --2- 172.21.15.100:0/1108078895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95a1f90 0x5555d95dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.589+0000 7f212b854740 1 -- 172.21.15.100:0/1108078895 >> 172.21.15.100:0/1108078895 conn(0x5555d95694b0 msgr2=0x5555d9603d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.591+0000 7f6223e00640 1 -- 172.21.15.100:0/1245918275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 msgr2=0x55d591918050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.591+0000 7f6223e00640 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.591+0000 7f6223e00640 1 -- 172.21.15.100:0/1245918275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 msgr2=0x55d5918dd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.591+0000 7f6223e00640 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.592+0000 7f6223e00640 1 -- 172.21.15.100:0/1245918275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5917cadf0 con 0x55d591918590 2024-02-21T07:52:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.593+0000 7f212b854740 1 -- 172.21.15.100:0/1108078895 shutdown_connections 2024-02-21T07:52:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.593+0000 7f212b854740 1 -- 172.21.15.100:0/1108078895 wait complete. 2024-02-21T07:52:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.593+0000 7f6222a00640 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.593+0000 7f6223400640 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.594+0000 7f212b854740 1 -- start start 2024-02-21T07:52:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.595+0000 7f212b854740 1 Processor -- start 2024-02-21T07:52:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.596+0000 7f6223e00640 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591919320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6224070470 tx=0x7f621c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e057ff3f6110bd77 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f620f400640 1 -- 172.21.15.100:0/1245918275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c046070 con 0x55d591918590 2024-02-21T07:52:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f620f400640 1 -- 172.21.15.100:0/1245918275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c03b040 con 0x55d591918590 2024-02-21T07:52:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f620f400640 1 -- 172.21.15.100:0/1245918275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c005390 con 0x55d591918590 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d959c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d96791d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d960fd80 con 0x5555d95dd070 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d9612450 con 0x5555d95a1f90 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.598+0000 7f212b854740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d960f000 con 0x5555d96114d0 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.599+0000 7f212b854740 10 client.0 _ll_register_callbacks cb 0x7f21140093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.599+0000 7f2121400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.599+0000 7f2121400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56052/0 (socket says 172.21.15.100:56052) 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.599+0000 7f2121400640 1 -- 172.21.15.100:0/2019406572 learned_addr learned my addr 172.21.15.100:0/2019406572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2122800640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d96791d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121e00640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d959c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121400640 1 -- 172.21.15.100:0/2019406572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 msgr2=0x5555d96791d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121400640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d96791d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121400640 1 -- 172.21.15.100:0/2019406572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 msgr2=0x5555d959c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121400640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d959c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2121400640 1 -- 172.21.15.100:0/2019406572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555d9506c50 con 0x5555d95dd070 2024-02-21T07:52:15.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f2122800640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d96791d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 -- 172.21.15.100:0/1245918275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 msgr2=0x55d591919320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591919320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6224070470 tx=0x7f621c02e000 comp rx=0 tx=0).stop 2024-02-21T07:52:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 -- 172.21.15.100:0/1245918275 shutdown_connections 2024-02-21T07:52:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591919320 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591918050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 --2- 172.21.15.100:0/1245918275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918dcec0 0x55d5918dd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.600+0000 7f622cc33740 1 -- 172.21.15.100:0/1245918275 >> 172.21.15.100:0/1245918275 conn(0x55d59189f490 msgr2=0x55d5918a0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.601+0000 7f2121400640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f211c0093e0 tx=0x7f211c0b9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad538051d4fceed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.601+0000 7f2102a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.601+0000 7f622cc33740 1 -- 172.21.15.100:0/1245918275 shutdown_connections 2024-02-21T07:52:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.601+0000 7f622cc33740 1 -- 172.21.15.100:0/1245918275 wait complete. 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0ba400 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f211c0be550 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555d952dd30 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f211c0c2ba0 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f212b854740 10 client.6246 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.602+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5555d94c92c0 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.603+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555d952dd30 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.603+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f211c04f020 con 0x5555d95dd070 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 10 client.6246 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 10 client.6246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 20 client.6246 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bc10 0x5555d9619350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 4 client.6246 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:52:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5555d9208600 con 0x5555d959bc10 2024-02-21T07:52:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.604+0000 7f2121e00640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bc10 0x5555d9619350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.605+0000 7f622cc33740 1 -- start start 2024-02-21T07:52:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.605+0000 7f622cc33740 1 Processor -- start 2024-02-21T07:52:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.605+0000 7f2121e00640 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bc10 0x5555d9619350 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c3fe7223dc08aa3 server_cookie=378bf5cdad3e33d3 in_seq=0 out_seq=0 2024-02-21T07:52:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.605+0000 7f2102a00640 10 client.6246 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 0x55d59189b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5917ae150 con 0x55d5918d11f0 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5917addf0 con 0x55d591918590 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5915771c0 con 0x55d5918dd7e0 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f622cc33740 10 client.0 _ll_register_callbacks cb 0x55d5917fd2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f6223400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f6223400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58754/0 (socket says 172.21.15.100:58754) 2024-02-21T07:52:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f6223400640 1 -- 172.21.15.100:0/2311600974 learned_addr learned my addr 172.21.15.100:0/2311600974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.607+0000 7f6223e00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 0x55d59189b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 -- 172.21.15.100:0/2311600974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 msgr2=0x55d5918dae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6222a00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 -- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 msgr2=0x55d59189b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 0x55d59189b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 -- 172.21.15.100:0/2311600974 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622418eac0 con 0x55d5918dd7e0 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223e00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 0x55d59189b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6222a00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6223400640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6214005580 tx=0x7f621400f600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83a36ca92dda366c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6203e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.608+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214007030 con 0x55d5918dd7e0 2024-02-21T07:52:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.609+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6214007190 con 0x55d5918dd7e0 2024-02-21T07:52:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.609+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5915087e0 con 0x55d5918dd7e0 2024-02-21T07:52:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.609+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6214007350 con 0x55d5918dd7e0 2024-02-21T07:52:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.618+0000 7f622cc33740 10 client.6386 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.618+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d5918075a0 con 0x55d5918dd7e0 2024-02-21T07:52:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.632+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5915087e0 con 0x55d5918dd7e0 2024-02-21T07:52:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.632+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f62140074b0 con 0x55d5918dd7e0 2024-02-21T07:52:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 10 client.6386 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 10 client.6386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 20 client.6386 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d59189b6e0 0x55d5918cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 4 client.6386 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d591545720 con 0x55d59189b6e0 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.634+0000 7f6222a00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d59189b6e0 0x55d5918cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.636+0000 7f6222a00640 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d59189b6e0 0x55d5918cadd0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc535b4c57ff52b server_cookie=dfbc1de76fb19167 in_seq=0 out_seq=0 2024-02-21T07:52:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.636+0000 7f6203e00640 10 client.6386 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.664+0000 7f2102a00640 1 -- 172.21.15.100:0/2019406572 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5555d9208600 con 0x5555d959bc10 2024-02-21T07:52:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.664+0000 7f2102a00640 10 client.6246 handle_command_reply: tid=0 2024-02-21T07:52:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.665+0000 7f6203e00640 1 -- 172.21.15.100:0/2311600974 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d591545720 con 0x55d59189b6e0 2024-02-21T07:52:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.665+0000 7f6203e00640 10 client.6386 handle_command_reply: tid=0 2024-02-21T07:52:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.667+0000 7f622cc33740 1 client.6386 shutdown 2024-02-21T07:52:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.671+0000 7f212b854740 1 client.6246 shutdown 2024-02-21T07:52:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.671+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 msgr2=0x5555d96118d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.671+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f211c0093e0 tx=0x7f211c0b9d60 comp rx=0 tx=0).stop 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 shutdown_connections 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5555d959bc10 0x5555d9619350 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5555d96114d0 0x5555d96791d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5555d95dd070 0x5555d96118d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 --2- 172.21.15.100:0/2019406572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5555d95a1f90 0x5555d959c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.673+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 >> 172.21.15.100:0/2019406572 conn(0x5555d95694b0 msgr2=0x5555d9597bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 msgr2=0x55d59189de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6214005580 tx=0x7f621400f600 comp rx=0 tx=0).stop 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 shutdown_connections 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d59189b6e0 0x55d5918cadd0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918d11f0 0x55d59189b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 --2- 172.21.15.100:0/2311600974 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d59189de80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 >> 172.21.15.100:0/2311600974 conn(0x55d5918dcec0 msgr2=0x55d5918a0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.677+0000 7f6203e00640 0 client.6386 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.675+0000 7f2102a00640 0 client.6246 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.675+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 shutdown_connections 2024-02-21T07:52:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.675+0000 7f212b854740 1 -- 172.21.15.100:0/2019406572 wait complete. 2024-02-21T07:52:15.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.676+0000 7f212b854740 20 client.6246 trim_cache size 0 max 16384 2024-02-21T07:52:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.680+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 shutdown_connections 2024-02-21T07:52:15.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.680+0000 7f622cc33740 1 -- 172.21.15.100:0/2311600974 wait complete. 2024-02-21T07:52:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:52:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:52:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:52:15.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:52:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.685+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 msgr2=0x7f21040a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.685+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 0x7f21040a16b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2114020000 tx=0x7f211401c000 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.685+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 msgr2=0x7f2124223fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.685+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 0x7f2124223fb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2124092880 tx=0x7f211c004a40 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 shutdown_connections 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f212415d910 0x7f21242244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f21240fe440 0x7f2124223fb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f210409f1f0 0x7f21040a16b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 --2- 172.21.15.100:0/313739578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21240fc550 0x7f2124156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 >> 172.21.15.100:0/313739578 conn(0x7f212408cfd0 msgr2=0x7f21240d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 shutdown_connections 2024-02-21T07:52:15.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:15.686+0000 7f2128c00640 1 -- 172.21.15.100:0/313739578 wait complete. 2024-02-21T07:52:15.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.687+0000 7f622cc33740 20 client.6386 trim_cache size 0 max 16384 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.740+0000 7f622cc33740 1 Processor -- start 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.741+0000 7f622cc33740 1 -- start start 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 0x55d5918db5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591910f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591918970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5918d10b0 con 0x55d591918590 2024-02-21T07:52:15.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d59189c8e0 con 0x55d5918d11f0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f622cc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5918d0af0 con 0x55d5918dd7e0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f6223400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 0x55d5918db5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f6223400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 0x55d5918db5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45768/0 (socket says 172.21.15.100:45768) 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.743+0000 7f6223400640 1 -- 172.21.15.100:0/883781420 learned_addr learned my addr 172.21.15.100:0/883781420 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.744+0000 7f6223e00640 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591918970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6222a00640 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591910f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6223e00640 1 -- 172.21.15.100:0/883781420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 msgr2=0x55d591910f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6223e00640 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591910f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6223e00640 1 -- 172.21.15.100:0/883781420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 msgr2=0x55d5918db5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6223e00640 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 0x55d5918db5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.748+0000 7f6223e00640 1 -- 172.21.15.100:0/883781420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5917a3ab0 con 0x55d591918590 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.749+0000 7f6223e00640 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591918970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f622408de80 tx=0x7f621c037070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eda05eafc0f656a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.750+0000 7f620ea00640 1 -- 172.21.15.100:0/883781420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c046040 con 0x55d591918590 2024-02-21T07:52:15.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.750+0000 7f620ea00640 1 -- 172.21.15.100:0/883781420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0052d0 con 0x55d591918590 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.751+0000 7f620ea00640 1 -- 172.21.15.100:0/883781420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c046040 con 0x55d591918590 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.751+0000 7f622cc33740 1 -- 172.21.15.100:0/883781420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 msgr2=0x55d591918970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.751+0000 7f622cc33740 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591918970 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f622408de80 tx=0x7f621c037070 comp rx=0 tx=0).stop 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.752+0000 7f622cc33740 1 -- 172.21.15.100:0/883781420 shutdown_connections 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.752+0000 7f622cc33740 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d591918590 0x55d591918970 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.752+0000 7f622cc33740 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918dd7e0 0x55d591910f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.752+0000 7f622cc33740 1 --2- 172.21.15.100:0/883781420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5918d11f0 0x55d5918db5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.752+0000 7f622cc33740 1 -- 172.21.15.100:0/883781420 >> 172.21.15.100:0/883781420 conn(0x55d5918dcec0 msgr2=0x55d5918a0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.771+0000 7f622cc33740 1 -- 172.21.15.100:0/883781420 shutdown_connections 2024-02-21T07:52:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.774+0000 7f622cc33740 1 -- 172.21.15.100:0/883781420 wait complete. 2024-02-21T07:52:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.775+0000 7f622cc33740 1 -- start start 2024-02-21T07:52:15.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.775+0000 7f622cc33740 1 Processor -- start 2024-02-21T07:52:15.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.785+0000 7f622cc33740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.786+0000 7f6223400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.788+0000 7f6223400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56090/0 (socket says 172.21.15.100:56090) 2024-02-21T07:52:15.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.788+0000 7f6223400640 1 -- 172.21.15.100:0/3315864151 learned_addr learned my addr 172.21.15.100:0/3315864151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:15.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.788+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.789+0000 7f6222a00640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.789+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918c72c0 0x55d591957380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.792+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5918cec30 con 0x55d5918dd7e0 2024-02-21T07:52:15.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.792+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d591922060 con 0x55d591918590 2024-02-21T07:52:15.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.792+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5918dc3c0 con 0x55d5918c72c0 2024-02-21T07:52:15.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.794+0000 7f622cc33740 10 client.0 _ll_register_callbacks cb 0x7f62080036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:15.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223400640 1 -- 172.21.15.100:0/3315864151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918c72c0 msgr2=0x55d591957380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223e00640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918c72c0 0x55d591957380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223400640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918c72c0 0x55d591957380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223400640 1 -- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 msgr2=0x55d5918dba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223400640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.795+0000 7f6223400640 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5917cadf0 con 0x55d5918dd7e0 2024-02-21T07:52:15.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.796+0000 7f6222a00640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.797+0000 7f6203e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:15.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.797+0000 7f6223400640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6214007fd0 tx=0x7f6214003760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49159830ad202115 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:15.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.799+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621401e620 con 0x55d5918dd7e0 2024-02-21T07:52:15.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.799+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f621c03b040 con 0x55d5918dd7e0 2024-02-21T07:52:15.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.799+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f621401e780 con 0x55d5918dd7e0 2024-02-21T07:52:15.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.801+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f621401e620 con 0x55d5918dd7e0 2024-02-21T07:52:15.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.801+0000 7f622cc33740 10 client.6255 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:15.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.801+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d5917c9650 con 0x55d5918dd7e0 2024-02-21T07:52:15.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c03b040 con 0x55d5918dd7e0 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f621401e940 con 0x55d5918dd7e0 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 10 client.6255 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 10 client.6255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 20 client.6255 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d5919578c0 0x55d591928f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 4 client.6255 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.802+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d591594890 con 0x55d5919578c0 2024-02-21T07:52:15.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.803+0000 7f6222a00640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d5919578c0 0x55d591928f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:15.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.805+0000 7f6222a00640 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d5919578c0 0x55d591928f20 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e60e4aefd44df8 server_cookie=c7ade6f7b578c75a in_seq=0 out_seq=0 2024-02-21T07:52:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.805+0000 7f6203e00640 10 client.6255 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.805+0000 7f6203e00640 1 -- 172.21.15.100:0/3315864151 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d591594890 con 0x55d5919578c0 2024-02-21T07:52:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.805+0000 7f6203e00640 10 client.6255 handle_command_reply: tid=0 2024-02-21T07:52:15.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.806+0000 7f622cc33740 1 client.6255 shutdown 2024-02-21T07:52:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.810+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 msgr2=0x55d591921390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.810+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6214007fd0 tx=0x7f6214003760 comp rx=0 tx=0).stop 2024-02-21T07:52:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.810+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 shutdown_connections 2024-02-21T07:52:15.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.810+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d5919578c0 0x55d591928f20 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.811+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d5918c72c0 0x55d591957380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.811+0000 7f6203e00640 0 client.6255 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.811+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d591918590 0x55d5918dba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.811+0000 7f622cc33740 1 --2- 172.21.15.100:0/3315864151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d5918dd7e0 0x55d591921390 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.811+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 >> 172.21.15.100:0/3315864151 conn(0x55d5918dcec0 msgr2=0x55d5918a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.814+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 shutdown_connections 2024-02-21T07:52:15.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.815+0000 7f622cc33740 1 -- 172.21.15.100:0/3315864151 wait complete. 2024-02-21T07:52:15.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.815+0000 7f622cc33740 20 client.6255 trim_cache size 0 max 16384 2024-02-21T07:52:15.820 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.818+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 msgr2=0x7f62040a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.818+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 0x7f62040a16b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f620800c620 tx=0x7f621c030000 comp rx=0 tx=0).stop 2024-02-21T07:52:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.818+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 msgr2=0x7f6224216da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.818+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6210007680 tx=0x7f621000f5a0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 shutdown_connections 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62242172e0 0x7f6224225d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f620409f1f0 0x7f62040a16b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6224182d00 0x7f6224216da0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 --2- 172.21.15.100:0/56239267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6208009970 0x7f6224170e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 >> 172.21.15.100:0/56239267 conn(0x7f62240668b0 msgr2=0x7f6224073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:15.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.819+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 shutdown_connections 2024-02-21T07:52:15.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:15.820+0000 7f622a000640 1 -- 172.21.15.100:0/56239267 wait complete. 2024-02-21T07:52:16.860 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:52:16.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:52:16.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:52:17.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.272+0000 7ffbd6200640 1 Processor -- start 2024-02-21T07:52:17.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.272+0000 7ffbd6200640 1 -- start start 2024-02-21T07:52:17.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbd6200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 0x7ffbd006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbd6200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ffbd00ca750 0x7ffbd00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbd6200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd006da60 con 0x7ffbd0187390 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbd6200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd006e6e0 con 0x7ffbd0184050 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbd6200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd006dd40 con 0x7ffbd00ca750 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbcf400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 0x7ffbd006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbcf400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 0x7ffbd006eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56096/0 (socket says 172.21.15.100:56096) 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.290+0000 7ffbcf400640 1 -- 172.21.15.100:0/3907674956 learned_addr learned my addr 172.21.15.100:0/3907674956 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.291+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3907674956 >> v2:172.21.15.156:3300/0 conn(0x7ffbd00ca750 0x7ffbd00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.291+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3907674956 >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 msgr2=0x7ffbd006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.291+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3907674956 >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 0x7ffbd006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.291+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3907674956 >> v1:172.21.15.156:6789/0 conn(0x7ffbd0187390 legacy=0x7ffbd0184620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.291+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3907674956 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd006e020 con 0x7ffbd00ca750 2024-02-21T07:52:17.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.293+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3907674956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd00ca750 0x7ffbd00caba0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00f7e20 tx=0x7ffbc002b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a5a8dcfd4bf7f58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.293+0000 7ffbce000640 1 -- 172.21.15.100:0/3907674956 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030710 con 0x7ffbd00ca750 2024-02-21T07:52:17.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.293+0000 7ffbce000640 1 -- 172.21.15.100:0/3907674956 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc002e050 con 0x7ffbd00ca750 2024-02-21T07:52:17.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.293+0000 7ffbce000640 1 -- 172.21.15.100:0/3907674956 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030a70 con 0x7ffbd00ca750 2024-02-21T07:52:17.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.295+0000 7ffbd6200640 1 -- 172.21.15.100:0/3907674956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd00ca750 msgr2=0x7ffbd00caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.295+0000 7ffbd6200640 1 --2- 172.21.15.100:0/3907674956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd00ca750 0x7ffbd00caba0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00f7e20 tx=0x7ffbc002b620 comp rx=0 tx=0).stop 2024-02-21T07:52:17.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.296+0000 7ffbd6200640 1 -- 172.21.15.100:0/3907674956 shutdown_connections 2024-02-21T07:52:17.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.296+0000 7ffbd6200640 1 --2- 172.21.15.100:0/3907674956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd00ca750 0x7ffbd00caba0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.296+0000 7ffbd6200640 1 --2- 172.21.15.100:0/3907674956 >> v2:172.21.15.100:3300/0 conn(0x7ffbd0184050 0x7ffbd006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.296+0000 7ffbd6200640 1 -- 172.21.15.100:0/3907674956 >> 172.21.15.100:0/3907674956 conn(0x7ffbd00668b0 msgr2=0x7ffbd0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.297+0000 7ffbd6200640 1 -- 172.21.15.100:0/3907674956 shutdown_connections 2024-02-21T07:52:17.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.297+0000 7ffbd6200640 1 -- 172.21.15.100:0/3907674956 wait complete. 2024-02-21T07:52:17.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.300+0000 7ffbd6200640 1 Processor -- start 2024-02-21T07:52:17.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.302+0000 7ffbd6200640 1 -- start start 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 0x7ffbd016d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbd0187390 0x7ffbd02201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd021fcd0 con 0x7ffbd00ca750 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0176c90 con 0x7ffbd0184050 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.303+0000 7ffbd6200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd0176f70 con 0x7ffbd0187390 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45800/0 (socket says 172.21.15.100:45800) 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 -- 172.21.15.100:0/2398738618 learned_addr learned my addr 172.21.15.100:0/2398738618 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbd0187390 0x7ffbd02201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 0x7ffbd016d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 -- 172.21.15.100:0/2398738618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbd0187390 msgr2=0x7ffbd02201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbd0187390 0x7ffbd02201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.304+0000 7ffbcea00640 1 -- 172.21.15.100:0/2398738618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 msgr2=0x7ffbd016d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.305+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 0x7ffbd016d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.305+0000 7ffbcea00640 1 -- 172.21.15.100:0/2398738618 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009400 con 0x7ffbd0184050 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.305+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 0x7ffbd016d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.305+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800caf0 tx=0x7ffbc80020b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.306+0000 7ffbc7400640 1 -- 172.21.15.100:0/2398738618 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8003da0 con 0x7ffbd0184050 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.306+0000 7ffbc7400640 1 -- 172.21.15.100:0/2398738618 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800a6e0 con 0x7ffbd0184050 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.306+0000 7ffbc7400640 1 -- 172.21.15.100:0/2398738618 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800aab0 con 0x7ffbd0184050 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.306+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd0177250 con 0x7ffbd0184050 2024-02-21T07:52:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.306+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd016dd70 con 0x7ffbd0184050 2024-02-21T07:52:17.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.311+0000 7ffbc7400640 1 -- 172.21.15.100:0/2398738618 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ffbc800ac10 con 0x7ffbd0184050 2024-02-21T07:52:17.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.312+0000 7ffbd8e50740 1 Processor -- start 2024-02-21T07:52:17.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.312+0000 7ffbd8e50740 1 -- start start 2024-02-21T07:52:17.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.313+0000 7ffbc7400640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 0x7ffbb00a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.313+0000 7ffbc7400640 1 -- 172.21.15.100:0/2398738618 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbc80c9540 con 0x7ffbd0184050 2024-02-21T07:52:17.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.313+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 0x7ffbb00a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 0x55c5b5f0f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f4a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 0x55c5b5f4b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5e8f300 con 0x55c5b5f0fae0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5e41e50 con 0x55c5b5f0f1c0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5e3f380 con 0x55c5b5f4a890 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 0x55c5b5f0f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f4a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 0x55c5b5f0f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45816/0 (socket says 172.21.15.100:45816) 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcf400640 1 -- 172.21.15.100:0/2271449577 learned_addr learned my addr 172.21.15.100:0/2271449577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 0x55c5b5f4b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.314+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 0x7ffbb00a1590 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 -- 172.21.15.100:0/2271449577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 msgr2=0x55c5b5f4b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 0x55c5b5f4b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 -- 172.21.15.100:0/2271449577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 msgr2=0x55c5b5f0f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 0x55c5b5f0f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 -- 172.21.15.100:0/2271449577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5b5e03c80 con 0x55c5b5f0fae0 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 0x55c5b5f4b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f4a350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80c6eb0 tx=0x7ffbc8096a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255cce194a4e1bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbbb400640 1 -- 172.21.15.100:0/2271449577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc809f7c0 con 0x55c5b5f0fae0 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbbb400640 1 -- 172.21.15.100:0/2271449577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc80953d0 con 0x55c5b5f0fae0 2024-02-21T07:52:17.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.315+0000 7ffbbb400640 1 -- 172.21.15.100:0/2271449577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8097330 con 0x55c5b5f0fae0 2024-02-21T07:52:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2271449577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 msgr2=0x55c5b5f4a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f4a350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80c6eb0 tx=0x7ffbc8096a30 comp rx=0 tx=0).stop 2024-02-21T07:52:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2271449577 shutdown_connections 2024-02-21T07:52:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f4a890 0x55c5b5f4b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f4a350 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2271449577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f0f1c0 0x55c5b5f0f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2271449577 >> 172.21.15.100:0/2271449577 conn(0x55c5b5ed1790 msgr2=0x55c5b5ed2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2271449577 shutdown_connections 2024-02-21T07:52:17.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.317+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2271449577 wait complete. 2024-02-21T07:52:17.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.320+0000 7ffbd8e50740 1 -- start start 2024-02-21T07:52:17.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.320+0000 7ffbd8e50740 1 Processor -- start 2024-02-21T07:52:17.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.329+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f0e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.330+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 0x55c5b5f06860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.331+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.332+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.332+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45828/0 (socket says 172.21.15.100:45828) 2024-02-21T07:52:17.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.332+0000 7ffbcfe00640 1 -- 172.21.15.100:0/2029855238 learned_addr learned my addr 172.21.15.100:0/2029855238 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.335+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5e3ab60 con 0x55c5b5f4a890 2024-02-21T07:52:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.335+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5ddffd0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.335+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5ddfc70 con 0x55c5b5f0fae0 2024-02-21T07:52:17.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.336+0000 7ffbd8e50740 10 client.0 _ll_register_callbacks cb 0x55c5b5b4bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:17.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.337+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f0e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.339+0000 7ffbcfe00640 1 -- 172.21.15.100:0/2029855238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 msgr2=0x55c5b5f0e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.339+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 0x55c5b5f06860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.340+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f0e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.340+0000 7ffbcfe00640 1 -- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 msgr2=0x55c5b5f06860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.340+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 0x55c5b5f06860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.341+0000 7ffbcfe00640 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd016dd70 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.342+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f0e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:17.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.342+0000 7ffbcea00640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 0x55c5b5f06860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.344+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0003da0 tx=0x7ffbc0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871b2ef676e60ce2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.345+0000 7ffbafe00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.345+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030920 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.345+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbc0043070 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.346+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5b5b3a860 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.349+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc0030920 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.350+0000 7ffbd8e50740 10 client.6436 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:17.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.350+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5b5e391e0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.351+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5b5b3a860 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.352+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffbc0046040 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.352+0000 7ffbd8e50740 10 client.6436 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.353+0000 7ffbd8e50740 10 client.6436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.353+0000 7ffbd8e50740 20 client.6436 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.353+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f0dea0 0x55c5b5f56a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.353+0000 7ffbd8e50740 4 client.6436 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:17.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.353+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5b5b8b410 con 0x55c5b5f0dea0 2024-02-21T07:52:17.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.356+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f0dea0 0x55c5b5f56a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.357+0000 7ffbcf400640 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f0dea0 0x55c5b5f56a50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=446883474164944a server_cookie=befae78599034fd3 in_seq=0 out_seq=0 2024-02-21T07:52:17.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.357+0000 7ffbafe00640 10 client.6436 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.358+0000 7ffbafe00640 1 -- 172.21.15.100:0/2029855238 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c5b5b8b410 con 0x55c5b5f0dea0 2024-02-21T07:52:17.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.358+0000 7ffbafe00640 10 client.6436 handle_command_reply: tid=0 2024-02-21T07:52:17.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.359+0000 7ffbd8e50740 1 client.6436 shutdown 2024-02-21T07:52:17.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 msgr2=0x55c5b5ece960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0003da0 tx=0x7ffbc0004730 comp rx=0 tx=0).stop 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 shutdown_connections 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f0dea0 0x55c5b5f56a50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5ece960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f4a890 0x55c5b5f06860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/2029855238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5f0e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 >> 172.21.15.100:0/2029855238 conn(0x55c5b5f0f1c0 msgr2=0x55c5b5ed3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.360+0000 7ffbafe00640 0 client.6436 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.361+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 shutdown_connections 2024-02-21T07:52:17.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.361+0000 7ffbd8e50740 1 -- 172.21.15.100:0/2029855238 wait complete. 2024-02-21T07:52:17.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.362+0000 7ffbd8e50740 20 client.6436 trim_cache size 0 max 16384 2024-02-21T07:52:17.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.399+0000 7ffbd8e50740 1 Processor -- start 2024-02-21T07:52:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.399+0000 7ffbd8e50740 1 -- start start 2024-02-21T07:52:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.401+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.401+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ecfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.401+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5b830c0 con 0x55c5b5f0fae0 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5f485f0 con 0x55c5b5f4a890 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5ed03a0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbcfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45842/0 (socket says 172.21.15.100:45842) 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3492166797 learned_addr learned my addr 172.21.15.100:0/3492166797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.402+0000 7ffbcf400640 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcea00640 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ecfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3492166797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5ef9ad0 msgr2=0x55c5b5f012e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f012e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3492166797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 msgr2=0x55c5b5ecfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ecfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 -- 172.21.15.100:0/3492166797 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5b5dd5a90 con 0x55c5b5f4a890 2024-02-21T07:52:17.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.403+0000 7ffbcfe00640 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009250 tx=0x7ffbc004b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef96ac595be9dd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.405+0000 7ffbbaa00640 1 -- 172.21.15.100:0/3492166797 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0030920 con 0x55c5b5f4a890 2024-02-21T07:52:17.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.405+0000 7ffbbaa00640 1 -- 172.21.15.100:0/3492166797 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0041070 con 0x55c5b5f4a890 2024-02-21T07:52:17.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.406+0000 7ffbd8e50740 1 -- 172.21.15.100:0/3492166797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 msgr2=0x55c5b5faf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.406+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0009250 tx=0x7ffbc004b070 comp rx=0 tx=0).stop 2024-02-21T07:52:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 -- 172.21.15.100:0/3492166797 shutdown_connections 2024-02-21T07:52:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5faf4a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ecfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/3492166797 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 -- 172.21.15.100:0/3492166797 >> 172.21.15.100:0/3492166797 conn(0x55c5b5f0f1c0 msgr2=0x55c5b5ed3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 -- 172.21.15.100:0/3492166797 shutdown_connections 2024-02-21T07:52:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.407+0000 7ffbd8e50740 1 -- 172.21.15.100:0/3492166797 wait complete. 2024-02-21T07:52:17.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.409+0000 7ffbd8e50740 1 -- start start 2024-02-21T07:52:17.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.409+0000 7ffbd8e50740 1 Processor -- start 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ed8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5ef2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5fbb970 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5ecd7f0 con 0x55c5b5f4a890 2024-02-21T07:52:17.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5b5ef2570 con 0x55c5b5f0fae0 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.411+0000 7ffbd8e50740 10 client.0 _ll_register_callbacks cb 0x7ffbc8003f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56156/0 (socket says 172.21.15.100:56156) 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 -- 172.21.15.100:0/1157850663 learned_addr learned my addr 172.21.15.100:0/1157850663 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcea00640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ed8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 -- 172.21.15.100:0/1157850663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 msgr2=0x55c5b5ed8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ed8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 -- 172.21.15.100:0/1157850663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 msgr2=0x55c5b5ef2a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5ef2a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.412+0000 7ffbcf400640 1 -- 172.21.15.100:0/1157850663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5b5e391e0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.413+0000 7ffbcea00640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ed8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.413+0000 7ffbcf400640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01edb0 tx=0x7ffbbc017410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9023418eb4bf3e15 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.413+0000 7ffbafe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.413+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc01c040 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.414+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbbc004240 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.414+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbc80953d0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.414+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbbc004400 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.414+0000 7ffbd8e50740 10 client.6267 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.414+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5b5dfb6a0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc80953d0 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffbbc026070 con 0x55c5b5ef9ad0 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 10 client.6267 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 10 client.6267 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 20 client.6267 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f4b100 0x55c5b5f12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 4 client.6267 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:52:17.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.415+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c5b5b777b0 con 0x55c5b5f4b100 2024-02-21T07:52:17.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.416+0000 7ffbcea00640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f4b100 0x55c5b5f12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.416+0000 7ffbcea00640 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f4b100 0x55c5b5f12c20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b4370d1243eab9 server_cookie=ca333638278fb415 in_seq=0 out_seq=0 2024-02-21T07:52:17.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.417+0000 7ffbafe00640 10 client.6267 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.420+0000 7ffbafe00640 1 -- 172.21.15.100:0/1157850663 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c5b5b777b0 con 0x55c5b5f4b100 2024-02-21T07:52:17.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.420+0000 7ffbafe00640 10 client.6267 handle_command_reply: tid=0 2024-02-21T07:52:17.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.420+0000 7ffbd8e50740 1 client.6267 shutdown 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 msgr2=0x55c5b5f12630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc01edb0 tx=0x7ffbbc017410 comp rx=0 tx=0).stop 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 shutdown_connections 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5b5f4b100 0x55c5b5f12c20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5b5f4a890 0x55c5b5ef2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5b5f0fae0 0x55c5b5ed8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 --2- 172.21.15.100:0/1157850663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5b5ef9ad0 0x55c5b5f12630 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 >> 172.21.15.100:0/1157850663 conn(0x55c5b5f0f1c0 msgr2=0x55c5b5ed3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.421+0000 7ffbafe00640 0 client.6267 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.422+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 shutdown_connections 2024-02-21T07:52:17.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.422+0000 7ffbd8e50740 1 -- 172.21.15.100:0/1157850663 wait complete. 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.422+0000 7ffbd8e50740 20 client.6267 trim_cache size 0 max 16384 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "9df1e2cd-87a2-454d-aa95-ed6bb494f823", 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:52:17.426 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.424+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 msgr2=0x7ffbb00a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.424+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 0x7ffbb00a1590 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0034000 tx=0x7ffbc0008030 comp rx=0 tx=0).stop 2024-02-21T07:52:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.424+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 msgr2=0x7ffbd021eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.424+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800caf0 tx=0x7ffbc80020b0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 shutdown_connections 2024-02-21T07:52:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbd0187390 0x7ffbd02201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbd0184050 0x7ffbd021eeb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffbb009f0d0 0x7ffbb00a1590 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 --2- 172.21.15.100:0/2398738618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbd00ca750 0x7ffbd016d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 >> 172.21.15.100:0/2398738618 conn(0x7ffbd00668b0 msgr2=0x7ffbd006f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 shutdown_connections 2024-02-21T07:52:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.427+0000 7ffbd6200640 1 -- 172.21.15.100:0/2398738618 wait complete. 2024-02-21T07:52:17.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:52:17.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:52:17.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.785+0000 7f4cf2a00640 1 Processor -- start 2024-02-21T07:52:17.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.785+0000 7f4cf2a00640 1 -- start start 2024-02-21T07:52:17.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.793+0000 7f4cf2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cec1808d0 0x7f4cec0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.793+0000 7f4cf2a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4cec0cb960 0x7f4cec18a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.793+0000 7f4cf2a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0f7e70 con 0x7f4cec0f8300 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.793+0000 7f4cf2a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0cbd70 con 0x7f4cec1808d0 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.793+0000 7f4cf2a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec180cb0 con 0x7f4cec0cb960 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4cec0cb960 0x7f4cec18a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4cec0cb960 0x7f4cec18a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58830/0 (socket says 172.21.15.100:58830) 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1084424817 learned_addr learned my addr 172.21.15.100:0/1084424817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1084424817 >> v2:172.21.15.156:3300/0 conn(0x7f4cec1808d0 msgr2=0x7f4cec0cb420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/1084424817 >> v2:172.21.15.156:3300/0 conn(0x7f4cec1808d0 0x7f4cec0cb420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1084424817 >> v1:172.21.15.170:6789/0 conn(0x7f4cec0f8300 legacy=0x7f4cec189de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.794+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1084424817 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0f6f80 con 0x7f4cec0cb960 2024-02-21T07:52:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.798+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/1084424817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec0cb960 0x7f4cec18a4f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4cec08f540 tx=0x7f4ce402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26db2ed5645333b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.801+0000 7f4ceaa00640 1 -- 172.21.15.100:0/1084424817 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce402caa0 con 0x7f4cec0cb960 2024-02-21T07:52:17.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.801+0000 7f4ceaa00640 1 -- 172.21.15.100:0/1084424817 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce402cc00 con 0x7f4cec0cb960 2024-02-21T07:52:17.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.801+0000 7f4ceaa00640 1 -- 172.21.15.100:0/1084424817 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40343f0 con 0x7f4cec0cb960 2024-02-21T07:52:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 -- 172.21.15.100:0/1084424817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec0cb960 msgr2=0x7f4cec18a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/1084424817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec0cb960 0x7f4cec18a4f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4cec08f540 tx=0x7f4ce402bf00 comp rx=0 tx=0).stop 2024-02-21T07:52:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 -- 172.21.15.100:0/1084424817 shutdown_connections 2024-02-21T07:52:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/1084424817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec0cb960 0x7f4cec18a4f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/1084424817 >> v2:172.21.15.156:3300/0 conn(0x7f4cec1808d0 0x7f4cec0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 -- 172.21.15.100:0/1084424817 >> 172.21.15.100:0/1084424817 conn(0x7f4cec0d05b0 msgr2=0x7f4cec0d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 -- 172.21.15.100:0/1084424817 shutdown_connections 2024-02-21T07:52:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.802+0000 7f4cf2a00640 1 -- 172.21.15.100:0/1084424817 wait complete. 2024-02-21T07:52:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.806+0000 7f4cf2a00640 1 Processor -- start 2024-02-21T07:52:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.806+0000 7f4cf2a00640 1 -- start start 2024-02-21T07:52:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cec0cb960 0x7f4cec17ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 0x7f4cec16f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 0x7f4cec1732e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec170e60 con 0x7f4cec0cb960 2024-02-21T07:52:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec175f80 con 0x7f4cec0f8300 2024-02-21T07:52:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.807+0000 7f4cf2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec170530 con 0x7f4cec1808d0 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.808+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 0x7f4cec1732e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.808+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 0x7f4cec1732e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58832/0 (socket says 172.21.15.100:58832) 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.808+0000 7f4cf0a00640 1 -- 172.21.15.100:0/862257480 learned_addr learned my addr 172.21.15.100:0/862257480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.808+0000 7f4ceb400640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 0x7f4cec16f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 -- 172.21.15.100:0/862257480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 msgr2=0x7f4cec1732e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 0x7f4cec1732e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 -- 172.21.15.100:0/862257480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cec0cb960 msgr2=0x7f4cec17ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cec0cb960 0x7f4cec17ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 -- 172.21.15.100:0/862257480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce4009b30 con 0x7f4cec0f8300 2024-02-21T07:52:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4ceb400640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 0x7f4cec16f9e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009fd0 tx=0x7f4cd800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4cdfe00640 1 -- 172.21.15.100:0/862257480 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011830 con 0x7f4cec0f8300 2024-02-21T07:52:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4cdfe00640 1 -- 172.21.15.100:0/862257480 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8011990 con 0x7f4cec0f8300 2024-02-21T07:52:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4cdfe00640 1 -- 172.21.15.100:0/862257480 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011da0 con 0x7f4cec0f8300 2024-02-21T07:52:17.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.809+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec170810 con 0x7f4cec0f8300 2024-02-21T07:52:17.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.810+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec16ff20 con 0x7f4cec0f8300 2024-02-21T07:52:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.815+0000 7f4cdfe00640 1 -- 172.21.15.100:0/862257480 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4cd801a400 con 0x7f4cec0f8300 2024-02-21T07:52:17.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.816+0000 7f4cf57c8740 1 Processor -- start 2024-02-21T07:52:17.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.816+0000 7f4cf57c8740 1 -- start start 2024-02-21T07:52:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636361f5150 con 0x5636362be8e0 2024-02-21T07:52:17.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636361f2680 con 0x5636362f3f80 2024-02-21T07:52:17.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.819+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636361ede60 con 0x5636362bdfc0 2024-02-21T07:52:17.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.820+0000 7f4cebe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.820+0000 7f4ceb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.820+0000 7f4cebe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45864/0 (socket says 172.21.15.100:45864) 2024-02-21T07:52:17.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.820+0000 7f4cebe00640 1 -- 172.21.15.100:0/3004260375 learned_addr learned my addr 172.21.15.100:0/3004260375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.820+0000 7f4cdfe00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 0x7f4ccc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cdfe00640 1 -- 172.21.15.100:0/862257480 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4cd80c9cf0 con 0x7f4cec0f8300 2024-02-21T07:52:17.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cebe00640 1 -- 172.21.15.100:0/3004260375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 msgr2=0x5636362f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cebe00640 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cebe00640 1 -- 172.21.15.100:0/3004260375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 msgr2=0x563636280ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cebe00640 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.821+0000 7f4cebe00640 1 -- 172.21.15.100:0/3004260375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636361a7060 con 0x5636362f3f80 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.822+0000 7f4cebe00640 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00015d0 tx=0x7f4ce00019d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70314cd92894fd0d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.822+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.822+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 0x7f4ccc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.823+0000 7f4cd3e00640 1 -- 172.21.15.100:0/3004260375 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0016070 con 0x5636362f3f80 2024-02-21T07:52:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.823+0000 7f4cd3e00640 1 -- 172.21.15.100:0/3004260375 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce0006850 con 0x5636362f3f80 2024-02-21T07:52:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.823+0000 7f4cd3e00640 1 -- 172.21.15.100:0/3004260375 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0006c00 con 0x5636362f3f80 2024-02-21T07:52:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.824+0000 7f4cf57c8740 1 -- 172.21.15.100:0/3004260375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 msgr2=0x5636362be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.824+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00015d0 tx=0x7f4ce00019d0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.827+0000 7f4cf57c8740 1 -- 172.21.15.100:0/3004260375 shutdown_connections 2024-02-21T07:52:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.827+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.827+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362f3f80 0x5636362be3a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.827+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/3004260375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.827+0000 7f4cf57c8740 1 -- 172.21.15.100:0/3004260375 >> 172.21.15.100:0/3004260375 conn(0x56363624d5a0 msgr2=0x563636284eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.835+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 0x7f4ccc0a16b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0f6bc0 tx=0x7f4ce4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.836+0000 7f4cf57c8740 1 -- 172.21.15.100:0/3004260375 shutdown_connections 2024-02-21T07:52:17.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.836+0000 7f4cf57c8740 1 -- 172.21.15.100:0/3004260375 wait complete. 2024-02-21T07:52:17.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.842+0000 7f4cf57c8740 1 -- start start 2024-02-21T07:52:17.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.843+0000 7f4cf57c8740 1 Processor -- start 2024-02-21T07:52:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362bdfc0 0x5636362c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x5636362b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563636192ec0 con 0x5636362be8e0 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563636192b60 con 0x5636362bdfc0 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563635f5c1c0 con 0x5636362f3f80 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf57c8740 10 client.0 _ll_register_callbacks cb 0x5636361a6960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58856/0 (socket says 172.21.15.100:58856) 2024-02-21T07:52:17.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.845+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1212906859 learned_addr learned my addr 172.21.15.100:0/1212906859 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x5636362b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1212906859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362bdfc0 msgr2=0x5636362c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362bdfc0 0x5636362c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 msgr2=0x5636362b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x5636362b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1212906859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce00011e0 con 0x5636362f3f80 2024-02-21T07:52:17.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.846+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x5636362b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.847+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034d60 tx=0x7f4ce4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c7da1e9062d746a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.847+0000 7f4cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:17.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.848+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce404b660 con 0x5636362f3f80 2024-02-21T07:52:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.848+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ce404b7c0 con 0x5636362f3f80 2024-02-21T07:52:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.848+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563635eed7e0 con 0x5636362f3f80 2024-02-21T07:52:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.849+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ce404b980 con 0x5636362f3f80 2024-02-21T07:52:17.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.849+0000 7f4cf57c8740 10 client.6407 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:17.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.849+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5636361ec4e0 con 0x5636362f3f80 2024-02-21T07:52:17.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563635eed7e0 con 0x5636362f3f80 2024-02-21T07:52:17.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ce403c040 con 0x5636362f3f80 2024-02-21T07:52:17.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 10 client.6407 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:17.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 10 client.6407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:17.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 20 client.6407 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:17.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56363628ca50 0x5636362b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 4 client.6407 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:17.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.851+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563635f2a720 con 0x56363628ca50 2024-02-21T07:52:17.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.854+0000 7f4cebe00640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56363628ca50 0x5636362b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.855+0000 7f4cebe00640 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56363628ca50 0x5636362b60a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f1c17aebe3e7baf server_cookie=8b2de444371521f6 in_seq=0 out_seq=0 2024-02-21T07:52:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.855+0000 7f4cd0c00640 10 client.6407 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.856+0000 7f4cd0c00640 1 -- 172.21.15.100:0/1212906859 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563635f2a720 con 0x56363628ca50 2024-02-21T07:52:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.856+0000 7f4cd0c00640 10 client.6407 handle_command_reply: tid=0 2024-02-21T07:52:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.856+0000 7f4cf57c8740 1 client.6407 shutdown 2024-02-21T07:52:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.856+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 msgr2=0x563636305ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.856+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034d60 tx=0x7f4ce4004ab0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 shutdown_connections 2024-02-21T07:52:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56363628ca50 0x5636362b60a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362f3f80 0x563636305ab0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x5636362b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1212906859 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5636362bdfc0 0x5636362c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 >> 172.21.15.100:0/1212906859 conn(0x56363624d5a0 msgr2=0x5636362f5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cd0c00640 0 client.6407 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 shutdown_connections 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1212906859 wait complete. 2024-02-21T07:52:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.857+0000 7f4cf57c8740 20 client.6407 trim_cache size 0 max 16384 2024-02-21T07:52:17.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.882+0000 7f4cf57c8740 1 Processor -- start 2024-02-21T07:52:17.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.882+0000 7f4cf57c8740 1 -- start start 2024-02-21T07:52:17.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.884+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.884+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.884+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x5636362b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.885+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563636282670 con 0x5636362be8e0 2024-02-21T07:52:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.885+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636362b5a70 con 0x563636302ed0 2024-02-21T07:52:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.885+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636362c82b0 con 0x5636362bdfc0 2024-02-21T07:52:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.886+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x5636362b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.886+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x5636362b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45874/0 (socket says 172.21.15.100:45874) 2024-02-21T07:52:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.886+0000 7f4cf0a00640 1 -- 172.21.15.100:0/1022309798 learned_addr learned my addr 172.21.15.100:0/1022309798 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.886+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.885+0000 7f4cebe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 -- 172.21.15.100:0/1022309798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 msgr2=0x5636362c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 -- 172.21.15.100:0/1022309798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 msgr2=0x5636362b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x5636362b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 -- 172.21.15.100:0/1022309798 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563636188950 con 0x5636362be8e0 2024-02-21T07:52:17.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.887+0000 7f4ceb400640 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80c7660 tx=0x7f4cd80957e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedf73ade4cd4175 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.888+0000 7f4cd3400640 1 -- 172.21.15.100:0/1022309798 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8095910 con 0x5636362be8e0 2024-02-21T07:52:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.889+0000 7f4cd3400640 1 -- 172.21.15.100:0/1022309798 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8097ed0 con 0x5636362be8e0 2024-02-21T07:52:17.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.889+0000 7f4cd3400640 1 -- 172.21.15.100:0/1022309798 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd80977d0 con 0x5636362be8e0 2024-02-21T07:52:17.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.892+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1022309798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 msgr2=0x563636280a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.892+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80c7660 tx=0x7f4cd80957e0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.893+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1022309798 shutdown_connections 2024-02-21T07:52:17.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.893+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x5636362b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.893+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362be8e0 0x563636280a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.893+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/1022309798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362bdfc0 0x5636362c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.893+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1022309798 >> 172.21.15.100:0/1022309798 conn(0x56363624d5a0 msgr2=0x563636316290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.895+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1022309798 shutdown_connections 2024-02-21T07:52:17.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.895+0000 7f4cf57c8740 1 -- 172.21.15.100:0/1022309798 wait complete. 2024-02-21T07:52:17.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.896+0000 7f4cf57c8740 1 -- start start 2024-02-21T07:52:17.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.896+0000 7f4cf57c8740 1 Processor -- start 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362bdfc0 0x5636362836c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362be8e0 0x563636281f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636362f1710 con 0x5636362bdfc0 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563636283c50 con 0x563636302ed0 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636362a9620 con 0x5636362be8e0 2024-02-21T07:52:17.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.899+0000 7f4cf57c8740 10 client.0 _ll_register_callbacks cb 0x7f4ce4043050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:17.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.900+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.900+0000 7f4cf0a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:45876/0 (socket says 172.21.15.100:45876) 2024-02-21T07:52:17.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.900+0000 7f4cf0a00640 1 -- 172.21.15.100:0/2286957609 learned_addr learned my addr 172.21.15.100:0/2286957609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.900+0000 7f4cebe00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362bdfc0 0x5636362836c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4ceb400640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362be8e0 0x563636281f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4cf0a00640 1 -- 172.21.15.100:0/2286957609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362be8e0 msgr2=0x563636281f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362be8e0 0x563636281f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4cf0a00640 1 -- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362bdfc0 msgr2=0x5636362836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362bdfc0 0x5636362836c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.901+0000 7f4cf0a00640 1 -- 172.21.15.100:0/2286957609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec16ff20 con 0x563636302ed0 2024-02-21T07:52:17.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.902+0000 7f4cf0a00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034fd0 tx=0x7f4ce4040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96670575b1955bee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:17.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.902+0000 7f4cd0c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:17.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.907+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce404b980 con 0x563636302ed0 2024-02-21T07:52:17.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.907+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ce4034b40 con 0x563636302ed0 2024-02-21T07:52:17.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.908+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ce0006850 con 0x563636302ed0 2024-02-21T07:52:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.911+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ce405e630 con 0x563636302ed0 2024-02-21T07:52:17.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.912+0000 7f4cf57c8740 10 client.6451 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.912+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5636361ae430 con 0x563636302ed0 2024-02-21T07:52:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.913+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce0006850 con 0x563636302ed0 2024-02-21T07:52:17.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.913+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ce4065030 con 0x563636302ed0 2024-02-21T07:52:17.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 10 client.6451 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 10 client.6451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 20 client.6451 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5636362b5490 0x56363628ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:17.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 4 client.6451 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:52:17.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.916+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563635f79890 con 0x5636362b5490 2024-02-21T07:52:17.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.926+0000 7f4cebe00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5636362b5490 0x56363628ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.928+0000 7f4cebe00640 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5636362b5490 0x56363628ac10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62159dbf6a2f9ba server_cookie=378d2d5e4d073519 in_seq=0 out_seq=0 2024-02-21T07:52:17.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.928+0000 7f4cd0c00640 10 client.6451 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.930+0000 7f4cd0c00640 1 -- 172.21.15.100:0/2286957609 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x563635f79890 con 0x5636362b5490 2024-02-21T07:52:17.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.931+0000 7f4cd0c00640 10 client.6451 handle_command_reply: tid=0 2024-02-21T07:52:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.936+0000 7f4cf57c8740 1 client.6451 shutdown 2024-02-21T07:52:17.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 msgr2=0x563636371c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034fd0 tx=0x7f4ce4040000 comp rx=0 tx=0).stop 2024-02-21T07:52:17.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 shutdown_connections 2024-02-21T07:52:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5636362b5490 0x56363628ac10 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563636302ed0 0x563636371c90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5636362be8e0 0x563636281f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 --2- 172.21.15.100:0/2286957609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5636362bdfc0 0x5636362836c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.937+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 >> 172.21.15.100:0/2286957609 conn(0x56363624d5a0 msgr2=0x56363628bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.939+0000 7f4cd0c00640 0 client.6451 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:17.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.941+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 shutdown_connections 2024-02-21T07:52:17.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.941+0000 7f4cf57c8740 1 -- 172.21.15.100:0/2286957609 wait complete. 2024-02-21T07:52:17.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.942+0000 7f4cf57c8740 20 client.6451 trim_cache size 0 max 16384 2024-02-21T07:52:17.945 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:17.945 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: "9df1e2cd-87a2-454d-aa95-ed6bb494f823": { 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "9df1e2cd-87a2-454d-aa95-ed6bb494f823", 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:52:17.946 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 msgr2=0x7f4ccc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 0x7f4ccc0a16b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0f6bc0 tx=0x7f4ce4030000 comp rx=0 tx=0).stop 2024-02-21T07:52:17.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 msgr2=0x7f4cec16f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 0x7f4cec16f9e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009fd0 tx=0x7f4cd800b870 comp rx=0 tx=0).stop 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 shutdown_connections 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cec1808d0 0x7f4cec1732e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cec0f8300 0x7f4cec16f9e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4ccc09f1f0 0x7f4ccc0a16b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 --2- 172.21.15.100:0/862257480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cec0cb960 0x7f4cec17ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.943+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 >> 172.21.15.100:0/862257480 conn(0x7f4cec0d05b0 msgr2=0x7f4cec072250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.944+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 shutdown_connections 2024-02-21T07:52:17.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:17.944+0000 7f4cf2a00640 1 -- 172.21.15.100:0/862257480 wait complete. 2024-02-21T07:52:17.972 INFO:tasks.cephfs.filesystem:scrub status for tag:9df1e2cd-87a2-454d-aa95-ed6bb494f823 - {'path': '/', 'tag': '9df1e2cd-87a2-454d-aa95-ed6bb494f823', 'options': 'recursive,force'} 2024-02-21T07:52:28.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.994+0000 7f6891000640 1 Processor -- start 2024-02-21T07:52:28.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.994+0000 7f6891000640 1 -- start start 2024-02-21T07:52:29.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.997+0000 7f6891000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f688c15c440 0x7f688c0d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.998+0000 7f6891000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0d24d0 con 0x7f688c0d1810 2024-02-21T07:52:29.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.998+0000 7f6891000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c1856b0 con 0x7f688c15cf30 2024-02-21T07:52:29.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.998+0000 7f6891000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c188ca0 con 0x7f688c15c440 2024-02-21T07:52:29.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.999+0000 7f688a800640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f688c15cf30 0x7f688c0f5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:34070/0 (socket says 172.21.15.100:34070) 2024-02-21T07:52:29.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.999+0000 7f688a800640 1 -- 172.21.15.100:0/1722980273 learned_addr learned my addr 172.21.15.100:0/1722980273 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:29.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:28.999+0000 7f6889400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f688c0d1810 0x7f688c15c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:49486/0 (socket says 172.21.15.100:49486) 2024-02-21T07:52:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.000+0000 7f6889e00640 1 --2- 172.21.15.100:0/1722980273 >> v2:172.21.15.100:3300/0 conn(0x7f688c15c440 0x7f688c0d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.000+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448600256 0 0) 0x7f688c0d24d0 con 0x7f688c0d1810 2024-02-21T07:52:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.001+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6870003520 con 0x7f688c0d1810 2024-02-21T07:52:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.001+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080291137 0 0) 0x7f688c1856b0 con 0x7f688c15cf30 2024-02-21T07:52:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.001+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f688c0d24d0 con 0x7f688c15cf30 2024-02-21T07:52:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703264687 0 0) 0x7f688c0d24d0 con 0x7f688c15cf30 2024-02-21T07:52:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 >> v2:172.21.15.100:3300/0 conn(0x7f688c15c440 msgr2=0x7f688c0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 --2- 172.21.15.100:0/1722980273 >> v2:172.21.15.100:3300/0 conn(0x7f688c15c440 0x7f688c0d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 >> v1:172.21.15.156:6789/0 conn(0x7f688c0d1810 legacy=0x7f688c15c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0d1c70 con 0x7f688c15cf30 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f6884001a20 con 0x7f688c15cf30 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 >> v1:172.21.15.170:6789/0 conn(0x7f688c15cf30 legacy=0x7f688c0f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870004b60 0x7f6870004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 0x7f6870003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6870004120 0x7f687000fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6878001230 con 0x7f6870003760 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c188ca0 con 0x7f6870004b60 2024-02-21T07:52:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.002+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870010510 con 0x7f6870004120 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.003+0000 7f6889e00640 1 --2- 172.21.15.100:0/1722980273 >> v2:172.21.15.100:3300/0 conn(0x7f688c15c440 0x7f688c0d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 0x7f6870003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889e00640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870004b60 0x7f6870004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 -- 172.21.15.100:0/1722980273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6870004120 msgr2=0x7f687000fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6870004120 0x7f687000fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 -- 172.21.15.100:0/1722980273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870004b60 msgr2=0x7f6870004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870004b60 0x7f6870004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.004+0000 7f6889400640 1 -- 172.21.15.100:0/1722980273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0d1c70 con 0x7f6870003760 2024-02-21T07:52:29.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.006+0000 7f688a800640 1 -- 172.21.15.100:0/1722980273 reap_dead start 2024-02-21T07:52:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.006+0000 7f6889400640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 0x7f6870003be0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6878007f50 tx=0x7f68700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0181c667d8d8c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.006+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780072d0 con 0x7f6870003760 2024-02-21T07:52:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.006+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878007430 con 0x7f6870003760 2024-02-21T07:52:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.007+0000 7f6888a00640 1 -- 172.21.15.100:0/1722980273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780047e0 con 0x7f6870003760 2024-02-21T07:52:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.007+0000 7f6891000640 1 -- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 msgr2=0x7f6870003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.007+0000 7f6891000640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 0x7f6870003be0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6878007f50 tx=0x7f68700057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.008+0000 7f6891000640 1 -- 172.21.15.100:0/1722980273 shutdown_connections 2024-02-21T07:52:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.008+0000 7f6891000640 1 --2- 172.21.15.100:0/1722980273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6870003760 0x7f6870003be0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.008+0000 7f6891000640 1 -- 172.21.15.100:0/1722980273 >> 172.21.15.100:0/1722980273 conn(0x7f688c0cdfb0 msgr2=0x7f688c0ce3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.008+0000 7f6891000640 1 -- 172.21.15.100:0/1722980273 shutdown_connections 2024-02-21T07:52:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.008+0000 7f6891000640 1 -- 172.21.15.100:0/1722980273 wait complete. 2024-02-21T07:52:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.010+0000 7f6891000640 1 Processor -- start 2024-02-21T07:52:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.010+0000 7f6891000640 1 -- start start 2024-02-21T07:52:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 0x7f688c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 0x7f688c21c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c21cb90 0x7f688c187d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c217d70 con 0x7f688c1591a0 2024-02-21T07:52:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c21b310 con 0x7f6870003760 2024-02-21T07:52:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6891000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c21b5b0 con 0x7f688c21cb90 2024-02-21T07:52:29.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6889e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 0x7f688c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6889e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 0x7f688c158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39626/0 (socket says 172.21.15.100:39626) 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.012+0000 7f6889e00640 1 -- 172.21.15.100:0/2794811523 learned_addr learned my addr 172.21.15.100:0/2794811523 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 0x7f688c21c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f688a800640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c21cb90 0x7f688c187d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 -- 172.21.15.100:0/2794811523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c21cb90 msgr2=0x7f688c187d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c21cb90 0x7f688c187d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 -- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 msgr2=0x7f688c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 0x7f688c158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.013+0000 7f6889400640 1 -- 172.21.15.100:0/2794811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c21b890 con 0x7f688c1591a0 2024-02-21T07:52:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6889400640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 0x7f688c21c650 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6870010460 tx=0x7f6878001750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6882000640 1 -- 172.21.15.100:0/2794811523 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780072d0 con 0x7f688c1591a0 2024-02-21T07:52:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6882000640 1 -- 172.21.15.100:0/2794811523 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68780013f0 con 0x7f688c1591a0 2024-02-21T07:52:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6882000640 1 -- 172.21.15.100:0/2794811523 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687802c940 con 0x7f688c1591a0 2024-02-21T07:52:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c21bb70 con 0x7f688c1591a0 2024-02-21T07:52:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.014+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c21c130 con 0x7f688c1591a0 2024-02-21T07:52:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.020+0000 7f6882000640 1 -- 172.21.15.100:0/2794811523 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6878032070 con 0x7f688c1591a0 2024-02-21T07:52:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.021+0000 7f6893d7f740 1 Processor -- start 2024-02-21T07:52:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.022+0000 7f6893d7f740 1 -- start start 2024-02-21T07:52:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.022+0000 7f6882000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 0x7f686c0a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.022+0000 7f6882000640 1 -- 172.21.15.100:0/2794811523 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68780eb670 con 0x7f688c1591a0 2024-02-21T07:52:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.023+0000 7f688a800640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 0x7f686c0a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f688a800640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 0x7f686c0a1610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f688c074ae0 tx=0x7f6884001b30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e479cc150 0x564e47a07610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e47987620 con 0x564e47a3b690 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e479398c0 con 0x564e479cc150 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6893d7f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e47936df0 con 0x564e47a07230 2024-02-21T07:52:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f688a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e479cc150 0x564e47a07610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6889400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60552/0 (socket says 172.21.15.100:60552) 2024-02-21T07:52:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6889400640 1 -- 172.21.15.100:0/3429070321 learned_addr learned my addr 172.21.15.100:0/3429070321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.024+0000 7f6889e00640 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889e00640 1 -- 172.21.15.100:0/3429070321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e479cc150 msgr2=0x564e47a07610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889e00640 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e479cc150 0x564e47a07610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889e00640 1 -- 172.21.15.100:0/3429070321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 msgr2=0x564e479cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889e00640 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889e00640 1 -- 172.21.15.100:0/3429070321 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e478b3b00 con 0x564e47a07230 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.025+0000 7f6889400640 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.026+0000 7f6889e00640 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479c6600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f687c009d70 tx=0x7f687c009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3a494c8e5b946af server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.026+0000 7f6876a00640 1 -- 172.21.15.100:0/3429070321 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c01f480 con 0x564e47a07230 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.026+0000 7f6876a00640 1 -- 172.21.15.100:0/3429070321 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c01f5e0 con 0x564e47a07230 2024-02-21T07:52:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.026+0000 7f6876a00640 1 -- 172.21.15.100:0/3429070321 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c01f950 con 0x564e47a07230 2024-02-21T07:52:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.028+0000 7f6893d7f740 1 -- 172.21.15.100:0/3429070321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 msgr2=0x564e479c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.028+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479c6600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f687c009d70 tx=0x7f687c009190 comp rx=0 tx=0).stop 2024-02-21T07:52:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.030+0000 7f6893d7f740 1 -- 172.21.15.100:0/3429070321 shutdown_connections 2024-02-21T07:52:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.030+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e479cc150 0x564e47a07610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.030+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e479cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.030+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3429070321 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479c6600 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.030+0000 7f6893d7f740 1 -- 172.21.15.100:0/3429070321 >> 172.21.15.100:0/3429070321 conn(0x564e479934b0 msgr2=0x564e479cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.031+0000 7f6893d7f740 1 -- 172.21.15.100:0/3429070321 shutdown_connections 2024-02-21T07:52:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.031+0000 7f6893d7f740 1 -- 172.21.15.100:0/3429070321 wait complete. 2024-02-21T07:52:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.032+0000 7f6893d7f740 1 -- start start 2024-02-21T07:52:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.032+0000 7f6893d7f740 1 Processor -- start 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e479fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e47a30a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e479325d0 con 0x564e47a3b690 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e478d7b50 con 0x564e47a07230 2024-02-21T07:52:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e478d77f0 con 0x564e479cc150 2024-02-21T07:52:29.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.034+0000 7f6893d7f740 10 client.0 _ll_register_callbacks cb 0x564e478eb550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.035+0000 7f6889e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.035+0000 7f6889e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38890/0 (socket says 172.21.15.100:38890) 2024-02-21T07:52:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.035+0000 7f6889e00640 1 -- 172.21.15.100:0/3567758786 learned_addr learned my addr 172.21.15.100:0/3567758786 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.035+0000 7f688a800640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e47a30a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.035+0000 7f6889400640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e479fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 -- 172.21.15.100:0/3567758786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 msgr2=0x564e479fcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e479fcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 -- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 msgr2=0x564e47a30a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e47a30a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 -- 172.21.15.100:0/3567758786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c009940 con 0x564e479cc150 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889400640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e479fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f6889e00640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f687c006d20 tx=0x7f687c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=327702f1fce96704 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f686b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.036+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c01fd00 con 0x564e479cc150 2024-02-21T07:52:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e47904cd0 con 0x564e479cc150 2024-02-21T07:52:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f687c01a070 con 0x564e479cc150 2024-02-21T07:52:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f687c01fe60 con 0x564e479cc150 2024-02-21T07:52:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 10 client.6422 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564e47930c50 con 0x564e479cc150 2024-02-21T07:52:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c036020 con 0x564e479cc150 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f687c029430 con 0x564e479cc150 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 10 client.6422 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 10 client.6422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 20 client.6422 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e47a30fa0 0x564e47a07ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 4 client.6422 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.037+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e47928ce0 con 0x564e47a30fa0 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.038+0000 7f6889400640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e47a30fa0 0x564e47a07ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.040+0000 7f6889400640 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e47a30fa0 0x564e47a07ae0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d080246fd7d6a24 server_cookie=c0062c92aa9b710 in_seq=0 out_seq=0 2024-02-21T07:52:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.040+0000 7f686b400640 10 client.6422 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f686b400640 1 -- 172.21.15.100:0/3567758786 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e47928ce0 con 0x564e47a30fa0 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f686b400640 10 client.6422 handle_command_reply: tid=0 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 client.6422 shutdown 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 msgr2=0x564e47a4d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f687c006d20 tx=0x7f687c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 shutdown_connections 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e47a30fa0 0x564e47a07ae0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e47a3b690 0x564e47a30a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e479fcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3567758786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e479cc150 0x564e47a4d3a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 >> 172.21.15.100:0/3567758786 conn(0x564e479934b0 msgr2=0x564e47a3baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f686b400640 0 client.6422 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 shutdown_connections 2024-02-21T07:52:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.041+0000 7f6893d7f740 1 -- 172.21.15.100:0/3567758786 wait complete. 2024-02-21T07:52:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.042+0000 7f6893d7f740 20 client.6422 trim_cache size 0 max 16384 2024-02-21T07:52:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.065+0000 7f6893d7f740 1 Processor -- start 2024-02-21T07:52:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.065+0000 7f6893d7f740 1 -- start start 2024-02-21T07:52:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.067+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e479fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.068+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479d2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.068+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a3b690 0x564e479cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.068+0000 7f6893d7f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e479c8dc0 con 0x564e479cc150 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6889400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479d2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6889400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479d2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38904/0 (socket says 172.21.15.100:38904) 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6893d7f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e4767ae60 con 0x564e47a3b690 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6893d7f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e479cbd90 con 0x564e47a07230 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6889400640 1 -- 172.21.15.100:0/3694645443 learned_addr learned my addr 172.21.15.100:0/3694645443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.069+0000 7f6889e00640 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e479fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.070+0000 7f6889e00640 1 -- 172.21.15.100:0/3694645443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 msgr2=0x564e479d2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.070+0000 7f6889e00640 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479d2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.070+0000 7f6889e00640 1 -- 172.21.15.100:0/3694645443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a3b690 msgr2=0x564e479cb850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.070+0000 7f6889e00640 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a3b690 0x564e479cb850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.070+0000 7f6889e00640 1 -- 172.21.15.100:0/3694645443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e478cd530 con 0x564e479cc150 2024-02-21T07:52:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.071+0000 7f6889e00640 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e479fbcd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f687c008010 tx=0x7f687c026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63bf84b5d683709 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.071+0000 7f6876000640 1 -- 172.21.15.100:0/3694645443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0299c0 con 0x564e479cc150 2024-02-21T07:52:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.071+0000 7f6876000640 1 -- 172.21.15.100:0/3694645443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c036050 con 0x564e479cc150 2024-02-21T07:52:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.071+0000 7f6876000640 1 -- 172.21.15.100:0/3694645443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c01f790 con 0x564e479cc150 2024-02-21T07:52:29.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.073+0000 7f6893d7f740 1 -- 172.21.15.100:0/3694645443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 msgr2=0x564e479fbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.073+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e479fbcd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f687c008010 tx=0x7f687c026000 comp rx=0 tx=0).stop 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.076+0000 7f6893d7f740 1 -- 172.21.15.100:0/3694645443 shutdown_connections 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.076+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a3b690 0x564e479cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.076+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a07230 0x564e479d2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.076+0000 7f6893d7f740 1 --2- 172.21.15.100:0/3694645443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e479fbcd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.076+0000 7f6893d7f740 1 -- 172.21.15.100:0/3694645443 >> 172.21.15.100:0/3694645443 conn(0x564e479934b0 msgr2=0x564e47a30870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.080+0000 7f6893d7f740 1 -- 172.21.15.100:0/3694645443 shutdown_connections 2024-02-21T07:52:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.081+0000 7f6893d7f740 1 -- 172.21.15.100:0/3694645443 wait complete. 2024-02-21T07:52:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.083+0000 7f6893d7f740 1 -- start start 2024-02-21T07:52:29.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.083+0000 7f6893d7f740 1 Processor -- start 2024-02-21T07:52:29.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a3b690 0x564e47a4ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e47a0a950 con 0x564e479cc150 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e47aa8680 con 0x564e47a07230 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e47ab1ef0 con 0x564e47a3b690 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.088+0000 7f6893d7f740 10 client.0 _ll_register_callbacks cb 0x7f687c006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.089+0000 7f6889e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.089+0000 7f6889400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.089+0000 7f6889e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60576/0 (socket says 172.21.15.100:60576) 2024-02-21T07:52:29.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.089+0000 7f6889400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:39672/0 (socket says 172.21.15.100:39672) 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.089+0000 7f6889e00640 1 -- 172.21.15.100:0/568527230 learned_addr learned my addr 172.21.15.100:0/568527230 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.090+0000 7f6889e00640 1 -- 172.21.15.100:0/568527230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a3b690 msgr2=0x564e47a4ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.090+0000 7f6889e00640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a3b690 0x564e47a4ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.090+0000 7f6889e00640 1 -- 172.21.15.100:0/568527230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 msgr2=0x564e47a9e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.090+0000 7f6889e00640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.090+0000 7f6889e00640 1 -- 172.21.15.100:0/568527230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e47930c50 con 0x564e479cc150 2024-02-21T07:52:29.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.091+0000 7f6889400640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:29.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.091+0000 7f6889e00640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f687c004700 tx=0x7f687c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d91eb5697b74c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:29.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.093+0000 7f686b400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.093+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c029920 con 0x564e479cc150 2024-02-21T07:52:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.093+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f687c01fe40 con 0x564e479cc150 2024-02-21T07:52:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.093+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e47957d30 con 0x564e479cc150 2024-02-21T07:52:29.096 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.093+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f687c029a80 con 0x564e479cc150 2024-02-21T07:52:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.094+0000 7f6893d7f740 10 client.6297 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:29.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.094+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564e478f32c0 con 0x564e479cc150 2024-02-21T07:52:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564e47957d30 con 0x564e479cc150 2024-02-21T07:52:29.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f687c03c480 con 0x564e479cc150 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f6893d7f740 10 client.6297 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f6893d7f740 10 client.6297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f6893d7f740 20 client.6297 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.095+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e479d0550 0x564e47a523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.096+0000 7f6893d7f740 4 client.6297 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.096+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564e47632600 con 0x564e479d0550 2024-02-21T07:52:29.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.096+0000 7f6889400640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e479d0550 0x564e47a523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.097+0000 7f6889400640 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e479d0550 0x564e47a523d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1656647aaa64551f server_cookie=65cf21a36c181470 in_seq=0 out_seq=0 2024-02-21T07:52:29.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.098+0000 7f686b400640 10 client.6297 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.150+0000 7f686b400640 1 -- 172.21.15.100:0/568527230 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564e47632600 con 0x564e479d0550 2024-02-21T07:52:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.150+0000 7f686b400640 10 client.6297 handle_command_reply: tid=0 2024-02-21T07:52:29.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.150+0000 7f6893d7f740 1 client.6297 shutdown 2024-02-21T07:52:29.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 msgr2=0x564e47ab13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f687c004700 tx=0x7f687c008040 comp rx=0 tx=0).stop 2024-02-21T07:52:29.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 shutdown_connections 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564e479d0550 0x564e47a523d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564e47a3b690 0x564e47a4ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564e47a07230 0x564e47a9e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 --2- 172.21.15.100:0/568527230 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564e479cc150 0x564e47ab13a0 secure :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f687c004700 tx=0x7f687c008040 comp rx=0 tx=0).stop 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.151+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 >> 172.21.15.100:0/568527230 conn(0x564e479934b0 msgr2=0x564e47a034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.155+0000 7f686b400640 0 client.6297 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.155+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 shutdown_connections 2024-02-21T07:52:29.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.156+0000 7f6893d7f740 1 -- 172.21.15.100:0/568527230 wait complete. 2024-02-21T07:52:29.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.157+0000 7f6893d7f740 20 client.6297 trim_cache size 0 max 16384 2024-02-21T07:52:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:52:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:52:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:52:29.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.162+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 msgr2=0x7f686c0a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.162+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 0x7f686c0a1610 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f688c074ae0 tx=0x7f6884001b30 comp rx=0 tx=0).stop 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.162+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 msgr2=0x7f688c21c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.162+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 0x7f688c21c650 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6870010460 tx=0x7f6878001750 comp rx=0 tx=0).stop 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 shutdown_connections 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f688c21cb90 0x7f688c187d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f686c09f150 0x7f686c0a1610 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f688c1591a0 0x7f688c21c650 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 --2- 172.21.15.100:0/2794811523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6870003760 0x7f688c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.163+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 >> 172.21.15.100:0/2794811523 conn(0x7f688c0cdfb0 msgr2=0x7f688c17f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.164+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 shutdown_connections 2024-02-21T07:52:29.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:29.164+0000 7f6891000640 1 -- 172.21.15.100:0/2794811523 wait complete. 2024-02-21T07:52:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.504+0000 7f407ae00640 1 Processor -- start 2024-02-21T07:52:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.505+0000 7f407ae00640 1 -- start start 2024-02-21T07:52:42.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.516+0000 7f407ae00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 0x7f407418d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.516+0000 7f407ae00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f407418e1f0 0x7f40740fd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.516+0000 7f407ae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 0x7f40740d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.517+0000 7f4073e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 0x7f407418d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.517+0000 7f4073e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 0x7f407418d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59782/0 (socket says 172.21.15.100:59782) 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.518+0000 7f407ae00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740fd220 con 0x7f40740fdb80 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.518+0000 7f407ae00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740fc070 con 0x7f407418e1f0 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.518+0000 7f407ae00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740fc2c0 con 0x7f4074168a40 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.518+0000 7f4078e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 0x7f40740d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.519+0000 7f4073e00640 1 -- 172.21.15.100:0/4211074151 learned_addr learned my addr 172.21.15.100:0/4211074151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.521+0000 7f4073400640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.156:3300/0 conn(0x7f407418e1f0 0x7f40740fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.522+0000 7f4073400640 1 -- 172.21.15.100:0/4211074151 >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 msgr2=0x7f407418d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.522+0000 7f4073400640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 0x7f407418d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.522+0000 7f4073400640 1 -- 172.21.15.100:0/4211074151 >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 msgr2=0x7f40740d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.523+0000 7f4073400640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 0x7f40740d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.523+0000 7f4073400640 1 -- 172.21.15.100:0/4211074151 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740fc5a0 con 0x7f407418e1f0 2024-02-21T07:52:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.523+0000 7f4078e00640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 0x7f40740d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.532+0000 7f4073400640 1 --2- 172.21.15.100:0/4211074151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40740fd640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40740fefa0 tx=0x7f406402b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15b10aeeddc5cdfd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.535+0000 7f4072a00640 1 -- 172.21.15.100:0/4211074151 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064030710 con 0x7f407418e1f0 2024-02-21T07:52:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.535+0000 7f4072a00640 1 -- 172.21.15.100:0/4211074151 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406402e050 con 0x7f407418e1f0 2024-02-21T07:52:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.535+0000 7f4072a00640 1 -- 172.21.15.100:0/4211074151 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064030a90 con 0x7f407418e1f0 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 -- 172.21.15.100:0/4211074151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 msgr2=0x7f40740fd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 --2- 172.21.15.100:0/4211074151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40740fd640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f40740fefa0 tx=0x7f406402b730 comp rx=0 tx=0).stop 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 -- 172.21.15.100:0/4211074151 shutdown_connections 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.100:3300/0 conn(0x7f40740fdb80 0x7f40740d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 --2- 172.21.15.100:0/4211074151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40740fd640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.540 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 --2- 172.21.15.100:0/4211074151 >> v2:172.21.15.170:3300/0 conn(0x7f4074168a40 0x7f407418d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.537+0000 7f407ae00640 1 -- 172.21.15.100:0/4211074151 >> 172.21.15.100:0/4211074151 conn(0x7f407408cfd0 msgr2=0x7f407408d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.541+0000 7f407ae00640 1 -- 172.21.15.100:0/4211074151 shutdown_connections 2024-02-21T07:52:42.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.542+0000 7f407ae00640 1 -- 172.21.15.100:0/4211074151 wait complete. 2024-02-21T07:52:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.548+0000 7f407ae00640 1 Processor -- start 2024-02-21T07:52:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.548+0000 7f407ae00640 1 -- start start 2024-02-21T07:52:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.551+0000 7f407ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.552+0000 7f407ae00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 0x7f4074161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.552+0000 7f407ae00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40741867e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f4073400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 0x7f4074161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f4073400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 0x7f4074161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59796/0 (socket says 172.21.15.100:59796) 2024-02-21T07:52:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f407ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4074157c20 con 0x7f40740fdb80 2024-02-21T07:52:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f407ae00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40741615b0 con 0x7f407418e1f0 2024-02-21T07:52:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f407ae00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40741570a0 con 0x7f4074168a40 2024-02-21T07:52:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32906/0 (socket says 172.21.15.100:32906) 2024-02-21T07:52:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.553+0000 7f4073e00640 1 -- 172.21.15.100:0/3502781451 learned_addr learned my addr 172.21.15.100:0/3502781451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.554+0000 7f4078e00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40741867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.555+0000 7f4073e00640 1 -- 172.21.15.100:0/3502781451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 msgr2=0x7f4074161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.555+0000 7f4073e00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 0x7f4074161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.555+0000 7f4073e00640 1 -- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 msgr2=0x7f40741867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.558+0000 7f4073e00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40741867e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.558+0000 7f4073e00640 1 -- 172.21.15.100:0/3502781451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009400 con 0x7f40740fdb80 2024-02-21T07:52:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.559+0000 7f4078e00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40741867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.565+0000 7f4073e00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4060020890 tx=0x7f4060020d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.573+0000 7f406be00640 1 -- 172.21.15.100:0/3502781451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406001eb00 con 0x7f40740fdb80 2024-02-21T07:52:42.579 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.574+0000 7f406be00640 1 -- 172.21.15.100:0/3502781451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406001ec60 con 0x7f40740fdb80 2024-02-21T07:52:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.576+0000 7f406be00640 1 -- 172.21.15.100:0/3502781451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060025470 con 0x7f40740fdb80 2024-02-21T07:52:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.577+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4074157380 con 0x7f40740fdb80 2024-02-21T07:52:42.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.577+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4074157940 con 0x7f40740fdb80 2024-02-21T07:52:42.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.598+0000 7f406be00640 1 -- 172.21.15.100:0/3502781451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f40600255d0 con 0x7f40740fdb80 2024-02-21T07:52:42.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.600+0000 7f406be00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 0x7f40540a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.606+0000 7f406be00640 1 -- 172.21.15.100:0/3502781451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f40600de170 con 0x7f40740fdb80 2024-02-21T07:52:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.606+0000 7f4073400640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 0x7f40540a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.608+0000 7f4073400640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 0x7f40540a1660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4064034000 tx=0x7f4064008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.623+0000 7f407da0d740 1 Processor -- start 2024-02-21T07:52:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.623+0000 7f407da0d740 1 -- start start 2024-02-21T07:52:42.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.625+0000 7f407da0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a58c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.633+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a58c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.633+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a58c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32912/0 (socket says 172.21.15.100:32912) 2024-02-21T07:52:42.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.635+0000 7f4073e00640 1 -- 172.21.15.100:0/2792980873 learned_addr learned my addr 172.21.15.100:0/2792980873 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.641+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a591a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.641+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.642+0000 7f4073400640 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a591a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.643+0000 7f4078e00640 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.644+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a54d620 con 0x558f7a5cd070 2024-02-21T07:52:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.645+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a4ff8c0 con 0x558f7a6014d0 2024-02-21T07:52:42.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.645+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a4fcdf0 con 0x558f7a591f90 2024-02-21T07:52:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.650+0000 7f4078e00640 1 -- 172.21.15.100:0/2792980873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 msgr2=0x558f7a591a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.650+0000 7f4078e00640 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a591a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.650+0000 7f4078e00640 1 -- 172.21.15.100:0/2792980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 msgr2=0x558f7a58c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.650+0000 7f4078e00640 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a58c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.650+0000 7f4078e00640 1 -- 172.21.15.100:0/2792980873 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f7a479b00 con 0x558f7a591f90 2024-02-21T07:52:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.655+0000 7f4078e00640 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5cd450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f406c009f20 tx=0x7f406c0077c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad762c941cfb5de6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.656+0000 7f4068c00640 1 -- 172.21.15.100:0/2792980873 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00e050 con 0x558f7a591f90 2024-02-21T07:52:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.656+0000 7f4068c00640 1 -- 172.21.15.100:0/2792980873 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c00f040 con 0x558f7a591f90 2024-02-21T07:52:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.656+0000 7f4068c00640 1 -- 172.21.15.100:0/2792980873 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0139d0 con 0x558f7a591f90 2024-02-21T07:52:42.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.659+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 msgr2=0x558f7a5cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.659+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5cd450 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f406c009f20 tx=0x7f406c0077c0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.664+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 shutdown_connections 2024-02-21T07:52:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.664+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5cd450 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.665+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a591a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.665+0000 7f407da0d740 1 --2- 172.21.15.100:0/2792980873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a58c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.665+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 >> 172.21.15.100:0/2792980873 conn(0x558f7a5594b0 msgr2=0x558f7a590ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.670+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 shutdown_connections 2024-02-21T07:52:42.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.670+0000 7f407da0d740 1 -- 172.21.15.100:0/2792980873 wait complete. 2024-02-21T07:52:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.672+0000 7f407da0d740 1 -- start start 2024-02-21T07:52:42.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.673+0000 7f407da0d740 1 Processor -- start 2024-02-21T07:52:42.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.683+0000 7f407da0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.687+0000 7f407da0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a600c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f407da0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a5c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f4073400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a600c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f407da0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a4f85d0 con 0x558f7a5cd070 2024-02-21T07:52:42.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f407da0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a49db50 con 0x558f7a6014d0 2024-02-21T07:52:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f407da0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a49d7f0 con 0x558f7a591f90 2024-02-21T07:52:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.688+0000 7f407da0d740 10 client.0 _ll_register_callbacks cb 0x558f7a4b1550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.690+0000 7f4073400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a600c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32918/0 (socket says 172.21.15.100:32918) 2024-02-21T07:52:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.690+0000 7f4073400640 1 -- 172.21.15.100:0/345560646 learned_addr learned my addr 172.21.15.100:0/345560646 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.692+0000 7f4078e00640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a5c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.692+0000 7f4073e00640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.695+0000 7f4073e00640 1 -- 172.21.15.100:0/345560646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 msgr2=0x558f7a5c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.695+0000 7f4073e00640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a5c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.695+0000 7f4073e00640 1 -- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 msgr2=0x558f7a600c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.695+0000 7f4073e00640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a600c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.695+0000 7f4073e00640 1 -- 172.21.15.100:0/345560646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c009af0 con 0x558f7a591f90 2024-02-21T07:52:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.696+0000 7f4073e00640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f40600a4500 tx=0x7f40600a7ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2872d0b471fd5e77 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.698+0000 7f405d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.698+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600b0840 con 0x558f7a591f90 2024-02-21T07:52:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.698+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f40600be020 con 0x558f7a591f90 2024-02-21T07:52:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.699+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f7a4cacd0 con 0x558f7a591f90 2024-02-21T07:52:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.699+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40600a74f0 con 0x558f7a591f90 2024-02-21T07:52:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.705+0000 7f407da0d740 10 client.6437 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.705+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558f7a4f6c50 con 0x558f7a591f90 2024-02-21T07:52:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.705+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f7a4cacd0 con 0x558f7a591f90 2024-02-21T07:52:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.705+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f40600a7650 con 0x558f7a591f90 2024-02-21T07:52:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 10 client.6437 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 10 client.6437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 20 client.6437 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5f6320 0x558f7a5c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 4 client.6437 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.706+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f7a4eece0 con 0x558f7a5f6320 2024-02-21T07:52:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.711+0000 7f4073400640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5f6320 0x558f7a5c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.714+0000 7f4073400640 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5f6320 0x558f7a5c03a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136a7ea41b96dcf9 server_cookie=51c67e8db62457e1 in_seq=0 out_seq=0 2024-02-21T07:52:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.715+0000 7f405d600640 10 client.6437 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.724+0000 7f405d600640 1 -- 172.21.15.100:0/345560646 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558f7a4eece0 con 0x558f7a5f6320 2024-02-21T07:52:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.724+0000 7f405d600640 10 client.6437 handle_command_reply: tid=0 2024-02-21T07:52:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.727+0000 7f407da0d740 1 client.6437 shutdown 2024-02-21T07:52:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.728+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 msgr2=0x558f7a5c11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.728+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f40600a4500 tx=0x7f40600a7ac0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 shutdown_connections 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5f6320 0x558f7a5c03a0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a5c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a600c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 --2- 172.21.15.100:0/345560646 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 >> 172.21.15.100:0/345560646 conn(0x558f7a5594b0 msgr2=0x558f7a601950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.741+0000 7f405d600640 0 client.6437 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.743+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 shutdown_connections 2024-02-21T07:52:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.744+0000 7f407da0d740 1 -- 172.21.15.100:0/345560646 wait complete. 2024-02-21T07:52:42.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.745+0000 7f407da0d740 20 client.6437 trim_cache size 0 max 16384 2024-02-21T07:52:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.831+0000 7f407da0d740 1 Processor -- start 2024-02-21T07:52:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.831+0000 7f407da0d740 1 -- start start 2024-02-21T07:52:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.836+0000 7f407da0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.837+0000 7f407da0d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a5cd070 0x558f7a600430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.837+0000 7f407da0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a6014d0 0x558f7a5c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.837+0000 7f407da0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a240e60 con 0x558f7a591f90 2024-02-21T07:52:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.838+0000 7f407da0d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a5c9d30 con 0x558f7a5cd070 2024-02-21T07:52:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.838+0000 7f407da0d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a5900a0 con 0x558f7a6014d0 2024-02-21T07:52:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.838+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.839+0000 7f4073e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32934/0 (socket says 172.21.15.100:32934) 2024-02-21T07:52:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.839+0000 7f4073e00640 1 -- 172.21.15.100:0/3704671052 learned_addr learned my addr 172.21.15.100:0/3704671052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.839+0000 7f4073400640 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a5cd070 0x558f7a600430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.840+0000 7f4073e00640 1 -- 172.21.15.100:0/3704671052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a6014d0 msgr2=0x558f7a5c97f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.840+0000 7f4073e00640 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a6014d0 0x558f7a5c97f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.840+0000 7f4073e00640 1 -- 172.21.15.100:0/3704671052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a5cd070 msgr2=0x558f7a600430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.840+0000 7f4073e00640 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a5cd070 0x558f7a600430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.840+0000 7f4073e00640 1 -- 172.21.15.100:0/3704671052 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f7a5c8380 con 0x558f7a591f90 2024-02-21T07:52:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.842+0000 7f4073e00640 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4060009640 tx=0x7f4060027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a689e4f334073f42 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.843+0000 7f405fe00640 1 -- 172.21.15.100:0/3704671052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600da230 con 0x558f7a591f90 2024-02-21T07:52:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.843+0000 7f405fe00640 1 -- 172.21.15.100:0/3704671052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600b0840 con 0x558f7a591f90 2024-02-21T07:52:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.843+0000 7f405fe00640 1 -- 172.21.15.100:0/3704671052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060005bd0 con 0x558f7a591f90 2024-02-21T07:52:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.844+0000 7f407da0d740 1 -- 172.21.15.100:0/3704671052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 msgr2=0x558f7a5c11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.844+0000 7f407da0d740 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4060009640 tx=0x7f4060027000 comp rx=0 tx=0).stop 2024-02-21T07:52:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.845+0000 7f407da0d740 1 -- 172.21.15.100:0/3704671052 shutdown_connections 2024-02-21T07:52:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.845+0000 7f407da0d740 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a6014d0 0x558f7a5c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.845+0000 7f407da0d740 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a5cd070 0x558f7a600430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.845+0000 7f407da0d740 1 --2- 172.21.15.100:0/3704671052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a591f90 0x558f7a5c11b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.845+0000 7f407da0d740 1 -- 172.21.15.100:0/3704671052 >> 172.21.15.100:0/3704671052 conn(0x558f7a5594b0 msgr2=0x558f7a6038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.846+0000 7f407da0d740 1 -- 172.21.15.100:0/3704671052 shutdown_connections 2024-02-21T07:52:42.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.846+0000 7f407da0d740 1 -- 172.21.15.100:0/3704671052 wait complete. 2024-02-21T07:52:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.849+0000 7f407da0d740 1 -- start start 2024-02-21T07:52:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.850+0000 7f407da0d740 1 Processor -- start 2024-02-21T07:52:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.854+0000 7f407da0d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.854+0000 7f407da0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a596390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.858+0000 7f4073e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.859+0000 7f4073400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a596390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.859+0000 7f4073e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59820/0 (socket says 172.21.15.100:59820) 2024-02-21T07:52:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.859+0000 7f4073e00640 1 -- 172.21.15.100:0/3353111361 learned_addr learned my addr 172.21.15.100:0/3353111361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.860+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a609c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.861+0000 7f4078e00640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a609c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.861+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a5c3c40 con 0x558f7a5cd070 2024-02-21T07:52:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.865+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a609800 con 0x558f7a6014d0 2024-02-21T07:52:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.865+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f7a60a1d0 con 0x558f7a591f90 2024-02-21T07:52:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.865+0000 7f407da0d740 10 client.0 _ll_register_callbacks cb 0x7f406c0096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.867+0000 7f4073400640 1 -- 172.21.15.100:0/3353111361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 msgr2=0x558f7a5f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.867+0000 7f4073400640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.867+0000 7f4073400640 1 -- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 msgr2=0x558f7a609c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.867+0000 7f4073400640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a609c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.867+0000 7f4073400640 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f7a4f6c50 con 0x558f7a5cd070 2024-02-21T07:52:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.868+0000 7f4078e00640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a609c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.869+0000 7f405d600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.870+0000 7f4073400640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a596390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x558f7a5c8570 tx=0x7f406402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b723ad76321a699 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.871+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406404f040 con 0x558f7a5cd070 2024-02-21T07:52:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.871+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f7a51dd30 con 0x558f7a5cd070 2024-02-21T07:52:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.872+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f406403d450 con 0x558f7a5cd070 2024-02-21T07:52:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.872+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f406404f040 con 0x558f7a5cd070 2024-02-21T07:52:42.890 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.885+0000 7f407da0d740 10 client.6315 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.885+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558f7a493530 con 0x558f7a5cd070 2024-02-21T07:52:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.893+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558f7a51dd30 con 0x558f7a5cd070 2024-02-21T07:52:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.895+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4064045040 con 0x558f7a5cd070 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 10 client.6315 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 10 client.6315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 20 client.6315 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5bdcd0 0x558f7a603ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 4 client.6315 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:52:42.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f7a1f8600 con 0x558f7a5bdcd0 2024-02-21T07:52:42.901 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.897+0000 7f4073e00640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5bdcd0 0x558f7a603ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.898+0000 7f4073e00640 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5bdcd0 0x558f7a603ca0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cef64c255c2c981f server_cookie=34a868c4664b8f9d in_seq=0 out_seq=0 2024-02-21T07:52:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:42.898+0000 7f405d600640 10 client.6315 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:43.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.284+0000 7f405d600640 1 -- 172.21.15.100:0/3353111361 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f7a1f8600 con 0x558f7a5bdcd0 2024-02-21T07:52:43.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.284+0000 7f405d600640 10 client.6315 handle_command_reply: tid=0 2024-02-21T07:52:43.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.284+0000 7f407da0d740 1 client.6315 shutdown 2024-02-21T07:52:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.286+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 msgr2=0x558f7a596390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:43.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.286+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a596390 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x558f7a5c8570 tx=0x7f406402d000 comp rx=0 tx=0).stop 2024-02-21T07:52:43.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 shutdown_connections 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558f7a5bdcd0 0x558f7a603ca0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f405d600640 0 client.6315 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558f7a6014d0 0x558f7a609c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558f7a5cd070 0x558f7a596390 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 --2- 172.21.15.100:0/3353111361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558f7a591f90 0x558f7a5f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.287+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 >> 172.21.15.100:0/3353111361 conn(0x558f7a5594b0 msgr2=0x558f7a6001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.289+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 shutdown_connections 2024-02-21T07:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.292+0000 7f407da0d740 1 -- 172.21.15.100:0/3353111361 wait complete. 2024-02-21T07:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.293+0000 7f407da0d740 20 client.6315 trim_cache size 0 max 16384 2024-02-21T07:52:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:52:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:52:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:52:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:52:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 msgr2=0x7f40540a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 0x7f40540a1660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4064034000 tx=0x7f4064008030 comp rx=0 tx=0).stop 2024-02-21T07:52:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 msgr2=0x7f4074156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:43.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4060020890 tx=0x7f4060020d50 comp rx=0 tx=0).stop 2024-02-21T07:52:43.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 shutdown_connections 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f407418e1f0 0x7f40741867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4074168a40 0x7f4074161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f405409f1a0 0x7f40540a1660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 --2- 172.21.15.100:0/3502781451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40740fdb80 0x7f4074156a40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.297+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 >> 172.21.15.100:0/3502781451 conn(0x7f407408cfd0 msgr2=0x7f40740cec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.298+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 shutdown_connections 2024-02-21T07:52:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:43.298+0000 7f407ae00640 1 -- 172.21.15.100:0/3502781451 wait complete. 2024-02-21T07:52:45.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:45.067 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:45.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:47.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:52:47.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:52:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.331+0000 7f7ca5200640 1 Processor -- start 2024-02-21T07:52:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.332+0000 7f7ca5200640 1 -- start start 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.333+0000 7f7ca5200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ca0183c20 0x7f7ca0184000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.333+0000 7f7ca5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 0x7f7ca00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.333+0000 7f7ca5200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca0072eb0 con 0x7f7ca006f280 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.333+0000 7f7ca5200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0072a90 con 0x7f7ca006ee10 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.333+0000 7f7ca5200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca0071b30 con 0x7f7ca0183c20 2024-02-21T07:52:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ca0183c20 0x7f7ca0184000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 0x7f7ca00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7ca0183c20 0x7f7ca0184000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47990/0 (socket says 172.21.15.100:47990) 2024-02-21T07:52:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 -- 172.21.15.100:0/2452177892 learned_addr learned my addr 172.21.15.100:0/2452177892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 -- 172.21.15.100:0/2452177892 >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 msgr2=0x7f7ca00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9ca00640 1 -- 172.21.15.100:0/2452177892 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493314647 0 0) 0x7f7ca0072eb0 con 0x7f7ca006f280 2024-02-21T07:52:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 --2- 172.21.15.100:0/2452177892 >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 0x7f7ca00711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 -- 172.21.15.100:0/2452177892 >> v1:172.21.15.156:6789/0 conn(0x7f7ca006f280 legacy=0x7f7ca0187c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9de00640 1 -- 172.21.15.100:0/2452177892 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca0071e10 con 0x7f7ca0183c20 2024-02-21T07:52:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.334+0000 7f7c9d400640 1 --2- 172.21.15.100:0/2452177892 >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 0x7f7ca00711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.336+0000 7f7c9de00640 1 --2- 172.21.15.100:0/2452177892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca0183c20 0x7f7ca0184000 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0090630 tx=0x7f7c9002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=784a6725584bc4f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.337+0000 7f7c9ca00640 1 -- 172.21.15.100:0/2452177892 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90031870 con 0x7f7ca0183c20 2024-02-21T07:52:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.337+0000 7f7c9ca00640 1 -- 172.21.15.100:0/2452177892 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900319d0 con 0x7f7ca0183c20 2024-02-21T07:52:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.337+0000 7f7c9ca00640 1 -- 172.21.15.100:0/2452177892 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90031d60 con 0x7f7ca0183c20 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 -- 172.21.15.100:0/2452177892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca0183c20 msgr2=0x7f7ca0184000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 --2- 172.21.15.100:0/2452177892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca0183c20 0x7f7ca0184000 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0090630 tx=0x7f7c9002b910 comp rx=0 tx=0).stop 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 -- 172.21.15.100:0/2452177892 shutdown_connections 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 --2- 172.21.15.100:0/2452177892 >> v2:172.21.15.100:3300/0 conn(0x7f7ca006ee10 0x7f7ca00711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 --2- 172.21.15.100:0/2452177892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca0183c20 0x7f7ca0184000 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 -- 172.21.15.100:0/2452177892 >> 172.21.15.100:0/2452177892 conn(0x7f7ca006ab60 msgr2=0x7f7ca006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 -- 172.21.15.100:0/2452177892 shutdown_connections 2024-02-21T07:52:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.338+0000 7f7ca5200640 1 -- 172.21.15.100:0/2452177892 wait complete. 2024-02-21T07:52:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.341+0000 7f7ca5200640 1 Processor -- start 2024-02-21T07:52:48.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.341+0000 7f7ca5200640 1 -- start start 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ca006ee10 0x7f7ca0222870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca01628c0 0x7f7ca006c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca006bc70 con 0x7f7ca0183c20 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca006c4a0 con 0x7f7ca01628c0 2024-02-21T07:52:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7ca5200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca00fadf0 con 0x7f7ca006ee10 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7c9e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca01628c0 0x7f7ca006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32964/0 (socket says 172.21.15.100:32964) 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.345+0000 7f7c9d400640 1 -- 172.21.15.100:0/1514610199 learned_addr learned my addr 172.21.15.100:0/1514610199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 -- 172.21.15.100:0/1514610199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ca006ee10 msgr2=0x7f7ca0222870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ca006ee10 0x7f7ca0222870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 -- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca01628c0 msgr2=0x7f7ca006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca01628c0 0x7f7ca006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 -- 172.21.15.100:0/1514610199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009400 con 0x7f7ca0183c20 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.346+0000 7f7c9d400640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00ec10 tx=0x7f7c8c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.347+0000 7f7c96000640 1 -- 172.21.15.100:0/1514610199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c009760 con 0x7f7ca0183c20 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.347+0000 7f7c96000640 1 -- 172.21.15.100:0/1514610199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00cbd0 con 0x7f7ca0183c20 2024-02-21T07:52:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.347+0000 7f7c96000640 1 -- 172.21.15.100:0/1514610199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c013470 con 0x7f7ca0183c20 2024-02-21T07:52:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.347+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c900094d0 con 0x7f7ca0183c20 2024-02-21T07:52:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.347+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca006be50 con 0x7f7ca0183c20 2024-02-21T07:52:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.353+0000 7f7ca7fc5740 1 Processor -- start 2024-02-21T07:52:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.354+0000 7f7ca7fc5740 1 -- start start 2024-02-21T07:52:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d17d0 0x5640ac707250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac694700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac600150 con 0x5640ac6d20f0 2024-02-21T07:52:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac5fd680 con 0x5640ac707790 2024-02-21T07:52:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.355+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac5f8e60 con 0x5640ac6d17d0 2024-02-21T07:52:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48014/0 (socket says 172.21.15.100:48014) 2024-02-21T07:52:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c9de00640 1 -- 172.21.15.100:0/4136683748 learned_addr learned my addr 172.21.15.100:0/4136683748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c9e800640 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d17d0 0x5640ac707250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c96000640 1 -- 172.21.15.100:0/1514610199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7c8c0135d0 con 0x7f7ca0183c20 2024-02-21T07:52:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.356+0000 7f7c9de00640 1 -- 172.21.15.100:0/4136683748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d17d0 msgr2=0x5640ac707250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.357+0000 7f7c9de00640 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d17d0 0x5640ac707250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.357+0000 7f7c9de00640 1 -- 172.21.15.100:0/4136683748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 msgr2=0x5640ac694700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.357+0000 7f7c9de00640 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac694700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.357+0000 7f7c9de00640 1 -- 172.21.15.100:0/4136683748 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640ac5b2060 con 0x5640ac707790 2024-02-21T07:52:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.357+0000 7f7c9de00640 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c90030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb3f5ee30de263e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.358+0000 7f7c8aa00640 1 -- 172.21.15.100:0/4136683748 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90031b40 con 0x5640ac707790 2024-02-21T07:52:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.358+0000 7f7c8aa00640 1 -- 172.21.15.100:0/4136683748 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90031ca0 con 0x5640ac707790 2024-02-21T07:52:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.358+0000 7f7c8aa00640 1 -- 172.21.15.100:0/4136683748 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003a660 con 0x5640ac707790 2024-02-21T07:52:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.358+0000 7f7c96000640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 0x7f7c800a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.358+0000 7f7c96000640 1 -- 172.21.15.100:0/1514610199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c8c0c9da0 con 0x7f7ca0183c20 2024-02-21T07:52:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/4136683748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 msgr2=0x5640ac6d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000c00 tx=0x7f7c90030000 comp rx=0 tx=0).stop 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/4136683748 shutdown_connections 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac694700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac707790 0x5640ac6d1bb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/4136683748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d17d0 0x5640ac707250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/4136683748 >> 172.21.15.100:0/4136683748 conn(0x5640ac6585a0 msgr2=0x5640ac6986c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/4136683748 shutdown_connections 2024-02-21T07:52:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7c9e800640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 0x7f7c800a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.359+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/4136683748 wait complete. 2024-02-21T07:52:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.361+0000 7f7ca7fc5740 1 -- start start 2024-02-21T07:52:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.361+0000 7f7ca7fc5740 1 Processor -- start 2024-02-21T07:52:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.361+0000 7f7c9e800640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 0x7f7c800a1610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c980012e0 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac6ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac59dec0 con 0x5640ac707790 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac59db60 con 0x5640ac6d17d0 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac3671c0 con 0x5640ac6d20f0 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7ca7fc5740 10 client.0 _ll_register_callbacks cb 0x5640ac5b1960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.362+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59846/0 (socket says 172.21.15.100:59846) 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 -- 172.21.15.100:0/2012751358 learned_addr learned my addr 172.21.15.100:0/2012751358 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9e800640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac6ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 -- 172.21.15.100:0/2012751358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 msgr2=0x5640ac6d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 -- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 msgr2=0x5640ac6ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac6ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 -- 172.21.15.100:0/2012751358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca0071e10 con 0x5640ac6d20f0 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9e800640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac6ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.363+0000 7f7c9d400640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c097580 tx=0x7f7c8c097770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc999a695e6e11c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7c7f400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c098db0 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c8c09b9d0 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640ac2f87e0 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c8c0a0020 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7ca7fc5740 10 client.6446 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5640ac5f74e0 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.364+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640ac2f87e0 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c8c011070 con 0x5640ac6d20f0 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 10 client.6446 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 10 client.6446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 20 client.6446 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6c7a40 0x5640ac6c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 4 client.6446 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640ac335720 con 0x5640ac6c7a40 2024-02-21T07:52:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.365+0000 7f7c9de00640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6c7a40 0x5640ac6c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.366+0000 7f7c9de00640 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6c7a40 0x5640ac6c7f30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16e4ec33c3498cc server_cookie=e61ddfd84e31fa9d in_seq=0 out_seq=0 2024-02-21T07:52:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.366+0000 7f7c7f400640 10 client.6446 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.367+0000 7f7c7f400640 1 -- 172.21.15.100:0/2012751358 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5640ac335720 con 0x5640ac6c7a40 2024-02-21T07:52:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.367+0000 7f7c7f400640 10 client.6446 handle_command_reply: tid=0 2024-02-21T07:52:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.367+0000 7f7ca7fc5740 1 client.6446 shutdown 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.368+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 msgr2=0x5640ac6c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.368+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c097580 tx=0x7f7c8c097770 comp rx=0 tx=0).stop 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 shutdown_connections 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6c7a40 0x5640ac6c7f30 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac6ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac6c9cd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/2012751358 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.370+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 >> 172.21.15.100:0/2012751358 conn(0x5640ac6585a0 msgr2=0x5640ac707040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.371+0000 7f7c7f400640 0 client.6446 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.376+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 shutdown_connections 2024-02-21T07:52:48.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.380+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/2012751358 wait complete. 2024-02-21T07:52:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.381+0000 7f7ca7fc5740 20 client.6446 trim_cache size 0 max 16384 2024-02-21T07:52:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.416+0000 7f7ca7fc5740 1 Processor -- start 2024-02-21T07:52:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.417+0000 7f7ca7fc5740 1 -- start start 2024-02-21T07:52:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.419+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.419+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac695c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 0x5640ac695010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48036/0 (socket says 172.21.15.100:48036) 2024-02-21T07:52:48.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7c9de00640 1 -- 172.21.15.100:0/55836375 learned_addr learned my addr 172.21.15.100:0/55836375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7c9d400640 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac695c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7c9e800640 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 0x5640ac695010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac708080 con 0x5640ac6d20f0 2024-02-21T07:52:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac708570 con 0x5640ac6d17d0 2024-02-21T07:52:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.420+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac6d0060 con 0x5640ac707790 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.421+0000 7f7c9e800640 1 -- 172.21.15.100:0/55836375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 msgr2=0x5640ac6d8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.421+0000 7f7c9e800640 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.421+0000 7f7c9e800640 1 -- 172.21.15.100:0/55836375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 msgr2=0x5640ac695c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.421+0000 7f7c9e800640 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac695c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.421+0000 7f7c9e800640 1 -- 172.21.15.100:0/55836375 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640ac593950 con 0x5640ac707790 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.422+0000 7f7c9e800640 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 0x5640ac695010 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5640ac706450 tx=0x7f7c98015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9828475f982ce7b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.422+0000 7f7c8a000640 1 -- 172.21.15.100:0/55836375 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98015c60 con 0x5640ac707790 2024-02-21T07:52:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.422+0000 7f7c8a000640 1 -- 172.21.15.100:0/55836375 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98015dc0 con 0x5640ac707790 2024-02-21T07:52:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.422+0000 7f7c8a000640 1 -- 172.21.15.100:0/55836375 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98015c60 con 0x5640ac707790 2024-02-21T07:52:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 msgr2=0x5640ac695010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 0x5640ac695010 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x5640ac706450 tx=0x7f7c98015000 comp rx=0 tx=0).stop 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 shutdown_connections 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac707790 0x5640ac695010 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac6d20f0 0x5640ac695c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/55836375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac6d8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 >> 172.21.15.100:0/55836375 conn(0x5640ac6585a0 msgr2=0x5640ac707040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 shutdown_connections 2024-02-21T07:52:48.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.424+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/55836375 wait complete. 2024-02-21T07:52:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.425+0000 7f7ca7fc5740 1 -- start start 2024-02-21T07:52:48.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.425+0000 7f7ca7fc5740 1 Processor -- start 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac721220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac76cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac70b430 con 0x5640ac707790 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac70bb50 con 0x5640ac6d17d0 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ac698dc0 con 0x5640ac6d20f0 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.427+0000 7f7ca7fc5740 10 client.0 _ll_register_callbacks cb 0x7f7c8c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:48.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.428+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.428+0000 7f7c9de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48052/0 (socket says 172.21.15.100:48052) 2024-02-21T07:52:48.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.428+0000 7f7c9de00640 1 -- 172.21.15.100:0/738844099 learned_addr learned my addr 172.21.15.100:0/738844099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 -- 172.21.15.100:0/738844099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 msgr2=0x5640ac721220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac721220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 -- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 msgr2=0x5640ac76cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:48.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac76cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 -- 172.21.15.100:0/738844099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c98012e40 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c9de00640 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009930 tx=0x7f7c90004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63215316b52835ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c7f400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90004450 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.429+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7c9002d040 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.430+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640ac697440 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.430+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c9002bf90 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.430+0000 7f7ca7fc5740 10 client.6499 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.430+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5640ac5b9430 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640ac697440 con 0x5640ac6d17d0 2024-02-21T07:52:48.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c9004d070 con 0x5640ac6d17d0 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 10 client.6499 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 10 client.6499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 20 client.6499 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6ff1d0 0x5640ac76d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 4 client.6499 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:52:48.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.431+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7c90031ca0 con 0x5640ac6ff1d0 2024-02-21T07:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.433+0000 7f7c9d400640 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6ff1d0 0x5640ac76d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.434+0000 7f7c9d400640 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6ff1d0 0x5640ac76d2a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca672957cbfd19e5 server_cookie=26f2b21bf34c7b58 in_seq=0 out_seq=0 2024-02-21T07:52:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.434+0000 7f7c7f400640 10 client.6499 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.435+0000 7f7c7f400640 1 -- 172.21.15.100:0/738844099 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f7c90031ca0 con 0x5640ac6ff1d0 2024-02-21T07:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.435+0000 7f7c7f400640 10 client.6499 handle_command_reply: tid=0 2024-02-21T07:52:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.435+0000 7f7ca7fc5740 1 client.6499 shutdown 2024-02-21T07:52:48.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.446+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 msgr2=0x5640ac76da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.446+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009930 tx=0x7f7c90004730 comp rx=0 tx=0).stop 2024-02-21T07:52:48.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 shutdown_connections 2024-02-21T07:52:48.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640ac6ff1d0 0x5640ac76d2a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640ac707790 0x5640ac76cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640ac6d20f0 0x5640ac721220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 --2- 172.21.15.100:0/738844099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640ac6d17d0 0x5640ac76da20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 >> 172.21.15.100:0/738844099 conn(0x5640ac6585a0 msgr2=0x5640ac701f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.447+0000 7f7c7f400640 0 client.6499 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.448+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 shutdown_connections 2024-02-21T07:52:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.448+0000 7f7ca7fc5740 1 -- 172.21.15.100:0/738844099 wait complete. 2024-02-21T07:52:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.449+0000 7f7ca7fc5740 20 client.6499 trim_cache size 0 max 16384 2024-02-21T07:52:48.453 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:48.453 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:52:48.454 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:52:48.454 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:48.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 msgr2=0x7f7c800a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 0x7f7c800a1610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7c980012e0 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2024-02-21T07:52:48.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 msgr2=0x7f7ca00cb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00ec10 tx=0x7f7c8c00c520 comp rx=0 tx=0).stop 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 shutdown_connections 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ca01628c0 0x7f7ca006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7c8009f150 0x7f7c800a1610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ca0183c20 0x7f7ca00cb260 secure :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00ec10 tx=0x7f7c8c00c520 comp rx=0 tx=0).stop 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 --2- 172.21.15.100:0/1514610199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ca006ee10 0x7f7ca0222870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.451+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 >> 172.21.15.100:0/1514610199 conn(0x7f7ca006ab60 msgr2=0x7f7ca006af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.452+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 shutdown_connections 2024-02-21T07:52:48.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.452+0000 7f7ca5200640 1 -- 172.21.15.100:0/1514610199 wait complete. 2024-02-21T07:52:48.497 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:52:48.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:52:48.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.900+0000 7f432ec00640 1 Processor -- start 2024-02-21T07:52:48.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.900+0000 7f432ec00640 1 -- start start 2024-02-21T07:52:48.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f432ec00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f43280f9580 0x7f4328188e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f432ec00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432806dc90 con 0x7f4328186df0 2024-02-21T07:52:48.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f4327400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4328186df0 0x7f4328188770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:58344/0 (socket says 172.21.15.100:58344) 2024-02-21T07:52:48.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f4327400640 1 -- 172.21.15.100:0/2186114981 learned_addr learned my addr 172.21.15.100:0/2186114981 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:48.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432806df70 con 0x7f4328185f20 2024-02-21T07:52:48.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432806e250 con 0x7f43280f9580 2024-02-21T07:52:48.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.903+0000 7f432cc00640 1 --2- 172.21.15.100:0/2186114981 >> v2:172.21.15.170:3300/0 conn(0x7f43280f9580 0x7f4328188e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.904+0000 7f432cc00640 1 -- 172.21.15.100:0/2186114981 >> v1:172.21.15.170:6789/0 conn(0x7f4328185f20 legacy=0x7f43281866e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.904+0000 7f4326a00640 1 -- 172.21.15.100:0/2186114981 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530510212 0 0) 0x7f432806dc90 con 0x7f4328186df0 2024-02-21T07:52:48.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.904+0000 7f432cc00640 1 -- 172.21.15.100:0/2186114981 >> v1:172.21.15.156:6789/0 conn(0x7f4328186df0 legacy=0x7f4328188770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.904+0000 7f432cc00640 1 -- 172.21.15.100:0/2186114981 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432806e530 con 0x7f43280f9580 2024-02-21T07:52:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.909+0000 7f432cc00640 1 --2- 172.21.15.100:0/2186114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f4328188e80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a505ac4d1ad1ebb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.910+0000 7f4326a00640 1 -- 172.21.15.100:0/2186114981 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432002cbe0 con 0x7f43280f9580 2024-02-21T07:52:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.910+0000 7f4326a00640 1 -- 172.21.15.100:0/2186114981 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432002cd40 con 0x7f43280f9580 2024-02-21T07:52:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.910+0000 7f4326a00640 1 -- 172.21.15.100:0/2186114981 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320034660 con 0x7f43280f9580 2024-02-21T07:52:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.912+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 msgr2=0x7f4328188e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.912+0000 7f432ec00640 1 --2- 172.21.15.100:0/2186114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f4328188e80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4320009d90 tx=0x7f432002be30 comp rx=0 tx=0).stop 2024-02-21T07:52:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.916+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 shutdown_connections 2024-02-21T07:52:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.916+0000 7f432ec00640 1 --2- 172.21.15.100:0/2186114981 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f4328188e80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.916+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 >> 172.21.15.100:0/2186114981 conn(0x7f43280ce160 msgr2=0x7f43280ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:48.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.917+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 shutdown_connections 2024-02-21T07:52:48.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.917+0000 7f432ec00640 1 -- 172.21.15.100:0/2186114981 wait complete. 2024-02-21T07:52:48.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.924+0000 7f432ec00640 1 Processor -- start 2024-02-21T07:52:48.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.925+0000 7f432ec00640 1 -- start start 2024-02-21T07:52:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f43281730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4328185f20 0x7f4328221f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 0x7f43280f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328220bc0 con 0x7f4328185f20 2024-02-21T07:52:48.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328220ea0 con 0x7f4328186df0 2024-02-21T07:52:48.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f432ec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4328221180 con 0x7f43280f9580 2024-02-21T07:52:48.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f4327e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f43281730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f4327e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f43281730d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:59872/0 (socket says 172.21.15.100:59872) 2024-02-21T07:52:48.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.929+0000 7f4327e00640 1 -- 172.21.15.100:0/2806928581 learned_addr learned my addr 172.21.15.100:0/2806928581 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.931+0000 7f432cc00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 0x7f43280f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.931+0000 7f4327400640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4328185f20 0x7f4328221f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.932+0000 7f432cc00640 1 -- 172.21.15.100:0/2806928581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 msgr2=0x7f43281730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.932+0000 7f432cc00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f43281730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.932+0000 7f432cc00640 1 -- 172.21.15.100:0/2806928581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4328185f20 msgr2=0x7f4328221f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.932+0000 7f432cc00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4328185f20 0x7f4328221f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.932+0000 7f432cc00640 1 -- 172.21.15.100:0/2806928581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320009a70 con 0x7f4328186df0 2024-02-21T07:52:48.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.933+0000 7f432cc00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 0x7f43280f50f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4320033000 tx=0x7f4320004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.935+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432003e610 con 0x7f4328186df0 2024-02-21T07:52:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.936+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432003e790 con 0x7f4328186df0 2024-02-21T07:52:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.936+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4328221460 con 0x7f4328186df0 2024-02-21T07:52:48.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.936+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4328221a20 con 0x7f4328186df0 2024-02-21T07:52:48.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.936+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432003eb40 con 0x7f4328186df0 2024-02-21T07:52:48.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.947+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4300005290 con 0x7f4328186df0 2024-02-21T07:52:48.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.957+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f432003b050 con 0x7f4328186df0 2024-02-21T07:52:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.959+0000 7f431fe00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 0x7f43080a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:48.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.960+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f43200ec750 con 0x7f4328186df0 2024-02-21T07:52:48.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.963+0000 7f4327e00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 0x7f43080a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:48.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.967+0000 7f4327e00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 0x7f43080a1630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4314001700 tx=0x7f4314009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:48.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:48.968+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f43200b65c0 con 0x7f4328186df0 2024-02-21T07:52:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.545+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4300005ac0 con 0x7f4328186df0 2024-02-21T07:52:49.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.548+0000 7f431fe00640 1 -- 172.21.15.100:0/2806928581 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f43200b9c80 con 0x7f4328186df0 2024-02-21T07:52:49.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:52:49.553 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:52:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:52:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.553+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 msgr2=0x7f43080a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.553+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 0x7f43080a1630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4314001700 tx=0x7f4314009040 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 msgr2=0x7f43280f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 0x7f43280f50f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4320033000 tx=0x7f4320004a40 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 shutdown_connections 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4328186df0 0x7f43280f50f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f430809f170 0x7f43080a1630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4328185f20 0x7f4328221f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 --2- 172.21.15.100:0/2806928581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43280f9580 0x7f43281730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:49.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.554+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 >> 172.21.15.100:0/2806928581 conn(0x7f43280ce160 msgr2=0x7f4328183940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.555+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 shutdown_connections 2024-02-21T07:52:49.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:49.555+0000 7f432ec00640 1 -- 172.21.15.100:0/2806928581 wait complete. 2024-02-21T07:52:49.593 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:49.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:52:50.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.060+0000 7feef2a00640 1 Processor -- start 2024-02-21T07:52:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.060+0000 7feef2a00640 1 -- start start 2024-02-21T07:52:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.063+0000 7feef2a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feeec1868b0 0x7feeec186d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.064+0000 7feef2000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7feeec187250 0x7feeec06d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37732/0 (socket says 172.21.15.100:37732) 2024-02-21T07:52:50.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.064+0000 7feef2000640 1 -- 172.21.15.100:0/2272510879 learned_addr learned my addr 172.21.15.100:0/2272510879 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.064+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec06eed0 con 0x7feeec17b3f0 2024-02-21T07:52:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.065+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec185720 con 0x7feeec187250 2024-02-21T07:52:50.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.065+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec071f20 con 0x7feeec1868b0 2024-02-21T07:52:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119091504 0 0) 0x7feeec185720 con 0x7feeec187250 2024-02-21T07:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed4003520 con 0x7feeec187250 2024-02-21T07:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408587142 0 0) 0x7feeec06eed0 con 0x7feeec17b3f0 2024-02-21T07:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeec185720 con 0x7feeec17b3f0 2024-02-21T07:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feef0c00640 1 --2- 172.21.15.100:0/2272510879 >> v2:172.21.15.156:3300/0 conn(0x7feeec1868b0 0x7feeec186d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1786709692 0 0) 0x7feeec185720 con 0x7feeec17b3f0 2024-02-21T07:52:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 >> v2:172.21.15.156:3300/0 conn(0x7feeec1868b0 msgr2=0x7feeec186d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 --2- 172.21.15.100:0/2272510879 >> v2:172.21.15.156:3300/0 conn(0x7feeec1868b0 0x7feeec186d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.067+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 >> v1:172.21.15.170:6789/0 conn(0x7feeec187250 legacy=0x7feeec06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec06e910 con 0x7feeec17b3f0 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7feee0001520 con 0x7feeec17b3f0 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 >> v1:172.21.15.156:6789/0 conn(0x7feeec17b3f0 legacy=0x7feeec185010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 0x7feed4005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4003760 0x7feed4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed4004300 0x7feed4009a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40015b0 con 0x7feed4003760 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec071f20 con 0x7feed4004c30 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.068+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed400a390 con 0x7feed4004300 2024-02-21T07:52:50.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.069+0000 7feef2000640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed4004300 0x7feed4009a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.069+0000 7feef1600640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 0x7feed4005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.070+0000 7feef1600640 1 -- 172.21.15.100:0/2272510879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed4004300 msgr2=0x7feed4009a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.070+0000 7feef1600640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feed4004300 0x7feed4009a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.071+0000 7feef0c00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4003760 0x7feed4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.070+0000 7feef1600640 1 -- 172.21.15.100:0/2272510879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4003760 msgr2=0x7feed4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.072+0000 7feef1600640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4003760 0x7feed4003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.072+0000 7feef1600640 1 -- 172.21.15.100:0/2272510879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec185720 con 0x7feed4004c30 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.072+0000 7feef2000640 1 -- 172.21.15.100:0/2272510879 reap_dead start 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.073+0000 7feef0c00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4003760 0x7feed4003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.074+0000 7feef1600640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 0x7feed4005010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feee0007d80 tx=0x7feed40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b38bdfbbf9eea5b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.078+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002c770 con 0x7feed4004c30 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.078+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee002c8f0 con 0x7feed4004c30 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.078+0000 7feeebe00640 1 -- 172.21.15.100:0/2272510879 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002cca0 con 0x7feed4004c30 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.079+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 msgr2=0x7feed4005010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.079+0000 7feef2a00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 0x7feed4005010 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feee0007d80 tx=0x7feed40057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.080+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 shutdown_connections 2024-02-21T07:52:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.080+0000 7feef2a00640 1 --2- 172.21.15.100:0/2272510879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feed4004c30 0x7feed4005010 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.080+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 >> 172.21.15.100:0/2272510879 conn(0x7feeec0ce150 msgr2=0x7feeec0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.080+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 shutdown_connections 2024-02-21T07:52:50.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.080+0000 7feef2a00640 1 -- 172.21.15.100:0/2272510879 wait complete. 2024-02-21T07:52:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.084+0000 7feef2a00640 1 Processor -- start 2024-02-21T07:52:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.085+0000 7feef2a00640 1 -- start start 2024-02-21T07:52:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.087+0000 7feef2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.087+0000 7feef2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0f7850 0x7feeec0f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.088+0000 7feef2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeec0f4a40 0x7feeec0f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.088+0000 7feef2a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0f4f40 con 0x7feed4004c30 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.088+0000 7feef2a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0f5220 con 0x7feeec0f4a40 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.088+0000 7feef2a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0f5500 con 0x7feeec0f7850 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.089+0000 7feef1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.089+0000 7feef1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40002/0 (socket says 172.21.15.100:40002) 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.089+0000 7feef1600640 1 -- 172.21.15.100:0/778376814 learned_addr learned my addr 172.21.15.100:0/778376814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.089+0000 7feef2000640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeec0f4a40 0x7feeec0f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.090+0000 7feef1600640 1 -- 172.21.15.100:0/778376814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0f7850 msgr2=0x7feeec0f4500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.090+0000 7feef1600640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0f7850 0x7feeec0f4500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.090+0000 7feef1600640 1 -- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeec0f4a40 msgr2=0x7feeec0f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.090+0000 7feef1600640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeec0f4a40 0x7feeec0f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.090+0000 7feef1600640 1 -- 172.21.15.100:0/778376814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec150880 con 0x7feed4004c30 2024-02-21T07:52:50.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.091+0000 7feef1600640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feee0007ea0 tx=0x7feee002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.091+0000 7feee9600640 1 -- 172.21.15.100:0/778376814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00035f0 con 0x7feed4004c30 2024-02-21T07:52:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.092+0000 7feee9600640 1 -- 172.21.15.100:0/778376814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0003750 con 0x7feed4004c30 2024-02-21T07:52:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.092+0000 7feee9600640 1 -- 172.21.15.100:0/778376814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0003b00 con 0x7feed4004c30 2024-02-21T07:52:50.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.092+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec150b60 con 0x7feed4004c30 2024-02-21T07:52:50.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.092+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0f5ca0 con 0x7feed4004c30 2024-02-21T07:52:50.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.110+0000 7feee9600640 1 -- 172.21.15.100:0/778376814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feee003b050 con 0x7feed4004c30 2024-02-21T07:52:50.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.113+0000 7feee9600640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 0x7feecc0a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.117+0000 7feef0c00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 0x7feecc0a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.118+0000 7feee9600640 1 -- 172.21.15.100:0/778376814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feee00eb5a0 con 0x7feed4004c30 2024-02-21T07:52:50.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.120+0000 7feef0c00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 0x7feecc0a1660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feeec0cdfd0 tx=0x7feed8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.125+0000 7feef6c14740 1 Processor -- start 2024-02-21T07:52:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.127+0000 7feef6c14740 1 -- start start 2024-02-21T07:52:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.130+0000 7feef6c14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564562795070 0x564562795450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.130+0000 7feef6c14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef6c14740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef6c14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645626c8210 con 0x564562795990 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef6c14740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645626c5740 con 0x5645627d0740 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef6c14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645626c0f20 con 0x564562795070 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41816/0 (socket says 172.21.15.100:41816) 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.131+0000 7feef2000640 1 -- 172.21.15.100:0/745687155 learned_addr learned my addr 172.21.15.100:0/745687155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.132+0000 7feef2000640 1 -- 172.21.15.100:0/745687155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564562795070 msgr2=0x564562795450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.132+0000 7feef2000640 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564562795070 0x564562795450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.132+0000 7feef2000640 1 -- 172.21.15.100:0/745687155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 msgr2=0x5645627d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.132+0000 7feef2000640 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.132+0000 7feef2000640 1 -- 172.21.15.100:0/745687155 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564562682df0 con 0x5645627d0740 2024-02-21T07:52:50.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.134+0000 7feef2000640 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feee4001b60 tx=0x7feee4007050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ae6bd36b986e8ae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.136+0000 7feeddc00640 1 -- 172.21.15.100:0/745687155 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee40077f0 con 0x5645627d0740 2024-02-21T07:52:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.136+0000 7feeddc00640 1 -- 172.21.15.100:0/745687155 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee4007950 con 0x5645627d0740 2024-02-21T07:52:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.137+0000 7feef6c14740 1 -- 172.21.15.100:0/745687155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 msgr2=0x5645627d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.137+0000 7feef6c14740 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feee4001b60 tx=0x7feee4007050 comp rx=0 tx=0).stop 2024-02-21T07:52:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.139+0000 7feef6c14740 1 -- 172.21.15.100:0/745687155 shutdown_connections 2024-02-21T07:52:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.139+0000 7feef6c14740 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d0740 0x5645627d14d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.140+0000 7feef6c14740 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.140+0000 7feef6c14740 1 --2- 172.21.15.100:0/745687155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564562795070 0x564562795450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.140+0000 7feef6c14740 1 -- 172.21.15.100:0/745687155 >> 172.21.15.100:0/745687155 conn(0x564562757640 msgr2=0x5645627586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.140+0000 7feef6c14740 1 -- 172.21.15.100:0/745687155 shutdown_connections 2024-02-21T07:52:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.141+0000 7feef6c14740 1 -- 172.21.15.100:0/745687155 wait complete. 2024-02-21T07:52:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.147+0000 7feef6c14740 1 -- start start 2024-02-21T07:52:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.148+0000 7feef6c14740 1 Processor -- start 2024-02-21T07:52:50.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.152+0000 7feef6c14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627dd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.152+0000 7feef6c14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x5645627be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.152+0000 7feef6c14740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef6c14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564562666150 con 0x564562795990 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef6c14740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564562665df0 con 0x5645627d75c0 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef6c14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456242f1c0 con 0x5645627d0740 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41826/0 (socket says 172.21.15.100:41826) 2024-02-21T07:52:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef2000640 1 -- 172.21.15.100:0/975858371 learned_addr learned my addr 172.21.15.100:0/975858371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef6c14740 10 client.0 _ll_register_callbacks cb 0x5645626b52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:50.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.153+0000 7feef0c00640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x5645627be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.154+0000 7feef2000640 1 -- 172.21.15.100:0/975858371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 msgr2=0x5645627be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.154+0000 7feef2000640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x5645627be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.154+0000 7feef2000640 1 -- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 msgr2=0x5645627dd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.154+0000 7feef2000640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627dd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.154+0000 7feef2000640 1 -- 172.21.15.100:0/975858371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee400f040 con 0x5645627d75c0 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.155+0000 7feef2000640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feee4001460 tx=0x7feee4001ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1f6d5a340d6ad6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.155+0000 7feed2000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.156+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee4027610 con 0x5645627d75c0 2024-02-21T07:52:50.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.156+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feee4027770 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.156+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645623c07e0 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.157+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee4014e70 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.157+0000 7feef6c14740 10 client.6520 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.157+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5645626bf5a0 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.157+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5645623c07e0 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feee4027930 con 0x5645627d75c0 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 10 client.6520 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 10 client.6520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 20 client.6520 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5645627c46d0 0x56456278aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 4 client.6520 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:50.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.159+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645623fd720 con 0x5645627c46d0 2024-02-21T07:52:50.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.160+0000 7feef1600640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5645627c46d0 0x56456278aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.161+0000 7feef1600640 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5645627c46d0 0x56456278aa90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87a0845f5825371f server_cookie=c3439fab0c440136 in_seq=0 out_seq=0 2024-02-21T07:52:50.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.161+0000 7feed2000640 10 client.6520 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:50.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.164+0000 7feed2000640 1 -- 172.21.15.100:0/975858371 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5645623fd720 con 0x5645627c46d0 2024-02-21T07:52:50.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.164+0000 7feed2000640 10 client.6520 handle_command_reply: tid=0 2024-02-21T07:52:50.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.164+0000 7feef6c14740 1 client.6520 shutdown 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.164+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 msgr2=0x56456279cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.164+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feee4001460 tx=0x7feee4001ad0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 shutdown_connections 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5645627c46d0 0x56456278aa90 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456279cde0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x5645627be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 --2- 172.21.15.100:0/975858371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x5645627dd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 >> 172.21.15.100:0/975858371 conn(0x564562795070 msgr2=0x564562752e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feed2000640 0 client.6520 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:50.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.165+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 shutdown_connections 2024-02-21T07:52:50.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.166+0000 7feef6c14740 1 -- 172.21.15.100:0/975858371 wait complete. 2024-02-21T07:52:50.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.166+0000 7feef6c14740 20 client.6520 trim_cache size 0 max 16384 2024-02-21T07:52:50.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.197+0000 7feef6c14740 1 Processor -- start 2024-02-21T07:52:50.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.199+0000 7feef6c14740 1 -- start start 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456277d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456282df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456278b910 con 0x564562795990 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456278e510 con 0x5645627d75c0 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.201+0000 7feef6c14740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645627c3370 con 0x5645627d0740 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.202+0000 7feef1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.203+0000 7feef1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40028/0 (socket says 172.21.15.100:40028) 2024-02-21T07:52:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.203+0000 7feef1600640 1 -- 172.21.15.100:0/3356023249 learned_addr learned my addr 172.21.15.100:0/3356023249 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.204+0000 7feef0c00640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456277d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.204+0000 7feef2000640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456282df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef1600640 1 -- 172.21.15.100:0/3356023249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 msgr2=0x56456277d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef1600640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456277d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef1600640 1 -- 172.21.15.100:0/3356023249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 msgr2=0x56456282df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef1600640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456282df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef1600640 1 -- 172.21.15.100:0/3356023249 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456265bab0 con 0x564562795990 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef0c00640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456277d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.205+0000 7feef2000640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456282df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.206+0000 7feef1600640 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feee00e8f40 tx=0x7feee0001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e424ae3a37c5c6eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.206+0000 7feedd200640 1 -- 172.21.15.100:0/3356023249 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00c1820 con 0x564562795990 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.207+0000 7feedd200640 1 -- 172.21.15.100:0/3356023249 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee00079a0 con 0x564562795990 2024-02-21T07:52:50.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.207+0000 7feedd200640 1 -- 172.21.15.100:0/3356023249 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00e9050 con 0x564562795990 2024-02-21T07:52:50.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 -- 172.21.15.100:0/3356023249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 msgr2=0x564562756e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feee00e8f40 tx=0x7feee0001570 comp rx=0 tx=0).stop 2024-02-21T07:52:50.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 -- 172.21.15.100:0/3356023249 shutdown_connections 2024-02-21T07:52:50.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5645627d75c0 0x56456282df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456277d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 --2- 172.21.15.100:0/3356023249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564562795990 0x564562756e50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.208+0000 7feef6c14740 1 -- 172.21.15.100:0/3356023249 >> 172.21.15.100:0/3356023249 conn(0x564562795070 msgr2=0x5645627ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.209+0000 7feef6c14740 1 -- 172.21.15.100:0/3356023249 shutdown_connections 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.209+0000 7feef6c14740 1 -- 172.21.15.100:0/3356023249 wait complete. 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.211+0000 7feef6c14740 1 -- start start 2024-02-21T07:52:50.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.211+0000 7feef6c14740 1 Processor -- start 2024-02-21T07:52:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.213+0000 7feef6c14740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.214+0000 7feef1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.214+0000 7feef1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41848/0 (socket says 172.21.15.100:41848) 2024-02-21T07:52:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.214+0000 7feef6c14740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456279d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.214+0000 7feef1600640 1 -- 172.21.15.100:0/2716528306 learned_addr learned my addr 172.21.15.100:0/2716528306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.214+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 0x5645627dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.215+0000 7feef2000640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 0x5645627dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.215+0000 7feef0c00640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456279d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.215+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645627cf840 con 0x5645627d75c0 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.215+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564562837760 con 0x564562795990 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.215+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564562792270 con 0x5645627d0740 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef1600640 1 -- 172.21.15.100:0/2716528306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 msgr2=0x56456279d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef1600640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456279d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef6c14740 10 client.0 _ll_register_callbacks cb 0x7feee4002180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef1600640 1 -- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 msgr2=0x5645627dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef1600640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 0x5645627dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef1600640 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec0f5ca0 con 0x564562795990 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef0c00640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456279d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.217+0000 7feef2000640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 0x5645627dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.218+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feee4007950 con 0x564562795990 2024-02-21T07:52:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.218+0000 7feef1600640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7feee0007e70 tx=0x7feee400e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327b7263c338f3fd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.218+0000 7feed2000640 10 client.6526 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:50.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.220+0000 7feed2000640 1 -- 172.21.15.100:0/2716528306 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00d0ea0 con 0x564562795990 2024-02-21T07:52:50.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.220+0000 7feed2000640 1 -- 172.21.15.100:0/2716528306 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feee00c1820 con 0x564562795990 2024-02-21T07:52:50.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.221+0000 7feed2000640 1 -- 172.21.15.100:0/2716528306 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feee00b56f0 con 0x564562795990 2024-02-21T07:52:50.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.224+0000 7feef6c14740 10 client.6526 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:50.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.224+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x564562681650 con 0x564562795990 2024-02-21T07:52:50.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.224+0000 7feed2000640 1 -- 172.21.15.100:0/2716528306 <== mon.1 v2:172.21.15.156:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feee0003c60 con 0x564562795990 2024-02-21T07:52:50.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.224+0000 7feef6c14740 10 client.6526 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:50.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.224+0000 7feef6c14740 10 client.6526 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:52:50.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.225+0000 7feef6c14740 20 client.6526 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:50.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.225+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56456278e340 0x56456282d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.225+0000 7feef6c14740 4 client.6526 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:50.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.225+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56456244c890 con 0x56456278e340 2024-02-21T07:52:50.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.225+0000 7feef0c00640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56456278e340 0x56456282d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.226+0000 7feef0c00640 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56456278e340 0x56456282d370 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e7986a0df07ab3a server_cookie=7835ac06b68d1293 in_seq=0 out_seq=0 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.226+0000 7feed2000640 10 client.6526 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.227+0000 7feed2000640 1 -- 172.21.15.100:0/2716528306 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56456244c890 con 0x56456278e340 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.227+0000 7feed2000640 10 client.6526 handle_command_reply: tid=0 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.227+0000 7feef6c14740 1 client.6526 shutdown 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 msgr2=0x564562791d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7feee0007e70 tx=0x7feee400e000 comp rx=0 tx=0).stop 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 shutdown_connections 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x56456278e340 0x56456282d370 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5645627d75c0 0x5645627dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5645627d0740 0x56456279d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 --2- 172.21.15.100:0/2716528306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564562795990 0x564562791d30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 >> 172.21.15.100:0/2716528306 conn(0x564562795070 msgr2=0x564562783c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feed2000640 0 client.6526 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:52:50.235 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 shutdown_connections 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.228+0000 7feef6c14740 1 -- 172.21.15.100:0/2716528306 wait complete. 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.229+0000 7feef6c14740 20 client.6526 trim_cache size 0 max 16384 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 msgr2=0x7feecc0a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 0x7feecc0a1660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feeec0cdfd0 tx=0x7feed8008040 comp rx=0 tx=0).stop 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 msgr2=0x7feeec171cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7feee0007ea0 tx=0x7feee002e070 comp rx=0 tx=0).stop 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 shutdown_connections 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feeec0f4a40 0x7feeec0f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feeec0f7850 0x7feeec0f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feecc09f1a0 0x7feecc0a1660 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 --2- 172.21.15.100:0/778376814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed4004c30 0x7feeec171cf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 >> 172.21.15.100:0/778376814 conn(0x7feeec0ce150 msgr2=0x7feeec0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.230+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 shutdown_connections 2024-02-21T07:52:50.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.231+0000 7feef2a00640 1 -- 172.21.15.100:0/778376814 wait complete. 2024-02-21T07:52:50.280 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:50.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:52:50.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.662+0000 7fb9fa200640 1 Processor -- start 2024-02-21T07:52:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.662+0000 7fb9fa200640 1 -- start start 2024-02-21T07:52:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.666+0000 7fb9fa200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 0x7fb9f4070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.666+0000 7fb9fa200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9f40f4b20 0x7fb9f40f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9f2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9f40f4b20 0x7fb9f40f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9fa200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f418dc80 con 0x7fb9f406e6b0 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9fa200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40f5b90 con 0x7fb9f40f4b20 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9fa200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f40f55d0 con 0x7fb9f4190260 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9f3400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 0x7fb9f4070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9f3e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb9f406e6b0 0x7fb9f4190640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37748/0 (socket says 172.21.15.100:37748) 2024-02-21T07:52:50.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.667+0000 7fb9f3e00640 1 -- 172.21.15.100:0/2346283086 learned_addr learned my addr 172.21.15.100:0/2346283086 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:50.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.668+0000 7fb9f2000640 1 -- 172.21.15.100:0/2346283086 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360694369 0 0) 0x7fb9f418dc80 con 0x7fb9f406e6b0 2024-02-21T07:52:50.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.671+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2346283086 >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 msgr2=0x7fb9f4070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.671+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/2346283086 >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 0x7fb9f4070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.671+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2346283086 >> v1:172.21.15.170:6789/0 conn(0x7fb9f406e6b0 legacy=0x7fb9f4190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.671+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2346283086 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40f58b0 con 0x7fb9f40f4b20 2024-02-21T07:52:50.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.671+0000 7fb9f3400640 1 --2- 172.21.15.100:0/2346283086 >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 0x7fb9f4070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:50.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.675+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/2346283086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40f4fb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb9f408d4e0 tx=0x7fb9e002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ad531793a0cf52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.676+0000 7fb9f2000640 1 -- 172.21.15.100:0/2346283086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0031520 con 0x7fb9f40f4b20 2024-02-21T07:52:50.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.676+0000 7fb9f2000640 1 -- 172.21.15.100:0/2346283086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0031680 con 0x7fb9f40f4b20 2024-02-21T07:52:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.680+0000 7fb9fa200640 1 -- 172.21.15.100:0/2346283086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 msgr2=0x7fb9f40f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.680+0000 7fb9fa200640 1 --2- 172.21.15.100:0/2346283086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40f4fb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb9f408d4e0 tx=0x7fb9e002b7c0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.679+0000 7fb9f2000640 1 -- 172.21.15.100:0/2346283086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0031520 con 0x7fb9f40f4b20 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 -- 172.21.15.100:0/2346283086 shutdown_connections 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 --2- 172.21.15.100:0/2346283086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40f4fb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 --2- 172.21.15.100:0/2346283086 >> v2:172.21.15.156:3300/0 conn(0x7fb9f4190260 0x7fb9f4070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 -- 172.21.15.100:0/2346283086 >> 172.21.15.100:0/2346283086 conn(0x7fb9f40668b0 msgr2=0x7fb9f4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 -- 172.21.15.100:0/2346283086 shutdown_connections 2024-02-21T07:52:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.682+0000 7fb9fa200640 1 -- 172.21.15.100:0/2346283086 wait complete. 2024-02-21T07:52:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.686+0000 7fb9fa200640 1 Processor -- start 2024-02-21T07:52:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.687+0000 7fb9fa200640 1 -- start start 2024-02-21T07:52:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.691+0000 7fb9fa200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 0x7fb9f416df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.691+0000 7fb9fa200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.692+0000 7fb9fa200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9f4190260 0x7fb9f42240b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.692+0000 7fb9f3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 0x7fb9f416df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9f3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 0x7fb9f416df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39568/0 (socket says 172.21.15.100:39568) 2024-02-21T07:52:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9f3400640 1 -- 172.21.15.100:0/3916381016 learned_addr learned my addr 172.21.15.100:0/3916381016 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40cb9d0 con 0x7fb9f40f4b20 2024-02-21T07:52:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40cbc20 con 0x7fb9f4190260 2024-02-21T07:52:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f40cbf00 con 0x7fb9f406e6b0 2024-02-21T07:52:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.693+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9f4190260 0x7fb9f42240b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.692+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.695+0000 7fb9f2a00640 1 -- 172.21.15.100:0/3916381016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 msgr2=0x7fb9f416df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.695+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 0x7fb9f416df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.695+0000 7fb9f2a00640 1 -- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9f4190260 msgr2=0x7fb9f42240b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.695+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9f4190260 0x7fb9f42240b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.695+0000 7fb9f2a00640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009a70 con 0x7fb9f40f4b20 2024-02-21T07:52:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.696+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40cd880 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0033000 tx=0x7fb9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.697+0000 7fb9eb400640 1 -- 172.21.15.100:0/3916381016 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0031520 con 0x7fb9f40f4b20 2024-02-21T07:52:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.698+0000 7fb9eb400640 1 -- 172.21.15.100:0/3916381016 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e0003a20 con 0x7fb9f40f4b20 2024-02-21T07:52:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.698+0000 7fb9eb400640 1 -- 172.21.15.100:0/3916381016 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003dd0 con 0x7fb9f40f4b20 2024-02-21T07:52:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.699+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e0009400 con 0x7fb9f40f4b20 2024-02-21T07:52:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.699+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f40cc4c0 con 0x7fb9f40f4b20 2024-02-21T07:52:50.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.707+0000 7fb9eb400640 1 -- 172.21.15.100:0/3916381016 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb9e003f450 con 0x7fb9f40f4b20 2024-02-21T07:52:50.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.712+0000 7fb9fce4b740 1 Processor -- start 2024-02-21T07:52:50.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.713+0000 7fb9fce4b740 1 -- start start 2024-02-21T07:52:50.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417fbf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fbfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417ec1210 con 0x563417fd8930 2024-02-21T07:52:50.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417ebe740 con 0x563417fd84b0 2024-02-21T07:52:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.715+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417eb9f20 con 0x563417f92d10 2024-02-21T07:52:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39576/0 (socket says 172.21.15.100:39576) 2024-02-21T07:52:50.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 -- 172.21.15.100:0/2957254261 learned_addr learned my addr 172.21.15.100:0/2957254261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 -- 172.21.15.100:0/2957254261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 msgr2=0x563417fbf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417fbf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.716+0000 7fb9f3e00640 1 -- 172.21.15.100:0/2957254261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 msgr2=0x563417fbfbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:50.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.717+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fbfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.717+0000 7fb9f3e00640 1 -- 172.21.15.100:0/2957254261 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563417e7bdf0 con 0x563417f92d10 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.717+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40076c0 tx=0x7fb9e4005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deff1b9100dca024 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.718+0000 7fb9df400640 1 -- 172.21.15.100:0/2957254261 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40016c0 con 0x563417f92d10 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.718+0000 7fb9df400640 1 -- 172.21.15.100:0/2957254261 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4001820 con 0x563417f92d10 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.718+0000 7fb9df400640 1 -- 172.21.15.100:0/2957254261 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40016c0 con 0x563417f92d10 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.718+0000 7fb9eb400640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 0x7fb9d40a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.718+0000 7fb9eb400640 1 -- 172.21.15.100:0/3916381016 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb9e00eb9b0 con 0x7fb9f40f4b20 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.719+0000 7fb9f3400640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 0x7fb9d40a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.720+0000 7fb9f3400640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 0x7fb9d40a1630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x563417f59690 tx=0x7fb9ec009750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.720+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2957254261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 msgr2=0x563417f930f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.720+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40076c0 tx=0x7fb9e4005bc0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2957254261 shutdown_connections 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fbfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417fbf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2957254261 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417f92d10 0x563417f930f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2957254261 >> 172.21.15.100:0/2957254261 conn(0x563417f50490 msgr2=0x563417f51510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2957254261 shutdown_connections 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.721+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2957254261 wait complete. 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.723+0000 7fb9fce4b740 1 -- start start 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.723+0000 7fb9fce4b740 1 Processor -- start 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.725+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.725+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 0x563417fd99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.725+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.726+0000 7fb9f3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.726+0000 7fb9f3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41872/0 (socket says 172.21.15.100:41872) 2024-02-21T07:52:50.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.726+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40066/0 (socket says 172.21.15.100:40066) 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 0x563417fd99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 0x563417fd99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39590/0 (socket says 172.21.15.100:39590) 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9f3400640 1 -- 172.21.15.100:0/616226069 learned_addr learned my addr 172.21.15.100:0/616226069 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417e5f150 con 0x563417f4c030 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417e5edf0 con 0x563417fd84b0 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417c281c0 con 0x563417fd8930 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.727+0000 7fb9fce4b740 10 client.0 _ll_register_callbacks cb 0x563417eae2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.729+0000 7fb9f3e00640 1 -- 172.21.15.100:0/616226069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 msgr2=0x563417fd99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.729+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 0x563417fd99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9f3e00640 1 -- 172.21.15.100:0/616226069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 msgr2=0x563417f72370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9f3e00640 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4007300 con 0x563417f4c030 2024-02-21T07:52:50.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9f3400640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4037000 tx=0x7fb9e4007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f323084db5641c15 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.730+0000 7fb9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.731+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e4036b10 con 0x563417f4c030 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.731+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb9e4036c70 con 0x563417f4c030 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.731+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563417bb97e0 con 0x563417f4c030 2024-02-21T07:52:50.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.731+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e4036e30 con 0x563417f4c030 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 10 client.6348 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563417eb85a0 con 0x563417f4c030 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563417bb97e0 con 0x563417f4c030 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb9e4051460 con 0x563417f4c030 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 10 client.6348 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 10 client.6348 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 20 client.6348 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.735+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x563417f72a50 0x563417fb6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.736+0000 7fb9fce4b740 4 client.6348 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:50.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.736+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563417bf6720 con 0x563417f72a50 2024-02-21T07:52:50.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.736+0000 7fb9f3400640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x563417f72a50 0x563417fb6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.737+0000 7fb9f3400640 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x563417f72a50 0x563417fb6fc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=651e9b1e643ae0a3 server_cookie=2ae11e3617890ce4 in_seq=0 out_seq=0 2024-02-21T07:52:50.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.737+0000 7fb9d3e00640 10 client.6348 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:50.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.739+0000 7fb9d3e00640 1 -- 172.21.15.100:0/616226069 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563417bf6720 con 0x563417f72a50 2024-02-21T07:52:50.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.739+0000 7fb9d3e00640 10 client.6348 handle_command_reply: tid=0 2024-02-21T07:52:50.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.739+0000 7fb9fce4b740 1 client.6348 shutdown 2024-02-21T07:52:50.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.739+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 msgr2=0x563417fb20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.739+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4037000 tx=0x7fb9e4007b40 comp rx=0 tx=0).stop 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 shutdown_connections 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417fb20d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd8930 0x563417fd99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x563417f72a50 0x563417fb6fc0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/616226069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd84b0 0x563417f72370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.740+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 >> 172.21.15.100:0/616226069 conn(0x563417f92d10 msgr2=0x563417fd8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.741+0000 7fb9d3e00640 0 client.6348 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:50.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.743+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 shutdown_connections 2024-02-21T07:52:50.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.744+0000 7fb9fce4b740 1 -- 172.21.15.100:0/616226069 wait complete. 2024-02-21T07:52:50.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.744+0000 7fb9fce4b740 20 client.6348 trim_cache size 0 max 16384 2024-02-21T07:52:50.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.780+0000 7fb9fce4b740 1 Processor -- start 2024-02-21T07:52:50.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.780+0000 7fb9fce4b740 1 -- start start 2024-02-21T07:52:50.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.785+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417f51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.786+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x5634180248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.786+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 0x563418024df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.786+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417f9d720 con 0x563417f4c030 2024-02-21T07:52:50.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.786+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417fd99d0 con 0x563417fd8930 2024-02-21T07:52:50.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.786+0000 7fb9fce4b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417f9d3c0 con 0x563417fd84b0 2024-02-21T07:52:50.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.787+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 0x563418024df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.787+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x5634180248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.787+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x5634180248b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39606/0 (socket says 172.21.15.100:39606) 2024-02-21T07:52:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.787+0000 7fb9f2a00640 1 -- 172.21.15.100:0/4081320880 learned_addr learned my addr 172.21.15.100:0/4081320880 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.787+0000 7fb9f3400640 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417f51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.788+0000 7fb9f3e00640 1 -- 172.21.15.100:0/4081320880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 msgr2=0x5634180248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.788+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x5634180248b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.788+0000 7fb9f3e00640 1 -- 172.21.15.100:0/4081320880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 msgr2=0x563417f51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.788+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417f51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.788+0000 7fb9f3e00640 1 -- 172.21.15.100:0/4081320880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563417e54ab0 con 0x563417fd8930 2024-02-21T07:52:50.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.790+0000 7fb9f3e00640 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 0x563418024df0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x563417f92af0 tx=0x7fb9e4007050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a74b4635e0e7fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.790+0000 7fb9dea00640 1 -- 172.21.15.100:0/4081320880 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40070c0 con 0x563417fd8930 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.790+0000 7fb9dea00640 1 -- 172.21.15.100:0/4081320880 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e400b050 con 0x563417fd8930 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.791+0000 7fb9fce4b740 1 -- 172.21.15.100:0/4081320880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 msgr2=0x563418024df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.791+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 0x563418024df0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x563417f92af0 tx=0x7fb9e4007050 comp rx=0 tx=0).stop 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.792+0000 7fb9fce4b740 1 -- 172.21.15.100:0/4081320880 shutdown_connections 2024-02-21T07:52:50.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.792+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417fd8930 0x563418024df0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.792+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x5634180248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.792+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/4081320880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417f4c030 0x563417f51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.793+0000 7fb9fce4b740 1 -- 172.21.15.100:0/4081320880 >> 172.21.15.100:0/4081320880 conn(0x563417f92d10 msgr2=0x563417fabb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.802+0000 7fb9fce4b740 1 -- 172.21.15.100:0/4081320880 shutdown_connections 2024-02-21T07:52:50.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.802+0000 7fb9fce4b740 1 -- 172.21.15.100:0/4081320880 wait complete. 2024-02-21T07:52:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.804+0000 7fb9fce4b740 1 -- start start 2024-02-21T07:52:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.804+0000 7fb9fce4b740 1 Processor -- start 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.832+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417f4c030 0x563417f4e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.832+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.832+0000 7fb9fce4b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fabee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9f2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39614/0 (socket says 172.21.15.100:39614) 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2629549248 learned_addr learned my addr 172.21.15.100:0/2629549248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:50.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417f56410 con 0x563417fd8930 2024-02-21T07:52:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417f48840 con 0x563417f4c030 2024-02-21T07:52:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.837+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563417fac420 con 0x563417fd84b0 2024-02-21T07:52:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.838+0000 7fb9fce4b740 10 client.0 _ll_register_callbacks cb 0x7fb9e4007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:50.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.839+0000 7fb9f3400640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417f4c030 0x563417f4e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.840+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2629549248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417f4c030 msgr2=0x563417f4e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.840+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417f4c030 0x563417f4e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 msgr2=0x563417fabee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fabee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9f2a00640 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563417eb85a0 con 0x563417fd84b0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9f2a00640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0036040 tx=0x7fb9e00b9410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eaad56828973f5a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00b9c80 con 0x563417fd84b0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb9e00b9580 con 0x563417fd84b0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9e4001820 con 0x563417fd84b0 2024-02-21T07:52:50.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.841+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9e00bd6d0 con 0x563417fd84b0 2024-02-21T07:52:50.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.850+0000 7fb9fce4b740 10 client.6485 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.850+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563417e7a650 con 0x563417fd84b0 2024-02-21T07:52:50.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e4001820 con 0x563417fd84b0 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb9e004f020 con 0x563417fd84b0 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 10 client.6485 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 10 client.6485 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 20 client.6485 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5634180268c0 0x563417fd8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 4 client.6485 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.863+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563417c45890 con 0x5634180268c0 2024-02-21T07:52:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.866+0000 7fb9f3400640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5634180268c0 0x563417fd8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.871+0000 7fb9f3400640 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5634180268c0 0x563417fd8d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8507bea86acf688f server_cookie=72d6ef05ae72a621 in_seq=0 out_seq=0 2024-02-21T07:52:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.871+0000 7fb9d3e00640 10 client.6485 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.874+0000 7fb9d3e00640 1 -- 172.21.15.100:0/2629549248 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563417c45890 con 0x5634180268c0 2024-02-21T07:52:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.874+0000 7fb9d3e00640 10 client.6485 handle_command_reply: tid=0 2024-02-21T07:52:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.875+0000 7fb9fce4b740 1 client.6485 shutdown 2024-02-21T07:52:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.876+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 msgr2=0x563417f48300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.876+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0036040 tx=0x7fb9e00b9410 comp rx=0 tx=0).stop 2024-02-21T07:52:50.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 shutdown_connections 2024-02-21T07:52:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563417fd8930 0x563417fabee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563417fd84b0 0x563417f48300 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5634180268c0 0x563417fd8d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 --2- 172.21.15.100:0/2629549248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563417f4c030 0x563417f4e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.877+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 >> 172.21.15.100:0/2629549248 conn(0x563417f92d10 msgr2=0x563417f51700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.880+0000 7fb9d3e00640 0 client.6485 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:52:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.881+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 shutdown_connections 2024-02-21T07:52:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.882+0000 7fb9fce4b740 1 -- 172.21.15.100:0/2629549248 wait complete. 2024-02-21T07:52:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.882+0000 7fb9fce4b740 20 client.6485 trim_cache size 0 max 16384 2024-02-21T07:52:50.886 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.885+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 msgr2=0x7fb9d40a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.885+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 0x7fb9d40a1630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x563417f59690 tx=0x7fb9ec009750 comp rx=0 tx=0).stop 2024-02-21T07:52:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.885+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 msgr2=0x7fb9f40cd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.885+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40cd880 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0033000 tx=0x7fb9e00046c0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 shutdown_connections 2024-02-21T07:52:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9f4190260 0x7fb9f42240b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb9d409f170 0x7fb9d40a1630 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9f40f4b20 0x7fb9f40cd880 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 --2- 172.21.15.100:0/3916381016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9f406e6b0 0x7fb9f416df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.887+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 >> 172.21.15.100:0/3916381016 conn(0x7fb9f40668b0 msgr2=0x7fb9f4071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.889+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 shutdown_connections 2024-02-21T07:52:50.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:50.889+0000 7fb9fa200640 1 -- 172.21.15.100:0/3916381016 wait complete. 2024-02-21T07:52:50.971 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:52:50.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:52:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.580+0000 7fbc02c00640 1 Processor -- start 2024-02-21T07:52:51.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.583+0000 7fbc02c00640 1 -- start start 2024-02-21T07:52:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.586+0000 7fbc02c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbbf4109af0 0x7fbbf4109fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.586+0000 7fbc02c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4054220 con 0x7fbbf4109710 2024-02-21T07:52:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.586+0000 7fbc02c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf4054500 con 0x7fbbf410ac20 2024-02-21T07:52:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.586+0000 7fbc02c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40547e0 con 0x7fbbf4109af0 2024-02-21T07:52:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.587+0000 7fbbfbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbbf4109710 0x7fbbf410d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38746/0 (socket says 172.21.15.100:38746) 2024-02-21T07:52:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.587+0000 7fbbfbe00640 1 -- 172.21.15.100:0/1631896667 learned_addr learned my addr 172.21.15.100:0/1631896667 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.588+0000 7fbbfb400640 1 --2- 172.21.15.100:0/1631896667 >> v2:172.21.15.170:3300/0 conn(0x7fbbf4109af0 0x7fbbf4109fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.588+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423558342 0 0) 0x7fbbf4054220 con 0x7fbbf4109710 2024-02-21T07:52:51.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.588+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbe4003520 con 0x7fbbf4109710 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.589+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861944637 0 0) 0x7fbbe4003520 con 0x7fbbf4109710 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.589+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 >> v2:172.21.15.170:3300/0 conn(0x7fbbf4109af0 msgr2=0x7fbbf4109fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.589+0000 7fbbfaa00640 1 --2- 172.21.15.100:0/1631896667 >> v2:172.21.15.170:3300/0 conn(0x7fbbf4109af0 0x7fbbf4109fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.589+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 >> v1:172.21.15.170:6789/0 conn(0x7fbbf410ac20 legacy=0x7fbbf410b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4054ac0 con 0x7fbbf4109710 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fbbe8001670 con 0x7fbbf4109710 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 >> v1:172.21.15.100:6789/0 conn(0x7fbbf4109710 legacy=0x7fbbf410d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4003970 0x7fbbe4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe4004380 0x7fbbe4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 0x7fbbe400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40547e0 con 0x7fbbe4005060 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400bff0 con 0x7fbbe4003970 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.591+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe400c160 con 0x7fbbe4004380 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.592+0000 7fbc00c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 0x7fbbe400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4003970 0x7fbbe4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.592+0000 7fbbfb400640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe4004380 0x7fbbe4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbc00c00640 1 -- 172.21.15.100:0/1631896667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe4004380 msgr2=0x7fbbe4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbc00c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbe4004380 0x7fbbe4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbc00c00640 1 -- 172.21.15.100:0/1631896667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4003970 msgr2=0x7fbbe4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbc00c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4003970 0x7fbbe4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.595+0000 7fbc00c00640 1 -- 172.21.15.100:0/1631896667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4054ac0 con 0x7fbbe4005060 2024-02-21T07:52:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.596+0000 7fbc00c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 0x7fbbe400b980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc068a00 tx=0x7fbbe40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3771307ef289bdf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.596+0000 7fbc00c00640 1 -- 172.21.15.100:0/1631896667 reap_dead start 2024-02-21T07:52:51.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.597+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0a7970 con 0x7fbbe4005060 2024-02-21T07:52:51.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.598+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0a7af0 con 0x7fbbe4005060 2024-02-21T07:52:51.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.598+0000 7fbbfaa00640 1 -- 172.21.15.100:0/1631896667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0a7ea0 con 0x7fbbe4005060 2024-02-21T07:52:51.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.601+0000 7fbc02c00640 1 -- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 msgr2=0x7fbbe400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.601+0000 7fbc02c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 0x7fbbe400b980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc068a00 tx=0x7fbbe40057f0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.603+0000 7fbc02c00640 1 -- 172.21.15.100:0/1631896667 shutdown_connections 2024-02-21T07:52:51.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.603+0000 7fbc02c00640 1 --2- 172.21.15.100:0/1631896667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbe4005060 0x7fbbe400b980 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.603+0000 7fbc02c00640 1 -- 172.21.15.100:0/1631896667 >> 172.21.15.100:0/1631896667 conn(0x7fbbf4052e00 msgr2=0x7fbbf4053210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.604+0000 7fbc02c00640 1 -- 172.21.15.100:0/1631896667 shutdown_connections 2024-02-21T07:52:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.604+0000 7fbc02c00640 1 -- 172.21.15.100:0/1631896667 wait complete. 2024-02-21T07:52:51.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.607+0000 7fbc02c00640 1 Processor -- start 2024-02-21T07:52:51.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.607+0000 7fbc02c00640 1 -- start start 2024-02-21T07:52:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4005060 0x7fbbf407d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbf40f5630 0x7fbbf40f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40f5fc0 con 0x7fbbf40f3f40 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40f62a0 con 0x7fbbe4005060 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc02c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40f6580 con 0x7fbbf40f5630 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc00c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc00c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40096/0 (socket says 172.21.15.100:40096) 2024-02-21T07:52:51.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.609+0000 7fbc00c00640 1 -- 172.21.15.100:0/3319746240 learned_addr learned my addr 172.21.15.100:0/3319746240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4005060 0x7fbbf407d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbf40f5630 0x7fbbf40f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 -- 172.21.15.100:0/3319746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbf40f5630 msgr2=0x7fbbf40f3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbf40f5630 0x7fbbf40f3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 -- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4005060 msgr2=0x7fbbf407d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4005060 0x7fbbf407d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 -- 172.21.15.100:0/3319746240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40f6860 con 0x7fbbf40f3f40 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.610+0000 7fbc00c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0506c0 tx=0x7fbbfc069530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.611+0000 7fbbefe00640 1 -- 172.21.15.100:0/3319746240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0bd070 con 0x7fbbf40f3f40 2024-02-21T07:52:51.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.611+0000 7fbbefe00640 1 -- 172.21.15.100:0/3319746240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0a7980 con 0x7fbbf40f3f40 2024-02-21T07:52:51.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.611+0000 7fbbefe00640 1 -- 172.21.15.100:0/3319746240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0b85f0 con 0x7fbbf40f3f40 2024-02-21T07:52:51.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.612+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf419ff70 con 0x7fbbf40f3f40 2024-02-21T07:52:51.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.613+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf407dcc0 con 0x7fbbf40f3f40 2024-02-21T07:52:51.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.619+0000 7fbbefe00640 1 -- 172.21.15.100:0/3319746240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbbfc0b8810 con 0x7fbbf40f3f40 2024-02-21T07:52:51.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.622+0000 7fbc05820740 1 Processor -- start 2024-02-21T07:52:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.622+0000 7fbc05820740 1 -- start start 2024-02-21T07:52:51.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.624+0000 7fbbefe00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 0x7fbbdc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.624+0000 7fbbefe00640 1 -- 172.21.15.100:0/3319746240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbbfc165c90 con 0x7fbbf40f3f40 2024-02-21T07:52:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.624+0000 7fbc05820740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 0x55cf28063450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.624+0000 7fbc05820740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 0x55cf2809e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc05820740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2809f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc05820740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27f96210 con 0x55cf2809e740 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc05820740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27f93740 con 0x55cf28063990 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc05820740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27f8ef20 con 0x55cf28063070 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 0x55cf28063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbbfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 0x55cf2809e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc00c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2809f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc00c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2809f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40098/0 (socket says 172.21.15.100:40098) 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbc00c00640 1 -- 172.21.15.100:0/4082218374 learned_addr learned my addr 172.21.15.100:0/4082218374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.625+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 0x7fbbdc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfbe00640 1 -- 172.21.15.100:0/4082218374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 msgr2=0x55cf2809e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 0x55cf2809e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfbe00640 1 -- 172.21.15.100:0/4082218374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 msgr2=0x55cf2809f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2809f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfbe00640 1 -- 172.21.15.100:0/4082218374 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf27f50df0 con 0x55cf28063070 2024-02-21T07:52:51.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.626+0000 7fbbfb400640 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 0x55cf2809e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:51.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.627+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 0x55cf28063450 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80016b0 tx=0x7fbbe80016e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7afa7c92ba2901e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.627+0000 7fbbe3e00640 1 -- 172.21.15.100:0/4082218374 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007180 con 0x55cf28063070 2024-02-21T07:52:51.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.627+0000 7fbbe3e00640 1 -- 172.21.15.100:0/4082218374 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe80072e0 con 0x55cf28063070 2024-02-21T07:52:51.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.627+0000 7fbbe3e00640 1 -- 172.21.15.100:0/4082218374 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007690 con 0x55cf28063070 2024-02-21T07:52:51.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.630+0000 7fbc05820740 1 -- 172.21.15.100:0/4082218374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 msgr2=0x55cf28063450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.630+0000 7fbc05820740 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 0x55cf28063450 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80016b0 tx=0x7fbbe80016e0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.630+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 0x7fbbdc0a16b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4050940 tx=0x7fbbf0010540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.633+0000 7fbc05820740 1 -- 172.21.15.100:0/4082218374 shutdown_connections 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.633+0000 7fbc05820740 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2809f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.634+0000 7fbc05820740 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf28063990 0x55cf2809e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.634+0000 7fbc05820740 1 --2- 172.21.15.100:0/4082218374 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf28063070 0x55cf28063450 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.634+0000 7fbc05820740 1 -- 172.21.15.100:0/4082218374 >> 172.21.15.100:0/4082218374 conn(0x55cf28025640 msgr2=0x55cf280266c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.635+0000 7fbc05820740 1 -- 172.21.15.100:0/4082218374 shutdown_connections 2024-02-21T07:52:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.635+0000 7fbc05820740 1 -- 172.21.15.100:0/4082218374 wait complete. 2024-02-21T07:52:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.636+0000 7fbc05820740 1 -- start start 2024-02-21T07:52:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.637+0000 7fbc05820740 1 Processor -- start 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28021e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27f34150 con 0x55cf28063990 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27f33df0 con 0x55cf280a7d70 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf27cfd1c0 con 0x55cf2809e740 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.639+0000 7fbc05820740 10 client.0 _ll_register_callbacks cb 0x55cf27f832b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:51.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.640+0000 7fbbfb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.640+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.640+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40104/0 (socket says 172.21.15.100:40104) 2024-02-21T07:52:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.640+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3724452538 learned_addr learned my addr 172.21.15.100:0/3724452538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.640+0000 7fbc00c00640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28021e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3724452538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 msgr2=0x55cf280510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3724452538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 msgr2=0x55cf28021e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28021e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3724452538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe800f040 con 0x55cf28063990 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8005fd0 tx=0x7fbbe8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423704fb4b752c12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.641+0000 7fbbe0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.643+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007180 con 0x55cf28063990 2024-02-21T07:52:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.644+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbbe80019a0 con 0x55cf28063990 2024-02-21T07:52:51.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.644+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf27c8e7e0 con 0x55cf28063990 2024-02-21T07:52:51.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.645+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbe8007760 con 0x55cf28063990 2024-02-21T07:52:51.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.645+0000 7fbc05820740 10 client.6363 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:51.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.645+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cf27f8d5a0 con 0x55cf28063990 2024-02-21T07:52:51.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf27c8e7e0 con 0x55cf28063990 2024-02-21T07:52:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbbe8015bc0 con 0x55cf28063990 2024-02-21T07:52:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbc05820740 10 client.6363 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbc05820740 10 client.6363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbc05820740 20 client.6363 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.646+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf280a81f0 0x55cf28022810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.647+0000 7fbc05820740 4 client.6363 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.647+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf27ccb720 con 0x55cf280a81f0 2024-02-21T07:52:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.647+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf280a81f0 0x55cf28022810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.648+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf280a81f0 0x55cf28022810 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cecc06f02e9d300 server_cookie=a38d5fb89edbc9c9 in_seq=0 out_seq=0 2024-02-21T07:52:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.648+0000 7fbbe0c00640 10 client.6363 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.648+0000 7fbbe0c00640 1 -- 172.21.15.100:0/3724452538 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cf27ccb720 con 0x55cf280a81f0 2024-02-21T07:52:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.648+0000 7fbbe0c00640 10 client.6363 handle_command_reply: tid=0 2024-02-21T07:52:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 client.6363 shutdown 2024-02-21T07:52:51.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 msgr2=0x55cf280558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8005fd0 tx=0x7fbbe8001930 comp rx=0 tx=0).stop 2024-02-21T07:52:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 shutdown_connections 2024-02-21T07:52:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf280a81f0 0x55cf28022810 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28021e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 --2- 172.21.15.100:0/3724452538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf28063990 0x55cf280558c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 >> 172.21.15.100:0/3724452538 conn(0x55cf28063070 msgr2=0x55cf280270b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.649+0000 7fbbe0c00640 0 client.6363 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.650+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 shutdown_connections 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.650+0000 7fbc05820740 1 -- 172.21.15.100:0/3724452538 wait complete. 2024-02-21T07:52:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.650+0000 7fbc05820740 20 client.6363 trim_cache size 0 max 16384 2024-02-21T07:52:51.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.677+0000 7fbc05820740 1 Processor -- start 2024-02-21T07:52:51.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.677+0000 7fbc05820740 1 -- start start 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28093f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2805fa50 0x55cf2808ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf28021950 con 0x55cf2809e740 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf28057560 con 0x55cf280a7d70 2024-02-21T07:52:51.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.678+0000 7fbc05820740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf28068760 con 0x55cf2805fa50 2024-02-21T07:52:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40116/0 (socket says 172.21.15.100:40116) 2024-02-21T07:52:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3669584126 learned_addr learned my addr 172.21.15.100:0/3669584126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28093f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbc00c00640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2805fa50 0x55cf2808ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3669584126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2805fa50 msgr2=0x55cf2808ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2805fa50 0x55cf2808ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3669584126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 msgr2=0x55cf28093f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28093f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfbe00640 1 -- 172.21.15.100:0/3669584126 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf27f29ab0 con 0x55cf2809e740 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.679+0000 7fbbfb400640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28093f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:51.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.680+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009010 tx=0x7fbbe8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da8ec7fa3da4d7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.680+0000 7fbbe3400640 1 -- 172.21.15.100:0/3669584126 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007760 con 0x55cf2809e740 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.680+0000 7fbbe3400640 1 -- 172.21.15.100:0/3669584126 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8001520 con 0x55cf2809e740 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.680+0000 7fbbe3400640 1 -- 172.21.15.100:0/3669584126 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8020c70 con 0x55cf2809e740 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 -- 172.21.15.100:0/3669584126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 msgr2=0x55cf2805d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009010 tx=0x7fbbe8021000 comp rx=0 tx=0).stop 2024-02-21T07:52:51.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 -- 172.21.15.100:0/3669584126 shutdown_connections 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2805fa50 0x55cf2808ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf280a7d70 0x55cf28093f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 --2- 172.21.15.100:0/3669584126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf2809e740 0x55cf2805d1b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 -- 172.21.15.100:0/3669584126 >> 172.21.15.100:0/3669584126 conn(0x55cf28063070 msgr2=0x55cf2804a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 -- 172.21.15.100:0/3669584126 shutdown_connections 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.681+0000 7fbc05820740 1 -- 172.21.15.100:0/3669584126 wait complete. 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.682+0000 7fbc05820740 1 -- start start 2024-02-21T07:52:51.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.682+0000 7fbc05820740 1 Processor -- start 2024-02-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf280a7d70 0x55cf280aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2809e150 con 0x55cf280a7d70 2024-02-21T07:52:51.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2804aee0 con 0x55cf2805fa50 2024-02-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.684+0000 7fbc05820740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf280234f0 con 0x55cf2809e740 2024-02-21T07:52:51.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbc05820740 10 client.0 _ll_register_callbacks cb 0x7fbbe8000f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41934/0 (socket says 172.21.15.100:41934) 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 -- 172.21.15.100:0/1248103414 learned_addr learned my addr 172.21.15.100:0/1248103414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbc00c00640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf280a7d70 0x55cf280aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 -- 172.21.15.100:0/1248103414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 msgr2=0x55cf280fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 -- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf280a7d70 msgr2=0x55cf280aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf280a7d70 0x55cf280aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.685+0000 7fbbfbe00640 1 -- 172.21.15.100:0/1248103414 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf27f8d5a0 con 0x55cf2805fa50 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.686+0000 7fbbfbe00640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f20 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e860970f193c17d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:51.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.686+0000 7fbbe0c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.686+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007760 con 0x55cf2805fa50 2024-02-21T07:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.687+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbbe8034440 con 0x55cf2805fa50 2024-02-21T07:52:51.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.687+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbe80072e0 con 0x55cf2805fa50 2024-02-21T07:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.687+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbe8034600 con 0x55cf2805fa50 2024-02-21T07:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.688+0000 7fbc05820740 10 client.6553 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.688+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cf27f4f650 con 0x55cf2805fa50 2024-02-21T07:52:51.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.688+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe80072e0 con 0x55cf2805fa50 2024-02-21T07:52:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbbe8034760 con 0x55cf2805fa50 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 10 client.6553 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 10 client.6553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 20 client.6553 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf2809c850 0x55cf280270b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 4 client.6553 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:52:51.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cf27d1a890 con 0x55cf2809c850 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.689+0000 7fbbfb400640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf2809c850 0x55cf280270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.690+0000 7fbbe0c00640 10 client.6553 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.690+0000 7fbbfb400640 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf2809c850 0x55cf280270b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf8f412a4dd5a66 server_cookie=ba7d058b61fcc94e in_seq=0 out_seq=0 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.690+0000 7fbbe0c00640 1 -- 172.21.15.100:0/1248103414 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cf27d1a890 con 0x55cf2809c850 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.690+0000 7fbbe0c00640 10 client.6553 handle_command_reply: tid=0 2024-02-21T07:52:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.690+0000 7fbc05820740 1 client.6553 shutdown 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 msgr2=0x55cf28022810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f20 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 shutdown_connections 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cf2809c850 0x55cf280270b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cf280a7d70 0x55cf280aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cf2809e740 0x55cf280fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbbe0c00640 0 client.6553 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 --2- 172.21.15.100:0/1248103414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2805fa50 0x55cf28022810 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 >> 172.21.15.100:0/1248103414 conn(0x55cf28063070 msgr2=0x55cf2809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 shutdown_connections 2024-02-21T07:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 1 -- 172.21.15.100:0/1248103414 wait complete. 2024-02-21T07:52:51.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.691+0000 7fbc05820740 20 client.6553 trim_cache size 0 max 16384 2024-02-21T07:52:51.700 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 msgr2=0x7fbbdc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 0x7fbbdc0a16b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4050940 tx=0x7fbbf0010540 comp rx=0 tx=0).stop 2024-02-21T07:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 msgr2=0x7fbbf40eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0506c0 tx=0x7fbbfc069530 comp rx=0 tx=0).stop 2024-02-21T07:52:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 shutdown_connections 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbbdc09f1f0 0x7fbbdc0a16b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf40f3f40 0x7fbbf40eda10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbbf40f5630 0x7fbbf40f3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 --2- 172.21.15.100:0/3319746240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbbe4005060 0x7fbbf407d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 >> 172.21.15.100:0/3319746240 conn(0x7fbbf4052e00 msgr2=0x7fbbf410d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 shutdown_connections 2024-02-21T07:52:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:51.692+0000 7fbc02c00640 1 -- 172.21.15.100:0/3319746240 wait complete. 2024-02-21T07:52:52.724 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:52:52.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:52:52.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:52:53.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.167+0000 7f3545000640 1 Processor -- start 2024-02-21T07:52:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.167+0000 7f3545000640 1 -- start start 2024-02-21T07:52:53.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.174+0000 7f353de00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f354018a470 0x7f354006e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:53340/0 (socket says 172.21.15.100:53340) 2024-02-21T07:52:53.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.174+0000 7f3545000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f354018ab00 0x7f354006f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.176+0000 7f353de00640 1 -- 172.21.15.100:0/2546706931 learned_addr learned my addr 172.21.15.100:0/2546706931 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.176+0000 7f353d400640 1 --2- 172.21.15.100:0/2546706931 >> v2:172.21.15.100:3300/0 conn(0x7f354018ab00 0x7f354006f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.177+0000 7f3545000640 1 --2- 172.21.15.100:0/2546706931 >> v2:172.21.15.170:3300/0 conn(0x7f354006f750 0x7f35400f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.177+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354018a850 con 0x7f354018a470 2024-02-21T07:52:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.178+0000 7f353e800640 1 --2- 172.21.15.100:0/2546706931 >> v2:172.21.15.170:3300/0 conn(0x7f354006f750 0x7f35400f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.178+0000 7f353ca00640 1 -- 172.21.15.100:0/2546706931 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089639103 0 0) 0x7f354018a850 con 0x7f354018a470 2024-02-21T07:52:53.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.182+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354006e470 con 0x7f354018ab00 2024-02-21T07:52:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.182+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354018af60 con 0x7f354006f750 2024-02-21T07:52:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.183+0000 7f353ca00640 1 -- 172.21.15.100:0/2546706931 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3524003520 con 0x7f354018a470 2024-02-21T07:52:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.183+0000 7f353d400640 1 -- 172.21.15.100:0/2546706931 >> v2:172.21.15.170:3300/0 conn(0x7f354006f750 msgr2=0x7f35400f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.183+0000 7f353d400640 1 --2- 172.21.15.100:0/2546706931 >> v2:172.21.15.170:3300/0 conn(0x7f354006f750 0x7f35400f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.183+0000 7f353d400640 1 -- 172.21.15.100:0/2546706931 >> v1:172.21.15.156:6789/0 conn(0x7f354018a470 legacy=0x7f354006e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.184+0000 7f353d400640 1 -- 172.21.15.100:0/2546706931 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400f8d70 con 0x7f354018ab00 2024-02-21T07:52:53.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.186+0000 7f353d400640 1 --2- 172.21.15.100:0/2546706931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354018ab00 0x7f354006f210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f35400f9c80 tx=0x7f352c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3327de3a30799db server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.187+0000 7f353ca00640 1 -- 172.21.15.100:0/2546706931 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c031750 con 0x7f354018ab00 2024-02-21T07:52:53.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.187+0000 7f353ca00640 1 -- 172.21.15.100:0/2546706931 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c0318b0 con 0x7f354018ab00 2024-02-21T07:52:53.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.187+0000 7f353ca00640 1 -- 172.21.15.100:0/2546706931 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c031c80 con 0x7f354018ab00 2024-02-21T07:52:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.191+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354018ab00 msgr2=0x7f354006f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.191+0000 7f3545000640 1 --2- 172.21.15.100:0/2546706931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354018ab00 0x7f354006f210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f35400f9c80 tx=0x7f352c02b7f0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.192+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 shutdown_connections 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.192+0000 7f3545000640 1 --2- 172.21.15.100:0/2546706931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354018ab00 0x7f354006f210 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.192+0000 7f3545000640 1 --2- 172.21.15.100:0/2546706931 >> v2:172.21.15.170:3300/0 conn(0x7f354006f750 0x7f35400f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.192+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 >> 172.21.15.100:0/2546706931 conn(0x7f35400668b0 msgr2=0x7f3540066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.193+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 shutdown_connections 2024-02-21T07:52:53.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.193+0000 7f3545000640 1 -- 172.21.15.100:0/2546706931 wait complete. 2024-02-21T07:52:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.197+0000 7f3545000640 1 Processor -- start 2024-02-21T07:52:53.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.198+0000 7f3545000640 1 -- start start 2024-02-21T07:52:53.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.200+0000 7f3545000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.201+0000 7f353de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.201+0000 7f353de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40132/0 (socket says 172.21.15.100:40132) 2024-02-21T07:52:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.202+0000 7f353de00640 1 -- 172.21.15.100:0/1242375207 learned_addr learned my addr 172.21.15.100:0/1242375207 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.202+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f354018a470 0x7f3540184640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.202+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 0x7f3540223060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.202+0000 7f353d400640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f354018a470 0x7f3540184640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.203+0000 7f353e800640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 0x7f3540223060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.203+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3540185130 con 0x7f354006f750 2024-02-21T07:52:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.203+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3540185410 con 0x7f354018a470 2024-02-21T07:52:53.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.203+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35401856f0 con 0x7f354018ab00 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.204+0000 7f353de00640 1 -- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 msgr2=0x7f3540223060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353de00640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 0x7f3540223060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353de00640 1 -- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f354018a470 msgr2=0x7f3540184640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353de00640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f354018a470 0x7f3540184640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353de00640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c009400 con 0x7f354006f750 2024-02-21T07:52:53.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353e800640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 0x7f3540223060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.205+0000 7f353de00640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f353000c390 tx=0x7f353000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.206+0000 7f3536000640 1 -- 172.21.15.100:0/1242375207 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530005ce0 con 0x7f354006f750 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.206+0000 7f3536000640 1 -- 172.21.15.100:0/1242375207 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530005e40 con 0x7f354006f750 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.206+0000 7f3536000640 1 -- 172.21.15.100:0/1242375207 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300072d0 con 0x7f354006f750 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.206+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35401859d0 con 0x7f354006f750 2024-02-21T07:52:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.206+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3540185f90 con 0x7f354006f750 2024-02-21T07:52:53.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.218+0000 7f3536000640 1 -- 172.21.15.100:0/1242375207 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3530007430 con 0x7f354006f750 2024-02-21T07:52:53.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.221+0000 7f3536000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 0x7f35200a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.221+0000 7f3536000640 1 -- 172.21.15.100:0/1242375207 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f35300c9090 con 0x7f354006f750 2024-02-21T07:52:53.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.221+0000 7f3547c41740 1 Processor -- start 2024-02-21T07:52:53.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.221+0000 7f3547c41740 1 -- start start 2024-02-21T07:52:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 0x564878616350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564878616890 0x564878617620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487855b300 con 0x564878616890 2024-02-21T07:52:53.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487850de50 con 0x5648785db1c0 2024-02-21T07:52:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f3547c41740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487850b380 con 0x5648785dbae0 2024-02-21T07:52:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f353de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f353de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41954/0 (socket says 172.21.15.100:41954) 2024-02-21T07:52:53.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.224+0000 7f353de00640 1 -- 172.21.15.100:0/346426232 learned_addr learned my addr 172.21.15.100:0/346426232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.225+0000 7f353d400640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 0x7f35200a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.225+0000 7f353d400640 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 0x564878616350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.226+0000 7f353de00640 1 -- 172.21.15.100:0/346426232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 msgr2=0x564878616350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.226+0000 7f353de00640 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 0x564878616350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.226+0000 7f353de00640 1 -- 172.21.15.100:0/346426232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564878616890 msgr2=0x564878617620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.226+0000 7f353de00640 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564878616890 0x564878617620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.226+0000 7f353de00640 1 -- 172.21.15.100:0/346426232 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648784cfc80 con 0x5648785db1c0 2024-02-21T07:52:53.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.227+0000 7f353d400640 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 0x564878616350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:53.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.228+0000 7f353de00640 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35300c69d0 tx=0x7f3530097330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b133e803c8bde01d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.229+0000 7f352aa00640 1 -- 172.21.15.100:0/346426232 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530097ea0 con 0x5648785db1c0 2024-02-21T07:52:53.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.229+0000 7f352aa00640 1 -- 172.21.15.100:0/346426232 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353009f310 con 0x5648785db1c0 2024-02-21T07:52:53.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.229+0000 7f352aa00640 1 -- 172.21.15.100:0/346426232 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300c6b40 con 0x5648785db1c0 2024-02-21T07:52:53.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.229+0000 7f353d400640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 0x7f35200a16b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f352c035000 tx=0x7f352c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.231+0000 7f3547c41740 1 -- 172.21.15.100:0/346426232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 msgr2=0x5648785db5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.231+0000 7f3547c41740 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f35300c69d0 tx=0x7f3530097330 comp rx=0 tx=0).stop 2024-02-21T07:52:53.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.231+0000 7f3547c41740 1 -- 172.21.15.100:0/346426232 shutdown_connections 2024-02-21T07:52:53.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.231+0000 7f3547c41740 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564878616890 0x564878617620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.231+0000 7f3547c41740 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785dbae0 0x564878616350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.232+0000 7f3547c41740 1 --2- 172.21.15.100:0/346426232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785db1c0 0x5648785db5a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.232+0000 7f3547c41740 1 -- 172.21.15.100:0/346426232 >> 172.21.15.100:0/346426232 conn(0x56487859d790 msgr2=0x56487859e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.240+0000 7f3547c41740 1 -- 172.21.15.100:0/346426232 shutdown_connections 2024-02-21T07:52:53.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.240+0000 7f3547c41740 1 -- 172.21.15.100:0/346426232 wait complete. 2024-02-21T07:52:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.243+0000 7f3547c41740 1 -- start start 2024-02-21T07:52:53.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.243+0000 7f3547c41740 1 Processor -- start 2024-02-21T07:52:53.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.246+0000 7f3547c41740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785dbae0 0x56487859b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.246+0000 7f3547c41740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564878616890 0x5648785d00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.246+0000 7f3547c41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f3547c41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564878506b60 con 0x5648785e42b0 2024-02-21T07:52:53.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f3547c41740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648784abfd0 con 0x5648785dbae0 2024-02-21T07:52:53.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f3547c41740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648784abc70 con 0x564878616890 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f3547c41740 10 client.0 _ll_register_callbacks cb 0x564878217c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f353e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f353e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40146/0 (socket says 172.21.15.100:40146) 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.247+0000 7f353e800640 1 -- 172.21.15.100:0/3667191235 learned_addr learned my addr 172.21.15.100:0/3667191235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.248+0000 7f353e800640 1 -- 172.21.15.100:0/3667191235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564878616890 msgr2=0x5648785d00b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.248+0000 7f353e800640 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564878616890 0x5648785d00b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.248+0000 7f353e800640 1 -- 172.21.15.100:0/3667191235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785dbae0 msgr2=0x56487859b7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.248+0000 7f353e800640 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785dbae0 0x56487859b7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.248+0000 7f353e800640 1 -- 172.21.15.100:0/3667191235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3540185f90 con 0x5648785e42b0 2024-02-21T07:52:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.249+0000 7f353e800640 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3538007ad0 tx=0x7f3538007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4248fc300226c077 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.249+0000 7f351f400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:53.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.249+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800fcc0 con 0x5648785e42b0 2024-02-21T07:52:53.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.250+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564878206860 con 0x5648785e42b0 2024-02-21T07:52:53.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.250+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f353800fe20 con 0x5648785e42b0 2024-02-21T07:52:53.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.252+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f353800fcc0 con 0x5648785e42b0 2024-02-21T07:52:53.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.252+0000 7f3547c41740 10 client.6378 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:53.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.252+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5648785051e0 con 0x5648785e42b0 2024-02-21T07:52:53.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.256+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538020450 con 0x5648785e42b0 2024-02-21T07:52:53.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.258+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f35380205c0 con 0x5648785e42b0 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 10 client.6378 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 10 client.6378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 20 client.6378 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56487859bce0 0x564878622db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 4 client.6378 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:53.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.259+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564878206860 con 0x56487859bce0 2024-02-21T07:52:53.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.263+0000 7f353de00640 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56487859bce0 0x564878622db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.266+0000 7f353de00640 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56487859bce0 0x564878622db0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b88244497e9c2432 server_cookie=6a33ff5f4eb723a4 in_seq=0 out_seq=0 2024-02-21T07:52:53.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.266+0000 7f351f400640 10 client.6378 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.267+0000 7f351f400640 1 -- 172.21.15.100:0/3667191235 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564878206860 con 0x56487859bce0 2024-02-21T07:52:53.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.267+0000 7f351f400640 10 client.6378 handle_command_reply: tid=0 2024-02-21T07:52:53.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.267+0000 7f3547c41740 1 client.6378 shutdown 2024-02-21T07:52:53.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.268+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 msgr2=0x5648785e4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.268+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3538007ad0 tx=0x7f3538007f90 comp rx=0 tx=0).stop 2024-02-21T07:52:53.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.270+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 shutdown_connections 2024-02-21T07:52:53.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56487859bce0 0x564878622db0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f351f400640 0 client.6378 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785e42b0 0x5648785e4750 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564878616890 0x5648785d00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f3547c41740 1 --2- 172.21.15.100:0/3667191235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785dbae0 0x56487859b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.271+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 >> 172.21.15.100:0/3667191235 conn(0x5648785db1c0 msgr2=0x56487859f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.272+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 shutdown_connections 2024-02-21T07:52:53.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.272+0000 7f3547c41740 1 -- 172.21.15.100:0/3667191235 wait complete. 2024-02-21T07:52:53.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.275+0000 7f3547c41740 20 client.6378 trim_cache size 0 max 16384 2024-02-21T07:52:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.326+0000 7f3547c41740 1 Processor -- start 2024-02-21T07:52:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.326+0000 7f3547c41740 1 -- start start 2024-02-21T07:52:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56487859bce0 0x56487859c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x56487866eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487824f0c0 con 0x5648785dbae0 2024-02-21T07:52:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648785e1630 con 0x56487859bce0 2024-02-21T07:52:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.329+0000 7f3547c41740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487859b9b0 con 0x5648785e42b0 2024-02-21T07:52:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.334+0000 7f353de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56487859bce0 0x56487859c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.334+0000 7f353e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.334+0000 7f353e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39730/0 (socket says 172.21.15.100:39730) 2024-02-21T07:52:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.334+0000 7f353e800640 1 -- 172.21.15.100:0/1300758658 learned_addr learned my addr 172.21.15.100:0/1300758658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.338+0000 7f353d400640 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x56487866eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.340+0000 7f353e800640 1 -- 172.21.15.100:0/1300758658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56487859bce0 msgr2=0x56487859c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.340+0000 7f353e800640 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56487859bce0 0x56487859c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.340+0000 7f353e800640 1 -- 172.21.15.100:0/1300758658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 msgr2=0x56487866eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.341+0000 7f353e800640 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x56487866eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.341+0000 7f353e800640 1 -- 172.21.15.100:0/1300758658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648784a1a90 con 0x5648785e42b0 2024-02-21T07:52:53.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.341+0000 7f353d400640 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x56487866eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:52:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.342+0000 7f353e800640 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3538002230 tx=0x7f3538015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f771ef18d4529e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.343+0000 7f352a000640 1 -- 172.21.15.100:0/1300758658 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800d040 con 0x5648785e42b0 2024-02-21T07:52:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.344+0000 7f352a000640 1 -- 172.21.15.100:0/1300758658 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35380097a0 con 0x5648785e42b0 2024-02-21T07:52:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.344+0000 7f352a000640 1 -- 172.21.15.100:0/1300758658 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538020650 con 0x5648785e42b0 2024-02-21T07:52:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.345+0000 7f3547c41740 1 -- 172.21.15.100:0/1300758658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 msgr2=0x56487866f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.345+0000 7f3547c41740 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3538002230 tx=0x7f3538015000 comp rx=0 tx=0).stop 2024-02-21T07:52:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.346+0000 7f3547c41740 1 -- 172.21.15.100:0/1300758658 shutdown_connections 2024-02-21T07:52:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.346+0000 7f3547c41740 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5648785e42b0 0x56487866f0a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.346+0000 7f3547c41740 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x56487866eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.346+0000 7f3547c41740 1 --2- 172.21.15.100:0/1300758658 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56487859bce0 0x56487859c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.346+0000 7f3547c41740 1 -- 172.21.15.100:0/1300758658 >> 172.21.15.100:0/1300758658 conn(0x5648785db1c0 msgr2=0x5648785e70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.347+0000 7f3547c41740 1 -- 172.21.15.100:0/1300758658 shutdown_connections 2024-02-21T07:52:53.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.347+0000 7f3547c41740 1 -- 172.21.15.100:0/1300758658 wait complete. 2024-02-21T07:52:53.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.349+0000 7f3547c41740 1 -- start start 2024-02-21T07:52:53.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.349+0000 7f3547c41740 1 Processor -- start 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 0x5648785e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x564878607f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785e42b0 0x564878599970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487860f6d0 con 0x5648785dbae0 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487866c870 con 0x5648785e42b0 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56487859eda0 con 0x56487859bce0 2024-02-21T07:52:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.352+0000 7f3547c41740 10 client.0 _ll_register_callbacks cb 0x7f3530092e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.355+0000 7f353d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x564878607f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.356+0000 7f353de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 0x5648785e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.356+0000 7f353de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 0x5648785e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39732/0 (socket says 172.21.15.100:39732) 2024-02-21T07:52:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.357+0000 7f353de00640 1 -- 172.21.15.100:0/639079375 learned_addr learned my addr 172.21.15.100:0/639079375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.357+0000 7f353e800640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785e42b0 0x564878599970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.359+0000 7f353d400640 1 -- 172.21.15.100:0/639079375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 msgr2=0x5648785e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.359+0000 7f353d400640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 0x5648785e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.359+0000 7f353d400640 1 -- 172.21.15.100:0/639079375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785e42b0 msgr2=0x564878599970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.359+0000 7f353d400640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785e42b0 0x564878599970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.359+0000 7f353d400640 1 -- 172.21.15.100:0/639079375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35400f8d70 con 0x5648785dbae0 2024-02-21T07:52:53.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.360+0000 7f353d400640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x564878607f10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f352c033000 tx=0x7f352c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab3b336aca95d21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.362+0000 7f351f400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.363+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c04bb10 con 0x5648785dbae0 2024-02-21T07:52:53.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.364+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f352c04bc70 con 0x5648785dbae0 2024-02-21T07:52:53.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.364+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f353009f310 con 0x5648785dbae0 2024-02-21T07:52:53.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.365+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f352c04bb10 con 0x5648785dbae0 2024-02-21T07:52:53.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.365+0000 7f3547c41740 10 client.6384 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:53.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.365+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5648785051e0 con 0x5648785dbae0 2024-02-21T07:52:53.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.366+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353009f310 con 0x5648785dbae0 2024-02-21T07:52:53.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.368+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f352c033440 con 0x5648785dbae0 2024-02-21T07:52:53.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.368+0000 7f3547c41740 10 client.6384 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:53.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.368+0000 7f3547c41740 10 client.6384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:53.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.369+0000 7f3547c41740 20 client.6384 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:53.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.369+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564878616890 0x5648785e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.369+0000 7f3547c41740 4 client.6384 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:52:53.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.369+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564878257410 con 0x564878616890 2024-02-21T07:52:53.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.370+0000 7f353de00640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564878616890 0x5648785e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.372+0000 7f353de00640 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564878616890 0x5648785e5e10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=853babbb0c22a943 server_cookie=a49ae0eb55dffaf6 in_seq=0 out_seq=0 2024-02-21T07:52:53.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.374+0000 7f351f400640 10 client.6384 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.376+0000 7f351f400640 1 -- 172.21.15.100:0/639079375 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564878257410 con 0x564878616890 2024-02-21T07:52:53.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.376+0000 7f351f400640 10 client.6384 handle_command_reply: tid=0 2024-02-21T07:52:53.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.376+0000 7f3547c41740 1 client.6384 shutdown 2024-02-21T07:52:53.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.379+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 msgr2=0x564878607f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.379+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x564878607f10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f352c033000 tx=0x7f352c004730 comp rx=0 tx=0).stop 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.380+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 shutdown_connections 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.380+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564878616890 0x5648785e5e10 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.381+0000 7f351f400640 0 client.6384 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.381+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648785e42b0 0x564878599970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.381+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5648785dbae0 0x564878607f10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.381+0000 7f3547c41740 1 --2- 172.21.15.100:0/639079375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56487859bce0 0x5648785e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.381+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 >> 172.21.15.100:0/639079375 conn(0x5648785db1c0 msgr2=0x5648785e7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.382+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 shutdown_connections 2024-02-21T07:52:53.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.383+0000 7f3547c41740 1 -- 172.21.15.100:0/639079375 wait complete. 2024-02-21T07:52:53.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.384+0000 7f3547c41740 20 client.6384 trim_cache size 0 max 16384 2024-02-21T07:52:53.388 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:53.388 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:52:53.388 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "523e067b-3fc7-4cd1-ba86-faea7287cfbd", 2024-02-21T07:52:53.388 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:52:53.388 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:53.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.386+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 msgr2=0x7f35200a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.387+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 0x7f35200a16b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f352c035000 tx=0x7f352c030000 comp rx=0 tx=0).stop 2024-02-21T07:52:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.387+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 msgr2=0x7f3540176da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.387+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f353000c390 tx=0x7f353000c850 comp rx=0 tx=0).stop 2024-02-21T07:52:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.389+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 shutdown_connections 2024-02-21T07:52:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.389+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f354018ab00 0x7f3540223060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.389+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f354018a470 0x7f3540184640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.389+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f352009f1f0 0x7f35200a16b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.390+0000 7f3545000640 1 --2- 172.21.15.100:0/1242375207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f354006f750 0x7f3540176da0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.390+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 >> 172.21.15.100:0/1242375207 conn(0x7f35400668b0 msgr2=0x7f35400705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.391+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 shutdown_connections 2024-02-21T07:52:53.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.392+0000 7f3545000640 1 -- 172.21.15.100:0/1242375207 wait complete. 2024-02-21T07:52:53.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:52:53.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:52:53.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.848+0000 7feb87800640 1 Processor -- start 2024-02-21T07:52:53.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.848+0000 7feb87800640 1 -- start start 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb87800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb80190260 0x7feb80070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb87800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb8006edc0 0x7feb800f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb87800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8018dc80 con 0x7feb800f4b20 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb87800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800f5b90 con 0x7feb8006edc0 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb87800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800f55d0 con 0x7feb80190260 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb85800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb8006edc0 0x7feb800f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb85800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb8006edc0 0x7feb800f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40170/0 (socket says 172.21.15.100:40170) 2024-02-21T07:52:53.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.851+0000 7feb85800640 1 -- 172.21.15.100:0/323318000 learned_addr learned my addr 172.21.15.100:0/323318000 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.852+0000 7feb85800640 1 -- 172.21.15.100:0/323318000 >> v2:172.21.15.156:3300/0 conn(0x7feb80190260 msgr2=0x7feb80070a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:53.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.852+0000 7feb85800640 1 --2- 172.21.15.100:0/323318000 >> v2:172.21.15.156:3300/0 conn(0x7feb80190260 0x7feb80070a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.852+0000 7feb85800640 1 -- 172.21.15.100:0/323318000 >> v1:172.21.15.170:6789/0 conn(0x7feb800f4b20 legacy=0x7feb8006e6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:53.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.852+0000 7feb85800640 1 -- 172.21.15.100:0/323318000 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800f58b0 con 0x7feb8006edc0 2024-02-21T07:52:53.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.857+0000 7feb85800640 1 --2- 172.21.15.100:0/323318000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8006edc0 0x7feb800f4fb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7feb8008d4e0 tx=0x7feb7802bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7436748778183c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.857+0000 7feb7f400640 1 -- 172.21.15.100:0/323318000 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7802c980 con 0x7feb8006edc0 2024-02-21T07:52:53.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.857+0000 7feb7f400640 1 -- 172.21.15.100:0/323318000 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7802cae0 con 0x7feb8006edc0 2024-02-21T07:52:53.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.857+0000 7feb7f400640 1 -- 172.21.15.100:0/323318000 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7802ce70 con 0x7feb8006edc0 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.858+0000 7feb87800640 1 -- 172.21.15.100:0/323318000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8006edc0 msgr2=0x7feb800f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.858+0000 7feb87800640 1 --2- 172.21.15.100:0/323318000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8006edc0 0x7feb800f4fb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7feb8008d4e0 tx=0x7feb7802bde0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 -- 172.21.15.100:0/323318000 shutdown_connections 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 --2- 172.21.15.100:0/323318000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb8006edc0 0x7feb800f4fb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 --2- 172.21.15.100:0/323318000 >> v2:172.21.15.156:3300/0 conn(0x7feb80190260 0x7feb80070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 -- 172.21.15.100:0/323318000 >> 172.21.15.100:0/323318000 conn(0x7feb800668b0 msgr2=0x7feb80066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 -- 172.21.15.100:0/323318000 shutdown_connections 2024-02-21T07:52:53.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.859+0000 7feb87800640 1 -- 172.21.15.100:0/323318000 wait complete. 2024-02-21T07:52:53.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.861+0000 7feb87800640 1 Processor -- start 2024-02-21T07:52:53.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.862+0000 7feb87800640 1 -- start start 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb800f4b20 0x7feb8016af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 0x7feb8016b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 0x7feb800f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800f8f60 con 0x7feb80190260 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800f8100 con 0x7feb800f4b20 2024-02-21T07:52:53.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.863+0000 7feb87800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80180710 con 0x7feb800f8590 2024-02-21T07:52:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.864+0000 7feb85800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 0x7feb800f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.864+0000 7feb85800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 0x7feb800f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39742/0 (socket says 172.21.15.100:39742) 2024-02-21T07:52:53.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.864+0000 7feb85800640 1 -- 172.21.15.100:0/1007222027 learned_addr learned my addr 172.21.15.100:0/1007222027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.866+0000 7feb84e00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb800f4b20 0x7feb8016af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.866+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 0x7feb8016b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.867+0000 7feb7fe00640 1 -- 172.21.15.100:0/1007222027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 msgr2=0x7feb800f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.867+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 0x7feb800f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.867+0000 7feb7fe00640 1 -- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb800f4b20 msgr2=0x7feb8016af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.867+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb800f4b20 0x7feb8016af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.867+0000 7feb7fe00640 1 -- 172.21.15.100:0/1007222027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009b30 con 0x7feb80190260 2024-02-21T07:52:53.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.869+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 0x7feb8016b4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b3e0 tx=0x7feb6c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.870+0000 7feb7cc00640 1 -- 172.21.15.100:0/1007222027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c011830 con 0x7feb80190260 2024-02-21T07:52:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.871+0000 7feb7cc00640 1 -- 172.21.15.100:0/1007222027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c011990 con 0x7feb80190260 2024-02-21T07:52:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.871+0000 7feb7cc00640 1 -- 172.21.15.100:0/1007222027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c011830 con 0x7feb80190260 2024-02-21T07:52:53.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.871+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb801809f0 con 0x7feb80190260 2024-02-21T07:52:53.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.871+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800f7ab0 con 0x7feb80190260 2024-02-21T07:52:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.882+0000 7feb7cc00640 1 -- 172.21.15.100:0/1007222027 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feb6c011b00 con 0x7feb80190260 2024-02-21T07:52:53.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.886+0000 7feb8a59f740 1 Processor -- start 2024-02-21T07:52:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.886+0000 7feb8a59f740 1 -- start start 2024-02-21T07:52:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.889+0000 7feb7cc00640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 0x7feb600a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.889+0000 7feb7cc00640 1 -- 172.21.15.100:0/1007222027 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb6c0c9940 con 0x7feb80190260 2024-02-21T07:52:53.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.890+0000 7feb85800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 0x7feb600a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.892+0000 7feb85800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 0x7feb600a15f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb780093e0 tx=0x7feb78030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.894+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f49a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.896+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.898+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.898+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40186/0 (socket says 172.21.15.100:40186) 2024-02-21T07:52:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.899+0000 7feb84e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f49a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.899+0000 7feb7fe00640 1 -- 172.21.15.100:0/1484132889 learned_addr learned my addr 172.21.15.100:0/1484132889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.901+0000 7feb8a59f740 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2ed6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.901+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2e4b150 con 0x55edf2f49f80 2024-02-21T07:52:53.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.901+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2e48680 con 0x55edf2f148e0 2024-02-21T07:52:53.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.902+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2e43e60 con 0x55edf2f13fc0 2024-02-21T07:52:53.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.902+0000 7feb85800640 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2ed6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.907+0000 7feb7fe00640 1 -- 172.21.15.100:0/1484132889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 msgr2=0x55edf2f49a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.907+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f49a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.907+0000 7feb7fe00640 1 -- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 msgr2=0x55edf2ed6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.907+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2ed6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.907+0000 7feb7fe00640 1 -- 172.21.15.100:0/1484132889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf2dfd060 con 0x55edf2f49f80 2024-02-21T07:52:53.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.908+0000 7feb85800640 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2ed6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:53.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.910+0000 7feb7fe00640 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00bfd0 tx=0x7feb6c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b0e5588081ffbd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.911+0000 7feb71600640 1 -- 172.21.15.100:0/1484132889 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c097500 con 0x55edf2f49f80 2024-02-21T07:52:53.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.912+0000 7feb71600640 1 -- 172.21.15.100:0/1484132889 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c09b5d0 con 0x55edf2f49f80 2024-02-21T07:52:53.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.912+0000 7feb71600640 1 -- 172.21.15.100:0/1484132889 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c09fc20 con 0x55edf2f49f80 2024-02-21T07:52:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.915+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 msgr2=0x55edf2f143a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.916+0000 7feb8a59f740 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00bfd0 tx=0x7feb6c011000 comp rx=0 tx=0).stop 2024-02-21T07:52:53.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.917+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 shutdown_connections 2024-02-21T07:52:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.918+0000 7feb8a59f740 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2ed6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.918+0000 7feb8a59f740 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f143a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.918+0000 7feb8a59f740 1 --2- 172.21.15.100:0/1484132889 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f49a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.919+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 >> 172.21.15.100:0/1484132889 conn(0x55edf2ea35a0 msgr2=0x55edf2edaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.920+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 shutdown_connections 2024-02-21T07:52:53.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.920+0000 7feb8a59f740 1 -- 172.21.15.100:0/1484132889 wait complete. 2024-02-21T07:52:53.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.923+0000 7feb8a59f740 1 -- start start 2024-02-21T07:52:53.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.923+0000 7feb8a59f740 1 Processor -- start 2024-02-21T07:52:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.930+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f09e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.930+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f11290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.930+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.931+0000 7feb8a59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2de8ec0 con 0x55edf2f49f80 2024-02-21T07:52:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.931+0000 7feb8a59f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2de8b60 con 0x55edf2f148e0 2024-02-21T07:52:53.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.931+0000 7feb8a59f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2bb21c0 con 0x55edf2f13fc0 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.931+0000 7feb85800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.931+0000 7feb85800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40196/0 (socket says 172.21.15.100:40196) 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.932+0000 7feb85800640 1 -- 172.21.15.100:0/2649056444 learned_addr learned my addr 172.21.15.100:0/2649056444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.932+0000 7feb84e00640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f09e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.933+0000 7feb7fe00640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f11290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.933+0000 7feb85800640 1 -- 172.21.15.100:0/2649056444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 msgr2=0x55edf2f09e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.933+0000 7feb85800640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f09e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.933+0000 7feb85800640 1 -- 172.21.15.100:0/2649056444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 msgr2=0x55edf2f11290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:53.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.934+0000 7feb85800640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f11290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.935+0000 7feb85800640 1 -- 172.21.15.100:0/2649056444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb800f7ab0 con 0x55edf2f49f80 2024-02-21T07:52:53.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.935+0000 7feb7fe00640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f11290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:53.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.935+0000 7feb8a59f740 10 client.0 _ll_register_callbacks cb 0x55edf2dfc960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:53.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.936+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edf2b437e0 con 0x55edf2f49f80 2024-02-21T07:52:53.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.937+0000 7feb66000640 10 client.6396 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:53.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.937+0000 7feb85800640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb78034e10 tx=0x7feb78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9943b38c727534de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:53.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.941+0000 7feb66000640 1 -- 172.21.15.100:0/2649056444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7803f710 con 0x55edf2f49f80 2024-02-21T07:52:53.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.942+0000 7feb66000640 1 -- 172.21.15.100:0/2649056444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb7803f870 con 0x55edf2f49f80 2024-02-21T07:52:53.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.942+0000 7feb66000640 1 -- 172.21.15.100:0/2649056444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb7803f710 con 0x55edf2f49f80 2024-02-21T07:52:53.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.942+0000 7feb8a59f740 10 client.6396 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:53.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.942+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x55edf2e424e0 con 0x55edf2f49f80 2024-02-21T07:52:53.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.948+0000 7feb66000640 1 -- 172.21.15.100:0/2649056444 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feb7803fa30 con 0x55edf2f49f80 2024-02-21T07:52:53.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.953+0000 7feb8a59f740 10 client.6396 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:53.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.953+0000 7feb8a59f740 10 client.6396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:53.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.953+0000 7feb8a59f740 20 client.6396 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:53.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.957+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f46e50 0x55edf2f47280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.957+0000 7feb8a59f740 4 client.6396 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:53.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.957+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edf2b80720 con 0x55edf2f46e50 2024-02-21T07:52:53.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.962+0000 7feb84e00640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f46e50 0x55edf2f47280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.967+0000 7feb84e00640 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f46e50 0x55edf2f47280 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bd75c9360a0ed68 server_cookie=bda29afa8651cb9e in_seq=0 out_seq=0 2024-02-21T07:52:53.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.972+0000 7feb66000640 10 client.6396 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.972+0000 7feb66000640 1 -- 172.21.15.100:0/2649056444 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55edf2b80720 con 0x55edf2f46e50 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.972+0000 7feb66000640 10 client.6396 handle_command_reply: tid=0 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.972+0000 7feb8a59f740 1 client.6396 shutdown 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.973+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 msgr2=0x55edf2f5f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.973+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb78034e10 tx=0x7feb78004ab0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.974+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 shutdown_connections 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.974+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f46e50 0x55edf2f47280 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.975+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f49f80 0x55edf2f5f140 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.975+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f11290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.975+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2649056444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f13fc0 0x55edf2f09e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.975+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 >> 172.21.15.100:0/2649056444 conn(0x55edf2ea35a0 msgr2=0x55edf2edbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:53.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.976+0000 7feb66000640 0 client.6396 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:53.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.980+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 shutdown_connections 2024-02-21T07:52:53.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.981+0000 7feb8a59f740 1 -- 172.21.15.100:0/2649056444 wait complete. 2024-02-21T07:52:53.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:53.982+0000 7feb8a59f740 20 client.6396 trim_cache size 0 max 16384 2024-02-21T07:52:54.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.072+0000 7feb8a59f740 1 Processor -- start 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.080+0000 7feb8a59f740 1 -- start start 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.081+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 0x55edf2ee2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.082+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.082+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2faa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.082+0000 7feb8a59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2f06570 con 0x55edf2f13fc0 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.082+0000 7feb8a59f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2edbc20 con 0x55edf2f148e0 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.082+0000 7feb8a59f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2f45600 con 0x55edf2f49f80 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.086+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.088+0000 7feb7fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42014/0 (socket says 172.21.15.100:42014) 2024-02-21T07:52:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.088+0000 7feb7fe00640 1 -- 172.21.15.100:0/2798116401 learned_addr learned my addr 172.21.15.100:0/2798116401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.088+0000 7feb84e00640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 0x55edf2ee2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.088+0000 7feb85800640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2faa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.090+0000 7feb7fe00640 1 -- 172.21.15.100:0/2798116401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 msgr2=0x55edf2faa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.090+0000 7feb7fe00640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2faa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.090+0000 7feb7fe00640 1 -- 172.21.15.100:0/2798116401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 msgr2=0x55edf2ee2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.091+0000 7feb7fe00640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 0x55edf2ee2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.091+0000 7feb7fe00640 1 -- 172.21.15.100:0/2798116401 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf2dde950 con 0x55edf2f148e0 2024-02-21T07:52:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.091+0000 7feb84e00640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 0x55edf2ee2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:52:54.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.094+0000 7feb7fe00640 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259acb7494dc170c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:54.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.095+0000 7feb70c00640 1 -- 172.21.15.100:0/2798116401 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c093690 con 0x55edf2f148e0 2024-02-21T07:52:54.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.095+0000 7feb70c00640 1 -- 172.21.15.100:0/2798116401 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c09fc20 con 0x55edf2f148e0 2024-02-21T07:52:54.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.095+0000 7feb70c00640 1 -- 172.21.15.100:0/2798116401 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c093690 con 0x55edf2f148e0 2024-02-21T07:52:54.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.100+0000 7feb8a59f740 1 -- 172.21.15.100:0/2798116401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 msgr2=0x55edf2f0dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.100+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb6c006fd0 tx=0x7feb6c01c000 comp rx=0 tx=0).stop 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.100+0000 7feb8a59f740 1 -- 172.21.15.100:0/2798116401 shutdown_connections 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.101+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2faa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.101+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f148e0 0x55edf2f0dca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.101+0000 7feb8a59f740 1 --2- 172.21.15.100:0/2798116401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f13fc0 0x55edf2ee2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.101+0000 7feb8a59f740 1 -- 172.21.15.100:0/2798116401 >> 172.21.15.100:0/2798116401 conn(0x55edf2ea35a0 msgr2=0x55edf2f492e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:54.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.105+0000 7feb8a59f740 1 -- 172.21.15.100:0/2798116401 shutdown_connections 2024-02-21T07:52:54.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.106+0000 7feb8a59f740 1 -- 172.21.15.100:0/2798116401 wait complete. 2024-02-21T07:52:54.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.112+0000 7feb8a59f740 1 -- start start 2024-02-21T07:52:54.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.112+0000 7feb8a59f740 1 Processor -- start 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f13fc0 0x55edf2ed5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f148e0 0x55edf2faacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2f5efb0 con 0x55edf2f148e0 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2f4b2b0 con 0x55edf2f13fc0 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf2f41890 con 0x55edf2f49f80 2024-02-21T07:52:54.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.117+0000 7feb8a59f740 10 client.0 _ll_register_callbacks cb 0x7feb78034470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:54.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.118+0000 7feb85800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.119+0000 7feb84e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f13fc0 0x55edf2ed5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.119+0000 7feb85800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39774/0 (socket says 172.21.15.100:39774) 2024-02-21T07:52:54.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.119+0000 7feb85800640 1 -- 172.21.15.100:0/3113842342 learned_addr learned my addr 172.21.15.100:0/3113842342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:54.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.119+0000 7feb7fe00640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f148e0 0x55edf2faacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.121+0000 7feb85800640 1 -- 172.21.15.100:0/3113842342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f13fc0 msgr2=0x55edf2ed5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:54.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.121+0000 7feb85800640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f13fc0 0x55edf2ed5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.121+0000 7feb85800640 1 -- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f148e0 msgr2=0x55edf2faacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:54.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.121+0000 7feb85800640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f148e0 0x55edf2faacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.121+0000 7feb85800640 1 -- 172.21.15.100:0/3113842342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edf2dfd060 con 0x55edf2f49f80 2024-02-21T07:52:54.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.122+0000 7feb85800640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55edf2f49a80 tx=0x7feb7803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabbece3248eb797 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:54.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.122+0000 7feb66000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78034e40 con 0x55edf2f49f80 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb78007000 con 0x55edf2f49f80 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb6c09b5d0 con 0x55edf2f49f80 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb7804c470 con 0x55edf2f49f80 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb8a59f740 10 client.6530 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.123+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55edf2e04430 con 0x55edf2f49f80 2024-02-21T07:52:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c09b5d0 con 0x55edf2f49f80 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feb7804c5d0 con 0x55edf2f49f80 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 10 client.6530 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 10 client.6530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 20 client.6530 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f06060 0x55edf2fad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 4 client.6530 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.124+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55edf2bcf890 con 0x55edf2f06060 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.126+0000 7feb84e00640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f06060 0x55edf2fad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.126+0000 7feb84e00640 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f06060 0x55edf2fad800 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd5901ffe7e6541 server_cookie=ca2ff2817af7bdd1 in_seq=0 out_seq=0 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb66000640 10 client.6530 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb66000640 1 -- 172.21.15.100:0/3113842342 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55edf2bcf890 con 0x55edf2f06060 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb66000640 10 client.6530 handle_command_reply: tid=0 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 client.6530 shutdown 2024-02-21T07:52:54.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 msgr2=0x55edf2fa6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x55edf2f49a80 tx=0x7feb7803f000 comp rx=0 tx=0).stop 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 shutdown_connections 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55edf2f06060 0x55edf2fad800 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55edf2f49f80 0x55edf2fa6e60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55edf2f148e0 0x55edf2faacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 --2- 172.21.15.100:0/3113842342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55edf2f13fc0 0x55edf2ed5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 >> 172.21.15.100:0/3113842342 conn(0x55edf2ea35a0 msgr2=0x55edf2f06e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.127+0000 7feb66000640 0 client.6530 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:54.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.129+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 shutdown_connections 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.129+0000 7feb8a59f740 1 -- 172.21.15.100:0/3113842342 wait complete. 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.129+0000 7feb8a59f740 20 client.6530 trim_cache size 0 max 16384 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "523e067b-3fc7-4cd1-ba86-faea7287cfbd": { 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "523e067b-3fc7-4cd1-ba86-faea7287cfbd", 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:52:54.133 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:52:54.134 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:52:54.134 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:52:54.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.140+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 msgr2=0x7feb600a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:54.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.140+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 0x7feb600a15f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feb780093e0 tx=0x7feb78030000 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.140+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 msgr2=0x7feb8016b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.140+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 0x7feb8016b4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b3e0 tx=0x7feb6c00b8a0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 shutdown_connections 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb800f8590 0x7feb800f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb6009f130 0x7feb600a15f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb80190260 0x7feb8016b4b0 secure :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b3e0 tx=0x7feb6c00b8a0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 --2- 172.21.15.100:0/1007222027 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb800f4b20 0x7feb8016af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:54.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 >> 172.21.15.100:0/1007222027 conn(0x7feb800668b0 msgr2=0x7feb8006e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:54.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.141+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 shutdown_connections 2024-02-21T07:52:54.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:52:54.142+0000 7feb87800640 1 -- 172.21.15.100:0/1007222027 wait complete. 2024-02-21T07:52:54.166 INFO:tasks.cephfs.filesystem:scrub status for tag:523e067b-3fc7-4cd1-ba86-faea7287cfbd - {'path': '/', 'tag': '523e067b-3fc7-4cd1-ba86-faea7287cfbd', 'options': 'recursive,force'} 2024-02-21T07:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.108+0000 7f83fac00640 1 Processor -- start 2024-02-21T07:52:57.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.109+0000 7f83fac00640 1 -- start start 2024-02-21T07:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.116+0000 7f83fac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83f417e920 0x7f83f41825e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.116+0000 7f83fac00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f83f4182b20 0x7f83f40f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.116+0000 7f83fac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40f5040 con 0x7f83f40f4b80 2024-02-21T07:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.116+0000 7f83fac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4188c70 con 0x7f83f417e920 2024-02-21T07:52:57.123 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.116+0000 7f83fac00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f4182fb0 con 0x7f83f4182b20 2024-02-21T07:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.117+0000 7f83f3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f83f40f4b80 0x7f83f40f7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38758/0 (socket says 172.21.15.100:38758) 2024-02-21T07:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.117+0000 7f83f3400640 1 -- 172.21.15.100:0/2769881014 learned_addr learned my addr 172.21.15.100:0/2769881014 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.117+0000 7f83f3e00640 1 --2- 172.21.15.100:0/2769881014 >> v2:172.21.15.100:3300/0 conn(0x7f83f417e920 0x7f83f41825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.121+0000 7f83f2a00640 1 -- 172.21.15.100:0/2769881014 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604375773 0 0) 0x7f83f40f5040 con 0x7f83f40f4b80 2024-02-21T07:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.121+0000 7f83f3e00640 1 -- 172.21.15.100:0/2769881014 >> v2:172.21.15.156:3300/0 conn(0x7f83f4182b20 msgr2=0x7f83f40f82f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.122+0000 7f83f3e00640 1 --2- 172.21.15.100:0/2769881014 >> v2:172.21.15.156:3300/0 conn(0x7f83f4182b20 0x7f83f40f82f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.122+0000 7f83f3e00640 1 -- 172.21.15.100:0/2769881014 >> v1:172.21.15.100:6789/0 conn(0x7f83f40f4b80 legacy=0x7f83f40f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.122+0000 7f83f3e00640 1 -- 172.21.15.100:0/2769881014 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40f5320 con 0x7f83f417e920 2024-02-21T07:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.128+0000 7f83f3e00640 1 --2- 172.21.15.100:0/2769881014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f417e920 0x7f83f41825e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83f40f0d40 tx=0x7f83ec030630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a66864a385c64c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.128+0000 7f83f2a00640 1 -- 172.21.15.100:0/2769881014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec007740 con 0x7f83f417e920 2024-02-21T07:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.128+0000 7f83f2a00640 1 -- 172.21.15.100:0/2769881014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec033050 con 0x7f83f417e920 2024-02-21T07:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.129+0000 7f83fac00640 1 -- 172.21.15.100:0/2769881014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f417e920 msgr2=0x7f83f41825e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.130+0000 7f83f2a00640 1 -- 172.21.15.100:0/2769881014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec007740 con 0x7f83f417e920 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.130+0000 7f83fac00640 1 --2- 172.21.15.100:0/2769881014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f417e920 0x7f83f41825e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83f40f0d40 tx=0x7f83ec030630 comp rx=0 tx=0).stop 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.131+0000 7f83fac00640 1 -- 172.21.15.100:0/2769881014 shutdown_connections 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.131+0000 7f83fac00640 1 --2- 172.21.15.100:0/2769881014 >> v2:172.21.15.156:3300/0 conn(0x7f83f4182b20 0x7f83f40f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.131+0000 7f83fac00640 1 --2- 172.21.15.100:0/2769881014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f417e920 0x7f83f41825e0 secure :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f83f40f0d40 tx=0x7f83ec030630 comp rx=0 tx=0).stop 2024-02-21T07:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.131+0000 7f83fac00640 1 -- 172.21.15.100:0/2769881014 >> 172.21.15.100:0/2769881014 conn(0x7f83f40ce1b0 msgr2=0x7f83f40ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.132+0000 7f83fac00640 1 -- 172.21.15.100:0/2769881014 shutdown_connections 2024-02-21T07:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.132+0000 7f83fac00640 1 -- 172.21.15.100:0/2769881014 wait complete. 2024-02-21T07:52:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.140+0000 7f83fac00640 1 Processor -- start 2024-02-21T07:52:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.140+0000 7f83fac00640 1 -- start start 2024-02-21T07:52:57.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.142+0000 7f83fac00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83f40f4b80 0x7f83f421a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.142+0000 7f83fac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83f4182b20 0x7f83f421af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.142+0000 7f83fac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.143+0000 7f83fac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f416b110 con 0x7f83f4162f80 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.143+0000 7f83fac00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f41816b0 con 0x7f83f40f4b80 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.143+0000 7f83fac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4181990 con 0x7f83f4182b20 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.143+0000 7f83f8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.144+0000 7f83f8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40238/0 (socket says 172.21.15.100:40238) 2024-02-21T07:52:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.144+0000 7f83f8c00640 1 -- 172.21.15.100:0/1484545806 learned_addr learned my addr 172.21.15.100:0/1484545806 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.144+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83f40f4b80 0x7f83f421a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.145+0000 7f83f8c00640 1 -- 172.21.15.100:0/1484545806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83f4182b20 msgr2=0x7f83f421af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.145+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83f4182b20 0x7f83f421af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.145+0000 7f83f8c00640 1 -- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83f40f4b80 msgr2=0x7f83f421a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.145+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83f40f4b80 0x7f83f421a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.145+0000 7f83f8c00640 1 -- 172.21.15.100:0/1484545806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009770 con 0x7f83f4162f80 2024-02-21T07:52:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.146+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b3f0 tx=0x7f83e000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.146+0000 7f83ebe00640 1 -- 172.21.15.100:0/1484545806 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011830 con 0x7f83f4162f80 2024-02-21T07:52:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.147+0000 7f83ebe00640 1 -- 172.21.15.100:0/1484545806 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e0011990 con 0x7f83f4162f80 2024-02-21T07:52:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.147+0000 7f83ebe00640 1 -- 172.21.15.100:0/1484545806 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0011d40 con 0x7f83f4162f80 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.148+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f4181c70 con 0x7f83f4162f80 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.150+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f416b600 con 0x7f83f4162f80 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.161+0000 7f83ebe00640 1 -- 172.21.15.100:0/1484545806 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f83e001a400 con 0x7f83f4162f80 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.166+0000 7f83ebe00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 0x7f83d40a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.167+0000 7f83ebe00640 1 -- 172.21.15.100:0/1484545806 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f83e00c8e40 con 0x7f83f4162f80 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.173+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 0x7f83d40a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.178+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 0x7f83d40a1630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83ec03a000 tx=0x7f83ec035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.206+0000 7f83fd9a1740 1 Processor -- start 2024-02-21T07:52:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.206+0000 7f83fd9a1740 1 -- start start 2024-02-21T07:52:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e957e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 0x5611e9583a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 0x5611e95bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e953f620 con 0x5611e9583f90 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e94f18c0 con 0x5611e95bf070 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.208+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e94eedf0 con 0x5611e95f34d0 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.209+0000 7f83f8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 0x5611e95bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.209+0000 7f83f3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 0x5611e9583a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.209+0000 7f83f3400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 0x5611e9583a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39804/0 (socket says 172.21.15.100:39804) 2024-02-21T07:52:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.209+0000 7f83f3400640 1 -- 172.21.15.100:0/2945335101 learned_addr learned my addr 172.21.15.100:0/2945335101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.209+0000 7f83f3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e957e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.213+0000 7f83f8c00640 1 -- 172.21.15.100:0/2945335101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 msgr2=0x5611e9583a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.213+0000 7f83f8c00640 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 0x5611e9583a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.213+0000 7f83f8c00640 1 -- 172.21.15.100:0/2945335101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 msgr2=0x5611e957e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.213+0000 7f83f8c00640 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e957e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.213+0000 7f83f8c00640 1 -- 172.21.15.100:0/2945335101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e946bb00 con 0x5611e9583f90 2024-02-21T07:52:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.214+0000 7f83f8c00640 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 0x5611e95bf450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f83e00c69d0 tx=0x7f83e0096560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6eb7645ddb2b19 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.215+0000 7f83dfe00640 1 -- 172.21.15.100:0/2945335101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e009ac90 con 0x5611e9583f90 2024-02-21T07:52:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.215+0000 7f83dfe00640 1 -- 172.21.15.100:0/2945335101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e009f2e0 con 0x5611e9583f90 2024-02-21T07:52:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.215+0000 7f83dfe00640 1 -- 172.21.15.100:0/2945335101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0093120 con 0x5611e9583f90 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.216+0000 7f83fd9a1740 1 -- 172.21.15.100:0/2945335101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 msgr2=0x5611e95bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.216+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 0x5611e95bf450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f83e00c69d0 tx=0x7f83e0096560 comp rx=0 tx=0).stop 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.217+0000 7f83fd9a1740 1 -- 172.21.15.100:0/2945335101 shutdown_connections 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.217+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e9583f90 0x5611e95bf450 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.217+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e95f34d0 0x5611e9583a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.217+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/2945335101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e957e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.217+0000 7f83fd9a1740 1 -- 172.21.15.100:0/2945335101 >> 172.21.15.100:0/2945335101 conn(0x5611e954b4b0 msgr2=0x5611e9582ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.218+0000 7f83fd9a1740 1 -- 172.21.15.100:0/2945335101 shutdown_connections 2024-02-21T07:52:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.219+0000 7f83fd9a1740 1 -- 172.21.15.100:0/2945335101 wait complete. 2024-02-21T07:52:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.221+0000 7f83fd9a1740 1 -- start start 2024-02-21T07:52:57.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.237+0000 7f83fd9a1740 1 Processor -- start 2024-02-21T07:52:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.256+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.256+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e95e6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.257+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e95e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.260+0000 7f83f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.260+0000 7f83f3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e95e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.260+0000 7f83f3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e95e6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42060/0 (socket says 172.21.15.100:42060) 2024-02-21T07:52:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.260+0000 7f83f3400640 1 -- 172.21.15.100:0/3337449633 learned_addr learned my addr 172.21.15.100:0/3337449633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:57.264 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.261+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e94ea5d0 con 0x5611e95f34d0 2024-02-21T07:52:57.267 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.261+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e948fb50 con 0x5611e95bf070 2024-02-21T07:52:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.265+0000 7f83f8c00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e95e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.269 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.266+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e948f7f0 con 0x5611e9583f90 2024-02-21T07:52:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.268+0000 7f83f8c00640 1 -- 172.21.15.100:0/3337449633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 msgr2=0x5611e95ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.268+0000 7f83f8c00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.268+0000 7f83f8c00640 1 -- 172.21.15.100:0/3337449633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 msgr2=0x5611e95e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.268+0000 7f83f8c00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e95e6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.272 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.268+0000 7f83f8c00640 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f416b600 con 0x5611e95f34d0 2024-02-21T07:52:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.269+0000 7f83f8c00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e95e66c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f83e00c6a00 tx=0x7f83e00c8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7d2e3668d91775 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.271+0000 7f83dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:57.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.271+0000 7f83fd9a1740 10 client.0 _ll_register_callbacks cb 0x5611e94a3550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:57.275 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.271+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611e94bccd0 con 0x5611e95f34d0 2024-02-21T07:52:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.272+0000 7f83dcc00640 1 -- 172.21.15.100:0/3337449633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e00c4070 con 0x5611e95f34d0 2024-02-21T07:52:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.272+0000 7f83dcc00640 1 -- 172.21.15.100:0/3337449633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f83e009f2e0 con 0x5611e95f34d0 2024-02-21T07:52:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.273+0000 7f83dcc00640 1 -- 172.21.15.100:0/3337449633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e009ac90 con 0x5611e95f34d0 2024-02-21T07:52:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.273+0000 7f83fd9a1740 10 client.6417 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:57.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.273+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x5611e94e8c50 con 0x5611e95f34d0 2024-02-21T07:52:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.275+0000 7f83dcc00640 1 -- 172.21.15.100:0/3337449633 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f83e0096da0 con 0x5611e95f34d0 2024-02-21T07:52:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.276+0000 7f83fd9a1740 10 client.6417 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:57.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.276+0000 7f83fd9a1740 10 client.6417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.277+0000 7f83fd9a1740 20 client.6417 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.277+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e960d850 0x5611e960f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.278+0000 7f83f3e00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e960d850 0x5611e960f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.279+0000 7f83fd9a1740 4 client.6417 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:52:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.279+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611e94e0ce0 con 0x5611e960d850 2024-02-21T07:52:57.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.280+0000 7f83f3e00640 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e960d850 0x5611e960f450 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147fac954238ba65 server_cookie=c082897672167410 in_seq=0 out_seq=0 2024-02-21T07:52:57.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.280+0000 7f83dcc00640 10 client.6417 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.283+0000 7f83dcc00640 1 -- 172.21.15.100:0/3337449633 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611e94e0ce0 con 0x5611e960d850 2024-02-21T07:52:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.283+0000 7f83dcc00640 10 client.6417 handle_command_reply: tid=0 2024-02-21T07:52:57.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.283+0000 7f83fd9a1740 1 client.6417 shutdown 2024-02-21T07:52:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.292+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 msgr2=0x5611e95e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.292+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e95e66c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f83e00c6a00 tx=0x7f83e00c8040 comp rx=0 tx=0).stop 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.292+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 shutdown_connections 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.292+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e960d850 0x5611e960f450 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.293+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e95e66c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.293+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e95e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.293+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/3337449633 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.293+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 >> 172.21.15.100:0/3337449633 conn(0x5611e954b4b0 msgr2=0x5611e95f3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.293+0000 7f83dcc00640 0 client.6417 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.294+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 shutdown_connections 2024-02-21T07:52:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.294+0000 7f83fd9a1740 1 -- 172.21.15.100:0/3337449633 wait complete. 2024-02-21T07:52:57.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.295+0000 7f83fd9a1740 20 client.6417 trim_cache size 0 max 16384 2024-02-21T07:52:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.339+0000 7f83fd9a1740 1 Processor -- start 2024-02-21T07:52:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.340+0000 7f83fd9a1740 1 -- start start 2024-02-21T07:52:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.343+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.344+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e9589de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.344+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.345+0000 7f83f3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.345+0000 7f83f8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83f8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40264/0 (socket says 172.21.15.100:40264) 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83f8c00640 1 -- 172.21.15.100:0/1972636750 learned_addr learned my addr 172.21.15.100:0/1972636750 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e9232e60 con 0x5611e95f34d0 2024-02-21T07:52:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e95839e0 con 0x5611e95bf070 2024-02-21T07:52:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e95ad840 con 0x5611e9583f90 2024-02-21T07:52:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.346+0000 7f83f3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e9589de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.347+0000 7f83f8c00640 1 -- 172.21.15.100:0/1972636750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 msgr2=0x5611e95aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.347+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.347+0000 7f83f8c00640 1 -- 172.21.15.100:0/1972636750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 msgr2=0x5611e9589de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.347+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e9589de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.347+0000 7f83f8c00640 1 -- 172.21.15.100:0/1972636750 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611e9589c50 con 0x5611e95f34d0 2024-02-21T07:52:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.348+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b3c0 tx=0x7f83e0099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1084478b76d9636b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.349+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.352+0000 7f83f3400640 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e9589de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:52:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.352+0000 7f83df400640 1 -- 172.21.15.100:0/1972636750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e009ac90 con 0x5611e95f34d0 2024-02-21T07:52:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.352+0000 7f83df400640 1 -- 172.21.15.100:0/1972636750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611e94bccd0 con 0x5611e95f34d0 2024-02-21T07:52:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.354+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 msgr2=0x5611e9659fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.354+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b3c0 tx=0x7f83e0099000 comp rx=0 tx=0).stop 2024-02-21T07:52:57.358 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.354+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 shutdown_connections 2024-02-21T07:52:57.358 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.355+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95f34d0 0x5611e9659fb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.358 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.355+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95bf070 0x5611e9589de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.355+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1972636750 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.359 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.355+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 >> 172.21.15.100:0/1972636750 conn(0x5611e954b4b0 msgr2=0x5611e95e9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.360 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.357+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 shutdown_connections 2024-02-21T07:52:57.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.357+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1972636750 wait complete. 2024-02-21T07:52:57.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.358+0000 7f83fd9a1740 1 -- start start 2024-02-21T07:52:57.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.359+0000 7f83fd9a1740 1 Processor -- start 2024-02-21T07:52:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95e6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95c4dd0 0x5611e95f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e95e2df0 con 0x5611e95bf070 2024-02-21T07:52:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e95a9f10 con 0x5611e95c4dd0 2024-02-21T07:52:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611e95e60f0 con 0x5611e9583f90 2024-02-21T07:52:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.364+0000 7f83fd9a1740 10 client.0 _ll_register_callbacks cb 0x7f83e00ca030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:52:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.365+0000 7f83f3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.365+0000 7f83f3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40278/0 (socket says 172.21.15.100:40278) 2024-02-21T07:52:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.365+0000 7f83f3400640 1 -- 172.21.15.100:0/1649860066 learned_addr learned my addr 172.21.15.100:0/1649860066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:52:57.369 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.365+0000 7f83f8c00640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95c4dd0 0x5611e95f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.366+0000 7f83f3400640 1 -- 172.21.15.100:0/1649860066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 msgr2=0x5611e95e6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.366+0000 7f83f3400640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95e6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.366+0000 7f83f3400640 1 -- 172.21.15.100:0/1649860066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95c4dd0 msgr2=0x5611e95f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.366+0000 7f83f3400640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95c4dd0 0x5611e95f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.366+0000 7f83f3400640 1 -- 172.21.15.100:0/1649860066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611e94e8c50 con 0x5611e95bf070 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83f3400640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x5611e95b9970 tx=0x7f83e4001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c95b765a020f6ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e401b030 con 0x5611e95bf070 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611e950fd30 con 0x5611e95bf070 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f83e401c070 con 0x5611e95bf070 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.367+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83e4001ce0 con 0x5611e95bf070 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 10 client.6423 fetch_fsmap learned FSMap version 17 2024-02-21T07:52:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5611e9485530 con 0x5611e95bf070 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611e950fd30 con 0x5611e95bf070 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f83e40155c0 con 0x5611e95bf070 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 10 client.6423 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 10 client.6423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 20 client.6423 populate_metadata read hostname 'smithi100' 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e9581c20 0x5611e95b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 4 client.6423 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:52:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.368+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5611e91ea600 con 0x5611e9581c20 2024-02-21T07:52:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.369+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e9581c20 0x5611e95b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:52:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.370+0000 7f83f3e00640 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e9581c20 0x5611e95b9fd0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e53ec8ed67676d server_cookie=1b6852f5ce9c3ae0 in_seq=0 out_seq=0 2024-02-21T07:52:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.370+0000 7f83dcc00640 10 client.6423 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.685+0000 7f83dcc00640 1 -- 172.21.15.100:0/1649860066 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5611e91ea600 con 0x5611e9581c20 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.685+0000 7f83dcc00640 10 client.6423 handle_command_reply: tid=0 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.686+0000 7f83fd9a1740 1 client.6423 shutdown 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 msgr2=0x5611e95f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x5611e95b9970 tx=0x7f83e4001680 comp rx=0 tx=0).stop 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 shutdown_connections 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5611e9581c20 0x5611e95b9fd0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611e95c4dd0 0x5611e95f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611e95bf070 0x5611e95f2450 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 --2- 172.21.15.100:0/1649860066 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611e9583f90 0x5611e95e6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.687+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 >> 172.21.15.100:0/1649860066 conn(0x5611e954b4b0 msgr2=0x5611e95f6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.688+0000 7f83dcc00640 0 client.6423 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:52:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.689+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 shutdown_connections 2024-02-21T07:52:57.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.690+0000 7f83fd9a1740 1 -- 172.21.15.100:0/1649860066 wait complete. 2024-02-21T07:52:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.690+0000 7f83fd9a1740 20 client.6423 trim_cache size 0 max 16384 2024-02-21T07:52:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:52:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:52:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:52:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:52:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.692+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 msgr2=0x7f83d40a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.692+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 0x7f83d40a1630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83ec03a000 tx=0x7f83ec035000 comp rx=0 tx=0).stop 2024-02-21T07:52:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.692+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 msgr2=0x7f83f4163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.692+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b3f0 tx=0x7f83e000b8b0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 shutdown_connections 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f83d409f170 0x7f83d40a1630 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f4162f80 0x7f83f4163430 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83f4182b20 0x7f83f421af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 --2- 172.21.15.100:0/1484545806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83f40f4b80 0x7f83f421a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 >> 172.21.15.100:0/1484545806 conn(0x7f83f40ce1b0 msgr2=0x7f83f4184140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:52:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 shutdown_connections 2024-02-21T07:52:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:52:57.693+0000 7f83fac00640 1 -- 172.21.15.100:0/1484545806 wait complete. 2024-02-21T07:53:11.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.206+0000 7f1768c00640 1 Processor -- start 2024-02-21T07:53:11.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.206+0000 7f1768c00640 1 -- start start 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17641825f0 0x7f17640d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f17640d0d80 0x7f17640f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1764189480 0x7f17640f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640d21a0 con 0x7f17641825f0 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640d1240 con 0x7f17640d0d80 2024-02-21T07:53:11.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.210+0000 7f1768c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17640d1520 con 0x7f1764189480 2024-02-21T07:53:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.211+0000 7f1762800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1764189480 0x7f17640f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.211+0000 7f1761e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17641825f0 0x7f17640d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.211+0000 7f1762800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1764189480 0x7f17640f8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55292/0 (socket says 172.21.15.100:55292) 2024-02-21T07:53:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.211+0000 7f1762800640 1 -- 172.21.15.100:0/1395259538 learned_addr learned my addr 172.21.15.100:0/1395259538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.211+0000 7f1761400640 1 --2- 172.21.15.100:0/1395259538 >> v2:172.21.15.156:3300/0 conn(0x7f17640d0d80 0x7f17640f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.212+0000 7f1762800640 1 -- 172.21.15.100:0/1395259538 >> v2:172.21.15.156:3300/0 conn(0x7f17640d0d80 msgr2=0x7f17640f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.212+0000 7f1762800640 1 --2- 172.21.15.100:0/1395259538 >> v2:172.21.15.156:3300/0 conn(0x7f17640d0d80 0x7f17640f8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.212+0000 7f1762800640 1 -- 172.21.15.100:0/1395259538 >> v2:172.21.15.100:3300/0 conn(0x7f17641825f0 msgr2=0x7f17640d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.212+0000 7f1762800640 1 --2- 172.21.15.100:0/1395259538 >> v2:172.21.15.100:3300/0 conn(0x7f17641825f0 0x7f17640d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.212+0000 7f1762800640 1 -- 172.21.15.100:0/1395259538 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640d1800 con 0x7f1764189480 2024-02-21T07:53:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.214+0000 7f1762800640 1 --2- 172.21.15.100:0/1395259538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1764189480 0x7f17640f8fd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f17640fafd0 tx=0x7f175c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee795cfb09c888b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.215+0000 7f1760a00640 1 -- 172.21.15.100:0/1395259538 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c031760 con 0x7f1764189480 2024-02-21T07:53:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.215+0000 7f1760a00640 1 -- 172.21.15.100:0/1395259538 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c0318c0 con 0x7f1764189480 2024-02-21T07:53:11.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.215+0000 7f1760a00640 1 -- 172.21.15.100:0/1395259538 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c031c50 con 0x7f1764189480 2024-02-21T07:53:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 -- 172.21.15.100:0/1395259538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1764189480 msgr2=0x7f17640f8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 --2- 172.21.15.100:0/1395259538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1764189480 0x7f17640f8fd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f17640fafd0 tx=0x7f175c02b800 comp rx=0 tx=0).stop 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 -- 172.21.15.100:0/1395259538 shutdown_connections 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 --2- 172.21.15.100:0/1395259538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1764189480 0x7f17640f8fd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 --2- 172.21.15.100:0/1395259538 >> v2:172.21.15.156:3300/0 conn(0x7f17640d0d80 0x7f17640f8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 --2- 172.21.15.100:0/1395259538 >> v2:172.21.15.100:3300/0 conn(0x7f17641825f0 0x7f17640d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.216+0000 7f1768c00640 1 -- 172.21.15.100:0/1395259538 >> 172.21.15.100:0/1395259538 conn(0x7f17640615c0 msgr2=0x7f17640619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.217+0000 7f1768c00640 1 -- 172.21.15.100:0/1395259538 shutdown_connections 2024-02-21T07:53:11.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.217+0000 7f1768c00640 1 -- 172.21.15.100:0/1395259538 wait complete. 2024-02-21T07:53:11.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.220+0000 7f1768c00640 1 Processor -- start 2024-02-21T07:53:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.221+0000 7f1768c00640 1 -- start start 2024-02-21T07:53:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.222+0000 7f1768c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 0x7f1764161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.222+0000 7f1768c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.223+0000 7f1768c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 0x7f17642249c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.223+0000 7f1768c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764161f90 con 0x7f17641825f0 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.223+0000 7f1768c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764223f20 con 0x7f1764189480 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.223+0000 7f1768c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1764223330 con 0x7f17640d0d80 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.223+0000 7f1761400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.224+0000 7f1761400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51444/0 (socket says 172.21.15.100:51444) 2024-02-21T07:53:11.226 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.224+0000 7f1761400640 1 -- 172.21.15.100:0/441452137 learned_addr learned my addr 172.21.15.100:0/441452137 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.224+0000 7f1761e00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 0x7f1764161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.224+0000 7f1762800640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 0x7f17642249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761400640 1 -- 172.21.15.100:0/441452137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 msgr2=0x7f1764161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761400640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 0x7f1764161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761400640 1 -- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 msgr2=0x7f17642249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761400640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 0x7f17642249c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761400640 1 -- 172.21.15.100:0/441452137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c0094d0 con 0x7f17641825f0 2024-02-21T07:53:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1762800640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 0x7f17642249c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.225+0000 7f1761e00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 0x7f1764161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.226+0000 7f1761400640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f175000d5f0 tx=0x7f175000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.226+0000 7f175a000640 1 -- 172.21.15.100:0/441452137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750018070 con 0x7f17641825f0 2024-02-21T07:53:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.226+0000 7f175a000640 1 -- 172.21.15.100:0/441452137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750004240 con 0x7f17641825f0 2024-02-21T07:53:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.226+0000 7f175a000640 1 -- 172.21.15.100:0/441452137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17500043f0 con 0x7f17641825f0 2024-02-21T07:53:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.227+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17640d2740 con 0x7f17641825f0 2024-02-21T07:53:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.228+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17642238f0 con 0x7f17641825f0 2024-02-21T07:53:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.233+0000 7f175a000640 1 -- 172.21.15.100:0/441452137 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1750003610 con 0x7f17641825f0 2024-02-21T07:53:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.234+0000 7f176b9c4740 1 Processor -- start 2024-02-21T07:53:11.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.235+0000 7f175a000640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 0x7f17440a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.236+0000 7f175a000640 1 -- 172.21.15.100:0/441452137 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f17500c98f0 con 0x7f17641825f0 2024-02-21T07:53:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.236+0000 7f176b9c4740 1 -- start start 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2ad2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2a93620 con 0x55a5d2b13070 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2a458c0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f176b9c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2a42df0 con 0x55a5d2b474d0 2024-02-21T07:53:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.238+0000 7f1762800640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 0x7f17440a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.239+0000 7f1762800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.239+0000 7f1762800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41104/0 (socket says 172.21.15.100:41104) 2024-02-21T07:53:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.239+0000 7f1762800640 1 -- 172.21.15.100:0/963701249 learned_addr learned my addr 172.21.15.100:0/963701249 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.239+0000 7f1762800640 1 -- 172.21.15.100:0/963701249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b474d0 msgr2=0x55a5d2ad7a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.240+0000 7f1762800640 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.240+0000 7f1762800640 1 -- 172.21.15.100:0/963701249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 msgr2=0x55a5d2ad2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.240+0000 7f1762800640 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2ad2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.240+0000 7f1762800640 1 -- 172.21.15.100:0/963701249 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5d29bfb00 con 0x55a5d2ad7f90 2024-02-21T07:53:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.241+0000 7f1762800640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 0x7f17440a1630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f175c034040 tx=0x7f175c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.241+0000 7f1762800640 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f175c006c70 tx=0x7f175c048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3ac1fa58410ca9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.241+0000 7f174e600640 1 -- 172.21.15.100:0/963701249 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c040070 con 0x55a5d2ad7f90 2024-02-21T07:53:11.244 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.241+0000 7f174e600640 1 -- 172.21.15.100:0/963701249 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c04bcf0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.241+0000 7f174e600640 1 -- 172.21.15.100:0/963701249 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c04bea0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 -- 172.21.15.100:0/963701249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 msgr2=0x55a5d2b13450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f175c006c70 tx=0x7f175c048000 comp rx=0 tx=0).stop 2024-02-21T07:53:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 -- 172.21.15.100:0/963701249 shutdown_connections 2024-02-21T07:53:11.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b13450 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.243+0000 7f176b9c4740 1 --2- 172.21.15.100:0/963701249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2ad2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.244+0000 7f176b9c4740 1 -- 172.21.15.100:0/963701249 >> 172.21.15.100:0/963701249 conn(0x55a5d2a9f4b0 msgr2=0x55a5d2ad6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.244+0000 7f176b9c4740 1 -- 172.21.15.100:0/963701249 shutdown_connections 2024-02-21T07:53:11.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.244+0000 7f176b9c4740 1 -- 172.21.15.100:0/963701249 wait complete. 2024-02-21T07:53:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.245+0000 7f176b9c4740 1 -- start start 2024-02-21T07:53:11.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.246+0000 7f176b9c4740 1 Processor -- start 2024-02-21T07:53:11.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.248+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b0dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.248+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f176b9c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2a3e5d0 con 0x55a5d2b474d0 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f1761400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f1761400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55326/0 (socket says 172.21.15.100:55326) 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f1761400640 1 -- 172.21.15.100:0/1702341723 learned_addr learned my addr 172.21.15.100:0/1702341723 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d29e3b50 con 0x55a5d2ad7f90 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d29e37f0 con 0x55a5d2b13070 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f1761e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b0dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.249+0000 7f1762800640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f176b9c4740 10 client.0 _ll_register_callbacks cb 0x55a5d29f7550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 -- 172.21.15.100:0/1702341723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 msgr2=0x55a5d2b0dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.254 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b0dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 -- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b474d0 msgr2=0x55a5d2ad18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17640d1800 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1761400640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17500973c0 tx=0x7f1750097c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62952f94d67a6bca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.250+0000 7f1742a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17500af080 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1750095730 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5d2a10cd0 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1750093aa0 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 10 client.6545 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a5d2a3cc50 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5d2a10cd0 con 0x55a5d2b13070 2024-02-21T07:53:11.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f175009b170 con 0x55a5d2b13070 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 10 client.6545 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 10 client.6545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.251+0000 7f176b9c4740 20 client.6545 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b076c0 0x55a5d2ad2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f176b9c4740 4 client.6545 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5d2a34ce0 con 0x55a5d2b076c0 2024-02-21T07:53:11.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f1761e00640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b076c0 0x55a5d2ad2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f1761e00640 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b076c0 0x55a5d2ad2820 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb1d1246f6c46aa5 server_cookie=e810e7f3bb986710 in_seq=0 out_seq=0 2024-02-21T07:53:11.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.252+0000 7f1742a00640 10 client.6545 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.253+0000 7f1742a00640 1 -- 172.21.15.100:0/1702341723 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5d2a34ce0 con 0x55a5d2b076c0 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.253+0000 7f1742a00640 10 client.6545 handle_command_reply: tid=0 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.253+0000 7f176b9c4740 1 client.6545 shutdown 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.253+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 msgr2=0x55a5d2b3c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.253+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f17500973c0 tx=0x7f1750097c70 comp rx=0 tx=0).stop 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 shutdown_connections 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b076c0 0x55a5d2ad2820 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b474d0 0x55a5d2ad18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b13070 0x55a5d2b3c680 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 --2- 172.21.15.100:0/1702341723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b0dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f1742a00640 0 client.6545 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 >> 172.21.15.100:0/1702341723 conn(0x55a5d2a9f4b0 msgr2=0x55a5d2b47950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 shutdown_connections 2024-02-21T07:53:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 1 -- 172.21.15.100:0/1702341723 wait complete. 2024-02-21T07:53:11.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.254+0000 7f176b9c4740 20 client.6545 trim_cache size 0 max 16384 2024-02-21T07:53:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.277+0000 7f176b9c4740 1 Processor -- start 2024-02-21T07:53:11.282 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.277+0000 7f176b9c4740 1 -- start start 2024-02-21T07:53:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.281+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2ad7f90 0x55a5d2ad6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.281+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b076c0 0x55a5d2b4a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.281+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.281+0000 7f176b9c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2786e60 con 0x55a5d2ad7f90 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.281+0000 7f176b9c4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2b13990 con 0x55a5d2b13070 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f176b9c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2b35c40 con 0x55a5d2b076c0 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f1762800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f1762800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41128/0 (socket says 172.21.15.100:41128) 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f1762800640 1 -- 172.21.15.100:0/3778246596 learned_addr learned my addr 172.21.15.100:0/3778246596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f1761400640 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b076c0 0x55a5d2b4a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.282+0000 7f1761e00640 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2ad7f90 0x55a5d2ad6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 -- 172.21.15.100:0/3778246596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b076c0 msgr2=0x55a5d2b4a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b076c0 0x55a5d2b4a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 -- 172.21.15.100:0/3778246596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2ad7f90 msgr2=0x55a5d2ad6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.287 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2ad7f90 0x55a5d2ad6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 -- 172.21.15.100:0/3778246596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5d2ade1f0 con 0x55a5d2b13070 2024-02-21T07:53:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.283+0000 7f1762800640 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f175c0090b0 tx=0x7f175c031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8ce8162f7ead08e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.284+0000 7f174dc00640 1 -- 172.21.15.100:0/3778246596 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c040070 con 0x55a5d2b13070 2024-02-21T07:53:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.284+0000 7f174dc00640 1 -- 172.21.15.100:0/3778246596 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175c049650 con 0x55a5d2b13070 2024-02-21T07:53:11.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.284+0000 7f174dc00640 1 -- 172.21.15.100:0/3778246596 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175c0499c0 con 0x55a5d2b13070 2024-02-21T07:53:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 -- 172.21.15.100:0/3778246596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 msgr2=0x55a5d2b13450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f175c0090b0 tx=0x7f175c031000 comp rx=0 tx=0).stop 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 -- 172.21.15.100:0/3778246596 shutdown_connections 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b13070 0x55a5d2b13450 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2b076c0 0x55a5d2b4a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 --2- 172.21.15.100:0/3778246596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2ad7f90 0x55a5d2ad6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 -- 172.21.15.100:0/3778246596 >> 172.21.15.100:0/3778246596 conn(0x55a5d2a9f4b0 msgr2=0x55a5d2ad5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 -- 172.21.15.100:0/3778246596 shutdown_connections 2024-02-21T07:53:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.287+0000 7f176b9c4740 1 -- 172.21.15.100:0/3778246596 wait complete. 2024-02-21T07:53:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.289+0000 7f176b9c4740 1 -- start start 2024-02-21T07:53:11.292 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.289+0000 7f176b9c4740 1 Processor -- start 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b076c0 0x55a5d2ad19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2acdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2ad1ff0 con 0x55a5d2b13070 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2b0ea30 con 0x55a5d2b076c0 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5d2ad45a0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.291+0000 7f176b9c4740 10 client.0 _ll_register_callbacks cb 0x7f175c02d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55344/0 (socket says 172.21.15.100:55344) 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 -- 172.21.15.100:0/2654400552 learned_addr learned my addr 172.21.15.100:0/2654400552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1762800640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2acdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 -- 172.21.15.100:0/2654400552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b076c0 msgr2=0x55a5d2ad19b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b076c0 0x55a5d2ad19b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 -- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 msgr2=0x55a5d2acdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2acdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.292+0000 7f1761e00640 1 -- 172.21.15.100:0/2654400552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5d29bfb00 con 0x55a5d2ad7f90 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.293+0000 7f1761e00640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1754009e70 tx=0x7f175401a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0489c1e1d0e51a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.293+0000 7f1742a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:53:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.293+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17540042c0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.293+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1754004420 con 0x55a5d2ad7f90 2024-02-21T07:53:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.293+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5d2a63d30 con 0x55a5d2ad7f90 2024-02-21T07:53:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17540045e0 con 0x55a5d2ad7f90 2024-02-21T07:53:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 10 client.6551 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a5d29d9530 con 0x55a5d2ad7f90 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5d2a63d30 con 0x55a5d2ad7f90 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1754014040 con 0x55a5d2ad7f90 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 10 client.6551 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 10 client.6551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 20 client.6551 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b474d0 0x55a5d2ba74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 4 client.6551 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.294+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a5d273e600 con 0x55a5d2b474d0 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.295+0000 7f1761400640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b474d0 0x55a5d2ba74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.295+0000 7f1761400640 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b474d0 0x55a5d2ba74e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbdd2514f7e944f6 server_cookie=b4889d939822cd82 in_seq=0 out_seq=0 2024-02-21T07:53:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.295+0000 7f1742a00640 10 client.6551 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.388+0000 7f1742a00640 1 -- 172.21.15.100:0/2654400552 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a5d273e600 con 0x55a5d2b474d0 2024-02-21T07:53:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.388+0000 7f1742a00640 10 client.6551 handle_command_reply: tid=0 2024-02-21T07:53:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.388+0000 7f176b9c4740 1 client.6551 shutdown 2024-02-21T07:53:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.392+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 msgr2=0x55a5d2b50110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.392+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1754009e70 tx=0x7f175401a410 comp rx=0 tx=0).stop 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 shutdown_connections 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a5d2b474d0 0x55a5d2ba74e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a5d2b13070 0x55a5d2acdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a5d2b076c0 0x55a5d2ad19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 --2- 172.21.15.100:0/2654400552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a5d2ad7f90 0x55a5d2b50110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 >> 172.21.15.100:0/2654400552 conn(0x55a5d2a9f4b0 msgr2=0x55a5d2b13450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f1742a00640 0 client.6551 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 shutdown_connections 2024-02-21T07:53:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.393+0000 7f176b9c4740 1 -- 172.21.15.100:0/2654400552 wait complete. 2024-02-21T07:53:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.394+0000 7f176b9c4740 20 client.6551 trim_cache size 0 max 16384 2024-02-21T07:53:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:53:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:53:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:53:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:53:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.395+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 msgr2=0x7f17440a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.395+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 0x7f17440a1630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f175c034040 tx=0x7f175c030000 comp rx=0 tx=0).stop 2024-02-21T07:53:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.396+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 msgr2=0x7f1764222ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:11.401 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.396+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f175000d5f0 tx=0x7f175000dab0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 shutdown_connections 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1764189480 0x7f17642249c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f174409f170 0x7f17440a1630 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17641825f0 0x7f1764222ab0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 --2- 172.21.15.100:0/441452137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17640d0d80 0x7f1764161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.402 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.399+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 >> 172.21.15.100:0/441452137 conn(0x7f17640615c0 msgr2=0x7f1764186c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.400+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 shutdown_connections 2024-02-21T07:53:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:11.400+0000 7f1768c00640 1 -- 172.21.15.100:0/441452137 wait complete. 2024-02-21T07:53:15.356 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:15.362 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:15.365 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:24.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:53:24.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:53:24.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.605+0000 7f7d56e00640 1 Processor -- start 2024-02-21T07:53:24.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.605+0000 7f7d56e00640 1 -- start start 2024-02-21T07:53:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d56e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7d48100660 0x7f7d48079290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d56e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d56e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d48079cb0 con 0x7f7d4804f060 2024-02-21T07:53:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d56e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d48079f90 con 0x7f7d480797d0 2024-02-21T07:53:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d56e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4807a270 con 0x7f7d48100660 2024-02-21T07:53:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d55000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d55000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46598/0 (socket says 172.21.15.100:46598) 2024-02-21T07:53:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d55000640 1 -- 172.21.15.100:0/1481719814 learned_addr learned my addr 172.21.15.100:0/1481719814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.608+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1481719814 >> v2:172.21.15.170:3300/0 conn(0x7f7d48100660 0x7f7d48079290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.609+0000 7f7d4fe00640 1 -- 172.21.15.100:0/1481719814 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905172423 0 0) 0x7f7d48079cb0 con 0x7f7d4804f060 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.609+0000 7f7d55a00640 1 -- 172.21.15.100:0/1481719814 >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 msgr2=0x7f7d4804eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.609+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1481719814 >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.609+0000 7f7d55a00640 1 -- 172.21.15.100:0/1481719814 >> v1:172.21.15.170:6789/0 conn(0x7f7d4804f060 legacy=0x7f7d48109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.609+0000 7f7d55a00640 1 -- 172.21.15.100:0/1481719814 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4807a550 con 0x7f7d48100660 2024-02-21T07:53:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.610+0000 7f7d55000640 1 --2- 172.21.15.100:0/1481719814 >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.613+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1481719814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d48100660 0x7f7d48079290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d48053f00 tx=0x7f7d4402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=472fd3d98d3cd8fd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.614+0000 7f7d4fe00640 1 -- 172.21.15.100:0/1481719814 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44031640 con 0x7f7d48100660 2024-02-21T07:53:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.614+0000 7f7d4fe00640 1 -- 172.21.15.100:0/1481719814 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440317a0 con 0x7f7d48100660 2024-02-21T07:53:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.614+0000 7f7d4fe00640 1 -- 172.21.15.100:0/1481719814 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44031b30 con 0x7f7d48100660 2024-02-21T07:53:24.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.615+0000 7f7d56e00640 1 -- 172.21.15.100:0/1481719814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d48100660 msgr2=0x7f7d48079290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.615+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1481719814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d48100660 0x7f7d48079290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d48053f00 tx=0x7f7d4402b8f0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.616+0000 7f7d56e00640 1 -- 172.21.15.100:0/1481719814 shutdown_connections 2024-02-21T07:53:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.616+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1481719814 >> v2:172.21.15.100:3300/0 conn(0x7f7d480797d0 0x7f7d4804eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.616+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1481719814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d48100660 0x7f7d48079290 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.616+0000 7f7d56e00640 1 -- 172.21.15.100:0/1481719814 >> 172.21.15.100:0/1481719814 conn(0x7f7d48052de0 msgr2=0x7f7d480531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.617+0000 7f7d56e00640 1 -- 172.21.15.100:0/1481719814 shutdown_connections 2024-02-21T07:53:24.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.617+0000 7f7d56e00640 1 -- 172.21.15.100:0/1481719814 wait complete. 2024-02-21T07:53:24.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.621+0000 7f7d56e00640 1 Processor -- start 2024-02-21T07:53:24.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.621+0000 7f7d56e00640 1 -- start start 2024-02-21T07:53:24.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 0x7f7d48199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d480797d0 0x7f7d480f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48054a70 con 0x7f7d48100660 2024-02-21T07:53:24.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48053ef0 con 0x7f7d480797d0 2024-02-21T07:53:24.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.624+0000 7f7d56e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d480541d0 con 0x7f7d4804f060 2024-02-21T07:53:24.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.625+0000 7f7d56400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.625+0000 7f7d56400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46604/0 (socket says 172.21.15.100:46604) 2024-02-21T07:53:24.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.625+0000 7f7d56400640 1 -- 172.21.15.100:0/1941714955 learned_addr learned my addr 172.21.15.100:0/1941714955 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.626+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 0x7f7d48199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.626+0000 7f7d55000640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d480797d0 0x7f7d480f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.627+0000 7f7d55a00640 1 -- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d480797d0 msgr2=0x7f7d480f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.627+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d480797d0 0x7f7d480f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.627+0000 7f7d55a00640 1 -- 172.21.15.100:0/1941714955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 msgr2=0x7f7d4807cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.631+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.631+0000 7f7d55a00640 1 -- 172.21.15.100:0/1941714955 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0094d0 con 0x7f7d4804f060 2024-02-21T07:53:24.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.631+0000 7f7d56400640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:24.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.631+0000 7f7d55a00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 0x7f7d48199130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d44033000 tx=0x7f7d440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.632+0000 7f7d4d600640 1 -- 172.21.15.100:0/1941714955 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4403ac60 con 0x7f7d4804f060 2024-02-21T07:53:24.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.633+0000 7f7d4d600640 1 -- 172.21.15.100:0/1941714955 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4403ade0 con 0x7f7d4804f060 2024-02-21T07:53:24.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.633+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44009400 con 0x7f7d4804f060 2024-02-21T07:53:24.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.633+0000 7f7d4d600640 1 -- 172.21.15.100:0/1941714955 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44044630 con 0x7f7d4804f060 2024-02-21T07:53:24.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.633+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d48054790 con 0x7f7d4804f060 2024-02-21T07:53:24.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.638+0000 7f7d5b068740 1 Processor -- start 2024-02-21T07:53:24.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.638+0000 7f7d5b068740 1 -- start start 2024-02-21T07:53:24.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.639+0000 7f7d4d600640 1 -- 172.21.15.100:0/1941714955 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7d4402f050 con 0x7f7d4804f060 2024-02-21T07:53:24.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3190 0x5641ceb08c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641cead3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d4d600640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 0x7f7d300a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d5b068740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cea0a150 con 0x5641ceb09150 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d4d600640 1 -- 172.21.15.100:0/1941714955 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7d440eb8d0 con 0x7f7d4804f060 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.642+0000 7f7d55000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34418/0 (socket says 172.21.15.100:34418) 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 -- 172.21.15.100:0/2054990431 learned_addr learned my addr 172.21.15.100:0/2054990431 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d56400640 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3190 0x5641ceb08c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cea07680 con 0x5641cead3190 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cea02e60 con 0x5641cead3ab0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d56400640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 0x7f7d300a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55a00640 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641cead3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 -- 172.21.15.100:0/2054990431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3190 msgr2=0x5641ceb08c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3190 0x5641ceb08c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 -- 172.21.15.100:0/2054990431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 msgr2=0x5641cead3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641cead3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.643+0000 7f7d55000640 1 -- 172.21.15.100:0/2054990431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ce9bc060 con 0x5641cead3ab0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.644+0000 7f7d56400640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 0x7f7d300a16b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d500736f0 tx=0x7f7d50068f80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.644+0000 7f7d55000640 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009ce0 tx=0x7f7d3c011690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2dfe2bba5f7d6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.644+0000 7f7d42000640 1 -- 172.21.15.100:0/2054990431 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014440 con 0x5641cead3ab0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.644+0000 7f7d42000640 1 -- 172.21.15.100:0/2054990431 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c0145a0 con 0x5641cead3ab0 2024-02-21T07:53:24.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.644+0000 7f7d42000640 1 -- 172.21.15.100:0/2054990431 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014910 con 0x5641cead3ab0 2024-02-21T07:53:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.645+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 msgr2=0x5641cea960c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.645+0000 7f7d5b068740 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009ce0 tx=0x7f7d3c011690 comp rx=0 tx=0).stop 2024-02-21T07:53:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 shutdown_connections 2024-02-21T07:53:24.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cea960c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641cead3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 --2- 172.21.15.100:0/2054990431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3190 0x5641ceb08c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 >> 172.21.15.100:0/2054990431 conn(0x5641cea625a0 msgr2=0x5641cea9a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 shutdown_connections 2024-02-21T07:53:24.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.646+0000 7f7d5b068740 1 -- 172.21.15.100:0/2054990431 wait complete. 2024-02-21T07:53:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.646+0000 7ffbccc00640 1 Processor -- start 2024-02-21T07:53:24.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.646+0000 7ffbccc00640 1 -- start start 2024-02-21T07:53:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.647+0000 7f7d5b068740 1 -- start start 2024-02-21T07:53:24.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.647+0000 7f7d5b068740 1 Processor -- start 2024-02-21T07:53:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbccc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ffbc81825f0 0x7ffbc80d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbccc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ffbc80f91a0 0x7ffbc818f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbccc00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc80d1240 con 0x7ffbc80d0d80 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbccc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80d21a0 con 0x7ffbc81825f0 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbccc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80d1520 con 0x7ffbc80f91a0 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbc5400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7ffbc80d0d80 0x7ffbc80f8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:34744/0 (socket says 172.21.15.100:34744) 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbc5400640 1 -- 172.21.15.100:0/4086500686 learned_addr learned my addr 172.21.15.100:0/4086500686 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.648+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4086500686 >> v2:172.21.15.100:3300/0 conn(0x7ffbc81825f0 0x7ffbc80d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995841539 0 0) 0x7ffbc80d1240 con 0x7ffbc80d0d80 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbac003520 con 0x7ffbc80d0d80 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2866566616 0 0) 0x7ffbac003520 con 0x7ffbc80d0d80 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 >> v2:172.21.15.170:3300/0 conn(0x7ffbc80f91a0 msgr2=0x7ffbc818f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 --2- 172.21.15.100:0/4086500686 >> v2:172.21.15.170:3300/0 conn(0x7ffbc80f91a0 0x7ffbc818f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 >> v2:172.21.15.100:3300/0 conn(0x7ffbc81825f0 msgr2=0x7ffbc80d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 --2- 172.21.15.100:0/4086500686 >> v2:172.21.15.100:3300/0 conn(0x7ffbc81825f0 0x7ffbc80d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80d1800 con 0x7ffbc80d0d80 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7ffbb4001670 con 0x7ffbc80d0d80 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 >> v1:172.21.15.170:6789/0 conn(0x7ffbc80d0d80 legacy=0x7ffbc80f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbac003a10 0x7ffbac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbac005380 0x7ffbac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80d21a0 con 0x7ffbac005380 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80d1520 con 0x7ffbac003a10 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac00c270 con 0x7ffbac0047c0 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.649+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbac003a10 0x7ffbac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc6800640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbac005380 0x7ffbac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5400640 1 -- 172.21.15.100:0/4086500686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbac003a10 msgr2=0x7ffbac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbac003a10 0x7ffbac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5400640 1 -- 172.21.15.100:0/4086500686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbac005380 msgr2=0x7ffbac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbac005380 0x7ffbac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc5400640 1 -- 172.21.15.100:0/4086500686 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac003520 con 0x7ffbac0047c0 2024-02-21T07:53:24.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.650+0000 7ffbc6800640 1 -- 172.21.15.100:0/4086500686 reap_dead start 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cead1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46632/0 (socket says 172.21.15.100:46632) 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d55a00640 1 -- 172.21.15.100:0/407663837 learned_addr learned my addr 172.21.15.100:0/407663837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 0x5641ceac56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ce9a7ec0 con 0x5641cead3190 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ce9a7b60 con 0x5641ceb09150 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ce7711c0 con 0x5641cead3ab0 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.650+0000 7f7d5b068740 10 client.0 _ll_register_callbacks cb 0x5641ce9bb960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 -- 172.21.15.100:0/407663837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 msgr2=0x5641cead1c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d56400640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 0x5641ceac56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cead1c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 -- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 msgr2=0x5641ceac56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 0x5641ceac56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c0099d0 con 0x5641cead3190 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d56400640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 0x5641ceac56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d55a00640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b90b0 tx=0x7f7d440b74f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd9fe7c6e411c03 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d36a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.651+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80f8960 tx=0x7ffbac0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22fdc6ed7a27b058 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.652+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4005ad0 con 0x7ffbac0047c0 2024-02-21T07:53:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.652+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb4005c30 con 0x7ffbac0047c0 2024-02-21T07:53:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.652+0000 7ffbc4a00640 1 -- 172.21.15.100:0/4086500686 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb402c7e0 con 0x7ffbac0047c0 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440b93b0 con 0x5641cead3190 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.651+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7d440bd500 con 0x5641cead3190 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.652+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641ce7027e0 con 0x5641cead3190 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.652+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d440c1b50 con 0x5641cead3190 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.653+0000 7f7d5b068740 10 client.6450 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.653+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5641cea014e0 con 0x5641cead3190 2024-02-21T07:53:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 -- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 msgr2=0x7ffbac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffbc80f8960 tx=0x7ffbac0057f0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.653+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641ce7027e0 con 0x5641cead3190 2024-02-21T07:53:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 -- 172.21.15.100:0/4086500686 shutdown_connections 2024-02-21T07:53:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 --2- 172.21.15.100:0/4086500686 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 -- 172.21.15.100:0/4086500686 >> 172.21.15.100:0/4086500686 conn(0x7ffbc80615c0 msgr2=0x7ffbc80619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 -- 172.21.15.100:0/4086500686 shutdown_connections 2024-02-21T07:53:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d440bd0d0 con 0x5641cead3190 2024-02-21T07:53:24.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.653+0000 7ffbccc00640 1 -- 172.21.15.100:0/4086500686 wait complete. 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 10 client.6450 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 10 client.6450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 20 client.6450 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641ceb0a2e0 0x5641cead0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 4 client.6450 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.654+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641ce73f720 con 0x5641ceb0a2e0 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.655+0000 7f7d55000640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641ceb0a2e0 0x5641cead0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.656+0000 7f7d55000640 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641ceb0a2e0 0x5641cead0cf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dbeec29ec0a745d server_cookie=5e3586441f2f4489 in_seq=0 out_seq=0 2024-02-21T07:53:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.656+0000 7f7d36a00640 10 client.6450 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.656+0000 7ffbccc00640 1 Processor -- start 2024-02-21T07:53:24.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d36a00640 1 -- 172.21.15.100:0/407663837 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641ce73f720 con 0x5641ceb0a2e0 2024-02-21T07:53:24.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d36a00640 10 client.6450 handle_command_reply: tid=0 2024-02-21T07:53:24.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.657+0000 7ffbccc00640 1 -- start start 2024-02-21T07:53:24.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 client.6450 shutdown 2024-02-21T07:53:24.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 msgr2=0x5641ceb06950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7d440b90b0 tx=0x7f7d440b74f0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 shutdown_connections 2024-02-21T07:53:24.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641ceb0a2e0 0x5641cead0cf0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641ceb09150 0x5641ceac56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3ab0 0x5641cead1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 --2- 172.21.15.100:0/407663837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641ceb06950 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 >> 172.21.15.100:0/407663837 conn(0x5641cea625a0 msgr2=0x5641ceb08980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d36a00640 0 client.6450 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 shutdown_connections 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.657+0000 7f7d5b068740 1 -- 172.21.15.100:0/407663837 wait complete. 2024-02-21T07:53:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.658+0000 7f7d5b068740 20 client.6450 trim_cache size 0 max 16384 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbc821f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 0x7ffbc8171860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8220260 con 0x7ffbc81713b0 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8174480 con 0x7ffbc8174000 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbccc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8174760 con 0x7ffbac0047c0 2024-02-21T07:53:24.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59334/0 (socket says 172.21.15.100:59334) 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 -- 172.21.15.100:0/346119560 learned_addr learned my addr 172.21.15.100:0/346119560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbc821f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc6800640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 0x7ffbc8171860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 -- 172.21.15.100:0/346119560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 msgr2=0x7ffbc821f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbc821f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 -- 172.21.15.100:0/346119560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 msgr2=0x7ffbc8171860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 0x7ffbc8171860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5400640 1 -- 172.21.15.100:0/346119560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc80d2740 con 0x7ffbc8174000 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc6800640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 0x7ffbc8171860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.659+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbc821f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:24.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbc5400640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40010e0 tx=0x7ffbb4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbbe000640 1 -- 172.21.15.100:0/346119560 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb403c040 con 0x7ffbc8174000 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbbe000640 1 -- 172.21.15.100:0/346119560 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb402cd30 con 0x7ffbc8174000 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbbe000640 1 -- 172.21.15.100:0/346119560 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb402cea0 con 0x7ffbc8174000 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc8174a40 con 0x7ffbc8174000 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.660+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc8175000 con 0x7ffbc8174000 2024-02-21T07:53:24.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.665+0000 7ffbbe000640 1 -- 172.21.15.100:0/346119560 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ffbb4032070 con 0x7ffbc8174000 2024-02-21T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.668+0000 7ffbbe000640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 0x7ffba80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.668+0000 7ffbcf7e8740 1 Processor -- start 2024-02-21T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.668+0000 7ffbbe000640 1 -- 172.21.15.100:0/346119560 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbb40eb030 con 0x7ffbc8174000 2024-02-21T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.668+0000 7ffbcf7e8740 1 -- start start 2024-02-21T07:53:24.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.668+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 0x7ffba80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.669+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 0x7ffba80a1560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8069be0 tx=0x7ffbb8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0a72690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0ab56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0a2e620 con 0x55f9a0a72bd0 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a09e08c0 con 0x55f9a0ab2810 2024-02-21T07:53:24.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.670+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a09dddf0 con 0x55f9a0ab3130 2024-02-21T07:53:24.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.672+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.672+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59350/0 (socket says 172.21.15.100:59350) 2024-02-21T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.672+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4140485425 learned_addr learned my addr 172.21.15.100:0/4140485425 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.673+0000 7ffbc6800640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0ab56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.673+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0a72690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4140485425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 msgr2=0x55f9a0a72690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0a72690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4140485425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 msgr2=0x55f9a0ab56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0ab56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4140485425 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9a095ab00 con 0x55f9a0ab2810 2024-02-21T07:53:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.675+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0a72690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.676+0000 7ffbc6800640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0ab56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.676+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8014e60 tx=0x7ffbb8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39277de7bb0daea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.678+0000 7ffbb2600640 1 -- 172.21.15.100:0/4140485425 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8016e40 con 0x55f9a0ab2810 2024-02-21T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.678+0000 7ffbb2600640 1 -- 172.21.15.100:0/4140485425 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb8009810 con 0x55f9a0ab2810 2024-02-21T07:53:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.678+0000 7ffbb2600640 1 -- 172.21.15.100:0/4140485425 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8023880 con 0x55f9a0ab2810 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4140485425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 msgr2=0x55f9a0ab2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8014e60 tx=0x7ffbb8017000 comp rx=0 tx=0).stop 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4140485425 shutdown_connections 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0ab56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0a72690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4140485425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0ab2bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.679+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4140485425 >> 172.21.15.100:0/4140485425 conn(0x55f9a0a3a4b0 msgr2=0x55f9a0a71ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.680+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4140485425 shutdown_connections 2024-02-21T07:53:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.680+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4140485425 wait complete. 2024-02-21T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.681+0000 7ffbcf7e8740 1 -- start start 2024-02-21T07:53:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.681+0000 7ffbcf7e8740 1 Processor -- start 2024-02-21T07:53:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0aa73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a09d95d0 con 0x55f9a0a72bd0 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a097eb50 con 0x55f9a0ab2810 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a097e7f0 con 0x55f9a0ab3130 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbcf7e8740 10 client.0 _ll_register_callbacks cb 0x55f9a0992550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46642/0 (socket says 172.21.15.100:46642) 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbc5400640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0aa73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbc5e00640 1 -- 172.21.15.100:0/2816911921 learned_addr learned my addr 172.21.15.100:0/2816911921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.684+0000 7ffbc6800640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 -- 172.21.15.100:0/2816911921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 msgr2=0x55f9a0aa42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 -- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 msgr2=0x55f9a0aa3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 -- 172.21.15.100:0/2816911921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb8014ae0 con 0x55f9a0ab2810 2024-02-21T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffbc5400640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0aa73a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40b8870 tx=0x7ffbb40b9270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b195644ac7950ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffba6a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40b9ea0 con 0x55f9a0ab2810 2024-02-21T07:53:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.685+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbb40bccc0 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9a09abcd0 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb40c1310 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffbcf7e8740 10 client.6619 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f9a09d7c50 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9a09abcd0 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.686+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffbb40ccbc0 con 0x55f9a0ab2810 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 10 client.6619 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 10 client.6619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 20 client.6619 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0a9bac0 0x55f9a0ae43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 4 client.6619 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9a09cfce0 con 0x55f9a0a9bac0 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.687+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0a9bac0 0x55f9a0ae43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.688+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0a9bac0 0x55f9a0ae43a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ace817ecc0c8b3 server_cookie=52b043501969d46 in_seq=0 out_seq=0 2024-02-21T07:53:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.688+0000 7ffba6a00640 10 client.6619 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.688+0000 7f7d5b068740 1 Processor -- start 2024-02-21T07:53:24.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.688+0000 7f7d5b068740 1 -- start start 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffba6a00640 1 -- 172.21.15.100:0/2816911921 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f9a09cfce0 con 0x55f9a0a9bac0 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffba6a00640 10 client.6619 handle_command_reply: tid=0 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 client.6619 shutdown 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 msgr2=0x55f9a0aa73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0aa73a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40b8870 tx=0x7ffbb40b9270 comp rx=0 tx=0).stop 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 shutdown_connections 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0a9bac0 0x55f9a0ae43a0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0aa73a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2816911921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 >> 172.21.15.100:0/2816911921 conn(0x55f9a0a3a4b0 msgr2=0x55f9a0ab3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffba6a00640 0 client.6619 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 shutdown_connections 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.689+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2816911921 wait complete. 2024-02-21T07:53:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.690+0000 7ffbcf7e8740 20 client.6619 trim_cache size 0 max 16384 2024-02-21T07:53:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641cea966e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641ceb09150 0x5641ceb69ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceacc800 con 0x5641cead3190 2024-02-21T07:53:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceb0d270 con 0x5641cead3ab0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d5b068740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceabf450 con 0x5641ceb09150 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641cea966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641cea966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46652/0 (socket says 172.21.15.100:46652) 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d55000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d55a00640 1 -- 172.21.15.100:0/794604546 learned_addr learned my addr 172.21.15.100:0/794604546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.690+0000 7f7d56400640 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641ceb09150 0x5641ceb69ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 -- 172.21.15.100:0/794604546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641ceb09150 msgr2=0x5641ceb69ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641ceb09150 0x5641ceb69ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 -- 172.21.15.100:0/794604546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 msgr2=0x5641cea966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641cea966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 -- 172.21.15.100:0/794604546 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641ce99d950 con 0x5641cead3ab0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d55000640 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb697a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006ca0 tx=0x7f7d3c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad40f776536beaa9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d41600640 1 -- 172.21.15.100:0/794604546 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014440 con 0x5641cead3ab0 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d41600640 1 -- 172.21.15.100:0/794604546 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641ce73f720 con 0x5641cead3ab0 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.691+0000 7f7d41600640 1 -- 172.21.15.100:0/794604546 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014bf0 con 0x5641cead3ab0 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 -- 172.21.15.100:0/794604546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 msgr2=0x5641ceb697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb697a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c006ca0 tx=0x7f7d3c016000 comp rx=0 tx=0).stop 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 -- 172.21.15.100:0/794604546 shutdown_connections 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641ceb09150 0x5641ceb69ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb697a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 --2- 172.21.15.100:0/794604546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641cead3190 0x5641cea966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 -- 172.21.15.100:0/794604546 >> 172.21.15.100:0/794604546 conn(0x5641cea625a0 msgr2=0x5641cead1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 -- 172.21.15.100:0/794604546 shutdown_connections 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.692+0000 7f7d5b068740 1 -- 172.21.15.100:0/794604546 wait complete. 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.693+0000 7f7d5b068740 1 -- start start 2024-02-21T07:53:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.693+0000 7f7d5b068740 1 Processor -- start 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.695+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 0x5641ceabe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.695+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 0x5641ceabe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d55a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 0x5641ceabe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34494/0 (socket says 172.21.15.100:34494) 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d55000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d55000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59368/0 (socket says 172.21.15.100:59368) 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d5b068740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641ceb64850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d5b068740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceb05a30 con 0x5641ceb09150 2024-02-21T07:53:24.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d5b068740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceacf3d0 con 0x5641cead3ab0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d5b068740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641ceb66740 con 0x5641cead3190 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d5b068740 10 client.0 _ll_register_callbacks cb 0x7f7d4403af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.696+0000 7f7d55a00640 1 -- 172.21.15.100:0/3717620906 learned_addr learned my addr 172.21.15.100:0/3717620906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d55000640 1 -- 172.21.15.100:0/3717620906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 msgr2=0x5641ceabe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d55000640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 0x5641ceabe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d55000640 1 -- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 msgr2=0x5641ceb64850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d56400640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641ceb64850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d55000640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641ceb64850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d55000640 1 -- 172.21.15.100:0/3717620906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641ce9bc060 con 0x5641cead3ab0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.697+0000 7f7d56400640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641ceb64850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d55000640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c012010 tx=0x7f7d3c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c64e25fdd00b0fad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d36a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c004220 con 0x5641cead3ab0 2024-02-21T07:53:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7d3c025040 con 0x5641cead3ab0 2024-02-21T07:53:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d3c0145a0 con 0x5641cead3ab0 2024-02-21T07:53:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d3c004380 con 0x5641cead3ab0 2024-02-21T07:53:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d5b068740 10 client.6625 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.698+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5641ce9c3430 con 0x5641cead3ab0 2024-02-21T07:53:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c0145a0 con 0x5641cead3ab0 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7d3c033040 con 0x5641cead3ab0 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 10 client.6625 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 10 client.6625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 20 client.6625 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641cea98890 0x5641ceac1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 4 client.6625 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.699+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5641ce78e890 con 0x5641cea98890 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.700+0000 7f7d55a00640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641cea98890 0x5641ceac1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.700+0000 7f7d55a00640 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641cea98890 0x5641ceac1fb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=239e3a99c3ba24b4 server_cookie=8eeaf7c48cb78a71 in_seq=0 out_seq=0 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.700+0000 7f7d36a00640 10 client.6625 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d36a00640 1 -- 172.21.15.100:0/3717620906 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5641ce78e890 con 0x5641cea98890 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d36a00640 10 client.6625 handle_command_reply: tid=0 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 client.6625 shutdown 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 msgr2=0x5641ceb64310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c012010 tx=0x7f7d3c014000 comp rx=0 tx=0).stop 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 shutdown_connections 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5641cea98890 0x5641ceac1fb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.701+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5641ceb09150 0x5641ceb64850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.702+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5641cead3ab0 0x5641ceb64310 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.702+0000 7f7d5b068740 1 --2- 172.21.15.100:0/3717620906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5641cead3190 0x5641ceabe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.702+0000 7f7d36a00640 0 client.6625 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.702+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 >> 172.21.15.100:0/3717620906 conn(0x5641cea625a0 msgr2=0x5641ceb084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.703+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 shutdown_connections 2024-02-21T07:53:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.703+0000 7f7d5b068740 1 -- 172.21.15.100:0/3717620906 wait complete. 2024-02-21T07:53:24.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.703+0000 7f7d5b068740 20 client.6625 trim_cache size 0 max 16384 2024-02-21T07:53:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:53:24.708 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:53:24.708 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:53:24.708 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 msgr2=0x7f7d300a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 0x7f7d300a16b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7d500736f0 tx=0x7f7d50068f80 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 msgr2=0x7f7d48199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 0x7f7d48199130 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d44033000 tx=0x7f7d440046c0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 shutdown_connections 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7d3009f1f0 0x7f7d300a16b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d48100660 0x7f7d4807cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d480797d0 0x7f7d480f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 --2- 172.21.15.100:0/1941714955 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d4804f060 0x7f7d48199130 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 >> 172.21.15.100:0/1941714955 conn(0x7f7d48052de0 msgr2=0x7f7d480522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.704+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 shutdown_connections 2024-02-21T07:53:24.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:24.705+0000 7f7d56e00640 1 -- 172.21.15.100:0/1941714955 wait complete. 2024-02-21T07:53:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.709+0000 7ffbcf7e8740 1 Processor -- start 2024-02-21T07:53:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.709+0000 7ffbcf7e8740 1 -- start start 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab2810 0x55f9a0a6d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 0x55f9a0a9bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0721e60 con 0x55f9a0a72bd0 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0aaf4f0 con 0x55f9a0ab3130 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0a6f3c0 con 0x55f9a0ab2810 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46670/0 (socket says 172.21.15.100:46670) 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbc5e00640 1 -- 172.21.15.100:0/2423656603 learned_addr learned my addr 172.21.15.100:0/2423656603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.712+0000 7ffbc6800640 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 0x55f9a0a9bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 -- 172.21.15.100:0/2423656603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab2810 msgr2=0x55f9a0a6d970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab2810 0x55f9a0a6d970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 -- 172.21.15.100:0/2423656603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 msgr2=0x55f9a0aa5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 -- 172.21.15.100:0/2423656603 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9a0974530 con 0x55f9a0ab3130 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.713+0000 7ffbc6800640 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 0x55f9a0a9bea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ffbc81865b0 tx=0x7ffbc000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b74280ea0150837 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.714+0000 7ffbb1c00640 1 -- 172.21.15.100:0/2423656603 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0012050 con 0x55f9a0ab3130 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.714+0000 7ffbb1c00640 1 -- 172.21.15.100:0/2423656603 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0013040 con 0x55f9a0ab3130 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.714+0000 7ffbb1c00640 1 -- 172.21.15.100:0/2423656603 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0017a10 con 0x55f9a0ab3130 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.715+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2423656603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 msgr2=0x55f9a0a9bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.715+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 0x55f9a0a9bea0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ffbc81865b0 tx=0x7ffbc000c7d0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.716+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2423656603 shutdown_connections 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.716+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab3130 0x55f9a0a9bea0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.716+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab2810 0x55f9a0a6d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.716+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/2423656603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0aa5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.716+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2423656603 >> 172.21.15.100:0/2423656603 conn(0x55f9a0a3a4b0 msgr2=0x55f9a0aae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.719+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2423656603 shutdown_connections 2024-02-21T07:53:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.721+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/2423656603 wait complete. 2024-02-21T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.722+0000 7ffbcf7e8740 1 -- start start 2024-02-21T07:53:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.726+0000 7ffbcf7e8740 1 Processor -- start 2024-02-21T07:53:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0b4ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0b5dec0 con 0x55f9a0a72bd0 2024-02-21T07:53:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0aa7bb0 con 0x55f9a0ab2810 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9a0a79010 con 0x55f9a0ab3130 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbcf7e8740 10 client.0 _ll_register_callbacks cb 0x7ffbb40b4d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.729+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46678/0 (socket says 172.21.15.100:46678) 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4007854754 learned_addr learned my addr 172.21.15.100:0/4007854754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc6800640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0b4ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4007854754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 msgr2=0x55f9a0aa3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4007854754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 msgr2=0x55f9a0b4ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0b4ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.730+0000 7ffbc5e00640 1 -- 172.21.15.100:0/4007854754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc0009b60 con 0x55f9a0a72bd0 2024-02-21T07:53:24.738 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:53:24.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.731+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0b4ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.732+0000 7ffbc5e00640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8004620 tx=0x7ffbb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c8813b5e1a45c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.732+0000 7ffba6a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.733+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8031040 con 0x55f9a0a72bd0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.733+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ffbb8016e40 con 0x55f9a0a72bd0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.733+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9a09fed30 con 0x55f9a0a72bd0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.734+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbb8005da0 con 0x55f9a0a72bd0 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.735+0000 7ffbcf7e8740 10 client.6462 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:24.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.735+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f9a099a2c0 con 0x55f9a0a72bd0 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.736+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9a09fed30 con 0x55f9a0a72bd0 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.736+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffbb8023920 con 0x55f9a0a72bd0 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 10 client.6462 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 10 client.6462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 20 client.6462 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0b0acd0 0x55f9a0b02cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:24.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 4 client.6462 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:53:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f9a06d9600 con 0x55f9a0b0acd0 2024-02-21T07:53:24.742 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.737+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0b0acd0 0x55f9a0b02cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.738+0000 7ffbc5400640 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0b0acd0 0x55f9a0b02cf0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395c41a2ca442d8 server_cookie=39533907283e10c5 in_seq=0 out_seq=0 2024-02-21T07:53:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.739+0000 7ffba6a00640 10 client.6462 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.801+0000 7ffba6a00640 1 -- 172.21.15.100:0/4007854754 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f9a06d9600 con 0x55f9a0b0acd0 2024-02-21T07:53:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.801+0000 7ffba6a00640 10 client.6462 handle_command_reply: tid=0 2024-02-21T07:53:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.801+0000 7ffbcf7e8740 1 client.6462 shutdown 2024-02-21T07:53:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.802+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 msgr2=0x55f9a0abd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.802+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8004620 tx=0x7ffbb80046c0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.802+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 shutdown_connections 2024-02-21T07:53:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.802+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f9a0b0acd0 0x55f9a0b02cf0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f9a0ab3130 0x55f9a0aa3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9a0ab2810 0x55f9a0b4ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 --2- 172.21.15.100:0/4007854754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9a0a72bd0 0x55f9a0abd600 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 >> 172.21.15.100:0/4007854754 conn(0x55f9a0a3a4b0 msgr2=0x55f9a0a6fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffba6a00640 0 client.6462 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 shutdown_connections 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 1 -- 172.21.15.100:0/4007854754 wait complete. 2024-02-21T07:53:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.803+0000 7ffbcf7e8740 20 client.6462 trim_cache size 0 max 16384 2024-02-21T07:53:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:53:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:53:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:53:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.804+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 msgr2=0x7ffba80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.804+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 0x7ffba80a1560 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8069be0 tx=0x7ffbb8008040 comp rx=0 tx=0).stop 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.805+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 msgr2=0x7ffbc821fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.805+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40010e0 tx=0x7ffbb4001930 comp rx=0 tx=0).stop 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 shutdown_connections 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ffba809f0a0 0x7ffba80a1560 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbc81713b0 0x7ffbc8171860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffbc8174000 0x7ffbc821fd20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 --2- 172.21.15.100:0/346119560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffbac0047c0 0x7ffbc821f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 >> 172.21.15.100:0/346119560 conn(0x7ffbc80615c0 msgr2=0x7ffbc8189900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.806+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 shutdown_connections 2024-02-21T07:53:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:24.807+0000 7ffbccc00640 1 -- 172.21.15.100:0/346119560 wait complete. 2024-02-21T07:53:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.115+0000 7f76c0400640 1 Processor -- start 2024-02-21T07:53:25.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.115+0000 7f76c0400640 1 -- start start 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76c0400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f76b8183f70 0x7f76b81844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76c0400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f76b806ec10 0x7f76b80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76c0400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80cbb00 con 0x7f76b806e7b0 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76c0400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b806e390 con 0x7f76b8183f70 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76c0400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b8187520 con 0x7f76b806ec10 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.117+0000 7f76be400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f76b806ec10 0x7f76b80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f76b806ec10 0x7f76b80ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34530/0 (socket says 172.21.15.100:34530) 2024-02-21T07:53:25.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 -- 172.21.15.100:0/14811326 learned_addr learned my addr 172.21.15.100:0/14811326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76bda00640 1 --2- 172.21.15.100:0/14811326 >> v2:172.21.15.156:3300/0 conn(0x7f76b8183f70 0x7f76b81844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 -- 172.21.15.100:0/14811326 >> v2:172.21.15.156:3300/0 conn(0x7f76b8183f70 msgr2=0x7f76b81844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 --2- 172.21.15.100:0/14811326 >> v2:172.21.15.156:3300/0 conn(0x7f76b8183f70 0x7f76b81844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 -- 172.21.15.100:0/14811326 >> v1:172.21.15.156:6789/0 conn(0x7f76b806e7b0 legacy=0x7f76b80f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.118+0000 7f76be400640 1 -- 172.21.15.100:0/14811326 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80cb820 con 0x7f76b806ec10 2024-02-21T07:53:25.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.119+0000 7f76be400640 1 --2- 172.21.15.100:0/14811326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806ec10 0x7f76b80ca5c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76b8070080 tx=0x7f76ac02b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=139f41ca2ab3b82b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.119+0000 7f76b7e00640 1 -- 172.21.15.100:0/14811326 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac030710 con 0x7f76b806ec10 2024-02-21T07:53:25.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.119+0000 7f76b7e00640 1 -- 172.21.15.100:0/14811326 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac02e050 con 0x7f76b806ec10 2024-02-21T07:53:25.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.119+0000 7f76b7e00640 1 -- 172.21.15.100:0/14811326 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac030a90 con 0x7f76b806ec10 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 -- 172.21.15.100:0/14811326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806ec10 msgr2=0x7f76b80ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 --2- 172.21.15.100:0/14811326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806ec10 0x7f76b80ca5c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76b8070080 tx=0x7f76ac02b6d0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 -- 172.21.15.100:0/14811326 shutdown_connections 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 --2- 172.21.15.100:0/14811326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806ec10 0x7f76b80ca5c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 --2- 172.21.15.100:0/14811326 >> v2:172.21.15.156:3300/0 conn(0x7f76b8183f70 0x7f76b81844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 -- 172.21.15.100:0/14811326 >> 172.21.15.100:0/14811326 conn(0x7f76b80ce160 msgr2=0x7f76b80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 -- 172.21.15.100:0/14811326 shutdown_connections 2024-02-21T07:53:25.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.120+0000 7f76c0400640 1 -- 172.21.15.100:0/14811326 wait complete. 2024-02-21T07:53:25.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.123+0000 7f76c0400640 1 Processor -- start 2024-02-21T07:53:25.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.123+0000 7f76c0400640 1 -- start start 2024-02-21T07:53:25.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806e7b0 0x7f76b815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 0x7f76b8071ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8070f30 con 0x7f76b806ec10 2024-02-21T07:53:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80714f0 con 0x7f76b8183f70 2024-02-21T07:53:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.126+0000 7f76c0400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8178d70 con 0x7f76b806e7b0 2024-02-21T07:53:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.127+0000 7f76bd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.127+0000 7f76bd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46686/0 (socket says 172.21.15.100:46686) 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.127+0000 7f76bd000640 1 -- 172.21.15.100:0/4147857125 learned_addr learned my addr 172.21.15.100:0/4147857125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.127+0000 7f76be400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 0x7f76b8071ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.127+0000 7f76bda00640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806e7b0 0x7f76b815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76be400640 1 -- 172.21.15.100:0/4147857125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806e7b0 msgr2=0x7f76b815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76be400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806e7b0 0x7f76b815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76be400640 1 -- 172.21.15.100:0/4147857125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 msgr2=0x7f76b8071980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76be400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76be400640 1 -- 172.21.15.100:0/4147857125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0094d0 con 0x7f76b8183f70 2024-02-21T07:53:25.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.128+0000 7f76bd000640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:25.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.129+0000 7f76be400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 0x7f76b8071ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f76ac032000 tx=0x7f76ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.131+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac03b810 con 0x7f76b8183f70 2024-02-21T07:53:25.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.131+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac03b990 con 0x7f76b8183f70 2024-02-21T07:53:25.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.131+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac03bd40 con 0x7f76b8183f70 2024-02-21T07:53:25.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.132+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8179050 con 0x7f76b8183f70 2024-02-21T07:53:25.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.132+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8071180 con 0x7f76b8183f70 2024-02-21T07:53:25.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.135+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7694005290 con 0x7f76b8183f70 2024-02-21T07:53:25.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.138+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f76ac039040 con 0x7f76b8183f70 2024-02-21T07:53:25.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.141+0000 7f76b5600640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 0x7f769c0a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.141+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f76ac0eb200 con 0x7f76b8183f70 2024-02-21T07:53:25.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.141+0000 7f76bda00640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 0x7f769c0a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.143+0000 7f76bda00640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 0x7f769c0a16e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76b00073f0 tx=0x7f76b000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.143+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f76ac0b4ef0 con 0x7f76b8183f70 2024-02-21T07:53:25.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.519+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7694005ac0 con 0x7f76b8183f70 2024-02-21T07:53:25.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.520+0000 7f76b5600640 1 -- 172.21.15.100:0/4147857125 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f76ac04b090 con 0x7f76b8183f70 2024-02-21T07:53:25.524 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:53:25.524 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:53:25.525 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:53:25.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 msgr2=0x7f769c0a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 0x7f769c0a16e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76b00073f0 tx=0x7f76b000b040 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 msgr2=0x7f76b8071ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 0x7f76b8071ec0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f76ac032000 tx=0x7f76ac0046c0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 shutdown_connections 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76b8183f70 0x7f76b8071ec0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f769c09f220 0x7f769c0a16e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76b806ec10 0x7f76b8071980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 --2- 172.21.15.100:0/4147857125 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b806e7b0 0x7f76b815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 >> 172.21.15.100:0/4147857125 conn(0x7f76b80ce160 msgr2=0x7f76b8070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 shutdown_connections 2024-02-21T07:53:25.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.524+0000 7f76c0400640 1 -- 172.21.15.100:0/4147857125 wait complete. 2024-02-21T07:53:25.556 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:53:25.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:53:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.860+0000 7f6319c00640 1 Processor -- start 2024-02-21T07:53:25.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.861+0000 7f6319c00640 1 -- start start 2024-02-21T07:53:25.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6319c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6314182f60 0x7f6314186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6319c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6314188c30 0x7f6314189040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6319c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6314186670 con 0x7f6314071d40 2024-02-21T07:53:25.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6319c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6314183340 con 0x7f6314182f60 2024-02-21T07:53:25.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6319c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6314071010 con 0x7f6314188c30 2024-02-21T07:53:25.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6313400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6314188c30 0x7f6314189040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6313400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6314188c30 0x7f6314189040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34558/0 (socket says 172.21.15.100:34558) 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6313400640 1 -- 172.21.15.100:0/516001887 learned_addr learned my addr 172.21.15.100:0/516001887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.863+0000 7f6312a00640 1 --2- 172.21.15.100:0/516001887 >> v2:172.21.15.156:3300/0 conn(0x7f6314182f60 0x7f6314186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.864+0000 7f6313400640 1 -- 172.21.15.100:0/516001887 >> v2:172.21.15.156:3300/0 conn(0x7f6314182f60 msgr2=0x7f6314186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.864+0000 7f6313400640 1 --2- 172.21.15.100:0/516001887 >> v2:172.21.15.156:3300/0 conn(0x7f6314182f60 0x7f6314186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.864+0000 7f6313400640 1 -- 172.21.15.100:0/516001887 >> v1:172.21.15.156:6789/0 conn(0x7f6314071d40 legacy=0x7f63140721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.864+0000 7f6313400640 1 -- 172.21.15.100:0/516001887 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631406eb10 con 0x7f6314188c30 2024-02-21T07:53:25.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.865+0000 7f6313400640 1 --2- 172.21.15.100:0/516001887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314188c30 0x7f6314189040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f631406f330 tx=0x7f630402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f5054fc88dd95c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.866+0000 7f6311600640 1 -- 172.21.15.100:0/516001887 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630402ca80 con 0x7f6314188c30 2024-02-21T07:53:25.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.866+0000 7f6311600640 1 -- 172.21.15.100:0/516001887 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630402cbe0 con 0x7f6314188c30 2024-02-21T07:53:25.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.866+0000 7f6311600640 1 -- 172.21.15.100:0/516001887 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630402ca80 con 0x7f6314188c30 2024-02-21T07:53:25.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.867+0000 7f6319c00640 1 -- 172.21.15.100:0/516001887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314188c30 msgr2=0x7f6314189040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.867+0000 7f6319c00640 1 --2- 172.21.15.100:0/516001887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314188c30 0x7f6314189040 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f631406f330 tx=0x7f630402bee0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.869+0000 7f6319c00640 1 -- 172.21.15.100:0/516001887 shutdown_connections 2024-02-21T07:53:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.869+0000 7f6319c00640 1 --2- 172.21.15.100:0/516001887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314188c30 0x7f6314189040 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.869+0000 7f6319c00640 1 --2- 172.21.15.100:0/516001887 >> v2:172.21.15.156:3300/0 conn(0x7f6314182f60 0x7f6314186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.869+0000 7f6319c00640 1 -- 172.21.15.100:0/516001887 >> 172.21.15.100:0/516001887 conn(0x7f63140668b0 msgr2=0x7f6314066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.871+0000 7f6319c00640 1 -- 172.21.15.100:0/516001887 shutdown_connections 2024-02-21T07:53:25.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.871+0000 7f6319c00640 1 -- 172.21.15.100:0/516001887 wait complete. 2024-02-21T07:53:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.874+0000 7f6319c00640 1 Processor -- start 2024-02-21T07:53:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.874+0000 7f6319c00640 1 -- start start 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6314182f60 0x7f6314221b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 0x7f6314222050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314190020 con 0x7f6314188c30 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314222630 con 0x7f6314182f60 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6319c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6314222910 con 0x7f6314071d40 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6312a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6312a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34566/0 (socket says 172.21.15.100:34566) 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6312a00640 1 -- 172.21.15.100:0/648225495 learned_addr learned my addr 172.21.15.100:0/648225495 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.875+0000 7f6312000640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6314182f60 0x7f6314221b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6313400640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 0x7f6314222050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 -- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6314182f60 msgr2=0x7f6314221b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6314182f60 0x7f6314221b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 -- 172.21.15.100:0/648225495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 msgr2=0x7f6314222050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 0x7f6314222050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 -- 172.21.15.100:0/648225495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304009b30 con 0x7f6314071d40 2024-02-21T07:53:25.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6313400640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 0x7f6314222050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f6312a00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d5f0 tx=0x7f62fc00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f630aa00640 1 -- 172.21.15.100:0/648225495 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0125f0 con 0x7f6314071d40 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f630aa00640 1 -- 172.21.15.100:0/648225495 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc012750 con 0x7f6314071d40 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.876+0000 7f630aa00640 1 -- 172.21.15.100:0/648225495 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc012b00 con 0x7f6314071d40 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.877+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631421e8f0 con 0x7f6314071d40 2024-02-21T07:53:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.877+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631421eeb0 con 0x7f6314071d40 2024-02-21T07:53:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.881+0000 7f630aa00640 1 -- 172.21.15.100:0/648225495 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f62fc012c60 con 0x7f6314071d40 2024-02-21T07:53:25.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.882+0000 7f630aa00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 0x7f62f00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.882+0000 7f630aa00640 1 -- 172.21.15.100:0/648225495 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f62fc0c9f60 con 0x7f6314071d40 2024-02-21T07:53:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.882+0000 7f6312000640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 0x7f62f00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.883+0000 7f6312000640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 0x7f62f00a1560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6314174750 tx=0x7f630c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.883+0000 7f631c9c0740 1 Processor -- start 2024-02-21T07:53:25.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.884+0000 7f631c9c0740 1 -- start start 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 0x558d6196c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6196c7e0 0x558d619a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 0x558d619a8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6189f210 con 0x558d6196c7e0 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6189c740 con 0x558d6196bec0 2024-02-21T07:53:25.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.885+0000 7f631c9c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d61897f20 con 0x558d619a7590 2024-02-21T07:53:25.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.886+0000 7f6312a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 0x558d6196c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.886+0000 7f6312a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 0x558d6196c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59446/0 (socket says 172.21.15.100:59446) 2024-02-21T07:53:25.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.886+0000 7f6313400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 0x558d619a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.886+0000 7f6312a00640 1 -- 172.21.15.100:0/866528518 learned_addr learned my addr 172.21.15.100:0/866528518 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.886+0000 7f6312000640 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6196c7e0 0x558d619a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 -- 172.21.15.100:0/866528518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 msgr2=0x558d6196c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 0x558d6196c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 -- 172.21.15.100:0/866528518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6196c7e0 msgr2=0x558d619a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6196c7e0 0x558d619a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 -- 172.21.15.100:0/866528518 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d61859df0 con 0x558d619a7590 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.887+0000 7f6313400640 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 0x558d619a8320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6314183480 tx=0x7f630402e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef4371d8acc479a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.888+0000 7f6303400640 1 -- 172.21.15.100:0/866528518 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304003b90 con 0x558d619a7590 2024-02-21T07:53:25.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.888+0000 7f6303400640 1 -- 172.21.15.100:0/866528518 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6304003cf0 con 0x558d619a7590 2024-02-21T07:53:25.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.888+0000 7f6303400640 1 -- 172.21.15.100:0/866528518 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304004260 con 0x558d619a7590 2024-02-21T07:53:25.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.889+0000 7f631c9c0740 1 -- 172.21.15.100:0/866528518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 msgr2=0x558d619a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.889+0000 7f631c9c0740 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 0x558d619a8320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6314183480 tx=0x7f630402e000 comp rx=0 tx=0).stop 2024-02-21T07:53:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 -- 172.21.15.100:0/866528518 shutdown_connections 2024-02-21T07:53:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d619a7590 0x558d619a8320 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6196c7e0 0x558d619a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 --2- 172.21.15.100:0/866528518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d6196bec0 0x558d6196c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 -- 172.21.15.100:0/866528518 >> 172.21.15.100:0/866528518 conn(0x558d6192e490 msgr2=0x558d6192f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 -- 172.21.15.100:0/866528518 shutdown_connections 2024-02-21T07:53:25.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.892+0000 7f631c9c0740 1 -- 172.21.15.100:0/866528518 wait complete. 2024-02-21T07:53:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.893+0000 7f631c9c0740 1 -- start start 2024-02-21T07:53:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.893+0000 7f631c9c0740 1 Processor -- start 2024-02-21T07:53:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d61958f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d619596c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6183d150 con 0x558d6195a910 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6183cdf0 con 0x558d619a7590 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d616061c0 con 0x558d6196c7e0 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.895+0000 7f631c9c0740 10 client.0 _ll_register_callbacks cb 0x558d6188c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.896+0000 7f6312a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.896+0000 7f6312a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34586/0 (socket says 172.21.15.100:34586) 2024-02-21T07:53:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.896+0000 7f6312a00640 1 -- 172.21.15.100:0/3126951243 learned_addr learned my addr 172.21.15.100:0/3126951243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 -- 172.21.15.100:0/3126951243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 msgr2=0x558d61958f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d61958f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 -- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 msgr2=0x558d619596c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d619596c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 -- 172.21.15.100:0/3126951243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631406eb10 con 0x558d6196c7e0 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f6312a00640 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d5c0 tx=0x7f62fc097ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf7817792ce4f9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f62f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc094140 con 0x558d6196c7e0 2024-02-21T07:53:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.897+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f62fc0942a0 con 0x558d6196c7e0 2024-02-21T07:53:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.898+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d615977e0 con 0x558d6196c7e0 2024-02-21T07:53:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.898+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62fc09cb40 con 0x558d6196c7e0 2024-02-21T07:53:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.898+0000 7f631c9c0740 10 client.6599 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.898+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558d618965a0 con 0x558d6196c7e0 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.898+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc09cca0 con 0x558d6196c7e0 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.899+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f62fc096f20 con 0x558d6196c7e0 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.899+0000 7f631c9c0740 10 client.6599 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.899+0000 7f631c9c0740 10 client.6599 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.900+0000 7f631c9c0740 20 client.6599 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.900+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6195ad30 0x558d6199ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.900+0000 7f631c9c0740 4 client.6599 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.900+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d615977e0 con 0x558d6195ad30 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.900+0000 7f6312000640 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6195ad30 0x558d6199ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.901+0000 7f62f7e00640 10 client.6599 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:53:25.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.901+0000 7f6312000640 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6195ad30 0x558d6199ae10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c1fa038d021d9fa server_cookie=1ab47624909f3118 in_seq=0 out_seq=0 2024-02-21T07:53:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.903+0000 7f62f7e00640 1 -- 172.21.15.100:0/3126951243 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558d615977e0 con 0x558d6195ad30 2024-02-21T07:53:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.903+0000 7f62f7e00640 10 client.6599 handle_command_reply: tid=0 2024-02-21T07:53:25.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.903+0000 7f631c9c0740 1 client.6599 shutdown 2024-02-21T07:53:25.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.907+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 msgr2=0x558d6199a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.907+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d5c0 tx=0x7f62fc097ad0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.913+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 shutdown_connections 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.913+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6195ad30 0x558d6199ae10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.914+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d619596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.914+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d61958f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.914+0000 7f631c9c0740 1 --2- 172.21.15.100:0/3126951243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d6199a730 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.914+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 >> 172.21.15.100:0/3126951243 conn(0x558d6196bec0 msgr2=0x558d6192ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.918+0000 7f62f7e00640 0 client.6599 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.918+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 shutdown_connections 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.918+0000 7f631c9c0740 1 -- 172.21.15.100:0/3126951243 wait complete. 2024-02-21T07:53:25.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.919+0000 7f631c9c0740 20 client.6599 trim_cache size 0 max 16384 2024-02-21T07:53:25.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.963+0000 7f631c9c0740 1 Processor -- start 2024-02-21T07:53:25.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.963+0000 7f631c9c0740 1 -- start start 2024-02-21T07:53:25.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.967+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d6192dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.967+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d61926300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.967+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f631c9c0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6192e280 con 0x558d6195a910 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f631c9c0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d619753f0 con 0x558d619a7590 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f631c9c0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6199a7b0 con 0x558d6196c7e0 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f6313400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f6313400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59452/0 (socket says 172.21.15.100:59452) 2024-02-21T07:53:25.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.968+0000 7f6313400640 1 -- 172.21.15.100:0/2503831470 learned_addr learned my addr 172.21.15.100:0/2503831470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 -- 172.21.15.100:0/2503831470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 msgr2=0x558d61926300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d61926300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 -- 172.21.15.100:0/2503831470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 msgr2=0x558d6192dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d6192dd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 -- 172.21.15.100:0/2503831470 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d61832ab0 con 0x558d619a7590 2024-02-21T07:53:25.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.969+0000 7f6313400640 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f630402c4f0 tx=0x7f6304009000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ef3a1cc1e3fb89 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:25.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.971+0000 7f6302a00640 1 -- 172.21.15.100:0/2503831470 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304003b90 con 0x558d619a7590 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.972+0000 7f6302a00640 1 -- 172.21.15.100:0/2503831470 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630402c560 con 0x558d619a7590 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.973+0000 7f631c9c0740 1 -- 172.21.15.100:0/2503831470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 msgr2=0x558d619a5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.973+0000 7f631c9c0740 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f630402c4f0 tx=0x7f6304009000 comp rx=0 tx=0).stop 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.973+0000 7f631c9c0740 1 -- 172.21.15.100:0/2503831470 shutdown_connections 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.973+0000 7f631c9c0740 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d619a7590 0x558d619a5cb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.974+0000 7f631c9c0740 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6196c7e0 0x558d61926300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.974+0000 7f631c9c0740 1 --2- 172.21.15.100:0/2503831470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d6195a910 0x558d6192dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.974+0000 7f631c9c0740 1 -- 172.21.15.100:0/2503831470 >> 172.21.15.100:0/2503831470 conn(0x558d6196bec0 msgr2=0x558d61977d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.974+0000 7f631c9c0740 1 -- 172.21.15.100:0/2503831470 shutdown_connections 2024-02-21T07:53:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.974+0000 7f631c9c0740 1 -- 172.21.15.100:0/2503831470 wait complete. 2024-02-21T07:53:25.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.976+0000 7f631c9c0740 1 -- start start 2024-02-21T07:53:25.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.976+0000 7f631c9c0740 1 Processor -- start 2024-02-21T07:53:26.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.997+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6195a910 0x558d619f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.997+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 0x558d61952a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.997+0000 7f631c9c0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:25.999+0000 7f6313400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f6313400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59460/0 (socket says 172.21.15.100:59460) 2024-02-21T07:53:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f6313400640 1 -- 172.21.15.100:0/691868596 learned_addr learned my addr 172.21.15.100:0/691868596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d61952fd0 con 0x558d619a7590 2024-02-21T07:53:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d619562d0 con 0x558d61936770 2024-02-21T07:53:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f6312000640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 0x558d61952a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.003+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6195e4c0 con 0x558d6195a910 2024-02-21T07:53:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.004+0000 7f631c9c0740 10 client.0 _ll_register_callbacks cb 0x7f6304009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.005+0000 7f6313400640 1 -- 172.21.15.100:0/691868596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6195a910 msgr2=0x558d619f97c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.006+0000 7f6313400640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6195a910 0x558d619f97c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.006+0000 7f6313400640 1 -- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 msgr2=0x558d61952a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.007+0000 7f6313400640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 0x558d61952a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.007+0000 7f6313400640 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d61859df0 con 0x558d61936770 2024-02-21T07:53:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.007+0000 7f6312000640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 0x558d61952a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:26.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.012+0000 7f6313400640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f630402c6d0 tx=0x7f6304004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e1076f39de0314 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.012+0000 7f62f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:26.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.013+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304050480 con 0x558d61936770 2024-02-21T07:53:26.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.014+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63040505e0 con 0x558d61936770 2024-02-21T07:53:26.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.014+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6304003cf0 con 0x558d61936770 2024-02-21T07:53:26.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.017+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63040507a0 con 0x558d61936770 2024-02-21T07:53:26.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.021+0000 7f631c9c0740 10 client.6655 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:26.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.021+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558d61858650 con 0x558d61936770 2024-02-21T07:53:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.025+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630405f080 con 0x558d61936770 2024-02-21T07:53:26.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.025+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f630403c040 con 0x558d61936770 2024-02-21T07:53:26.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 10 client.6655 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:26.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 10 client.6655 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:53:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 20 client.6655 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6192d570 0x558d619f8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 4 client.6655 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:53:26.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.027+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d615d4720 con 0x558d6192d570 2024-02-21T07:53:26.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.031+0000 7f6312a00640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6192d570 0x558d619f8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.034+0000 7f62f7e00640 10 client.6655 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:53:26.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.034+0000 7f6312a00640 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6192d570 0x558d619f8fd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=574331841bc43c43 server_cookie=8af9ac04ef34a28b in_seq=0 out_seq=0 2024-02-21T07:53:26.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.035+0000 7f62f7e00640 1 -- 172.21.15.100:0/691868596 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d615d4720 con 0x558d6192d570 2024-02-21T07:53:26.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.035+0000 7f62f7e00640 10 client.6655 handle_command_reply: tid=0 2024-02-21T07:53:26.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.035+0000 7f631c9c0740 1 client.6655 shutdown 2024-02-21T07:53:26.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.036+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 msgr2=0x558d61955640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.036+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f630402c6d0 tx=0x7f6304004ab0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 shutdown_connections 2024-02-21T07:53:26.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x558d6192d570 0x558d619f8fd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f62f7e00640 0 client.6655 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:53:26.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558d61936770 0x558d61955640 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558d619a7590 0x558d61952a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 --2- 172.21.15.100:0/691868596 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558d6195a910 0x558d619f97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.039+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 >> 172.21.15.100:0/691868596 conn(0x558d6196bec0 msgr2=0x558d619a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.040+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 shutdown_connections 2024-02-21T07:53:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.040+0000 7f631c9c0740 1 -- 172.21.15.100:0/691868596 wait complete. 2024-02-21T07:53:26.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.044+0000 7f631c9c0740 20 client.6655 trim_cache size 0 max 16384 2024-02-21T07:53:26.052 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:53:26.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.056+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 msgr2=0x7f62f00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.056+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 0x7f62f00a1560 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6314174750 tx=0x7f630c009040 comp rx=0 tx=0).stop 2024-02-21T07:53:26.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.056+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 msgr2=0x7f6314158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.056+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00d5f0 tx=0x7f62fc00dab0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 shutdown_connections 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62f009f0a0 0x7f62f00a1560 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6314188c30 0x7f6314222050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6314182f60 0x7f6314221b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 --2- 172.21.15.100:0/648225495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6314071d40 0x7f6314158f10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.057+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 >> 172.21.15.100:0/648225495 conn(0x7f63140668b0 msgr2=0x7f631406f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.059+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 shutdown_connections 2024-02-21T07:53:26.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.060+0000 7f6319c00640 1 -- 172.21.15.100:0/648225495 wait complete. 2024-02-21T07:53:26.141 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:53:26.142 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:53:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.474+0000 7f813ee00640 1 Processor -- start 2024-02-21T07:53:26.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.474+0000 7f813ee00640 1 -- start start 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.480+0000 7f813ee00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8138185010 0x7f81381868b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.480+0000 7f813ee00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8138185470 0x7f8138186df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813ee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813806eed0 con 0x7f81380cec70 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813ee00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8138071f20 con 0x7f8138185010 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813ee00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813806ebf0 con 0x7f8138185470 2024-02-21T07:53:26.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813e400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8138185470 0x7f8138186df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813e400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f8138185470 0x7f8138186df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34602/0 (socket says 172.21.15.100:34602) 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813e400640 1 -- 172.21.15.100:0/3291686021 learned_addr learned my addr 172.21.15.100:0/3291686021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.481+0000 7f813d000640 1 --2- 172.21.15.100:0/3291686021 >> v2:172.21.15.156:3300/0 conn(0x7f8138185010 0x7f81381868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.482+0000 7f813e400640 1 -- 172.21.15.100:0/3291686021 >> v2:172.21.15.156:3300/0 conn(0x7f8138185010 msgr2=0x7f81381868b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.482+0000 7f813e400640 1 --2- 172.21.15.100:0/3291686021 >> v2:172.21.15.156:3300/0 conn(0x7f8138185010 0x7f81381868b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.482+0000 7f813e400640 1 -- 172.21.15.100:0/3291686021 >> v1:172.21.15.100:6789/0 conn(0x7f81380cec70 legacy=0x7f813817b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.482+0000 7f813e400640 1 -- 172.21.15.100:0/3291686021 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138185dd0 con 0x7f8138185470 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.485+0000 7f813e400640 1 --2- 172.21.15.100:0/3291686021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8138185470 0x7f8138186df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81380ce030 tx=0x7f813003cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a0577d432002 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.486+0000 7f8137e00640 1 -- 172.21.15.100:0/3291686021 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813003da90 con 0x7f8138185470 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.486+0000 7f8137e00640 1 -- 172.21.15.100:0/3291686021 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813003dbf0 con 0x7f8138185470 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.487+0000 7f813ee00640 1 -- 172.21.15.100:0/3291686021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8138185470 msgr2=0x7f8138186df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.487+0000 7f813ee00640 1 --2- 172.21.15.100:0/3291686021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8138185470 0x7f8138186df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81380ce030 tx=0x7f813003cef0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 -- 172.21.15.100:0/3291686021 shutdown_connections 2024-02-21T07:53:26.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 --2- 172.21.15.100:0/3291686021 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8138185470 0x7f8138186df0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 --2- 172.21.15.100:0/3291686021 >> v2:172.21.15.156:3300/0 conn(0x7f8138185010 0x7f81381868b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 -- 172.21.15.100:0/3291686021 >> 172.21.15.100:0/3291686021 conn(0x7f81380ce150 msgr2=0x7f81380ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 -- 172.21.15.100:0/3291686021 shutdown_connections 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.488+0000 7f813ee00640 1 -- 172.21.15.100:0/3291686021 wait complete. 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.495+0000 7f813ee00640 1 Processor -- start 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.495+0000 7f813ee00640 1 -- start start 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.497+0000 7f813ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81380cec70 0x7f813806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.497+0000 7f813ee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 0x7f81381aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.497+0000 7f813ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.499+0000 7f813e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.499+0000 7f813e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46730/0 (socket says 172.21.15.100:46730) 2024-02-21T07:53:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.499+0000 7f813d000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 0x7f81381aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.500+0000 7f813d000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 0x7f81381aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59474/0 (socket says 172.21.15.100:59474) 2024-02-21T07:53:26.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.500+0000 7f813e400640 1 -- 172.21.15.100:0/511367240 learned_addr learned my addr 172.21.15.100:0/511367240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.500+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813816fb30 con 0x7f8138185470 2024-02-21T07:53:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.500+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138170c70 con 0x7f8138185010 2024-02-21T07:53:26.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.500+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813816fd80 con 0x7f81380cec70 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813da00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81380cec70 0x7f813806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813e400640 1 -- 172.21.15.100:0/511367240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81380cec70 msgr2=0x7f813806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813e400640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81380cec70 0x7f813806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813e400640 1 -- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 msgr2=0x7f81381aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813e400640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 0x7f81381aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.501+0000 7f813e400640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009b30 con 0x7f8138185470 2024-02-21T07:53:26.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.502+0000 7f813e400640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f813003d500 tx=0x7f8130004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.512+0000 7f8135600640 1 -- 172.21.15.100:0/511367240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813000e070 con 0x7f8138185470 2024-02-21T07:53:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.512+0000 7f8135600640 1 -- 172.21.15.100:0/511367240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8130009510 con 0x7f8138185470 2024-02-21T07:53:26.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.512+0000 7f8135600640 1 -- 172.21.15.100:0/511367240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8130045800 con 0x7f8138185470 2024-02-21T07:53:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.515+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8138170060 con 0x7f8138185470 2024-02-21T07:53:26.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.515+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8138170620 con 0x7f8138185470 2024-02-21T07:53:26.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.520+0000 7f8135600640 1 -- 172.21.15.100:0/511367240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f813003d890 con 0x7f8138185470 2024-02-21T07:53:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.527+0000 7f8135600640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 0x7f81180a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.527+0000 7f8135600640 1 -- 172.21.15.100:0/511367240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f81300ec930 con 0x7f8138185470 2024-02-21T07:53:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.528+0000 7f813da00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 0x7f81180a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.529+0000 7f813da00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 0x7f81180a1610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8124001500 tx=0x7f8124009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.530+0000 7f8143212740 1 Processor -- start 2024-02-21T07:53:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.531+0000 7f8143212740 1 -- start start 2024-02-21T07:53:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.532+0000 7f8143212740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c070 0x5639e715c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.532+0000 7f8143212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e715c990 0x5639e7197200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.532+0000 7f8143212740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.532+0000 7f8143212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e708f210 con 0x5639e715c990 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.532+0000 7f8143212740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e708c740 con 0x5639e715c070 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.533+0000 7f8143212740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e7087f20 con 0x5639e7197740 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.533+0000 7f813e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.533+0000 7f813e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34610/0 (socket says 172.21.15.100:34610) 2024-02-21T07:53:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.533+0000 7f813e400640 1 -- 172.21.15.100:0/1598444998 learned_addr learned my addr 172.21.15.100:0/1598444998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 -- 172.21.15.100:0/1598444998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c070 msgr2=0x5639e715c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c070 0x5639e715c450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 -- 172.21.15.100:0/1598444998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e715c990 msgr2=0x5639e7197200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e715c990 0x5639e7197200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 -- 172.21.15.100:0/1598444998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639e7049df0 con 0x5639e7197740 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f813e400640 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f81300c2680 tx=0x7f81300b9f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f6847185088753a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.534+0000 7f812a000640 1 -- 172.21.15.100:0/1598444998 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300bab10 con 0x5639e7197740 2024-02-21T07:53:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.535+0000 7f812a000640 1 -- 172.21.15.100:0/1598444998 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81300ba410 con 0x5639e7197740 2024-02-21T07:53:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.535+0000 7f812a000640 1 -- 172.21.15.100:0/1598444998 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81300be560 con 0x5639e7197740 2024-02-21T07:53:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.536+0000 7f8143212740 1 -- 172.21.15.100:0/1598444998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 msgr2=0x5639e71984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.536+0000 7f8143212740 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f81300c2680 tx=0x7f81300b9f50 comp rx=0 tx=0).stop 2024-02-21T07:53:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.537+0000 7f8143212740 1 -- 172.21.15.100:0/1598444998 shutdown_connections 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.537+0000 7f8143212740 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71984d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.537+0000 7f8143212740 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e715c990 0x5639e7197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.537+0000 7f8143212740 1 --2- 172.21.15.100:0/1598444998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c070 0x5639e715c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.537+0000 7f8143212740 1 -- 172.21.15.100:0/1598444998 >> 172.21.15.100:0/1598444998 conn(0x5639e711e640 msgr2=0x5639e711f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.538+0000 7f8143212740 1 -- 172.21.15.100:0/1598444998 shutdown_connections 2024-02-21T07:53:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.538+0000 7f8143212740 1 -- 172.21.15.100:0/1598444998 wait complete. 2024-02-21T07:53:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.539+0000 7f8143212740 1 -- start start 2024-02-21T07:53:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.544+0000 7f8143212740 1 Processor -- start 2024-02-21T07:53:26.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.548+0000 7f8143212740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 0x5639e7151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.548+0000 7f8143212740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 0x5639e71472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.549+0000 7f813da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 0x5639e7151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.549+0000 7f813da00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 0x5639e7151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34622/0 (socket says 172.21.15.100:34622) 2024-02-21T07:53:26.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.549+0000 7f813da00640 1 -- 172.21.15.100:0/1166420628 learned_addr learned my addr 172.21.15.100:0/1166420628 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.549+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e711afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.550+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e702d150 con 0x5639e71a1a50 2024-02-21T07:53:26.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.549+0000 7f813d000640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 0x5639e71472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.550+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e702cdf0 con 0x5639e7197740 2024-02-21T07:53:26.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.550+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e6df61c0 con 0x5639e715c990 2024-02-21T07:53:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.551+0000 7f813e400640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e711afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.551+0000 7f8143212740 10 client.0 _ll_register_callbacks cb 0x5639e707c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:26.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.552+0000 7f813d000640 1 -- 172.21.15.100:0/1166420628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 msgr2=0x5639e7151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.552+0000 7f813d000640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 0x5639e7151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.552+0000 7f813d000640 1 -- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 msgr2=0x5639e711afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.552+0000 7f813d000640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e711afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.552+0000 7f813d000640 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8138170620 con 0x5639e7197740 2024-02-21T07:53:26.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.553+0000 7f813e400640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e711afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:26.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.553+0000 7f813d000640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 0x5639e71472b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8138183f70 tx=0x7f812c0119d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b9da6b167f9692 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.553+0000 7f811ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c004300 con 0x5639e7197740 2024-02-21T07:53:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f812c004460 con 0x5639e7197740 2024-02-21T07:53:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639e6d877e0 con 0x5639e7197740 2024-02-21T07:53:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f812c003610 con 0x5639e7197740 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f8143212740 10 client.6664 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.555+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5639e70865a0 con 0x5639e7197740 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.556+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639e6d877e0 con 0x5639e7197740 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.556+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f812c003770 con 0x5639e7197740 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.556+0000 7f8143212740 10 client.6664 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.556+0000 7f8143212740 10 client.6664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:53:26.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.557+0000 7f8143212740 20 client.6664 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:26.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.557+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e7194ca0 0x5639e71950b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.557+0000 7f8143212740 4 client.6664 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:26.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.557+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639e6dc4720 con 0x5639e7194ca0 2024-02-21T07:53:26.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.559+0000 7f813da00640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e7194ca0 0x5639e71950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.560+0000 7f813da00640 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e7194ca0 0x5639e71950b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb9f922783edd746 server_cookie=f647fb648676e74f in_seq=0 out_seq=0 2024-02-21T07:53:26.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.560+0000 7f811ea00640 10 client.6664 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:53:26.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.562+0000 7f811ea00640 1 -- 172.21.15.100:0/1166420628 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5639e6dc4720 con 0x5639e7194ca0 2024-02-21T07:53:26.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.562+0000 7f811ea00640 10 client.6664 handle_command_reply: tid=0 2024-02-21T07:53:26.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.562+0000 7f8143212740 1 client.6664 shutdown 2024-02-21T07:53:26.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 msgr2=0x5639e71472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 0x5639e71472b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8138183f70 tx=0x7f812c0119d0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 shutdown_connections 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e711afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e7194ca0 0x5639e71950b0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e7197740 0x5639e71472b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 --2- 172.21.15.100:0/1166420628 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e715c990 0x5639e7151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 >> 172.21.15.100:0/1166420628 conn(0x5639e715c070 msgr2=0x5639e71200b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.563+0000 7f811ea00640 0 client.6664 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:53:26.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.564+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 shutdown_connections 2024-02-21T07:53:26.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.564+0000 7f8143212740 1 -- 172.21.15.100:0/1166420628 wait complete. 2024-02-21T07:53:26.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.564+0000 7f8143212740 20 client.6664 trim_cache size 0 max 16384 2024-02-21T07:53:26.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.591+0000 7f8143212740 1 Processor -- start 2024-02-21T07:53:26.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.591+0000 7f8143212740 1 -- start start 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e7197740 0x5639e711c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e71a1a50 0x5639e7167db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e711a470 con 0x5639e7197740 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e71620d0 con 0x5639e715c990 2024-02-21T07:53:26.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.593+0000 7f8143212740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e711ce50 con 0x5639e71a1a50 2024-02-21T07:53:26.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59488/0 (socket says 172.21.15.100:59488) 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 -- 172.21.15.100:0/1983549804 learned_addr learned my addr 172.21.15.100:0/1983549804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813d000640 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e7197740 0x5639e711c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813e400640 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e71a1a50 0x5639e7167db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 -- 172.21.15.100:0/1983549804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e71a1a50 msgr2=0x5639e7167db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e71a1a50 0x5639e7167db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 -- 172.21.15.100:0/1983549804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e7197740 msgr2=0x5639e711c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e7197740 0x5639e711c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.594+0000 7f813da00640 1 -- 172.21.15.100:0/1983549804 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639e7022ab0 con 0x5639e715c990 2024-02-21T07:53:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.597+0000 7f813da00640 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5639e711bcc0 tx=0x7f8124010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eec4e73b474210c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.598+0000 7f8129600640 1 -- 172.21.15.100:0/1983549804 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240149c0 con 0x5639e715c990 2024-02-21T07:53:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.598+0000 7f8129600640 1 -- 172.21.15.100:0/1983549804 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124014b20 con 0x5639e715c990 2024-02-21T07:53:26.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.598+0000 7f8129600640 1 -- 172.21.15.100:0/1983549804 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124014cd0 con 0x5639e715c990 2024-02-21T07:53:26.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 -- 172.21.15.100:0/1983549804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 msgr2=0x5639e7120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5639e711bcc0 tx=0x7f8124010000 comp rx=0 tx=0).stop 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 -- 172.21.15.100:0/1983549804 shutdown_connections 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e71a1a50 0x5639e7167db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e7197740 0x5639e711c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 --2- 172.21.15.100:0/1983549804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7120160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 -- 172.21.15.100:0/1983549804 >> 172.21.15.100:0/1983549804 conn(0x5639e715c070 msgr2=0x5639e71470c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 -- 172.21.15.100:0/1983549804 shutdown_connections 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.599+0000 7f8143212740 1 -- 172.21.15.100:0/1983549804 wait complete. 2024-02-21T07:53:26.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.600+0000 7f8143212740 1 -- start start 2024-02-21T07:53:26.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.601+0000 7f8143212740 1 Processor -- start 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e71f3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e71ffa40 con 0x5639e71a1a50 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e7144110 con 0x5639e715c990 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639e7189220 con 0x5639e7197740 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f8143212740 10 client.0 _ll_register_callbacks cb 0x7f812c009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813d000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34636/0 (socket says 172.21.15.100:34636) 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59500/0 (socket says 172.21.15.100:59500) 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813d000640 1 -- 172.21.15.100:0/40495853 learned_addr learned my addr 172.21.15.100:0/40495853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813e400640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e71f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 -- 172.21.15.100:0/40495853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 msgr2=0x5639e71ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 -- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 msgr2=0x5639e71f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.603+0000 7f813da00640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e71f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f813da00640 1 -- 172.21.15.100:0/40495853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813806eed0 con 0x5639e715c990 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f813d000640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f813e400640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e71f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f813da00640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8124015000 tx=0x7f8124000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328fe0b43d9408d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:26.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f811ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124014ea0 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8124022ae0 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81300ba410 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8124022ca0 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f8143212740 10 client.6670 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.604+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5639e7048650 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812403d020 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f812401f040 con 0x5639e715c990 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 10 client.6670 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 10 client.6670 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 20 client.6670 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:26.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e71608a0 0x5639e7158660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 4 client.6670 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5639e6e13890 con 0x5639e71608a0 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.605+0000 7f813d000640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e71608a0 0x5639e7158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f813d000640 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e71608a0 0x5639e7158660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f858855015d24a00 server_cookie=52ccb8e431cb796f in_seq=0 out_seq=0 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f811ea00640 10 client.6670 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f811ea00640 1 -- 172.21.15.100:0/40495853 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5639e6e13890 con 0x5639e71608a0 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f811ea00640 10 client.6670 handle_command_reply: tid=0 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 client.6670 shutdown 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 msgr2=0x5639e7188ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8124015000 tx=0x7f8124000bc0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 shutdown_connections 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5639e71a1a50 0x5639e71f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5639e7197740 0x5639e71ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5639e71608a0 0x5639e7158660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 --2- 172.21.15.100:0/40495853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5639e715c990 0x5639e7188ce0 secure :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8124015000 tx=0x7f8124000bc0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 >> 172.21.15.100:0/40495853 conn(0x5639e715c070 msgr2=0x5639e7167db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.606+0000 7f811ea00640 0 client.6670 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.607+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 shutdown_connections 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.607+0000 7f8143212740 1 -- 172.21.15.100:0/40495853 wait complete. 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.607+0000 7f8143212740 20 client.6670 trim_cache size 0 max 16384 2024-02-21T07:53:26.613 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 msgr2=0x7f81180a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 0x7f81180a1610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8124001500 tx=0x7f8124009040 comp rx=0 tx=0).stop 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 msgr2=0x7f81381aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f813003d500 tx=0x7f8130004a40 comp rx=0 tx=0).stop 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 shutdown_connections 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f811809f150 0x7f81180a1610 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138185470 0x7f81381aa8b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8138185010 0x7f81381aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 --2- 172.21.15.100:0/511367240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81380cec70 0x7f813806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.608+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 >> 172.21.15.100:0/511367240 conn(0x7f81380ce150 msgr2=0x7f8138072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.609+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 shutdown_connections 2024-02-21T07:53:26.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:26.609+0000 7f813ee00640 1 -- 172.21.15.100:0/511367240 wait complete. 2024-02-21T07:53:26.637 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:53:26.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:53:27.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.037+0000 7fbaf1800640 1 Processor -- start 2024-02-21T07:53:27.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.038+0000 7fbaf1800640 1 -- start start 2024-02-21T07:53:27.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.046+0000 7fbaf1800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbae41084c0 0x7fbae4052c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.047+0000 7fbaf1800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae410fe00 con 0x7fbae4115c90 2024-02-21T07:53:27.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.048+0000 7fbaf1800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae41100e0 con 0x7fbae4115820 2024-02-21T07:53:27.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.052+0000 7fbaea000640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbae4115820 0x7fbae407d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:34582/0 (socket says 172.21.15.100:34582) 2024-02-21T07:53:27.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.052+0000 7fbaea000640 1 -- 172.21.15.100:0/2953721093 learned_addr learned my addr 172.21.15.100:0/2953721093 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:53:27.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.048+0000 7fbaeaa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbae41084c0 0x7fbae4052c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.053+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae4059600 con 0x7fbae41084c0 2024-02-21T07:53:27.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.053+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546929897 0 0) 0x7fbae41100e0 con 0x7fbae4115820 2024-02-21T07:53:27.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.054+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad0003520 con 0x7fbae4115820 2024-02-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.054+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594900615 0 0) 0x7fbae410fe00 con 0x7fbae4115c90 2024-02-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.054+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae41100e0 con 0x7fbae4115c90 2024-02-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.054+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820205041 0 0) 0x7fbad0003520 con 0x7fbae4115820 2024-02-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 >> v2:172.21.15.170:3300/0 conn(0x7fbae41084c0 msgr2=0x7fbae4052c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 --2- 172.21.15.100:0/2953721093 >> v2:172.21.15.170:3300/0 conn(0x7fbae41084c0 0x7fbae4052c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 >> v1:172.21.15.100:6789/0 conn(0x7fbae4115c90 legacy=0x7fbae407de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae41103c0 con 0x7fbae4115820 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fbadc001670 con 0x7fbae4115820 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 >> v1:172.21.15.156:6789/0 conn(0x7fbae4115820 legacy=0x7fbae407d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbad0003b50 0x7fbad0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 0x7fbad0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad0005180 0x7fbad000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad000c050 con 0x7fbad0003b50 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad000c190 con 0x7fbad00047c0 2024-02-21T07:53:27.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.055+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad000c350 con 0x7fbad0005180 2024-02-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.058+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbad0003b50 0x7fbad0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.059+0000 7fbaeb400640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad0005180 0x7fbad000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.059+0000 7fbaea000640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 0x7fbad0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.060+0000 7fbaea000640 1 -- 172.21.15.100:0/2953721093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad0005180 msgr2=0x7fbad000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.060+0000 7fbaea000640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad0005180 0x7fbad000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.060+0000 7fbaea000640 1 -- 172.21.15.100:0/2953721093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbad0003b50 msgr2=0x7fbad0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.067+0000 7fbaea000640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbad0003b50 0x7fbad0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.067+0000 7fbaea000640 1 -- 172.21.15.100:0/2953721093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae41103c0 con 0x7fbad00047c0 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.067+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbad0003b50 0x7fbad0003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.067+0000 7fbaeb400640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad0005180 0x7fbad000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:27.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.067+0000 7fbaeb400640 1 -- 172.21.15.100:0/2953721093 reap_dead start 2024-02-21T07:53:27.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.069+0000 7fbaea000640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 0x7fbad0004c40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c1e0 tx=0x7fbad00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b8ae216a80e2d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.070+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc005ad0 con 0x7fbad00047c0 2024-02-21T07:53:27.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.070+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc005c30 con 0x7fbad00047c0 2024-02-21T07:53:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.070+0000 7fbae9600640 1 -- 172.21.15.100:0/2953721093 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc02ca90 con 0x7fbad00047c0 2024-02-21T07:53:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.071+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 msgr2=0x7fbad0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.071+0000 7fbaf1800640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 0x7fbad0004c40 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c1e0 tx=0x7fbad00057f0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.072+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 shutdown_connections 2024-02-21T07:53:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.072+0000 7fbaf1800640 1 --2- 172.21.15.100:0/2953721093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbad00047c0 0x7fbad0004c40 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.072+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 >> 172.21.15.100:0/2953721093 conn(0x7fbae4057270 msgr2=0x7fbae4057680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.073+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 shutdown_connections 2024-02-21T07:53:27.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.073+0000 7fbaf1800640 1 -- 172.21.15.100:0/2953721093 wait complete. 2024-02-21T07:53:27.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.077+0000 7fbaf1800640 1 Processor -- start 2024-02-21T07:53:27.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.078+0000 7fbaf1800640 1 -- start start 2024-02-21T07:53:27.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.081+0000 7fbaf1800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.081+0000 7fbaf1800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 0x7fbae4105fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.081+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.082+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34664/0 (socket says 172.21.15.100:34664) 2024-02-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.082+0000 7fbaeaa00640 1 -- 172.21.15.100:0/1276630670 learned_addr learned my addr 172.21.15.100:0/1276630670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:27.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.082+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 0x7fbae41a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.086+0000 7fbaea000640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 0x7fbae4105fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.086+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40f0d60 con 0x7fbae4106500 2024-02-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.086+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae4057020 con 0x7fbae4081250 2024-02-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.086+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae40561c0 con 0x7fbad00047c0 2024-02-21T07:53:27.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.087+0000 7fbaeb400640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 0x7fbae41a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeaa00640 1 -- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 msgr2=0x7fbae4105fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 0x7fbae4105fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeaa00640 1 -- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 msgr2=0x7fbae41a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 0x7fbae41a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeaa00640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae40564a0 con 0x7fbad00047c0 2024-02-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaeb400640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 0x7fbae41a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.088+0000 7fbaea000640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 0x7fbae4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:27.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.089+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbaec075540 tx=0x7fbaec068050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.089+0000 7fbae2a00640 1 -- 172.21.15.100:0/1276630670 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec090070 con 0x7fbad00047c0 2024-02-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.089+0000 7fbae2a00640 1 -- 172.21.15.100:0/1276630670 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec094410 con 0x7fbad00047c0 2024-02-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.089+0000 7fbae2a00640 1 -- 172.21.15.100:0/1276630670 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0947c0 con 0x7fbad00047c0 2024-02-21T07:53:27.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.090+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae4056780 con 0x7fbad00047c0 2024-02-21T07:53:27.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.090+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4056d40 con 0x7fbad00047c0 2024-02-21T07:53:27.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.106+0000 7fbaf43e1740 1 Processor -- start 2024-02-21T07:53:27.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.106+0000 7fbaf43e1740 1 -- start start 2024-02-21T07:53:27.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 0x561ecd2e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2e59b0 0x561ecd320220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd218210 con 0x561ecd2e5090 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd215740 con 0x561ecd320760 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.110+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd210f20 con 0x561ecd2e59b0 2024-02-21T07:53:27.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.112+0000 7fbae2a00640 1 -- 172.21.15.100:0/1276630670 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbaec094920 con 0x7fbad00047c0 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.119+0000 7fbaeb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 0x561ecd2e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.119+0000 7fbae2a00640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 0x7fbacc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.119+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2e59b0 0x561ecd320220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.119+0000 7fbaea000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.122+0000 7fbaeb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 0x561ecd2e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46762/0 (socket says 172.21.15.100:46762) 2024-02-21T07:53:27.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.122+0000 7fbaeb400640 1 -- 172.21.15.100:0/2656776308 learned_addr learned my addr 172.21.15.100:0/2656776308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:27.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.123+0000 7fbae2a00640 1 -- 172.21.15.100:0/1276630670 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbaec1444c0 con 0x7fbad00047c0 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.124+0000 7fbaeb400640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 0x7fbacc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.125+0000 7fbaea000640 1 -- 172.21.15.100:0/2656776308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2e59b0 msgr2=0x561ecd320220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.125+0000 7fbaea000640 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2e59b0 0x561ecd320220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.125+0000 7fbaea000640 1 -- 172.21.15.100:0/2656776308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 msgr2=0x561ecd2e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.125+0000 7fbaea000640 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 0x561ecd2e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.125+0000 7fbaea000640 1 -- 172.21.15.100:0/2656776308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ecd1d2df0 con 0x561ecd320760 2024-02-21T07:53:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.129+0000 7fbaea000640 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3214f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c320 tx=0x7fbadc007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5afe92fc92cf166c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.129+0000 7fbad7400640 1 -- 172.21.15.100:0/2656776308 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc001670 con 0x561ecd320760 2024-02-21T07:53:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.130+0000 7fbad7400640 1 -- 172.21.15.100:0/2656776308 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc03a040 con 0x561ecd320760 2024-02-21T07:53:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.130+0000 7fbad7400640 1 -- 172.21.15.100:0/2656776308 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc001670 con 0x561ecd320760 2024-02-21T07:53:27.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.130+0000 7fbaeb400640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 0x7fbacc0a16b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x561ecd2a73e0 tx=0x7fbad8001340 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.134+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2656776308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 msgr2=0x561ecd3214f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.134+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3214f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c320 tx=0x7fbadc007000 comp rx=0 tx=0).stop 2024-02-21T07:53:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.138+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2656776308 shutdown_connections 2024-02-21T07:53:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.138+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3214f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.138+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2e59b0 0x561ecd320220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.138+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2656776308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e5090 0x561ecd2e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.138+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2656776308 >> 172.21.15.100:0/2656776308 conn(0x561ecd2a7660 msgr2=0x561ecd2a86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.145+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2656776308 shutdown_connections 2024-02-21T07:53:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.148+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2656776308 wait complete. 2024-02-21T07:53:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.150+0000 7fbaf43e1740 1 -- start start 2024-02-21T07:53:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.150+0000 7fbaf43e1740 1 Processor -- start 2024-02-21T07:53:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.156+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2ebca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.156+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd2a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaea000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd2a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd1b6150 con 0x561ecd2e59b0 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd1b5df0 con 0x561ecd2a4620 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561eccf7f1c0 con 0x561ecd320760 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2ebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2ebca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46770/0 (socket says 172.21.15.100:46770) 2024-02-21T07:53:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaeaa00640 1 -- 172.21.15.100:0/3592394197 learned_addr learned my addr 172.21.15.100:0/3592394197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.157+0000 7fbaeb400640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.158+0000 7fbaf43e1740 10 client.0 _ll_register_callbacks cb 0x561ecd2052b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.160+0000 7fbaeb400640 1 -- 172.21.15.100:0/3592394197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 msgr2=0x561ecd2a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaeb400640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd2a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaeb400640 1 -- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 msgr2=0x561ecd2ebca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaeb400640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2ebca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaeb400640 1 -- 172.21.15.100:0/3592394197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae41103c0 con 0x561ecd2a4620 2024-02-21T07:53:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaea000640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd2a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbacbe00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:27.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.161+0000 7fbaeb400640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2de5b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbae4016b00 tx=0x7fbad80012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4231d0459ffb0f16 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.162+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8021070 con 0x561ecd2a4620 2024-02-21T07:53:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.162+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbad8018440 con 0x561ecd2a4620 2024-02-21T07:53:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.163+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561eccf107e0 con 0x561ecd2a4620 2024-02-21T07:53:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.167+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad8018600 con 0x561ecd2a4620 2024-02-21T07:53:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.167+0000 7fbaf43e1740 10 client.6682 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:27.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.167+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561ecd20f5a0 con 0x561ecd2a4620 2024-02-21T07:53:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.167+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561eccf107e0 con 0x561ecd2a4620 2024-02-21T07:53:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.168+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbad8018760 con 0x561ecd2a4620 2024-02-21T07:53:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.169+0000 7fbaf43e1740 10 client.6682 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:27.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.169+0000 7fbaf43e1740 10 client.6682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.169+0000 7fbaf43e1740 20 client.6682 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.169+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd2a4aa0 0x561ecd2ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.169+0000 7fbaf43e1740 4 client.6682 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.170+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561eccf4d720 con 0x561ecd2a4aa0 2024-02-21T07:53:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.170+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd2a4aa0 0x561ecd2ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.173+0000 7fbacbe00640 10 client.6682 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.173+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd2a4aa0 0x561ecd2ec3f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2af254a26b85974 server_cookie=62413b5cc83d2b44 in_seq=0 out_seq=0 2024-02-21T07:53:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.175+0000 7fbacbe00640 1 -- 172.21.15.100:0/3592394197 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561eccf4d720 con 0x561ecd2a4aa0 2024-02-21T07:53:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.175+0000 7fbacbe00640 10 client.6682 handle_command_reply: tid=0 2024-02-21T07:53:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.175+0000 7fbaf43e1740 1 client.6682 shutdown 2024-02-21T07:53:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 msgr2=0x561ecd2de5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2de5b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbae4016b00 tx=0x7fbad80012d0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 shutdown_connections 2024-02-21T07:53:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd2a4aa0 0x561ecd2ec3f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2de5b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd2a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/3592394197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2ebca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.181+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 >> 172.21.15.100:0/3592394197 conn(0x561ecd2e5090 msgr2=0x561ecd3125b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.186+0000 7fbacbe00640 0 client.6682 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.187+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 shutdown_connections 2024-02-21T07:53:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.187+0000 7fbaf43e1740 1 -- 172.21.15.100:0/3592394197 wait complete. 2024-02-21T07:53:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.187+0000 7fbaf43e1740 20 client.6682 trim_cache size 0 max 16384 2024-02-21T07:53:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.225+0000 7fbaf43e1740 1 Processor -- start 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.225+0000 7fbaf43e1740 1 -- start start 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd310950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd2e5470 con 0x561ecd2e59b0 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd320c70 con 0x561ecd2a4620 2024-02-21T07:53:27.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.227+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd29f710 con 0x561ecd320760 2024-02-21T07:53:27.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaea000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaea000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46782/0 (socket says 172.21.15.100:46782) 2024-02-21T07:53:27.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaeaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59544/0 (socket says 172.21.15.100:59544) 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaea000640 1 -- 172.21.15.100:0/2881220479 learned_addr learned my addr 172.21.15.100:0/2881220479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.229+0000 7fbaeb400640 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd310950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.230+0000 7fbaea000640 1 -- 172.21.15.100:0/2881220479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 msgr2=0x561ecd310950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.230+0000 7fbaea000640 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd310950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.230+0000 7fbaea000640 1 -- 172.21.15.100:0/2881220479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 msgr2=0x561ecd2af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.230+0000 7fbaea000640 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.230+0000 7fbaea000640 1 -- 172.21.15.100:0/2881220479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ecd1abab0 con 0x561ecd2e59b0 2024-02-21T07:53:27.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.231+0000 7fbaea000640 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbadc001200 tx=0x7fbadc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b2e7961a3c7536 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.232+0000 7fbad6a00640 1 -- 172.21.15.100:0/2881220479 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc02de90 con 0x561ecd2e59b0 2024-02-21T07:53:27.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.232+0000 7fbad6a00640 1 -- 172.21.15.100:0/2881220479 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc02de90 con 0x561ecd2e59b0 2024-02-21T07:53:27.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.232+0000 7fbad6a00640 1 -- 172.21.15.100:0/2881220479 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0047e0 con 0x561ecd2e59b0 2024-02-21T07:53:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.233+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2881220479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 msgr2=0x561ecd31deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.233+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbadc001200 tx=0x7fbadc02f000 comp rx=0 tx=0).stop 2024-02-21T07:53:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.234+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2881220479 shutdown_connections 2024-02-21T07:53:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.234+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd320760 0x561ecd310950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.234+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd31deb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.234+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2881220479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd2a4620 0x561ecd2af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.234+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2881220479 >> 172.21.15.100:0/2881220479 conn(0x561ecd2e5090 msgr2=0x561ecd2de3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.235+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2881220479 shutdown_connections 2024-02-21T07:53:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.236+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2881220479 wait complete. 2024-02-21T07:53:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.241+0000 7fbaf43e1740 1 -- start start 2024-02-21T07:53:27.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.247+0000 7fbaf43e1740 1 Processor -- start 2024-02-21T07:53:27.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.263+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2a4620 0x561ecd31e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd31eab0 con 0x561ecd2e59b0 2024-02-21T07:53:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd376e30 con 0x561ecd320760 2024-02-21T07:53:27.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ecd394110 con 0x561ecd2a4620 2024-02-21T07:53:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.265+0000 7fbaf43e1740 10 client.0 _ll_register_callbacks cb 0x7fbad0003840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.266+0000 7fbaea000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.266+0000 7fbaea000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46790/0 (socket says 172.21.15.100:46790) 2024-02-21T07:53:27.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.266+0000 7fbaea000640 1 -- 172.21.15.100:0/2668949086 learned_addr learned my addr 172.21.15.100:0/2668949086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:27.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.267+0000 7fbaeb400640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.268+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2a4620 0x561ecd31e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.269+0000 7fbaea000640 1 -- 172.21.15.100:0/2668949086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2a4620 msgr2=0x561ecd31e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.270+0000 7fbaea000640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2a4620 0x561ecd31e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.270+0000 7fbaea000640 1 -- 172.21.15.100:0/2668949086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 msgr2=0x561ecd3768f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:27.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.270+0000 7fbaea000640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3768f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.270+0000 7fbaea000640 1 -- 172.21.15.100:0/2668949086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ecd1d2df0 con 0x561ecd2e59b0 2024-02-21T07:53:27.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.271+0000 7fbaea000640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbadc001eb0 tx=0x7fbadc02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36623b21fcd2ca9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:27.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.271+0000 7fbacbe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:27.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.273+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc02dc90 con 0x561ecd2e59b0 2024-02-21T07:53:27.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.273+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbadc03a040 con 0x561ecd2e59b0 2024-02-21T07:53:27.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.275+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbadc007240 con 0x561ecd2e59b0 2024-02-21T07:53:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.276+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbadc02dc90 con 0x561ecd2e59b0 2024-02-21T07:53:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.277+0000 7fbaf43e1740 10 client.6501 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:27.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.277+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561ecd1d1650 con 0x561ecd2e59b0 2024-02-21T07:53:27.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.277+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc061080 con 0x561ecd2e59b0 2024-02-21T07:53:27.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbadc052070 con 0x561ecd2e59b0 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 10 client.6501 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 10 client.6501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 20 client.6501 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd311e50 0x561ecd31f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 4 client.6501 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:53:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.278+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561eccf9c890 con 0x561ecd311e50 2024-02-21T07:53:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.281+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd311e50 0x561ecd31f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.285+0000 7fbaeaa00640 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd311e50 0x561ecd31f3a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a603f3a4030134 server_cookie=b85611fa54172c2f in_seq=0 out_seq=0 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.285+0000 7fbacbe00640 10 client.6501 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.285+0000 7fbacbe00640 1 -- 172.21.15.100:0/2668949086 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561eccf9c890 con 0x561ecd311e50 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.285+0000 7fbacbe00640 10 client.6501 handle_command_reply: tid=0 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.285+0000 7fbaf43e1740 1 client.6501 shutdown 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 msgr2=0x561ecd2daa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbadc001eb0 tx=0x7fbadc02e070 comp rx=0 tx=0).stop 2024-02-21T07:53:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 shutdown_connections 2024-02-21T07:53:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561ecd311e50 0x561ecd31f3a0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561ecd320760 0x561ecd3768f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561ecd2e59b0 0x561ecd2daa90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.286+0000 7fbaf43e1740 1 --2- 172.21.15.100:0/2668949086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561ecd2a4620 0x561ecd31e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.287+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 >> 172.21.15.100:0/2668949086 conn(0x561ecd2e5090 msgr2=0x561ecd2a90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.287+0000 7fbacbe00640 0 client.6501 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.287+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 shutdown_connections 2024-02-21T07:53:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.288+0000 7fbaf43e1740 1 -- 172.21.15.100:0/2668949086 wait complete. 2024-02-21T07:53:27.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.288+0000 7fbaf43e1740 20 client.6501 trim_cache size 0 max 16384 2024-02-21T07:53:27.293 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:53:27.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.293+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 msgr2=0x7fbacc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.293+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 0x7fbacc0a16b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x561ecd2a73e0 tx=0x7fbad8001340 comp rx=0 tx=0).stop 2024-02-21T07:53:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.293+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 msgr2=0x7fbae40f0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.293+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbaec075540 tx=0x7fbaec068050 comp rx=0 tx=0).stop 2024-02-21T07:53:27.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 shutdown_connections 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbacc09f1f0 0x7fbacc0a16b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae4106500 0x7fbae41a7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae4081250 0x7fbae4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 --2- 172.21.15.100:0/1276630670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbad00047c0 0x7fbae40f0820 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.294+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 >> 172.21.15.100:0/1276630670 conn(0x7fbae4057270 msgr2=0x7fbae4057650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.295+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 shutdown_connections 2024-02-21T07:53:27.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:27.295+0000 7fbaf1800640 1 -- 172.21.15.100:0/1276630670 wait complete. 2024-02-21T07:53:28.361 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:53:28.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:28.362 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:53:28.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.859+0000 7f9b11a00640 1 Processor -- start 2024-02-21T07:53:28.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.859+0000 7f9b11a00640 1 -- start start 2024-02-21T07:53:28.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.864+0000 7f9b11a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b0c0711e0 0x7f9b0c1882f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.864+0000 7f9b11a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c071660 con 0x7f9b0c183c90 2024-02-21T07:53:28.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.864+0000 7f9b11a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c071940 con 0x7f9b0c184070 2024-02-21T07:53:28.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.864+0000 7f9b11a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c06dc90 con 0x7f9b0c0711e0 2024-02-21T07:53:28.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.866+0000 7f9b0b400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f9b0c184070 0x7f9b0c0cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:34594/0 (socket says 172.21.15.100:34594) 2024-02-21T07:53:28.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.866+0000 7f9b0b400640 1 -- 172.21.15.100:0/2781973504 learned_addr learned my addr 172.21.15.100:0/2781973504 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:53:28.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.867+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63468998 0 0) 0x7f9b0c071940 con 0x7f9b0c184070 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.867+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af0003520 con 0x7f9b0c184070 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899916636 0 0) 0x7f9af0003520 con 0x7f9b0c184070 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 >> v2:172.21.15.100:3300/0 conn(0x7f9b0c0711e0 msgr2=0x7f9b0c1882f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 --2- 172.21.15.100:0/2781973504 >> v2:172.21.15.100:3300/0 conn(0x7f9b0c0711e0 0x7f9b0c1882f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 >> v1:172.21.15.100:6789/0 conn(0x7f9b0c183c90 legacy=0x7f9b0c187be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c071c20 con 0x7f9b0c184070 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f9b040019d0 con 0x7f9b0c184070 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 >> v1:172.21.15.156:6789/0 conn(0x7f9b0c184070 legacy=0x7f9b0c0cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9af0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af00047c0 0x7f9af0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af00053d0 0x7f9af000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c06dc90 con 0x7f9af00047c0 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0014b20 con 0x7f9af0003a10 2024-02-21T07:53:28.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.868+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0014ce0 con 0x7f9af00053d0 2024-02-21T07:53:28.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.869+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9af0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.869+0000 7f9b0b400640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af00053d0 0x7f9af000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.870+0000 7f9b0aa00640 1 -- 172.21.15.100:0/2781973504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af00053d0 msgr2=0x7f9af000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.870+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9af00053d0 0x7f9af000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.870+0000 7f9b0aa00640 1 -- 172.21.15.100:0/2781973504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af00047c0 msgr2=0x7f9af0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.870+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af00047c0 0x7f9af0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.871+0000 7f9b0b400640 1 -- 172.21.15.100:0/2781973504 reap_dead start 2024-02-21T07:53:28.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.871+0000 7f9b0aa00640 1 -- 172.21.15.100:0/2781973504 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0003520 con 0x7f9af0003a10 2024-02-21T07:53:28.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.874+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9af0003e50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9afc001650 tx=0x7f9af00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43ba3a49dfe47b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.875+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc005270 con 0x7f9af0003a10 2024-02-21T07:53:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.875+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc02e070 con 0x7f9af0003a10 2024-02-21T07:53:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.875+0000 7f9b09600640 1 -- 172.21.15.100:0/2781973504 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc005270 con 0x7f9af0003a10 2024-02-21T07:53:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.876+0000 7f9b11a00640 1 -- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 msgr2=0x7f9af0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.876+0000 7f9b11a00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9af0003e50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9afc001650 tx=0x7f9af00057f0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.877+0000 7f9b11a00640 1 -- 172.21.15.100:0/2781973504 shutdown_connections 2024-02-21T07:53:28.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.877+0000 7f9b11a00640 1 --2- 172.21.15.100:0/2781973504 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9af0003e50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.877+0000 7f9b11a00640 1 -- 172.21.15.100:0/2781973504 >> 172.21.15.100:0/2781973504 conn(0x7f9b0c0d0420 msgr2=0x7f9b0c0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:28.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.878+0000 7f9b11a00640 1 -- 172.21.15.100:0/2781973504 shutdown_connections 2024-02-21T07:53:28.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.878+0000 7f9b11a00640 1 -- 172.21.15.100:0/2781973504 wait complete. 2024-02-21T07:53:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.882+0000 7f9b11a00640 1 Processor -- start 2024-02-21T07:53:28.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.885+0000 7f9b11a00640 1 -- start start 2024-02-21T07:53:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.888+0000 7f9b11a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9b0c0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.888+0000 7f9b11a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 0x7f9b0c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.889+0000 7f9b11a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c21d8f0 0x7f9b0c21dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.889+0000 7f9b11a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c06c120 con 0x7f9b0c1650e0 2024-02-21T07:53:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.889+0000 7f9b11a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c06c390 con 0x7f9af0003a10 2024-02-21T07:53:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.889+0000 7f9b11a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c06c670 con 0x7f9b0c21d8f0 2024-02-21T07:53:28.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.892+0000 7f9b0b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c21d8f0 0x7f9b0c21dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.892+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9b0c0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.892+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 0x7f9b0c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.892+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 0x7f9b0c06d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46824/0 (socket says 172.21.15.100:46824) 2024-02-21T07:53:28.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.892+0000 7f9b0a000640 1 -- 172.21.15.100:0/38213187 learned_addr learned my addr 172.21.15.100:0/38213187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:28.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.895+0000 7f9b0aa00640 1 -- 172.21.15.100:0/38213187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c21d8f0 msgr2=0x7f9b0c21dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.895+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c21d8f0 0x7f9b0c21dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.895+0000 7f9b0aa00640 1 -- 172.21.15.100:0/38213187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 msgr2=0x7f9b0c06d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.895+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 0x7f9b0c06d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.895+0000 7f9b0aa00640 1 -- 172.21.15.100:0/38213187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c06c950 con 0x7f9af0003a10 2024-02-21T07:53:28.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.897+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9b0c0d1550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9afc030000 tx=0x7f9afc000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.898+0000 7f9b02a00640 1 -- 172.21.15.100:0/38213187 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc005270 con 0x7f9af0003a10 2024-02-21T07:53:28.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.898+0000 7f9b02a00640 1 -- 172.21.15.100:0/38213187 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc003a60 con 0x7f9af0003a10 2024-02-21T07:53:28.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.898+0000 7f9b02a00640 1 -- 172.21.15.100:0/38213187 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc003c10 con 0x7f9af0003a10 2024-02-21T07:53:28.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.899+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c06cc30 con 0x7f9af0003a10 2024-02-21T07:53:28.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.899+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c06d970 con 0x7f9af0003a10 2024-02-21T07:53:28.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.906+0000 7f9b02a00640 1 -- 172.21.15.100:0/38213187 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f9afc030030 con 0x7f9af0003a10 2024-02-21T07:53:28.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.908+0000 7f9b147b2740 1 Processor -- start 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.908+0000 7f9b147b2740 1 -- start start 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21b1c0 0x55a6bd21b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd256350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd19b300 con 0x55a6bd21bae0 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd14de50 con 0x55a6bd21b1c0 2024-02-21T07:53:28.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.910+0000 7f9b147b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd14b380 con 0x55a6bd256890 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.911+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.911+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34706/0 (socket says 172.21.15.100:34706) 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.911+0000 7f9b0a000640 1 -- 172.21.15.100:0/1206695826 learned_addr learned my addr 172.21.15.100:0/1206695826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.911+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd256350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.911+0000 7f9b0b400640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21b1c0 0x55a6bd21b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b02a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 0x7f9aec0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0a000640 1 -- 172.21.15.100:0/1206695826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21b1c0 msgr2=0x55a6bd21b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0a000640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21b1c0 0x55a6bd21b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0a000640 1 -- 172.21.15.100:0/1206695826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 msgr2=0x55a6bd256350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0a000640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd256350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b02a00640 1 -- 172.21.15.100:0/38213187 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9afc0eaac0 con 0x7f9af0003a10 2024-02-21T07:53:28.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0b400640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 0x7f9aec0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0a000640 1 -- 172.21.15.100:0/1206695826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6bd10fc80 con 0x55a6bd256890 2024-02-21T07:53:28.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.912+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd256350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.913+0000 7f9b0a000640 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af800b7f0 tx=0x7f9af800bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92815e1a8cc1682 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.913+0000 7f9af7400640 1 -- 172.21.15.100:0/1206695826 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005c40 con 0x55a6bd256890 2024-02-21T07:53:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.913+0000 7f9b0b400640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 0x7f9aec0a16b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c075540 tx=0x7f9b04009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.913+0000 7f9af7400640 1 -- 172.21.15.100:0/1206695826 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8005da0 con 0x55a6bd256890 2024-02-21T07:53:28.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.913+0000 7f9af7400640 1 -- 172.21.15.100:0/1206695826 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800d980 con 0x55a6bd256890 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 -- 172.21.15.100:0/1206695826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 msgr2=0x55a6bd257620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9af800b7f0 tx=0x7f9af800bcb0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 -- 172.21.15.100:0/1206695826 shutdown_connections 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd256890 0x55a6bd257620 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd256350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 --2- 172.21.15.100:0/1206695826 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21b1c0 0x55a6bd21b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 -- 172.21.15.100:0/1206695826 >> 172.21.15.100:0/1206695826 conn(0x55a6bd1dd790 msgr2=0x55a6bd1de810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.914+0000 7f9b147b2740 1 -- 172.21.15.100:0/1206695826 shutdown_connections 2024-02-21T07:53:28.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.915+0000 7f9b147b2740 1 -- 172.21.15.100:0/1206695826 wait complete. 2024-02-21T07:53:28.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.916+0000 7f9b147b2740 1 -- start start 2024-02-21T07:53:28.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.916+0000 7f9b147b2740 1 Processor -- start 2024-02-21T07:53:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 0x55a6bd20fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd20dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd146b60 con 0x55a6bd256890 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd0ebfd0 con 0x55a6bd21bae0 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.918+0000 7f9b147b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd0ebc70 con 0x55a6bd211690 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b147b2740 10 client.0 _ll_register_callbacks cb 0x55a6bce57c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46854/0 (socket says 172.21.15.100:46854) 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 0x55a6bd20fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 -- 172.21.15.100:0/3474854343 learned_addr learned my addr 172.21.15.100:0/3474854343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 -- 172.21.15.100:0/3474854343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 msgr2=0x55a6bd20dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd20dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 -- 172.21.15.100:0/3474854343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 msgr2=0x55a6bd20fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 0x55a6bd20fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0a000640 1 -- 172.21.15.100:0/3474854343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af800e040 con 0x55a6bd256890 2024-02-21T07:53:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.919+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 0x55a6bd20fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.920+0000 7f9b0a000640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9af8014040 tx=0x7f9af80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af69ef8cea3726e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.920+0000 7f9aebe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.920+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8005c40 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.920+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9af8006030 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.921+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6bce46860 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.921+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af80061f0 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.921+0000 7f9b147b2740 10 client.6510 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.921+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a6bd1451e0 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a6bce46860 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9af8006350 con 0x55a6bd256890 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 10 client.6510 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 10 client.6510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 20 client.6510 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd263000 0x55a6bd263410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 4 client.6510 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.922+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6bce97410 con 0x55a6bd263000 2024-02-21T07:53:28.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.923+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd263000 0x55a6bd263410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.924+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd263000 0x55a6bd263410 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd27d0bd4d7b6e6 server_cookie=6d42d03145daf97b in_seq=0 out_seq=0 2024-02-21T07:53:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.924+0000 7f9aebe00640 10 client.6510 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.925+0000 7f9aebe00640 1 -- 172.21.15.100:0/3474854343 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a6bce97410 con 0x55a6bd263000 2024-02-21T07:53:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.925+0000 7f9aebe00640 10 client.6510 handle_command_reply: tid=0 2024-02-21T07:53:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.926+0000 7f9b147b2740 1 client.6510 shutdown 2024-02-21T07:53:28.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.931+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 msgr2=0x55a6bd205d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.931+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9af8014040 tx=0x7f9af80047d0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 shutdown_connections 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd263000 0x55a6bd263410 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd20dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd205d90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 --2- 172.21.15.100:0/3474854343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd21bae0 0x55a6bd20fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9aebe00640 0 client.6510 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.933+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 >> 172.21.15.100:0/3474854343 conn(0x55a6bd21b1c0 msgr2=0x55a6bd1df200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:28.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.936+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 shutdown_connections 2024-02-21T07:53:28.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.936+0000 7f9b147b2740 1 -- 172.21.15.100:0/3474854343 wait complete. 2024-02-21T07:53:28.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.937+0000 7f9b147b2740 20 client.6510 trim_cache size 0 max 16384 2024-02-21T07:53:28.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.968+0000 7f9b147b2740 1 Processor -- start 2024-02-21T07:53:28.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.968+0000 7f9b147b2740 1 -- start start 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd21bae0 0x55a6bd1df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd24b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bce8f0c0 con 0x55a6bd256890 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd1df740 con 0x55a6bd211690 2024-02-21T07:53:28.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.971+0000 7f9b147b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd1dcc50 con 0x55a6bd21bae0 2024-02-21T07:53:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.972+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.972+0000 7f9b0b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd24b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.972+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59588/0 (socket says 172.21.15.100:59588) 2024-02-21T07:53:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.972+0000 7f9b0aa00640 1 -- 172.21.15.100:0/239802968 learned_addr learned my addr 172.21.15.100:0/239802968 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:28.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0aa00640 1 -- 172.21.15.100:0/239802968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd21bae0 msgr2=0x55a6bd1df200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd21bae0 0x55a6bd1df200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0aa00640 1 -- 172.21.15.100:0/239802968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 msgr2=0x55a6bd24b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd24b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0aa00640 1 -- 172.21.15.100:0/239802968 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6bd0e1a90 con 0x55a6bd211690 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.973+0000 7f9b0b400640 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd24b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:28.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.974+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0b85c0 tx=0x7f9afc0e8330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3ef3cc20f4dfb6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.975+0000 7f9af6a00640 1 -- 172.21.15.100:0/239802968 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b7f90 con 0x55a6bd211690 2024-02-21T07:53:28.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.975+0000 7f9af6a00640 1 -- 172.21.15.100:0/239802968 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc0b8d30 con 0x55a6bd211690 2024-02-21T07:53:28.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.975+0000 7f9af6a00640 1 -- 172.21.15.100:0/239802968 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0b8630 con 0x55a6bd211690 2024-02-21T07:53:28.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 -- 172.21.15.100:0/239802968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 msgr2=0x55a6bd2703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9afc0b85c0 tx=0x7f9afc0e8330 comp rx=0 tx=0).stop 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 -- 172.21.15.100:0/239802968 shutdown_connections 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd256890 0x55a6bd24b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd21bae0 0x55a6bd1df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 --2- 172.21.15.100:0/239802968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd211690 0x55a6bd2703d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.976+0000 7f9b147b2740 1 -- 172.21.15.100:0/239802968 >> 172.21.15.100:0/239802968 conn(0x55a6bd21b1c0 msgr2=0x55a6bd205ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:28.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.977+0000 7f9b147b2740 1 -- 172.21.15.100:0/239802968 shutdown_connections 2024-02-21T07:53:28.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.977+0000 7f9b147b2740 1 -- 172.21.15.100:0/239802968 wait complete. 2024-02-21T07:53:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.978+0000 7f9b147b2740 1 -- start start 2024-02-21T07:53:28.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.979+0000 7f9b147b2740 1 Processor -- start 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd1d9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd2b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd256890 0x55a6bd20f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd2bada0 con 0x55a6bd21bae0 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd1d8e60 con 0x55a6bd256890 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6bd2bd980 con 0x55a6bd211690 2024-02-21T07:53:28.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.981+0000 7f9b147b2740 10 client.0 _ll_register_callbacks cb 0x7f9af800b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.982+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd2b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.982+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd1d9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.982+0000 7f9b0aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd1d9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34736/0 (socket says 172.21.15.100:34736) 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.982+0000 7f9b0aa00640 1 -- 172.21.15.100:0/307863086 learned_addr learned my addr 172.21.15.100:0/307863086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 -- 172.21.15.100:0/307863086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 msgr2=0x55a6bd1d9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd1d9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 -- 172.21.15.100:0/307863086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd256890 msgr2=0x55a6bd20f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd256890 0x55a6bd20f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 -- 172.21.15.100:0/307863086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c06cc30 con 0x55a6bd21bae0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9b0a000640 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd2b7b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9af8001eb0 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20933478be67790b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9aebe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.983+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800b460 con 0x55a6bd21bae0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.984+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9af8006000 con 0x55a6bd21bae0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.984+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9af8005da0 con 0x55a6bd21bae0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.984+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af80061c0 con 0x55a6bd21bae0 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.984+0000 7f9b147b2740 10 client.6516 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:28.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.984+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a6bd1076a0 con 0x55a6bd21bae0 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8005da0 con 0x55a6bd21bae0 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9af8006320 con 0x55a6bd21bae0 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 10 client.6516 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 10 client.6516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 20 client.6516 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd2ba410 0x55a6bd211a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 4 client.6516 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:53:28.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.985+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a6bce837b0 con 0x55a6bd2ba410 2024-02-21T07:53:28.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.986+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd2ba410 0x55a6bd211a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:28.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.989+0000 7f9b0aa00640 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd2ba410 0x55a6bd211a90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c1b8854b6cb398 server_cookie=78e47adbdcebdbd8 in_seq=0 out_seq=0 2024-02-21T07:53:28.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.990+0000 7f9aebe00640 10 client.6516 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:28.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.991+0000 7f9aebe00640 1 -- 172.21.15.100:0/307863086 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a6bce837b0 con 0x55a6bd2ba410 2024-02-21T07:53:28.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.991+0000 7f9aebe00640 10 client.6516 handle_command_reply: tid=0 2024-02-21T07:53:28.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.991+0000 7f9b147b2740 1 client.6516 shutdown 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 msgr2=0x55a6bd2b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd2b7b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9af8001eb0 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 shutdown_connections 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a6bd2ba410 0x55a6bd211a90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a6bd256890 0x55a6bd20f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6bd21bae0 0x55a6bd2b7b60 secure :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9af8001eb0 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 --2- 172.21.15.100:0/307863086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a6bd211690 0x55a6bd1d9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 >> 172.21.15.100:0/307863086 conn(0x55a6bd21b1c0 msgr2=0x55a6bd213ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:28.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.995+0000 7f9aebe00640 0 client.6516 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:28.999+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 shutdown_connections 2024-02-21T07:53:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.000+0000 7f9b147b2740 1 -- 172.21.15.100:0/307863086 wait complete. 2024-02-21T07:53:29.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.000+0000 7f9b147b2740 20 client.6516 trim_cache size 0 max 16384 2024-02-21T07:53:29.009 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:53:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:53:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "c431a3b5-826f-4323-ac76-b5f7cf1106b9", 2024-02-21T07:53:29.009 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:53:29.009 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.005+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 msgr2=0x7f9aec0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.005+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 0x7f9aec0a16b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c075540 tx=0x7f9b04009040 comp rx=0 tx=0).stop 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.005+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 msgr2=0x7f9b0c0d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.005+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9b0c0d1550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9afc030000 tx=0x7f9afc000fb0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 shutdown_connections 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b0c21d8f0 0x7f9b0c21dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9aec09f1f0 0x7f9aec0a16b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b0c1650e0 0x7f9b0c06d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 --2- 172.21.15.100:0/38213187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9af0003a10 0x7f9b0c0d1550 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.006+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 >> 172.21.15.100:0/38213187 conn(0x7f9b0c0d0420 msgr2=0x7f9b0c17f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.008+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 shutdown_connections 2024-02-21T07:53:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.008+0000 7f9b11a00640 1 -- 172.21.15.100:0/38213187 wait complete. 2024-02-21T07:53:29.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:53:29.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:53:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.505+0000 7f678aa00640 1 Processor -- start 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.505+0000 7f678aa00640 1 -- start start 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.509+0000 7f678aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f678406d950 0x7f67840710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.509+0000 7f678aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6784071610 0x7f678406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.509+0000 7f678aa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6784071a90 con 0x7f678406e270 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.509+0000 7f678aa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67841943c0 con 0x7f678406d950 2024-02-21T07:53:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.509+0000 7f678aa00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6784193460 con 0x7f6784071610 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.511+0000 7f6788c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6784071610 0x7f678406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.512+0000 7f6789600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f678406d950 0x7f67840710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.512+0000 7f678a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f678406e270 0x7f6784198940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40608/0 (socket says 172.21.15.100:40608) 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.512+0000 7f678a000640 1 -- 172.21.15.100:0/1809296244 learned_addr learned my addr 172.21.15.100:0/1809296244 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.515+0000 7f6783e00640 1 -- 172.21.15.100:0/1809296244 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940655050 0 0) 0x7f6784071a90 con 0x7f678406e270 2024-02-21T07:53:29.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.521+0000 7f6783e00640 1 -- 172.21.15.100:0/1809296244 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f676c003520 con 0x7f678406e270 2024-02-21T07:53:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.521+0000 7f6789600640 1 -- 172.21.15.100:0/1809296244 >> v2:172.21.15.170:3300/0 conn(0x7f6784071610 msgr2=0x7f678406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.521+0000 7f6789600640 1 --2- 172.21.15.100:0/1809296244 >> v2:172.21.15.170:3300/0 conn(0x7f6784071610 0x7f678406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.521+0000 7f6789600640 1 -- 172.21.15.100:0/1809296244 >> v1:172.21.15.100:6789/0 conn(0x7f678406e270 legacy=0x7f6784198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.521+0000 7f6789600640 1 -- 172.21.15.100:0/1809296244 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784193740 con 0x7f678406d950 2024-02-21T07:53:29.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.524+0000 7f6789600640 1 --2- 172.21.15.100:0/1809296244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406d950 0x7f67840710d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6784074ae0 tx=0x7f677802fe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bd01114e320ca2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.525+0000 7f6783e00640 1 -- 172.21.15.100:0/1809296244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778030be0 con 0x7f678406d950 2024-02-21T07:53:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.525+0000 7f6783e00640 1 -- 172.21.15.100:0/1809296244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778030d40 con 0x7f678406d950 2024-02-21T07:53:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.525+0000 7f6783e00640 1 -- 172.21.15.100:0/1809296244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778030be0 con 0x7f678406d950 2024-02-21T07:53:29.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.526+0000 7f678aa00640 1 -- 172.21.15.100:0/1809296244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406d950 msgr2=0x7f67840710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.526+0000 7f678aa00640 1 --2- 172.21.15.100:0/1809296244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406d950 0x7f67840710d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6784074ae0 tx=0x7f677802fe30 comp rx=0 tx=0).stop 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 -- 172.21.15.100:0/1809296244 shutdown_connections 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 --2- 172.21.15.100:0/1809296244 >> v2:172.21.15.170:3300/0 conn(0x7f6784071610 0x7f678406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 --2- 172.21.15.100:0/1809296244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406d950 0x7f67840710d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 -- 172.21.15.100:0/1809296244 >> 172.21.15.100:0/1809296244 conn(0x7f67840ce150 msgr2=0x7f67840ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 -- 172.21.15.100:0/1809296244 shutdown_connections 2024-02-21T07:53:29.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.527+0000 7f678aa00640 1 -- 172.21.15.100:0/1809296244 wait complete. 2024-02-21T07:53:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.531+0000 7f678aa00640 1 Processor -- start 2024-02-21T07:53:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.532+0000 7f678aa00640 1 -- start start 2024-02-21T07:53:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.534+0000 7f678aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 0x7f67841880c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f678aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 0x7f67840f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f678aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 0x7f67840f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f6789600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 0x7f67841880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f6789600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 0x7f67841880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34760/0 (socket says 172.21.15.100:34760) 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840f45a0 con 0x7f678406e270 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784195cf0 con 0x7f6784071610 2024-02-21T07:53:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.535+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6784195fd0 con 0x7f678406d950 2024-02-21T07:53:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6789600640 1 -- 172.21.15.100:0/1751077385 learned_addr learned my addr 172.21.15.100:0/1751077385 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 0x7f67840f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f678a000640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 0x7f67840f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 -- 172.21.15.100:0/1751077385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 msgr2=0x7f67841880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 0x7f67841880c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 -- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 msgr2=0x7f67840f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 0x7f67840f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f6788c00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778008480 con 0x7f678406e270 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.536+0000 7f678a000640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 0x7f67840f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.537+0000 7f6788c00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 0x7f67840f36d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f677400d990 tx=0x7f677400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.537+0000 7f6781600640 1 -- 172.21.15.100:0/1751077385 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774007a90 con 0x7f678406e270 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.537+0000 7f6781600640 1 -- 172.21.15.100:0/1751077385 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774007bf0 con 0x7f678406e270 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.537+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67841962b0 con 0x7f678406e270 2024-02-21T07:53:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.537+0000 7f6781600640 1 -- 172.21.15.100:0/1751077385 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774010470 con 0x7f678406e270 2024-02-21T07:53:29.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.538+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6784196590 con 0x7f678406e270 2024-02-21T07:53:29.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.544+0000 7f678ec75740 1 Processor -- start 2024-02-21T07:53:29.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.545+0000 7f678ec75740 1 -- start start 2024-02-21T07:53:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25be3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 0x55ca25b710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25ae5150 con 0x55ca25be4150 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25ae2680 con 0x55ca25baeab0 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.546+0000 7f678ec75740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25adde60 con 0x55ca25bae190 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6788c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 0x55ca25b710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46892/0 (socket says 172.21.15.100:46892) 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 -- 172.21.15.100:0/4116923903 learned_addr learned my addr 172.21.15.100:0/4116923903 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6781600640 1 -- 172.21.15.100:0/1751077385 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f67740105d0 con 0x7f678406e270 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 -- 172.21.15.100:0/4116923903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 msgr2=0x55ca25be3c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:29.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25be3c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.547+0000 7f6789600640 1 -- 172.21.15.100:0/4116923903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 msgr2=0x55ca25b710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f6789600640 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 0x55ca25b710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f6789600640 1 -- 172.21.15.100:0/4116923903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca25a97060 con 0x55ca25be4150 2024-02-21T07:53:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f6781600640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 0x7f67680a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f6788c00640 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 0x55ca25b710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:29.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f6781600640 1 -- 172.21.15.100:0/1751077385 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f67740c9fa0 con 0x7f678406e270 2024-02-21T07:53:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.550+0000 7f678a000640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 0x7f67680a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.551+0000 7f678a000640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 0x7f67680a1610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f677c005c00 tx=0x7f677c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.551+0000 7f6789600640 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f67780088e0 tx=0x7f6778032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d6ac850a5948de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.552+0000 7f6771c00640 1 -- 172.21.15.100:0/4116923903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67780309e0 con 0x55ca25be4150 2024-02-21T07:53:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.552+0000 7f6771c00640 1 -- 172.21.15.100:0/4116923903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6778030b40 con 0x55ca25be4150 2024-02-21T07:53:29.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.552+0000 7f6771c00640 1 -- 172.21.15.100:0/4116923903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778004240 con 0x55ca25be4150 2024-02-21T07:53:29.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.553+0000 7f678ec75740 1 -- 172.21.15.100:0/4116923903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 msgr2=0x55ca25bae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.553+0000 7f678ec75740 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f67780088e0 tx=0x7f6778032000 comp rx=0 tx=0).stop 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 -- 172.21.15.100:0/4116923903 shutdown_connections 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25baeab0 0x55ca25b710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25be4150 0x55ca25bae570 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 --2- 172.21.15.100:0/4116923903 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25be3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 -- 172.21.15.100:0/4116923903 >> 172.21.15.100:0/4116923903 conn(0x55ca25b3d5a0 msgr2=0x55ca25b75080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 -- 172.21.15.100:0/4116923903 shutdown_connections 2024-02-21T07:53:29.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.554+0000 7f678ec75740 1 -- 172.21.15.100:0/4116923903 wait complete. 2024-02-21T07:53:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.556+0000 7f678ec75740 1 -- start start 2024-02-21T07:53:29.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.556+0000 7f678ec75740 1 Processor -- start 2024-02-21T07:53:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.559+0000 7f678ec75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.559+0000 7f678ec75740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25be16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.559+0000 7f678ec75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25bb6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.559+0000 7f678ec75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25a82ec0 con 0x55ca25bae190 2024-02-21T07:53:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.559+0000 7f678ec75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25a82b60 con 0x55ca25be4150 2024-02-21T07:53:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.560+0000 7f678ec75740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2584c1c0 con 0x55ca25baeab0 2024-02-21T07:53:29.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.560+0000 7f678ec75740 10 client.0 _ll_register_callbacks cb 0x55ca25a96960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:29.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.561+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.562+0000 7f678a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25bb6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.563+0000 7f678a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25bb6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:59628/0 (socket says 172.21.15.100:59628) 2024-02-21T07:53:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.563+0000 7f678a000640 1 -- 172.21.15.100:0/4057694979 learned_addr learned my addr 172.21.15.100:0/4057694979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.561+0000 7f6788c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25be16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.563+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46908/0 (socket says 172.21.15.100:46908) 2024-02-21T07:53:29.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.567+0000 7f6789600640 1 -- 172.21.15.100:0/4057694979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 msgr2=0x55ca25be16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.567+0000 7f6789600640 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25be16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.567+0000 7f6789600640 1 -- 172.21.15.100:0/4057694979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 msgr2=0x55ca25bb6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.567+0000 7f6789600640 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25bb6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.567+0000 7f6789600640 1 -- 172.21.15.100:0/4057694979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6784193740 con 0x55ca25bae190 2024-02-21T07:53:29.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.569+0000 7f6789600640 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6778045000 tx=0x7f6778004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d31ddc414e61850 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.569+0000 7f6766000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:53:29.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.570+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778005b90 con 0x55ca25bae190 2024-02-21T07:53:29.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.570+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca257dd7e0 con 0x55ca25bae190 2024-02-21T07:53:29.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.570+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6778005cf0 con 0x55ca25bae190 2024-02-21T07:53:29.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.571+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6778003610 con 0x55ca25bae190 2024-02-21T07:53:29.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.571+0000 7f678ec75740 10 client.6531 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:29.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.571+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca25adc4e0 con 0x55ca25bae190 2024-02-21T07:53:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.572+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca257dd7e0 con 0x55ca25bae190 2024-02-21T07:53:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.572+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6778003770 con 0x55ca25bae190 2024-02-21T07:53:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 10 client.6531 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:29.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 10 client.6531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 20 client.6531 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba4130 0x55ca25be1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 4 client.6531 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.577+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca2581a720 con 0x55ca25ba4130 2024-02-21T07:53:29.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.578+0000 7f6788c00640 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba4130 0x55ca25be1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.579+0000 7f6788c00640 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba4130 0x55ca25be1000 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0bfa47f08ae9f0 server_cookie=1c9ffaa8a3834ede in_seq=0 out_seq=0 2024-02-21T07:53:29.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.581+0000 7f6766000640 10 client.6531 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.581+0000 7f6766000640 1 -- 172.21.15.100:0/4057694979 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca2581a720 con 0x55ca25ba4130 2024-02-21T07:53:29.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.581+0000 7f6766000640 10 client.6531 handle_command_reply: tid=0 2024-02-21T07:53:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.582+0000 7f678ec75740 1 client.6531 shutdown 2024-02-21T07:53:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.583+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 msgr2=0x55ca25bf4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.583+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6778045000 tx=0x7f6778004730 comp rx=0 tx=0).stop 2024-02-21T07:53:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 shutdown_connections 2024-02-21T07:53:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba4130 0x55ca25be1000 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25bb6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25be16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 --2- 172.21.15.100:0/4057694979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bf4670 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 >> 172.21.15.100:0/4057694979 conn(0x55ca25b3d5a0 msgr2=0x55ca25b75a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.585+0000 7f6766000640 0 client.6531 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:29.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.590+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 shutdown_connections 2024-02-21T07:53:29.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.593+0000 7f678ec75740 1 -- 172.21.15.100:0/4057694979 wait complete. 2024-02-21T07:53:29.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.594+0000 7f678ec75740 20 client.6531 trim_cache size 0 max 16384 2024-02-21T07:53:29.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.676+0000 7f678ec75740 1 Processor -- start 2024-02-21T07:53:29.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.678+0000 7f678ec75740 1 -- start start 2024-02-21T07:53:29.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.683+0000 7f678ec75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.684+0000 7f678ec75740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25c4a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.685+0000 7f678ec75740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c4ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.686+0000 7f678ec75740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25bdfca0 con 0x55ca25bae190 2024-02-21T07:53:29.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.686+0000 7f678ec75740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25b740a0 con 0x55ca25be4150 2024-02-21T07:53:29.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.686+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f6788c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25c4a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f6789600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46916/0 (socket says 172.21.15.100:46916) 2024-02-21T07:53:29.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f678ec75740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25b73930 con 0x55ca25baeab0 2024-02-21T07:53:29.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f6788c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25c4a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34794/0 (socket says 172.21.15.100:34794) 2024-02-21T07:53:29.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f6788c00640 1 -- 172.21.15.100:0/56815065 learned_addr learned my addr 172.21.15.100:0/56815065 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:29.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.687+0000 7f678a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c4ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.688+0000 7f678a000640 1 -- 172.21.15.100:0/56815065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 msgr2=0x55ca25c4a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.688+0000 7f678a000640 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25c4a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.690+0000 7f678a000640 1 -- 172.21.15.100:0/56815065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 msgr2=0x55ca25bb7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.690+0000 7f678a000640 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.690+0000 7f678a000640 1 -- 172.21.15.100:0/56815065 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca25a78950 con 0x55ca25be4150 2024-02-21T07:53:29.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.690+0000 7f6789600640 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:29.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.694+0000 7f678a000640 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c4ace0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55ca25ba84c0 tx=0x7f677c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37beeb60cfa36985 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.694+0000 7f6771200640 1 -- 172.21.15.100:0/56815065 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c007870 con 0x55ca25be4150 2024-02-21T07:53:29.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.694+0000 7f6771200640 1 -- 172.21.15.100:0/56815065 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0079d0 con 0x55ca25be4150 2024-02-21T07:53:29.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.695+0000 7f678ec75740 1 -- 172.21.15.100:0/56815065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 msgr2=0x55ca25c4ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f6771200640 1 -- 172.21.15.100:0/56815065 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c007870 con 0x55ca25be4150 2024-02-21T07:53:29.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c4ace0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x55ca25ba84c0 tx=0x7f677c011000 comp rx=0 tx=0).stop 2024-02-21T07:53:29.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 -- 172.21.15.100:0/56815065 shutdown_connections 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c4ace0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25baeab0 0x55ca25c4a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 --2- 172.21.15.100:0/56815065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25bae190 0x55ca25bb7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 -- 172.21.15.100:0/56815065 >> 172.21.15.100:0/56815065 conn(0x55ca25b3d5a0 msgr2=0x55ca25bdf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.696+0000 7f678ec75740 1 -- 172.21.15.100:0/56815065 shutdown_connections 2024-02-21T07:53:29.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.697+0000 7f678ec75740 1 -- 172.21.15.100:0/56815065 wait complete. 2024-02-21T07:53:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.701+0000 7f678ec75740 1 -- start start 2024-02-21T07:53:29.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.701+0000 7f678ec75740 1 Processor -- start 2024-02-21T07:53:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.703+0000 7f678ec75740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.704+0000 7f678ec75740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 0x55ca25c379f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.704+0000 7f6789600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.704+0000 7f6789600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34810/0 (socket says 172.21.15.100:34810) 2024-02-21T07:53:29.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.705+0000 7f6789600640 1 -- 172.21.15.100:0/2112363949 learned_addr learned my addr 172.21.15.100:0/2112363949 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:29.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.705+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c54490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.707+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25be8880 con 0x55ca25baeab0 2024-02-21T07:53:29.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.707+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25b73d50 con 0x55ca25be4150 2024-02-21T07:53:29.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.707+0000 7f678a000640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c54490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.707+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca25bb7050 con 0x55ca25bae190 2024-02-21T07:53:29.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.707+0000 7f6788c00640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 0x55ca25c379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.709+0000 7f678a000640 1 -- 172.21.15.100:0/2112363949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 msgr2=0x55ca25bb5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.709+0000 7f678ec75740 10 client.0 _ll_register_callbacks cb 0x7f67780086a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.709+0000 7f678a000640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.709+0000 7f678a000640 1 -- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 msgr2=0x55ca25c379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:29.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.710+0000 7f678a000640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 0x55ca25c379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.710+0000 7f678a000640 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c00f040 con 0x55ca25be4150 2024-02-21T07:53:29.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.710+0000 7f6789600640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:29.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.710+0000 7f6788c00640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 0x55ca25c379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:29.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.713+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6778030b40 con 0x55ca25be4150 2024-02-21T07:53:29.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.713+0000 7f6766000640 10 client.6715 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.713+0000 7f678a000640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c54490 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f677c017000 tx=0x7f677c001420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6636034a2f4d827a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.713+0000 7f6766000640 1 -- 172.21.15.100:0/2112363949 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c013860 con 0x55ca25be4150 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.714+0000 7f6766000640 1 -- 172.21.15.100:0/2112363949 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f677c0139c0 con 0x55ca25be4150 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.714+0000 7f6766000640 1 -- 172.21.15.100:0/2112363949 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f677c013860 con 0x55ca25be4150 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.714+0000 7f678ec75740 10 client.6715 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:29.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.714+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x55ca25a9e430 con 0x55ca25be4150 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.715+0000 7f6766000640 1 -- 172.21.15.100:0/2112363949 <== mon.1 v2:172.21.15.156:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f677c020070 con 0x55ca25be4150 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.715+0000 7f678ec75740 10 client.6715 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.715+0000 7f678ec75740 10 client.6715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.715+0000 7f678ec75740 20 client.6715 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.715+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba3d30 0x55ca25c549d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.716+0000 7f678ec75740 4 client.6715 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:53:29.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.716+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca25869890 con 0x55ca25ba3d30 2024-02-21T07:53:29.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.717+0000 7f6789600640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba3d30 0x55ca25c549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:29.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.718+0000 7f6789600640 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba3d30 0x55ca25c549d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d5633fc37cf05 server_cookie=54d0eb09ecab6c7d in_seq=0 out_seq=0 2024-02-21T07:53:29.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.718+0000 7f6766000640 10 client.6715 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:29.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.718+0000 7f6766000640 1 -- 172.21.15.100:0/2112363949 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ca25869890 con 0x55ca25ba3d30 2024-02-21T07:53:29.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.718+0000 7f6766000640 10 client.6715 handle_command_reply: tid=0 2024-02-21T07:53:29.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.719+0000 7f678ec75740 1 client.6715 shutdown 2024-02-21T07:53:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.719+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 msgr2=0x55ca25c54490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.719+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c54490 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f677c017000 tx=0x7f677c001420 comp rx=0 tx=0).stop 2024-02-21T07:53:29.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.719+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 shutdown_connections 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca25ba3d30 0x55ca25c549d0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca25be4150 0x55ca25c54490 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca25baeab0 0x55ca25c379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f678ec75740 1 --2- 172.21.15.100:0/2112363949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca25bae190 0x55ca25bb5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 >> 172.21.15.100:0/2112363949 conn(0x55ca25b3d5a0 msgr2=0x55ca25c06840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.720+0000 7f6766000640 0 client.6715 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.721+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 shutdown_connections 2024-02-21T07:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.721+0000 7f678ec75740 1 -- 172.21.15.100:0/2112363949 wait complete. 2024-02-21T07:53:29.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.721+0000 7f678ec75740 20 client.6715 trim_cache size 0 max 16384 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "c431a3b5-826f-4323-ac76-b5f7cf1106b9": { 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "c431a3b5-826f-4323-ac76-b5f7cf1106b9", 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:53:29.728 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:53:29.729 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:53:29.729 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:53:29.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.729+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 msgr2=0x7f67680a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.729+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 0x7f67680a1610 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f677c005c00 tx=0x7f677c009040 comp rx=0 tx=0).stop 2024-02-21T07:53:29.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.729+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 msgr2=0x7f67840f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:29.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.729+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 0x7f67840f36d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f677400d990 tx=0x7f677400de50 comp rx=0 tx=0).stop 2024-02-21T07:53:29.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 shutdown_connections 2024-02-21T07:53:29.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6784071610 0x7f67840f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f676809f150 0x7f67680a1610 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f678406e270 0x7f67840f36d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 --2- 172.21.15.100:0/1751077385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f678406d950 0x7f67841880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.730+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 >> 172.21.15.100:0/1751077385 conn(0x7f67840ce150 msgr2=0x7f67840f9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.731+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 shutdown_connections 2024-02-21T07:53:29.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:53:29.731+0000 7f678aa00640 1 -- 172.21.15.100:0/1751077385 wait complete. 2024-02-21T07:53:29.771 INFO:tasks.cephfs.filesystem:scrub status for tag:c431a3b5-826f-4323-ac76-b5f7cf1106b9 - {'path': '/', 'tag': 'c431a3b5-826f-4323-ac76-b5f7cf1106b9', 'options': 'recursive,force'} 2024-02-21T07:53:38.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.064+0000 7fc25aa00640 1 Processor -- start 2024-02-21T07:53:38.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.064+0000 7fc25aa00640 1 -- start start 2024-02-21T07:53:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.069+0000 7fc25aa00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 0x7fc2540cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.069+0000 7fc25aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2540f61d0 0x7fc2540cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.069+0000 7fc25aa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2540cc0e0 con 0x7fc25418cbd0 2024-02-21T07:53:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.069+0000 7fc25aa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2541911b0 con 0x7fc2540f61d0 2024-02-21T07:53:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.069+0000 7fc25aa00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2540cc380 con 0x7fc25418a590 2024-02-21T07:53:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.071+0000 7fc253400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2540f61d0 0x7fc2540cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.071+0000 7fc253400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2540f61d0 0x7fc2540cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51012/0 (socket says 172.21.15.100:51012) 2024-02-21T07:53:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.071+0000 7fc253400640 1 -- 172.21.15.100:0/3454383033 learned_addr learned my addr 172.21.15.100:0/3454383033 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.072+0000 7fc253400640 1 -- 172.21.15.100:0/3454383033 >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 msgr2=0x7fc2540cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.072+0000 7fc253e00640 1 --2- 172.21.15.100:0/3454383033 >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 0x7fc2540cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.072+0000 7fc253400640 1 --2- 172.21.15.100:0/3454383033 >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 0x7fc2540cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.072+0000 7fc253400640 1 -- 172.21.15.100:0/3454383033 >> v1:172.21.15.100:6789/0 conn(0x7fc25418cbd0 legacy=0x7fc25418d000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.074+0000 7fc253400640 1 -- 172.21.15.100:0/3454383033 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2540cc660 con 0x7fc2540f61d0 2024-02-21T07:53:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.075+0000 7fc253e00640 1 --2- 172.21.15.100:0/3454383033 >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 0x7fc2540cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.076+0000 7fc253400640 1 --2- 172.21.15.100:0/3454383033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2540cd960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc25408e040 tx=0x7fc24002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0d04d1193b5c02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.077+0000 7fc252a00640 1 -- 172.21.15.100:0/3454383033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240031750 con 0x7fc2540f61d0 2024-02-21T07:53:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.078+0000 7fc252a00640 1 -- 172.21.15.100:0/3454383033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2400318b0 con 0x7fc2540f61d0 2024-02-21T07:53:38.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.078+0000 7fc252a00640 1 -- 172.21.15.100:0/3454383033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240031c40 con 0x7fc2540f61d0 2024-02-21T07:53:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.079+0000 7fc25aa00640 1 -- 172.21.15.100:0/3454383033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 msgr2=0x7fc2540cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.079+0000 7fc25aa00640 1 --2- 172.21.15.100:0/3454383033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2540cd960 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc25408e040 tx=0x7fc24002b7f0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.080+0000 7fc25aa00640 1 -- 172.21.15.100:0/3454383033 shutdown_connections 2024-02-21T07:53:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.080+0000 7fc25aa00640 1 --2- 172.21.15.100:0/3454383033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2540cd960 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.080+0000 7fc25aa00640 1 --2- 172.21.15.100:0/3454383033 >> v2:172.21.15.156:3300/0 conn(0x7fc25418a590 0x7fc2540cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.080+0000 7fc25aa00640 1 -- 172.21.15.100:0/3454383033 >> 172.21.15.100:0/3454383033 conn(0x7fc2540ce1b0 msgr2=0x7fc2540ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.081+0000 7fc25aa00640 1 -- 172.21.15.100:0/3454383033 shutdown_connections 2024-02-21T07:53:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.081+0000 7fc25aa00640 1 -- 172.21.15.100:0/3454383033 wait complete. 2024-02-21T07:53:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.084+0000 7fc25aa00640 1 Processor -- start 2024-02-21T07:53:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.084+0000 7fc25aa00640 1 -- start start 2024-02-21T07:53:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2541720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25418cbd0 0x7fc254224480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254172630 con 0x7fc2540f61d0 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc254181500 con 0x7fc25418cbd0 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.086+0000 7fc25aa00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2541817e0 con 0x7fc25418a590 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54358/0 (socket says 172.21.15.100:54358) 2024-02-21T07:53:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 -- 172.21.15.100:0/742565150 learned_addr learned my addr 172.21.15.100:0/742565150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253e00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2541720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 -- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25418cbd0 msgr2=0x7fc254224480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25418cbd0 0x7fc254224480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 -- 172.21.15.100:0/742565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 msgr2=0x7fc2541720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2541720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.087+0000 7fc253400640 1 -- 172.21.15.100:0/742565150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400094d0 con 0x7fc25418a590 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.088+0000 7fc253400640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc240000c00 tx=0x7fc2400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.088+0000 7fc24be00640 1 -- 172.21.15.100:0/742565150 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240033c80 con 0x7fc25418a590 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.089+0000 7fc24be00640 1 -- 172.21.15.100:0/742565150 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240033e00 con 0x7fc25418a590 2024-02-21T07:53:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.089+0000 7fc24be00640 1 -- 172.21.15.100:0/742565150 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24003c640 con 0x7fc25418a590 2024-02-21T07:53:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.089+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc254181ac0 con 0x7fc25418a590 2024-02-21T07:53:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.089+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc254182080 con 0x7fc25418a590 2024-02-21T07:53:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.099+0000 7fc24be00640 1 -- 172.21.15.100:0/742565150 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc24003a040 con 0x7fc25418a590 2024-02-21T07:53:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.101+0000 7fc24be00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 0x7fc2340a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.102+0000 7fc25d804740 1 Processor -- start 2024-02-21T07:53:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.102+0000 7fc253e00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 0x7fc2340a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.102+0000 7fc25d804740 1 -- start start 2024-02-21T07:53:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c50070 0x55e963c0f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.107 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c50450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963bd0620 con 0x55e963c844d0 2024-02-21T07:53:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963b828c0 con 0x55e963c50070 2024-02-21T07:53:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc25d804740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963b7fdf0 con 0x55e963c14f90 2024-02-21T07:53:38.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc253400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc253400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51036/0 (socket says 172.21.15.100:51036) 2024-02-21T07:53:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.104+0000 7fc253400640 1 -- 172.21.15.100:0/3388331975 learned_addr learned my addr 172.21.15.100:0/3388331975 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.107+0000 7fc253400640 1 -- 172.21.15.100:0/3388331975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 msgr2=0x55e963c50450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.107+0000 7fc253400640 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c50450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.107+0000 7fc253400640 1 -- 172.21.15.100:0/3388331975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c50070 msgr2=0x55e963c0f440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.107+0000 7fc253400640 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c50070 0x55e963c0f440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.107+0000 7fc253400640 1 -- 172.21.15.100:0/3388331975 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e963afcb00 con 0x55e963c844d0 2024-02-21T07:53:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.109+0000 7fc24be00640 1 -- 172.21.15.100:0/742565150 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc2400eb830 con 0x7fc25418a590 2024-02-21T07:53:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.109+0000 7fc253e00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 0x7fc2340a16b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc254220910 tx=0x7fc244008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.110+0000 7fc253400640 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc2400e9110 tx=0x7fc2400b9be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efac909c95e9c52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.110+0000 7fc23fe00640 1 -- 172.21.15.100:0/3388331975 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400d2020 con 0x55e963c844d0 2024-02-21T07:53:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.111+0000 7fc23fe00640 1 -- 172.21.15.100:0/3388331975 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2400d3040 con 0x55e963c844d0 2024-02-21T07:53:38.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.111+0000 7fc23fe00640 1 -- 172.21.15.100:0/3388331975 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400b9420 con 0x55e963c844d0 2024-02-21T07:53:38.114 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.112+0000 7fc25d804740 1 -- 172.21.15.100:0/3388331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 msgr2=0x55e963c14a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.112+0000 7fc25d804740 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc2400e9110 tx=0x7fc2400b9be0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.127+0000 7fc25d804740 1 -- 172.21.15.100:0/3388331975 shutdown_connections 2024-02-21T07:53:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.127+0000 7fc25d804740 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c50450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.127+0000 7fc25d804740 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c844d0 0x55e963c14a50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.127+0000 7fc25d804740 1 --2- 172.21.15.100:0/3388331975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c50070 0x55e963c0f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.127+0000 7fc25d804740 1 -- 172.21.15.100:0/3388331975 >> 172.21.15.100:0/3388331975 conn(0x55e963bdc4b0 msgr2=0x55e963c13ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.129+0000 7fc25d804740 1 -- 172.21.15.100:0/3388331975 shutdown_connections 2024-02-21T07:53:38.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.129+0000 7fc25d804740 1 -- 172.21.15.100:0/3388331975 wait complete. 2024-02-21T07:53:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.130+0000 7fc25d804740 1 -- start start 2024-02-21T07:53:38.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.131+0000 7fc25d804740 1 Processor -- start 2024-02-21T07:53:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.144+0000 7fc25d804740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963c41d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.150+0000 7fc25d804740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c863f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.151+0000 7fc25d804740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c7a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.151+0000 7fc25d804740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963b7b5d0 con 0x55e963c14f90 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.151+0000 7fc25d804740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963b20b50 con 0x55e963c844d0 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.151+0000 7fc25d804740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963b207f0 con 0x55e963c50070 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.152+0000 7fc25d804740 10 client.0 _ll_register_callbacks cb 0x55e963b34550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.152+0000 7fc258a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c7a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.150+0000 7fc253400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c863f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.152+0000 7fc258a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c7a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54786/0 (socket says 172.21.15.100:54786) 2024-02-21T07:53:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.152+0000 7fc258a00640 1 -- 172.21.15.100:0/204298194 learned_addr learned my addr 172.21.15.100:0/204298194 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.153+0000 7fc253e00640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963c41d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.155+0000 7fc253400640 1 -- 172.21.15.100:0/204298194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 msgr2=0x55e963c7a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.155+0000 7fc253400640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c7a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.155+0000 7fc253400640 1 -- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 msgr2=0x55e963c41d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.158+0000 7fc253400640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963c41d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.158+0000 7fc253400640 1 -- 172.21.15.100:0/204298194 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc254182080 con 0x55e963c50070 2024-02-21T07:53:38.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.159+0000 7fc253e00640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963c41d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:38.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.161+0000 7fc253400640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c863f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2400cf000 tx=0x7fc2400ce000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c051450eadd7b773 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.162+0000 7fc23cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:53:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.164+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400bd4f0 con 0x55e963c50070 2024-02-21T07:53:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.164+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc2400e1070 con 0x55e963c50070 2024-02-21T07:53:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.164+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e963b4dcd0 con 0x55e963c50070 2024-02-21T07:53:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.166+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2400c1ab0 con 0x55e963c50070 2024-02-21T07:53:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.175+0000 7fc25d804740 10 client.6662 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.175+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e963b79c50 con 0x55e963c50070 2024-02-21T07:53:38.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.175+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2400b93a0 con 0x55e963c50070 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc24004f020 con 0x55e963c50070 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 10 client.6662 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 10 client.6662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 20 client.6662 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963c0f350 0x55e963c0f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 4 client.6662 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.178+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e963b4dcd0 con 0x55e963c0f350 2024-02-21T07:53:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.179+0000 7fc253e00640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963c0f350 0x55e963c0f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.184+0000 7fc253e00640 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963c0f350 0x55e963c0f730 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e9050e7af4ad94 server_cookie=498de890e10b4f8 in_seq=0 out_seq=0 2024-02-21T07:53:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.185+0000 7fc23cc00640 10 client.6662 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.185+0000 7fc23cc00640 1 -- 172.21.15.100:0/204298194 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e963b4dcd0 con 0x55e963c0f350 2024-02-21T07:53:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.185+0000 7fc23cc00640 10 client.6662 handle_command_reply: tid=0 2024-02-21T07:53:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.187+0000 7fc25d804740 1 client.6662 shutdown 2024-02-21T07:53:38.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 msgr2=0x55e963c863f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c863f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc2400cf000 tx=0x7fc2400ce000 comp rx=0 tx=0).stop 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 shutdown_connections 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963c0f350 0x55e963c0f730 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c7a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c863f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 --2- 172.21.15.100:0/204298194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963c41d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 >> 172.21.15.100:0/204298194 conn(0x55e963bdc4b0 msgr2=0x55e963c1ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.193+0000 7fc23cc00640 0 client.6662 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:38.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.194+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 shutdown_connections 2024-02-21T07:53:38.197 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.195+0000 7fc25d804740 1 -- 172.21.15.100:0/204298194 wait complete. 2024-02-21T07:53:38.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.196+0000 7fc25d804740 20 client.6662 trim_cache size 0 max 16384 2024-02-21T07:53:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.242+0000 7fc25d804740 1 Processor -- start 2024-02-21T07:53:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.243+0000 7fc25d804740 1 -- start start 2024-02-21T07:53:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.247+0000 7fc25d804740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.248+0000 7fc25d804740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 0x55e963c41820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.248+0000 7fc253e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.248+0000 7fc253e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54372/0 (socket says 172.21.15.100:54372) 2024-02-21T07:53:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.248+0000 7fc253e00640 1 -- 172.21.15.100:0/2555554418 learned_addr learned my addr 172.21.15.100:0/2555554418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.249+0000 7fc25d804740 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963ca4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.249+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9638c3e60 con 0x55e963c50070 2024-02-21T07:53:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.249+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963c828b0 con 0x55e963c844d0 2024-02-21T07:53:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.250+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963c42a10 con 0x55e963c14f90 2024-02-21T07:53:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.250+0000 7fc253400640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 0x55e963c41820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.251+0000 7fc258a00640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963ca4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc253400640 1 -- 172.21.15.100:0/2555554418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 msgr2=0x55e963c863d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc253400640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc253400640 1 -- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 msgr2=0x55e963ca4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc253400640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963ca4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc253400640 1 -- 172.21.15.100:0/2555554418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e963b16530 con 0x55e963c50070 2024-02-21T07:53:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.252+0000 7fc258a00640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963ca4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:53:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.254+0000 7fc253e00640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:53:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.254+0000 7fc253400640 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 0x55e963c41820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b9f20 tx=0x7fc240043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee1a5dbe51aed84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.257+0000 7fc23f400640 1 -- 172.21.15.100:0/2555554418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400d2020 con 0x55e963c50070 2024-02-21T07:53:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.257+0000 7fc23f400640 1 -- 172.21.15.100:0/2555554418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24003c7a0 con 0x55e963c50070 2024-02-21T07:53:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.257+0000 7fc23f400640 1 -- 172.21.15.100:0/2555554418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400b9170 con 0x55e963c50070 2024-02-21T07:53:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.259+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 msgr2=0x55e963c41820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.259+0000 7fc25d804740 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 0x55e963c41820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b9f20 tx=0x7fc240043000 comp rx=0 tx=0).stop 2024-02-21T07:53:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.259+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 shutdown_connections 2024-02-21T07:53:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963ca4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c50070 0x55e963c41820 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 --2- 172.21.15.100:0/2555554418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c14f90 0x55e963c863d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 >> 172.21.15.100:0/2555554418 conn(0x55e963bdc4b0 msgr2=0x55e963c0abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 shutdown_connections 2024-02-21T07:53:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.260+0000 7fc25d804740 1 -- 172.21.15.100:0/2555554418 wait complete. 2024-02-21T07:53:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.264+0000 7fc25d804740 1 -- start start 2024-02-21T07:53:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.264+0000 7fc25d804740 1 Processor -- start 2024-02-21T07:53:38.273 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963ce41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c13c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c86070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963c53190 con 0x55e963c14f90 2024-02-21T07:53:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963c806d0 con 0x55e963c844d0 2024-02-21T07:53:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e963ce4720 con 0x55e963c50070 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.271+0000 7fc25d804740 10 client.0 _ll_register_callbacks cb 0x7fc2400b8ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc253400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c13c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc253400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c13c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54388/0 (socket says 172.21.15.100:54388) 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc253400640 1 -- 172.21.15.100:0/1908296879 learned_addr learned my addr 172.21.15.100:0/1908296879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c86070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 -- 172.21.15.100:0/1908296879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 msgr2=0x55e963c13c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c13c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 -- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 msgr2=0x55e963ce41e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963ce41e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.272+0000 7fc258a00640 1 -- 172.21.15.100:0/1908296879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e963b79c50 con 0x55e963c844d0 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.273+0000 7fc258a00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c86070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55e963c12fb0 tx=0x7fc24c00af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb078a98cc1ee37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.273+0000 7fc23cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.275+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c01a070 con 0x55e963c844d0 2024-02-21T07:53:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.275+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc24c007b70 con 0x55e963c844d0 2024-02-21T07:53:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.275+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e963b71ce0 con 0x55e963c844d0 2024-02-21T07:53:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.276+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc24c010050 con 0x55e963c844d0 2024-02-21T07:53:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.276+0000 7fc25d804740 10 client.6724 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.276+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e963b3c2c0 con 0x55e963c844d0 2024-02-21T07:53:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.280+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e963b71ce0 con 0x55e963c844d0 2024-02-21T07:53:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.280+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc24c01d030 con 0x55e963c844d0 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 10 client.6724 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 10 client.6724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 20 client.6724 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963ce4930 0x55e963c83430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 4 client.6724 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:53:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.281+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e96387b600 con 0x55e963ce4930 2024-02-21T07:53:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.286+0000 7fc253e00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963ce4930 0x55e963c83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.287+0000 7fc253e00640 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963ce4930 0x55e963c83430 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42a0c4ac871e6a4e server_cookie=42dcc435cc396325 in_seq=0 out_seq=0 2024-02-21T07:53:38.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.288+0000 7fc23cc00640 10 client.6724 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.328+0000 7fc23cc00640 1 -- 172.21.15.100:0/1908296879 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e96387b600 con 0x55e963ce4930 2024-02-21T07:53:38.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.328+0000 7fc23cc00640 10 client.6724 handle_command_reply: tid=0 2024-02-21T07:53:38.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.338+0000 7fc25d804740 1 client.6724 shutdown 2024-02-21T07:53:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.338+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 msgr2=0x55e963c86070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.341 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.338+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c86070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55e963c12fb0 tx=0x7fc24c00af40 comp rx=0 tx=0).stop 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 shutdown_connections 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e963ce4930 0x55e963c83430 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e963c844d0 0x55e963c86070 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e963c50070 0x55e963c13c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 --2- 172.21.15.100:0/1908296879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e963c14f90 0x55e963ce41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 >> 172.21.15.100:0/1908296879 conn(0x55e963bdc4b0 msgr2=0x55e963c849e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.339+0000 7fc23cc00640 0 client.6724 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.343+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 shutdown_connections 2024-02-21T07:53:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.343+0000 7fc25d804740 1 -- 172.21.15.100:0/1908296879 wait complete. 2024-02-21T07:53:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.344+0000 7fc25d804740 20 client.6724 trim_cache size 0 max 16384 2024-02-21T07:53:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:53:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:53:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:53:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:53:38.351 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.349+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 msgr2=0x7fc2340a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.349+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 0x7fc2340a16b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc254220910 tx=0x7fc244008040 comp rx=0 tx=0).stop 2024-02-21T07:53:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.349+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 msgr2=0x7fc254223f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:38.352 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.349+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc240000c00 tx=0x7fc2400046c0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 shutdown_connections 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc25418cbd0 0x7fc254224480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc25418a590 0x7fc254223f40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc23409f1f0 0x7fc2340a16b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 --2- 172.21.15.100:0/742565150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2540f61d0 0x7fc2541720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:38.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.358+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 >> 172.21.15.100:0/742565150 conn(0x7fc2540ce1b0 msgr2=0x7fc2540d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:38.364 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.359+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 shutdown_connections 2024-02-21T07:53:38.364 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:38.361+0000 7fc25aa00640 1 -- 172.21.15.100:0/742565150 wait complete. 2024-02-21T07:53:46.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:46.115 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:46.118 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.654+0000 7f1054c00640 1 Processor -- start 2024-02-21T07:53:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.655+0000 7f1054c00640 1 -- start start 2024-02-21T07:53:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.659+0000 7f1054c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105018bbc0 con 0x7f105018bdc0 2024-02-21T07:53:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.659+0000 7f1054c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1050074550 con 0x7f105018c8b0 2024-02-21T07:53:51.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.659+0000 7f1054c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105018ac60 con 0x7f10500740c0 2024-02-21T07:53:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.659+0000 7f104de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f105018bdc0 0x7f105018c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53774/0 (socket says 172.21.15.100:53774) 2024-02-21T07:53:51.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.659+0000 7f104de00640 1 -- 172.21.15.100:0/3418549620 learned_addr learned my addr 172.21.15.100:0/3418549620 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:53:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.661+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327971589 0 0) 0x7f105018bbc0 con 0x7f105018bdc0 2024-02-21T07:53:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.661+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1034003520 con 0x7f105018bdc0 2024-02-21T07:53:51.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.663+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2803334743 0 0) 0x7f1034003520 con 0x7f105018bdc0 2024-02-21T07:53:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.663+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 >> v1:172.21.15.170:6789/0 conn(0x7f10500740c0 legacy=0x7f1050186a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:51.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.663+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 >> v1:172.21.15.156:6789/0 conn(0x7f105018c8b0 legacy=0x7f10500f94e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:51.667 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105018af40 con 0x7f105018bdc0 2024-02-21T07:53:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f1040001670 con 0x7f105018bdc0 2024-02-21T07:53:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 >> v1:172.21.15.100:6789/0 conn(0x7f105018bdc0 legacy=0x7f105018c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f1034003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340047c0 0x7f1034004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1034005380 0x7f103400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103400c210 con 0x7f10340047c0 2024-02-21T07:53:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103400c380 con 0x7f1034005380 2024-02-21T07:53:51.669 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.664+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103400c540 con 0x7f1034003a40 2024-02-21T07:53:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.666+0000 7f104de00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f1034003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.666+0000 7f104e800640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1034005380 0x7f103400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.666+0000 7f1047e00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340047c0 0x7f1034004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104de00640 1 -- 172.21.15.100:0/3418549620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1034005380 msgr2=0x7f103400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104de00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1034005380 0x7f103400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104de00640 1 -- 172.21.15.100:0/3418549620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340047c0 msgr2=0x7f1034004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104de00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340047c0 0x7f1034004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104de00640 1 -- 172.21.15.100:0/3418549620 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034003520 con 0x7f1034003a40 2024-02-21T07:53:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.670+0000 7f104e800640 1 -- 172.21.15.100:0/3418549620 reap_dead start 2024-02-21T07:53:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.677+0000 7f104de00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f1034003e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f104000c190 tx=0x7f10340057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a318fe52ef7ce6d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.678+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040005ad0 con 0x7f1034003a40 2024-02-21T07:53:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.679+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1040005c30 con 0x7f1034003a40 2024-02-21T07:53:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.680+0000 7f1054c00640 1 -- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 msgr2=0x7f1034003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.683+0000 7f104d400640 1 -- 172.21.15.100:0/3418549620 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040005ad0 con 0x7f1034003a40 2024-02-21T07:53:51.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.683+0000 7f1054c00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f1034003e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f104000c190 tx=0x7f10340057f0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.691+0000 7f1054c00640 1 -- 172.21.15.100:0/3418549620 shutdown_connections 2024-02-21T07:53:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.691+0000 7f1054c00640 1 --2- 172.21.15.100:0/3418549620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f1034003e20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.691+0000 7f1054c00640 1 -- 172.21.15.100:0/3418549620 >> 172.21.15.100:0/3418549620 conn(0x7f10500ceaa0 msgr2=0x7f10500ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.694 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.692+0000 7f1054c00640 1 -- 172.21.15.100:0/3418549620 shutdown_connections 2024-02-21T07:53:51.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.692+0000 7f1054c00640 1 -- 172.21.15.100:0/3418549620 wait complete. 2024-02-21T07:53:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.698+0000 7f1054c00640 1 Processor -- start 2024-02-21T07:53:51.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.698+0000 7f1054c00640 1 -- start start 2024-02-21T07:53:51.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.702+0000 7f1054c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f105015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.706+0000 7f1054c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.706+0000 7f1054c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10500d00d0 0x7f10500d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.706+0000 7f1054c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105021d080 con 0x7f105021c6c0 2024-02-21T07:53:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.706+0000 7f1054c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105021d2e0 con 0x7f10500d00d0 2024-02-21T07:53:51.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.706+0000 7f1054c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105021d5c0 con 0x7f1034003a40 2024-02-21T07:53:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.707+0000 7f1047e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.707+0000 7f1047e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33856/0 (socket says 172.21.15.100:33856) 2024-02-21T07:53:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.707+0000 7f1047e00640 1 -- 172.21.15.100:0/1702938295 learned_addr learned my addr 172.21.15.100:0/1702938295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:51.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.708+0000 7f1047e00640 1 -- 172.21.15.100:0/1702938295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 msgr2=0x7f105015dc90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:53:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.708+0000 7f1047e00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f105015dc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.708+0000 7f1047e00640 1 -- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10500d00d0 msgr2=0x7f10500d0550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:53:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.708+0000 7f1047e00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10500d00d0 0x7f10500d0550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.708+0000 7f1047e00640 1 -- 172.21.15.100:0/1702938295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105021d8a0 con 0x7f105021c6c0 2024-02-21T07:53:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.709+0000 7f1047e00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f103800d4b0 tx=0x7f103800d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.710+0000 7f1046000640 1 -- 172.21.15.100:0/1702938295 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038014620 con 0x7f105021c6c0 2024-02-21T07:53:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.714+0000 7f1046000640 1 -- 172.21.15.100:0/1702938295 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10380147a0 con 0x7f105021c6c0 2024-02-21T07:53:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.714+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105021db80 con 0x7f105021c6c0 2024-02-21T07:53:51.721 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.714+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105021e140 con 0x7f105021c6c0 2024-02-21T07:53:51.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.725+0000 7f1046000640 1 -- 172.21.15.100:0/1702938295 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038014b50 con 0x7f105021c6c0 2024-02-21T07:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.733+0000 7f1046000640 1 -- 172.21.15.100:0/1702938295 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1038014cb0 con 0x7f105021c6c0 2024-02-21T07:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.734+0000 7f1057988740 1 Processor -- start 2024-02-21T07:53:51.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.735+0000 7f1057988740 1 -- start start 2024-02-21T07:53:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a4187e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a418824450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4187a4620 con 0x55a4188584d0 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4187568c0 con 0x55a4187e8f90 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f1057988740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418753df0 con 0x55a418824070 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f104e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f104e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34214/0 (socket says 172.21.15.100:34214) 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.737+0000 7f104e800640 1 -- 172.21.15.100:0/263788219 learned_addr learned my addr 172.21.15.100:0/263788219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:51.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.738+0000 7f104e800640 1 -- 172.21.15.100:0/263788219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 msgr2=0x55a418824450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.738+0000 7f104e800640 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a418824450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.738+0000 7f104e800640 1 -- 172.21.15.100:0/263788219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 msgr2=0x55a4187e8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.738+0000 7f104e800640 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a4187e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.738+0000 7f104e800640 1 -- 172.21.15.100:0/263788219 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4186d0b00 con 0x55a418824070 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.739+0000 7f104e800640 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1048007b30 tx=0x7f104800c170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=540ac5face6e085c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.743+0000 7f103e600640 1 -- 172.21.15.100:0/263788219 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800a070 con 0x55a418824070 2024-02-21T07:53:51.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.743+0000 7f103e600640 1 -- 172.21.15.100:0/263788219 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104800cba0 con 0x55a418824070 2024-02-21T07:53:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.744+0000 7f1057988740 1 -- 172.21.15.100:0/263788219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 msgr2=0x55a4187e3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.744+0000 7f1057988740 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1048007b30 tx=0x7f104800c170 comp rx=0 tx=0).stop 2024-02-21T07:53:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.744+0000 7f1046000640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 0x7f102c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.744+0000 7f1046000640 1 -- 172.21.15.100:0/1702938295 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f10380c9b70 con 0x7f105021c6c0 2024-02-21T07:53:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.748+0000 7f104e800640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 0x7f102c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f1057988740 1 -- 172.21.15.100:0/263788219 shutdown_connections 2024-02-21T07:53:51.753 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f1057988740 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a418824450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f1057988740 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a4187e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f1057988740 1 --2- 172.21.15.100:0/263788219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a4187e3440 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f1057988740 1 -- 172.21.15.100:0/263788219 >> 172.21.15.100:0/263788219 conn(0x55a4187b04b0 msgr2=0x55a4187e7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.751+0000 7f104e800640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 0x7f102c0a1590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1048007b30 tx=0x7f104800a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.760+0000 7f1057988740 1 -- 172.21.15.100:0/263788219 shutdown_connections 2024-02-21T07:53:51.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.761+0000 7f1057988740 1 -- 172.21.15.100:0/263788219 wait complete. 2024-02-21T07:53:51.767 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.765+0000 7f1057988740 1 -- start start 2024-02-21T07:53:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.766+0000 7f1057988740 1 Processor -- start 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a418850ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a41884d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a41874f5d0 con 0x55a4188584d0 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4186f4b50 con 0x55a4187e8f90 2024-02-21T07:53:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4186f47f0 con 0x55a418824070 2024-02-21T07:53:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.773+0000 7f1057988740 10 client.0 _ll_register_callbacks cb 0x55a418708550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.774+0000 7f104de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.774+0000 7f1047e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a418850ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.774+0000 7f104de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:32926/0 (socket says 172.21.15.100:32926) 2024-02-21T07:53:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.774+0000 7f104de00640 1 -- 172.21.15.100:0/3024303558 learned_addr learned my addr 172.21.15.100:0/3024303558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.775+0000 7f104de00640 1 -- 172.21.15.100:0/3024303558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 msgr2=0x55a418850ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.775+0000 7f104de00640 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a418850ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.775+0000 7f104de00640 1 -- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 msgr2=0x55a41884d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.775+0000 7f104de00640 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a41884d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.775+0000 7f104de00640 1 -- 172.21.15.100:0/3024303558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10480077e0 con 0x55a4187e8f90 2024-02-21T07:53:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.778+0000 7f104de00640 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1040007eb0 tx=0x7f1040001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5755fe2a401fa01 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.778+0000 7f1032a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.779+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104003c070 con 0x55a4187e8f90 2024-02-21T07:53:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.779+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f104002c850 con 0x55a4187e8f90 2024-02-21T07:53:51.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.780+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a418721cd0 con 0x55a4187e8f90 2024-02-21T07:53:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.781+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f104002ca10 con 0x55a4187e8f90 2024-02-21T07:53:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.782+0000 7f1057988740 10 client.6727 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.782+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a41874dc50 con 0x55a4187e8f90 2024-02-21T07:53:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.782+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a418721cd0 con 0x55a4187e8f90 2024-02-21T07:53:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.783+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1040048070 con 0x55a4187e8f90 2024-02-21T07:53:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.783+0000 7f1057988740 10 client.6727 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.783+0000 7f1057988740 10 client.6727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.784+0000 7f1057988740 20 client.6727 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.784+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a418816820 0x55a418816c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.784+0000 7f1057988740 4 client.6727 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:53:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.784+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a418745ce0 con 0x55a418816820 2024-02-21T07:53:51.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.785+0000 7f1047e00640 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a418816820 0x55a418816c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.786+0000 7f1047e00640 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a418816820 0x55a418816c30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68fb5adef82a1564 server_cookie=dae766a1b06c01dc in_seq=0 out_seq=0 2024-02-21T07:53:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.786+0000 7f1032a00640 10 client.6727 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.787+0000 7f1032a00640 1 -- 172.21.15.100:0/3024303558 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a418745ce0 con 0x55a418816820 2024-02-21T07:53:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.787+0000 7f1032a00640 10 client.6727 handle_command_reply: tid=0 2024-02-21T07:53:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.788+0000 7f1057988740 1 client.6727 shutdown 2024-02-21T07:53:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 msgr2=0x55a4187e3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1040007eb0 tx=0x7f1040001930 comp rx=0 tx=0).stop 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 shutdown_connections 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a418816820 0x55a418816c30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4188584d0 0x55a41884d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a418824070 0x55a418850ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 --2- 172.21.15.100:0/3024303558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187e8f90 0x55a4187e3730 secure :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1040007eb0 tx=0x7f1040001930 comp rx=0 tx=0).stop 2024-02-21T07:53:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.789+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 >> 172.21.15.100:0/3024303558 conn(0x55a4187b04b0 msgr2=0x55a4187eee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.796+0000 7f1032a00640 0 client.6727 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.796+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 shutdown_connections 2024-02-21T07:53:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.797+0000 7f1057988740 1 -- 172.21.15.100:0/3024303558 wait complete. 2024-02-21T07:53:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.797+0000 7f1057988740 20 client.6727 trim_cache size 0 max 16384 2024-02-21T07:53:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.828+0000 7f1057988740 1 Processor -- start 2024-02-21T07:53:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.828+0000 7f1057988740 1 -- start start 2024-02-21T07:53:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.831+0000 7f1057988740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 0x55a4188132a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.831+0000 7f1057988740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.831+0000 7f104de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 0x55a4188132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.831+0000 7f104de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 0x55a4188132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:32942/0 (socket says 172.21.15.100:32942) 2024-02-21T07:53:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f104de00640 1 -- 172.21.15.100:0/3918177185 learned_addr learned my addr 172.21.15.100:0/3918177185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f1047e00640 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f1057988740 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4187debd0 0x55a418850b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418497e60 con 0x55a4187debd0 2024-02-21T07:53:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418816350 con 0x55a418824070 2024-02-21T07:53:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.832+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418856b80 con 0x55a4188584d0 2024-02-21T07:53:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f104e800640 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4187debd0 0x55a418850b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f1047e00640 1 -- 172.21.15.100:0/3918177185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 msgr2=0x55a4188132a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f1047e00640 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 0x55a4188132a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f1047e00640 1 -- 172.21.15.100:0/3918177185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4187debd0 msgr2=0x55a418850b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f1047e00640 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4187debd0 0x55a418850b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.833+0000 7f1047e00640 1 -- 172.21.15.100:0/3918177185 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4186ea530 con 0x55a4188584d0 2024-02-21T07:53:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.835+0000 7f1047e00640 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188579f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10380c7540 tx=0x7f10380c7440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3208a2446188abec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.835+0000 7f103dc00640 1 -- 172.21.15.100:0/3918177185 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103809b800 con 0x55a4188584d0 2024-02-21T07:53:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.836+0000 7f103dc00640 1 -- 172.21.15.100:0/3918177185 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103809fe50 con 0x55a4188584d0 2024-02-21T07:53:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.836+0000 7f103dc00640 1 -- 172.21.15.100:0/3918177185 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103809b800 con 0x55a4188584d0 2024-02-21T07:53:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 msgr2=0x55a4188579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188579f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10380c7540 tx=0x7f10380c7440 comp rx=0 tx=0).stop 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 shutdown_connections 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a4187debd0 0x55a418850b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188579f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 --2- 172.21.15.100:0/3918177185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a418824070 0x55a4188132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 >> 172.21.15.100:0/3918177185 conn(0x55a4187b04b0 msgr2=0x55a41884f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 shutdown_connections 2024-02-21T07:53:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.837+0000 7f1057988740 1 -- 172.21.15.100:0/3918177185 wait complete. 2024-02-21T07:53:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.839+0000 7f1057988740 1 -- start start 2024-02-21T07:53:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.839+0000 7f1057988740 1 Processor -- start 2024-02-21T07:53:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 0x55a4188cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188289f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4188cd340 con 0x55a418824070 2024-02-21T07:53:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4188ccbe0 con 0x55a4187debd0 2024-02-21T07:53:51.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a418856e40 con 0x55a4188584d0 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.843+0000 7f1057988740 10 client.0 _ll_register_callbacks cb 0x7f10480073c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.844+0000 7f104e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.844+0000 7f104de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 0x55a4188cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.844+0000 7f1047e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.844+0000 7f1047e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33876/0 (socket says 172.21.15.100:33876) 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.844+0000 7f1047e00640 1 -- 172.21.15.100:0/4198488327 learned_addr learned my addr 172.21.15.100:0/4198488327 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.845+0000 7f104de00640 1 -- 172.21.15.100:0/4198488327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 msgr2=0x55a4188289f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.845+0000 7f104de00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188289f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.847 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.845+0000 7f104de00640 1 -- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 msgr2=0x55a41884f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:53:51.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.846+0000 7f104de00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.846+0000 7f104de00640 1 -- 172.21.15.100:0/4198488327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105021e140 con 0x55a4187debd0 2024-02-21T07:53:51.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.846+0000 7f1047e00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:53:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.847+0000 7f104de00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 0x55a4188cc6a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f104002cb80 tx=0x7f1040009030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931d00e65dda9893 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:53:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.847+0000 7f1032a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:53:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.847+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040007480 con 0x55a4187debd0 2024-02-21T07:53:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.848+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f10400075e0 con 0x55a4187debd0 2024-02-21T07:53:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.848+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a418774d30 con 0x55a4187debd0 2024-02-21T07:53:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.848+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10400077a0 con 0x55a4187debd0 2024-02-21T07:53:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.848+0000 7f1057988740 10 client.6733 fetch_fsmap learned FSMap version 17 2024-02-21T07:53:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.849+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a4187102c0 con 0x55a4187debd0 2024-02-21T07:53:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.853+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a418774d30 con 0x55a4187debd0 2024-02-21T07:53:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.853+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1040048040 con 0x55a4187debd0 2024-02-21T07:53:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 10 client.6733 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:53:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 10 client.6733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:53:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 20 client.6733 populate_metadata read hostname 'smithi100' 2024-02-21T07:53:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a4188bc8c0 0x55a4187e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 4 client.6733 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:53:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.854+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a41844f600 con 0x55a4188bc8c0 2024-02-21T07:53:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.859+0000 7f1047e00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a4188bc8c0 0x55a4187e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:53:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.860+0000 7f1047e00640 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a4188bc8c0 0x55a4187e43d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556846d38c6411d7 server_cookie=ade6e2f6eae4bff8 in_seq=0 out_seq=0 2024-02-21T07:53:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.860+0000 7f1032a00640 10 client.6733 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.890+0000 7f1032a00640 1 -- 172.21.15.100:0/4198488327 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a41844f600 con 0x55a4188bc8c0 2024-02-21T07:53:51.893 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.890+0000 7f1032a00640 10 client.6733 handle_command_reply: tid=0 2024-02-21T07:53:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.891+0000 7f1057988740 1 client.6733 shutdown 2024-02-21T07:53:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 msgr2=0x55a4188cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.894 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 0x55a4188cc6a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f104002cb80 tx=0x7f1040009030 comp rx=0 tx=0).stop 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 shutdown_connections 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a4188bc8c0 0x55a4187e43d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a4188584d0 0x55a4188289f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a418824070 0x55a41884f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 --2- 172.21.15.100:0/4198488327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4187debd0 0x55a4188cc6a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.892+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 >> 172.21.15.100:0/4198488327 conn(0x55a4187b04b0 msgr2=0x55a4188579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.894+0000 7f1032a00640 0 client.6733 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:53:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.894+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 shutdown_connections 2024-02-21T07:53:51.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.895+0000 7f1057988740 1 -- 172.21.15.100:0/4198488327 wait complete. 2024-02-21T07:53:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.896+0000 7f1057988740 20 client.6733 trim_cache size 0 max 16384 2024-02-21T07:53:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:53:51.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:53:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:53:51.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:53:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.899+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 msgr2=0x7f102c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.899+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 0x7f102c0a1590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1048007b30 tx=0x7f104800a000 comp rx=0 tx=0).stop 2024-02-21T07:53:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.899+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 msgr2=0x7f105021cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:53:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f103800d4b0 tx=0x7f103800d970 comp rx=0 tx=0).stop 2024-02-21T07:53:51.903 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 shutdown_connections 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10500d00d0 0x7f10500d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f102c09f0d0 0x7f102c0a1590 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f105021c6c0 0x7f105021cb40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.900+0000 7f1054c00640 1 --2- 172.21.15.100:0/1702938295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1034003a40 0x7f105015dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.901+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 >> 172.21.15.100:0/1702938295 conn(0x7f10500ceaa0 msgr2=0x7f105018c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.901+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 shutdown_connections 2024-02-21T07:53:51.904 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:53:51.901+0000 7f1054c00640 1 -- 172.21.15.100:0/1702938295 wait complete. 2024-02-21T07:53:59.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:53:59.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:54:00.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.093+0000 7f1244600640 1 Processor -- start 2024-02-21T07:54:00.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.093+0000 7f1244600640 1 -- start start 2024-02-21T07:54:00.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.096+0000 7f1244600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f123c06ee90 0x7f123c072000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.096+0000 7f1244600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0f7e70 con 0x7f123c0f8300 2024-02-21T07:54:00.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.097+0000 7f1244600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c180cb0 con 0x7f123c1808d0 2024-02-21T07:54:00.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.097+0000 7f1244600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0f6f80 con 0x7f123c06ee90 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.097+0000 7f1241200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f123c0f8300 0x7f123c0718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38274/0 (socket says 172.21.15.100:38274) 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.097+0000 7f1241200640 1 -- 172.21.15.100:0/3079674740 learned_addr learned my addr 172.21.15.100:0/3079674740 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.097+0000 7f1242600640 1 --2- 172.21.15.100:0/3079674740 >> v2:172.21.15.100:3300/0 conn(0x7f123c06ee90 0x7f123c072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.098+0000 7f1242600640 1 -- 172.21.15.100:0/3079674740 >> v1:172.21.15.170:6789/0 conn(0x7f123c1808d0 legacy=0x7f123c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.098+0000 7f1242600640 1 -- 172.21.15.100:0/3079674740 >> v1:172.21.15.100:6789/0 conn(0x7f123c0f8300 legacy=0x7f123c0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.098+0000 7f1242600640 1 -- 172.21.15.100:0/3079674740 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0f7260 con 0x7f123c06ee90 2024-02-21T07:54:00.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.100+0000 7f1242600640 1 --2- 172.21.15.100:0/3079674740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c06ee90 0x7f123c072000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1234009d90 tx=0x7f123402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4653323266bda8d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.100+0000 7f123be00640 1 -- 172.21.15.100:0/3079674740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123402cbd0 con 0x7f123c06ee90 2024-02-21T07:54:00.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.100+0000 7f123be00640 1 -- 172.21.15.100:0/3079674740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123402cd30 con 0x7f123c06ee90 2024-02-21T07:54:00.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.100+0000 7f123be00640 1 -- 172.21.15.100:0/3079674740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123402cea0 con 0x7f123c06ee90 2024-02-21T07:54:00.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.101+0000 7f1244600640 1 -- 172.21.15.100:0/3079674740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c06ee90 msgr2=0x7f123c072000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.101+0000 7f1244600640 1 --2- 172.21.15.100:0/3079674740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c06ee90 0x7f123c072000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1234009d90 tx=0x7f123402be20 comp rx=0 tx=0).stop 2024-02-21T07:54:00.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.102+0000 7f1244600640 1 -- 172.21.15.100:0/3079674740 shutdown_connections 2024-02-21T07:54:00.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.102+0000 7f1244600640 1 --2- 172.21.15.100:0/3079674740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c06ee90 0x7f123c072000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.102+0000 7f1244600640 1 -- 172.21.15.100:0/3079674740 >> 172.21.15.100:0/3079674740 conn(0x7f123c0d05b0 msgr2=0x7f123c0d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.102+0000 7f1244600640 1 -- 172.21.15.100:0/3079674740 shutdown_connections 2024-02-21T07:54:00.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.103+0000 7f1244600640 1 -- 172.21.15.100:0/3079674740 wait complete. 2024-02-21T07:54:00.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.107+0000 7f1244600640 1 Processor -- start 2024-02-21T07:54:00.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.108+0000 7f1244600640 1 -- start start 2024-02-21T07:54:00.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.115+0000 7f1244600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 0x7f123c0cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.115+0000 7f1244600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.115+0000 7f1244600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f123c1808d0 0x7f123c184620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.116+0000 7f1244600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0cb3b0 con 0x7f123c0f8300 2024-02-21T07:54:00.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.116+0000 7f1244600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0cb600 con 0x7f123c1808d0 2024-02-21T07:54:00.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.116+0000 7f1244600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0cb8e0 con 0x7f123c06ee90 2024-02-21T07:54:00.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35512/0 (socket says 172.21.15.100:35512) 2024-02-21T07:54:00.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 -- 172.21.15.100:0/4094798672 learned_addr learned my addr 172.21.15.100:0/4094798672 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241c00640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 0x7f123c0cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 -- 172.21.15.100:0/4094798672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 msgr2=0x7f123c0cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 0x7f123c0cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 -- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f123c1808d0 msgr2=0x7f123c184620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f123c1808d0 0x7f123c184620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.118+0000 7f1241200640 1 -- 172.21.15.100:0/4094798672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009a70 con 0x7f123c0f8300 2024-02-21T07:54:00.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.119+0000 7f1241c00640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 0x7f123c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.119+0000 7f1241200640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f122800c400 tx=0x7f122800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.120+0000 7f1239600640 1 -- 172.21.15.100:0/4094798672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228005ce0 con 0x7f123c0f8300 2024-02-21T07:54:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.120+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0cbbc0 con 0x7f123c0f8300 2024-02-21T07:54:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.120+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c0cc180 con 0x7f123c0f8300 2024-02-21T07:54:00.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.123+0000 7f1239600640 1 -- 172.21.15.100:0/4094798672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1228005e40 con 0x7f123c0f8300 2024-02-21T07:54:00.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.123+0000 7f1239600640 1 -- 172.21.15.100:0/4094798672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12280072d0 con 0x7f123c0f8300 2024-02-21T07:54:00.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.130+0000 7f12471fa740 1 Processor -- start 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.130+0000 7f1239600640 1 -- 172.21.15.100:0/4094798672 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f12280074f0 con 0x7f123c0f8300 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.130+0000 7f12471fa740 1 -- start start 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014a4c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014ac4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014a86050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0149b5150 con 0x55f014a85bf0 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0149b2680 con 0x55f014ab5ca0 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.132+0000 7f12471fa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0149ade60 con 0x55f014a85810 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.133+0000 7f1242600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014a4c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.133+0000 7f1242600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014a4c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45204/0 (socket says 172.21.15.100:45204) 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.133+0000 7f1242600640 1 -- 172.21.15.100:0/894988621 learned_addr learned my addr 172.21.15.100:0/894988621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.133+0000 7f1241c00640 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014ac4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.134+0000 7f1241c00640 1 -- 172.21.15.100:0/894988621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 msgr2=0x55f014a4c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.134+0000 7f1241c00640 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014a4c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.134+0000 7f1241c00640 1 -- 172.21.15.100:0/894988621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 msgr2=0x55f014a86050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.145+0000 7f1239600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 0x7f121c0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.146+0000 7f1239600640 1 -- 172.21.15.100:0/4094798672 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f12280c8f40 con 0x7f123c0f8300 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.149+0000 7f1241200640 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014a86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.149+0000 7f1241c00640 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014a86050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.149+0000 7f1241c00640 1 -- 172.21.15.100:0/894988621 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f014967060 con 0x55f014ab5ca0 2024-02-21T07:54:00.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.150+0000 7f1241c00640 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014ac4000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f123000a850 tx=0x7f123000ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc63786e7b64bd95 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.150+0000 7f122e000640 1 -- 172.21.15.100:0/894988621 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000cb40 con 0x55f014ab5ca0 2024-02-21T07:54:00.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.151+0000 7f122e000640 1 -- 172.21.15.100:0/894988621 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123000cca0 con 0x55f014ab5ca0 2024-02-21T07:54:00.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.151+0000 7f122e000640 1 -- 172.21.15.100:0/894988621 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230011630 con 0x55f014ab5ca0 2024-02-21T07:54:00.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.152+0000 7f12471fa740 1 -- 172.21.15.100:0/894988621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 msgr2=0x55f014ac4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.152+0000 7f12471fa740 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014ac4000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f123000a850 tx=0x7f123000ad10 comp rx=0 tx=0).stop 2024-02-21T07:54:00.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.159+0000 7f12471fa740 1 -- 172.21.15.100:0/894988621 shutdown_connections 2024-02-21T07:54:00.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.159+0000 7f12471fa740 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014a86050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.159+0000 7f12471fa740 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014ac4000 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.159+0000 7f12471fa740 1 --2- 172.21.15.100:0/894988621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014a4c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.159+0000 7f12471fa740 1 -- 172.21.15.100:0/894988621 >> 172.21.15.100:0/894988621 conn(0x55f014a0d5a0 msgr2=0x55f014a44eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.162+0000 7f1242600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 0x7f121c0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.162+0000 7f12471fa740 1 -- 172.21.15.100:0/894988621 shutdown_connections 2024-02-21T07:54:00.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.168+0000 7f1242600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 0x7f121c0a15e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f123402be60 tx=0x7f1234030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.169+0000 7f12471fa740 1 -- 172.21.15.100:0/894988621 wait complete. 2024-02-21T07:54:00.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.170+0000 7f12471fa740 1 -- start start 2024-02-21T07:54:00.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.171+0000 7f12471fa740 1 Processor -- start 2024-02-21T07:54:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.173+0000 7f12471fa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.173+0000 7f12471fa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014aae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.173+0000 7f12471fa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014aa95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.173+0000 7f1241c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.173+0000 7f12471fa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014952ec0 con 0x55f014a85bf0 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f12471fa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014952b60 con 0x55f014ab5ca0 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f12471fa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f01471c1c0 con 0x55f014a85810 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45216/0 (socket says 172.21.15.100:45216) 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 -- 172.21.15.100:0/3384408802 learned_addr learned my addr 172.21.15.100:0/3384408802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f12471fa740 10 client.0 _ll_register_callbacks cb 0x55f014966960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241200640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014aae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 -- 172.21.15.100:0/3384408802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 msgr2=0x55f014aa95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014aa95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 -- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 msgr2=0x55f014aae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014aae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 -- 172.21.15.100:0/3384408802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123000a4b0 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1241c00640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f123000c520 tx=0x7f1230004680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1556903d770dec8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.174+0000 7f1222a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230020070 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0146ad7e0 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f123001b4e0 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123001b6a0 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f12471fa740 10 client.6680 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f0149ac4e0 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.175+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230033020 con 0x55f014a85810 2024-02-21T07:54:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f123001b800 con 0x55f014a85810 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 10 client.6680 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 10 client.6680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 20 client.6680 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014ab6ca0 0x55f014a681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 4 client.6680 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0146ea720 con 0x55f014ab6ca0 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.176+0000 7f1241200640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014ab6ca0 0x55f014a681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.177+0000 7f1241200640 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014ab6ca0 0x55f014a681c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0248cbade9deca server_cookie=2e0abfec4f523264 in_seq=0 out_seq=0 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.178+0000 7f1222a00640 10 client.6680 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.179+0000 7f1222a00640 1 -- 172.21.15.100:0/3384408802 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f0146ea720 con 0x55f014ab6ca0 2024-02-21T07:54:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.179+0000 7f1222a00640 10 client.6680 handle_command_reply: tid=0 2024-02-21T07:54:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.179+0000 7f12471fa740 1 client.6680 shutdown 2024-02-21T07:54:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.181+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 msgr2=0x55f014aaa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.181+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f123000c520 tx=0x7f1230004680 comp rx=0 tx=0).stop 2024-02-21T07:54:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.182+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 shutdown_connections 2024-02-21T07:54:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.183+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014ab6ca0 0x55f014a681c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.183+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014ab5ca0 0x55f014aa95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.183+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85bf0 0x55f014aae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.183+0000 7f12471fa740 1 --2- 172.21.15.100:0/3384408802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014a85810 0x55f014aaa1b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.183+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 >> 172.21.15.100:0/3384408802 conn(0x55f014a0d5a0 msgr2=0x55f014a44e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.186+0000 7f1222a00640 0 client.6680 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:00.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.187+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 shutdown_connections 2024-02-21T07:54:00.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.187+0000 7f12471fa740 1 -- 172.21.15.100:0/3384408802 wait complete. 2024-02-21T07:54:00.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.188+0000 7f12471fa740 20 client.6680 trim_cache size 0 max 16384 2024-02-21T07:54:00.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.233+0000 7f12471fa740 1 Processor -- start 2024-02-21T07:54:00.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.233+0000 7f12471fa740 1 -- start start 2024-02-21T07:54:00.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014aa6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014ab4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014b22420 con 0x55f014a85810 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014aa9ed0 con 0x55f014a85bf0 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f12471fa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014aaa400 con 0x55f014ab5ca0 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f1242600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014ab4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f1241200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f1242600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014ab4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45220/0 (socket says 172.21.15.100:45220) 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f1242600640 1 -- 172.21.15.100:0/2164879241 learned_addr learned my addr 172.21.15.100:0/2164879241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.235+0000 7f1241200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47960/0 (socket says 172.21.15.100:47960) 2024-02-21T07:54:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241c00640 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014aa6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 -- 172.21.15.100:0/2164879241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 msgr2=0x55f014ab4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014ab4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 -- 172.21.15.100:0/2164879241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 msgr2=0x55f014aa6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014aa6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 -- 172.21.15.100:0/2164879241 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f014948950 con 0x55f014a85bf0 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241c00640 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014aa6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.236+0000 7f1241200640 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f12280c68b0 tx=0x7f12280c67b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=786cedb70d231fab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.237+0000 7f122d600640 1 -- 172.21.15.100:0/2164879241 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122809ac00 con 0x55f014a85bf0 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.237+0000 7f122d600640 1 -- 172.21.15.100:0/2164879241 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122809f1c0 con 0x55f014a85bf0 2024-02-21T07:54:00.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.237+0000 7f122d600640 1 -- 172.21.15.100:0/2164879241 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228094db0 con 0x55f014a85bf0 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 -- 172.21.15.100:0/2164879241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 msgr2=0x55f014ab6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f12280c68b0 tx=0x7f12280c67b0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 -- 172.21.15.100:0/2164879241 shutdown_connections 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014ab4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014ab6080 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 --2- 172.21.15.100:0/2164879241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014aa6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 -- 172.21.15.100:0/2164879241 >> 172.21.15.100:0/2164879241 conn(0x55f014a0d5a0 msgr2=0x55f014a43e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.238+0000 7f12471fa740 1 -- 172.21.15.100:0/2164879241 shutdown_connections 2024-02-21T07:54:00.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.240+0000 7f12471fa740 1 -- 172.21.15.100:0/2164879241 wait complete. 2024-02-21T07:54:00.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.241+0000 7f12471fa740 1 -- start start 2024-02-21T07:54:00.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.241+0000 7f12471fa740 1 Processor -- start 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014a70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014b19fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014b34d20 con 0x55f014a85810 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014a70650 con 0x55f014a85bf0 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f014a654e0 con 0x55f014ab5ca0 2024-02-21T07:54:00.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.242+0000 7f12471fa740 10 client.0 _ll_register_callbacks cb 0x7f1234037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:00.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.243+0000 7f1241c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.243+0000 7f1241c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35542/0 (socket says 172.21.15.100:35542) 2024-02-21T07:54:00.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.243+0000 7f1241c00640 1 -- 172.21.15.100:0/3931332778 learned_addr learned my addr 172.21.15.100:0/3931332778 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.243+0000 7f1241200640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014a70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1242600640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014b19fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 -- 172.21.15.100:0/3931332778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 msgr2=0x55f014b19fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014b19fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 -- 172.21.15.100:0/3931332778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 msgr2=0x55f014a70110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014a70110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 -- 172.21.15.100:0/3931332778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0149ac4e0 con 0x55f014a85810 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1242600640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014b19fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1241c00640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f123000c520 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7442ed69db0bacd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1222a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:00.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230004440 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1230000e40 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.244+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f123000cca0 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123000c550 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 10 client.6576 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f123c0cc180 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230041020 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f12300117a0 con 0x55f014a85810 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 10 client.6576 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 10 client.6576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 20 client.6576 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.245+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014a89d00 0x55f014ae7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.246+0000 7f12471fa740 4 client.6576 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:54:00.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.246+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f014739890 con 0x55f014a89d00 2024-02-21T07:54:00.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.246+0000 7f1241200640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014a89d00 0x55f014ae7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.249+0000 7f1241200640 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014a89d00 0x55f014ae7810 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40f6dcdd1ac328 server_cookie=65a0e3cbb514abd0 in_seq=0 out_seq=0 2024-02-21T07:54:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.249+0000 7f1222a00640 10 client.6576 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.251+0000 7f1222a00640 1 -- 172.21.15.100:0/3931332778 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f014739890 con 0x55f014a89d00 2024-02-21T07:54:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.251+0000 7f1222a00640 10 client.6576 handle_command_reply: tid=0 2024-02-21T07:54:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.251+0000 7f12471fa740 1 client.6576 shutdown 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 msgr2=0x55f014ab7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f123000c520 tx=0x7f1230008040 comp rx=0 tx=0).stop 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 shutdown_connections 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f014a89d00 0x55f014ae7810 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f014ab5ca0 0x55f014b19fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f014a85bf0 0x55f014a70110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 --2- 172.21.15.100:0/3931332778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f014a85810 0x55f014ab7b50 secure :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f123000c520 tx=0x7f1230008040 comp rx=0 tx=0).stop 2024-02-21T07:54:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 >> 172.21.15.100:0/3931332778 conn(0x55f014a0d5a0 msgr2=0x55f014a80de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.255+0000 7f1222a00640 0 client.6576 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.256+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 shutdown_connections 2024-02-21T07:54:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.256+0000 7f12471fa740 1 -- 172.21.15.100:0/3931332778 wait complete. 2024-02-21T07:54:00.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.260+0000 7f12471fa740 20 client.6576 trim_cache size 0 max 16384 2024-02-21T07:54:00.265 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:54:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:54:00.266 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:00.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.263+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 msgr2=0x7f121c0a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.263+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 0x7f121c0a15e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f123402be60 tx=0x7f1234030000 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.263+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 msgr2=0x7f123c0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.263+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f122800c400 tx=0x7f122800c8c0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 shutdown_connections 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f123c1808d0 0x7f123c184620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f121c09f120 0x7f121c0a15e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f123c0f8300 0x7f123c0cfd00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 --2- 172.21.15.100:0/4094798672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f123c06ee90 0x7f123c0cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 >> 172.21.15.100:0/4094798672 conn(0x7f123c0d05b0 msgr2=0x7f123c17fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 shutdown_connections 2024-02-21T07:54:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.264+0000 7f1244600640 1 -- 172.21.15.100:0/4094798672 wait complete. 2024-02-21T07:54:00.307 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:54:00.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:54:00.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.723+0000 7f6e00600640 1 Processor -- start 2024-02-21T07:54:00.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.724+0000 7f6e00600640 1 -- start start 2024-02-21T07:54:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.728+0000 7f6e00600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6df010ff20 0x7f6df0110390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.728+0000 7f6e00600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6df01108d0 0x7f6df01119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.728+0000 7f6e00600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df007d3b0 con 0x7f6df010f2b0 2024-02-21T07:54:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.728+0000 7f6e00600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df010fad0 con 0x7f6df010ff20 2024-02-21T07:54:00.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.728+0000 7f6e00600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df010f690 con 0x7f6df01108d0 2024-02-21T07:54:00.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.729+0000 7f6dfdc00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6df010f2b0 0x7f6df007c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39636/0 (socket says 172.21.15.100:39636) 2024-02-21T07:54:00.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.729+0000 7f6dfdc00640 1 -- 172.21.15.100:0/4035030466 learned_addr learned my addr 172.21.15.100:0/4035030466 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.731+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401914174 0 0) 0x7f6df007d3b0 con 0x7f6df010f2b0 2024-02-21T07:54:00.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.731+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de0003520 con 0x7f6df010f2b0 2024-02-21T07:54:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647229242 0 0) 0x7f6de0003520 con 0x7f6df010f2b0 2024-02-21T07:54:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 >> v2:172.21.15.156:3300/0 conn(0x7f6df01108d0 msgr2=0x7f6df01119a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 --2- 172.21.15.100:0/4035030466 >> v2:172.21.15.156:3300/0 conn(0x7f6df01108d0 0x7f6df01119a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 >> v2:172.21.15.100:3300/0 conn(0x7f6df010ff20 msgr2=0x7f6df0110390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 --2- 172.21.15.100:0/4035030466 >> v2:172.21.15.100:3300/0 conn(0x7f6df010ff20 0x7f6df0110390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df007c830 con 0x7f6df010f2b0 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f6de4001670 con 0x7f6df010f2b0 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 >> v1:172.21.15.156:6789/0 conn(0x7f6df010f2b0 legacy=0x7f6df007c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de00039c0 0x7f6de0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00047c0 0x7f6de0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6de0009970 0x7f6de000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df010fad0 con 0x7f6de0009970 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df010f690 con 0x7f6de00047c0 2024-02-21T07:54:00.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.734+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de000c3d0 con 0x7f6de00039c0 2024-02-21T07:54:00.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.738+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de00039c0 0x7f6de0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.739+0000 7f6dfdc00640 1 -- 172.21.15.100:0/4035030466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00047c0 msgr2=0x7f6de0004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.739+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00047c0 0x7f6de0004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.739+0000 7f6dfdc00640 1 -- 172.21.15.100:0/4035030466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6de0009970 msgr2=0x7f6de000bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.739+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6de0009970 0x7f6de000bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.740+0000 7f6dfdc00640 1 -- 172.21.15.100:0/4035030466 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df007c830 con 0x7f6de00039c0 2024-02-21T07:54:00.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.743+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de00039c0 0x7f6de0003de0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c260 tx=0x7f6de00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db883076a62e5913 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.746+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de402cb30 con 0x7f6de00039c0 2024-02-21T07:54:00.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.746+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de402ccb0 con 0x7f6de00039c0 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.746+0000 7f6df7e00640 1 -- 172.21.15.100:0/4035030466 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4005b10 con 0x7f6de00039c0 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.747+0000 7f6e00600640 1 -- 172.21.15.100:0/4035030466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de00039c0 msgr2=0x7f6de0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.747+0000 7f6e00600640 1 --2- 172.21.15.100:0/4035030466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6de00039c0 0x7f6de0003de0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c260 tx=0x7f6de00057f0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.748+0000 7f6dfe600640 1 -- 172.21.15.100:0/4035030466 reap_dead start 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.748+0000 7f6dfe600640 1 -- 172.21.15.100:0/4035030466 reap_dead start 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.749+0000 7f6e00600640 1 -- 172.21.15.100:0/4035030466 shutdown_connections 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.749+0000 7f6e00600640 1 -- 172.21.15.100:0/4035030466 >> 172.21.15.100:0/4035030466 conn(0x7f6df0006390 msgr2=0x7f6df00067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.749+0000 7f6e00600640 1 -- 172.21.15.100:0/4035030466 shutdown_connections 2024-02-21T07:54:00.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.749+0000 7f6e00600640 1 -- 172.21.15.100:0/4035030466 wait complete. 2024-02-21T07:54:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.756+0000 7f6e00600640 1 Processor -- start 2024-02-21T07:54:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.756+0000 7f6e00600640 1 -- start start 2024-02-21T07:54:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6df01cab60 0x7f6df01b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df01b9c30 0x7f6df01ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df010d230 con 0x7f6df01b9c30 2024-02-21T07:54:00.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df010d510 con 0x7f6de00039c0 2024-02-21T07:54:00.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6e00600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df010d7f0 con 0x7f6df01cab60 2024-02-21T07:54:00.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6dfdc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6dfdc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47976/0 (socket says 172.21.15.100:47976) 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.758+0000 7f6dfdc00640 1 -- 172.21.15.100:0/543848623 learned_addr learned my addr 172.21.15.100:0/543848623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfd200640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6df01cab60 0x7f6df01b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfe600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df01b9c30 0x7f6df01ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfdc00640 1 -- 172.21.15.100:0/543848623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6df01cab60 msgr2=0x7f6df01b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6df01cab60 0x7f6df01b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfdc00640 1 -- 172.21.15.100:0/543848623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df01b9c30 msgr2=0x7f6df01ba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df01b9c30 0x7f6df01ba6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.759+0000 7f6dfdc00640 1 -- 172.21.15.100:0/543848623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df010dad0 con 0x7f6de00039c0 2024-02-21T07:54:00.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.761+0000 7f6dfdc00640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c260 tx=0x7f6de4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.764+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40049f0 con 0x7f6de00039c0 2024-02-21T07:54:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.764+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4004b50 con 0x7f6de00039c0 2024-02-21T07:54:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.764+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40049f0 con 0x7f6de00039c0 2024-02-21T07:54:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.764+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df010ddb0 con 0x7f6de00039c0 2024-02-21T07:54:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.764+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df010eaf0 con 0x7f6de00039c0 2024-02-21T07:54:00.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.775+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df007d0b0 con 0x7f6de00039c0 2024-02-21T07:54:00.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.776+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6de4032070 con 0x7f6de00039c0 2024-02-21T07:54:00.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.780+0000 7f6df5600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.780+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6de40eaff0 con 0x7f6de00039c0 2024-02-21T07:54:00.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.781+0000 7f6dfd200640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:00.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.783+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6de411e8c0 con 0x7f6de00039c0 2024-02-21T07:54:00.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:00.783+0000 7f6dfd200640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6df01caf40 tx=0x7f6dec009110 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.347+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6df00058d0 con 0x7f6de00039c0 2024-02-21T07:54:01.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.356+0000 7f6df5600640 1 -- 172.21.15.100:0/543848623 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f6df007d0b0 con 0x7f6de00039c0 2024-02-21T07:54:01.362 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:54:01.362 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:54:01.363 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:54:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 msgr2=0x7f6dd80a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6df01caf40 tx=0x7f6dec009110 comp rx=0 tx=0).stop 2024-02-21T07:54:01.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 msgr2=0x7f6df010e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c260 tx=0x7f6de4001930 comp rx=0 tx=0).stop 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 shutdown_connections 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6dd809f1b0 0x7f6dd80a1670 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df01b9c30 0x7f6df01ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6df01cab60 0x7f6df01b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.364+0000 7f6e00600640 1 --2- 172.21.15.100:0/543848623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6de00039c0 0x7f6df010e5b0 secure :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c260 tx=0x7f6de4001930 comp rx=0 tx=0).stop 2024-02-21T07:54:01.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.365+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 >> 172.21.15.100:0/543848623 conn(0x7f6df0006390 msgr2=0x7f6df0005ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.366+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 shutdown_connections 2024-02-21T07:54:01.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.369+0000 7f6e00600640 1 -- 172.21.15.100:0/543848623 wait complete. 2024-02-21T07:54:01.457 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:01.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:54:01.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.799+0000 7fbaea600640 1 Processor -- start 2024-02-21T07:54:01.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.799+0000 7fbaea600640 1 -- start start 2024-02-21T07:54:01.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.801+0000 7fbaea600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbae40cb800 0x7fbae40f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.801+0000 7fbaea600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbae40f94b0 0x7fbae406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbaea600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae40cac60 con 0x7fbae417d0b0 2024-02-21T07:54:01.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbaea600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae417d490 con 0x7fbae40cb800 2024-02-21T07:54:01.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbaea600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae406e830 con 0x7fbae40f94b0 2024-02-21T07:54:01.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbae9200640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fbae417d0b0 0x7fbae40cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39640/0 (socket says 172.21.15.100:39640) 2024-02-21T07:54:01.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbae9200640 1 -- 172.21.15.100:0/3718418119 learned_addr learned my addr 172.21.15.100:0/3718418119 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:01.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.802+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3718418119 >> v2:172.21.15.156:3300/0 conn(0x7fbae40cb800 0x7fbae40f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.803+0000 7fbae3e00640 1 -- 172.21.15.100:0/3718418119 >> v2:172.21.15.170:3300/0 conn(0x7fbae40f94b0 msgr2=0x7fbae406d950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:01.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.803+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3718418119 >> v2:172.21.15.170:3300/0 conn(0x7fbae40f94b0 0x7fbae406d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.803+0000 7fbae3e00640 1 -- 172.21.15.100:0/3718418119 >> v1:172.21.15.156:6789/0 conn(0x7fbae417d0b0 legacy=0x7fbae40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.803+0000 7fbae3e00640 1 -- 172.21.15.100:0/3718418119 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae406eb10 con 0x7fbae40cb800 2024-02-21T07:54:01.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.805+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3718418119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae40f8f70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbae40d25b0 tx=0x7fbad002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55452b250b13c5c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.806+0000 7fbae3400640 1 -- 172.21.15.100:0/3718418119 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0031870 con 0x7fbae40cb800 2024-02-21T07:54:01.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.806+0000 7fbae3400640 1 -- 172.21.15.100:0/3718418119 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad00319d0 con 0x7fbae40cb800 2024-02-21T07:54:01.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.806+0000 7fbae3400640 1 -- 172.21.15.100:0/3718418119 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0031da0 con 0x7fbae40cb800 2024-02-21T07:54:01.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 -- 172.21.15.100:0/3718418119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 msgr2=0x7fbae40f8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 --2- 172.21.15.100:0/3718418119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae40f8f70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbae40d25b0 tx=0x7fbad002b910 comp rx=0 tx=0).stop 2024-02-21T07:54:01.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 -- 172.21.15.100:0/3718418119 shutdown_connections 2024-02-21T07:54:01.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 --2- 172.21.15.100:0/3718418119 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae40f8f70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 --2- 172.21.15.100:0/3718418119 >> v2:172.21.15.170:3300/0 conn(0x7fbae40f94b0 0x7fbae406d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 -- 172.21.15.100:0/3718418119 >> 172.21.15.100:0/3718418119 conn(0x7fbae40ce150 msgr2=0x7fbae40ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 -- 172.21.15.100:0/3718418119 shutdown_connections 2024-02-21T07:54:01.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.807+0000 7fbaea600640 1 -- 172.21.15.100:0/3718418119 wait complete. 2024-02-21T07:54:01.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.810+0000 7fbaea600640 1 Processor -- start 2024-02-21T07:54:01.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.811+0000 7fbaea600640 1 -- start start 2024-02-21T07:54:01.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.812+0000 7fbaea600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.812+0000 7fbaea600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbae40f94b0 0x7fbae4172390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.812+0000 7fbaea600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35568/0 (socket says 172.21.15.100:35568) 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae415dd30 con 0x7fbae417d0b0 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 -- 172.21.15.100:0/3904129199 learned_addr learned my addr 172.21.15.100:0/3904129199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae416a4f0 con 0x7fbae40cb800 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae41653a0 con 0x7fbae40f94b0 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbae40f94b0 0x7fbae4172390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 -- 172.21.15.100:0/3904129199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbae40f94b0 msgr2=0x7fbae4172390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbae40f94b0 0x7fbae4172390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 -- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 msgr2=0x7fbae415d7f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae415d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.813+0000 7fbae9c00640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0009400 con 0x7fbae417d0b0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbae9c00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00b990 tx=0x7fbadc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbae0c00640 1 -- 172.21.15.100:0/3904129199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc01dbb0 con 0x7fbae417d0b0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae4172dd0 con 0x7fbae417d0b0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbae0c00640 1 -- 172.21.15.100:0/3904129199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc01dd10 con 0x7fbae417d0b0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbae0c00640 1 -- 172.21.15.100:0/3904129199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc025680 con 0x7fbae417d0b0 2024-02-21T07:54:01.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.814+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4173390 con 0x7fbae417d0b0 2024-02-21T07:54:01.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.819+0000 7fbae0c00640 1 -- 172.21.15.100:0/3904129199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbadc02e3b0 con 0x7fbae417d0b0 2024-02-21T07:54:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.822+0000 7fbaee9fb740 1 Processor -- start 2024-02-21T07:54:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.822+0000 7fbaee9fb740 1 -- start start 2024-02-21T07:54:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.823+0000 7fbae0c00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 0x7fbac40a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.823+0000 7fbae0c00640 1 -- 172.21.15.100:0/3904129199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbadc0daba0 con 0x7fbae417d0b0 2024-02-21T07:54:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.823+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 0x7fbac40a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.824+0000 7fbae3e00640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 0x7fbac40a15e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbad0036000 tx=0x7fbad003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.825+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 0x55c82505c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbae9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 0x55c82505c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbae9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 0x55c82505c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45258/0 (socket says 172.21.15.100:45258) 2024-02-21T07:54:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbae3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbae3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47996/0 (socket says 172.21.15.100:47996) 2024-02-21T07:54:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.826+0000 7fbae3e00640 1 -- 172.21.15.100:0/2137604624 learned_addr learned my addr 172.21.15.100:0/2137604624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.827+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c8250984d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.827+0000 7fbae9c00640 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c8250984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.828+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824f8f210 con 0x55c825097740 2024-02-21T07:54:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.828+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824f8c740 con 0x55c82505c990 2024-02-21T07:54:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.828+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824f87f20 con 0x55c82505c070 2024-02-21T07:54:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 -- 172.21.15.100:0/2137604624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 msgr2=0x55c82505c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 0x55c82505c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 -- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 msgr2=0x55c8250984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c8250984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 -- 172.21.15.100:0/2137604624 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c824f49df0 con 0x55c82505c990 2024-02-21T07:54:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.829+0000 7fbae3e00640 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbad002bf20 tx=0x7fbad0030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502a28543ed3fd1b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.830+0000 7fbad5600640 1 -- 172.21.15.100:0/2137604624 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad004a070 con 0x55c82505c990 2024-02-21T07:54:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.830+0000 7fbad5600640 1 -- 172.21.15.100:0/2137604624 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0031e10 con 0x55c82505c990 2024-02-21T07:54:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.830+0000 7fbad5600640 1 -- 172.21.15.100:0/2137604624 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad004f470 con 0x55c82505c990 2024-02-21T07:54:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.830+0000 7fbae9c00640 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c8250984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 msgr2=0x55c825097200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fbad002bf20 tx=0x7fbad0030000 comp rx=0 tx=0).stop 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 shutdown_connections 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c8250984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c825097200 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2137604624 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c070 0x55c82505c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 >> 172.21.15.100:0/2137604624 conn(0x55c82501e640 msgr2=0x55c82501f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 shutdown_connections 2024-02-21T07:54:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.831+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2137604624 wait complete. 2024-02-21T07:54:01.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.833+0000 7fbaee9fb740 1 -- start start 2024-02-21T07:54:01.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.833+0000 7fbaee9fb740 1 Processor -- start 2024-02-21T07:54:01.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.835+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c82505c990 0x55c825046ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.835+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.835+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c8250524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.836+0000 7fbae3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.836+0000 7fbae3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48004/0 (socket says 172.21.15.100:48004) 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 -- 172.21.15.100:0/186959146 learned_addr learned my addr 172.21.15.100:0/186959146 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824f2d150 con 0x55c82505c990 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824f2cdf0 con 0x55c825097740 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c824cf61c0 con 0x55c825052060 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbaee9fb740 10 client.0 _ll_register_callbacks cb 0x55c824f7c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:01.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 -- 172.21.15.100:0/186959146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 msgr2=0x55c8250524d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c8250524d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 -- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c82505c990 msgr2=0x55c825046ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c82505c990 0x55c825046ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.837+0000 7fbae3e00640 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae406eb10 con 0x55c825097740 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.838+0000 7fbae3e00640 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009860 tx=0x7fbad0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72da42fe6361571f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.838+0000 7fbaca000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:01.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.838+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad004a040 con 0x55c825097740 2024-02-21T07:54:01.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.838+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbad003f070 con 0x55c825097740 2024-02-21T07:54:01.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.838+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c824c877e0 con 0x55c825097740 2024-02-21T07:54:01.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.839+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad004fd30 con 0x55c825097740 2024-02-21T07:54:01.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.839+0000 7fbaee9fb740 10 client.6760 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.839+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c824f865a0 con 0x55c825097740 2024-02-21T07:54:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.841+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c824c877e0 con 0x55c825097740 2024-02-21T07:54:01.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.842+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbad0058410 con 0x55c825097740 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.842+0000 7fbaee9fb740 10 client.6760 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.842+0000 7fbaee9fb740 10 client.6760 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.842+0000 7fbaee9fb740 20 client.6760 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.842+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c8250a0ce0 0x55c8250a1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.843+0000 7fbaee9fb740 4 client.6760 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:01.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.843+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c824cc4720 con 0x55c8250a0ce0 2024-02-21T07:54:01.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.843+0000 7fbae9200640 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c8250a0ce0 0x55c8250a1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.850+0000 7fbaca000640 10 client.6760 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.850+0000 7fbae9200640 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c8250a0ce0 0x55c8250a1100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ef534124c88e308 server_cookie=604eb6d79e52cbd3 in_seq=0 out_seq=0 2024-02-21T07:54:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.851+0000 7fbaca000640 1 -- 172.21.15.100:0/186959146 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c824cc4720 con 0x55c8250a0ce0 2024-02-21T07:54:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.851+0000 7fbaca000640 10 client.6760 handle_command_reply: tid=0 2024-02-21T07:54:01.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.852+0000 7fbaee9fb740 1 client.6760 shutdown 2024-02-21T07:54:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.859+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 msgr2=0x55c82509ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.859+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009860 tx=0x7fbad0004730 comp rx=0 tx=0).stop 2024-02-21T07:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 shutdown_connections 2024-02-21T07:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c8250a0ce0 0x55c8250a1100 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c8250524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c82509ebf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/186959146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c82505c990 0x55c825046ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 >> 172.21.15.100:0/186959146 conn(0x55c82505c070 msgr2=0x55c8250200b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.867+0000 7fbaca000640 0 client.6760 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:01.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.871+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 shutdown_connections 2024-02-21T07:54:01.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.872+0000 7fbaee9fb740 1 -- 172.21.15.100:0/186959146 wait complete. 2024-02-21T07:54:01.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.872+0000 7fbaee9fb740 20 client.6760 trim_cache size 0 max 16384 2024-02-21T07:54:01.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.911+0000 7fbaee9fb740 1 Processor -- start 2024-02-21T07:54:01.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.911+0000 7fbaee9fb740 1 -- start start 2024-02-21T07:54:01.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c82501d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c8250b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c825039a40 con 0x55c825097740 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c825052e10 con 0x55c82505c990 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82501fa90 con 0x55c825052060 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbae9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35592/0 (socket says 172.21.15.100:35592) 2024-02-21T07:54:01.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.913+0000 7fbae9c00640 1 -- 172.21.15.100:0/2088667620 learned_addr learned my addr 172.21.15.100:0/2088667620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 -- 172.21.15.100:0/2088667620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 msgr2=0x55c82501d720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c82501d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 -- 172.21.15.100:0/2088667620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 msgr2=0x55c8250b1420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c8250b1420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 -- 172.21.15.100:0/2088667620 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c824f22ab0 con 0x55c825097740 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbae9c00640 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbadc01d6b0 tx=0x7fbadc0a8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a76189914bbd135 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.914+0000 7fbad4c00640 1 -- 172.21.15.100:0/2088667620 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0b0e20 con 0x55c825097740 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.915+0000 7fbad4c00640 1 -- 172.21.15.100:0/2088667620 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc0d8650 con 0x55c825097740 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.915+0000 7fbad4c00640 1 -- 172.21.15.100:0/2088667620 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0a88e0 con 0x55c825097740 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.915+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2088667620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 msgr2=0x55c825046df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.915+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbadc01d6b0 tx=0x7fbadc0a8d80 comp rx=0 tx=0).stop 2024-02-21T07:54:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2088667620 shutdown_connections 2024-02-21T07:54:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825097740 0x55c825046df0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c82505c990 0x55c8250b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/2088667620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c825052060 0x55c82501d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2088667620 >> 172.21.15.100:0/2088667620 conn(0x55c82505c070 msgr2=0x55c825097b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2088667620 shutdown_connections 2024-02-21T07:54:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.916+0000 7fbaee9fb740 1 -- 172.21.15.100:0/2088667620 wait complete. 2024-02-21T07:54:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.917+0000 7fbaee9fb740 1 -- start start 2024-02-21T07:54:01.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.917+0000 7fbaee9fb740 1 Processor -- start 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.918+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 0x55c8250f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c8250968f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82501bae0 con 0x55c825052060 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c825096e30 con 0x55c825097740 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c82501b800 con 0x55c82505c990 2024-02-21T07:54:01.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbaee9fb740 10 client.0 _ll_register_callbacks cb 0x7fbad0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35600/0 (socket says 172.21.15.100:35600) 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae9200640 1 -- 172.21.15.100:0/837429976 learned_addr learned my addr 172.21.15.100:0/837429976 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae9c00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c8250968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae3e00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 0x55c8250f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.919+0000 7fbae9200640 1 -- 172.21.15.100:0/837429976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 msgr2=0x55c8250f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:01.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9200640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 0x55c8250f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9200640 1 -- 172.21.15.100:0/837429976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 msgr2=0x55c8250968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9200640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c8250968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9200640 1 -- 172.21.15.100:0/837429976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae4173390 con 0x55c825052060 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9c00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c8250968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae3e00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 0x55c8250f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbae9200640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbad80014c0 tx=0x7fbad8015a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d900a4fe120776 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.920+0000 7fbaca000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad80073b0 con 0x55c825052060 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbad8007510 con 0x55c825052060 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c82501c0a0 con 0x55c825052060 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbad80076d0 con 0x55c825052060 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaee9fb740 10 client.6588 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:01.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.921+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c824f48650 con 0x55c825052060 2024-02-21T07:54:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c82501c0a0 con 0x55c825052060 2024-02-21T07:54:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbad80047e0 con 0x55c825052060 2024-02-21T07:54:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 10 client.6588 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:01.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 10 client.6588 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 20 client.6588 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c825039e00 0x55c8250fec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 4 client.6588 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.923+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fbad0031e10 con 0x55c825039e00 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.924+0000 7fbae3e00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c825039e00 0x55c8250fec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.924+0000 7fbaca000640 10 client.6588 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:01.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.924+0000 7fbae3e00640 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c825039e00 0x55c8250fec90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad1d4d4c0908fabb server_cookie=42eb2841ad96c19 in_seq=0 out_seq=0 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaca000640 1 -- 172.21.15.100:0/837429976 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fbad0031e10 con 0x55c825039e00 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaca000640 10 client.6588 handle_command_reply: tid=0 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 client.6588 shutdown 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 msgr2=0x55c82501b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbad80014c0 tx=0x7fbad8015a10 comp rx=0 tx=0).stop 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 shutdown_connections 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c825039e00 0x55c8250fec90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c825097740 0x55c8250968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c82505c990 0x55c8250f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 --2- 172.21.15.100:0/837429976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c825052060 0x55c82501b1a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 >> 172.21.15.100:0/837429976 conn(0x55c82505c070 msgr2=0x55c82501a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaca000640 0 client.6588 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:01.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 shutdown_connections 2024-02-21T07:54:01.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 1 -- 172.21.15.100:0/837429976 wait complete. 2024-02-21T07:54:01.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.925+0000 7fbaee9fb740 20 client.6588 trim_cache size 0 max 16384 2024-02-21T07:54:01.929 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 msgr2=0x7fbac40a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 0x7fbac40a15e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbad0036000 tx=0x7fbad003c040 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 msgr2=0x7fbae4165830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00b990 tx=0x7fbadc00be50 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 shutdown_connections 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbac409f120 0x7fbac40a15e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbae417d0b0 0x7fbae4165830 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbae40f94b0 0x7fbae4172390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 --2- 172.21.15.100:0/3904129199 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbae40cb800 0x7fbae415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.926+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 >> 172.21.15.100:0/3904129199 conn(0x7fbae40ce150 msgr2=0x7fbae4183cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.927+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 shutdown_connections 2024-02-21T07:54:01.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:01.927+0000 7fbaea600640 1 -- 172.21.15.100:0/3904129199 wait complete. 2024-02-21T07:54:01.954 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:01.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:54:02.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.296+0000 7f6e9d200640 1 Processor -- start 2024-02-21T07:54:02.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.297+0000 7f6e9d200640 1 -- start start 2024-02-21T07:54:02.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.300+0000 7f6e95e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6e9817e970 0x7f6e98070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39654/0 (socket says 172.21.15.100:39654) 2024-02-21T07:54:02.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.300+0000 7f6e95e00640 1 -- 172.21.15.100:0/2227880353 learned_addr learned my addr 172.21.15.100:0/2227880353 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.300+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980f4760 con 0x7f6e98185df0 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.300+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e98070d80 con 0x7f6e9817e970 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.300+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980f49b0 con 0x7f6e98184900 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147052992 0 0) 0x7f6e98070d80 con 0x7f6e9817e970 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e7c007930 con 0x7f6e9817e970 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989018940 0 0) 0x7f6e980f4760 con 0x7f6e98185df0 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e98070d80 con 0x7f6e98185df0 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757631742 0 0) 0x7f6e7c007930 con 0x7f6e9817e970 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 >> v1:172.21.15.170:6789/0 conn(0x7f6e98184900 legacy=0x7f6e98184d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 >> v1:172.21.15.100:6789/0 conn(0x7f6e98185df0 legacy=0x7f6e981862a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980f4c90 con 0x7f6e9817e970 2024-02-21T07:54:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f6e880015f0 con 0x7f6e9817e970 2024-02-21T07:54:02.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 >> v1:172.21.15.156:6789/0 conn(0x7f6e9817e970 legacy=0x7f6e98070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.301+0000 7f6e95400640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 0x7f6e7c008320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e95400640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c008bd0 0x7f6e7c009050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e95400640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7c0097e0 0x7f6e7c00fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0106c0 con 0x7f6e7c0097e0 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c010830 con 0x7f6e7c008bd0 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0109f0 con 0x7f6e7c007f40 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e96800640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7c0097e0 0x7f6e7c00fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.302+0000 7f6e8d400640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c008bd0 0x7f6e7c009050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 0x7f6e7c008320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 -- 172.21.15.100:0/2227880353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c008bd0 msgr2=0x7f6e7c009050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c008bd0 0x7f6e7c009050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 -- 172.21.15.100:0/2227880353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7c0097e0 msgr2=0x7f6e7c00fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e7c0097e0 0x7f6e7c00fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e95e00640 1 -- 172.21.15.100:0/2227880353 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980f4c90 con 0x7f6e7c007f40 2024-02-21T07:54:02.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.303+0000 7f6e96800640 1 -- 172.21.15.100:0/2227880353 reap_dead start 2024-02-21T07:54:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.305+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 0x7f6e7c008320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c110 tx=0x7f6e7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c75def7ab2fe56 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.307+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88005ad0 con 0x7f6e7c007f40 2024-02-21T07:54:02.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.307+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88005c30 con 0x7f6e7c007f40 2024-02-21T07:54:02.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.307+0000 7f6e95400640 1 -- 172.21.15.100:0/2227880353 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8802c810 con 0x7f6e7c007f40 2024-02-21T07:54:02.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.308+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 msgr2=0x7f6e7c008320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.308+0000 7f6e9d200640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 0x7f6e7c008320 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c110 tx=0x7f6e7c009c00 comp rx=0 tx=0).stop 2024-02-21T07:54:02.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.309+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 shutdown_connections 2024-02-21T07:54:02.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.309+0000 7f6e9d200640 1 --2- 172.21.15.100:0/2227880353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e7c007f40 0x7f6e7c008320 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.309+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 >> 172.21.15.100:0/2227880353 conn(0x7f6e980668b0 msgr2=0x7f6e98066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.309+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 shutdown_connections 2024-02-21T07:54:02.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.309+0000 7f6e9d200640 1 -- 172.21.15.100:0/2227880353 wait complete. 2024-02-21T07:54:02.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.314+0000 7f6e9d200640 1 Processor -- start 2024-02-21T07:54:02.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.315+0000 7f6e9d200640 1 -- start start 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e980d0f90 0x7f6e98160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 0x7f6e9821b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980d0b70 con 0x7f6e9821b380 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980cf940 con 0x7f6e7c007f40 2024-02-21T07:54:02.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.317+0000 7f6e9d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980cfc10 con 0x7f6e980d0f90 2024-02-21T07:54:02.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.321+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.321+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48032/0 (socket says 172.21.15.100:48032) 2024-02-21T07:54:02.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.321+0000 7f6e95e00640 1 -- 172.21.15.100:0/825699185 learned_addr learned my addr 172.21.15.100:0/825699185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.321+0000 7f6e8d400640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e980d0f90 0x7f6e98160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.321+0000 7f6e96800640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 0x7f6e9821b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.323+0000 7f6e95e00640 1 -- 172.21.15.100:0/825699185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e980d0f90 msgr2=0x7f6e98160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.323+0000 7f6e95e00640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e980d0f90 0x7f6e98160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.323+0000 7f6e95e00640 1 -- 172.21.15.100:0/825699185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 msgr2=0x7f6e9821b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.327+0000 7f6e95e00640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 0x7f6e9821b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.327+0000 7f6e95e00640 1 -- 172.21.15.100:0/825699185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980cfef0 con 0x7f6e7c007f40 2024-02-21T07:54:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.327+0000 7f6e96800640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 0x7f6e9821b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:02.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.327+0000 7f6e95e00640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c110 tx=0x7f6e8802e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.328+0000 7f6e8ea00640 1 -- 172.21.15.100:0/825699185 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8803c070 con 0x7f6e7c007f40 2024-02-21T07:54:02.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.328+0000 7f6e8ea00640 1 -- 172.21.15.100:0/825699185 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8802ca20 con 0x7f6e7c007f40 2024-02-21T07:54:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.329+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980d01d0 con 0x7f6e7c007f40 2024-02-21T07:54:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.330+0000 7f6e8ea00640 1 -- 172.21.15.100:0/825699185 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8803c070 con 0x7f6e7c007f40 2024-02-21T07:54:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.330+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980d0790 con 0x7f6e7c007f40 2024-02-21T07:54:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.338+0000 7f6e8ea00640 1 -- 172.21.15.100:0/825699185 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6e88032070 con 0x7f6e7c007f40 2024-02-21T07:54:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.340+0000 7f6e8ea00640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 0x7f6e740a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.341+0000 7f6e8ea00640 1 -- 172.21.15.100:0/825699185 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e880ea470 con 0x7f6e7c007f40 2024-02-21T07:54:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.341+0000 7f6e8d400640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 0x7f6e740a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.343+0000 7f6e8d400640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 0x7f6e740a15f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e98217d50 tx=0x7f6e80009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.347+0000 7f6e9ffb1740 1 Processor -- start 2024-02-21T07:54:02.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.348+0000 7f6e9ffb1740 1 -- start start 2024-02-21T07:54:02.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00edcec0 0x564f00edd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f19320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00e10210 con 0x564f00edd7e0 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00e0d740 con 0x564f00edcec0 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00e08f20 con 0x564f00f18590 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35626/0 (socket says 172.21.15.100:35626) 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e8d400640 1 -- 172.21.15.100:0/941595883 learned_addr learned my addr 172.21.15.100:0/941595883 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.350+0000 7f6e96800640 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f19320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.351+0000 7f6e8d400640 1 -- 172.21.15.100:0/941595883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 msgr2=0x564f00f19320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.351+0000 7f6e8d400640 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f19320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.351+0000 7f6e8d400640 1 -- 172.21.15.100:0/941595883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00edcec0 msgr2=0x564f00edd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.351+0000 7f6e8d400640 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00edcec0 0x564f00edd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.351+0000 7f6e8d400640 1 -- 172.21.15.100:0/941595883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f00dcadf0 con 0x564f00edd7e0 2024-02-21T07:54:02.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.355+0000 7f6e8d400640 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6e80012c10 tx=0x7f6e80015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e1b007ae525c15 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.357+0000 7f6e86a00640 1 -- 172.21.15.100:0/941595883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800159c0 con 0x564f00edd7e0 2024-02-21T07:54:02.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.358+0000 7f6e86a00640 1 -- 172.21.15.100:0/941595883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e80015b20 con 0x564f00edd7e0 2024-02-21T07:54:02.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.358+0000 7f6e86a00640 1 -- 172.21.15.100:0/941595883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80015e90 con 0x564f00edd7e0 2024-02-21T07:54:02.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/941595883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 msgr2=0x564f00f18050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6e80012c10 tx=0x7f6e80015000 comp rx=0 tx=0).stop 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/941595883 shutdown_connections 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f19320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00edd7e0 0x564f00f18050 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/941595883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00edcec0 0x564f00edd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.359+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/941595883 >> 172.21.15.100:0/941595883 conn(0x564f00e9f490 msgr2=0x564f00ea0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.360+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/941595883 shutdown_connections 2024-02-21T07:54:02.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.360+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/941595883 wait complete. 2024-02-21T07:54:02.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.361+0000 7f6e9ffb1740 1 -- start start 2024-02-21T07:54:02.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.361+0000 7f6e9ffb1740 1 Processor -- start 2024-02-21T07:54:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f21800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00dae150 con 0x564f00f1f770 2024-02-21T07:54:02.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00daddf0 con 0x564f00f220b0 2024-02-21T07:54:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00b771c0 con 0x564f00f18590 2024-02-21T07:54:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.364+0000 7f6e9ffb1740 10 client.0 _ll_register_callbacks cb 0x564f00dfd2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:02.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35634/0 (socket says 172.21.15.100:35634) 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 -- 172.21.15.100:0/2746733892 learned_addr learned my addr 172.21.15.100:0/2746733892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 -- 172.21.15.100:0/2746733892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 msgr2=0x564f00f21800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f21800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.365+0000 7f6e8d400640 1 -- 172.21.15.100:0/2746733892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 msgr2=0x564f00ed2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.366+0000 7f6e8d400640 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.366+0000 7f6e8d400640 1 -- 172.21.15.100:0/2746733892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e80012890 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.367+0000 7f6e8d400640 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009010 tx=0x7f6e800011e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bec2cd08d34561f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.367+0000 7f6e7b400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.367+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e800069d0 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.367+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e80006b30 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.368+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f00b087e0 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.368+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e800076d0 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.368+0000 7f6e9ffb1740 10 client.6600 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.368+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564f00e075a0 con 0x564f00f1f770 2024-02-21T07:54:02.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f00b087e0 con 0x564f00f1f770 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e80006cf0 con 0x564f00f1f770 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 10 client.6600 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 10 client.6600 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 20 client.6600 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f22530 0x564f00e9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 4 client.6600 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.369+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f00b45720 con 0x564f00f22530 2024-02-21T07:54:02.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.370+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f22530 0x564f00e9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.371+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f22530 0x564f00e9abe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2866b871be14120c server_cookie=66bd9e1fbabb853c in_seq=0 out_seq=0 2024-02-21T07:54:02.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.371+0000 7f6e7b400640 10 client.6600 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:02.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.371+0000 7f6e7b400640 1 -- 172.21.15.100:0/2746733892 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564f00b45720 con 0x564f00f22530 2024-02-21T07:54:02.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.371+0000 7f6e7b400640 10 client.6600 handle_command_reply: tid=0 2024-02-21T07:54:02.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 client.6600 shutdown 2024-02-21T07:54:02.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 msgr2=0x564f00ec81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009010 tx=0x7f6e800011e0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 shutdown_connections 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f22530 0x564f00e9abe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f1f770 0x564f00ec81c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2746733892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f21800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e7b400640 0 client.6600 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:02.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 >> 172.21.15.100:0/2746733892 conn(0x564f00edcec0 msgr2=0x564f00ed96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.372+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 shutdown_connections 2024-02-21T07:54:02.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.373+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2746733892 wait complete. 2024-02-21T07:54:02.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.373+0000 7f6e9ffb1740 20 client.6600 trim_cache size 0 max 16384 2024-02-21T07:54:02.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.406+0000 7f6e9ffb1740 1 Processor -- start 2024-02-21T07:54:02.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.406+0000 7f6e9ffb1740 1 -- start start 2024-02-21T07:54:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f220b0 0x564f00ee2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18970 0x564f00ecf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00f16ef0 con 0x564f00f220b0 2024-02-21T07:54:02.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00ea7930 con 0x564f00f18590 2024-02-21T07:54:02.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00f32910 con 0x564f00f18970 2024-02-21T07:54:02.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e96800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18970 0x564f00ecf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.408+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48056/0 (socket says 172.21.15.100:48056) 2024-02-21T07:54:02.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.409+0000 7f6e95e00640 1 -- 172.21.15.100:0/2489879192 learned_addr learned my addr 172.21.15.100:0/2489879192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 -- 172.21.15.100:0/2489879192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18970 msgr2=0x564f00ecf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18970 0x564f00ecf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 -- 172.21.15.100:0/2489879192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f220b0 msgr2=0x564f00ee2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f220b0 0x564f00ee2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 -- 172.21.15.100:0/2489879192 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f00da3ab0 con 0x564f00f18590 2024-02-21T07:54:02.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e95e00640 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e88000c00 tx=0x7f6e88001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8340d6f11ebdc6d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e86000640 1 -- 172.21.15.100:0/2489879192 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8802c590 con 0x564f00f18590 2024-02-21T07:54:02.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e86000640 1 -- 172.21.15.100:0/2489879192 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8802ca20 con 0x564f00f18590 2024-02-21T07:54:02.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.410+0000 7f6e86000640 1 -- 172.21.15.100:0/2489879192 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880b8000 con 0x564f00f18590 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2489879192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 msgr2=0x564f00e9e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e88000c00 tx=0x7f6e88001a40 comp rx=0 tx=0).stop 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2489879192 shutdown_connections 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18970 0x564f00ecf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f220b0 0x564f00ee2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/2489879192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f18590 0x564f00e9e570 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.411+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2489879192 >> 172.21.15.100:0/2489879192 conn(0x564f00edcec0 msgr2=0x564f00ed9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.412+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2489879192 shutdown_connections 2024-02-21T07:54:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.412+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/2489879192 wait complete. 2024-02-21T07:54:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.413+0000 7f6e9ffb1740 1 -- start start 2024-02-21T07:54:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.413+0000 7f6e9ffb1740 1 Processor -- start 2024-02-21T07:54:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f18970 0x564f00ecf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00ed6410 con 0x564f00f18970 2024-02-21T07:54:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00f0d6b0 con 0x564f00f220b0 2024-02-21T07:54:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.414+0000 7f6e9ffb1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f00f7a2e0 con 0x564f00f18590 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e9ffb1740 10 client.0 _ll_register_callbacks cb 0x7f6e80012ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45318/0 (socket says 172.21.15.100:45318) 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 -- 172.21.15.100:0/1115391171 learned_addr learned my addr 172.21.15.100:0/1115391171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e96800640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 -- 172.21.15.100:0/1115391171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 msgr2=0x564f00ed19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 -- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f18970 msgr2=0x564f00ecf5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f18970 0x564f00ecf5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.415+0000 7f6e95e00640 1 -- 172.21.15.100:0/1115391171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980d0790 con 0x564f00f18590 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.418+0000 7f6e95e00640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6e880b43d0 tx=0x7f6e80018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62c5a663b170b20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.418+0000 7f6e7b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.418+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880bc0a0 con 0x564f00f18590 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.418+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e880c06f0 con 0x564f00f18590 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.419+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e80015b20 con 0x564f00f18590 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.420+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e880b8000 con 0x564f00f18590 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.420+0000 7f6e9ffb1740 10 client.6710 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:02.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.420+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564f00dc9650 con 0x564f00f18590 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.421+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880b45e0 con 0x564f00f18590 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.422+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6e8802cb90 con 0x564f00f18590 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 10 client.6710 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 10 client.6710 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 20 client.6710 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f120d0 0x564f00ed1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 4 client.6710 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:02.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.423+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f6e80015b20 con 0x564f00f120d0 2024-02-21T07:54:02.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.427+0000 7f6e8d400640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f120d0 0x564f00ed1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e8d400640 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f120d0 0x564f00ed1f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e441682373360108 server_cookie=14e987408bb7713f in_seq=0 out_seq=0 2024-02-21T07:54:02.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e7b400640 10 client.6710 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:02.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e7b400640 1 -- 172.21.15.100:0/1115391171 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f6e80015b20 con 0x564f00f120d0 2024-02-21T07:54:02.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e7b400640 10 client.6710 handle_command_reply: tid=0 2024-02-21T07:54:02.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 client.6710 shutdown 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 msgr2=0x564f00f79da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6e880b43d0 tx=0x7f6e80018000 comp rx=0 tx=0).stop 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 shutdown_connections 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564f00f120d0 0x564f00ed1f00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f00f220b0 0x564f00ed19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f00f18970 0x564f00ecf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e7b400640 0 client.6710 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 --2- 172.21.15.100:0/1115391171 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564f00f18590 0x564f00f79da0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.429+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 >> 172.21.15.100:0/1115391171 conn(0x564f00edcec0 msgr2=0x564f00ec1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.430+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 shutdown_connections 2024-02-21T07:54:02.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.430+0000 7f6e9ffb1740 1 -- 172.21.15.100:0/1115391171 wait complete. 2024-02-21T07:54:02.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.431+0000 7f6e9ffb1740 20 client.6710 trim_cache size 0 max 16384 2024-02-21T07:54:02.436 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.435+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 msgr2=0x7f6e740a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.435+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 0x7f6e740a15f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e98217d50 tx=0x7f6e80009040 comp rx=0 tx=0).stop 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.435+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 msgr2=0x7f6e980cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.435+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c110 tx=0x7f6e8802e070 comp rx=0 tx=0).stop 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 shutdown_connections 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6e7409f130 0x7f6e740a15f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e9821b380 0x7f6e9821b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e980d0f90 0x7f6e98160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 --2- 172.21.15.100:0/825699185 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c007f40 0x7f6e980cf400 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 >> 172.21.15.100:0/825699185 conn(0x7f6e980668b0 msgr2=0x7f6e98071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 shutdown_connections 2024-02-21T07:54:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.436+0000 7f6e9d200640 1 -- 172.21.15.100:0/825699185 wait complete. 2024-02-21T07:54:02.459 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:02.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:54:02.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.791+0000 7f5c76a00640 1 Processor -- start 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.798+0000 7f5c76a00640 1 -- start start 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.806+0000 7f5c76a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c70190260 0x7f5c70070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.806+0000 7f5c76a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 0x7f5c700f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.806+0000 7f5c76a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7018dc80 con 0x7f5c700f4b20 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.806+0000 7f5c76a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700f5b90 con 0x7f5c7006edc0 2024-02-21T07:54:02.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.806+0000 7f5c76a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700f55d0 con 0x7f5c70190260 2024-02-21T07:54:02.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.814+0000 7f5c6fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c70190260 0x7f5c70070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.815+0000 7f5c6fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c70190260 0x7f5c70070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48082/0 (socket says 172.21.15.100:48082) 2024-02-21T07:54:02.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.819+0000 7f5c6fe00640 1 -- 172.21.15.100:0/1127349679 learned_addr learned my addr 172.21.15.100:0/1127349679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.819+0000 7f5c74a00640 1 --2- 172.21.15.100:0/1127349679 >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 0x7f5c700f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.820+0000 7f5c6fe00640 1 -- 172.21.15.100:0/1127349679 >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 msgr2=0x7f5c700f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.821+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/1127349679 >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 0x7f5c700f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.821+0000 7f5c6fe00640 1 -- 172.21.15.100:0/1127349679 >> v1:172.21.15.170:6789/0 conn(0x7f5c700f4b20 legacy=0x7f5c7006e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.821+0000 7f5c6fe00640 1 -- 172.21.15.100:0/1127349679 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c700f58b0 con 0x7f5c70190260 2024-02-21T07:54:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.822+0000 7f5c74a00640 1 --2- 172.21.15.100:0/1127349679 >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 0x7f5c700f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.831+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/1127349679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c70070a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5c7008d4e0 tx=0x7f5c6002b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18cfc95a8019dec3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.831+0000 7f5c6ea00640 1 -- 172.21.15.100:0/1127349679 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c600317f0 con 0x7f5c70190260 2024-02-21T07:54:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.831+0000 7f5c6ea00640 1 -- 172.21.15.100:0/1127349679 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60031950 con 0x7f5c70190260 2024-02-21T07:54:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.831+0000 7f5c6ea00640 1 -- 172.21.15.100:0/1127349679 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60031ce0 con 0x7f5c70190260 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.833+0000 7f5c76a00640 1 -- 172.21.15.100:0/1127349679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 msgr2=0x7f5c70070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.833+0000 7f5c76a00640 1 --2- 172.21.15.100:0/1127349679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c70070a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5c7008d4e0 tx=0x7f5c6002b890 comp rx=0 tx=0).stop 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.834+0000 7f5c76a00640 1 -- 172.21.15.100:0/1127349679 shutdown_connections 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.834+0000 7f5c76a00640 1 --2- 172.21.15.100:0/1127349679 >> v2:172.21.15.100:3300/0 conn(0x7f5c7006edc0 0x7f5c700f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.834+0000 7f5c76a00640 1 --2- 172.21.15.100:0/1127349679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c70070a30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.834+0000 7f5c76a00640 1 -- 172.21.15.100:0/1127349679 >> 172.21.15.100:0/1127349679 conn(0x7f5c700668b0 msgr2=0x7f5c70066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.835+0000 7f5c76a00640 1 -- 172.21.15.100:0/1127349679 shutdown_connections 2024-02-21T07:54:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.835+0000 7f5c76a00640 1 -- 172.21.15.100:0/1127349679 wait complete. 2024-02-21T07:54:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.838+0000 7f5c76a00640 1 Processor -- start 2024-02-21T07:54:02.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.838+0000 7f5c76a00640 1 -- start start 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 0x7f5c7018ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c7016af50 0x7f5c7016b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7018b910 con 0x7f5c700f4b20 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701709e0 con 0x7f5c70190260 2024-02-21T07:54:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c76a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70170cc0 con 0x7f5c7016af50 2024-02-21T07:54:02.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c6fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 0x7f5c7018ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48090/0 (socket says 172.21.15.100:48090) 2024-02-21T07:54:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c6f400640 1 -- 172.21.15.100:0/248257147 learned_addr learned my addr 172.21.15.100:0/248257147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.840+0000 7f5c74a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c7016af50 0x7f5c7016b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.841+0000 7f5c6f400640 1 -- 172.21.15.100:0/248257147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c7016af50 msgr2=0x7f5c7016b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.841+0000 7f5c6f400640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c7016af50 0x7f5c7016b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.841+0000 7f5c6f400640 1 -- 172.21.15.100:0/248257147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 msgr2=0x7f5c7018ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.842+0000 7f5c6f400640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 0x7f5c7018ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.842+0000 7f5c6f400640 1 -- 172.21.15.100:0/248257147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009a70 con 0x7f5c70190260 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.842+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 0x7f5c7018ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.842+0000 7f5c6f400640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c430 tx=0x7f5c5c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.843+0000 7f5c67e00640 1 -- 172.21.15.100:0/248257147 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0052d0 con 0x7f5c70190260 2024-02-21T07:54:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.843+0000 7f5c67e00640 1 -- 172.21.15.100:0/248257147 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c005430 con 0x7f5c70190260 2024-02-21T07:54:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.843+0000 7f5c67e00640 1 -- 172.21.15.100:0/248257147 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c003830 con 0x7f5c70190260 2024-02-21T07:54:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.843+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c600094d0 con 0x7f5c70190260 2024-02-21T07:54:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.843+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70171280 con 0x7f5c70190260 2024-02-21T07:54:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.848+0000 7f5c67e00640 1 -- 172.21.15.100:0/248257147 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5c5c003990 con 0x7f5c70190260 2024-02-21T07:54:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.848+0000 7f5c795e3740 1 Processor -- start 2024-02-21T07:54:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.849+0000 7f5c795e3740 1 -- start start 2024-02-21T07:54:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.851+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 0x55ccb053a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.851+0000 7f5c67e00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 0x7f5c500a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c67e00640 1 -- 172.21.15.100:0/248257147 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c5c0c8fe0 con 0x7f5c70190260 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb0576320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c795e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb046d210 con 0x55ccb053a7e0 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c795e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb046a740 con 0x55ccb0539ec0 2024-02-21T07:54:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.852+0000 7f5c795e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb0465f20 con 0x55ccb0575590 2024-02-21T07:54:02.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 0x7f5c500a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35676/0 (socket says 172.21.15.100:35676) 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 -- 172.21.15.100:0/2945939991 learned_addr learned my addr 172.21.15.100:0/2945939991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 0x55ccb053a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb0576320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 -- 172.21.15.100:0/2945939991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 msgr2=0x55ccb0576320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb0576320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 -- 172.21.15.100:0/2945939991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 msgr2=0x55ccb053a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 0x55ccb053a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.853+0000 7f5c6f400640 1 -- 172.21.15.100:0/2945939991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccb0427df0 con 0x55ccb053a7e0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.854+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 0x55ccb053a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.854+0000 7f5c6f400640 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c09ed70 tx=0x7f5c5c097200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ababd6c88e976cbd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.854+0000 7f5c5be00640 1 -- 172.21.15.100:0/2945939991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c09f2a0 con 0x55ccb053a7e0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.854+0000 7f5c5be00640 1 -- 172.21.15.100:0/2945939991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c094e00 con 0x55ccb053a7e0 2024-02-21T07:54:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.854+0000 7f5c5be00640 1 -- 172.21.15.100:0/2945939991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0aab50 con 0x55ccb053a7e0 2024-02-21T07:54:02.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.855+0000 7f5c795e3740 1 -- 172.21.15.100:0/2945939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 msgr2=0x55ccb0575050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.855+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c09ed70 tx=0x7f5c5c097200 comp rx=0 tx=0).stop 2024-02-21T07:54:02.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 -- 172.21.15.100:0/2945939991 shutdown_connections 2024-02-21T07:54:02.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb0576320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb053a7e0 0x55ccb0575050 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2945939991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb0539ec0 0x55ccb053a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 -- 172.21.15.100:0/2945939991 >> 172.21.15.100:0/2945939991 conn(0x55ccb04fc490 msgr2=0x55ccb04fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 0x7f5c500a1590 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c60036000 tx=0x7f5c6003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 -- 172.21.15.100:0/2945939991 shutdown_connections 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.856+0000 7f5c795e3740 1 -- 172.21.15.100:0/2945939991 wait complete. 2024-02-21T07:54:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.857+0000 7f5c795e3740 1 -- start start 2024-02-21T07:54:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.858+0000 7f5c795e3740 1 Processor -- start 2024-02-21T07:54:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0537230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb04fae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb040b150 con 0x55ccb052a910 2024-02-21T07:54:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb040adf0 con 0x55ccb053a7e0 2024-02-21T07:54:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb01d41c0 con 0x55ccb0575590 2024-02-21T07:54:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.859+0000 7f5c795e3740 10 client.0 _ll_register_callbacks cb 0x55ccb045a2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:02.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.860+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.860+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35690/0 (socket says 172.21.15.100:35690) 2024-02-21T07:54:02.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.860+0000 7f5c74a00640 1 -- 172.21.15.100:0/2146462351 learned_addr learned my addr 172.21.15.100:0/2146462351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.860+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0537230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.861+0000 7f5c74a00640 1 -- 172.21.15.100:0/2146462351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 msgr2=0x55ccb04fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.861+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb04fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.861+0000 7f5c74a00640 1 -- 172.21.15.100:0/2146462351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 msgr2=0x55ccb0537230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.861+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0537230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.861+0000 7f5c74a00640 1 -- 172.21.15.100:0/2146462351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70171280 con 0x55ccb052a910 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.862+0000 7f5c74a00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5c68007220 tx=0x7f5c68008360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbccce2e16e3061 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.862+0000 7f5c58c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.862+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800e050 con 0x55ccb052a910 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.862+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccb01657e0 con 0x55ccb052a910 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.862+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c68008d20 con 0x55ccb052a910 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c68008ee0 con 0x55ccb052a910 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 10 client.6612 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:02.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ccb04645a0 con 0x55ccb052a910 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ccb01657e0 con 0x55ccb052a910 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5c68023440 con 0x55ccb052a910 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 10 client.6612 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 10 client.6612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 20 client.6612 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb04f9f50 0x55ccb04fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 4 client.6612 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.863+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccb01a2720 con 0x55ccb04f9f50 2024-02-21T07:54:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.864+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb04f9f50 0x55ccb04fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.865+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb04f9f50 0x55ccb04fa330 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d438265013ec675 server_cookie=a71ee2e71d0c8463 in_seq=0 out_seq=0 2024-02-21T07:54:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.865+0000 7f5c58c00640 10 client.6612 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.865+0000 7f5c58c00640 1 -- 172.21.15.100:0/2146462351 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ccb01a2720 con 0x55ccb04f9f50 2024-02-21T07:54:02.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.865+0000 7f5c58c00640 10 client.6612 handle_command_reply: tid=0 2024-02-21T07:54:02.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 client.6612 shutdown 2024-02-21T07:54:02.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 msgr2=0x55ccb0523b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5c68007220 tx=0x7f5c68008360 comp rx=0 tx=0).stop 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 shutdown_connections 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb04f9f50 0x55ccb04fa330 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb052a910 0x55ccb0523b80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb0575590 0x55ccb04fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 --2- 172.21.15.100:0/2146462351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0537230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c58c00640 0 client.6612 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 >> 172.21.15.100:0/2146462351 conn(0x55ccb0539ec0 msgr2=0x55ccb04fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 shutdown_connections 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 1 -- 172.21.15.100:0/2146462351 wait complete. 2024-02-21T07:54:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.866+0000 7f5c795e3740 20 client.6612 trim_cache size 0 max 16384 2024-02-21T07:54:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.886+0000 7f5c795e3740 1 Processor -- start 2024-02-21T07:54:02.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.887+0000 7f5c795e3740 1 -- start start 2024-02-21T07:54:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.889+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.889+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb04fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.889+0000 7f5c6fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.890+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.890+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.890+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35706/0 (socket says 172.21.15.100:35706) 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.890+0000 7f5c74a00640 1 -- 172.21.15.100:0/3807985803 learned_addr learned my addr 172.21.15.100:0/3807985803 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.890+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb04fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.891+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb057ef20 con 0x55ccb0575590 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.891+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb053a620 con 0x55ccb053a7e0 2024-02-21T07:54:02.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.891+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb0516770 con 0x55ccb052a910 2024-02-21T07:54:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.892+0000 7f5c74a00640 1 -- 172.21.15.100:0/3807985803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 msgr2=0x55ccb053e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.892+0000 7f5c74a00640 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.892+0000 7f5c74a00640 1 -- 172.21.15.100:0/3807985803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 msgr2=0x55ccb04fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.892+0000 7f5c74a00640 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb04fa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.892+0000 7f5c74a00640 1 -- 172.21.15.100:0/3807985803 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccb0400ab0 con 0x55ccb0575590 2024-02-21T07:54:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.893+0000 7f5c74a00640 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800b010 tx=0x7f5c6801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c822505f69176b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.893+0000 7f5c6f400640 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb04fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.894+0000 7f5c5b400640 1 -- 172.21.15.100:0/3807985803 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800e040 con 0x55ccb0575590 2024-02-21T07:54:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.894+0000 7f5c5b400640 1 -- 172.21.15.100:0/3807985803 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800f040 con 0x55ccb0575590 2024-02-21T07:54:02.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.894+0000 7f5c5b400640 1 -- 172.21.15.100:0/3807985803 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800e040 con 0x55ccb0575590 2024-02-21T07:54:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 msgr2=0x55ccb0515660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800b010 tx=0x7f5c6801b000 comp rx=0 tx=0).stop 2024-02-21T07:54:02.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 shutdown_connections 2024-02-21T07:54:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb0515660 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb04fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3807985803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.896+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 >> 172.21.15.100:0/3807985803 conn(0x55ccb0539ec0 msgr2=0x55ccb0523990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.897+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 shutdown_connections 2024-02-21T07:54:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.897+0000 7f5c795e3740 1 -- 172.21.15.100:0/3807985803 wait complete. 2024-02-21T07:54:02.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.899+0000 7f5c795e3740 1 -- start start 2024-02-21T07:54:02.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.899+0000 7f5c795e3740 1 Processor -- start 2024-02-21T07:54:02.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0585680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb053e8c0 con 0x55ccb0575590 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb0586350 con 0x55ccb053a7e0 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccb051c7b0 con 0x55ccb052a910 2024-02-21T07:54:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.901+0000 7f5c795e3740 10 client.0 _ll_register_callbacks cb 0x7f5c5c092da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.902+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.902+0000 7f5c74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35708/0 (socket says 172.21.15.100:35708) 2024-02-21T07:54:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.902+0000 7f5c74a00640 1 -- 172.21.15.100:0/3318044233 learned_addr learned my addr 172.21.15.100:0/3318044233 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.902+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.902+0000 7f5c6f400640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0585680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.903+0000 7f5c6fe00640 1 -- 172.21.15.100:0/3318044233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 msgr2=0x55ccb0585680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.903+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0585680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.903+0000 7f5c6fe00640 1 -- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 msgr2=0x55ccb04fa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.906+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.906+0000 7f5c6fe00640 1 -- 172.21.15.100:0/3318044233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccb0427df0 con 0x55ccb052a910 2024-02-21T07:54:02.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.907+0000 7f5c74a00640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:02.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.909+0000 7f5c6fe00640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e380 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5c700f5710 tx=0x7f5c60004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809f598d38e5593c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.909+0000 7f5c58c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:54:02.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.911+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6004a040 con 0x55ccb052a910 2024-02-21T07:54:02.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.911+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c60040070 con 0x55ccb052a910 2024-02-21T07:54:02.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.912+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c5c094e00 con 0x55ccb052a910 2024-02-21T07:54:02.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.915+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c600542d0 con 0x55ccb052a910 2024-02-21T07:54:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.915+0000 7f5c795e3740 10 client.6725 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:02.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.915+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ccb04645a0 con 0x55ccb052a910 2024-02-21T07:54:02.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60061030 con 0x55ccb052a910 2024-02-21T07:54:02.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5c60054430 con 0x55ccb052a910 2024-02-21T07:54:02.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 10 client.6725 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:02.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 10 client.6725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:02.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 20 client.6725 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb057f270 0x55ccb05d6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 4 client.6725 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.920+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ccb01f1890 con 0x55ccb057f270 2024-02-21T07:54:02.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.921+0000 7f5c6f400640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb057f270 0x55ccb05d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:02.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.923+0000 7f5c6f400640 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb057f270 0x55ccb05d6010 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90f590f2102a1c30 server_cookie=3de83737b96260fd in_seq=0 out_seq=0 2024-02-21T07:54:02.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.924+0000 7f5c58c00640 10 client.6725 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:02.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.924+0000 7f5c58c00640 1 -- 172.21.15.100:0/3318044233 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ccb01f1890 con 0x55ccb057f270 2024-02-21T07:54:02.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.924+0000 7f5c58c00640 10 client.6725 handle_command_reply: tid=0 2024-02-21T07:54:02.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.925+0000 7f5c795e3740 1 client.6725 shutdown 2024-02-21T07:54:02.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.925+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 msgr2=0x55ccb053e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.925+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e380 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5c700f5710 tx=0x7f5c60004730 comp rx=0 tx=0).stop 2024-02-21T07:54:02.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 shutdown_connections 2024-02-21T07:54:02.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ccb057f270 0x55ccb05d6010 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ccb0575590 0x55ccb04fa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ccb053a7e0 0x55ccb0585680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 --2- 172.21.15.100:0/3318044233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ccb052a910 0x55ccb053e380 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 >> 172.21.15.100:0/3318044233 conn(0x55ccb0539ec0 msgr2=0x55ccb057d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c58c00640 0 client.6725 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.926+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 shutdown_connections 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.927+0000 7f5c795e3740 1 -- 172.21.15.100:0/3318044233 wait complete. 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.927+0000 7f5c795e3740 20 client.6725 trim_cache size 0 max 16384 2024-02-21T07:54:02.933 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:02.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.928+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 msgr2=0x7f5c500a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.928+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 0x7f5c500a1590 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c60036000 tx=0x7f5c6003d040 comp rx=0 tx=0).stop 2024-02-21T07:54:02.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.928+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 msgr2=0x7f5c7018b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:02.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.928+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c430 tx=0x7f5c5c00c830 comp rx=0 tx=0).stop 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 shutdown_connections 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c7016af50 0x7f5c7016b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c70190260 0x7f5c7018b3d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5c5009f0d0 0x7f5c500a1590 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 --2- 172.21.15.100:0/248257147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c700f4b20 0x7f5c7018ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 >> 172.21.15.100:0/248257147 conn(0x7f5c700668b0 msgr2=0x7f5c700f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.929+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 shutdown_connections 2024-02-21T07:54:02.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:02.931+0000 7f5c76a00640 1 -- 172.21.15.100:0/248257147 wait complete. 2024-02-21T07:54:03.978 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:54:03.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:54:03.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:54:04.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.412+0000 7f39cf400640 1 Processor -- start 2024-02-21T07:54:04.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.412+0000 7f39cf400640 1 -- start start 2024-02-21T07:54:04.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f39c8182600 0x7f39c81888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c8188de0 0x7f39c80f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f39c80f8c00 0x7f39c8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80f82a0 con 0x7f39c8188de0 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c80f7c70 con 0x7f39c8182600 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39cf400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c8070470 con 0x7f39c80f8c00 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39c7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c8188de0 0x7f39c80f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.415+0000 7f39c7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c8188de0 0x7f39c80f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35712/0 (socket says 172.21.15.100:35712) 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 -- 172.21.15.100:0/544203551 learned_addr learned my addr 172.21.15.100:0/544203551 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39cca00640 1 --2- 172.21.15.100:0/544203551 >> v2:172.21.15.156:3300/0 conn(0x7f39c8182600 0x7f39c81888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 -- 172.21.15.100:0/544203551 >> v2:172.21.15.170:3300/0 conn(0x7f39c80f8c00 msgr2=0x7f39c8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 --2- 172.21.15.100:0/544203551 >> v2:172.21.15.170:3300/0 conn(0x7f39c80f8c00 0x7f39c8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 -- 172.21.15.100:0/544203551 >> v2:172.21.15.156:3300/0 conn(0x7f39c8182600 msgr2=0x7f39c81888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 --2- 172.21.15.100:0/544203551 >> v2:172.21.15.156:3300/0 conn(0x7f39c8182600 0x7f39c81888a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.416+0000 7f39c7e00640 1 -- 172.21.15.100:0/544203551 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8070750 con 0x7f39c8188de0 2024-02-21T07:54:04.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.418+0000 7f39c7e00640 1 --2- 172.21.15.100:0/544203551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c8188de0 0x7f39c80f86c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f39c808e750 tx=0x7f39b402dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595bf07c60a49bbf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.418+0000 7f39c7400640 1 -- 172.21.15.100:0/544203551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b402eb50 con 0x7f39c8188de0 2024-02-21T07:54:04.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.418+0000 7f39c7400640 1 -- 172.21.15.100:0/544203551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4032070 con 0x7f39c8188de0 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.418+0000 7f39c7400640 1 -- 172.21.15.100:0/544203551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4038400 con 0x7f39c8188de0 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.420+0000 7f39cf400640 1 -- 172.21.15.100:0/544203551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c8188de0 msgr2=0x7f39c80f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.420+0000 7f39cf400640 1 --2- 172.21.15.100:0/544203551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c8188de0 0x7f39c80f86c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f39c808e750 tx=0x7f39b402dda0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.421+0000 7f39cf400640 1 -- 172.21.15.100:0/544203551 shutdown_connections 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.421+0000 7f39cf400640 1 --2- 172.21.15.100:0/544203551 >> v2:172.21.15.170:3300/0 conn(0x7f39c80f8c00 0x7f39c8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.421+0000 7f39cf400640 1 --2- 172.21.15.100:0/544203551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c8188de0 0x7f39c80f86c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.421+0000 7f39cf400640 1 --2- 172.21.15.100:0/544203551 >> v2:172.21.15.156:3300/0 conn(0x7f39c8182600 0x7f39c81888a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.421+0000 7f39cf400640 1 -- 172.21.15.100:0/544203551 >> 172.21.15.100:0/544203551 conn(0x7f39c80668b0 msgr2=0x7f39c8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.422+0000 7f39cf400640 1 -- 172.21.15.100:0/544203551 shutdown_connections 2024-02-21T07:54:04.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.422+0000 7f39cf400640 1 -- 172.21.15.100:0/544203551 wait complete. 2024-02-21T07:54:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.428+0000 7f39cf400640 1 Processor -- start 2024-02-21T07:54:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.428+0000 7f39cf400640 1 -- start start 2024-02-21T07:54:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.430+0000 7f39cf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 0x7f39c822f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.430+0000 7f39cf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c8182600 0x7f39c822f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.431+0000 7f39cf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.431+0000 7f39cf400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c806b780 con 0x7f39c80f8c00 2024-02-21T07:54:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.431+0000 7f39cf400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c806ba60 con 0x7f39c8182600 2024-02-21T07:54:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.431+0000 7f39cf400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c806bd40 con 0x7f39c8188de0 2024-02-21T07:54:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45364/0 (socket says 172.21.15.100:45364) 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 -- 172.21.15.100:0/2536989202 learned_addr learned my addr 172.21.15.100:0/2536989202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39c7e00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c8182600 0x7f39c822f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 -- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c8182600 msgr2=0x7f39c822f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c8182600 0x7f39c822f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cd400640 1 -- 172.21.15.100:0/2536989202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 msgr2=0x7f39c822f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.432+0000 7f39cca00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 0x7f39c822f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.433+0000 7f39cd400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 0x7f39c822f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.433+0000 7f39cd400640 1 -- 172.21.15.100:0/2536989202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b400b760 con 0x7f39c8188de0 2024-02-21T07:54:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.433+0000 7f39cca00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 0x7f39c822f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.433+0000 7f39cd400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b970 tx=0x7f39c000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.434+0000 7f39c4c00640 1 -- 172.21.15.100:0/2536989202 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000cb40 con 0x7f39c8188de0 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.434+0000 7f39c4c00640 1 -- 172.21.15.100:0/2536989202 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000ccc0 con 0x7f39c8188de0 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.434+0000 7f39c4c00640 1 -- 172.21.15.100:0/2536989202 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0014680 con 0x7f39c8188de0 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.434+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c806c020 con 0x7f39c8188de0 2024-02-21T07:54:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.435+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c806c5e0 con 0x7f39c8188de0 2024-02-21T07:54:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.440+0000 7f39c4c00640 1 -- 172.21.15.100:0/2536989202 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f39c001d3b0 con 0x7f39c8188de0 2024-02-21T07:54:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.442+0000 7f39c4c00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 0x7f39a80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.443+0000 7f39c4c00640 1 -- 172.21.15.100:0/2536989202 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f39c00c9bd0 con 0x7f39c8188de0 2024-02-21T07:54:04.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.443+0000 7f39cca00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 0x7f39a80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.444+0000 7f39cca00640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 0x7f39a80a1560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f39bc006fd0 tx=0x7f39bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.444+0000 7f39d21a2740 1 Processor -- start 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.444+0000 7f39d21a2740 1 -- start start 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b78350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b79620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753abd300 con 0x564753b78890 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753a6fe50 con 0x564753b3d1c0 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39d21a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753a6d380 con 0x564753b3dae0 2024-02-21T07:54:04.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39cca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39cca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48158/0 (socket says 172.21.15.100:48158) 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39cca00640 1 -- 172.21.15.100:0/2052930534 learned_addr learned my addr 172.21.15.100:0/2052930534 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.445+0000 7f39c7e00640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b78350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cd400640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b79620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 -- 172.21.15.100:0/2052930534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 msgr2=0x564753b78350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b78350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 -- 172.21.15.100:0/2052930534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 msgr2=0x564753b79620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b79620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 -- 172.21.15.100:0/2052930534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564753a31c80 con 0x564753b3d1c0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cd400640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b79620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39cca00640 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00e8f0 tx=0x7f39bc011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37ceaf52e5b054d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39b9200640 1 -- 172.21.15.100:0/2052930534 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc015640 con 0x564753b3d1c0 2024-02-21T07:54:04.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39b9200640 1 -- 172.21.15.100:0/2052930534 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc0157a0 con 0x564753b3d1c0 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.446+0000 7f39b9200640 1 -- 172.21.15.100:0/2052930534 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc015b10 con 0x564753b3d1c0 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 -- 172.21.15.100:0/2052930534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 msgr2=0x564753b3d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00e8f0 tx=0x7f39bc011000 comp rx=0 tx=0).stop 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 -- 172.21.15.100:0/2052930534 shutdown_connections 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b79620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b78350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 --2- 172.21.15.100:0/2052930534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3d1c0 0x564753b3d5a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 -- 172.21.15.100:0/2052930534 >> 172.21.15.100:0/2052930534 conn(0x564753aff790 msgr2=0x564753b00810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 -- 172.21.15.100:0/2052930534 shutdown_connections 2024-02-21T07:54:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.447+0000 7f39d21a2740 1 -- 172.21.15.100:0/2052930534 wait complete. 2024-02-21T07:54:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.448+0000 7f39d21a2740 1 -- start start 2024-02-21T07:54:04.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.448+0000 7f39d21a2740 1 Processor -- start 2024-02-21T07:54:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.452+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3dae0 0x564753b75d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b328c0 0x564753b6a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753a68b60 con 0x564753b78890 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753a0dfd0 con 0x564753b3dae0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753a0dc70 con 0x564753b328c0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.453+0000 7f39d21a2740 10 client.0 _ll_register_callbacks cb 0x564753779c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.454+0000 7f39c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.454+0000 7f39c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35726/0 (socket says 172.21.15.100:35726) 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.454+0000 7f39c7e00640 1 -- 172.21.15.100:0/639637380 learned_addr learned my addr 172.21.15.100:0/639637380 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.454+0000 7f39cd400640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b328c0 0x564753b6a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.454+0000 7f39cca00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3dae0 0x564753b75d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 -- 172.21.15.100:0/639637380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b328c0 msgr2=0x564753b6a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b328c0 0x564753b6a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 -- 172.21.15.100:0/639637380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3dae0 msgr2=0x564753b75d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3dae0 0x564753b75d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 -- 172.21.15.100:0/639637380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc009e70 con 0x564753b78890 2024-02-21T07:54:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.455+0000 7f39c7e00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f39b402e3b0 tx=0x7f39b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe35b964f9bdf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.456+0000 7f39ad600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.456+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4038b40 con 0x564753b78890 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.456+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f39b4038ca0 con 0x564753b78890 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.457+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564753768860 con 0x564753b78890 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.457+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b4038e60 con 0x564753b78890 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.457+0000 7f39d21a2740 10 client.6624 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:04.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.457+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564753a671e0 con 0x564753b78890 2024-02-21T07:54:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.458+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564753768860 con 0x564753b78890 2024-02-21T07:54:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39b4036030 con 0x564753b78890 2024-02-21T07:54:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 10 client.6624 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 10 client.6624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:04.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 20 client.6624 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:04.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753afbec0 0x564753afc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 4 client.6624 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:04.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.459+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647537b9410 con 0x564753afbec0 2024-02-21T07:54:04.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.462+0000 7f39cca00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753afbec0 0x564753afc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.463+0000 7f39cca00640 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753afbec0 0x564753afc2a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735f66c72b2d491c server_cookie=87771a4f9ae69ffa in_seq=0 out_seq=0 2024-02-21T07:54:04.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.463+0000 7f39ad600640 10 client.6624 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.466+0000 7f39ad600640 1 -- 172.21.15.100:0/639637380 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5647537b9410 con 0x564753afbec0 2024-02-21T07:54:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.466+0000 7f39ad600640 10 client.6624 handle_command_reply: tid=0 2024-02-21T07:54:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.466+0000 7f39d21a2740 1 client.6624 shutdown 2024-02-21T07:54:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.467+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 msgr2=0x564753b27e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.467+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f39b402e3b0 tx=0x7f39b4004730 comp rx=0 tx=0).stop 2024-02-21T07:54:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 shutdown_connections 2024-02-21T07:54:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753afbec0 0x564753afc2a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b328c0 0x564753b6a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b27e20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 --2- 172.21.15.100:0/639637380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b3dae0 0x564753b75d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.468+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 >> 172.21.15.100:0/639637380 conn(0x564753b3d1c0 msgr2=0x564753b01200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.469+0000 7f39ad600640 0 client.6624 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.469+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 shutdown_connections 2024-02-21T07:54:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.469+0000 7f39d21a2740 1 -- 172.21.15.100:0/639637380 wait complete. 2024-02-21T07:54:04.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.469+0000 7f39d21a2740 20 client.6624 trim_cache size 0 max 16384 2024-02-21T07:54:04.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.528+0000 7f39d21a2740 1 Processor -- start 2024-02-21T07:54:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.528+0000 7f39d21a2740 1 -- start start 2024-02-21T07:54:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753afe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 0x564753b6aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647537b10c0 con 0x564753b3dae0 2024-02-21T07:54:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753b3ce90 con 0x564753b328c0 2024-02-21T07:54:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.530+0000 7f39d21a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753b92400 con 0x564753b78890 2024-02-21T07:54:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.532+0000 7f39cd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.532+0000 7f39cd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45390/0 (socket says 172.21.15.100:45390) 2024-02-21T07:54:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.532+0000 7f39cd400640 1 -- 172.21.15.100:0/1675075291 learned_addr learned my addr 172.21.15.100:0/1675075291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.533+0000 7f39cca00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753afe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.533+0000 7f39c7e00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 0x564753b6aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.538+0000 7f39c7e00640 1 -- 172.21.15.100:0/1675075291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 msgr2=0x564753b007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.539+0000 7f39c7e00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.539+0000 7f39c7e00640 1 -- 172.21.15.100:0/1675075291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 msgr2=0x564753afe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.539+0000 7f39c7e00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753afe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.539+0000 7f39c7e00640 1 -- 172.21.15.100:0/1675075291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564753a03a90 con 0x564753b3dae0 2024-02-21T07:54:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.544+0000 7f39cd400640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.544+0000 7f39cca00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753afe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.551+0000 7f39c7e00640 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 0x564753b6aa90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f39b402e3b0 tx=0x7f39b4040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeebf2094d129a75 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.575+0000 7f39afe00640 1 -- 172.21.15.100:0/1675075291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4004220 con 0x564753b3dae0 2024-02-21T07:54:04.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.575+0000 7f39afe00640 1 -- 172.21.15.100:0/1675075291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b4004380 con 0x564753b3dae0 2024-02-21T07:54:04.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.575+0000 7f39afe00640 1 -- 172.21.15.100:0/1675075291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b4038b40 con 0x564753b3dae0 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.576+0000 7f39d21a2740 1 -- 172.21.15.100:0/1675075291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 msgr2=0x564753b6aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.576+0000 7f39d21a2740 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 0x564753b6aa90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f39b402e3b0 tx=0x7f39b4040000 comp rx=0 tx=0).stop 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.579+0000 7f39d21a2740 1 -- 172.21.15.100:0/1675075291 shutdown_connections 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.579+0000 7f39d21a2740 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b78890 0x564753b007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.579+0000 7f39d21a2740 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b3dae0 0x564753b6aa90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.579+0000 7f39d21a2740 1 --2- 172.21.15.100:0/1675075291 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753afe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.579+0000 7f39d21a2740 1 -- 172.21.15.100:0/1675075291 >> 172.21.15.100:0/1675075291 conn(0x564753b3d1c0 msgr2=0x564753b01200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.580+0000 7f39d21a2740 1 -- 172.21.15.100:0/1675075291 shutdown_connections 2024-02-21T07:54:04.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.580+0000 7f39d21a2740 1 -- 172.21.15.100:0/1675075291 wait complete. 2024-02-21T07:54:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.582+0000 7f39d21a2740 1 -- start start 2024-02-21T07:54:04.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.582+0000 7f39d21a2740 1 Processor -- start 2024-02-21T07:54:04.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.591+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753b2e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.591+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.591+0000 7f39cca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753b2e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.591+0000 7f39cca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753b2e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48176/0 (socket says 172.21.15.100:48176) 2024-02-21T07:54:04.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.597+0000 7f39d21a2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b41680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.597+0000 7f39d21a2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753b3b990 con 0x564753b78890 2024-02-21T07:54:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.597+0000 7f39d21a2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753b2ac40 con 0x564753b328c0 2024-02-21T07:54:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.597+0000 7f39d21a2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564753aff2e0 con 0x564753b3dae0 2024-02-21T07:54:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.597+0000 7f39d21a2740 10 client.0 _ll_register_callbacks cb 0x7f39bc009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:04.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.598+0000 7f39cca00640 1 -- 172.21.15.100:0/909163206 learned_addr learned my addr 172.21.15.100:0/909163206 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.598+0000 7f39cd400640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b41680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.599+0000 7f39cd400640 1 -- 172.21.15.100:0/909163206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 msgr2=0x564753b2ba00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.599+0000 7f39cd400640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b2ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.599+0000 7f39cd400640 1 -- 172.21.15.100:0/909163206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 msgr2=0x564753b2e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.599+0000 7f39cd400640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753b2e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.599+0000 7f39cd400640 1 -- 172.21.15.100:0/909163206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564753a31c80 con 0x564753b78890 2024-02-21T07:54:04.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.600+0000 7f39ad600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:04.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.600+0000 7f39cd400640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b41680 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f39c0097410 tx=0x7f39c0093a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c85c697334c53cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:04.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.601+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00af370 con 0x564753b78890 2024-02-21T07:54:04.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.602+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f39c009feb0 con 0x564753b78890 2024-02-21T07:54:04.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.603+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564753afd900 con 0x564753b78890 2024-02-21T07:54:04.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.610+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39c00822c0 con 0x564753b78890 2024-02-21T07:54:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.610+0000 7f39d21a2740 10 client.6630 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.610+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f39c806c5e0 con 0x564753b78890 2024-02-21T07:54:04.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.613+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564753afd900 con 0x564753b78890 2024-02-21T07:54:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.614+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39c009fa20 con 0x564753b78890 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 10 client.6630 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 10 client.6630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 20 client.6630 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753b76050 0x564753b21320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 4 client.6630 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:54:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.615+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f39bc0157a0 con 0x564753b76050 2024-02-21T07:54:04.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.617+0000 7f39cca00640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753b76050 0x564753b21320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.619+0000 7f39ad600640 10 client.6630 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.620+0000 7f39cca00640 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753b76050 0x564753b21320 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d71c2bf998ef56 server_cookie=3155cb4e29d66473 in_seq=0 out_seq=0 2024-02-21T07:54:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.625+0000 7f39ad600640 1 -- 172.21.15.100:0/909163206 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f39bc0157a0 con 0x564753b76050 2024-02-21T07:54:04.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.625+0000 7f39ad600640 10 client.6630 handle_command_reply: tid=0 2024-02-21T07:54:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.626+0000 7f39d21a2740 1 client.6630 shutdown 2024-02-21T07:54:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.627+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 msgr2=0x564753b41680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.627+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b41680 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f39c0097410 tx=0x7f39c0093a50 comp rx=0 tx=0).stop 2024-02-21T07:54:04.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 shutdown_connections 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x564753b76050 0x564753b21320 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564753b78890 0x564753b41680 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564753b3dae0 0x564753b2ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 --2- 172.21.15.100:0/909163206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564753b328c0 0x564753b2e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 >> 172.21.15.100:0/909163206 conn(0x564753b3d1c0 msgr2=0x564753b27a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.628+0000 7f39ad600640 0 client.6630 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:04.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.630+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 shutdown_connections 2024-02-21T07:54:04.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.630+0000 7f39d21a2740 1 -- 172.21.15.100:0/909163206 wait complete. 2024-02-21T07:54:04.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.630+0000 7f39d21a2740 20 client.6630 trim_cache size 0 max 16384 2024-02-21T07:54:04.634 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:04.634 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:54:04.634 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "f01f2312-c917-4993-81bf-699c71b1ef1f", 2024-02-21T07:54:04.634 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:54:04.634 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.634+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 msgr2=0x7f39a80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.634+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 0x7f39a80a1560 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f39bc006fd0 tx=0x7f39bc008040 comp rx=0 tx=0).stop 2024-02-21T07:54:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.634+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 msgr2=0x7f39c806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:04.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.634+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f39c000b970 tx=0x7f39c000be30 comp rx=0 tx=0).stop 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 shutdown_connections 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f39c8188de0 0x7f39c806ab60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c8182600 0x7f39c822f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f39a809f0a0 0x7f39a80a1560 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 --2- 172.21.15.100:0/2536989202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c80f8c00 0x7f39c822f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.635+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 >> 172.21.15.100:0/2536989202 conn(0x7f39c80668b0 msgr2=0x7f39c80cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:04.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.637+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 shutdown_connections 2024-02-21T07:54:04.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:04.637+0000 7f39cf400640 1 -- 172.21.15.100:0/2536989202 wait complete. 2024-02-21T07:54:04.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:54:04.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:54:05.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.082+0000 7f4d01a00640 1 Processor -- start 2024-02-21T07:54:05.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.082+0000 7f4d01a00640 1 -- start start 2024-02-21T07:54:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.085+0000 7f4d01a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cfc185b80 0x7f4cfc0fda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.085+0000 7f4d01a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4cfc1872b0 0x7f4cfc188760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4d01a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc186710 con 0x7f4cfc0f8a10 2024-02-21T07:54:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4d01a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0f8e80 con 0x7f4cfc1872b0 2024-02-21T07:54:05.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4d01a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc0d6a00 con 0x7f4cfc185b80 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4cfb400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4cfc0f8a10 0x7f4cfc186ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39666/0 (socket says 172.21.15.100:39666) 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4cfb400640 1 -- 172.21.15.100:0/1416788282 learned_addr learned my addr 172.21.15.100:0/1416788282 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/1416788282 >> v2:172.21.15.156:3300/0 conn(0x7f4cfc185b80 0x7f4cfc0fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.086+0000 7f4d01000640 1 --2- 172.21.15.100:0/1416788282 >> v2:172.21.15.100:3300/0 conn(0x7f4cfc1872b0 0x7f4cfc188760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362790544 0 0) 0x7f4cfc186710 con 0x7f4cfc0f8a10 2024-02-21T07:54:05.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce0003520 con 0x7f4cfc0f8a10 2024-02-21T07:54:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4d01000640 1 -- 172.21.15.100:0/1416788282 >> v2:172.21.15.156:3300/0 conn(0x7f4cfc185b80 msgr2=0x7f4cfc0fda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4d01000640 1 --2- 172.21.15.100:0/1416788282 >> v2:172.21.15.156:3300/0 conn(0x7f4cfc185b80 0x7f4cfc0fda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120024639 0 0) 0x7f4ce0003520 con 0x7f4cfc0f8a10 2024-02-21T07:54:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4d01000640 1 -- 172.21.15.100:0/1416788282 >> v1:172.21.15.156:6789/0 conn(0x7f4cfc0f8a10 legacy=0x7f4cfc186ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.087+0000 7f4d01000640 1 -- 172.21.15.100:0/1416788282 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0f9100 con 0x7f4cfc1872b0 2024-02-21T07:54:05.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.091+0000 7f4d01000640 1 --2- 172.21.15.100:0/1416788282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc188760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0674b0 tx=0x7f4cf402bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e116c644b80e1652 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.092+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8001670 con 0x7f4cfc1872b0 2024-02-21T07:54:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.092+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf402c830 con 0x7f4cfc1872b0 2024-02-21T07:54:05.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.092+0000 7f4cfaa00640 1 -- 172.21.15.100:0/1416788282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf402cbc0 con 0x7f4cfc1872b0 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 -- 172.21.15.100:0/1416788282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc1872b0 msgr2=0x7f4cfc188760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1416788282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc188760 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc0674b0 tx=0x7f4cf402bd00 comp rx=0 tx=0).stop 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 -- 172.21.15.100:0/1416788282 shutdown_connections 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1416788282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc188760 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1416788282 >> v2:172.21.15.156:3300/0 conn(0x7f4cfc185b80 0x7f4cfc0fda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 -- 172.21.15.100:0/1416788282 >> 172.21.15.100:0/1416788282 conn(0x7f4cfc0d2560 msgr2=0x7f4cfc0d2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 -- 172.21.15.100:0/1416788282 shutdown_connections 2024-02-21T07:54:05.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.093+0000 7f4d01a00640 1 -- 172.21.15.100:0/1416788282 wait complete. 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.096+0000 7f4d01a00640 1 Processor -- start 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.096+0000 7f4d01a00640 1 -- start start 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc0f8a10 0x7f4cfc1716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc0d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0d33c0 con 0x7f4cfc0f8a10 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc06add0 con 0x7f4cfc185b80 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.097+0000 7f4d01a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc06b390 con 0x7f4cfc1872b0 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.098+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.098+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48194/0 (socket says 172.21.15.100:48194) 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.098+0000 7f4cfb400640 1 -- 172.21.15.100:0/1603535443 learned_addr learned my addr 172.21.15.100:0/1603535443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.098+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc0f8a10 0x7f4cfc1716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4d01000640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc0d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 -- 172.21.15.100:0/1603535443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 msgr2=0x7f4cfc0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc0d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 -- 172.21.15.100:0/1603535443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc0f8a10 msgr2=0x7f4cfc1716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc0f8a10 0x7f4cfc1716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 -- 172.21.15.100:0/1603535443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009a70 con 0x7f4cfc185b80 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4d01000640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc0d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cfb400640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c790 tx=0x7f4ce800cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cf3e00640 1 -- 172.21.15.100:0/1603535443 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8005ad0 con 0x7f4cfc185b80 2024-02-21T07:54:05.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cf3e00640 1 -- 172.21.15.100:0/1603535443 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005c30 con 0x7f4cfc185b80 2024-02-21T07:54:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4cf3e00640 1 -- 172.21.15.100:0/1603535443 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8007070 con 0x7f4cfc185b80 2024-02-21T07:54:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.099+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc0d35f0 con 0x7f4cfc185b80 2024-02-21T07:54:05.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.100+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0d3bb0 con 0x7f4cfc185b80 2024-02-21T07:54:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.104+0000 7f4cf3e00640 1 -- 172.21.15.100:0/1603535443 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4ce80071d0 con 0x7f4cfc185b80 2024-02-21T07:54:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.105+0000 7f4d05d71740 1 Processor -- start 2024-02-21T07:54:05.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.106+0000 7f4d05d71740 1 -- start start 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.106+0000 7f4cf3e00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 0x7f4cdc0a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.106+0000 7f4cf3e00640 1 -- 172.21.15.100:0/1603535443 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ce80c9880 con 0x7f4cfc185b80 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d01000640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 0x7f4cdc0a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8406c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83940c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8308150 con 0x557ec8407150 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8305680 con 0x557ec83d1ab0 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d05d71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8300e60 con 0x557ec83d1190 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.107+0000 7f4d01000640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 0x7f4cdc0a1610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4036000 tx=0x7f4cf4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35770/0 (socket says 172.21.15.100:35770) 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 -- 172.21.15.100:0/416828789 learned_addr learned my addr 172.21.15.100:0/416828789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4d01000640 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83940c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8406c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 -- 172.21.15.100:0/416828789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 msgr2=0x557ec8406c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8406c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 -- 172.21.15.100:0/416828789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 msgr2=0x557ec83940c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83940c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.108+0000 7f4cfb400640 1 -- 172.21.15.100:0/416828789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec82ba060 con 0x557ec8407150 2024-02-21T07:54:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.109+0000 7f4cfb400640 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4ce809f5d0 tx=0x7f4ce80b6190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46302b2b70050bab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.109+0000 7f4cf0c00640 1 -- 172.21.15.100:0/416828789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce809b4b0 con 0x557ec8407150 2024-02-21T07:54:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.109+0000 7f4cf0c00640 1 -- 172.21.15.100:0/416828789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce809fb00 con 0x557ec8407150 2024-02-21T07:54:05.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.109+0000 7f4cf0c00640 1 -- 172.21.15.100:0/416828789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80c7330 con 0x557ec8407150 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.110+0000 7f4d05d71740 1 -- 172.21.15.100:0/416828789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 msgr2=0x557ec83d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.110+0000 7f4d05d71740 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4ce809f5d0 tx=0x7f4ce80b6190 comp rx=0 tx=0).stop 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 -- 172.21.15.100:0/416828789 shutdown_connections 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83940c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec83d1570 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 --2- 172.21.15.100:0/416828789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8406c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 -- 172.21.15.100:0/416828789 >> 172.21.15.100:0/416828789 conn(0x557ec83605a0 msgr2=0x557ec8398080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 -- 172.21.15.100:0/416828789 shutdown_connections 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.111+0000 7f4d05d71740 1 -- 172.21.15.100:0/416828789 wait complete. 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.112+0000 7f4d05d71740 1 -- start start 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.112+0000 7f4d05d71740 1 Processor -- start 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83ab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec82a5ec0 con 0x557ec83d1190 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec82a5b60 con 0x557ec83d1ab0 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec806f1c0 con 0x557ec8407150 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.114+0000 7f4d05d71740 10 client.0 _ll_register_callbacks cb 0x557ec82b9960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:05.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.115+0000 7f4cfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.115+0000 7f4cfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35772/0 (socket says 172.21.15.100:35772) 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.115+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3938562354 learned_addr learned my addr 172.21.15.100:0/3938562354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.115+0000 7f4d01000640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.115+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3938562354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 msgr2=0x557ec83c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.116+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.116+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3938562354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 msgr2=0x557ec83ab370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.116+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83ab370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.116+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3938562354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0d3bb0 con 0x557ec83d1190 2024-02-21T07:54:05.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.116+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4cec014650 tx=0x7f4cec014b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270acd955053576a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.117+0000 7f4ce5600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.117+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec012850 con 0x557ec83d1190 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.117+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4cec01a070 con 0x557ec83d1190 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.118+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ec80007e0 con 0x557ec83d1190 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.119+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cec0129b0 con 0x557ec83d1190 2024-02-21T07:54:05.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.120+0000 7f4d05d71740 10 client.6642 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:05.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.120+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557ec82ff4e0 con 0x557ec83d1190 2024-02-21T07:54:05.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.121+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557ec80007e0 con 0x557ec83d1190 2024-02-21T07:54:05.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.121+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4cec011030 con 0x557ec83d1190 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.122+0000 7f4d05d71740 10 client.6642 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.122+0000 7f4d05d71740 10 client.6642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.122+0000 7f4d05d71740 20 client.6642 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.122+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec841c440 0x557ec841c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.123+0000 7f4d05d71740 4 client.6642 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.123+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ec803d720 con 0x557ec841c440 2024-02-21T07:54:05.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.123+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec841c440 0x557ec841c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.124+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec841c440 0x557ec841c840 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcc87998e82fe42f server_cookie=11128db96de33749 in_seq=0 out_seq=0 2024-02-21T07:54:05.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.125+0000 7f4ce5600640 10 client.6642 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.125+0000 7f4ce5600640 1 -- 172.21.15.100:0/3938562354 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ec803d720 con 0x557ec841c440 2024-02-21T07:54:05.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.125+0000 7f4ce5600640 10 client.6642 handle_command_reply: tid=0 2024-02-21T07:54:05.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.126+0000 7f4d05d71740 1 client.6642 shutdown 2024-02-21T07:54:05.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.126+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 msgr2=0x557ec83fdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.126+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4cec014650 tx=0x7f4cec014b10 comp rx=0 tx=0).stop 2024-02-21T07:54:05.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.127+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 shutdown_connections 2024-02-21T07:54:05.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.127+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec841c440 0x557ec841c840 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.128+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.128+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec83ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.128+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3938562354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1190 0x557ec83fdb90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.128+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 >> 172.21.15.100:0/3938562354 conn(0x557ec83605a0 msgr2=0x557ec8408de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.129+0000 7f4ce5600640 0 client.6642 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.129+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 shutdown_connections 2024-02-21T07:54:05.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.129+0000 7f4d05d71740 1 -- 172.21.15.100:0/3938562354 wait complete. 2024-02-21T07:54:05.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.130+0000 7f4d05d71740 20 client.6642 trim_cache size 0 max 16384 2024-02-21T07:54:05.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.172+0000 7f4d05d71740 1 Processor -- start 2024-02-21T07:54:05.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.172+0000 7f4d05d71740 1 -- start start 2024-02-21T07:54:05.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.174+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8397000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.174+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.175+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec8398be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.175+0000 7f4d05d71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8404c50 con 0x557ec8407150 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.175+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.175+0000 7f4cfb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48232/0 (socket says 172.21.15.100:48232) 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4d05d71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8420a00 con 0x557ec83d1ab0 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4d05d71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8399120 con 0x557ec83d1190 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 -- 172.21.15.100:0/3032536068 learned_addr learned my addr 172.21.15.100:0/3032536068 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4d01000640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec8398be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 -- 172.21.15.100:0/3032536068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 msgr2=0x557ec8397000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8397000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8397000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 -- 172.21.15.100:0/3032536068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 msgr2=0x557ec8398be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec8398be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.176+0000 7f4cfb400640 1 -- 172.21.15.100:0/3032536068 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec829b950 con 0x557ec83d1ab0 2024-02-21T07:54:05.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.177+0000 7f4d01000640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec8398be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:05.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.177+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8397000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.178+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ce809f5d0 tx=0x7f4ce801c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=863b3cca9d3d8744 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.179+0000 7f4ce7e00640 1 -- 172.21.15.100:0/3032536068 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8097130 con 0x557ec83d1ab0 2024-02-21T07:54:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.179+0000 7f4ce7e00640 1 -- 172.21.15.100:0/3032536068 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8095660 con 0x557ec83d1ab0 2024-02-21T07:54:05.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.179+0000 7f4ce7e00640 1 -- 172.21.15.100:0/3032536068 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80939d0 con 0x557ec83d1ab0 2024-02-21T07:54:05.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.183+0000 7f51bf200640 1 Processor -- start 2024-02-21T07:54:05.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.184+0000 7f51bf200640 1 -- start start 2024-02-21T07:54:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.183+0000 7f4d05d71740 1 -- 172.21.15.100:0/3032536068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 msgr2=0x557ec8404fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.183+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4ce809f5d0 tx=0x7f4ce801c000 comp rx=0 tx=0).stop 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 -- 172.21.15.100:0/3032536068 shutdown_connections 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec8407150 0x557ec8398be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1ab0 0x557ec8404fa0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3032536068 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec83d1190 0x557ec8397000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 -- 172.21.15.100:0/3032536068 >> 172.21.15.100:0/3032536068 conn(0x557ec83605a0 msgr2=0x557ec83fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 -- 172.21.15.100:0/3032536068 shutdown_connections 2024-02-21T07:54:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f51bf200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f51b80d0780 0x7f51b80d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f51bf200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 0x7f51b8188ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f51bf200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b8187ef0 con 0x7f51b8182840 2024-02-21T07:54:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f51bf200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b80fec50 con 0x7f51b80d0780 2024-02-21T07:54:05.190 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f51bf200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b8182c20 con 0x7f51b81886c0 2024-02-21T07:54:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.186+0000 7f4d05d71740 1 -- 172.21.15.100:0/3032536068 wait complete. 2024-02-21T07:54:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.187+0000 7f51be800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 0x7f51b8188ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.187+0000 7f51be800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 0x7f51b8188ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45428/0 (socket says 172.21.15.100:45428) 2024-02-21T07:54:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.187+0000 7f51be800640 1 -- 172.21.15.100:0/934119720 learned_addr learned my addr 172.21.15.100:0/934119720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.187+0000 7f51bd400640 1 --2- 172.21.15.100:0/934119720 >> v2:172.21.15.100:3300/0 conn(0x7f51b80d0780 0x7f51b80d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.188+0000 7f4d05d71740 1 -- start start 2024-02-21T07:54:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.188+0000 7f51bd400640 1 -- 172.21.15.100:0/934119720 >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 msgr2=0x7f51b8188ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.188+0000 7f51bd400640 1 --2- 172.21.15.100:0/934119720 >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 0x7f51b8188ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.188+0000 7f51bd400640 1 -- 172.21.15.100:0/934119720 >> v1:172.21.15.170:6789/0 conn(0x7f51b8182840 legacy=0x7f51b8186630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.188+0000 7f51bd400640 1 -- 172.21.15.100:0/934119720 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8186d40 con 0x7f51b80d0780 2024-02-21T07:54:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.189+0000 7f51bd400640 1 --2- 172.21.15.100:0/934119720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b80d0780 0x7f51b80d0c30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f51b80621e0 tx=0x7f51a802b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715e9c242f420ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.190+0000 7f51bca00640 1 -- 172.21.15.100:0/934119720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8033640 con 0x7f51b80d0780 2024-02-21T07:54:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.190+0000 7f51bca00640 1 -- 172.21.15.100:0/934119720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a80337a0 con 0x7f51b80d0780 2024-02-21T07:54:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.190+0000 7f51bca00640 1 -- 172.21.15.100:0/934119720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8033b30 con 0x7f51b80d0780 2024-02-21T07:54:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 -- 172.21.15.100:0/934119720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b80d0780 msgr2=0x7f51b80d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.194 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 --2- 172.21.15.100:0/934119720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b80d0780 0x7f51b80d0c30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f51b80621e0 tx=0x7f51a802b720 comp rx=0 tx=0).stop 2024-02-21T07:54:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 -- 172.21.15.100:0/934119720 shutdown_connections 2024-02-21T07:54:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 --2- 172.21.15.100:0/934119720 >> v2:172.21.15.170:3300/0 conn(0x7f51b81886c0 0x7f51b8188ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 --2- 172.21.15.100:0/934119720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b80d0780 0x7f51b80d0c30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 -- 172.21.15.100:0/934119720 >> 172.21.15.100:0/934119720 conn(0x7f51b80615c0 msgr2=0x7f51b80619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f4d05d71740 1 Processor -- start 2024-02-21T07:54:05.195 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.191+0000 7f51bf200640 1 -- 172.21.15.100:0/934119720 shutdown_connections 2024-02-21T07:54:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.192+0000 7f51bf200640 1 -- 172.21.15.100:0/934119720 wait complete. 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.193+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.193+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1ab0 0x557ec83ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.193+0000 7f4d05d71740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4d05d71740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec84212a0 con 0x557ec83d1ab0 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4d05d71740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec83fa3a0 con 0x557ec83d1190 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4d05d71740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec8398250 con 0x557ec8407150 2024-02-21T07:54:05.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4d05d71740 10 client.0 _ll_register_callbacks cb 0x7f4cec009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f51bf200640 1 Processor -- start 2024-02-21T07:54:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f51bf200640 1 -- start start 2024-02-21T07:54:05.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48244/0 (socket says 172.21.15.100:48244) 2024-02-21T07:54:05.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3665277647 learned_addr learned my addr 172.21.15.100:0/3665277647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1ab0 0x557ec83ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4d01000640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3665277647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 msgr2=0x557ec83ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1ab0 msgr2=0x557ec83ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1ab0 0x557ec83ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.194+0000 7f4cfbe00640 1 -- 172.21.15.100:0/3665277647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0f9100 con 0x557ec83d1190 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.195+0000 7f4cfbe00640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4cec000c00 tx=0x7f4cec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0c4063207f4ec0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.195+0000 7f4ce5600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:05.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.195+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec004040 con 0x557ec83d1190 2024-02-21T07:54:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.195+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4cec000e40 con 0x557ec83d1190 2024-02-21T07:54:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.195+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ce809fb00 con 0x557ec83d1190 2024-02-21T07:54:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b80d0780 0x7f51b816b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cec0041a0 con 0x557ec83d1190 2024-02-21T07:54:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f4d05d71740 10 client.6829 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 0x7f51b8224380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8189ab0 con 0x7f51b81886c0 2024-02-21T07:54:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b82248c0 con 0x7f51b8182840 2024-02-21T07:54:05.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557ec82ba060 con 0x557ec83d1190 2024-02-21T07:54:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bf200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b818ad60 con 0x7f51b80d0780 2024-02-21T07:54:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bd400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48250/0 (socket says 172.21.15.100:48250) 2024-02-21T07:54:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f51bd400640 1 -- 172.21.15.100:0/2229790953 learned_addr learned my addr 172.21.15.100:0/2229790953 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.196+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce809fb00 con 0x557ec83d1190 2024-02-21T07:54:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f51be800640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 0x7f51b8224380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f51bd400640 1 -- 172.21.15.100:0/2229790953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b80d0780 msgr2=0x7f51b816b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4cec011070 con 0x557ec83d1190 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 10 client.6829 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 10 client.6829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 20 client.6829 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec83fd5f0 0x557ec847ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 4 client.6829 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.197+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557ec808c890 con 0x557ec83fd5f0 2024-02-21T07:54:05.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec83fd5f0 0x557ec847ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f51bd400640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b80d0780 0x7f51b816b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f51bd400640 1 -- 172.21.15.100:0/2229790953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 msgr2=0x7f51b8224380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f51bd400640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 0x7f51b8224380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f51bd400640 1 -- 172.21.15.100:0/2229790953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8009400 con 0x7f51b8182840 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.198+0000 7f51be800640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 0x7f51b8224380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.199+0000 7f51bd400640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009890 tx=0x7f51a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.199+0000 7f51b2000640 1 -- 172.21.15.100:0/2229790953 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8030b00 con 0x7f51b8182840 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.199+0000 7f51b2000640 1 -- 172.21.15.100:0/2229790953 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8030c60 con 0x7f51b8182840 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.199+0000 7f51b2000640 1 -- 172.21.15.100:0/2229790953 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a803d410 con 0x7f51b8182840 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.199+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b8189cc0 con 0x7f51b8182840 2024-02-21T07:54:05.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.200+0000 7f4cfb400640 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec83fd5f0 0x557ec847ddc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71bffe2a2090b310 server_cookie=8ccf848564cefb12 in_seq=0 out_seq=0 2024-02-21T07:54:05.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.201+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b818a280 con 0x7f51b8182840 2024-02-21T07:54:05.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4ce5600640 10 client.6829 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4ce5600640 1 -- 172.21.15.100:0/3665277647 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557ec808c890 con 0x557ec83fd5f0 2024-02-21T07:54:05.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4ce5600640 10 client.6829 handle_command_reply: tid=0 2024-02-21T07:54:05.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 client.6829 shutdown 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 msgr2=0x557ec83cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4cec000c00 tx=0x7f4cec0046c0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 shutdown_connections 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557ec83fd5f0 0x557ec847ddc0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557ec8407150 0x557ec83ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557ec83d1ab0 0x557ec83ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 --2- 172.21.15.100:0/3665277647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557ec83d1190 0x557ec83cdb70 secure :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4cec000c00 tx=0x7f4cec0046c0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.202+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 >> 172.21.15.100:0/3665277647 conn(0x557ec83605a0 msgr2=0x557ec840c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.203+0000 7f4ce5600640 0 client.6829 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.203+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 shutdown_connections 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.203+0000 7f4d05d71740 1 -- 172.21.15.100:0/3665277647 wait complete. 2024-02-21T07:54:05.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.203+0000 7f4d05d71740 20 client.6829 trim_cache size 0 max 16384 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "f01f2312-c917-4993-81bf-699c71b1ef1f": { 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "f01f2312-c917-4993-81bf-699c71b1ef1f", 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:54:05.210 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:05.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.205+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 msgr2=0x7f4cdc0a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.205+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 0x7f4cdc0a1610 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4036000 tx=0x7f4cf4030000 comp rx=0 tx=0).stop 2024-02-21T07:54:05.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.205+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 msgr2=0x7f4cfc0d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.205+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c790 tx=0x7f4ce800cc50 comp rx=0 tx=0).stop 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 shutdown_connections 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cfc1872b0 0x7f4cfc0d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cfc185b80 0x7f4cfc0d2940 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4cdc09f150 0x7f4cdc0a1610 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 --2- 172.21.15.100:0/1603535443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cfc0f8a10 0x7f4cfc1716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 >> 172.21.15.100:0/1603535443 conn(0x7f4cfc0d2560 msgr2=0x7f4cfc0d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 shutdown_connections 2024-02-21T07:54:05.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:05.208+0000 7f4d01a00640 1 -- 172.21.15.100:0/1603535443 wait complete. 2024-02-21T07:54:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.209+0000 7f51b2000640 1 -- 172.21.15.100:0/2229790953 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f51a803a050 con 0x7f51b8182840 2024-02-21T07:54:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.211+0000 7f51c3122740 1 Processor -- start 2024-02-21T07:54:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.211+0000 7f51c3122740 1 -- start start 2024-02-21T07:54:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.212+0000 7f51b2000640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 0x7f519c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.212+0000 7f51b2000640 1 -- 172.21.15.100:0/2229790953 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f51a80eb820 con 0x7f51b8182840 2024-02-21T07:54:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51be800640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 0x7f519c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605486286e0 0x5605485b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605485b91a0 0x5605485f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548574620 con 0x5605485f4280 2024-02-21T07:54:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605485268c0 con 0x5605485b91a0 2024-02-21T07:54:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.213+0000 7f51c3122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548523df0 con 0x5605486286e0 2024-02-21T07:54:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.214+0000 7f51be800640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 0x7f519c0a16b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009fd0 tx=0x7f51b400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.214+0000 7f51bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.214+0000 7f51bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35806/0 (socket says 172.21.15.100:35806) 2024-02-21T07:54:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.214+0000 7f51bde00640 1 -- 172.21.15.100:0/1036221439 learned_addr learned my addr 172.21.15.100:0/1036221439 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.214+0000 7f51be800640 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605485b91a0 0x5605485f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bd400640 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605486286e0 0x5605485b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bde00640 1 -- 172.21.15.100:0/1036221439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605486286e0 msgr2=0x5605485b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bde00640 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605486286e0 0x5605485b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bde00640 1 -- 172.21.15.100:0/1036221439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605485b91a0 msgr2=0x5605485f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bde00640 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605485b91a0 0x5605485f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.215+0000 7f51bde00640 1 -- 172.21.15.100:0/1036221439 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605484a0b00 con 0x5605485f4280 2024-02-21T07:54:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.216+0000 7f51bde00640 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097a0 tx=0x7f51ac009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced6ebe4c4d9c3da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.217+0000 7f51a6600640 1 -- 172.21.15.100:0/1036221439 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00bad0 con 0x5605485f4280 2024-02-21T07:54:05.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.217+0000 7f51a6600640 1 -- 172.21.15.100:0/1036221439 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00bc30 con 0x5605485f4280 2024-02-21T07:54:05.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.217+0000 7f51a6600640 1 -- 172.21.15.100:0/1036221439 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac011420 con 0x5605485f4280 2024-02-21T07:54:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.218+0000 7f51c3122740 1 -- 172.21.15.100:0/1036221439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 msgr2=0x5605485b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.218+0000 7f51c3122740 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097a0 tx=0x7f51ac009c60 comp rx=0 tx=0).stop 2024-02-21T07:54:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.219+0000 7f51c3122740 1 -- 172.21.15.100:0/1036221439 shutdown_connections 2024-02-21T07:54:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.219+0000 7f51c3122740 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605485b91a0 0x5605485f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.227 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.219+0000 7f51c3122740 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605486286e0 0x5605485b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.219+0000 7f51c3122740 1 --2- 172.21.15.100:0/1036221439 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485b3650 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.219+0000 7f51c3122740 1 -- 172.21.15.100:0/1036221439 >> 172.21.15.100:0/1036221439 conn(0x5605485804b0 msgr2=0x5605485b7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.222+0000 7f51c3122740 1 -- 172.21.15.100:0/1036221439 shutdown_connections 2024-02-21T07:54:05.228 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.223+0000 7f51c3122740 1 -- 172.21.15.100:0/1036221439 wait complete. 2024-02-21T07:54:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.224+0000 7f51c3122740 1 -- start start 2024-02-21T07:54:05.229 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.224+0000 7f51c3122740 1 Processor -- start 2024-02-21T07:54:05.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.228+0000 7f51c3122740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.228+0000 7f51c3122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.228+0000 7f51c3122740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.228+0000 7f51bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.228+0000 7f51bde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35812/0 (socket says 172.21.15.100:35812) 2024-02-21T07:54:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51bd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51bd400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45464/0 (socket says 172.21.15.100:45464) 2024-02-21T07:54:05.234 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51c3122740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56054851f5d0 con 0x5605485b91a0 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51c3122740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605484c4b50 con 0x5605486286e0 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51c3122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605484c47f0 con 0x5605485f4280 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51c3122740 10 client.0 _ll_register_callbacks cb 0x5605484d8550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48274/0 (socket says 172.21.15.100:48274) 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.229+0000 7f51be800640 1 -- 172.21.15.100:0/2081636280 learned_addr learned my addr 172.21.15.100:0/2081636280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 -- 172.21.15.100:0/2081636280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 msgr2=0x56054863b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 -- 172.21.15.100:0/2081636280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 msgr2=0x56054861d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 -- 172.21.15.100:0/2081636280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac009370 con 0x5605485b91a0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bd400640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51bde00640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097a0 tx=0x7f51ac004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e993aa0094b1275f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f51be800640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f519aa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac004020 con 0x5605485b91a0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.230+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f51ac004180 con 0x5605485b91a0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.231+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5605484f1cd0 con 0x5605485b91a0 2024-02-21T07:54:05.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.231+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51ac004340 con 0x5605485b91a0 2024-02-21T07:54:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.231+0000 7f51c3122740 10 client.6660 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:05.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.231+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56054851dc50 con 0x5605485b91a0 2024-02-21T07:54:05.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.231+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5605484f1cd0 con 0x5605485b91a0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f51ac0035f0 con 0x5605485b91a0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 10 client.6660 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 10 client.6660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 20 client.6660 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485ef9e0 0x5605485efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 4 client.6660 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560548515ce0 con 0x5605485ef9e0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.232+0000 7f51bd400640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485ef9e0 0x5605485efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.234+0000 7f51bd400640 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485ef9e0 0x5605485efdc0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbceb2890f514ae server_cookie=1148165ce2486143 in_seq=0 out_seq=0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.234+0000 7f519aa00640 10 client.6660 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.235+0000 7f519aa00640 1 -- 172.21.15.100:0/2081636280 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560548515ce0 con 0x5605485ef9e0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.235+0000 7f519aa00640 10 client.6660 handle_command_reply: tid=0 2024-02-21T07:54:05.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.235+0000 7f51c3122740 1 client.6660 shutdown 2024-02-21T07:54:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 msgr2=0x5605485ed830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0097a0 tx=0x7f51ac004720 comp rx=0 tx=0).stop 2024-02-21T07:54:05.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 shutdown_connections 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485ef9e0 0x5605485efdc0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x56054861d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485f4280 0x56054863b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 --2- 172.21.15.100:0/2081636280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485b91a0 0x5605485ed830 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 >> 172.21.15.100:0/2081636280 conn(0x5605485804b0 msgr2=0x560548628b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f519aa00640 0 client.6660 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 shutdown_connections 2024-02-21T07:54:05.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.236+0000 7f51c3122740 1 -- 172.21.15.100:0/2081636280 wait complete. 2024-02-21T07:54:05.242 INFO:tasks.cephfs.filesystem:scrub status for tag:f01f2312-c917-4993-81bf-699c71b1ef1f - {'path': '/', 'tag': 'f01f2312-c917-4993-81bf-699c71b1ef1f', 'options': 'recursive,force'} 2024-02-21T07:54:05.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.237+0000 7f51c3122740 20 client.6660 trim_cache size 0 max 16384 2024-02-21T07:54:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.285+0000 7f51c3122740 1 Processor -- start 2024-02-21T07:54:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.285+0000 7f51c3122740 1 -- start start 2024-02-21T07:54:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.287+0000 7f51c3122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.288+0000 7f51c3122740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485beff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.291 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.288+0000 7f51c3122740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x5605485ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.288+0000 7f51c3122740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605485f3f50 con 0x5605485f4280 2024-02-21T07:54:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.289+0000 7f51c3122740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548267e60 con 0x5605486286e0 2024-02-21T07:54:05.292 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.289+0000 7f51c3122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548648b10 con 0x5605485b91a0 2024-02-21T07:54:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.289+0000 7f51be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x5605485ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.293 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.289+0000 7f51bde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.290+0000 7f51bde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45472/0 (socket says 172.21.15.100:45472) 2024-02-21T07:54:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.290+0000 7f51bde00640 1 -- 172.21.15.100:0/3716460679 learned_addr learned my addr 172.21.15.100:0/3716460679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.294 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.290+0000 7f51bd400640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485beff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bde00640 1 -- 172.21.15.100:0/3716460679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 msgr2=0x5605485ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bde00640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x5605485ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.295 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51be800640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x5605485ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bde00640 1 -- 172.21.15.100:0/3716460679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 msgr2=0x5605485beff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bde00640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485beff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bde00640 1 -- 172.21.15.100:0/3716460679 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605484ba530 con 0x5605485b91a0 2024-02-21T07:54:05.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.292+0000 7f51bd400640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485beff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:05.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.294+0000 7f51bde00640 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51ac003c90 tx=0x7f51ac01c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203cd0eb707d494b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.295+0000 7f51a5c00640 1 -- 172.21.15.100:0/3716460679 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac006da0 con 0x5605485b91a0 2024-02-21T07:54:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.295+0000 7f51a5c00640 1 -- 172.21.15.100:0/3716460679 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac0069b0 con 0x5605485b91a0 2024-02-21T07:54:05.298 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.295+0000 7f51a5c00640 1 -- 172.21.15.100:0/3716460679 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac003e20 con 0x5605485b91a0 2024-02-21T07:54:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.297+0000 7f51c3122740 1 -- 172.21.15.100:0/3716460679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 msgr2=0x5605485b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.297+0000 7f51c3122740 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f51ac003c90 tx=0x7f51ac01c040 comp rx=0 tx=0).stop 2024-02-21T07:54:05.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.299+0000 7f51c3122740 1 -- 172.21.15.100:0/3716460679 shutdown_connections 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.299+0000 7f51c3122740 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x5605485ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.299+0000 7f51c3122740 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485beff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.299+0000 7f51c3122740 1 --2- 172.21.15.100:0/3716460679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x5605485b4b80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.299+0000 7f51c3122740 1 -- 172.21.15.100:0/3716460679 >> 172.21.15.100:0/3716460679 conn(0x5605485804b0 msgr2=0x56054861d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.300+0000 7f51c3122740 1 -- 172.21.15.100:0/3716460679 shutdown_connections 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.300+0000 7f51c3122740 1 -- 172.21.15.100:0/3716460679 wait complete. 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.301+0000 7f51c3122740 1 -- start start 2024-02-21T07:54:05.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.302+0000 7f51c3122740 1 Processor -- start 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x560548695fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605486964f0 con 0x5605485f4280 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548696be0 con 0x5605486286e0 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560548617340 con 0x5605485b91a0 2024-02-21T07:54:05.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51c3122740 10 client.0 _ll_register_callbacks cb 0x7f51ac006f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.304+0000 7f51be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51bd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48298/0 (socket says 172.21.15.100:48298) 2024-02-21T07:54:05.308 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 -- 172.21.15.100:0/3632000025 learned_addr learned my addr 172.21.15.100:0/3632000025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 -- 172.21.15.100:0/3632000025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 msgr2=0x560548695fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x560548695fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 -- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 msgr2=0x5605485eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.305+0000 7f51be800640 1 -- 172.21.15.100:0/3632000025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b818a280 con 0x5605486286e0 2024-02-21T07:54:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.306+0000 7f51be800640 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51b4017780 tx=0x7f51b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c4e41e0da56e561 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:05.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.306+0000 7f519aa00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.308+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b401c040 con 0x5605486286e0 2024-02-21T07:54:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.308+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f51b4025b90 con 0x5605486286e0 2024-02-21T07:54:05.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.309+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560548544d30 con 0x5605486286e0 2024-02-21T07:54:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.309+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51b400e040 con 0x5605486286e0 2024-02-21T07:54:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.309+0000 7f51c3122740 10 client.6844 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56054851dc50 con 0x5605486286e0 2024-02-21T07:54:05.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560548544d30 con 0x5605486286e0 2024-02-21T07:54:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f51b402e440 con 0x5605486286e0 2024-02-21T07:54:05.314 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 10 client.6844 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 10 client.6844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 20 client.6844 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485b8480 0x56054867f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 4 client.6844 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.310+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56054821f600 con 0x5605485b8480 2024-02-21T07:54:05.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.312+0000 7f51bde00640 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485b8480 0x56054867f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:05.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.315+0000 7f519aa00640 10 client.6844 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.315+0000 7f51bde00640 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485b8480 0x56054867f810 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20fb87373ee6e007 server_cookie=af072468bfb4c06e in_seq=0 out_seq=0 2024-02-21T07:54:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.357+0000 7f519aa00640 1 -- 172.21.15.100:0/3632000025 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56054821f600 con 0x5605485b8480 2024-02-21T07:54:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.357+0000 7f519aa00640 10 client.6844 handle_command_reply: tid=0 2024-02-21T07:54:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.364+0000 7f51c3122740 1 client.6844 shutdown 2024-02-21T07:54:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.365+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 msgr2=0x560548616ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.365+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f51b4017780 tx=0x7f51b4004a40 comp rx=0 tx=0).stop 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 shutdown_connections 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5605485b8480 0x56054867f810 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5605486286e0 0x560548616ad0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5605485f4280 0x5605485eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 --2- 172.21.15.100:0/3632000025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5605485b91a0 0x560548695fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 >> 172.21.15.100:0/3632000025 conn(0x5605485804b0 msgr2=0x5605485b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.371+0000 7f519aa00640 0 client.6844 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.372+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 shutdown_connections 2024-02-21T07:54:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.372+0000 7f51c3122740 1 -- 172.21.15.100:0/3632000025 wait complete. 2024-02-21T07:54:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.373+0000 7f51c3122740 20 client.6844 trim_cache size 0 max 16384 2024-02-21T07:54:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:54:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:54:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:54:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 msgr2=0x7f519c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 0x7f519c0a16b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009fd0 tx=0x7f51b400b040 comp rx=0 tx=0).stop 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 msgr2=0x7f51b8223e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009890 tx=0x7f51a80046c0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 shutdown_connections 2024-02-21T07:54:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f519c09f1f0 0x7f519c0a16b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51b81886c0 0x7f51b8224380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f51b8182840 0x7f51b8223e40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 --2- 172.21.15.100:0/2229790953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f51b80d0780 0x7f51b816b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 >> 172.21.15.100:0/2229790953 conn(0x7f51b80615c0 msgr2=0x7f51b8186530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 shutdown_connections 2024-02-21T07:54:05.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:05.375+0000 7f51bf200640 1 -- 172.21.15.100:0/2229790953 wait complete. 2024-02-21T07:54:16.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:16.501 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:16.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.591+0000 7fd06f200640 1 Processor -- start 2024-02-21T07:54:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.591+0000 7fd06f200640 1 -- start start 2024-02-21T07:54:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06f200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd0700d0c30 0x7fd070188dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070187ef0 con 0x7fd070182840 2024-02-21T07:54:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06f200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd070186d40 con 0x7fd0700d0780 2024-02-21T07:54:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06f200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0700fec50 con 0x7fd0700d0c30 2024-02-21T07:54:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd070182840 0x7fd070186630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49934/0 (socket says 172.21.15.100:49934) 2024-02-21T07:54:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06de00640 1 -- 172.21.15.100:0/4070206610 learned_addr learned my addr 172.21.15.100:0/4070206610 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.600+0000 7fd06e800640 1 --2- 172.21.15.100:0/4070206610 >> v2:172.21.15.170:3300/0 conn(0x7fd0700d0c30 0x7fd070188dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138415833 0 0) 0x7fd070186d40 con 0x7fd0700d0780 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054003520 con 0x7fd0700d0780 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525561178 0 0) 0x7fd070187ef0 con 0x7fd070182840 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd070186d40 con 0x7fd070182840 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06e800640 1 -- 172.21.15.100:0/4070206610 >> v1:172.21.15.170:6789/0 conn(0x7fd0700d0780 legacy=0x7fd0701886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06e800640 1 -- 172.21.15.100:0/4070206610 >> v1:172.21.15.100:6789/0 conn(0x7fd070182840 legacy=0x7fd070186630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.601+0000 7fd06e800640 1 -- 172.21.15.100:0/4070206610 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070187000 con 0x7fd0700d0c30 2024-02-21T07:54:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.603+0000 7fd06e800640 1 --2- 172.21.15.100:0/4070206610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0c30 0x7fd070188dd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097a0 tx=0x7fd05c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62991b41d93612d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.604+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c02e070 con 0x7fd0700d0c30 2024-02-21T07:54:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.604+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c0315a0 con 0x7fd0700d0c30 2024-02-21T07:54:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.604+0000 7fd06ca00640 1 -- 172.21.15.100:0/4070206610 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c031930 con 0x7fd0700d0c30 2024-02-21T07:54:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.605+0000 7fd06f200640 1 -- 172.21.15.100:0/4070206610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0c30 msgr2=0x7fd070188dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.605+0000 7fd06f200640 1 --2- 172.21.15.100:0/4070206610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0c30 0x7fd070188dd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0097a0 tx=0x7fd05c02b840 comp rx=0 tx=0).stop 2024-02-21T07:54:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.605+0000 7fd06f200640 1 -- 172.21.15.100:0/4070206610 shutdown_connections 2024-02-21T07:54:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.605+0000 7fd06f200640 1 --2- 172.21.15.100:0/4070206610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0c30 0x7fd070188dd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.605+0000 7fd06f200640 1 -- 172.21.15.100:0/4070206610 >> 172.21.15.100:0/4070206610 conn(0x7fd0700615c0 msgr2=0x7fd0700619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.606+0000 7fd06f200640 1 -- 172.21.15.100:0/4070206610 shutdown_connections 2024-02-21T07:54:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.606+0000 7fd06f200640 1 -- 172.21.15.100:0/4070206610 wait complete. 2024-02-21T07:54:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.609+0000 7fd06f200640 1 Processor -- start 2024-02-21T07:54:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.610+0000 7fd06f200640 1 -- start start 2024-02-21T07:54:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 0x7fd070225250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 0x7fd070184970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070182840 0x7fd070172d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070223bf0 con 0x7fd070182840 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd070223ed0 con 0x7fd0700d0c30 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.612+0000 7fd06f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0702241b0 con 0x7fd0700d0780 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.613+0000 7fd06de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 0x7fd070225250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.613+0000 7fd06d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 0x7fd070184970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.613+0000 7fd06de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 0x7fd070225250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48394/0 (socket says 172.21.15.100:48394) 2024-02-21T07:54:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.613+0000 7fd06de00640 1 -- 172.21.15.100:0/3468882142 learned_addr learned my addr 172.21.15.100:0/3468882142 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.614+0000 7fd06e800640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070182840 0x7fd070172d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.615+0000 7fd06d400640 1 -- 172.21.15.100:0/3468882142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 msgr2=0x7fd070225250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.615+0000 7fd06d400640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 0x7fd070225250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.615+0000 7fd06d400640 1 -- 172.21.15.100:0/3468882142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070182840 msgr2=0x7fd070172d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.615+0000 7fd06d400640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070182840 0x7fd070172d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.615+0000 7fd06d400640 1 -- 172.21.15.100:0/3468882142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c009400 con 0x7fd0700d0c30 2024-02-21T07:54:18.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.619+0000 7fd06d400640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 0x7fd070184970 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c390 tx=0x7fd060001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.619+0000 7fd066000640 1 -- 172.21.15.100:0/3468882142 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600052d0 con 0x7fd0700d0c30 2024-02-21T07:54:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.620+0000 7fd066000640 1 -- 172.21.15.100:0/3468882142 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060005430 con 0x7fd0700d0c30 2024-02-21T07:54:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.620+0000 7fd066000640 1 -- 172.21.15.100:0/3468882142 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060003830 con 0x7fd0700d0c30 2024-02-21T07:54:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.620+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd070224490 con 0x7fd0700d0c30 2024-02-21T07:54:18.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.620+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd070224a50 con 0x7fd0700d0c30 2024-02-21T07:54:18.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.625+0000 7fd066000640 1 -- 172.21.15.100:0/3468882142 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd060003990 con 0x7fd0700d0c30 2024-02-21T07:54:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.626+0000 7fd077e26740 1 Processor -- start 2024-02-21T07:54:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.628+0000 7fd066000640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 0x7fd0500a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.629+0000 7fd077e26740 1 -- start start 2024-02-21T07:54:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.631+0000 7fd066000640 1 -- 172.21.15.100:0/3468882142 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd0600c90b0 con 0x7fd0700d0c30 2024-02-21T07:54:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd06e800640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 0x7fd0500a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583b95c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583bd1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583b51620 con 0x55a583bd1280 2024-02-21T07:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583b038c0 con 0x55a583b961a0 2024-02-21T07:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.632+0000 7fd077e26740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583b00df0 con 0x55a583c056e0 2024-02-21T07:54:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50736/0 (socket says 172.21.15.100:50736) 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 -- 172.21.15.100:0/2525734098 learned_addr learned my addr 172.21.15.100:0/2525734098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06d400640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583b95c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06e800640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583bd1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 -- 172.21.15.100:0/2525734098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 msgr2=0x55a583b95c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583b95c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.633+0000 7fd06de00640 1 -- 172.21.15.100:0/2525734098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 msgr2=0x55a583bd1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd06de00640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583bd1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd06de00640 1 -- 172.21.15.100:0/2525734098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a583a7db00 con 0x55a583bd1280 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd06e800640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583bd1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd06de00640 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd068002200 tx=0x7fd068001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215b3865523aa1b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd06e800640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 0x7fd0500a16b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd05c036000 tx=0x7fd05c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd05aa00640 1 -- 172.21.15.100:0/2525734098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680070d0 con 0x55a583bd1280 2024-02-21T07:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd05aa00640 1 -- 172.21.15.100:0/2525734098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068007230 con 0x55a583bd1280 2024-02-21T07:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.634+0000 7fd05aa00640 1 -- 172.21.15.100:0/2525734098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680075a0 con 0x55a583bd1280 2024-02-21T07:54:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.636+0000 7fd077e26740 1 -- 172.21.15.100:0/2525734098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 msgr2=0x55a583b90650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.636+0000 7fd077e26740 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd068002200 tx=0x7fd068001a70 comp rx=0 tx=0).stop 2024-02-21T07:54:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 -- 172.21.15.100:0/2525734098 shutdown_connections 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583bd1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583b95c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 --2- 172.21.15.100:0/2525734098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583b90650 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 -- 172.21.15.100:0/2525734098 >> 172.21.15.100:0/2525734098 conn(0x55a583b5d4b0 msgr2=0x55a583b94eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 -- 172.21.15.100:0/2525734098 shutdown_connections 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.637+0000 7fd077e26740 1 -- 172.21.15.100:0/2525734098 wait complete. 2024-02-21T07:54:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.638+0000 7fd077e26740 1 -- start start 2024-02-21T07:54:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.639+0000 7fd077e26740 1 Processor -- start 2024-02-21T07:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 0x55a583bc7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c07730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583afc5d0 con 0x55a583b961a0 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583aa1b50 con 0x55a583bd1280 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583aa17f0 con 0x55a583c056e0 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd077e26740 10 client.0 _ll_register_callbacks cb 0x55a583ab5550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd06de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd06de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50752/0 (socket says 172.21.15.100:50752) 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd06de00640 1 -- 172.21.15.100:0/783057788 learned_addr learned my addr 172.21.15.100:0/783057788 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd06d400640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 0x55a583bc7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.641+0000 7fd06e800640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c07730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 -- 172.21.15.100:0/783057788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 msgr2=0x55a583c07730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c07730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 -- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 msgr2=0x55a583bfb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 -- 172.21.15.100:0/783057788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd070186d40 con 0x55a583bd1280 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06de00640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd06d400640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 0x55a583bc7420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd0600c6a20 tx=0x7fd060096cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1aca58814a02aef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd04f400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600ae070 con 0x55a583bd1280 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.642+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd0600aabe0 con 0x55a583bd1280 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.643+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a583acecd0 con 0x55a583bd1280 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.643+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0600b4140 con 0x55a583bd1280 2024-02-21T07:54:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.643+0000 7fd077e26740 10 client.6850 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.643+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a583afac50 con 0x55a583bd1280 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.644+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a583acecd0 con 0x55a583bd1280 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.644+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd060095fe0 con 0x55a583bd1280 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 10 client.6850 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 10 client.6850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 20 client.6850 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583c18d40 0x55a583c19160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 4 client.6850 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.645+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a583af2ce0 con 0x55a583c18d40 2024-02-21T07:54:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.646+0000 7fd06de00640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583c18d40 0x55a583c19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.648+0000 7fd06de00640 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583c18d40 0x55a583c19160 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=befca94affad21c6 server_cookie=e4ae559650343c10 in_seq=0 out_seq=0 2024-02-21T07:54:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.648+0000 7fd04f400640 10 client.6850 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.649+0000 7fd04f400640 1 -- 172.21.15.100:0/783057788 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a583af2ce0 con 0x55a583c18d40 2024-02-21T07:54:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.649+0000 7fd04f400640 10 client.6850 handle_command_reply: tid=0 2024-02-21T07:54:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.649+0000 7fd077e26740 1 client.6850 shutdown 2024-02-21T07:54:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.649+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 msgr2=0x55a583bc7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.649+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 0x55a583bc7420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd0600c6a20 tx=0x7fd060096cd0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 shutdown_connections 2024-02-21T07:54:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583c18d40 0x55a583c19160 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd04f400640 0 client.6850 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c07730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583bd1280 0x55a583bc7420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 --2- 172.21.15.100:0/783057788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583b961a0 0x55a583bfb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 >> 172.21.15.100:0/783057788 conn(0x55a583b5d4b0 msgr2=0x55a583c05b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 shutdown_connections 2024-02-21T07:54:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 1 -- 172.21.15.100:0/783057788 wait complete. 2024-02-21T07:54:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.650+0000 7fd077e26740 20 client.6850 trim_cache size 0 max 16384 2024-02-21T07:54:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.671+0000 7fd077e26740 1 Processor -- start 2024-02-21T07:54:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.673+0000 7fd077e26740 1 -- start start 2024-02-21T07:54:18.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c66010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c66550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583844e60 con 0x55a583bd1280 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583c052d0 con 0x55a583b961a0 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.686+0000 7fd077e26740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583c04e10 con 0x55a583c056e0 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.687+0000 7fd06de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.692 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.687+0000 7fd06de00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:48092/0 (socket says 172.21.15.100:48092) 2024-02-21T07:54:18.693 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.687+0000 7fd06de00640 1 -- 172.21.15.100:0/4026509057 learned_addr learned my addr 172.21.15.100:0/4026509057 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.700+0000 7fd06d400640 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c66010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.701+0000 7fd06e800640 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c66550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.701+0000 7fd06de00640 1 -- 172.21.15.100:0/4026509057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 msgr2=0x55a583c66550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.701+0000 7fd06de00640 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c66550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.702+0000 7fd06de00640 1 -- 172.21.15.100:0/4026509057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 msgr2=0x55a583c66010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.702+0000 7fd06de00640 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c66010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.702+0000 7fd06de00640 1 -- 172.21.15.100:0/4026509057 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a583c07e40 con 0x55a583b961a0 2024-02-21T07:54:18.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.704+0000 7fd06de00640 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd068009010 tx=0x7fd06800a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a33d0b056c4b7313 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.705+0000 7fd05a000640 1 -- 172.21.15.100:0/4026509057 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068022040 con 0x55a583b961a0 2024-02-21T07:54:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.705+0000 7fd05a000640 1 -- 172.21.15.100:0/4026509057 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680079a0 con 0x55a583b961a0 2024-02-21T07:54:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.705+0000 7fd05a000640 1 -- 172.21.15.100:0/4026509057 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068001e50 con 0x55a583b961a0 2024-02-21T07:54:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.706+0000 7fd077e26740 1 -- 172.21.15.100:0/4026509057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 msgr2=0x55a583c03ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.706+0000 7fd077e26740 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd068009010 tx=0x7fd06800a000 comp rx=0 tx=0).stop 2024-02-21T07:54:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.711+0000 7fd077e26740 1 -- 172.21.15.100:0/4026509057 shutdown_connections 2024-02-21T07:54:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.711+0000 7fd077e26740 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583c056e0 0x55a583c66550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.711+0000 7fd077e26740 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c66010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.711+0000 7fd077e26740 1 --2- 172.21.15.100:0/4026509057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583b961a0 0x55a583c03ea0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.712+0000 7fd077e26740 1 -- 172.21.15.100:0/4026509057 >> 172.21.15.100:0/4026509057 conn(0x55a583b5d4b0 msgr2=0x55a583bfb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.713+0000 7fd077e26740 1 -- 172.21.15.100:0/4026509057 shutdown_connections 2024-02-21T07:54:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.717+0000 7fd077e26740 1 -- 172.21.15.100:0/4026509057 wait complete. 2024-02-21T07:54:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.720+0000 7fd077e26740 1 -- start start 2024-02-21T07:54:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.722+0000 7fd077e26740 1 Processor -- start 2024-02-21T07:54:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 0x55a583bc6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c648a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583c056e0 0x55a583c731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583c654f0 con 0x55a583bd1280 2024-02-21T07:54:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583bfeac0 con 0x55a583c056e0 2024-02-21T07:54:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a583bc6580 con 0x55a583b961a0 2024-02-21T07:54:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.730+0000 7fd077e26740 10 client.0 _ll_register_callbacks cb 0x7fd068001da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.733+0000 7fd06de00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 0x55a583bc6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.734+0000 7fd06d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.734+0000 7fd06d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50768/0 (socket says 172.21.15.100:50768) 2024-02-21T07:54:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.734+0000 7fd06d400640 1 -- 172.21.15.100:0/528322332 learned_addr learned my addr 172.21.15.100:0/528322332 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.734+0000 7fd06e800640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583c056e0 0x55a583c731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.735+0000 7fd06de00640 1 -- 172.21.15.100:0/528322332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583c056e0 msgr2=0x55a583c731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.735+0000 7fd06de00640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583c056e0 0x55a583c731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.735+0000 7fd06de00640 1 -- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 msgr2=0x55a583c648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.735+0000 7fd06de00640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.735+0000 7fd06de00640 1 -- 172.21.15.100:0/528322332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a583a7db00 con 0x55a583b961a0 2024-02-21T07:54:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.736+0000 7fd04f400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:54:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.736+0000 7fd06de00640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 0x55a583bc6040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd06802a000 tx=0x7fd0680014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a50a614c84ccfc18 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.736+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068022050 con 0x55a583b961a0 2024-02-21T07:54:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.737+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd068007540 con 0x55a583b961a0 2024-02-21T07:54:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.737+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a583b21d30 con 0x55a583b961a0 2024-02-21T07:54:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.737+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd068022050 con 0x55a583b961a0 2024-02-21T07:54:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.738+0000 7fd077e26740 10 client.6779 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.738+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a583a97530 con 0x55a583b961a0 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.738+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06802a440 con 0x55a583b961a0 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd06803b050 con 0x55a583b961a0 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 10 client.6779 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 10 client.6779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 20 client.6779 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583bfaf40 0x55a583c736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 4 client.6779 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:54:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a583b21d30 con 0x55a583bfaf40 2024-02-21T07:54:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.741+0000 7fd06d400640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583bfaf40 0x55a583c736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.742+0000 7fd06d400640 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583bfaf40 0x55a583c736f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3f38a94e4890ee server_cookie=e83e710a95e8cce5 in_seq=0 out_seq=0 2024-02-21T07:54:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.743+0000 7fd04f400640 10 client.6779 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.791+0000 7fd04f400640 1 -- 172.21.15.100:0/528322332 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a583b21d30 con 0x55a583bfaf40 2024-02-21T07:54:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.791+0000 7fd04f400640 10 client.6779 handle_command_reply: tid=0 2024-02-21T07:54:18.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.792+0000 7fd077e26740 1 client.6779 shutdown 2024-02-21T07:54:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.799+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 msgr2=0x55a583bc6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.801 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.799+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 0x55a583bc6040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd06802a000 tx=0x7fd0680014d0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.799+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 shutdown_connections 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.799+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55a583bfaf40 0x55a583c736f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.801+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a583c056e0 0x55a583c731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.801+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a583bd1280 0x55a583c648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.801+0000 7fd077e26740 1 --2- 172.21.15.100:0/528322332 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a583b961a0 0x55a583bc6040 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.801+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 >> 172.21.15.100:0/528322332 conn(0x55a583b5d4b0 msgr2=0x55a583bc1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.802+0000 7fd04f400640 0 client.6779 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.804+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 shutdown_connections 2024-02-21T07:54:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.806+0000 7fd077e26740 1 -- 172.21.15.100:0/528322332 wait complete. 2024-02-21T07:54:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.806+0000 7fd077e26740 20 client.6779 trim_cache size 0 max 16384 2024-02-21T07:54:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:54:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:54:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:54:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.807+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 msgr2=0x7fd0500a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.807+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 0x7fd0500a16b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd05c036000 tx=0x7fd05c03d040 comp rx=0 tx=0).stop 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 msgr2=0x7fd070184970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 0x7fd070184970 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c390 tx=0x7fd060001e70 comp rx=0 tx=0).stop 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 shutdown_connections 2024-02-21T07:54:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd05009f1f0 0x7fd0500a16b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd070182840 0x7fd070172d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0700d0c30 0x7fd070184970 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 --2- 172.21.15.100:0/3468882142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0700d0780 0x7fd070225250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.808+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 >> 172.21.15.100:0/3468882142 conn(0x7fd0700615c0 msgr2=0x7fd07018b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.810+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 shutdown_connections 2024-02-21T07:54:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:18.810+0000 7fd06f200640 1 -- 172.21.15.100:0/3468882142 wait complete. 2024-02-21T07:54:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.078+0000 7f8b31200640 1 Processor -- start 2024-02-21T07:54:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.078+0000 7f8b31200640 1 -- start start 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.081+0000 7f8b31200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.081+0000 7f8b31200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b2c0f4c80 0x7f8b2c0d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.081+0000 7f8b31200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2c18af90 con 0x7f8b2c0f5130 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.081+0000 7f8b31200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c0f6470 con 0x7f8b2c0f4c80 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.081+0000 7f8b31200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2c0f58f0 con 0x7f8b2c0620e0 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.082+0000 7f8b2b400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36694/0 (socket says 172.21.15.100:36694) 2024-02-21T07:54:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 -- 172.21.15.100:0/1381405383 learned_addr learned my addr 172.21.15.100:0/1381405383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 -- 172.21.15.100:0/1381405383 >> v2:172.21.15.100:3300/0 conn(0x7f8b2c0f4c80 msgr2=0x7f8b2c0d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 --2- 172.21.15.100:0/1381405383 >> v2:172.21.15.100:3300/0 conn(0x7f8b2c0f4c80 0x7f8b2c0d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 -- 172.21.15.100:0/1381405383 >> v1:172.21.15.156:6789/0 conn(0x7f8b2c0f5130 legacy=0x7f8b2c182980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.083+0000 7f8b2b400640 1 -- 172.21.15.100:0/1381405383 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c0f5bd0 con 0x7f8b2c0620e0 2024-02-21T07:54:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.091+0000 7f8b2b400640 1 --2- 172.21.15.100:0/1381405383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c06d790 tx=0x7f8b2403ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a23d6d5e54bf853 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.091+0000 7f8b2a000640 1 -- 172.21.15.100:0/1381405383 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2403da20 con 0x7f8b2c0620e0 2024-02-21T07:54:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.091+0000 7f8b2a000640 1 -- 172.21.15.100:0/1381405383 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2403db80 con 0x7f8b2c0620e0 2024-02-21T07:54:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.091+0000 7f8b2a000640 1 -- 172.21.15.100:0/1381405383 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2403da20 con 0x7f8b2c0620e0 2024-02-21T07:54:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.093+0000 7f8b31200640 1 -- 172.21.15.100:0/1381405383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0620e0 msgr2=0x7f8b2c17e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.093+0000 7f8b31200640 1 --2- 172.21.15.100:0/1381405383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c06d790 tx=0x7f8b2403ce80 comp rx=0 tx=0).stop 2024-02-21T07:54:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.097+0000 7f8b31200640 1 -- 172.21.15.100:0/1381405383 shutdown_connections 2024-02-21T07:54:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.097+0000 7f8b31200640 1 --2- 172.21.15.100:0/1381405383 >> v2:172.21.15.100:3300/0 conn(0x7f8b2c0f4c80 0x7f8b2c0d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.102+0000 7f8b31200640 1 --2- 172.21.15.100:0/1381405383 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c17e4b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.102+0000 7f8b31200640 1 -- 172.21.15.100:0/1381405383 >> 172.21.15.100:0/1381405383 conn(0x7f8b2c0615c0 msgr2=0x7f8b2c0619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.103+0000 7f8b31200640 1 -- 172.21.15.100:0/1381405383 shutdown_connections 2024-02-21T07:54:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.105+0000 7f8b31200640 1 -- 172.21.15.100:0/1381405383 wait complete. 2024-02-21T07:54:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.109+0000 7f8b31200640 1 Processor -- start 2024-02-21T07:54:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.109+0000 7f8b31200640 1 -- start start 2024-02-21T07:54:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b2c0f4c80 0x7f8b2c186780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0f5130 0x7f8b2c186cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c172440 con 0x7f8b2c0f4c80 2024-02-21T07:54:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c1862f0 con 0x7f8b2c0f5130 2024-02-21T07:54:32.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.115+0000 7f8b31200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c0cc570 con 0x7f8b2c0620e0 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.117+0000 7f8b2b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.117+0000 7f8b2b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41570/0 (socket says 172.21.15.100:41570) 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.117+0000 7f8b2b400640 1 -- 172.21.15.100:0/2083137197 learned_addr learned my addr 172.21.15.100:0/2083137197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 -- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0f5130 msgr2=0x7f8b2c186cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0f5130 0x7f8b2c186cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 -- 172.21.15.100:0/2083137197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b2c0f4c80 msgr2=0x7f8b2c186780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b2c0f4c80 0x7f8b2c186780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 -- 172.21.15.100:0/2083137197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24009b30 con 0x7f8b2c0620e0 2024-02-21T07:54:32.121 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.118+0000 7f8b2b400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009f40 tx=0x7f8b24004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.119+0000 7f8b23400640 1 -- 172.21.15.100:0/2083137197 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24004390 con 0x7f8b2c0620e0 2024-02-21T07:54:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.119+0000 7f8b23400640 1 -- 172.21.15.100:0/2083137197 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24004510 con 0x7f8b2c0620e0 2024-02-21T07:54:32.122 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.119+0000 7f8b23400640 1 -- 172.21.15.100:0/2083137197 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2404f450 con 0x7f8b2c0620e0 2024-02-21T07:54:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.120+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c0cc850 con 0x7f8b2c0620e0 2024-02-21T07:54:32.127 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.120+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c0cce10 con 0x7f8b2c0620e0 2024-02-21T07:54:32.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.141+0000 7f8b3540e740 1 Processor -- start 2024-02-21T07:54:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.143+0000 7f8b3540e740 1 -- start start 2024-02-21T07:54:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.146+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.148+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.149+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46808/0 (socket says 172.21.15.100:46808) 2024-02-21T07:54:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.149+0000 7f8b2be00640 1 -- 172.21.15.100:0/531861166 learned_addr learned my addr 172.21.15.100:0/531861166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.149+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c2988abc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.149+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988e7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.151+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c298867620 con 0x55c2988e7230 2024-02-21T07:54:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.153+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2988198c0 con 0x55c2988ac150 2024-02-21T07:54:32.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.153+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c298816df0 con 0x55c29891b690 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.154+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.154+0000 7f8b2be00640 1 -- 172.21.15.100:0/531861166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 msgr2=0x55c2988abc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.154+0000 7f8b2be00640 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c2988abc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.154+0000 7f8b2be00640 1 -- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 msgr2=0x55c2988e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.154+0000 7f8b2be00640 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988e7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.155+0000 7f8b2be00640 1 -- 172.21.15.100:0/531861166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c298793b00 con 0x55c2988e7230 2024-02-21T07:54:32.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.155+0000 7f8b23400640 1 -- 172.21.15.100:0/2083137197 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8b2404f5b0 con 0x7f8b2c0620e0 2024-02-21T07:54:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.156+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.156+0000 7f8b2be00640 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009980 tx=0x7f8b18009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8660358015f133 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.157+0000 7f8b17e00640 1 -- 172.21.15.100:0/531861166 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800b980 con 0x55c2988e7230 2024-02-21T07:54:32.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.161+0000 7f8b17e00640 1 -- 172.21.15.100:0/531861166 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800bb00 con 0x55c2988e7230 2024-02-21T07:54:32.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.161+0000 7f8b17e00640 1 -- 172.21.15.100:0/531861166 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011420 con 0x55c2988e7230 2024-02-21T07:54:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.162+0000 7f8b23400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 0x7f8b0c0a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.162+0000 7f8b23400640 1 -- 172.21.15.100:0/2083137197 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8b240fda90 con 0x7f8b2c0620e0 2024-02-21T07:54:32.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.163+0000 7f8b2b400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 0x7f8b0c0a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.164+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 msgr2=0x55c2988a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.164+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009980 tx=0x7f8b18009e40 comp rx=0 tx=0).stop 2024-02-21T07:54:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.164+0000 7f8b2b400640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 0x7f8b0c0a16e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b240d37e0 tx=0x7f8b24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.165+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 shutdown_connections 2024-02-21T07:54:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.165+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.165+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c2988abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.165+0000 7f8b3540e740 1 --2- 172.21.15.100:0/531861166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c2988a6600 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.165+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 >> 172.21.15.100:0/531861166 conn(0x55c2988734b0 msgr2=0x55c2988aae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.166+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 shutdown_connections 2024-02-21T07:54:32.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.168+0000 7f8b3540e740 1 -- 172.21.15.100:0/531861166 wait complete. 2024-02-21T07:54:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.169+0000 7f8b3540e740 1 -- start start 2024-02-21T07:54:32.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.169+0000 7f8b3540e740 1 Processor -- start 2024-02-21T07:54:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c29892cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c298910790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2988125d0 con 0x55c2988e7230 2024-02-21T07:54:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2987b7b50 con 0x55c2988ac150 2024-02-21T07:54:32.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2987b77f0 con 0x55c29891b690 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b3540e740 10 client.0 _ll_register_callbacks cb 0x55c2987cb550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36714/0 (socket says 172.21.15.100:36714) 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b2be00640 1 -- 172.21.15.100:0/257658407 learned_addr learned my addr 172.21.15.100:0/257658407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.172+0000 7f8b2be00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c298910790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.173+0000 7f8b2be00640 1 -- 172.21.15.100:0/257658407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 msgr2=0x55c298910790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.173+0000 7f8b2be00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c298910790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.173+0000 7f8b2be00640 1 -- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 msgr2=0x55c29892cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.173+0000 7f8b2be00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c29892cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.173+0000 7f8b2be00640 1 -- 172.21.15.100:0/257658407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180092f0 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.174+0000 7f8b2be00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e80 tx=0x7f8b18010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caacb34c75af59ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.174+0000 7f8b14c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.174+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1801d960 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.174+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8b1801dac0 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.174+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2987e4cd0 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.175+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1801dc80 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.175+0000 7f8b3540e740 10 client.6862 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.175+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c298810c50 con 0x55c2988ac150 2024-02-21T07:54:32.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.175+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2987e4cd0 con 0x55c2988ac150 2024-02-21T07:54:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b1802a450 con 0x55c2988ac150 2024-02-21T07:54:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 10 client.6862 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 10 client.6862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:32.179 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 20 client.6862 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988a7690 0x55c2988d8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 4 client.6862 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.176+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c298808ce0 con 0x55c2988a7690 2024-02-21T07:54:32.180 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.177+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988a7690 0x55c2988d8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.178+0000 7f8b14c00640 10 client.6862 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:32.181 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.178+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988a7690 0x55c2988d8dd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a84ca761dfe8d34 server_cookie=d2d0ae39b97d7380 in_seq=0 out_seq=0 2024-02-21T07:54:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.180+0000 7f8b14c00640 1 -- 172.21.15.100:0/257658407 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c298808ce0 con 0x55c2988a7690 2024-02-21T07:54:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.180+0000 7f8b14c00640 10 client.6862 handle_command_reply: tid=0 2024-02-21T07:54:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.181+0000 7f8b3540e740 1 client.6862 shutdown 2024-02-21T07:54:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 msgr2=0x55c2988d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e80 tx=0x7f8b18010000 comp rx=0 tx=0).stop 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 shutdown_connections 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988a7690 0x55c2988d8dd0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c29891b690 0x55c298910790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988e7230 0x55c29892cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 --2- 172.21.15.100:0/257658407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2988d87b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.182+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 >> 172.21.15.100:0/257658407 conn(0x55c2988734b0 msgr2=0x55c2988b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.183+0000 7f8b14c00640 0 client.6862 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.183+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 shutdown_connections 2024-02-21T07:54:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.183+0000 7f8b3540e740 1 -- 172.21.15.100:0/257658407 wait complete. 2024-02-21T07:54:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.183+0000 7f8b3540e740 20 client.6862 trim_cache size 0 max 16384 2024-02-21T07:54:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.206+0000 7f8b3540e740 1 Processor -- start 2024-02-21T07:54:32.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.207+0000 7f8b3540e740 1 -- start start 2024-02-21T07:54:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2989113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 0x55c2988a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29855ae60 con 0x55c29891b690 2024-02-21T07:54:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c298911010 con 0x55c2988ac150 2024-02-21T07:54:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.208+0000 7f8b3540e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c298933bb0 con 0x55c2988e7230 2024-02-21T07:54:32.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41596/0 (socket says 172.21.15.100:41596) 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 -- 172.21.15.100:0/2322376411 learned_addr learned my addr 172.21.15.100:0/2322376411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2be00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 0x55c2988a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2be00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2989113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 -- 172.21.15.100:0/2322376411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 msgr2=0x55c2989113a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2989113a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 -- 172.21.15.100:0/2322376411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 msgr2=0x55c2988a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 0x55c2988a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2aa00640 1 -- 172.21.15.100:0/2322376411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2987ad530 con 0x55c2988e7230 2024-02-21T07:54:32.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.209+0000 7f8b2be00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 0x55c2988a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.210+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c184b40 tx=0x7f8b1c00ae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ccdb05cf4b5e743 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.210+0000 7f8b17400640 1 -- 172.21.15.100:0/2322376411 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c013a60 con 0x55c2988e7230 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.210+0000 7f8b17400640 1 -- 172.21.15.100:0/2322376411 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00c040 con 0x55c2988e7230 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.210+0000 7f8b17400640 1 -- 172.21.15.100:0/2322376411 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c013e00 con 0x55c2988e7230 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.211+0000 7f8b3540e740 1 -- 172.21.15.100:0/2322376411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 msgr2=0x55c2988a80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.211+0000 7f8b3540e740 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c184b40 tx=0x7f8b1c00ae10 comp rx=0 tx=0).stop 2024-02-21T07:54:32.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 -- 172.21.15.100:0/2322376411 shutdown_connections 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c29891b690 0x55c2988a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2988a80e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 --2- 172.21.15.100:0/2322376411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2988ac150 0x55c2989113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 -- 172.21.15.100:0/2322376411 >> 172.21.15.100:0/2322376411 conn(0x55c2988734b0 msgr2=0x55c2988e7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 -- 172.21.15.100:0/2322376411 shutdown_connections 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.212+0000 7f8b3540e740 1 -- 172.21.15.100:0/2322376411 wait complete. 2024-02-21T07:54:32.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.213+0000 7f8b3540e740 1 -- start start 2024-02-21T07:54:32.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.213+0000 7f8b3540e740 1 Processor -- start 2024-02-21T07:54:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.215+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.215+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2989113a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b3540e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c29891b690 0x55c29897f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b3540e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2988a7cd0 con 0x55c2988ac150 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b3540e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c29893b4a0 con 0x55c29891b690 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b3540e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2989865f0 con 0x55c2988e7230 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b3540e740 10 client.0 _ll_register_callbacks cb 0x7f8b18006e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46840/0 (socket says 172.21.15.100:46840) 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b2be00640 1 -- 172.21.15.100:0/4204171855 learned_addr learned my addr 172.21.15.100:0/4204171855 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:32.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.216+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2989113a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 -- 172.21.15.100:0/4204171855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 msgr2=0x55c2989113a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2989113a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 -- 172.21.15.100:0/4204171855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c29891b690 msgr2=0x55c29897f9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c29891b690 0x55c29897f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 -- 172.21.15.100:0/4204171855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c00a3d0 con 0x55c2988ac150 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b2be00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800fc30 tx=0x7f8b18009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e92067b8f94c8f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b14c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.217+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1801dc80 con 0x55c2988ac150 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.218+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8b1800b8a0 con 0x55c2988ac150 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.218+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c298837d30 con 0x55c2988ac150 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.218+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1800bd70 con 0x55c2988ac150 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.218+0000 7f8b3540e740 10 client.6690 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:32.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.218+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c2987d32c0 con 0x55c2988ac150 2024-02-21T07:54:32.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c298837d30 con 0x55c2988ac150 2024-02-21T07:54:32.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8b1802a450 con 0x55c2988ac150 2024-02-21T07:54:32.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b3540e740 10 client.6690 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:32.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b3540e740 10 client.6690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:32.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b3540e740 20 client.6690 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:32.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.219+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988e4880 0x55c2988b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:32.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.220+0000 7f8b3540e740 4 client.6690 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:54:32.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.220+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c298512600 con 0x55c2988e4880 2024-02-21T07:54:32.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.221+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988e4880 0x55c2988b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:32.224 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.222+0000 7f8b2aa00640 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988e4880 0x55c2988b0550 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7acbce93c9a138fc server_cookie=f64a0d17161e5c6a in_seq=0 out_seq=0 2024-02-21T07:54:32.225 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.223+0000 7f8b14c00640 10 client.6690 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:32.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.237+0000 7f8b14c00640 1 -- 172.21.15.100:0/4204171855 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c298512600 con 0x55c2988e4880 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.237+0000 7f8b14c00640 10 client.6690 handle_command_reply: tid=0 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.237+0000 7f8b3540e740 1 client.6690 shutdown 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.237+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 msgr2=0x55c2989066a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.237+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800fc30 tx=0x7f8b18009060 comp rx=0 tx=0).stop 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 shutdown_connections 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c2988e4880 0x55c2988b0550 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b14c00640 0 client.6690 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c29891b690 0x55c29897f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c2988e7230 0x55c2989113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 --2- 172.21.15.100:0/4204171855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c2988ac150 0x55c2989066a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 >> 172.21.15.100:0/4204171855 conn(0x55c2988734b0 msgr2=0x55c2988db480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 shutdown_connections 2024-02-21T07:54:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.238+0000 7f8b3540e740 1 -- 172.21.15.100:0/4204171855 wait complete. 2024-02-21T07:54:32.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.239+0000 7f8b3540e740 20 client.6690 trim_cache size 0 max 16384 2024-02-21T07:54:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:54:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:54:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:54:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:54:32.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 msgr2=0x7f8b0c0a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 0x7f8b0c0a16e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8b240d37e0 tx=0x7f8b24009040 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 msgr2=0x7f8b2c0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009f40 tx=0x7f8b24004a40 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 shutdown_connections 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0f5130 0x7f8b2c186cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b0c09f220 0x7f8b0c0a16e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b2c0f4c80 0x7f8b2c186780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 --2- 172.21.15.100:0/2083137197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b2c0620e0 0x7f8b2c0cbc30 secure :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009f40 tx=0x7f8b24004a40 comp rx=0 tx=0).stop 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 >> 172.21.15.100:0/2083137197 conn(0x7f8b2c0615c0 msgr2=0x7f8b2c188420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 shutdown_connections 2024-02-21T07:54:32.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:32.240+0000 7f8b31200640 1 -- 172.21.15.100:0/2083137197 wait complete. 2024-02-21T07:54:35.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:54:35.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:54:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.569+0000 7fae9d400640 1 Processor -- start 2024-02-21T07:54:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.569+0000 7fae9d400640 1 -- start start 2024-02-21T07:54:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.572+0000 7fae9d400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae98190260 0x7fae98070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.572+0000 7fae9d400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae980f4b20 0x7fae980f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.573+0000 7fae95e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae980f4b20 0x7fae980f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.573+0000 7fae95e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fae980f4b20 0x7fae980f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41618/0 (socket says 172.21.15.100:41618) 2024-02-21T07:54:35.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.573+0000 7fae9d400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9818dc80 con 0x7fae9806e6b0 2024-02-21T07:54:35.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.573+0000 7fae95e00640 1 -- 172.21.15.100:0/707932057 learned_addr learned my addr 172.21.15.100:0/707932057 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.574+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae980f5b90 con 0x7fae98190260 2024-02-21T07:54:35.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.574+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae980f55d0 con 0x7fae980f4b20 2024-02-21T07:54:35.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.574+0000 7fae96800640 1 --2- 172.21.15.100:0/707932057 >> v2:172.21.15.156:3300/0 conn(0x7fae98190260 0x7fae98070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.575+0000 7fae95400640 1 -- 172.21.15.100:0/707932057 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323134499 0 0) 0x7fae9818dc80 con 0x7fae9806e6b0 2024-02-21T07:54:35.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.575+0000 7fae95e00640 1 -- 172.21.15.100:0/707932057 >> v2:172.21.15.156:3300/0 conn(0x7fae98190260 msgr2=0x7fae98070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.575+0000 7fae95e00640 1 --2- 172.21.15.100:0/707932057 >> v2:172.21.15.156:3300/0 conn(0x7fae98190260 0x7fae98070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.576+0000 7fae95e00640 1 -- 172.21.15.100:0/707932057 >> v1:172.21.15.100:6789/0 conn(0x7fae9806e6b0 legacy=0x7fae98190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.576+0000 7fae95e00640 1 -- 172.21.15.100:0/707932057 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980f58b0 con 0x7fae980f4b20 2024-02-21T07:54:35.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.578+0000 7fae95e00640 1 --2- 172.21.15.100:0/707932057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980f4fb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae9808d410 tx=0x7fae8402b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f9efccb7f8b08b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.579+0000 7fae95400640 1 -- 172.21.15.100:0/707932057 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840317f0 con 0x7fae980f4b20 2024-02-21T07:54:35.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.580+0000 7fae95400640 1 -- 172.21.15.100:0/707932057 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84031950 con 0x7fae980f4b20 2024-02-21T07:54:35.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.581+0000 7fae95400640 1 -- 172.21.15.100:0/707932057 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84031ce0 con 0x7fae980f4b20 2024-02-21T07:54:35.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.581+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 msgr2=0x7fae980f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.581+0000 7fae9d400640 1 --2- 172.21.15.100:0/707932057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980f4fb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fae9808d410 tx=0x7fae8402b890 comp rx=0 tx=0).stop 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 shutdown_connections 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 --2- 172.21.15.100:0/707932057 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980f4fb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 --2- 172.21.15.100:0/707932057 >> v2:172.21.15.156:3300/0 conn(0x7fae98190260 0x7fae98070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 >> 172.21.15.100:0/707932057 conn(0x7fae980668b0 msgr2=0x7fae98066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 shutdown_connections 2024-02-21T07:54:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.586+0000 7fae9d400640 1 -- 172.21.15.100:0/707932057 wait complete. 2024-02-21T07:54:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.593+0000 7fae9d400640 1 Processor -- start 2024-02-21T07:54:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.593+0000 7fae9d400640 1 -- start start 2024-02-21T07:54:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.597+0000 7fae9d400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 0x7fae98174c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.598+0000 7fae9d400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.598+0000 7fae96800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 0x7fae98174c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.598+0000 7fae96800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 0x7fae98174c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36740/0 (socket says 172.21.15.100:36740) 2024-02-21T07:54:35.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.598+0000 7fae96800640 1 -- 172.21.15.100:0/3243703149 learned_addr learned my addr 172.21.15.100:0/3243703149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.599+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 0x7fae980ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.599+0000 7fae97200640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 0x7fae980ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.600+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980cb9d0 con 0x7fae98190260 2024-02-21T07:54:35.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.600+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9817ef20 con 0x7fae9806e6b0 2024-02-21T07:54:35.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.600+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980cbc20 con 0x7fae980f4b20 2024-02-21T07:54:35.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.600+0000 7fae95e00640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.601+0000 7fae97200640 1 -- 172.21.15.100:0/3243703149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 msgr2=0x7fae980cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.601+0000 7fae97200640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.601+0000 7fae97200640 1 -- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 msgr2=0x7fae98174c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.601+0000 7fae97200640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 0x7fae98174c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.601+0000 7fae97200640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840094d0 con 0x7fae98190260 2024-02-21T07:54:35.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.602+0000 7fae97200640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 0x7fae980ccf20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c3e0 tx=0x7fae8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.602+0000 7fae8ea00640 1 -- 172.21.15.100:0/3243703149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880035f0 con 0x7fae98190260 2024-02-21T07:54:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.603+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae980cbf00 con 0x7fae98190260 2024-02-21T07:54:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.603+0000 7fae8ea00640 1 -- 172.21.15.100:0/3243703149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae88003750 con 0x7fae98190260 2024-02-21T07:54:35.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.604+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae980cc4c0 con 0x7fae98190260 2024-02-21T07:54:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.605+0000 7fae8ea00640 1 -- 172.21.15.100:0/3243703149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880035f0 con 0x7fae98190260 2024-02-21T07:54:35.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.610+0000 7fae8ea00640 1 -- 172.21.15.100:0/3243703149 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fae880038c0 con 0x7fae98190260 2024-02-21T07:54:35.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.613+0000 7fae8ea00640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 0x7fae780a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.613+0000 7fae8ea00640 1 -- 172.21.15.100:0/3243703149 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fae880c8a20 con 0x7fae98190260 2024-02-21T07:54:35.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.613+0000 7fae96800640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 0x7fae780a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.616+0000 7faea0171740 1 Processor -- start 2024-02-21T07:54:35.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.618+0000 7faea0171740 1 -- start start 2024-02-21T07:54:35.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.619+0000 7fae96800640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 0x7fae780a1640 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae90003b80 tx=0x7fae900098d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d464f80 0x55708d42f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d42f8e0 0x55708d3f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d366150 con 0x55708d464f80 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d363680 con 0x55708d42f8e0 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.621+0000 7faea0171740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d35ee60 con 0x55708d42efc0 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41642/0 (socket says 172.21.15.100:41642) 2024-02-21T07:54:35.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 -- 172.21.15.100:0/3220531191 learned_addr learned my addr 172.21.15.100:0/3220531191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae97200640 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d42f8e0 0x55708d3f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 -- 172.21.15.100:0/3220531191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d42f8e0 msgr2=0x55708d3f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d42f8e0 0x55708d3f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 -- 172.21.15.100:0/3220531191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d464f80 msgr2=0x55708d42f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d464f80 0x55708d42f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.627+0000 7fae96800640 1 -- 172.21.15.100:0/3220531191 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55708d318060 con 0x55708d42efc0 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.629+0000 7fae96800640 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fae90004930 tx=0x7fae90013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f751a50645c66d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.629+0000 7fae83000640 1 -- 172.21.15.100:0/3220531191 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae900155f0 con 0x55708d42efc0 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.630+0000 7fae83000640 1 -- 172.21.15.100:0/3220531191 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90015750 con 0x55708d42efc0 2024-02-21T07:54:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.632+0000 7fae83000640 1 -- 172.21.15.100:0/3220531191 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90015ac0 con 0x55708d42efc0 2024-02-21T07:54:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.633+0000 7faea0171740 1 -- 172.21.15.100:0/3220531191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 msgr2=0x55708d464a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.633+0000 7faea0171740 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fae90004930 tx=0x7fae90013000 comp rx=0 tx=0).stop 2024-02-21T07:54:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.637+0000 7faea0171740 1 -- 172.21.15.100:0/3220531191 shutdown_connections 2024-02-21T07:54:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.637+0000 7faea0171740 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d42f8e0 0x55708d3f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.637+0000 7faea0171740 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d464f80 0x55708d42f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.637+0000 7faea0171740 1 --2- 172.21.15.100:0/3220531191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42efc0 0x55708d464a40 secure :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fae90004930 tx=0x7fae90013000 comp rx=0 tx=0).stop 2024-02-21T07:54:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.637+0000 7faea0171740 1 -- 172.21.15.100:0/3220531191 >> 172.21.15.100:0/3220531191 conn(0x55708d3be5a0 msgr2=0x55708d3f5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.640+0000 7faea0171740 1 -- 172.21.15.100:0/3220531191 shutdown_connections 2024-02-21T07:54:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.640+0000 7faea0171740 1 -- 172.21.15.100:0/3220531191 wait complete. 2024-02-21T07:54:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.641+0000 7faea0171740 1 -- start start 2024-02-21T07:54:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.641+0000 7faea0171740 1 Processor -- start 2024-02-21T07:54:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.646+0000 7faea0171740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 0x55708d3f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.647+0000 7faea0171740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d47a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.647+0000 7fae96800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 0x55708d3f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.647+0000 7fae96800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 0x55708d3f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41658/0 (socket says 172.21.15.100:41658) 2024-02-21T07:54:35.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.648+0000 7fae96800640 1 -- 172.21.15.100:0/4183068639 learned_addr learned my addr 172.21.15.100:0/4183068639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.649+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 0x55708d45b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.649+0000 7fae95e00640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d47a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.650+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d303ec0 con 0x55708d45b460 2024-02-21T07:54:35.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.650+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d303b60 con 0x55708d464f80 2024-02-21T07:54:35.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.651+0000 7fae97200640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 0x55708d45b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.652+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d0cd1c0 con 0x55708d42f8e0 2024-02-21T07:54:35.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.652+0000 7faea0171740 10 client.0 _ll_register_callbacks cb 0x55708d317960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:35.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.659+0000 7fae97200640 1 -- 172.21.15.100:0/4183068639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 msgr2=0x55708d3f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.659+0000 7fae97200640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 0x55708d3f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.659+0000 7fae97200640 1 -- 172.21.15.100:0/4183068639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 msgr2=0x55708d47a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.659+0000 7fae97200640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d47a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.659+0000 7fae97200640 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90011040 con 0x55708d45b460 2024-02-21T07:54:35.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.663+0000 7fae97200640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 0x55708d45b8e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae8800cda0 tx=0x7fae88096780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b0f7ebd6077e2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.664+0000 7fae77400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:35.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.664+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880812b0 con 0x55708d45b460 2024-02-21T07:54:35.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.664+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fae880c6590 con 0x55708d45b460 2024-02-21T07:54:35.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.665+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55708d05e7e0 con 0x55708d45b460 2024-02-21T07:54:35.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.665+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae88003b70 con 0x55708d45b460 2024-02-21T07:54:35.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.665+0000 7faea0171740 10 client.6699 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:35.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.665+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55708d35d4e0 con 0x55708d45b460 2024-02-21T07:54:35.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.666+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55708d05e7e0 con 0x55708d45b460 2024-02-21T07:54:35.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.666+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fae88003cd0 con 0x55708d45b460 2024-02-21T07:54:35.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 10 client.6699 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:35.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 10 client.6699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:35.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 20 client.6699 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:35.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d462b20 0x55708d460c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 4 client.6699 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:35.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.667+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55708d09b720 con 0x55708d462b20 2024-02-21T07:54:35.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.669+0000 7fae96800640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d462b20 0x55708d460c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.671+0000 7fae96800640 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d462b20 0x55708d460c20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b1c4c7f1154e03c server_cookie=f0cb7725b8cefb0 in_seq=0 out_seq=0 2024-02-21T07:54:35.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.671+0000 7fae77400640 10 client.6699 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:35.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.672+0000 7fae77400640 1 -- 172.21.15.100:0/4183068639 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55708d09b720 con 0x55708d462b20 2024-02-21T07:54:35.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.672+0000 7fae77400640 10 client.6699 handle_command_reply: tid=0 2024-02-21T07:54:35.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 client.6699 shutdown 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 msgr2=0x55708d45b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 0x55708d45b8e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae8800cda0 tx=0x7fae88096780 comp rx=0 tx=0).stop 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 shutdown_connections 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d462b20 0x55708d460c20 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d45b460 0x55708d45b8e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d47a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.673+0000 7faea0171740 1 --2- 172.21.15.100:0/4183068639 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d42f8e0 0x55708d3f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.674+0000 7fae77400640 0 client.6699 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.674+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 >> 172.21.15.100:0/4183068639 conn(0x55708d3be5a0 msgr2=0x55708d464610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.674+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 shutdown_connections 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.674+0000 7faea0171740 1 -- 172.21.15.100:0/4183068639 wait complete. 2024-02-21T07:54:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.674+0000 7faea0171740 20 client.6699 trim_cache size 0 max 16384 2024-02-21T07:54:35.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.715+0000 7faea0171740 1 Processor -- start 2024-02-21T07:54:35.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.715+0000 7faea0171740 1 -- start start 2024-02-21T07:54:35.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d45b460 0x55708d3fd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d463440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d3f32c0 con 0x55708d42f8e0 2024-02-21T07:54:35.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d454cc0 con 0x55708d464f80 2024-02-21T07:54:35.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.718+0000 7faea0171740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d460cb0 con 0x55708d45b460 2024-02-21T07:54:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.720+0000 7fae96800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.720+0000 7fae96800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46876/0 (socket says 172.21.15.100:46876) 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.720+0000 7fae96800640 1 -- 172.21.15.100:0/1006564609 learned_addr learned my addr 172.21.15.100:0/1006564609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.720+0000 7fae95e00640 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d45b460 0x55708d3fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.720+0000 7fae96800640 1 -- 172.21.15.100:0/1006564609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d45b460 msgr2=0x55708d3fd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.721+0000 7fae96800640 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d45b460 0x55708d3fd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.721+0000 7fae96800640 1 -- 172.21.15.100:0/1006564609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 msgr2=0x55708d463440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.721+0000 7fae96800640 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d463440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.721+0000 7fae96800640 1 -- 172.21.15.100:0/1006564609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55708d2f9950 con 0x55708d42f8e0 2024-02-21T07:54:35.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.724+0000 7fae96800640 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55708d469670 tx=0x7fae90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173fd4a7e245ca10 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.732+0000 7fae82600640 1 -- 172.21.15.100:0/1006564609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90015d00 con 0x55708d42f8e0 2024-02-21T07:54:35.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.732+0000 7fae82600640 1 -- 172.21.15.100:0/1006564609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90015e60 con 0x55708d42f8e0 2024-02-21T07:54:35.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.732+0000 7fae82600640 1 -- 172.21.15.100:0/1006564609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9002e650 con 0x55708d42f8e0 2024-02-21T07:54:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 -- 172.21.15.100:0/1006564609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 msgr2=0x55708d469c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x55708d469670 tx=0x7fae90017000 comp rx=0 tx=0).stop 2024-02-21T07:54:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 -- 172.21.15.100:0/1006564609 shutdown_connections 2024-02-21T07:54:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d464f80 0x55708d463440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d45b460 0x55708d3fd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 --2- 172.21.15.100:0/1006564609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d42f8e0 0x55708d469c20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 -- 172.21.15.100:0/1006564609 >> 172.21.15.100:0/1006564609 conn(0x55708d3be5a0 msgr2=0x55708d4381d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 -- 172.21.15.100:0/1006564609 shutdown_connections 2024-02-21T07:54:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.734+0000 7faea0171740 1 -- 172.21.15.100:0/1006564609 wait complete. 2024-02-21T07:54:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.736+0000 7faea0171740 1 -- start start 2024-02-21T07:54:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.736+0000 7faea0171740 1 Processor -- start 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.738+0000 7faea0171740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d45b460 0x55708d44e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.738+0000 7faea0171740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 0x55708d426330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.739+0000 7faea0171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 0x55708d4c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.739+0000 7faea0171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d44e680 con 0x55708d476b20 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.739+0000 7faea0171740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d426870 con 0x55708d45b460 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.739+0000 7faea0171740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55708d463440 con 0x55708d464f80 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.739+0000 7faea0171740 10 client.0 _ll_register_callbacks cb 0x55708d477c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.740+0000 7fae96800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d45b460 0x55708d44e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.740+0000 7fae95e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 0x55708d426330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.740+0000 7fae95e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 0x55708d426330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41678/0 (socket says 172.21.15.100:41678) 2024-02-21T07:54:35.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.740+0000 7fae95e00640 1 -- 172.21.15.100:0/470052275 learned_addr learned my addr 172.21.15.100:0/470052275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:35.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.740+0000 7fae97200640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 0x55708d4c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.741+0000 7fae97200640 1 -- 172.21.15.100:0/470052275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 msgr2=0x55708d426330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.741+0000 7fae97200640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 0x55708d426330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.741+0000 7fae97200640 1 -- 172.21.15.100:0/470052275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d45b460 msgr2=0x55708d44e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.741+0000 7fae97200640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d45b460 0x55708d44e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.741+0000 7fae97200640 1 -- 172.21.15.100:0/470052275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55708d318060 con 0x55708d476b20 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.742+0000 7fae97200640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 0x55708d4c8470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae880965d0 tx=0x7fae880c6290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9aee9ed6e5bd93 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.742+0000 7fae77400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88096180 con 0x55708d476b20 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fae880c6590 con 0x55708d476b20 2024-02-21T07:54:35.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae90015750 con 0x55708d476b20 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae88092920 con 0x55708d476b20 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7faea0171740 10 client.6705 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.743+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55708d31f430 con 0x55708d476b20 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90015750 con 0x55708d476b20 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fae88003b70 con 0x55708d476b20 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7faea0171740 10 client.6705 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7faea0171740 10 client.6705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7faea0171740 20 client.6705 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:35.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.744+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d461560 0x55708d42d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:35.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.745+0000 7faea0171740 4 client.6705 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:54:35.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.745+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55708d0ea890 con 0x55708d461560 2024-02-21T07:54:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.746+0000 7fae96800640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d461560 0x55708d42d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:35.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.748+0000 7fae96800640 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d461560 0x55708d42d9a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3ffd5dc726773a8 server_cookie=5b9ce68f4557788d in_seq=0 out_seq=0 2024-02-21T07:54:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.753+0000 7fae77400640 10 client.6705 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.753+0000 7fae77400640 1 -- 172.21.15.100:0/470052275 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55708d0ea890 con 0x55708d461560 2024-02-21T07:54:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.753+0000 7fae77400640 10 client.6705 handle_command_reply: tid=0 2024-02-21T07:54:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.755+0000 7faea0171740 1 client.6705 shutdown 2024-02-21T07:54:35.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 msgr2=0x55708d4c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 0x55708d4c8470 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae880965d0 tx=0x7fae880c6290 comp rx=0 tx=0).stop 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 shutdown_connections 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55708d461560 0x55708d42d9a0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55708d476b20 0x55708d4c8470 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55708d464f80 0x55708d426330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 --2- 172.21.15.100:0/470052275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55708d45b460 0x55708d44e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 >> 172.21.15.100:0/470052275 conn(0x55708d3be5a0 msgr2=0x55708d464510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.757+0000 7fae77400640 0 client.6705 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:35.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.758+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 shutdown_connections 2024-02-21T07:54:35.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.759+0000 7faea0171740 1 -- 172.21.15.100:0/470052275 wait complete. 2024-02-21T07:54:35.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.759+0000 7faea0171740 20 client.6705 trim_cache size 0 max 16384 2024-02-21T07:54:35.762 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:35.762 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:54:35.762 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:54:35.762 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:35.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.760+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 msgr2=0x7fae780a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 0x7fae780a1640 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae90003b80 tx=0x7fae900098d0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 msgr2=0x7fae980ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 0x7fae980ccf20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fae8800c3e0 tx=0x7fae8800c8a0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 shutdown_connections 2024-02-21T07:54:35.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae7809f180 0x7fae780a1640 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae98190260 0x7fae980ccf20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae980f4b20 0x7fae980cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 --2- 172.21.15.100:0/3243703149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9806e6b0 0x7fae98174c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.761+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 >> 172.21.15.100:0/3243703149 conn(0x7fae980668b0 msgr2=0x7fae980f5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.764+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 shutdown_connections 2024-02-21T07:54:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:35.764+0000 7fae9d400640 1 -- 172.21.15.100:0/3243703149 wait complete. 2024-02-21T07:54:35.797 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:54:35.797 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:54:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.179+0000 7f49a9600640 1 Processor -- start 2024-02-21T07:54:36.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.180+0000 7f49a9600640 1 -- start start 2024-02-21T07:54:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.181+0000 7f49a9600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49a4180660 0x7f49a41879b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.181+0000 7f49a9600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f49a40cb620 0x7f49a40f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.181+0000 7f49a9600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a40cad10 con 0x7f49a40cb1a0 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.181+0000 7f49a9600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a4180a40 con 0x7f49a4180660 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.181+0000 7f49a9600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a40ca400 con 0x7f49a40cb620 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49a4180660 0x7f49a41879b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a8c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f49a40cb620 0x7f49a40f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f49a4180660 0x7f49a41879b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36774/0 (socket says 172.21.15.100:36774) 2024-02-21T07:54:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 -- 172.21.15.100:0/355814653 learned_addr learned my addr 172.21.15.100:0/355814653 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 -- 172.21.15.100:0/355814653 >> v2:172.21.15.170:3300/0 conn(0x7f49a40cb620 msgr2=0x7f49a40f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 --2- 172.21.15.100:0/355814653 >> v2:172.21.15.170:3300/0 conn(0x7f49a40cb620 0x7f49a40f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 -- 172.21.15.100:0/355814653 >> v1:172.21.15.170:6789/0 conn(0x7f49a40cb1a0 legacy=0x7f49a40f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.182+0000 7f49a3e00640 1 -- 172.21.15.100:0/355814653 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a40f50c0 con 0x7f49a4180660 2024-02-21T07:54:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.184+0000 7f49a3e00640 1 --2- 172.21.15.100:0/355814653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a4180660 0x7f49a41879b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49a408d350 tx=0x7f499402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11553ae49fc646fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.184+0000 7f49a2a00640 1 -- 172.21.15.100:0/355814653 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994030870 con 0x7f49a4180660 2024-02-21T07:54:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.184+0000 7f49a2a00640 1 -- 172.21.15.100:0/355814653 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49940309d0 con 0x7f49a4180660 2024-02-21T07:54:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.184+0000 7f49a2a00640 1 -- 172.21.15.100:0/355814653 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994030d60 con 0x7f49a4180660 2024-02-21T07:54:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 -- 172.21.15.100:0/355814653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a4180660 msgr2=0x7f49a41879b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 --2- 172.21.15.100:0/355814653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a4180660 0x7f49a41879b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49a408d350 tx=0x7f499402b9b0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 -- 172.21.15.100:0/355814653 shutdown_connections 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 --2- 172.21.15.100:0/355814653 >> v2:172.21.15.170:3300/0 conn(0x7f49a40cb620 0x7f49a40f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 --2- 172.21.15.100:0/355814653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a4180660 0x7f49a41879b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.185+0000 7f49a9600640 1 -- 172.21.15.100:0/355814653 >> 172.21.15.100:0/355814653 conn(0x7f49a40f64a0 msgr2=0x7f49a40f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.186+0000 7f49a9600640 1 -- 172.21.15.100:0/355814653 shutdown_connections 2024-02-21T07:54:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.186+0000 7f49a9600640 1 -- 172.21.15.100:0/355814653 wait complete. 2024-02-21T07:54:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.189+0000 7f49a9600640 1 Processor -- start 2024-02-21T07:54:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.189+0000 7f49a9600640 1 -- start start 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 0x7f49a416dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a4180660 0x7f49a416e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41729e0 con 0x7f49a40cb620 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4177dd0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a9600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a41780b0 con 0x7f49a4180660 2024-02-21T07:54:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36776/0 (socket says 172.21.15.100:36776) 2024-02-21T07:54:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a3e00640 1 -- 172.21.15.100:0/3648380929 learned_addr learned my addr 172.21.15.100:0/3648380929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.190+0000 7f49a3400640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 0x7f49a416dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a8c00640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a4180660 0x7f49a416e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 -- 172.21.15.100:0/3648380929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a4180660 msgr2=0x7f49a416e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a4180660 0x7f49a416e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 -- 172.21.15.100:0/3648380929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 msgr2=0x7f49a416dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 0x7f49a416dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 -- 172.21.15.100:0/3648380929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940094d0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3400640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 0x7f49a416dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a3e00640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f499402b9f0 tx=0x7f4994004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994039a10 con 0x7f49a40cb1a0 2024-02-21T07:54:36.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994039b90 con 0x7f49a40cb1a0 2024-02-21T07:54:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a4178390 con 0x7f49a40cb1a0 2024-02-21T07:54:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994043410 con 0x7f49a40cb1a0 2024-02-21T07:54:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.191+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a4178950 con 0x7f49a40cb1a0 2024-02-21T07:54:36.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.193+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c005290 con 0x7f49a40cb1a0 2024-02-21T07:54:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.195+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f499402f3c0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.196+0000 7f499be00640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 0x7f49840a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.196+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f49940ebfe0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.197+0000 7f49a3400640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 0x7f49840a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.198+0000 7f49a3400640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 0x7f49840a15e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49a416fa00 tx=0x7f4990009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.202+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f49940b5df0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.640+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f497c005ac0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.641+0000 7f499be00640 1 -- 172.21.15.100:0/3648380929 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f49940b94b0 con 0x7f49a40cb1a0 2024-02-21T07:54:36.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:54:36.644 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:54:36.644 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 msgr2=0x7f49840a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 0x7f49840a15e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49a416fa00 tx=0x7f4990009040 comp rx=0 tx=0).stop 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 msgr2=0x7f49a416d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f499402b9f0 tx=0x7f4994004730 comp rx=0 tx=0).stop 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 shutdown_connections 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f49a4180660 0x7f49a416e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f498409f120 0x7f49840a15e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a40cb620 0x7f49a416dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 --2- 172.21.15.100:0/3648380929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49a40cb1a0 0x7f49a416d690 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 >> 172.21.15.100:0/3648380929 conn(0x7f49a40f64a0 msgr2=0x7f49a417de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:36.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.646+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 shutdown_connections 2024-02-21T07:54:36.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:36.647+0000 7f49a9600640 1 -- 172.21.15.100:0/3648380929 wait complete. 2024-02-21T07:54:36.676 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:36.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:54:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.013+0000 7f3650c00640 1 Processor -- start 2024-02-21T07:54:37.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.013+0000 7f3650c00640 1 -- start start 2024-02-21T07:54:37.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.025+0000 7f3650c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c1873a0 con 0x7f364c0f5c30 2024-02-21T07:54:37.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.025+0000 7f3650c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0f6370 con 0x7f364c186f20 2024-02-21T07:54:37.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.025+0000 7f3650c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c0f6650 con 0x7f364c070da0 2024-02-21T07:54:37.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.027+0000 7f3641e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f364c0f5c30 0x7f364c186810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41856/0 (socket says 172.21.15.100:41856) 2024-02-21T07:54:37.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.027+0000 7f3641e00640 1 -- 172.21.15.100:0/140812635 learned_addr learned my addr 172.21.15.100:0/140812635 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:37.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.028+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200892725 0 0) 0x7f364c1873a0 con 0x7f364c0f5c30 2024-02-21T07:54:37.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.028+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3630003520 con 0x7f364c0f5c30 2024-02-21T07:54:37.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1559732670 0 0) 0x7f3630003520 con 0x7f364c0f5c30 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 >> v1:172.21.15.170:6789/0 conn(0x7f364c070da0 legacy=0x7f364c06ab60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 >> v1:172.21.15.156:6789/0 conn(0x7f364c186f20 legacy=0x7f364c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c18bc90 con 0x7f364c0f5c30 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f363c001670 con 0x7f364c0f5c30 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 >> v1:172.21.15.100:6789/0 conn(0x7f364c0f5c30 legacy=0x7f364c186810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36300039f0 0x7f3630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f3630004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36300052a0 0x7f3630014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300149d0 con 0x7f36300047c0 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3630014b40 con 0x7f36300039f0 2024-02-21T07:54:37.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.029+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36300059d0 con 0x7f36300052a0 2024-02-21T07:54:37.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.030+0000 7f3649e00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f3630004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3641e00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36300039f0 0x7f3630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3649e00640 1 -- 172.21.15.100:0/140812635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36300052a0 msgr2=0x7f3630014190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3649e00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36300052a0 0x7f3630014190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3649e00640 1 -- 172.21.15.100:0/140812635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36300039f0 msgr2=0x7f3630003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3649e00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f36300039f0 0x7f3630003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.031+0000 7f3649e00640 1 -- 172.21.15.100:0/140812635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c18bc90 con 0x7f36300047c0 2024-02-21T07:54:37.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.034+0000 7f364a800640 1 -- 172.21.15.100:0/140812635 reap_dead start 2024-02-21T07:54:37.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.035+0000 7f3649e00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f3630004c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3634003da0 tx=0x7f36300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14871dba13451c79 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.036+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634032600 con 0x7f36300047c0 2024-02-21T07:54:37.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.036+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363402e050 con 0x7f36300047c0 2024-02-21T07:54:37.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.037+0000 7f3649400640 1 -- 172.21.15.100:0/140812635 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340329c0 con 0x7f36300047c0 2024-02-21T07:54:37.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.038+0000 7f3650c00640 1 -- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 msgr2=0x7f3630004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.038+0000 7f3650c00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f3630004c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3634003da0 tx=0x7f36300057f0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.044+0000 7f3650c00640 1 -- 172.21.15.100:0/140812635 shutdown_connections 2024-02-21T07:54:37.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.044+0000 7f3650c00640 1 --2- 172.21.15.100:0/140812635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f3630004c40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.044+0000 7f3650c00640 1 -- 172.21.15.100:0/140812635 >> 172.21.15.100:0/140812635 conn(0x7f364c071fd0 msgr2=0x7f364c0723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.049+0000 7f3650c00640 1 -- 172.21.15.100:0/140812635 shutdown_connections 2024-02-21T07:54:37.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.049+0000 7f3650c00640 1 -- 172.21.15.100:0/140812635 wait complete. 2024-02-21T07:54:37.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.053+0000 7f3650c00640 1 Processor -- start 2024-02-21T07:54:37.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.053+0000 7f3650c00640 1 -- start start 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.054+0000 7f3650c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3650c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f364c218210 0x7f364c21cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3650c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364c21d2b0 0x7f364c21d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3650c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c21a0d0 con 0x7f36300047c0 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3650c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c21b710 con 0x7f364c218210 2024-02-21T07:54:37.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3650c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c21b9f0 con 0x7f364c21d2b0 2024-02-21T07:54:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3641e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3641e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46912/0 (socket says 172.21.15.100:46912) 2024-02-21T07:54:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.055+0000 7f3641e00640 1 -- 172.21.15.100:0/1846475381 learned_addr learned my addr 172.21.15.100:0/1846475381 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3649e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f364c218210 0x7f364c21cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f364a800640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364c21d2b0 0x7f364c21d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3641e00640 1 -- 172.21.15.100:0/1846475381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364c21d2b0 msgr2=0x7f364c21d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3641e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364c21d2b0 0x7f364c21d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3641e00640 1 -- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f364c218210 msgr2=0x7f364c21cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3641e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f364c218210 0x7f364c21cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.056+0000 7f3641e00640 1 -- 172.21.15.100:0/1846475381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c21bcd0 con 0x7f36300047c0 2024-02-21T07:54:37.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.058+0000 7f3641e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f363c00d8e0 tx=0x7f363c00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.061+0000 7f3642a00640 1 -- 172.21.15.100:0/1846475381 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0075a0 con 0x7f36300047c0 2024-02-21T07:54:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.061+0000 7f3642a00640 1 -- 172.21.15.100:0/1846475381 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0047e0 con 0x7f36300047c0 2024-02-21T07:54:37.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.061+0000 7f3642a00640 1 -- 172.21.15.100:0/1846475381 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c004b50 con 0x7f36300047c0 2024-02-21T07:54:37.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.062+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c21bfb0 con 0x7f36300047c0 2024-02-21T07:54:37.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.062+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c21c570 con 0x7f36300047c0 2024-02-21T07:54:37.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.066+0000 7f3642a00640 1 -- 172.21.15.100:0/1846475381 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f363c004cb0 con 0x7f36300047c0 2024-02-21T07:54:37.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.074+0000 7f3642a00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 0x7f36280a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.075+0000 7f3642a00640 1 -- 172.21.15.100:0/1846475381 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f363c0c9a70 con 0x7f36300047c0 2024-02-21T07:54:37.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.088+0000 7f36537f4740 1 Processor -- start 2024-02-21T07:54:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.080+0000 7f3649e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 0x7f36280a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.089+0000 7f36537f4740 1 -- start start 2024-02-21T07:54:37.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.090+0000 7f3649e00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 0x7f36280a16e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3634034000 tx=0x7f3634009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 0x557bd70602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd709b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd709c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6f93210 con 0x557bd709b590 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6f90740 con 0x557bd705fec0 2024-02-21T07:54:37.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f36537f4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6f8bf20 con 0x557bd70607e0 2024-02-21T07:54:37.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.091+0000 7f3641e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 0x557bd70602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3649e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd709b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3649e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd709b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41718/0 (socket says 172.21.15.100:41718) 2024-02-21T07:54:37.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3649e00640 1 -- 172.21.15.100:0/2832290562 learned_addr learned my addr 172.21.15.100:0/2832290562 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f364a800640 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd709c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3641e00640 1 -- 172.21.15.100:0/2832290562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 msgr2=0x557bd709b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3641e00640 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd709b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3641e00640 1 -- 172.21.15.100:0/2832290562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 msgr2=0x557bd709c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.092+0000 7f3641e00640 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd709c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.093+0000 7f3641e00640 1 -- 172.21.15.100:0/2832290562 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd6f4ddf0 con 0x557bd705fec0 2024-02-21T07:54:37.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.094+0000 7f3641e00640 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 0x557bd70602a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f363c0c73e0 tx=0x7f363c096f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5371f8c3747d68 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.100+0000 7f363a600640 1 -- 172.21.15.100:0/2832290562 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c09b6a0 con 0x557bd705fec0 2024-02-21T07:54:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.100+0000 7f363a600640 1 -- 172.21.15.100:0/2832290562 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c09fcf0 con 0x557bd705fec0 2024-02-21T07:54:37.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.100+0000 7f363a600640 1 -- 172.21.15.100:0/2832290562 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0b6070 con 0x557bd705fec0 2024-02-21T07:54:37.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.101+0000 7f36537f4740 1 -- 172.21.15.100:0/2832290562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 msgr2=0x557bd70602a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.101+0000 7f36537f4740 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 0x557bd70602a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f363c0c73e0 tx=0x7f363c096f70 comp rx=0 tx=0).stop 2024-02-21T07:54:37.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.104+0000 7f36537f4740 1 -- 172.21.15.100:0/2832290562 shutdown_connections 2024-02-21T07:54:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.104+0000 7f36537f4740 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd709c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.105+0000 7f36537f4740 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd709b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.105+0000 7f36537f4740 1 --2- 172.21.15.100:0/2832290562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd705fec0 0x557bd70602a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.105+0000 7f36537f4740 1 -- 172.21.15.100:0/2832290562 >> 172.21.15.100:0/2832290562 conn(0x557bd7022490 msgr2=0x557bd7023510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.106+0000 7f36537f4740 1 -- 172.21.15.100:0/2832290562 shutdown_connections 2024-02-21T07:54:37.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.107+0000 7f36537f4740 1 -- 172.21.15.100:0/2832290562 wait complete. 2024-02-21T07:54:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.109+0000 7f36537f4740 1 -- start start 2024-02-21T07:54:37.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.109+0000 7f36537f4740 1 Processor -- start 2024-02-21T07:54:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.114+0000 7f36537f4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd70a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.114+0000 7f36537f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7066910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.114+0000 7f36537f4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f36537f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6f31150 con 0x557bd709b590 2024-02-21T07:54:37.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f36537f4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6f30df0 con 0x557bd70a4df0 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f36537f4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd6cfa1c0 con 0x557bd70607e0 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f364a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f364a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36808/0 (socket says 172.21.15.100:36808) 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f364a800640 1 -- 172.21.15.100:0/2397299999 learned_addr learned my addr 172.21.15.100:0/2397299999 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f3641e00640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd70a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.115+0000 7f36537f4740 10 client.0 _ll_register_callbacks cb 0x557bd6f802b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.116+0000 7f364a800640 1 -- 172.21.15.100:0/2397299999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 msgr2=0x557bd70a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.116+0000 7f364a800640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd70a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.116+0000 7f364a800640 1 -- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 msgr2=0x557bd7066910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.116+0000 7f364a800640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7066910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.116+0000 7f364a800640 1 -- 172.21.15.100:0/2397299999 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c21c570 con 0x557bd70a4df0 2024-02-21T07:54:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.122+0000 7f364a800640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f364c08ecd0 tx=0x7f364400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a76048e6aaf0e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.122+0000 7f362ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:37.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.125+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644012070 con 0x557bd70a4df0 2024-02-21T07:54:37.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.125+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f364400bb10 con 0x557bd70a4df0 2024-02-21T07:54:37.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.126+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bd6c8b7e0 con 0x557bd70a4df0 2024-02-21T07:54:37.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.126+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f364400bcd0 con 0x557bd70a4df0 2024-02-21T07:54:37.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.126+0000 7f36537f4740 10 client.6889 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:37.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.126+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557bd6f8a5a0 con 0x557bd70a4df0 2024-02-21T07:54:37.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.128+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bd6c8b7e0 con 0x557bd70a4df0 2024-02-21T07:54:37.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.128+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f364401e3f0 con 0x557bd70a4df0 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.128+0000 7f36537f4740 10 client.6889 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.128+0000 7f36537f4740 10 client.6889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.128+0000 7f36537f4740 20 client.6889 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.129+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd70a5270 0x557bd7056490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.129+0000 7f36537f4740 4 client.6889 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.129+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bd6cc8720 con 0x557bd70a5270 2024-02-21T07:54:37.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.131+0000 7f3641e00640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd70a5270 0x557bd7056490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.132+0000 7f3641e00640 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd70a5270 0x557bd7056490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d3d4aa710ed13a1 server_cookie=3b66de9b4fa6abae in_seq=0 out_seq=0 2024-02-21T07:54:37.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.133+0000 7f362ea00640 10 client.6889 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.136+0000 7f362ea00640 1 -- 172.21.15.100:0/2397299999 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557bd6cc8720 con 0x557bd70a5270 2024-02-21T07:54:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.136+0000 7f362ea00640 10 client.6889 handle_command_reply: tid=0 2024-02-21T07:54:37.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.136+0000 7f36537f4740 1 client.6889 shutdown 2024-02-21T07:54:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 msgr2=0x557bd70889d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f364c08ecd0 tx=0x7f364400dbe0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 shutdown_connections 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd70a5270 0x557bd7056490 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70889d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 --2- 172.21.15.100:0/2397299999 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70607e0 0x557bd70a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.138+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 >> 172.21.15.100:0/2397299999 conn(0x557bd705fec0 msgr2=0x557bd709b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.139+0000 7f362ea00640 0 client.6889 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:37.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.146+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 shutdown_connections 2024-02-21T07:54:37.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.147+0000 7f36537f4740 1 -- 172.21.15.100:0/2397299999 wait complete. 2024-02-21T07:54:37.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.147+0000 7f36537f4740 20 client.6889 trim_cache size 0 max 16384 2024-02-21T07:54:37.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.178+0000 7f36537f4740 1 Processor -- start 2024-02-21T07:54:37.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.179+0000 7f36537f4740 1 -- start start 2024-02-21T07:54:37.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 0x557bd7021570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 0x557bd7097570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70f4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c06e3d0 con 0x557bd70607e0 2024-02-21T07:54:37.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd701e760 con 0x557bd70a4df0 2024-02-21T07:54:37.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.181+0000 7f36537f4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd7029e70 con 0x557bd709b590 2024-02-21T07:54:37.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.182+0000 7f364a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.182+0000 7f364a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36824/0 (socket says 172.21.15.100:36824) 2024-02-21T07:54:37.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.182+0000 7f364a800640 1 -- 172.21.15.100:0/3406971237 learned_addr learned my addr 172.21.15.100:0/3406971237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.182+0000 7f3649e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 0x557bd7097570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.183+0000 7f3641e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 0x557bd7021570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.184+0000 7f3641e00640 1 -- 172.21.15.100:0/3406971237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 msgr2=0x557bd7097570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.185+0000 7f3641e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 0x557bd7097570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.185+0000 7f3641e00640 1 -- 172.21.15.100:0/3406971237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 msgr2=0x557bd70f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.185+0000 7f3641e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.185+0000 7f3641e00640 1 -- 172.21.15.100:0/3406971237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd7098a30 con 0x557bd70607e0 2024-02-21T07:54:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.186+0000 7f3649e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 0x557bd7097570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:37.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.188+0000 7f3641e00640 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 0x557bd7021570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdf360f51325de8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.190+0000 7f3639c00640 1 -- 172.21.15.100:0/3406971237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0af040 con 0x557bd70607e0 2024-02-21T07:54:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.192+0000 7f3639c00640 1 -- 172.21.15.100:0/3406971237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c0af1a0 con 0x557bd70607e0 2024-02-21T07:54:37.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.192+0000 7f3639c00640 1 -- 172.21.15.100:0/3406971237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0af040 con 0x557bd70607e0 2024-02-21T07:54:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.197+0000 7f36537f4740 1 -- 172.21.15.100:0/3406971237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 msgr2=0x557bd7021570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.197+0000 7f36537f4740 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 0x557bd7021570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f363c00b4a0 tx=0x7f363c01f000 comp rx=0 tx=0).stop 2024-02-21T07:54:37.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.202+0000 7f36537f4740 1 -- 172.21.15.100:0/3406971237 shutdown_connections 2024-02-21T07:54:37.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.202+0000 7f36537f4740 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70a4df0 0x557bd70f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.202+0000 7f36537f4740 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd709b590 0x557bd7097570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.203+0000 7f36537f4740 1 --2- 172.21.15.100:0/3406971237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd70607e0 0x557bd7021570 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.203+0000 7f36537f4740 1 -- 172.21.15.100:0/3406971237 >> 172.21.15.100:0/3406971237 conn(0x557bd705fec0 msgr2=0x557bd7067540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.204+0000 7f36537f4740 1 -- 172.21.15.100:0/3406971237 shutdown_connections 2024-02-21T07:54:37.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.204+0000 7f36537f4740 1 -- 172.21.15.100:0/3406971237 wait complete. 2024-02-21T07:54:37.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.207+0000 7f36537f4740 1 -- start start 2024-02-21T07:54:37.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.207+0000 7f36537f4740 1 Processor -- start 2024-02-21T07:54:37.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.210+0000 7f36537f4740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.210+0000 7f36537f4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7023830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f36537f4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70a4df0 0x557bd7020cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f36537f4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd7090a70 con 0x557bd709b590 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f36537f4740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd7088e30 con 0x557bd70607e0 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f36537f4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd70ac410 con 0x557bd70a4df0 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f36537f4740 10 client.0 _ll_register_callbacks cb 0x7f363c007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f3641e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f3641e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36826/0 (socket says 172.21.15.100:36826) 2024-02-21T07:54:37.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.211+0000 7f3641e00640 1 -- 172.21.15.100:0/4242955128 learned_addr learned my addr 172.21.15.100:0/4242955128 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.212+0000 7f3649e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7023830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.212+0000 7f364a800640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70a4df0 0x557bd7020cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3641e00640 1 -- 172.21.15.100:0/4242955128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70a4df0 msgr2=0x557bd7020cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3641e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70a4df0 0x557bd7020cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3641e00640 1 -- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 msgr2=0x557bd7023830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3641e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7023830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3641e00640 1 -- 172.21.15.100:0/4242955128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c18bc90 con 0x557bd70607e0 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.213+0000 7f3649e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7023830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.214+0000 7f3641e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f363c0019d0 tx=0x7f363c000f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23ecb5528360998 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.214+0000 7f362ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.215+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0c7640 con 0x557bd70607e0 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.215+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f363c0b6070 con 0x557bd70607e0 2024-02-21T07:54:37.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.216+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f363c09fcf0 con 0x557bd70607e0 2024-02-21T07:54:37.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.217+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f363c0b6230 con 0x557bd70607e0 2024-02-21T07:54:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.217+0000 7f36537f4740 10 client.6895 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.217+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x557bd6f4ddf0 con 0x557bd70607e0 2024-02-21T07:54:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c09fcf0 con 0x557bd70607e0 2024-02-21T07:54:37.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f363c0969a0 con 0x557bd70607e0 2024-02-21T07:54:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 10 client.6895 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 10 client.6895 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:54:37.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 20 client.6895 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd708d8b0 0x557bd708fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 4 client.6895 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.218+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557bd6d17890 con 0x557bd708d8b0 2024-02-21T07:54:37.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.219+0000 7f3649e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd708d8b0 0x557bd708fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.221+0000 7f3649e00640 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd708d8b0 0x557bd708fdc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10cab0c1130a2daa server_cookie=b685bce1b25307be in_seq=0 out_seq=0 2024-02-21T07:54:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.221+0000 7f362ea00640 10 client.6895 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f362ea00640 1 -- 172.21.15.100:0/4242955128 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557bd6d17890 con 0x557bd708d8b0 2024-02-21T07:54:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f362ea00640 10 client.6895 handle_command_reply: tid=0 2024-02-21T07:54:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 client.6895 shutdown 2024-02-21T07:54:37.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 msgr2=0x557bd70f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f363c0019d0 tx=0x7f363c000f50 comp rx=0 tx=0).stop 2024-02-21T07:54:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 shutdown_connections 2024-02-21T07:54:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x557bd708d8b0 0x557bd708fdc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557bd70a4df0 0x557bd7020cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557bd709b590 0x557bd7023830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 --2- 172.21.15.100:0/4242955128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557bd70607e0 0x557bd70f0d40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.222+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 >> 172.21.15.100:0/4242955128 conn(0x557bd705fec0 msgr2=0x557bd701e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.224+0000 7f362ea00640 0 client.6895 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:54:37.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.225+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 shutdown_connections 2024-02-21T07:54:37.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.225+0000 7f36537f4740 1 -- 172.21.15.100:0/4242955128 wait complete. 2024-02-21T07:54:37.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.227+0000 7f36537f4740 20 client.6895 trim_cache size 0 max 16384 2024-02-21T07:54:37.230 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:37.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.228+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 msgr2=0x7f36280a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.228+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 0x7f36280a16e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3634034000 tx=0x7f3634009030 comp rx=0 tx=0).stop 2024-02-21T07:54:37.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.228+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 msgr2=0x7f364c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.228+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f363c00d8e0 tx=0x7f363c00dda0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 shutdown_connections 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f364c21d2b0 0x7f364c21d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f364c218210 0x7f364c21cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f362809f220 0x7f36280a16e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 --2- 172.21.15.100:0/1846475381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36300047c0 0x7f364c0ccac0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 >> 172.21.15.100:0/1846475381 conn(0x7f364c071fd0 msgr2=0x7f364c1861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 shutdown_connections 2024-02-21T07:54:37.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.229+0000 7f3650c00640 1 -- 172.21.15.100:0/1846475381 wait complete. 2024-02-21T07:54:37.256 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:37.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:54:37.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.557+0000 7f2ecf000640 1 Processor -- start 2024-02-21T07:54:37.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.557+0000 7f2ecf000640 1 -- start start 2024-02-21T07:54:37.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.560+0000 7f2ecf000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 0x7f2ec8186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.561+0000 7f2ecf000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec8186670 con 0x7f2ec8071d40 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.561+0000 7f2ecf000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec8071010 con 0x7f2ec8188c30 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.561+0000 7f2ecf000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec8183340 con 0x7f2ec8182f60 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.561+0000 7f2ec7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 0x7f2ec8186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.562+0000 7f2ec7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 0x7f2ec8186130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41748/0 (socket says 172.21.15.100:41748) 2024-02-21T07:54:37.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.562+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4083967789 learned_addr learned my addr 172.21.15.100:0/4083967789 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.563+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024805074 0 0) 0x7f2ec8071010 con 0x7f2ec8188c30 2024-02-21T07:54:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.563+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eac005730 con 0x7f2ec8188c30 2024-02-21T07:54:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.563+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691055553 0 0) 0x7f2ec8186670 con 0x7f2ec8071d40 2024-02-21T07:54:37.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.563+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec8071010 con 0x7f2ec8071d40 2024-02-21T07:54:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 368835006 0 0) 0x7f2eac005730 con 0x7f2ec8188c30 2024-02-21T07:54:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 msgr2=0x7f2ec8186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 --2- 172.21.15.100:0/4083967789 >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 0x7f2ec8186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 >> v1:172.21.15.100:6789/0 conn(0x7f2ec8071d40 legacy=0x7f2ec80721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec806eb10 con 0x7f2ec8188c30 2024-02-21T07:54:37.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f2ec00019f0 con 0x7f2ec8188c30 2024-02-21T07:54:37.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.566+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 >> v1:172.21.15.170:6789/0 conn(0x7f2ec8188c30 legacy=0x7f2ec8189040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.567+0000 7f2ec6a00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2eac0071c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.567+0000 7f2ec6a00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eac005970 0x7f2eac005df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.568+0000 7f2ec6a00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eac006330 0x7f2eac00ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.569+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8183340 con 0x7f2eac005970 2024-02-21T07:54:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.569+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0106c0 con 0x7f2eac006330 2024-02-21T07:54:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.569+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac010880 con 0x7f2eac006dc0 2024-02-21T07:54:37.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.570+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4083967789 >> v2:172.21.15.170:3300/0 conn(0x7f2ec8182f60 0x7f2ec8186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.570+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2eac0071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.570+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4083967789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eac006330 msgr2=0x7f2eac00ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.570+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2eac006330 0x7f2eac00ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.570+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4083967789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eac005970 msgr2=0x7f2eac005df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.571+0000 7f2ec7400640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eac005970 0x7f2eac005df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.571+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eac005970 0x7f2eac005df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.572+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4083967789 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec806eb10 con 0x7f2eac006dc0 2024-02-21T07:54:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.573+0000 7f2ecd000640 1 -- 172.21.15.100:0/4083967789 reap_dead start 2024-02-21T07:54:37.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.573+0000 7f2ec7400640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2eac005970 0x7f2eac005df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:37.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.573+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2eac0071c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800ab40 tx=0x7f2eac007a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda1633be67239a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.574+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb802d700 con 0x7f2eac006dc0 2024-02-21T07:54:37.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.574+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb802d860 con 0x7f2eac006dc0 2024-02-21T07:54:37.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.574+0000 7f2ec6a00640 1 -- 172.21.15.100:0/4083967789 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb802dc10 con 0x7f2eac006dc0 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 -- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 msgr2=0x7f2eac0071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2eac0071c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800ab40 tx=0x7f2eac007a00 comp rx=0 tx=0).stop 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 -- 172.21.15.100:0/4083967789 shutdown_connections 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4083967789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2eac0071c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 -- 172.21.15.100:0/4083967789 >> 172.21.15.100:0/4083967789 conn(0x7f2ec80668b0 msgr2=0x7f2ec8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.575+0000 7f2ecf000640 1 -- 172.21.15.100:0/4083967789 shutdown_connections 2024-02-21T07:54:37.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.576+0000 7f2ecf000640 1 -- 172.21.15.100:0/4083967789 wait complete. 2024-02-21T07:54:37.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.579+0000 7f2ecf000640 1 Processor -- start 2024-02-21T07:54:37.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.579+0000 7f2ecf000640 1 -- start start 2024-02-21T07:54:37.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.581+0000 7f2ecf000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.581+0000 7f2ecf000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 0x7f2ec821b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ec7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 0x7f2ec821b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41778/0 (socket says 172.21.15.100:41778) 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ecf000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8217ef0 0x7f2ec8218370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ecf000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec821bd90 con 0x7f2ec821b3f0 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ecf000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec821bfd0 con 0x7f2ec8217ef0 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ecf000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec821c2b0 con 0x7f2eac006dc0 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4191452835 learned_addr learned my addr 172.21.15.100:0/4191452835 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.582+0000 7f2ec7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 0x7f2ec821b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46964/0 (socket says 172.21.15.100:46964) 2024-02-21T07:54:37.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ecd000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8217ef0 0x7f2ec8218370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8217ef0 msgr2=0x7f2ec8218370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8217ef0 0x7f2ec8218370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4191452835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 msgr2=0x7f2ec821b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 0x7f2ec821b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.583+0000 7f2ec7e00640 1 -- 172.21.15.100:0/4191452835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec821c590 con 0x7f2eac006dc0 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.584+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8037040 tx=0x7f2eb8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.584+0000 7f2ebfe00640 1 -- 172.21.15.100:0/4191452835 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8035c60 con 0x7f2eac006dc0 2024-02-21T07:54:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.584+0000 7f2ebfe00640 1 -- 172.21.15.100:0/4191452835 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb8035dc0 con 0x7f2eac006dc0 2024-02-21T07:54:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.584+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec821c870 con 0x7f2eac006dc0 2024-02-21T07:54:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.585+0000 7f2ebfe00640 1 -- 172.21.15.100:0/4191452835 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80416b0 con 0x7f2eac006dc0 2024-02-21T07:54:37.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.585+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec821ce30 con 0x7f2eac006dc0 2024-02-21T07:54:37.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.591+0000 7f2ed1d9a740 1 Processor -- start 2024-02-21T07:54:37.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.593+0000 7f2ed1d9a740 1 -- start start 2024-02-21T07:54:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.594+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 0x5651456d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.594+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145701680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.594+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145603210 con 0x5651456d4b60 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145600740 con 0x5651456db580 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651455fbf20 con 0x5651456db100 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ecd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 0x5651456d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36864/0 (socket says 172.21.15.100:36864) 2024-02-21T07:54:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 -- 172.21.15.100:0/2121756070 learned_addr learned my addr 172.21.15.100:0/2121756070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 -- 172.21.15.100:0/2121756070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 msgr2=0x565145701680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145701680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 -- 172.21.15.100:0/2121756070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 msgr2=0x5651456d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.595+0000 7f2ec7400640 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 0x5651456d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.596+0000 7f2ec7400640 1 -- 172.21.15.100:0/2121756070 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651455bddf0 con 0x5651456db580 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.596+0000 7f2ecd000640 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 0x5651456d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.596+0000 7f2ec7400640 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0001640 tx=0x7f2eb0001b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1be145cd55d6b427 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.597+0000 7f2ebcc00640 1 -- 172.21.15.100:0/2121756070 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00052e0 con 0x5651456db580 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.597+0000 7f2ebcc00640 1 -- 172.21.15.100:0/2121756070 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000d070 con 0x5651456db580 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.597+0000 7f2ebcc00640 1 -- 172.21.15.100:0/2121756070 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000f750 con 0x5651456db580 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.597+0000 7f2ebfe00640 1 -- 172.21.15.100:0/4191452835 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2eb8041810 con 0x7f2eac006dc0 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2121756070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 msgr2=0x565145701bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0001640 tx=0x7f2eb0001b00 comp rx=0 tx=0).stop 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2121756070 shutdown_connections 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x565145701bc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145701680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2121756070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456d4b60 0x5651456d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2121756070 >> 172.21.15.100:0/2121756070 conn(0x565145692490 msgr2=0x565145693510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2121756070 shutdown_connections 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.598+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2121756070 wait complete. 2024-02-21T07:54:37.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.599+0000 7f2ebfe00640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 0x7f2ea40a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.599+0000 7f2ed1d9a740 1 -- start start 2024-02-21T07:54:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.599+0000 7f2ebfe00640 1 -- 172.21.15.100:0/4191452835 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2eb8031070 con 0x7f2eac006dc0 2024-02-21T07:54:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.599+0000 7f2ed1d9a740 1 Processor -- start 2024-02-21T07:54:37.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145703e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x5651456c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651455a1150 con 0x5651456c32a0 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651455a0df0 con 0x5651456db580 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514536a1c0 con 0x5651456db100 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ed1d9a740 10 client.0 _ll_register_callbacks cb 0x5651455f02b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.602+0000 7f2ecd000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 0x7f2ea40a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.603+0000 7f2ec7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x5651456c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.603+0000 7f2ecd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.603+0000 7f2ecd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46988/0 (socket says 172.21.15.100:46988) 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.603+0000 7f2ecd000640 1 -- 172.21.15.100:0/2744697626 learned_addr learned my addr 172.21.15.100:0/2744697626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.604+0000 7f2ecd000640 1 -- 172.21.15.100:0/2744697626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 msgr2=0x565145703e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.604+0000 7f2ecd000640 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145703e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.604+0000 7f2ecd000640 1 -- 172.21.15.100:0/2744697626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 msgr2=0x5651456c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.604+0000 7f2ecd000640 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x5651456c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.604+0000 7f2ecd000640 1 -- 172.21.15.100:0/2744697626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec8071010 con 0x5651456c32a0 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.605+0000 7f2ecd000640 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80cc160 tx=0x7f2ec0014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bcfc6815ccf191 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.605+0000 7f2eb5600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.605+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0008c30 con 0x5651456c32a0 2024-02-21T07:54:37.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.607+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651452fb7e0 con 0x5651456c32a0 2024-02-21T07:54:37.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.607+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ec0019480 con 0x5651456c32a0 2024-02-21T07:54:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.609+0000 7f2ecd000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 0x7f2ea40a14f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0014b50 tx=0x7f2ec0010000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.611+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec0008c30 con 0x5651456c32a0 2024-02-21T07:54:37.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.611+0000 7f2ed1d9a740 10 client.6732 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:37.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.615+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5651455fa5a0 con 0x5651456c32a0 2024-02-21T07:54:37.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.621+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651452fb7e0 con 0x5651456c32a0 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ec0003b80 con 0x5651456c32a0 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 10 client.6732 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 10 client.6732 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 20 client.6732 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5651456c3720 0x5651457184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 4 client.6732 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:37.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.622+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565145338720 con 0x5651456c3720 2024-02-21T07:54:37.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.631+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5651456c3720 0x5651457184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.632+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5651456c3720 0x5651457184a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49ad34f3ee2b7cb4 server_cookie=db553d7c051d29 in_seq=0 out_seq=0 2024-02-21T07:54:37.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.635+0000 7f2eb5600640 10 client.6732 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:37.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.635+0000 7f2eb5600640 1 -- 172.21.15.100:0/2744697626 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565145338720 con 0x5651456c3720 2024-02-21T07:54:37.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.635+0000 7f2eb5600640 10 client.6732 handle_command_reply: tid=0 2024-02-21T07:54:37.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.636+0000 7f2ed1d9a740 1 client.6732 shutdown 2024-02-21T07:54:37.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.642+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 msgr2=0x5651456c0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.642+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80cc160 tx=0x7f2ec0014650 comp rx=0 tx=0).stop 2024-02-21T07:54:37.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 shutdown_connections 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456c32a0 0x5651456c0cf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5651456c3720 0x5651457184a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456db580 0x5651456c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/2744697626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db100 0x565145703e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2eb5600640 0 client.6732 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.644+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 >> 172.21.15.100:0/2744697626 conn(0x5651456d4b60 msgr2=0x565145702580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.655+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 shutdown_connections 2024-02-21T07:54:37.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.659+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/2744697626 wait complete. 2024-02-21T07:54:37.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.663+0000 7f2ed1d9a740 20 client.6732 trim_cache size 0 max 16384 2024-02-21T07:54:37.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.714+0000 7f2ed1d9a740 1 Processor -- start 2024-02-21T07:54:37.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.714+0000 7f2ed1d9a740 1 -- start start 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x5651456fd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x5651456d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145692920 con 0x5651456db100 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145718780 con 0x5651456c32a0 2024-02-21T07:54:37.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.716+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145713770 con 0x5651456db580 2024-02-21T07:54:37.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.720+0000 7f2ecd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.720+0000 7f2ecd000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41796/0 (socket says 172.21.15.100:41796) 2024-02-21T07:54:37.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.720+0000 7f2ecd000640 1 -- 172.21.15.100:0/3624078318 learned_addr learned my addr 172.21.15.100:0/3624078318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.724+0000 7f2ecd000640 1 -- 172.21.15.100:0/3624078318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 msgr2=0x5651456fd570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.725+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x5651456fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.725+0000 7f2ecd000640 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x5651456fd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.725+0000 7f2ecd000640 1 -- 172.21.15.100:0/3624078318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 msgr2=0x5651456d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.725+0000 7f2ecd000640 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x5651456d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.725+0000 7f2ecd000640 1 -- 172.21.15.100:0/3624078318 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565145596ab0 con 0x5651456db580 2024-02-21T07:54:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.726+0000 7f2ecd000640 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0014690 tx=0x7f2ec0001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba742bc75800d98 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.727+0000 7f2eb7e00640 1 -- 172.21.15.100:0/3624078318 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0018e70 con 0x5651456db580 2024-02-21T07:54:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.728+0000 7f2eb7e00640 1 -- 172.21.15.100:0/3624078318 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0003b80 con 0x5651456db580 2024-02-21T07:54:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.728+0000 7f2eb7e00640 1 -- 172.21.15.100:0/3624078318 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0004220 con 0x5651456db580 2024-02-21T07:54:37.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.729+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x5651456fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.731+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/3624078318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 msgr2=0x5651457024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.731+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0014690 tx=0x7f2ec0001250 comp rx=0 tx=0).stop 2024-02-21T07:54:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.734+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/3624078318 shutdown_connections 2024-02-21T07:54:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.734+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x5651457024e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.734+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x5651456d5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.734+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/3624078318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x5651456fd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.734+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/3624078318 >> 172.21.15.100:0/3624078318 conn(0x5651456d4b60 msgr2=0x565145703ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.735+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/3624078318 shutdown_connections 2024-02-21T07:54:37.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.737+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/3624078318 wait complete. 2024-02-21T07:54:37.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.738+0000 7f2ed1d9a740 1 -- start start 2024-02-21T07:54:37.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.738+0000 7f2ed1d9a740 1 Processor -- start 2024-02-21T07:54:37.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x56514575c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x565145700740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x56514575c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x565145702950 con 0x5651456db100 2024-02-21T07:54:37.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514570ee60 con 0x5651456c32a0 2024-02-21T07:54:37.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56514576f0e0 con 0x5651456db580 2024-02-21T07:54:37.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.745+0000 7f2ed1d9a740 10 client.0 _ll_register_callbacks cb 0x7f2eb0007c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:37.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.746+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x56514575c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.746+0000 7f2ec7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x56514575c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36912/0 (socket says 172.21.15.100:36912) 2024-02-21T07:54:37.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.746+0000 7f2ec7e00640 1 -- 172.21.15.100:0/1334045713 learned_addr learned my addr 172.21.15.100:0/1334045713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.746+0000 7f2ec7400640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x565145700740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.747+0000 7f2ec7400640 1 -- 172.21.15.100:0/1334045713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 msgr2=0x56514575c180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.747+0000 7f2ec7400640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x56514575c180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.747+0000 7f2ec7400640 1 -- 172.21.15.100:0/1334045713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 msgr2=0x56514575c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.747+0000 7f2ec7400640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x56514575c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.747+0000 7f2ec7400640 1 -- 172.21.15.100:0/1334045713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651455fa5a0 con 0x5651456db100 2024-02-21T07:54:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.748+0000 7f2ec7400640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x565145700740 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0028000 tx=0x7f2eb0007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714069c332bf17c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.748+0000 7f2eb5600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.748+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0006e90 con 0x5651456db100 2024-02-21T07:54:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.749+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2eb0007040 con 0x5651456db100 2024-02-21T07:54:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.749+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2eb000d070 con 0x5651456db100 2024-02-21T07:54:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.750+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eb0007200 con 0x5651456db100 2024-02-21T07:54:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.750+0000 7f2ed1d9a740 10 client.6735 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:37.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.750+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5651455bc650 con 0x5651456db100 2024-02-21T07:54:37.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000d070 con 0x5651456db100 2024-02-21T07:54:37.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2eb0007360 con 0x5651456db100 2024-02-21T07:54:37.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 10 client.6735 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:37.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 10 client.6735 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 20 client.6735 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56514568e110 0x56514576f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 4 client.6735 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.752+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x565145387890 con 0x56514568e110 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.753+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56514568e110 0x56514576f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:37.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.753+0000 7f2ec7e00640 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56514568e110 0x56514576f570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26eccd5ced8a9f1c server_cookie=56cccdc8e482b6bc in_seq=0 out_seq=0 2024-02-21T07:54:37.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2eb5600640 10 client.6735 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:37.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2eb5600640 1 -- 172.21.15.100:0/1334045713 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x565145387890 con 0x56514568e110 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2eb5600640 10 client.6735 handle_command_reply: tid=0 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 client.6735 shutdown 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 msgr2=0x565145700740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x565145700740 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0028000 tx=0x7f2eb0007910 comp rx=0 tx=0).stop 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 shutdown_connections 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5651456db580 0x56514575c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5651456db100 0x565145700740 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.754+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x56514568e110 0x56514576f570 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.755+0000 7f2eb5600640 0 client.6735 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.755+0000 7f2ed1d9a740 1 --2- 172.21.15.100:0/1334045713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651456c32a0 0x56514575c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.755+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 >> 172.21.15.100:0/1334045713 conn(0x5651456d4b60 msgr2=0x565145690450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.755+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 shutdown_connections 2024-02-21T07:54:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.755+0000 7f2ed1d9a740 1 -- 172.21.15.100:0/1334045713 wait complete. 2024-02-21T07:54:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.756+0000 7f2ed1d9a740 20 client.6735 trim_cache size 0 max 16384 2024-02-21T07:54:37.761 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.756+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 msgr2=0x7f2ea40a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.756+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 0x7f2ea40a14f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0014b50 tx=0x7f2ec0010000 comp rx=0 tx=0).stop 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.756+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 msgr2=0x7f2ec8159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.756+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8037040 tx=0x7f2eb8004730 comp rx=0 tx=0).stop 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 shutdown_connections 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ec8217ef0 0x7f2ec8218370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2ea409f030 0x7f2ea40a14f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ec821b3f0 0x7f2ec821b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 --2- 172.21.15.100:0/4191452835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac006dc0 0x7f2ec8159640 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.757+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 >> 172.21.15.100:0/4191452835 conn(0x7f2ec80668b0 msgr2=0x7f2ec806b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.758+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 shutdown_connections 2024-02-21T07:54:37.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:37.758+0000 7f2ecf000640 1 -- 172.21.15.100:0/4191452835 wait complete. 2024-02-21T07:54:37.789 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:54:37.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.173+0000 7f8b0a200640 1 Processor -- start 2024-02-21T07:54:38.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.173+0000 7f8b0a200640 1 -- start start 2024-02-21T07:54:38.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.176+0000 7f8b0a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b04187030 0x7f8b04188110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.176+0000 7f8b0a200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040700c0 con 0x7f8b040673d0 2024-02-21T07:54:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.176+0000 7f8b0a200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040703a0 con 0x7f8b0406f990 2024-02-21T07:54:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.176+0000 7f8b0a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b04072020 con 0x7f8b04187030 2024-02-21T07:54:38.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.178+0000 7f8b03e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b04187030 0x7f8b04188110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.178+0000 7f8b03400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8b040673d0 0x7f8b0406f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:47174/0 (socket says 172.21.15.100:47174) 2024-02-21T07:54:38.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.178+0000 7f8b03400640 1 -- 172.21.15.100:0/1505723935 learned_addr learned my addr 172.21.15.100:0/1505723935 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:38.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.180+0000 7f8b02000640 1 -- 172.21.15.100:0/1505723935 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454880405 0 0) 0x7f8b040700c0 con 0x7f8b040673d0 2024-02-21T07:54:38.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.180+0000 7f8b02000640 1 -- 172.21.15.100:0/1505723935 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae8003520 con 0x7f8b040673d0 2024-02-21T07:54:38.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.181+0000 7f8b03e00640 1 -- 172.21.15.100:0/1505723935 >> v1:172.21.15.170:6789/0 conn(0x7f8b0406f990 legacy=0x7f8b04186920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.181+0000 7f8b03e00640 1 -- 172.21.15.100:0/1505723935 >> v1:172.21.15.156:6789/0 conn(0x7f8b040673d0 legacy=0x7f8b0406f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.181+0000 7f8b03e00640 1 -- 172.21.15.100:0/1505723935 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04070680 con 0x7f8b04187030 2024-02-21T07:54:38.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.187+0000 7f8b03e00640 1 --2- 172.21.15.100:0/1505723935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b04187030 0x7f8b04188110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b050 tx=0x7f8afc02c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe512d9c8dd25d63 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.188+0000 7f8b02000640 1 -- 172.21.15.100:0/1505723935 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec001650 con 0x7f8b04187030 2024-02-21T07:54:38.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.188+0000 7f8b02000640 1 -- 172.21.15.100:0/1505723935 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc02c940 con 0x7f8b04187030 2024-02-21T07:54:38.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.190+0000 7f8b02000640 1 -- 172.21.15.100:0/1505723935 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec001650 con 0x7f8b04187030 2024-02-21T07:54:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.192+0000 7f8b0a200640 1 -- 172.21.15.100:0/1505723935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b04187030 msgr2=0x7f8b04188110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.192+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1505723935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b04187030 0x7f8b04188110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b050 tx=0x7f8afc02c020 comp rx=0 tx=0).stop 2024-02-21T07:54:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.192+0000 7f8b0a200640 1 -- 172.21.15.100:0/1505723935 shutdown_connections 2024-02-21T07:54:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.192+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1505723935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b04187030 0x7f8b04188110 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.192+0000 7f8b0a200640 1 -- 172.21.15.100:0/1505723935 >> 172.21.15.100:0/1505723935 conn(0x7f8b040668b0 msgr2=0x7f8b04066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.193+0000 7f8b0a200640 1 -- 172.21.15.100:0/1505723935 shutdown_connections 2024-02-21T07:54:38.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.193+0000 7f8b0a200640 1 -- 172.21.15.100:0/1505723935 wait complete. 2024-02-21T07:54:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.197+0000 7f8b0a200640 1 Processor -- start 2024-02-21T07:54:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.198+0000 7f8b0a200640 1 -- start start 2024-02-21T07:54:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.200+0000 7f8b0a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.200+0000 7f8b0a200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b0406f990 0x7f8b041561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.201+0000 7f8b0a200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b04187030 0x7f8b041765c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.201+0000 7f8b0a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04171470 con 0x7f8b040673d0 2024-02-21T07:54:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.201+0000 7f8b0a200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04220350 con 0x7f8b04187030 2024-02-21T07:54:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.201+0000 7f8b0a200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b04170860 con 0x7f8b0406f990 2024-02-21T07:54:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.201+0000 7f8b03400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47024/0 (socket says 172.21.15.100:47024) 2024-02-21T07:54:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 -- 172.21.15.100:0/1187454578 learned_addr learned my addr 172.21.15.100:0/1187454578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b02a00640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b0406f990 0x7f8b041561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 -- 172.21.15.100:0/1187454578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b0406f990 msgr2=0x7f8b041561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b0406f990 0x7f8b041561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 -- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b04187030 msgr2=0x7f8b041765c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b04187030 0x7f8b041765c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.202+0000 7f8b03400640 1 -- 172.21.15.100:0/1187454578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc009a70 con 0x7f8b040673d0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.203+0000 7f8b03400640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00caf0 tx=0x7f8aec001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.203+0000 7f8afb400640 1 -- 172.21.15.100:0/1187454578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec005ce0 con 0x7f8b040673d0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.203+0000 7f8afb400640 1 -- 172.21.15.100:0/1187454578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec005e40 con 0x7f8b040673d0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.203+0000 7f8afb400640 1 -- 172.21.15.100:0/1187454578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec007270 con 0x7f8b040673d0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.204+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b04170b40 con 0x7f8b040673d0 2024-02-21T07:54:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.204+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04171100 con 0x7f8b040673d0 2024-02-21T07:54:38.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.209+0000 7f8afb400640 1 -- 172.21.15.100:0/1187454578 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8aec007490 con 0x7f8b040673d0 2024-02-21T07:54:38.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.212+0000 7f8afb400640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 0x7f8ae00a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.212+0000 7f8afb400640 1 -- 172.21.15.100:0/1187454578 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8aec0c94d0 con 0x7f8b040673d0 2024-02-21T07:54:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.213+0000 7f8b02a00640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 0x7f8ae00a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.219+0000 7f8b02a00640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 0x7f8ae00a16b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8b04153a90 tx=0x7f8af4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.221+0000 7f8b0cf98740 1 Processor -- start 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.222+0000 7f8b0cf98740 1 -- start start 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.228+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.228+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa40449100 0x55fa4046f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.228+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 0x55fa4046fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.228+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa40371210 con 0x55fa40449580 2024-02-21T07:54:38.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.228+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4036e740 con 0x55fa40442b60 2024-02-21T07:54:38.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.229+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa40369f20 con 0x55fa40449100 2024-02-21T07:54:38.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.235+0000 7f8b03400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.235+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa40449100 0x55fa4046f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.239+0000 7f8b03400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36936/0 (socket says 172.21.15.100:36936) 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.239+0000 7f8b03400640 1 -- 172.21.15.100:0/1215137862 learned_addr learned my addr 172.21.15.100:0/1215137862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.240+0000 7f8b03e00640 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 0x55fa4046fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.240+0000 7f8b03400640 1 -- 172.21.15.100:0/1215137862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa40449100 msgr2=0x55fa4046f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.240+0000 7f8b03400640 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa40449100 0x55fa4046f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.240+0000 7f8b03400640 1 -- 172.21.15.100:0/1215137862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 msgr2=0x55fa4046fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.240+0000 7f8b03400640 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 0x55fa4046fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.244+0000 7f8b03400640 1 -- 172.21.15.100:0/1215137862 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa4032bdf0 con 0x55fa40442b60 2024-02-21T07:54:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.244+0000 7f8b03e00640 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 0x55fa4046fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.245+0000 7f8b03400640 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0c6db0 tx=0x7f8aec0969d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5482c2ffd796bb49 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.246+0000 7f8af3400640 1 -- 172.21.15.100:0/1215137862 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec09b100 con 0x55fa40442b60 2024-02-21T07:54:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.246+0000 7f8af3400640 1 -- 172.21.15.100:0/1215137862 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec09f750 con 0x55fa40442b60 2024-02-21T07:54:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.247+0000 7f8af3400640 1 -- 172.21.15.100:0/1215137862 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec09f2c0 con 0x55fa40442b60 2024-02-21T07:54:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.247+0000 7f8b0cf98740 1 -- 172.21.15.100:0/1215137862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 msgr2=0x55fa40442f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.247+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0c6db0 tx=0x7f8aec0969d0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.258+0000 7f8b0cf98740 1 -- 172.21.15.100:0/1215137862 shutdown_connections 2024-02-21T07:54:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.258+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449580 0x55fa4046fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.258+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa40449100 0x55fa4046f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.258+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/1215137862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40442b60 0x55fa40442f40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.258+0000 7f8b0cf98740 1 -- 172.21.15.100:0/1215137862 >> 172.21.15.100:0/1215137862 conn(0x55fa40400490 msgr2=0x55fa40401510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.262+0000 7f8b0cf98740 1 -- 172.21.15.100:0/1215137862 shutdown_connections 2024-02-21T07:54:38.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.262+0000 7f8b0cf98740 1 -- 172.21.15.100:0/1215137862 wait complete. 2024-02-21T07:54:38.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.264+0000 7f8b0cf98740 1 -- start start 2024-02-21T07:54:38.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.265+0000 7f8b0cf98740 1 Processor -- start 2024-02-21T07:54:38.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449100 0x55fa40471590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4042a580 0x55fa40481780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4030f150 con 0x55fa40449100 2024-02-21T07:54:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4030edf0 con 0x55fa40449580 2024-02-21T07:54:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa400d81c0 con 0x55fa4042a580 2024-02-21T07:54:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b0cf98740 10 client.0 _ll_register_callbacks cb 0x55fa4035e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.291+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36946/0 (socket says 172.21.15.100:36946) 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 -- 172.21.15.100:0/2516508537 learned_addr learned my addr 172.21.15.100:0/2516508537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 -- 172.21.15.100:0/2516508537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4042a580 msgr2=0x55fa40481780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4042a580 0x55fa40481780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 -- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449100 msgr2=0x55fa40471590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449100 0x55fa40471590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 -- 172.21.15.100:0/2516508537 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04171100 con 0x55fa40449580 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.292+0000 7f8b02a00640 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003940 tx=0x7f8af4001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192ccf6135133229 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.293+0000 7f8ae7e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.308+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400ec30 con 0x55fa40449580 2024-02-21T07:54:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.308+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8af400ed90 con 0x55fa40449580 2024-02-21T07:54:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.309+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa400697e0 con 0x55fa40449580 2024-02-21T07:54:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.310+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af4013420 con 0x55fa40449580 2024-02-21T07:54:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.313+0000 7f8b0cf98740 10 client.6916 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.313+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fa403685a0 con 0x55fa40449580 2024-02-21T07:54:38.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.321+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa400697e0 con 0x55fa40449580 2024-02-21T07:54:38.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.321+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8af402a070 con 0x55fa40449580 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 10 client.6916 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 10 client.6916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 20 client.6916 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa4047e960 0x55fa40428eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 4 client.6916 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa400a6720 con 0x55fa4047e960 2024-02-21T07:54:38.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.322+0000 7f8b03400640 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa4047e960 0x55fa40428eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.324+0000 7f8b03400640 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa4047e960 0x55fa40428eb0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a425fc00e2f1cf35 server_cookie=fa24d643284e4cbc in_seq=0 out_seq=0 2024-02-21T07:54:38.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.324+0000 7f8ae7e00640 10 client.6916 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:38.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.326+0000 7f8ae7e00640 1 -- 172.21.15.100:0/2516508537 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fa400a6720 con 0x55fa4047e960 2024-02-21T07:54:38.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.326+0000 7f8ae7e00640 10 client.6916 handle_command_reply: tid=0 2024-02-21T07:54:38.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.326+0000 7f8b0cf98740 1 client.6916 shutdown 2024-02-21T07:54:38.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 msgr2=0x55fa403fc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003940 tx=0x7f8af4001080 comp rx=0 tx=0).stop 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 shutdown_connections 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa4047e960 0x55fa40428eb0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4042a580 0x55fa40481780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449580 0x55fa403fc460 secure :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003940 tx=0x7f8af4001080 comp rx=0 tx=0).stop 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/2516508537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa40449100 0x55fa40471590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 >> 172.21.15.100:0/2516508537 conn(0x55fa40442b60 msgr2=0x55fa404801e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8ae7e00640 0 client.6916 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.329+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 shutdown_connections 2024-02-21T07:54:38.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.330+0000 7f8b0cf98740 1 -- 172.21.15.100:0/2516508537 wait complete. 2024-02-21T07:54:38.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.331+0000 7f8b0cf98740 20 client.6916 trim_cache size 0 max 16384 2024-02-21T07:54:38.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.361+0000 7f8b0cf98740 1 Processor -- start 2024-02-21T07:54:38.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.361+0000 7f8b0cf98740 1 -- start start 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa4047cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa40401930 con 0x55fa4042a580 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa40481920 con 0x55fa40449100 2024-02-21T07:54:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.363+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa404707b0 con 0x55fa4046ef50 2024-02-21T07:54:38.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:41820/0 (socket says 172.21.15.100:41820) 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 -- 172.21.15.100:0/3981342907 learned_addr learned my addr 172.21.15.100:0/3981342907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03400640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa4047cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b02a00640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 -- 172.21.15.100:0/3981342907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 msgr2=0x55fa4043e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 -- 172.21.15.100:0/3981342907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 msgr2=0x55fa4047cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.364+0000 7f8b03e00640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa4047cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8b03e00640 1 -- 172.21.15.100:0/3981342907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa40304ab0 con 0x55fa4046ef50 2024-02-21T07:54:38.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8b03400640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa4047cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8b02a00640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8b03e00640 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b050 tx=0x7f8afc02e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8528197702a19587 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8af2a00640 1 -- 172.21.15.100:0/3981342907 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc02ddc0 con 0x55fa4046ef50 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8af2a00640 1 -- 172.21.15.100:0/3981342907 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc003990 con 0x55fa4046ef50 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.365+0000 7f8af2a00640 1 -- 172.21.15.100:0/3981342907 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc003d00 con 0x55fa4046ef50 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3981342907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 msgr2=0x55fa4046f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00b050 tx=0x7f8afc02e070 comp rx=0 tx=0).stop 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3981342907 shutdown_connections 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa4046f660 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3981342907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa4047cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.367+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3981342907 >> 172.21.15.100:0/3981342907 conn(0x55fa40442b60 msgr2=0x55fa40449dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.368+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3981342907 shutdown_connections 2024-02-21T07:54:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.369+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3981342907 wait complete. 2024-02-21T07:54:38.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.371+0000 7f8b0cf98740 1 -- start start 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.371+0000 7f8b0cf98740 1 Processor -- start 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.376+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa40448a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.376+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.376+0000 7f8b0cf98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa40469cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.377+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.377+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:36966/0 (socket says 172.21.15.100:36966) 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.378+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa403fbbe0 con 0x55fa4042a580 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.378+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4043c4b0 con 0x55fa40449100 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.378+0000 7f8b0cf98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4046a9a0 con 0x55fa4046ef50 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.378+0000 7f8b0cf98740 10 client.0 _ll_register_callbacks cb 0x7f8aec006fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 -- 172.21.15.100:0/3604691709 learned_addr learned my addr 172.21.15.100:0/3604691709 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b03e00640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa40469cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 -- 172.21.15.100:0/3604691709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 msgr2=0x55fa40469cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa40469cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 -- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 msgr2=0x55fa40448a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa40448a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.381+0000 7f8b02a00640 1 -- 172.21.15.100:0/3604691709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa4032bdf0 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8b02a00640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003ee0 tx=0x7f8af4020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d6a9f0bb036944d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8ae7e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4013420 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8af4013860 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aec09f750 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.382+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af4013a20 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 10 client.6922 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f8b04070680 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec09f750 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8af402a070 con 0x55fa40449100 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 10 client.6922 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 10 client.6922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 20 client.6922 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa404e18e0 0x55fa404de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 4 client.6922 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:54:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.383+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fa400f5890 con 0x55fa404e18e0 2024-02-21T07:54:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.384+0000 7f8b03400640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa404e18e0 0x55fa404de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.385+0000 7f8b03400640 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa404e18e0 0x55fa404de1d0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2054d1fd3ff9ce98 server_cookie=d4644306334b1dbb in_seq=0 out_seq=0 2024-02-21T07:54:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.385+0000 7f8ae7e00640 10 client.6922 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.385+0000 7f8ae7e00640 1 -- 172.21.15.100:0/3604691709 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fa400f5890 con 0x55fa404e18e0 2024-02-21T07:54:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.385+0000 7f8ae7e00640 10 client.6922 handle_command_reply: tid=0 2024-02-21T07:54:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.385+0000 7f8b0cf98740 1 client.6922 shutdown 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 msgr2=0x55fa4043bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8af4003ee0 tx=0x7f8af4020000 comp rx=0 tx=0).stop 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 shutdown_connections 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fa404e18e0 0x55fa404de1d0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fa4046ef50 0x55fa40469cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fa40449100 0x55fa4043bf70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 --2- 172.21.15.100:0/3604691709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fa4042a580 0x55fa40448a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.386+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 >> 172.21.15.100:0/3604691709 conn(0x55fa40442b60 msgr2=0x55fa4046f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.387+0000 7f8ae7e00640 0 client.6922 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.387+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 shutdown_connections 2024-02-21T07:54:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.387+0000 7f8b0cf98740 1 -- 172.21.15.100:0/3604691709 wait complete. 2024-02-21T07:54:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.387+0000 7f8b0cf98740 20 client.6922 trim_cache size 0 max 16384 2024-02-21T07:54:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 msgr2=0x7f8ae00a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 0x7f8ae00a16b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8b04153a90 tx=0x7f8af4009040 comp rx=0 tx=0).stop 2024-02-21T07:54:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 msgr2=0x7f8b0417e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:38.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00caf0 tx=0x7f8aec001d30 comp rx=0 tx=0).stop 2024-02-21T07:54:38.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 shutdown_connections 2024-02-21T07:54:38.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b04187030 0x7f8b041765c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b0406f990 0x7f8b041561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8ae009f1f0 0x7f8ae00a16b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 --2- 172.21.15.100:0/1187454578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b040673d0 0x7f8b0417e990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.390+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 >> 172.21.15.100:0/1187454578 conn(0x7f8b040668b0 msgr2=0x7f8b04156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.394+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 shutdown_connections 2024-02-21T07:54:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:38.394+0000 7f8b0a200640 1 -- 172.21.15.100:0/1187454578 wait complete. 2024-02-21T07:54:39.437 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:54:39.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:54:39.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:54:39.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.823+0000 7fe4ba600640 1 Processor -- start 2024-02-21T07:54:39.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.823+0000 7fe4ba600640 1 -- start start 2024-02-21T07:54:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4ba600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe4b4186cd0 0x7fe4b40d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4ba600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe4b40d6800 0x7fe4b418e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4ba600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b406bb60 con 0x7fe4b418e700 2024-02-21T07:54:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4ba600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b41912d0 con 0x7fe4b40d6800 2024-02-21T07:54:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4ba600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b406cee0 con 0x7fe4b4186cd0 2024-02-21T07:54:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4b9c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe4b418e700 0x7fe4b40fbec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:47184/0 (socket says 172.21.15.100:47184) 2024-02-21T07:54:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.828+0000 7fe4b9c00640 1 -- 172.21.15.100:0/2912678427 learned_addr learned my addr 172.21.15.100:0/2912678427 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.829+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2912678427 >> v2:172.21.15.100:3300/0 conn(0x7fe4b40d6800 0x7fe4b418e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.829+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2912678427 >> v2:172.21.15.170:3300/0 conn(0x7fe4b4186cd0 msgr2=0x7fe4b40d62c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.829+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2912678427 >> v2:172.21.15.170:3300/0 conn(0x7fe4b4186cd0 0x7fe4b40d62c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.829+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2912678427 >> v1:172.21.15.156:6789/0 conn(0x7fe4b418e700 legacy=0x7fe4b40fbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.829+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2912678427 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b418dce0 con 0x7fe4b40d6800 2024-02-21T07:54:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.831+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2912678427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40d6800 0x7fe4b418e1c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe4b406d020 tx=0x7fe4a402b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cc09872bdb8f7a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.833+0000 7fe4b3400640 1 -- 172.21.15.100:0/2912678427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4030710 con 0x7fe4b40d6800 2024-02-21T07:54:39.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.833+0000 7fe4b3400640 1 -- 172.21.15.100:0/2912678427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a402e050 con 0x7fe4b40d6800 2024-02-21T07:54:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.834+0000 7fe4b3400640 1 -- 172.21.15.100:0/2912678427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4030a90 con 0x7fe4b40d6800 2024-02-21T07:54:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.835+0000 7fe4ba600640 1 -- 172.21.15.100:0/2912678427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40d6800 msgr2=0x7fe4b418e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.835+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2912678427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40d6800 0x7fe4b418e1c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe4b406d020 tx=0x7fe4a402b690 comp rx=0 tx=0).stop 2024-02-21T07:54:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.837+0000 7fe4ba600640 1 -- 172.21.15.100:0/2912678427 shutdown_connections 2024-02-21T07:54:39.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.837+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2912678427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40d6800 0x7fe4b418e1c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.837+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2912678427 >> v2:172.21.15.170:3300/0 conn(0x7fe4b4186cd0 0x7fe4b40d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.837+0000 7fe4ba600640 1 -- 172.21.15.100:0/2912678427 >> 172.21.15.100:0/2912678427 conn(0x7fe4b40d2690 msgr2=0x7fe4b40d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.838+0000 7fe4ba600640 1 -- 172.21.15.100:0/2912678427 shutdown_connections 2024-02-21T07:54:39.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.838+0000 7fe4ba600640 1 -- 172.21.15.100:0/2912678427 wait complete. 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.841+0000 7fe4ba600640 1 Processor -- start 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.841+0000 7fe4ba600640 1 -- start start 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b4186cd0 0x7fe4b4179720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 0x7fe4b417a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40f9230 con 0x7fe4b40f8840 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b417aaf0 con 0x7fe4b418e700 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.843+0000 7fe4ba600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b417add0 con 0x7fe4b4186cd0 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34654/0 (socket says 172.21.15.100:34654) 2024-02-21T07:54:39.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b9c00640 1 -- 172.21.15.100:0/2612615081 learned_addr learned my addr 172.21.15.100:0/2612615081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 0x7fe4b417a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2612615081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b4186cd0 msgr2=0x7fe4b4179720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b4186cd0 0x7fe4b4179720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2612615081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 msgr2=0x7fe4b40f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2612615081 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4009400 con 0x7fe4b418e700 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.844+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.845+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 0x7fe4b417a250 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4032000 tx=0x7fe4a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.845+0000 7fe4b0c00640 1 -- 172.21.15.100:0/2612615081 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4004220 con 0x7fe4b418e700 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.845+0000 7fe4b0c00640 1 -- 172.21.15.100:0/2612615081 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a402be90 con 0x7fe4b418e700 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.845+0000 7fe4b0c00640 1 -- 172.21.15.100:0/2612615081 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4032690 con 0x7fe4b418e700 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.845+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b417b0b0 con 0x7fe4b418e700 2024-02-21T07:54:39.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.846+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b417b670 con 0x7fe4b418e700 2024-02-21T07:54:39.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.850+0000 7fe4b0c00640 1 -- 172.21.15.100:0/2612615081 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe4a4039040 con 0x7fe4b418e700 2024-02-21T07:54:39.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.853+0000 7fe4b0c00640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 0x7fe4940a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.853+0000 7fe4b0c00640 1 -- 172.21.15.100:0/2612615081 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe4a40eb2c0 con 0x7fe4b418e700 2024-02-21T07:54:39.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.853+0000 7fe4b9200640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 0x7fe4940a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.857+0000 7fe4b9200640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 0x7fe4940a1660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00abb0 tx=0x7fe4ac009250 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.859+0000 7fe4be9e2740 1 Processor -- start 2024-02-21T07:54:39.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.860+0000 7fe4be9e2740 1 -- start start 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 0x5568aec92770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 0x5568aeccd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aeccda60 0x5568aecce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aec12300 con 0x5568aeccda60 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aebc4e50 con 0x5568aec92390 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aebc2380 con 0x5568aec92cb0 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 0x5568aeccd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.861+0000 7fe4b9200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 0x5568aec92770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b9200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 0x5568aec92770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42054/0 (socket says 172.21.15.100:42054) 2024-02-21T07:54:39.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b9200640 1 -- 172.21.15.100:0/2375477911 learned_addr learned my addr 172.21.15.100:0/2375477911 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aeccda60 0x5568aecce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2375477911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 msgr2=0x5568aec92770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 0x5568aec92770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2375477911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aeccda60 msgr2=0x5568aecce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aeccda60 0x5568aecce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 -- 172.21.15.100:0/2375477911 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568aeb86c80 con 0x5568aec92cb0 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.862+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 0x5568aeccd520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40e8c90 tx=0x7fe4a40b7000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cbdd6659397a1a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.863+0000 7fe4a9600640 1 -- 172.21.15.100:0/2375477911 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40bb070 con 0x5568aec92cb0 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.863+0000 7fe4a9600640 1 -- 172.21.15.100:0/2375477911 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a40b8e00 con 0x5568aec92cb0 2024-02-21T07:54:39.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.863+0000 7fe4a9600640 1 -- 172.21.15.100:0/2375477911 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40bcf50 con 0x5568aec92cb0 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.863+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2375477911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 msgr2=0x5568aeccd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.863+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 0x5568aeccd520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40e8c90 tx=0x7fe4a40b7000 comp rx=0 tx=0).stop 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2375477911 shutdown_connections 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aeccda60 0x5568aecce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec92cb0 0x5568aeccd520 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2375477911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92390 0x5568aec92770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2375477911 >> 172.21.15.100:0/2375477911 conn(0x5568aec54960 msgr2=0x5568aec559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2375477911 shutdown_connections 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.864+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2375477911 wait complete. 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.865+0000 7fe4be9e2740 1 -- start start 2024-02-21T07:54:39.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.865+0000 7fe4be9e2740 1 Processor -- start 2024-02-21T07:54:39.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aecd7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec7cc10 0x5568aec7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aebbdb60 con 0x5568aec92cb0 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aeb62fd0 con 0x5568aec7cc10 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aeb62c70 con 0x5568aeccda60 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4be9e2740 10 client.0 _ll_register_callbacks cb 0x5568ae8cec60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4b9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aecd7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4b3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:45040/0 (socket says 172.21.15.100:45040) 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4b3e00640 1 -- 172.21.15.100:0/4287839630 learned_addr learned my addr 172.21.15.100:0/4287839630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.867+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec7cc10 0x5568aec7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 -- 172.21.15.100:0/4287839630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec7cc10 msgr2=0x5568aec7d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec7cc10 0x5568aec7d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 -- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 msgr2=0x5568aecd7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aecd7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 -- 172.21.15.100:0/4287839630 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b417b670 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40b8b00 tx=0x7fe4a4009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b236ae777f2c180 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe49e000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40bb070 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe4a40bcf50 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568ae8bd860 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a40c1110 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4be9e2740 10 client.6863 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.868+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5568aebbc1e0 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5568ae8bd860 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe4a40b8250 con 0x5568aeccda60 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 10 client.6863 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:39.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 10 client.6863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:39.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 20 client.6863 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:39.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aec872a0 0x5568aec87680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 4 client.6863 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:39.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568ae90e410 con 0x5568aec872a0 2024-02-21T07:54:39.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.869+0000 7fe4b9200640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aec872a0 0x5568aec87680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.870+0000 7fe4b9200640 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aec872a0 0x5568aec87680 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bcebafed372e8e3 server_cookie=3bd072fcf51a7b7 in_seq=0 out_seq=0 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.870+0000 7fe49e000640 10 client.6863 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.871+0000 7fe49e000640 1 -- 172.21.15.100:0/4287839630 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5568ae90e410 con 0x5568aec872a0 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.871+0000 7fe49e000640 10 client.6863 handle_command_reply: tid=0 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.871+0000 7fe4be9e2740 1 client.6863 shutdown 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 msgr2=0x5568aec84d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40b8b00 tx=0x7fe4a4009190 comp rx=0 tx=0).stop 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 shutdown_connections 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aec872a0 0x5568aec87680 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec7cc10 0x5568aec7d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec84d90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/4287839630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aecd7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 >> 172.21.15.100:0/4287839630 conn(0x5568aec92390 msgr2=0x5568aeccdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.872+0000 7fe49e000640 0 client.6863 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.873+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 shutdown_connections 2024-02-21T07:54:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.873+0000 7fe4be9e2740 1 -- 172.21.15.100:0/4287839630 wait complete. 2024-02-21T07:54:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.874+0000 7fe4be9e2740 20 client.6863 trim_cache size 0 max 16384 2024-02-21T07:54:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.903+0000 7fe4be9e2740 1 Processor -- start 2024-02-21T07:54:39.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.908+0000 7fe4be9e2740 1 -- start start 2024-02-21T07:54:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92cb0 0x5568aeccd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec86770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ae9060c0 con 0x5568aec7cc10 2024-02-21T07:54:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aeccb0e0 con 0x5568aec92cb0 2024-02-21T07:54:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.909+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aebbfad0 con 0x5568aeccda60 2024-02-21T07:54:39.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34684/0 (socket says 172.21.15.100:34684) 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 -- 172.21.15.100:0/2414546386 learned_addr learned my addr 172.21.15.100:0/2414546386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 -- 172.21.15.100:0/2414546386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 msgr2=0x5568aec86770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec86770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 -- 172.21.15.100:0/2414546386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92cb0 msgr2=0x5568aeccd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92cb0 0x5568aeccd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.910+0000 7fe4b9200640 1 -- 172.21.15.100:0/2414546386 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568aeb58a90 con 0x5568aec7cc10 2024-02-21T07:54:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.911+0000 7fe4b9200640 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009720 tx=0x7fe4ac00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed360b7139a4a01 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.911+0000 7fe4a8c00640 1 -- 172.21.15.100:0/2414546386 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac01f040 con 0x5568aec7cc10 2024-02-21T07:54:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.911+0000 7fe4a8c00640 1 -- 172.21.15.100:0/2414546386 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac0245b0 con 0x5568aec7cc10 2024-02-21T07:54:39.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.911+0000 7fe4a8c00640 1 -- 172.21.15.100:0/2414546386 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac024920 con 0x5568aec7cc10 2024-02-21T07:54:39.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.914+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2414546386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 msgr2=0x5568aec8ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.914+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac009720 tx=0x7fe4ac00f000 comp rx=0 tx=0).stop 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.915+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2414546386 shutdown_connections 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.915+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aeccda60 0x5568aec86770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.915+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aec92cb0 0x5568aeccd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.915+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/2414546386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec7cc10 0x5568aec8ebb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.915+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2414546386 >> 172.21.15.100:0/2414546386 conn(0x5568aec92390 msgr2=0x5568aec6fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.916+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2414546386 shutdown_connections 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.916+0000 7fe4be9e2740 1 -- 172.21.15.100:0/2414546386 wait complete. 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.917+0000 7fe4be9e2740 1 -- start start 2024-02-21T07:54:39.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.917+0000 7fe4be9e2740 1 Processor -- start 2024-02-21T07:54:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.920+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec7cc10 0x5568aec95f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.920+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aec8eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4be9e2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aec8f060 con 0x5568aec92cb0 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aecc63e0 con 0x5568aeccda60 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4be9e2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568aec7d090 con 0x5568aec7cc10 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4be9e2740 10 client.0 _ll_register_callbacks cb 0x7fe4a4004580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:39.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42094/0 (socket says 172.21.15.100:42094) 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 -- 172.21.15.100:0/3466689809 learned_addr learned my addr 172.21.15.100:0/3466689809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9200640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec7cc10 0x5568aec95f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 -- 172.21.15.100:0/3466689809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec7cc10 msgr2=0x5568aec95f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec7cc10 0x5568aec95f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.921+0000 7fe4b9c00640 1 -- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 msgr2=0x5568aec8eb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aec8eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aec8eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe4b9c00640 1 -- 172.21.15.100:0/3466689809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac012070 con 0x5568aeccda60 2024-02-21T07:54:39.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe4b3e00640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aec8eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:39.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe4b9c00640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0004890 tx=0x7fe4a0004d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a79bd3d8b075bf32 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:39.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.922+0000 7fe49e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:39.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.923+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0015b20 con 0x5568aeccda60 2024-02-21T07:54:39.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.923+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe4a0015c80 con 0x5568aeccda60 2024-02-21T07:54:39.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.923+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4a40b8e00 con 0x5568aeccda60 2024-02-21T07:54:39.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.925+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4a0015e40 con 0x5568aeccda60 2024-02-21T07:54:39.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.925+0000 7fe4be9e2740 10 client.6937 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:39.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.925+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5568aeb7e6a0 con 0x5568aeccda60 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a40b8e00 con 0x5568aeccda60 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe4a0012050 con 0x5568aeccda60 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 10 client.6937 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 10 client.6937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 20 client.6937 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:39.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aed2b280 0x5568aed350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 4 client.6937 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:54:39.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.927+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5568ae8fa7b0 con 0x5568aed2b280 2024-02-21T07:54:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.939+0000 7fe4b9200640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aed2b280 0x5568aed350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.943+0000 7fe4b9200640 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aed2b280 0x5568aed350b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23da13bc7523d210 server_cookie=92327a5c1736d419 in_seq=0 out_seq=0 2024-02-21T07:54:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.943+0000 7fe49e000640 10 client.6937 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.945+0000 7fe49e000640 1 -- 172.21.15.100:0/3466689809 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5568ae8fa7b0 con 0x5568aed2b280 2024-02-21T07:54:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.945+0000 7fe49e000640 10 client.6937 handle_command_reply: tid=0 2024-02-21T07:54:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.946+0000 7fe4be9e2740 1 client.6937 shutdown 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.946+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 msgr2=0x5568aed2a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.946+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0004890 tx=0x7fe4a0004d50 comp rx=0 tx=0).stop 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 shutdown_connections 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5568aed2b280 0x5568aed350b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568aeccda60 0x5568aed2a7d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5568aec92cb0 0x5568aec8eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 --2- 172.21.15.100:0/3466689809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568aec7cc10 0x5568aec95f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 >> 172.21.15.100:0/3466689809 conn(0x5568aec92390 msgr2=0x5568aec76650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe49e000640 0 client.6937 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 shutdown_connections 2024-02-21T07:54:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.947+0000 7fe4be9e2740 1 -- 172.21.15.100:0/3466689809 wait complete. 2024-02-21T07:54:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.948+0000 7fe4be9e2740 20 client.6937 trim_cache size 0 max 16384 2024-02-21T07:54:39.950 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "f0bbeaa7-dbc2-4bac-a163-24042a58d012", 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.949+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 msgr2=0x7fe4940a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.949+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 0x7fe4940a1660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00abb0 tx=0x7fe4ac009250 comp rx=0 tx=0).stop 2024-02-21T07:54:39.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.949+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 msgr2=0x7fe4b417a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:39.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.949+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 0x7fe4b417a250 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4032000 tx=0x7fe4a40046c0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 shutdown_connections 2024-02-21T07:54:39.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe49409f1a0 0x7fe4940a1660 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4b40f8840 0x7fe4b40f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4b418e700 0x7fe4b417a250 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 --2- 172.21.15.100:0/2612615081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe4b4186cd0 0x7fe4b4179720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.951+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 >> 172.21.15.100:0/2612615081 conn(0x7fe4b40d2690 msgr2=0x7fe4b4180f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.952+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 shutdown_connections 2024-02-21T07:54:39.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:39.952+0000 7fe4ba600640 1 -- 172.21.15.100:0/2612615081 wait complete. 2024-02-21T07:54:40.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:54:40.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:54:40.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.415+0000 7fea00e00640 1 Processor -- start 2024-02-21T07:54:40.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.416+0000 7fea00e00640 1 -- start start 2024-02-21T07:54:40.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.419+0000 7fea00e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 0x7fe9fc185cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.420+0000 7fea00e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.420+0000 7fe9f9400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 0x7fe9fc185cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.420+0000 7fe9f9400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 0x7fe9fc185cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42110/0 (socket says 172.21.15.100:42110) 2024-02-21T07:54:40.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.421+0000 7fe9fb200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe9fc06da30 0x7fe9fc186230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:51336/0 (socket says 172.21.15.100:51336) 2024-02-21T07:54:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.422+0000 7fe9f9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.422+0000 7fe9f9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34690/0 (socket says 172.21.15.100:34690) 2024-02-21T07:54:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.422+0000 7fe9f9400640 1 -- 172.21.15.100:0/2923733607 learned_addr learned my addr 172.21.15.100:0/2923733607 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.422+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc1822c0 con 0x7fe9fc06da30 2024-02-21T07:54:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.423+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc06ef50 con 0x7fe9fc0f4610 2024-02-21T07:54:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.423+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937109500 0 0) 0x7fe9fc1822c0 con 0x7fe9fc06da30 2024-02-21T07:54:40.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.423+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc186940 con 0x7fe9fc181ee0 2024-02-21T07:54:40.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.424+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e0003520 con 0x7fe9fc06da30 2024-02-21T07:54:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.424+0000 7fe9f9e00640 1 -- 172.21.15.100:0/2923733607 >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 msgr2=0x7fe9fc185cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.425+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275751888 0 0) 0x7fe9e0003520 con 0x7fe9fc06da30 2024-02-21T07:54:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.425+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/2923733607 >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 0x7fe9fc185cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.425+0000 7fe9f9e00640 1 -- 172.21.15.100:0/2923733607 >> v1:172.21.15.170:6789/0 conn(0x7fe9fc06da30 legacy=0x7fe9fc186230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.425+0000 7fe9f9e00640 1 -- 172.21.15.100:0/2923733607 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc06dff0 con 0x7fe9fc0f4610 2024-02-21T07:54:40.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.428+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/2923733607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc08d5f0 tx=0x7fe9f402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff9cc02b19d01eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.428+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8001670 con 0x7fe9fc0f4610 2024-02-21T07:54:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.429+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400b040 con 0x7fe9fc0f4610 2024-02-21T07:54:40.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.429+0000 7fe9f8a00640 1 -- 172.21.15.100:0/2923733607 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f402cb00 con 0x7fe9fc0f4610 2024-02-21T07:54:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.430+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc0f4610 msgr2=0x7fe9fc0f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.430+0000 7fea00e00640 1 --2- 172.21.15.100:0/2923733607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc08d5f0 tx=0x7fe9f402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.431+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 shutdown_connections 2024-02-21T07:54:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.431+0000 7fea00e00640 1 --2- 172.21.15.100:0/2923733607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc0f4aa0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.431+0000 7fea00e00640 1 --2- 172.21.15.100:0/2923733607 >> v2:172.21.15.156:3300/0 conn(0x7fe9fc181ee0 0x7fe9fc185cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.431+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 >> 172.21.15.100:0/2923733607 conn(0x7fe9fc0ce160 msgr2=0x7fe9fc0ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.432+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 shutdown_connections 2024-02-21T07:54:40.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.432+0000 7fea00e00640 1 -- 172.21.15.100:0/2923733607 wait complete. 2024-02-21T07:54:40.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.436+0000 7fea00e00640 1 Processor -- start 2024-02-21T07:54:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.437+0000 7fea00e00640 1 -- start start 2024-02-21T07:54:40.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 0x7fe9fc16c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc218500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc181ee0 0x7fe9fc218a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc06f9d0 con 0x7fe9fc181ee0 2024-02-21T07:54:40.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc17d270 con 0x7fe9fc0f4610 2024-02-21T07:54:40.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.440+0000 7fea00e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc21c770 con 0x7fe9fc06da30 2024-02-21T07:54:40.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.441+0000 7fe9fb200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc218500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.442+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 0x7fe9fc16c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.442+0000 7fe9f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc181ee0 0x7fe9fc218a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.442+0000 7fe9fb200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc218500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42116/0 (socket says 172.21.15.100:42116) 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.442+0000 7fe9fb200640 1 -- 172.21.15.100:0/2281524837 learned_addr learned my addr 172.21.15.100:0/2281524837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.445+0000 7fe9f9400640 1 -- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 msgr2=0x7fe9fc218500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.445+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc218500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.446+0000 7fe9f9400640 1 -- 172.21.15.100:0/2281524837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc181ee0 msgr2=0x7fe9fc218a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.446+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc181ee0 0x7fe9fc218a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.446+0000 7fe9f9400640 1 -- 172.21.15.100:0/2281524837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f400a7a0 con 0x7fe9fc06da30 2024-02-21T07:54:40.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.447+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 0x7fe9fc16c6a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00e600 tx=0x7fe9ec00eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.447+0000 7fe9f2000640 1 -- 172.21.15.100:0/2281524837 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00c620 con 0x7fe9fc06da30 2024-02-21T07:54:40.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.447+0000 7fe9f2000640 1 -- 172.21.15.100:0/2281524837 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00c780 con 0x7fe9fc06da30 2024-02-21T07:54:40.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.447+0000 7fe9f2000640 1 -- 172.21.15.100:0/2281524837 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00cb10 con 0x7fe9fc06da30 2024-02-21T07:54:40.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.450+0000 7fea00e00640 1 -- 172.21.15.100:0/2281524837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc21ca50 con 0x7fe9fc06da30 2024-02-21T07:54:40.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.450+0000 7fea00e00640 1 -- 172.21.15.100:0/2281524837 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc21d010 con 0x7fe9fc06da30 2024-02-21T07:54:40.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.459+0000 7fe9f2000640 1 -- 172.21.15.100:0/2281524837 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe9ec00cc70 con 0x7fe9fc06da30 2024-02-21T07:54:40.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.467+0000 7fe9f2000640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 0x7fe9dc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.468+0000 7fe9f2000640 1 -- 172.21.15.100:0/2281524837 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9ec0c96e0 con 0x7fe9fc06da30 2024-02-21T07:54:40.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.475+0000 7fea03b77740 1 Processor -- start 2024-02-21T07:54:40.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.476+0000 7fe9fb200640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 0x7fe9dc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.481+0000 7fe9fb200640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 0x7fe9dc0a16b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0cb4e0 tx=0x7fe9e8001910 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.481+0000 7fea03b77740 1 -- start start 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b87e0 0x5640771b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564077140c30 0x56407713b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640770a7150 con 0x5640771b9100 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640770a4680 con 0x5640771b87e0 2024-02-21T07:54:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.483+0000 7fea03b77740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407709fe60 con 0x564077140c30 2024-02-21T07:54:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.484+0000 7fe9fb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.484+0000 7fe9fb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34694/0 (socket says 172.21.15.100:34694) 2024-02-21T07:54:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.484+0000 7fe9fb200640 1 -- 172.21.15.100:0/3515207799 learned_addr learned my addr 172.21.15.100:0/3515207799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.487+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564077140c30 0x56407713b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.492+0000 7fe9fb200640 1 -- 172.21.15.100:0/3515207799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564077140c30 msgr2=0x56407713b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.492+0000 7fe9fb200640 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564077140c30 0x56407713b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.492+0000 7fe9fb200640 1 -- 172.21.15.100:0/3515207799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b87e0 msgr2=0x5640771b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.492+0000 7fe9fb200640 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b87e0 0x5640771b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.492+0000 7fe9fb200640 1 -- 172.21.15.100:0/3515207799 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564077059060 con 0x5640771b9100 2024-02-21T07:54:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.495+0000 7fe9fb200640 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800fcc0 tx=0x7fe9e8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62842a289bc89681 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.496+0000 7fea00e00640 1 -- 172.21.15.100:0/3515207799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8006260 con 0x5640771b9100 2024-02-21T07:54:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.496+0000 7fea00e00640 1 -- 172.21.15.100:0/3515207799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e80063c0 con 0x5640771b9100 2024-02-21T07:54:40.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.496+0000 7fea00e00640 1 -- 172.21.15.100:0/3515207799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8006260 con 0x5640771b9100 2024-02-21T07:54:40.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.498+0000 7fea03b77740 1 -- 172.21.15.100:0/3515207799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 msgr2=0x5640771406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.498+0000 7fea03b77740 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800fcc0 tx=0x7fe9e8012000 comp rx=0 tx=0).stop 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.499+0000 7fea03b77740 1 -- 172.21.15.100:0/3515207799 shutdown_connections 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.499+0000 7fea03b77740 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564077140c30 0x56407713b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.499+0000 7fea03b77740 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x5640771406f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.499+0000 7fea03b77740 1 --2- 172.21.15.100:0/3515207799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b87e0 0x5640771b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.499+0000 7fea03b77740 1 -- 172.21.15.100:0/3515207799 >> 172.21.15.100:0/3515207799 conn(0x5640770ff5a0 msgr2=0x56407713fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.500+0000 7fea03b77740 1 -- 172.21.15.100:0/3515207799 shutdown_connections 2024-02-21T07:54:40.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.501+0000 7fea03b77740 1 -- 172.21.15.100:0/3515207799 wait complete. 2024-02-21T07:54:40.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.506+0000 7fea03b77740 1 -- start start 2024-02-21T07:54:40.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.510+0000 7fea03b77740 1 Processor -- start 2024-02-21T07:54:40.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.525+0000 7fea03b77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 0x56407713b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.527+0000 7fea03b77740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.528+0000 7fea03b77740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 0x56407713c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.529+0000 7fe9f9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 0x56407713c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.529+0000 7fe9f9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 0x56407713c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42132/0 (socket says 172.21.15.100:42132) 2024-02-21T07:54:40.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.529+0000 7fe9f9e00640 1 -- 172.21.15.100:0/2650488867 learned_addr learned my addr 172.21.15.100:0/2650488867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.529+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564077044ec0 con 0x564077140c30 2024-02-21T07:54:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.530+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564077044b60 con 0x5640771b9100 2024-02-21T07:54:40.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.530+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564076e0e1c0 con 0x5640771b87e0 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.530+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 0x56407713b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.529+0000 7fe9fb200640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fea03b77740 10 client.0 _ll_register_callbacks cb 0x564077058960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fe9f9400640 1 -- 172.21.15.100:0/2650488867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 msgr2=0x5640771a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fe9f9400640 1 -- 172.21.15.100:0/2650488867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 msgr2=0x56407713c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 0x56407713c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.531+0000 7fe9f9400640 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e800f940 con 0x564077140c30 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.532+0000 7fe9f9400640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 0x56407713b730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x5640771b0da0 tx=0x7fe9ec096cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab518d3dc0dc0932 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.532+0000 7fe9db400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.534+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec0c92d0 con 0x564077140c30 2024-02-21T07:54:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.534+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9ec0966c0 con 0x564077140c30 2024-02-21T07:54:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.536+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564076d9f7e0 con 0x564077140c30 2024-02-21T07:54:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.539+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9ec096880 con 0x564077140c30 2024-02-21T07:54:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.539+0000 7fea03b77740 10 client.6771 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.539+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56407709e4e0 con 0x564077140c30 2024-02-21T07:54:40.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.540+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564076d9f7e0 con 0x564077140c30 2024-02-21T07:54:40.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.540+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9ec0ad020 con 0x564077140c30 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.540+0000 7fea03b77740 10 client.6771 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.540+0000 7fea03b77740 10 client.6771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.540+0000 7fea03b77740 20 client.6771 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.541+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771b1730 0x5640771a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.541+0000 7fea03b77740 4 client.6771 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:40.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.541+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564076ddc720 con 0x5640771b1730 2024-02-21T07:54:40.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.546+0000 7fe9fb200640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771b1730 0x5640771a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.558+0000 7fe9fb200640 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771b1730 0x5640771a5300 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd8a2009b855d4a0 server_cookie=cfbe0a4bcc37438d in_seq=0 out_seq=0 2024-02-21T07:54:40.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.558+0000 7fe9db400640 10 client.6771 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.564+0000 7fe9db400640 1 -- 172.21.15.100:0/2650488867 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564076ddc720 con 0x5640771b1730 2024-02-21T07:54:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.564+0000 7fe9db400640 10 client.6771 handle_command_reply: tid=0 2024-02-21T07:54:40.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.564+0000 7fea03b77740 1 client.6771 shutdown 2024-02-21T07:54:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.566+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 msgr2=0x56407713b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.566+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 0x56407713b730 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x5640771b0da0 tx=0x7fe9ec096cc0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.567+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 shutdown_connections 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.567+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771b1730 0x5640771a5300 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.567+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5640771b9100 0x56407713c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.568+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.568+0000 7fea03b77740 1 --2- 172.21.15.100:0/2650488867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564077140c30 0x56407713b730 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.568+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 >> 172.21.15.100:0/2650488867 conn(0x5640770ff5a0 msgr2=0x5640771317e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.568+0000 7fe9db400640 0 client.6771 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:40.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.568+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 shutdown_connections 2024-02-21T07:54:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.569+0000 7fea03b77740 1 -- 172.21.15.100:0/2650488867 wait complete. 2024-02-21T07:54:40.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.570+0000 7fea03b77740 20 client.6771 trim_cache size 0 max 16384 2024-02-21T07:54:40.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.628+0000 7fea03b77740 1 Processor -- start 2024-02-21T07:54:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.628+0000 7fea03b77740 1 -- start start 2024-02-21T07:54:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.631+0000 7fea03b77740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.632+0000 7fea03b77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 0x5640771317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.632+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.632+0000 7fe9f9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42140/0 (socket says 172.21.15.100:42140) 2024-02-21T07:54:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.633+0000 7fe9f9400640 1 -- 172.21.15.100:0/1576102138 learned_addr learned my addr 172.21.15.100:0/1576102138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.633+0000 7fea03b77740 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 0x56407720f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.633+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407713f140 con 0x5640771b87e0 2024-02-21T07:54:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.634+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640771ad7c0 con 0x564077140c30 2024-02-21T07:54:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.634+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 0x56407720f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.634+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407717ae40 con 0x5640771b9100 2024-02-21T07:54:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.634+0000 7fe9fb200640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 0x5640771317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.635+0000 7fe9fb200640 1 -- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 msgr2=0x56407720f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.636+0000 7fe9fb200640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 0x56407720f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.636+0000 7fe9fb200640 1 -- 172.21.15.100:0/1576102138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 msgr2=0x56407713c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.636+0000 7fe9fb200640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.636+0000 7fe9fb200640 1 -- 172.21.15.100:0/1576102138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640771b3c70 con 0x5640771b87e0 2024-02-21T07:54:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.637+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 0x56407720f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:40.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.637+0000 7fe9fb200640 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 0x5640771317e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8023000 tx=0x7fe9e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fc8dd26b9579ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.638+0000 7fe9e6000640 1 -- 172.21.15.100:0/1576102138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8037440 con 0x5640771b87e0 2024-02-21T07:54:40.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.638+0000 7fe9e6000640 1 -- 172.21.15.100:0/1576102138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8032040 con 0x5640771b87e0 2024-02-21T07:54:40.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.638+0000 7fe9e6000640 1 -- 172.21.15.100:0/1576102138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e80377c0 con 0x5640771b87e0 2024-02-21T07:54:40.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.639+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 msgr2=0x5640771317e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.639+0000 7fea03b77740 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 0x5640771317e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8023000 tx=0x7fe9e8013000 comp rx=0 tx=0).stop 2024-02-21T07:54:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.640+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 shutdown_connections 2024-02-21T07:54:40.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.640+0000 7fea03b77740 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b9100 0x56407720f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.640+0000 7fea03b77740 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b87e0 0x5640771317e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.640+0000 7fea03b77740 1 --2- 172.21.15.100:0/1576102138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.640+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 >> 172.21.15.100:0/1576102138 conn(0x5640770ff5a0 msgr2=0x5640771a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.641+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 shutdown_connections 2024-02-21T07:54:40.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.642+0000 7fea03b77740 1 -- 172.21.15.100:0/1576102138 wait complete. 2024-02-21T07:54:40.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.643+0000 7fea03b77740 1 -- start start 2024-02-21T07:54:40.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.644+0000 7fea03b77740 1 Processor -- start 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640772087e0 con 0x5640771b9100 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564077174e00 con 0x564077140c30 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407721e6b0 con 0x5640771b87e0 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fea03b77740 10 client.0 _ll_register_callbacks cb 0x5640771327f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fe9f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fe9f9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34730/0 (socket says 172.21.15.100:34730) 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fe9f9e00640 1 -- 172.21.15.100:0/1087772344 learned_addr learned my addr 172.21.15.100:0/1087772344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.648+0000 7fe9f9400640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9fb200640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9e00640 1 -- 172.21.15.100:0/1087772344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 msgr2=0x5640771a9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9e00640 1 -- 172.21.15.100:0/1087772344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 msgr2=0x56407713dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9e00640 1 -- 172.21.15.100:0/1087772344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564077059060 con 0x5640771b9100 2024-02-21T07:54:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.649+0000 7fe9f9400640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.654+0000 7fe9f9e00640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe9f402c3c0 tx=0x7fe9f4002110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554fde4987d73bda server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.654+0000 7fe9db400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.655+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4035d20 con 0x5640771b9100 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.655+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9f4049440 con 0x5640771b9100 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.658+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9e80063c0 con 0x5640771b9100 2024-02-21T07:54:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.659+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9f4035e80 con 0x5640771b9100 2024-02-21T07:54:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.660+0000 7fea03b77740 10 client.6777 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.660+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56407703a950 con 0x5640771b9100 2024-02-21T07:54:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.661+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e80063c0 con 0x5640771b9100 2024-02-21T07:54:40.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9f4049600 con 0x5640771b9100 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fea03b77740 10 client.6777 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fea03b77740 10 client.6777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fea03b77740 20 client.6777 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771807c0 0x5640771317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.666+0000 7fea03b77740 4 client.6777 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.667+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564076e2b890 con 0x5640771807c0 2024-02-21T07:54:40.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.667+0000 7fe9f9400640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771807c0 0x5640771317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:40.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.669+0000 7fe9f9400640 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771807c0 0x5640771317e0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690c25b494cff7ac server_cookie=e3e4cc99f4d9ae6a in_seq=0 out_seq=0 2024-02-21T07:54:40.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.670+0000 7fe9db400640 10 client.6777 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:40.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.670+0000 7fe9db400640 1 -- 172.21.15.100:0/1087772344 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564076e2b890 con 0x5640771807c0 2024-02-21T07:54:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.670+0000 7fe9db400640 10 client.6777 handle_command_reply: tid=0 2024-02-21T07:54:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.670+0000 7fea03b77740 1 client.6777 shutdown 2024-02-21T07:54:40.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.672+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 msgr2=0x56407712de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.672+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe9f402c3c0 tx=0x7fe9f4002110 comp rx=0 tx=0).stop 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 shutdown_connections 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5640771807c0 0x5640771317e0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5640771b9100 0x56407712de20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5640771b87e0 0x5640771a9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 --2- 172.21.15.100:0/1087772344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564077140c30 0x56407713dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.681+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 >> 172.21.15.100:0/1087772344 conn(0x5640770ff5a0 msgr2=0x564077140450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.684+0000 7fe9db400640 0 client.6777 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:40.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.685+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 shutdown_connections 2024-02-21T07:54:40.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.686+0000 7fea03b77740 1 -- 172.21.15.100:0/1087772344 wait complete. 2024-02-21T07:54:40.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.687+0000 7fea03b77740 20 client.6777 trim_cache size 0 max 16384 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "f0bbeaa7-dbc2-4bac-a163-24042a58d012": { 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "f0bbeaa7-dbc2-4bac-a163-24042a58d012", 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:54:40.691 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:54:40.692 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:54:40.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 msgr2=0x7fe9dc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 0x7fe9dc0a16b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0cb4e0 tx=0x7fe9e8001910 comp rx=0 tx=0).stop 2024-02-21T07:54:40.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 msgr2=0x7fe9fc16c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:40.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 0x7fe9fc16c6a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00e600 tx=0x7fe9ec00eac0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 shutdown_connections 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.691+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe9dc09f1f0 0x7fe9dc0a16b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9fc181ee0 0x7fe9fc218a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9fc0f4610 0x7fe9fc218500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 --2- 172.21.15.100:0/2281524837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9fc06da30 0x7fe9fc16c6a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:40.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 >> 172.21.15.100:0/2281524837 conn(0x7fe9fc0ce160 msgr2=0x7fe9fc06b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:40.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 shutdown_connections 2024-02-21T07:54:40.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:54:40.692+0000 7fe9e7400640 1 -- 172.21.15.100:0/2281524837 wait complete. 2024-02-21T07:54:40.734 INFO:tasks.cephfs.filesystem:scrub status for tag:f0bbeaa7-dbc2-4bac-a163-24042a58d012 - {'path': '/', 'tag': 'f0bbeaa7-dbc2-4bac-a163-24042a58d012', 'options': 'recursive,force'} 2024-02-21T07:54:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.459+0000 7f9e96400640 1 Processor -- start 2024-02-21T07:54:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.459+0000 7f9e96400640 1 -- start start 2024-02-21T07:54:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9e8810bb40 0x7f9e88111f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 0x7f9e88110690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e88110bd0 0x7f9e880792b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8810bf20 con 0x7f9e88110bd0 2024-02-21T07:54:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8810f960 con 0x7f9e8810bb40 2024-02-21T07:54:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e96400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8807a1e0 con 0x7f9e88112450 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e8f400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f9e8810bb40 0x7f9e88111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.463+0000 7f9e8fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e88110bd0 0x7f9e880792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e88110bd0 0x7f9e880792b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34732/0 (socket says 172.21.15.100:34732) 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3055925356 learned_addr learned my addr 172.21.15.100:0/3055925356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 0x7f9e88110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3055925356 >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 msgr2=0x7f9e88110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 0x7f9e88110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3055925356 >> v2:172.21.15.156:3300/0 conn(0x7f9e8810bb40 msgr2=0x7f9e88111f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.156:3300/0 conn(0x7f9e8810bb40 0x7f9e88111f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3055925356 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8807a4c0 con 0x7f9e88110bd0 2024-02-21T07:54:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.464+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 0x7f9e88110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.466+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3055925356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e880792b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9e90062740 tx=0x7f9e900a6fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3612e71d4f53a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.466+0000 7f9e8e000640 1 -- 172.21.15.100:0/3055925356 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900a7c20 con 0x7f9e88110bd0 2024-02-21T07:54:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.467+0000 7f9e8e000640 1 -- 172.21.15.100:0/3055925356 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e900a7dc0 con 0x7f9e88110bd0 2024-02-21T07:54:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.467+0000 7f9e8e000640 1 -- 172.21.15.100:0/3055925356 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900af640 con 0x7f9e88110bd0 2024-02-21T07:54:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.468+0000 7f9e96400640 1 -- 172.21.15.100:0/3055925356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 msgr2=0x7f9e880792b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.468+0000 7f9e96400640 1 --2- 172.21.15.100:0/3055925356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e880792b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9e90062740 tx=0x7f9e900a6fc0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.468+0000 7f9e96400640 1 -- 172.21.15.100:0/3055925356 shutdown_connections 2024-02-21T07:54:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.469+0000 7f9e96400640 1 --2- 172.21.15.100:0/3055925356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e880792b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.469+0000 7f9e96400640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.170:3300/0 conn(0x7f9e88112450 0x7f9e88110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.469+0000 7f9e96400640 1 --2- 172.21.15.100:0/3055925356 >> v2:172.21.15.156:3300/0 conn(0x7f9e8810bb40 0x7f9e88111f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.469+0000 7f9e96400640 1 -- 172.21.15.100:0/3055925356 >> 172.21.15.100:0/3055925356 conn(0x7f9e88052e00 msgr2=0x7f9e88053210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.469+0000 7f9e96400640 1 -- 172.21.15.100:0/3055925356 shutdown_connections 2024-02-21T07:54:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.470+0000 7f9e96400640 1 -- 172.21.15.100:0/3055925356 wait complete. 2024-02-21T07:54:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.474+0000 7f9e96400640 1 Processor -- start 2024-02-21T07:54:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.474+0000 7f9e96400640 1 -- start start 2024-02-21T07:54:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.477+0000 7f9e96400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 0x7f9e880feec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.477+0000 7f9e96400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e881aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.477+0000 7f9e96400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42170/0 (socket says 172.21.15.100:42170) 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3582643527 learned_addr learned my addr 172.21.15.100:0/3582643527 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881aa270 con 0x7f9e88110bd0 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881a9380 con 0x7f9e88112450 2024-02-21T07:54:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.478+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881a9660 con 0x7f9e8810bb40 2024-02-21T07:54:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.479+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e881aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.479+0000 7f9e8f400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 0x7f9e880feec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3582643527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 msgr2=0x7f9e880feec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 0x7f9e880feec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3582643527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 msgr2=0x7f9e881aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e881aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9004fdd0 con 0x7f9e88112450 2024-02-21T07:54:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8f400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 0x7f9e880feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:45.484 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.480+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e881aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.484+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e9004fc90 tx=0x7f9e900643c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.485+0000 7f9e83400640 1 -- 172.21.15.100:0/3582643527 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900bb650 con 0x7f9e88112450 2024-02-21T07:54:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.485+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e881a9940 con 0x7f9e88112450 2024-02-21T07:54:45.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.485+0000 7f9e83400640 1 -- 172.21.15.100:0/3582643527 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e900bb7b0 con 0x7f9e88112450 2024-02-21T07:54:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.485+0000 7f9e83400640 1 -- 172.21.15.100:0/3582643527 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900bbb60 con 0x7f9e88112450 2024-02-21T07:54:45.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.485+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e881a9f00 con 0x7f9e88112450 2024-02-21T07:54:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.500+0000 7f9e83400640 1 -- 172.21.15.100:0/3582643527 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f9e900bbcc0 con 0x7f9e88112450 2024-02-21T07:54:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.502+0000 7f9e991ac740 1 Processor -- start 2024-02-21T07:54:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.503+0000 7f9e991ac740 1 -- start start 2024-02-21T07:54:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.503+0000 7f9e83400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 0x7f9e700a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.507 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.503+0000 7f9e83400640 1 -- 172.21.15.100:0/3582643527 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9e901671f0 con 0x7f9e88112450 2024-02-21T07:54:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.504+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 0x7f9e700a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 0x555bbf8fd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf902c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8be620 con 0x555bbf93e250 2024-02-21T07:54:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8708c0 con 0x555bbf903170 2024-02-21T07:54:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.505+0000 7f9e991ac740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf86ddf0 con 0x555bbf9726b0 2024-02-21T07:54:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 0x555bbf8fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42180/0 (socket says 172.21.15.100:42180) 2024-02-21T07:54:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8fe00640 1 -- 172.21.15.100:0/1919973303 learned_addr learned my addr 172.21.15.100:0/1919973303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 0x7f9e700a16b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e8810f080 tx=0x7f9e84008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.506+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf902c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.509+0000 7f9e8f400640 1 -- 172.21.15.100:0/1919973303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 msgr2=0x555bbf902c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.509+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf902c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.509+0000 7f9e8f400640 1 -- 172.21.15.100:0/1919973303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 msgr2=0x555bbf93e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.509+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.509+0000 7f9e8f400640 1 -- 172.21.15.100:0/1919973303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bbf7eab00 con 0x555bbf93e250 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.510+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:54:45.513 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.510+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 0x555bbf8fd620 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009ae0 tx=0x7f9e7c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda0978c9dfb52a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.511+0000 7f9e77e00640 1 -- 172.21.15.100:0/1919973303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c011b00 con 0x555bbf93e250 2024-02-21T07:54:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.511+0000 7f9e77e00640 1 -- 172.21.15.100:0/1919973303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c011c60 con 0x555bbf93e250 2024-02-21T07:54:45.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.511+0000 7f9e77e00640 1 -- 172.21.15.100:0/1919973303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c011b00 con 0x555bbf93e250 2024-02-21T07:54:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.512+0000 7f9e991ac740 1 -- 172.21.15.100:0/1919973303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 msgr2=0x555bbf8fd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.512+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 0x555bbf8fd620 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009ae0 tx=0x7f9e7c009190 comp rx=0 tx=0).stop 2024-02-21T07:54:45.518 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.515+0000 7f9e991ac740 1 -- 172.21.15.100:0/1919973303 shutdown_connections 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.515+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf93e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.515+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf902c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.515+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1919973303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf93e250 0x555bbf8fd620 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.515+0000 7f9e991ac740 1 -- 172.21.15.100:0/1919973303 >> 172.21.15.100:0/1919973303 conn(0x555bbf8ca4b0 msgr2=0x555bbf901e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.516+0000 7f9e991ac740 1 -- 172.21.15.100:0/1919973303 shutdown_connections 2024-02-21T07:54:45.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.517+0000 7f9e991ac740 1 -- 172.21.15.100:0/1919973303 wait complete. 2024-02-21T07:54:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.519+0000 7f9e991ac740 1 -- start start 2024-02-21T07:54:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.520+0000 7f9e991ac740 1 Processor -- start 2024-02-21T07:54:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.523+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf903170 0x555bbf8fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.523+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf983d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.523+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34762/0 (socket says 172.21.15.100:34762) 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e8fe00640 1 -- 172.21.15.100:0/1520346510 learned_addr learned my addr 172.21.15.100:0/1520346510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8695d0 con 0x555bbf9726b0 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf80eb50 con 0x555bbf93e250 2024-02-21T07:54:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.524+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf80e7f0 con 0x555bbf903170 2024-02-21T07:54:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.525+0000 7f9e991ac740 10 client.0 _ll_register_callbacks cb 0x555bbf822550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8fe00640 1 -- 172.21.15.100:0/1520346510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf903170 msgr2=0x555bbf8fdbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:54:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf903170 0x555bbf8fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf903170 0x555bbf8fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8fe00640 1 -- 172.21.15.100:0/1520346510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 msgr2=0x555bbf983d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf983d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.529+0000 7f9e8fe00640 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c0096b0 con 0x555bbf9726b0 2024-02-21T07:54:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.530+0000 7f9e74c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:54:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.530+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9e90069d40 tx=0x7f9e90134aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa568f3ea87f3e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.530+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900cb500 con 0x555bbf9726b0 2024-02-21T07:54:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.531+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9e901353d0 con 0x555bbf9726b0 2024-02-21T07:54:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.531+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bbf83bcd0 con 0x555bbf9726b0 2024-02-21T07:54:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.531+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e90134cd0 con 0x555bbf9726b0 2024-02-21T07:54:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.532+0000 7f9e991ac740 10 client.6789 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.532+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555bbf867c50 con 0x555bbf9726b0 2024-02-21T07:54:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.532+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e90138e20 con 0x555bbf9726b0 2024-02-21T07:54:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.534+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9e90148d20 con 0x555bbf9726b0 2024-02-21T07:54:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.535+0000 7f9e991ac740 10 client.6789 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.535+0000 7f9e991ac740 10 client.6789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.535+0000 7f9e991ac740 20 client.6789 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.535+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf9439f0 0x555bbf8fe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.536+0000 7f9e991ac740 4 client.6789 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.536+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555bbf83bcd0 con 0x555bbf9439f0 2024-02-21T07:54:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.536+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf9439f0 0x555bbf8fe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.537+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf9439f0 0x555bbf8fe300 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf30e35ee87ebb7a server_cookie=28a3bb85884a3213 in_seq=0 out_seq=0 2024-02-21T07:54:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.539+0000 7f9e74c00640 10 client.6789 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.539+0000 7f9e74c00640 1 -- 172.21.15.100:0/1520346510 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555bbf83bcd0 con 0x555bbf9439f0 2024-02-21T07:54:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.539+0000 7f9e74c00640 10 client.6789 handle_command_reply: tid=0 2024-02-21T07:54:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.539+0000 7f9e991ac740 1 client.6789 shutdown 2024-02-21T07:54:45.543 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.540+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 msgr2=0x555bbf967910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.540+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9e90069d40 tx=0x7f9e90134aa0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 shutdown_connections 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf9439f0 0x555bbf8fe300 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf967910 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf983d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1520346510 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf903170 0x555bbf8fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 >> 172.21.15.100:0/1520346510 conn(0x555bbf8ca4b0 msgr2=0x555bbf972b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.541+0000 7f9e74c00640 0 client.6789 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.542+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 shutdown_connections 2024-02-21T07:54:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.542+0000 7f9e991ac740 1 -- 172.21.15.100:0/1520346510 wait complete. 2024-02-21T07:54:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.542+0000 7f9e991ac740 20 client.6789 trim_cache size 0 max 16384 2024-02-21T07:54:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.581+0000 7f9e991ac740 1 Processor -- start 2024-02-21T07:54:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.581+0000 7f9e991ac740 1 -- start start 2024-02-21T07:54:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.583+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.583+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf909160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.583+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf9d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.584+0000 7f9e991ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf5b1e60 con 0x555bbf903170 2024-02-21T07:54:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.584+0000 7f9e991ac740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf936f90 con 0x555bbf93e250 2024-02-21T07:54:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.584+0000 7f9e991ac740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8fd820 con 0x555bbf9726b0 2024-02-21T07:54:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf9d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34774/0 (socket says 172.21.15.100:34774) 2024-02-21T07:54:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8f400640 1 -- 172.21.15.100:0/3776602748 learned_addr learned my addr 172.21.15.100:0/3776602748 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf909160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.586+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3776602748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 msgr2=0x555bbf909160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.600+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf909160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.600+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3776602748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 msgr2=0x555bbf8fda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.600+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.600+0000 7f9e8fe00640 1 -- 172.21.15.100:0/3776602748 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555bbf804530 con 0x555bbf9726b0 2024-02-21T07:54:45.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.600+0000 7f9e8f400640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:45.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.601+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf909160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:54:45.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.609+0000 7f9e8fe00640 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf9d0900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x555bbf939d00 tx=0x7f9e90166000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e2c8aeee3fe28f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.610+0000 7f9e77400640 1 -- 172.21.15.100:0/3776602748 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9013a150 con 0x555bbf9726b0 2024-02-21T07:54:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.610+0000 7f9e77400640 1 -- 172.21.15.100:0/3776602748 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e901353d0 con 0x555bbf9726b0 2024-02-21T07:54:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.611+0000 7f9e991ac740 1 -- 172.21.15.100:0/3776602748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 msgr2=0x555bbf9d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.614+0000 7f9e77400640 1 -- 172.21.15.100:0/3776602748 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9013a150 con 0x555bbf9726b0 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf9d0900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x555bbf939d00 tx=0x7f9e90166000 comp rx=0 tx=0).stop 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 -- 172.21.15.100:0/3776602748 shutdown_connections 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf9726b0 0x555bbf9d0900 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf93e250 0x555bbf909160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 --2- 172.21.15.100:0/3776602748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.617+0000 7f9e991ac740 1 -- 172.21.15.100:0/3776602748 >> 172.21.15.100:0/3776602748 conn(0x555bbf8ca4b0 msgr2=0x555bbf942650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.627+0000 7f9e991ac740 1 -- 172.21.15.100:0/3776602748 shutdown_connections 2024-02-21T07:54:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.627+0000 7f9e991ac740 1 -- 172.21.15.100:0/3776602748 wait complete. 2024-02-21T07:54:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.629+0000 7f9e991ac740 1 -- start start 2024-02-21T07:54:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.629+0000 7f9e991ac740 1 Processor -- start 2024-02-21T07:54:45.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.641+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf93e250 0x555bbf939b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf9d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf9e0270 con 0x555bbf9726b0 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8fcce0 con 0x555bbf903170 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555bbf8fcfc0 con 0x555bbf93e250 2024-02-21T07:54:45.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.642+0000 7f9e991ac740 10 client.0 _ll_register_callbacks cb 0x7f9e7c009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.644+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf9d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.644+0000 7f9e8f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.644+0000 7f9e8f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:42212/0 (socket says 172.21.15.100:42212) 2024-02-21T07:54:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.644+0000 7f9e8f400640 1 -- 172.21.15.100:0/1271237229 learned_addr learned my addr 172.21.15.100:0/1271237229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:45.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.644+0000 7f9e8ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf93e250 0x555bbf939b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.646+0000 7f9e8f400640 1 -- 172.21.15.100:0/1271237229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf93e250 msgr2=0x555bbf939b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.646+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf93e250 0x555bbf939b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.646+0000 7f9e8f400640 1 -- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 msgr2=0x555bbf9d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.646+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf9d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.646+0000 7f9e8f400640 1 -- 172.21.15.100:0/1271237229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555bbf867c50 con 0x555bbf903170 2024-02-21T07:54:45.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.647+0000 7f9e74c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:45.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.647+0000 7f9e8f400640 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009190 tx=0x7f9e7c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f18a98443dfedb33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.648+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c029380 con 0x555bbf903170 2024-02-21T07:54:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.648+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9e7c0294e0 con 0x555bbf903170 2024-02-21T07:54:45.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.649+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555bbf88ed30 con 0x555bbf903170 2024-02-21T07:54:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.650+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e7c0296a0 con 0x555bbf903170 2024-02-21T07:54:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.650+0000 7f9e991ac740 10 client.6964 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:45.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.650+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555bbf82a2c0 con 0x555bbf903170 2024-02-21T07:54:45.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.651+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7c038030 con 0x555bbf903170 2024-02-21T07:54:45.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.652+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9e7c02f020 con 0x555bbf903170 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.652+0000 7f9e991ac740 10 client.6964 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.652+0000 7f9e991ac740 10 client.6964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.652+0000 7f9e991ac740 20 client.6964 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.652+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf935570 0x555bbf97b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.653+0000 7f9e991ac740 4 client.6964 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.653+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555bbf85fce0 con 0x555bbf935570 2024-02-21T07:54:45.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.653+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf935570 0x555bbf97b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.654+0000 7f9e8ea00640 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf935570 0x555bbf97b0f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12673daaa6666750 server_cookie=10a2f09e303aba63 in_seq=0 out_seq=0 2024-02-21T07:54:45.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.654+0000 7f9e74c00640 10 client.6964 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:45.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e74c00640 1 -- 172.21.15.100:0/1271237229 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555bbf85fce0 con 0x555bbf935570 2024-02-21T07:54:45.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e74c00640 10 client.6964 handle_command_reply: tid=0 2024-02-21T07:54:45.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 client.6964 shutdown 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 msgr2=0x555bbf8fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009190 tx=0x7f9e7c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 shutdown_connections 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x555bbf935570 0x555bbf97b0f0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555bbf9726b0 0x555bbf9d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555bbf93e250 0x555bbf939b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.686 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 --2- 172.21.15.100:0/1271237229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555bbf903170 0x555bbf8fda30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e74c00640 0 client.6964 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.681+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 >> 172.21.15.100:0/1271237229 conn(0x555bbf8ca4b0 msgr2=0x555bbf9005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 shutdown_connections 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e991ac740 1 -- 172.21.15.100:0/1271237229 wait complete. 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e991ac740 20 client.6964 trim_cache size 0 max 16384 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:54:45.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:54:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 msgr2=0x7f9e700a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 0x7f9e700a16b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9e8810f080 tx=0x7f9e84008040 comp rx=0 tx=0).stop 2024-02-21T07:54:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 msgr2=0x7f9e881a8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:45.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9e9004fc90 tx=0x7f9e900643c0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 shutdown_connections 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9e88112450 0x7f9e881a8c90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f9e7009f1f0 0x7f9e700a16b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e88110bd0 0x7f9e881aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 --2- 172.21.15.100:0/3582643527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9e8810bb40 0x7f9e880feec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.682+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 >> 172.21.15.100:0/3582643527 conn(0x7f9e88052e00 msgr2=0x7f9e88054c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.683+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 shutdown_connections 2024-02-21T07:54:45.689 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:45.683+0000 7f9e96400640 1 -- 172.21.15.100:0/3582643527 wait complete. 2024-02-21T07:54:46.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:46.817 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:46.820 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.930+0000 7f385e400640 1 Processor -- start 2024-02-21T07:54:58.934 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.930+0000 7f385e400640 1 -- start start 2024-02-21T07:54:58.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.933+0000 7f385e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f38580d3de0 0x7f38580d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.935 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.933+0000 7f3857400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f385815da00 0x7f38580f8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:54322/0 (socket says 172.21.15.100:54322) 2024-02-21T07:54:58.936 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.934+0000 7f3857400640 1 -- 172.21.15.100:0/668941054 learned_addr learned my addr 172.21.15.100:0/668941054 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:54:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.935+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580d43a0 con 0x7f38580f95b0 2024-02-21T07:54:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.935+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580d4680 con 0x7f385815da00 2024-02-21T07:54:58.937 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.935+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38580d3a30 con 0x7f38580d3de0 2024-02-21T07:54:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.936+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635951682 0 0) 0x7f38580d43a0 con 0x7f38580f95b0 2024-02-21T07:54:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.937+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383c003520 con 0x7f38580f95b0 2024-02-21T07:54:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.937+0000 7f3856a00640 1 --2- 172.21.15.100:0/668941054 >> v2:172.21.15.100:3300/0 conn(0x7f38580d3de0 0x7f38580d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.937+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692395293 0 0) 0x7f38580d4680 con 0x7f385815da00 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.937+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38580d43a0 con 0x7f385815da00 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448808120 0 0) 0x7f383c003520 con 0x7f38580f95b0 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 >> v2:172.21.15.100:3300/0 conn(0x7f38580d3de0 msgr2=0x7f38580d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 --2- 172.21.15.100:0/668941054 >> v2:172.21.15.100:3300/0 conn(0x7f38580d3de0 0x7f38580d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 >> v1:172.21.15.170:6789/0 conn(0x7f385815da00 legacy=0x7f38580f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580d4960 con 0x7f38580f95b0 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f38500019f0 con 0x7f38580f95b0 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 >> v1:172.21.15.156:6789/0 conn(0x7f38580f95b0 legacy=0x7f385818bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f383c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f383c0047c0 0x7f383c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f383c0052f0 0x7f383c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c00c210 con 0x7f383c003b50 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c00c380 con 0x7f383c0047c0 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.938+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c00c540 con 0x7f383c0052f0 2024-02-21T07:54:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.939+0000 7f3856a00640 1 --2- 172.21.15.100:0/668941054 >> v2:172.21.15.100:3300/0 conn(0x7f38580d3de0 0x7f38580d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.940+0000 7f3857e00640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f383c0052f0 0x7f383c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.940+0000 7f3856a00640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f383c0047c0 0x7f383c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.940+0000 7f3857400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f383c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.941+0000 7f3857400640 1 -- 172.21.15.100:0/668941054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f383c0052f0 msgr2=0x7f383c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.941+0000 7f3857400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f383c0052f0 0x7f383c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.942+0000 7f3857400640 1 -- 172.21.15.100:0/668941054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f383c0047c0 msgr2=0x7f383c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.942+0000 7f3857400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f383c0047c0 0x7f383c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.942+0000 7f3857400640 1 -- 172.21.15.100:0/668941054 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580d4960 con 0x7f383c003b50 2024-02-21T07:54:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.942+0000 7f3856a00640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f383c0047c0 0x7f383c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.943+0000 7f3857e00640 1 -- 172.21.15.100:0/668941054 reap_dead start 2024-02-21T07:54:58.946 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.944+0000 7f3857400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f383c003f50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3848001c20 tx=0x7f383c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7294dd474eca7f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:58.947 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.944+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848004aa0 con 0x7f383c003b50 2024-02-21T07:54:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.944+0000 7f3856000640 1 -- 172.21.15.100:0/668941054 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848004c00 con 0x7f383c003b50 2024-02-21T07:54:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.945+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 msgr2=0x7f383c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.948 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.945+0000 7f385e400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f383c003f50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3848001c20 tx=0x7f383c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.947+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 shutdown_connections 2024-02-21T07:54:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.947+0000 7f385e400640 1 --2- 172.21.15.100:0/668941054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f383c003f50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.947+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 >> 172.21.15.100:0/668941054 conn(0x7f385808cfd0 msgr2=0x7f385808d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.955+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 shutdown_connections 2024-02-21T07:54:58.960 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.955+0000 7f385e400640 1 -- 172.21.15.100:0/668941054 wait complete. 2024-02-21T07:54:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.960+0000 7f385e400640 1 Processor -- start 2024-02-21T07:54:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.961+0000 7f385e400640 1 -- start start 2024-02-21T07:54:58.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3858185bc0 0x7f385822b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f385822b710 0x7f385815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580d1ca0 con 0x7f383c003b50 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580d20c0 con 0x7f385822b710 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f385e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385822bd60 con 0x7f3858185bc0 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f3857400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f3857400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46230/0 (socket says 172.21.15.100:46230) 2024-02-21T07:54:58.968 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.965+0000 7f3857400640 1 -- 172.21.15.100:0/126015652 learned_addr learned my addr 172.21.15.100:0/126015652 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:58.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.966+0000 7f3856a00640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3858185bc0 0x7f385822b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857e00640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f385822b710 0x7f385815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857400640 1 -- 172.21.15.100:0/126015652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3858185bc0 msgr2=0x7f385822b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3858185bc0 0x7f385822b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857400640 1 -- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f385822b710 msgr2=0x7f385815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f385822b710 0x7f385815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.967+0000 7f3857400640 1 -- 172.21.15.100:0/126015652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385822c040 con 0x7f383c003b50 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.968+0000 7f3857400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f384802c090 tx=0x7f38480012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:58.970 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.968+0000 7f384f400640 1 -- 172.21.15.100:0/126015652 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384803d070 con 0x7f383c003b50 2024-02-21T07:54:58.971 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.969+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580d1020 con 0x7f383c003b50 2024-02-21T07:54:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.970+0000 7f384f400640 1 -- 172.21.15.100:0/126015652 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384802d500 con 0x7f383c003b50 2024-02-21T07:54:58.972 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.970+0000 7f384f400640 1 -- 172.21.15.100:0/126015652 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384802d870 con 0x7f383c003b50 2024-02-21T07:54:58.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.974+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580d15e0 con 0x7f383c003b50 2024-02-21T07:54:58.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.983+0000 7f384f400640 1 -- 172.21.15.100:0/126015652 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f384802d9d0 con 0x7f383c003b50 2024-02-21T07:54:58.988 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.986+0000 7f384f400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 0x7f38380a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.986+0000 7f3856a00640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 0x7f38380a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.987+0000 7f384f400640 1 -- 172.21.15.100:0/126015652 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f38480b4770 con 0x7f383c003b50 2024-02-21T07:54:58.989 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.987+0000 7f3856a00640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 0x7f38380a1560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f385821dff0 tx=0x7f3844008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.988+0000 7f386104e740 1 Processor -- start 2024-02-21T07:54:58.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.988+0000 7f386104e740 1 -- start start 2024-02-21T07:54:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b114440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b119a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.995 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b0d5620 con 0x55ca2b1894d0 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b0878c0 con 0x55ca2b155070 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f386104e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b084df0 con 0x55ca2b119f90 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:42772/0 (socket says 172.21.15.100:42772) 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 -- 172.21.15.100:0/293908740 learned_addr learned my addr 172.21.15.100:0/293908740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 -- 172.21.15.100:0/293908740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 msgr2=0x55ca2b114440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b114440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 -- 172.21.15.100:0/293908740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 msgr2=0x55ca2b119a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b119a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.992+0000 7f3857e00640 1 -- 172.21.15.100:0/293908740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca2b001b00 con 0x55ca2b119f90 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.993+0000 7f3857e00640 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3850002210 tx=0x7f3850003d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3424c10961686208 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.993+0000 7f3843e00640 1 -- 172.21.15.100:0/293908740 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850001970 con 0x55ca2b119f90 2024-02-21T07:54:58.996 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.993+0000 7f3843e00640 1 -- 172.21.15.100:0/293908740 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850005530 con 0x55ca2b119f90 2024-02-21T07:54:58.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.993+0000 7f3843e00640 1 -- 172.21.15.100:0/293908740 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850013360 con 0x55ca2b119f90 2024-02-21T07:54:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 -- 172.21.15.100:0/293908740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 msgr2=0x55ca2b155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3850002210 tx=0x7f3850003d40 comp rx=0 tx=0).stop 2024-02-21T07:54:58.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 -- 172.21.15.100:0/293908740 shutdown_connections 2024-02-21T07:54:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b155450 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b119a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 --2- 172.21.15.100:0/293908740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:58.999 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.996+0000 7f386104e740 1 -- 172.21.15.100:0/293908740 >> 172.21.15.100:0/293908740 conn(0x55ca2b0e14b0 msgr2=0x55ca2b118ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:59.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.998+0000 7f386104e740 1 -- 172.21.15.100:0/293908740 shutdown_connections 2024-02-21T07:54:59.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:58.999+0000 7f386104e740 1 -- 172.21.15.100:0/293908740 wait complete. 2024-02-21T07:54:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.000+0000 7f386104e740 1 -- start start 2024-02-21T07:54:59.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.001+0000 7f386104e740 1 Processor -- start 2024-02-21T07:54:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b1147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b17e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b0805d0 con 0x55ca2b1894d0 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b025b50 con 0x55ca2b155070 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b0257f0 con 0x55ca2b119f90 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.004+0000 7f386104e740 10 client.0 _ll_register_callbacks cb 0x55ca2b039550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:59.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:37844/0 (socket says 172.21.15.100:37844) 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 -- 172.21.15.100:0/1347724295 learned_addr learned my addr 172.21.15.100:0/1347724295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 -- 172.21.15.100:0/1347724295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 msgr2=0x55ca2b1147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b1147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 -- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 msgr2=0x55ca2b17e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b17e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.005+0000 7f3856a00640 1 -- 172.21.15.100:0/1347724295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385000f040 con 0x55ca2b155070 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.006+0000 7f3840c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.006+0000 7f3856a00640 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f384400ed20 tx=0x7f3844004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d776dc461ca25a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.006+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844024640 con 0x55ca2b155070 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.006+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3844016e30 con 0x55ca2b155070 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.007+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca2b052cd0 con 0x55ca2b155070 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.007+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38440247a0 con 0x55ca2b155070 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.007+0000 7f386104e740 10 client.6970 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:59.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.007+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca2b07ec50 con 0x55ca2b155070 2024-02-21T07:54:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.008+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca2b052cd0 con 0x55ca2b155070 2024-02-21T07:54:59.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.008+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3844024900 con 0x55ca2b155070 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.008+0000 7f386104e740 10 client.6970 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.008+0000 7f386104e740 10 client.6970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.008+0000 7f386104e740 20 client.6970 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b14aa60 0x55ca2b148870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f386104e740 4 client.6970 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca2b076ce0 con 0x55ca2b14aa60 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f3857400640 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b14aa60 0x55ca2b148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f3857400640 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b14aa60 0x55ca2b148870 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5225274341d63edf server_cookie=91a8083816c96923 in_seq=0 out_seq=0 2024-02-21T07:54:59.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.009+0000 7f3840c00640 10 client.6970 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f3840c00640 1 -- 172.21.15.100:0/1347724295 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca2b076ce0 con 0x55ca2b14aa60 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f3840c00640 10 client.6970 handle_command_reply: tid=0 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 client.6970 shutdown 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 msgr2=0x55ca2b18a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f384400ed20 tx=0x7f3844004730 comp rx=0 tx=0).stop 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 shutdown_connections 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b14aa60 0x55ca2b148870 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b1894d0 0x55ca2b17e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b18a5f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 --2- 172.21.15.100:0/1347724295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b119f90 0x55ca2b1147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f3840c00640 0 client.6970 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.010+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 >> 172.21.15.100:0/1347724295 conn(0x55ca2b0e14b0 msgr2=0x55ca2b189950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.011+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 shutdown_connections 2024-02-21T07:54:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.011+0000 7f386104e740 1 -- 172.21.15.100:0/1347724295 wait complete. 2024-02-21T07:54:59.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.011+0000 7f386104e740 20 client.6970 trim_cache size 0 max 16384 2024-02-21T07:54:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.042+0000 7f386104e740 1 Processor -- start 2024-02-21T07:54:59.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.042+0000 7f386104e740 1 -- start start 2024-02-21T07:54:59.047 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.045+0000 7f386104e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 0x55ca2b119690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.045+0000 7f386104e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b10fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.045+0000 7f386104e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b18a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.046+0000 7f386104e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2adc8e60 con 0x55ca2b119f90 2024-02-21T07:54:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.046+0000 7f386104e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b1a1e80 con 0x55ca2b155070 2024-02-21T07:54:59.048 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.046+0000 7f386104e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b14c450 con 0x55ca2b1894d0 2024-02-21T07:54:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.047+0000 7f3857e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b18a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.047+0000 7f3857e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b18a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:42794/0 (socket says 172.21.15.100:42794) 2024-02-21T07:54:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.047+0000 7f3857e00640 1 -- 172.21.15.100:0/806428210 learned_addr learned my addr 172.21.15.100:0/806428210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:59.049 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.047+0000 7f3857400640 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 0x55ca2b119690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.051 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.049+0000 7f3856a00640 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b10fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.051 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.049+0000 7f3857400640 1 -- 172.21.15.100:0/806428210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 msgr2=0x55ca2b18a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.049+0000 7f3857400640 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b18a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.049+0000 7f3857400640 1 -- 172.21.15.100:0/806428210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 msgr2=0x55ca2b10fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.049+0000 7f3857400640 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b10fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.050+0000 7f3857400640 1 -- 172.21.15.100:0/806428210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca2b01b530 con 0x55ca2b119f90 2024-02-21T07:54:59.052 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.050+0000 7f3857400640 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 0x55ca2b119690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f38480e7f90 tx=0x7f38480e7e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412ddbb7ceb1b2ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.052+0000 7f3843400640 1 -- 172.21.15.100:0/806428210 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480b7a60 con 0x55ca2b119f90 2024-02-21T07:54:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.052+0000 7f3843400640 1 -- 172.21.15.100:0/806428210 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480015e0 con 0x55ca2b119f90 2024-02-21T07:54:59.054 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.052+0000 7f3843400640 1 -- 172.21.15.100:0/806428210 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480b8800 con 0x55ca2b119f90 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.053+0000 7f386104e740 1 -- 172.21.15.100:0/806428210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 msgr2=0x55ca2b119690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 0x55ca2b119690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f38480e7f90 tx=0x7f38480e7e90 comp rx=0 tx=0).stop 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 -- 172.21.15.100:0/806428210 shutdown_connections 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b18a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b155070 0x55ca2b10fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 --2- 172.21.15.100:0/806428210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b119f90 0x55ca2b119690 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 -- 172.21.15.100:0/806428210 >> 172.21.15.100:0/806428210 conn(0x55ca2b0e14b0 msgr2=0x55ca2b17df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:59.056 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 -- 172.21.15.100:0/806428210 shutdown_connections 2024-02-21T07:54:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.054+0000 7f386104e740 1 -- 172.21.15.100:0/806428210 wait complete. 2024-02-21T07:54:59.057 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.056+0000 7f386104e740 1 -- start start 2024-02-21T07:54:59.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.056+0000 7f386104e740 1 Processor -- start 2024-02-21T07:54:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b155070 0x55ca2b15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b1ddc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b1ee740 con 0x55ca2b155070 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b1de8d0 con 0x55ca2b119f90 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2b1eee60 con 0x55ca2b1894d0 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3857400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f386104e740 10 client.0 _ll_register_callbacks cb 0x7f3850001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3857400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:37860/0 (socket says 172.21.15.100:37860) 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3857400640 1 -- 172.21.15.100:0/2003609280 learned_addr learned my addr 172.21.15.100:0/2003609280 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3857e00640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b1ddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3856a00640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b155070 0x55ca2b15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.059+0000 7f3857400640 1 -- 172.21.15.100:0/2003609280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 msgr2=0x55ca2b1ddc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857400640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b1ddc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857400640 1 -- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b155070 msgr2=0x55ca2b15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857400640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b155070 0x55ca2b15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857400640 1 -- 172.21.15.100:0/2003609280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580d15e0 con 0x55ca2b119f90 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857e00640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b1ddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3857400640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f38480be740 tx=0x7f3844016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778e25874c4cf28c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3840c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480b7a60 con 0x55ca2b119f90 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f38480b8800 con 0x55ca2b119f90 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca2b0a5d30 con 0x55ca2b119f90 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38480b8100 con 0x55ca2b119f90 2024-02-21T07:54:59.064 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f386104e740 10 client.6976 fetch_fsmap learned FSMap version 17 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.060+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ca2b0412c0 con 0x55ca2b119f90 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ca2b0a5d30 con 0x55ca2b119f90 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3848034030 con 0x55ca2b119f90 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 10 client.6976 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 10 client.6976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 20 client.6976 populate_metadata read hostname 'smithi100' 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b1147a0 0x55ca2b1de170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 4 client.6976 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:54:59.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ca2ad80600 con 0x55ca2b1147a0 2024-02-21T07:54:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.061+0000 7f3856a00640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b1147a0 0x55ca2b1de170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:54:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.063+0000 7f3856a00640 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b1147a0 0x55ca2b1de170 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1055c0109a471c5 server_cookie=bd8e7d83b56da3c9 in_seq=0 out_seq=0 2024-02-21T07:54:59.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.063+0000 7f3840c00640 10 client.6976 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f3840c00640 1 -- 172.21.15.100:0/2003609280 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ca2ad80600 con 0x55ca2b1147a0 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f3840c00640 10 client.6976 handle_command_reply: tid=0 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 client.6976 shutdown 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 msgr2=0x55ca2b1ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f38480be740 tx=0x7f3844016000 comp rx=0 tx=0).stop 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 shutdown_connections 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55ca2b1147a0 0x55ca2b1de170 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ca2b1894d0 0x55ca2b1ddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ca2b155070 0x55ca2b15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.080 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 --2- 172.21.15.100:0/2003609280 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca2b119f90 0x55ca2b1ee200 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 >> 172.21.15.100:0/2003609280 conn(0x55ca2b0e14b0 msgr2=0x55ca2b18a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f3840c00640 0 client.6976 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 shutdown_connections 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.077+0000 7f386104e740 1 -- 172.21.15.100:0/2003609280 wait complete. 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.078+0000 7f386104e740 20 client.6976 trim_cache size 0 max 16384 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:54:59.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 msgr2=0x7f38380a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 0x7f38380a1560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f385821dff0 tx=0x7f3844008040 comp rx=0 tx=0).stop 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 msgr2=0x7f3858185680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f384802c090 tx=0x7f38480012d0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 shutdown_connections 2024-02-21T07:54:59.082 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f385822b710 0x7f385815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3858185bc0 0x7f385822b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383809f0a0 0x7f38380a1560 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 --2- 172.21.15.100:0/126015652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c003b50 0x7f3858185680 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 >> 172.21.15.100:0/126015652 conn(0x7f385808cfd0 msgr2=0x7f38580cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 shutdown_connections 2024-02-21T07:54:59.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:54:59.079+0000 7f385e400640 1 -- 172.21.15.100:0/126015652 wait complete. 2024-02-21T07:55:10.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:55:10.736 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:55:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.188+0000 7f47b8a00640 1 Processor -- start 2024-02-21T07:55:11.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.189+0000 7f47b8a00640 1 -- start start 2024-02-21T07:55:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.192+0000 7f47b8a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f47ac10ade0 0x7f47ac10eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.193+0000 7f47b8a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 0x7f47ac110c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.193+0000 7f47b8a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac10f0c0 con 0x7f47ac006460 2024-02-21T07:55:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.193+0000 7f47b8a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ac10e6a0 con 0x7f47ac0e5d70 2024-02-21T07:55:11.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.193+0000 7f47b8a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ac0068e0 con 0x7f47ac10ade0 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.194+0000 7f47b1e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f47ac10ade0 0x7f47ac10eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.194+0000 7f47b2800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 0x7f47ac110c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.194+0000 7f47b1e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f47ac10ade0 0x7f47ac10eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38850/0 (socket says 172.21.15.100:38850) 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.194+0000 7f47b1e00640 1 -- 172.21.15.100:0/1022538810 learned_addr learned my addr 172.21.15.100:0/1022538810 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.195+0000 7f47b1e00640 1 -- 172.21.15.100:0/1022538810 >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 msgr2=0x7f47ac110c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.195+0000 7f47b1e00640 1 --2- 172.21.15.100:0/1022538810 >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 0x7f47ac110c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.195+0000 7f47b1e00640 1 -- 172.21.15.100:0/1022538810 >> v1:172.21.15.170:6789/0 conn(0x7f47ac006460 legacy=0x7f47ac007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.196+0000 7f47b1e00640 1 -- 172.21.15.100:0/1022538810 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac006bc0 con 0x7f47ac10ade0 2024-02-21T07:55:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.196+0000 7f47b2800640 1 --2- 172.21.15.100:0/1022538810 >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 0x7f47ac110c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:11.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.200+0000 7f47b1e00640 1 --2- 172.21.15.100:0/1022538810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac10ade0 0x7f47ac10eb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f47ac07e8a0 tx=0x7f47a402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c184eb72f7d40 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.200+0000 7f47b0a00640 1 -- 172.21.15.100:0/1022538810 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4030610 con 0x7f47ac10ade0 2024-02-21T07:55:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.201+0000 7f47b0a00640 1 -- 172.21.15.100:0/1022538810 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a4030770 con 0x7f47ac10ade0 2024-02-21T07:55:11.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.201+0000 7f47b0a00640 1 -- 172.21.15.100:0/1022538810 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4030b00 con 0x7f47ac10ade0 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.206+0000 7f47b8a00640 1 -- 172.21.15.100:0/1022538810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac10ade0 msgr2=0x7f47ac10eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.206+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1022538810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac10ade0 0x7f47ac10eb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f47ac07e8a0 tx=0x7f47a402b960 comp rx=0 tx=0).stop 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.207+0000 7f47b8a00640 1 -- 172.21.15.100:0/1022538810 shutdown_connections 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.207+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1022538810 >> v2:172.21.15.156:3300/0 conn(0x7f47ac0e5d70 0x7f47ac110c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.207+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1022538810 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac10ade0 0x7f47ac10eb80 secure :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f47ac07e8a0 tx=0x7f47a402b960 comp rx=0 tx=0).stop 2024-02-21T07:55:11.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.207+0000 7f47b8a00640 1 -- 172.21.15.100:0/1022538810 >> 172.21.15.100:0/1022538810 conn(0x7f47ac052e10 msgr2=0x7f47ac053220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.213+0000 7f47b8a00640 1 -- 172.21.15.100:0/1022538810 shutdown_connections 2024-02-21T07:55:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.214+0000 7f47b8a00640 1 -- 172.21.15.100:0/1022538810 wait complete. 2024-02-21T07:55:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.218+0000 7f47b8a00640 1 Processor -- start 2024-02-21T07:55:11.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.219+0000 7f47b8a00640 1 -- start start 2024-02-21T07:55:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 0x7f47ac075db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 0x7f47ac074900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac10e560 con 0x7f47ac006460 2024-02-21T07:55:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac078330 con 0x7f47ac0e5d70 2024-02-21T07:55:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.221+0000 7f47b8a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac073a40 con 0x7f47ac074450 2024-02-21T07:55:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42664/0 (socket says 172.21.15.100:42664) 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b1e00640 1 -- 172.21.15.100:0/1021698040 learned_addr learned my addr 172.21.15.100:0/1021698040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 0x7f47ac074900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b1400640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 0x7f47ac075db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 -- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 msgr2=0x7f47ac075db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 0x7f47ac075db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 -- 172.21.15.100:0/1021698040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 msgr2=0x7f47ac0e4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.222+0000 7f47b2800640 1 -- 172.21.15.100:0/1021698040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4068eb0 con 0x7f47ac074450 2024-02-21T07:55:11.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.223+0000 7f47b1400640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 0x7f47ac075db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:11.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.223+0000 7f47b1e00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:11.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.223+0000 7f47b2800640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 0x7f47ac074900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f47b404fc90 tx=0x7f47b4068050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.223+0000 7f47aa000640 1 -- 172.21.15.100:0/1021698040 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40906a0 con 0x7f47ac074450 2024-02-21T07:55:11.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.224+0000 7f47aa000640 1 -- 172.21.15.100:0/1021698040 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4090800 con 0x7f47ac074450 2024-02-21T07:55:11.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.224+0000 7f47aa000640 1 -- 172.21.15.100:0/1021698040 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4090b90 con 0x7f47ac074450 2024-02-21T07:55:11.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.224+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40094d0 con 0x7f47ac074450 2024-02-21T07:55:11.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.224+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac077a90 con 0x7f47ac074450 2024-02-21T07:55:11.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.230+0000 7f47aa000640 1 -- 172.21.15.100:0/1021698040 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f47b4090cf0 con 0x7f47ac074450 2024-02-21T07:55:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.233+0000 7f47aa000640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 0x7f47940a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.234+0000 7f47bb81b740 1 Processor -- start 2024-02-21T07:55:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.234+0000 7f47aa000640 1 -- 172.21.15.100:0/1021698040 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f47b4144a70 con 0x7f47ac074450 2024-02-21T07:55:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.234+0000 7f47bb81b740 1 -- start start 2024-02-21T07:55:11.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.234+0000 7f47b1e00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 0x7f47940a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655190 0x56121068ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210655570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121058c150 con 0x56121068b150 2024-02-21T07:55:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210589680 con 0x561210655ab0 2024-02-21T07:55:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47bb81b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210584e60 con 0x561210655190 2024-02-21T07:55:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47b2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47b2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34462/0 (socket says 172.21.15.100:34462) 2024-02-21T07:55:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.236+0000 7f47b2800640 1 -- 172.21.15.100:0/3202142603 learned_addr learned my addr 172.21.15.100:0/3202142603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.237+0000 7f47b2800640 1 -- 172.21.15.100:0/3202142603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655190 msgr2=0x56121068ac10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.237+0000 7f47b1400640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210655570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b1e00640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655190 0x56121068ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b2800640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655190 0x56121068ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b2800640 1 -- 172.21.15.100:0/3202142603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 msgr2=0x561210655570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b2800640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210655570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b2800640 1 -- 172.21.15.100:0/3202142603 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56121053e060 con 0x561210655ab0 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.238+0000 7f47b1400640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210655570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.239+0000 7f47b2800640 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f47b402d330 tx=0x7f47b4068da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3554d521d3ca88e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.239+0000 7f47b1e00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 0x7f47940a1660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f47a402b9a0 tx=0x7f47a4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.239+0000 7f479e600640 1 -- 172.21.15.100:0/3202142603 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b41125b0 con 0x561210655ab0 2024-02-21T07:55:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.239+0000 7f479e600640 1 -- 172.21.15.100:0/3202142603 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4116700 con 0x561210655ab0 2024-02-21T07:55:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.239+0000 7f479e600640 1 -- 172.21.15.100:0/3202142603 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b411ad50 con 0x561210655ab0 2024-02-21T07:55:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.240+0000 7f47bb81b740 1 -- 172.21.15.100:0/3202142603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 msgr2=0x5612106180c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.240+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f47b402d330 tx=0x7f47b4068da0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.242+0000 7f47bb81b740 1 -- 172.21.15.100:0/3202142603 shutdown_connections 2024-02-21T07:55:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.242+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655ab0 0x5612106180c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.242+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210655570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.242+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3202142603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655190 0x56121068ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.242+0000 7f47bb81b740 1 -- 172.21.15.100:0/3202142603 >> 172.21.15.100:0/3202142603 conn(0x5612105e45a0 msgr2=0x56121061c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.244+0000 7f47bb81b740 1 -- 172.21.15.100:0/3202142603 shutdown_connections 2024-02-21T07:55:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.244+0000 7f47bb81b740 1 -- 172.21.15.100:0/3202142603 wait complete. 2024-02-21T07:55:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.246+0000 7f47bb81b740 1 -- start start 2024-02-21T07:55:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.246+0000 7f47bb81b740 1 Processor -- start 2024-02-21T07:55:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.248+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655190 0x561210623960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.248+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.248+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210654240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.249+0000 7f47bb81b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210529ec0 con 0x56121068b150 2024-02-21T07:55:11.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210654240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47bb81b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210529b60 con 0x561210655190 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47bb81b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612102f31c0 con 0x561210655ab0 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47bb81b740 10 client.0 _ll_register_callbacks cb 0x56121053d960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655190 0x561210623960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38880/0 (socket says 172.21.15.100:38880) 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 -- 172.21.15.100:0/2597198503 learned_addr learned my addr 172.21.15.100:0/2597198503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 -- 172.21.15.100:0/2597198503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655190 msgr2=0x561210623960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655190 0x561210623960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 -- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 msgr2=0x561210654240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210654240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.250+0000 7f47b1400640 1 -- 172.21.15.100:0/2597198503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac077a90 con 0x561210655ab0 2024-02-21T07:55:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.251+0000 7f47b1400640 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001ce0 tx=0x7f47a000e590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f183fcec5aab691 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.251+0000 7f4792a00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00052d0 con 0x561210655ab0 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f47a0005430 con 0x561210655ab0 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612102847e0 con 0x561210655ab0 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a00035f0 con 0x561210655ab0 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f47bb81b740 10 client.6923 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:11.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.252+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5612105834e0 con 0x561210655ab0 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5612102847e0 con 0x561210655ab0 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f47a0003750 con 0x561210655ab0 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 10 client.6923 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 10 client.6923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 20 client.6923 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56121064b230 0x561210654780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 4 client.6923 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:11.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.253+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612102c1720 con 0x56121064b230 2024-02-21T07:55:11.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.255+0000 7f47b1e00640 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56121064b230 0x561210654780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.261+0000 7f47b1e00640 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56121064b230 0x561210654780 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0266c45149fc6a server_cookie=3592a81e086cacec in_seq=0 out_seq=0 2024-02-21T07:55:11.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.262+0000 7f4792a00640 10 client.6923 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.263+0000 7f4792a00640 1 -- 172.21.15.100:0/2597198503 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5612102c1720 con 0x56121064b230 2024-02-21T07:55:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.263+0000 7f4792a00640 10 client.6923 handle_command_reply: tid=0 2024-02-21T07:55:11.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.263+0000 7f47bb81b740 1 client.6923 shutdown 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 msgr2=0x5612106a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001ce0 tx=0x7f47a000e590 comp rx=0 tx=0).stop 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 shutdown_connections 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56121064b230 0x561210654780 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56121068b150 0x561210654240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561210655ab0 0x5612106a00e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 --2- 172.21.15.100:0/2597198503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210655190 0x561210623960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.264+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 >> 172.21.15.100:0/2597198503 conn(0x5612105e45a0 msgr2=0x56121068a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.265+0000 7f4792a00640 0 client.6923 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.266+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 shutdown_connections 2024-02-21T07:55:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.266+0000 7f47bb81b740 1 -- 172.21.15.100:0/2597198503 wait complete. 2024-02-21T07:55:11.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.267+0000 7f47bb81b740 20 client.6923 trim_cache size 0 max 16384 2024-02-21T07:55:11.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.314+0000 7f47bb81b740 1 Processor -- start 2024-02-21T07:55:11.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.315+0000 7f47bb81b740 1 -- start start 2024-02-21T07:55:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x561210660b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x56121065e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x5612106ec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121068a790 con 0x561210655190 2024-02-21T07:55:11.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210661490 con 0x561210612f60 2024-02-21T07:55:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.317+0000 7f47bb81b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56121065e650 con 0x56121068b150 2024-02-21T07:55:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.318+0000 7f47b2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x5612106ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x561210660b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x561210660b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42692/0 (socket says 172.21.15.100:42692) 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1e00640 1 -- 172.21.15.100:0/231326407 learned_addr learned my addr 172.21.15.100:0/231326407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x56121065e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 -- 172.21.15.100:0/231326407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 msgr2=0x5612106ec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x5612106ec710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 -- 172.21.15.100:0/231326407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 msgr2=0x561210660b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x561210660b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.319+0000 7f47b1400640 1 -- 172.21.15.100:0/231326407 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56121051f950 con 0x56121068b150 2024-02-21T07:55:11.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.333+0000 7f47b1400640 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x56121065e110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009010 tx=0x7f47a000c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d815f8cbb4d32dd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.333+0000 7f479dc00640 1 -- 172.21.15.100:0/231326407 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0007d90 con 0x56121068b150 2024-02-21T07:55:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.334+0000 7f479dc00640 1 -- 172.21.15.100:0/231326407 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000d040 con 0x56121068b150 2024-02-21T07:55:11.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.334+0000 7f479dc00640 1 -- 172.21.15.100:0/231326407 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0003830 con 0x56121068b150 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 -- 172.21.15.100:0/231326407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 msgr2=0x56121065e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x56121065e110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009010 tx=0x7f47a000c000 comp rx=0 tx=0).stop 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 -- 172.21.15.100:0/231326407 shutdown_connections 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x5612106ec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x56121065e110 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 --2- 172.21.15.100:0/231326407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x561210660b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.336+0000 7f47bb81b740 1 -- 172.21.15.100:0/231326407 >> 172.21.15.100:0/231326407 conn(0x5612105e45a0 msgr2=0x56121061b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.340+0000 7f47bb81b740 1 -- 172.21.15.100:0/231326407 shutdown_connections 2024-02-21T07:55:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.340+0000 7f47bb81b740 1 -- 172.21.15.100:0/231326407 wait complete. 2024-02-21T07:55:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.341+0000 7f47bb81b740 1 -- start start 2024-02-21T07:55:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.341+0000 7f47bb81b740 1 Processor -- start 2024-02-21T07:55:11.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.351+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.351+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x5612106e8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.353+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.353+0000 7f47b1e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34480/0 (socket says 172.21.15.100:34480) 2024-02-21T07:55:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.355+0000 7f47bb81b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x5612106e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.356+0000 7f47b1e00640 1 -- 172.21.15.100:0/3779189959 learned_addr learned my addr 172.21.15.100:0/3779189959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.356+0000 7f47b2800640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x5612106e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.356+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612106f88d0 con 0x561210655190 2024-02-21T07:55:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.357+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561210660d00 con 0x561210612f60 2024-02-21T07:55:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.357+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612106e95d0 con 0x56121068b150 2024-02-21T07:55:11.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.358+0000 7f47b1400640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x5612106e8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.359+0000 7f47bb81b740 10 client.0 _ll_register_callbacks cb 0x5612106907d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.359+0000 7f47b1e00640 1 -- 172.21.15.100:0/3779189959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 msgr2=0x5612106e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.359+0000 7f47b1e00640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x5612106e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.360+0000 7f47b1e00640 1 -- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 msgr2=0x5612106e8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.360+0000 7f47b1e00640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x5612106e8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.360+0000 7f47b1e00640 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612105834e0 con 0x561210612f60 2024-02-21T07:55:11.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.361+0000 7f47b1e00640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006da0 tx=0x7f47a4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf5e387028210592 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.361+0000 7f4792a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:11.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.361+0000 7f4792a00640 1 -- 172.21.15.100:0/3779189959 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a4030d30 con 0x561210612f60 2024-02-21T07:55:11.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.363+0000 7f4792a00640 1 -- 172.21.15.100:0/3779189959 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f47a403e040 con 0x561210612f60 2024-02-21T07:55:11.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.363+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47b4116700 con 0x561210612f60 2024-02-21T07:55:11.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.370+0000 7f4792a00640 1 -- 172.21.15.100:0/3779189959 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a4030e90 con 0x561210612f60 2024-02-21T07:55:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.372+0000 7f47bb81b740 10 client.6988 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:11.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.373+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x561210545430 con 0x561210612f60 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f4792a00640 1 -- 172.21.15.100:0/3779189959 <== mon.1 v2:172.21.15.156:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f47a4042050 con 0x561210612f60 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 10 client.6988 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 10 client.6988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 20 client.6988 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561210619d10 0x5612106fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 4 client.6988 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:55:11.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.374+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561210310890 con 0x561210619d10 2024-02-21T07:55:11.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.380+0000 7f47b1400640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561210619d10 0x5612106fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.382+0000 7f47b1400640 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561210619d10 0x5612106fbd40 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662da2ce63822a99 server_cookie=e8e9345ba937b5fe in_seq=0 out_seq=0 2024-02-21T07:55:11.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.382+0000 7f4792a00640 10 client.6988 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:11.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.384+0000 7f4792a00640 1 -- 172.21.15.100:0/3779189959 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561210310890 con 0x561210619d10 2024-02-21T07:55:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.386+0000 7f4792a00640 10 client.6988 handle_command_reply: tid=0 2024-02-21T07:55:11.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.386+0000 7f47bb81b740 1 client.6988 shutdown 2024-02-21T07:55:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.387+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 msgr2=0x561210651030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.387+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006da0 tx=0x7f47a4004730 comp rx=0 tx=0).stop 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 shutdown_connections 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561210619d10 0x5612106fbd40 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56121068b150 0x5612106e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561210655190 0x5612106e8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 --2- 172.21.15.100:0/3779189959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561210612f60 0x561210651030 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 >> 172.21.15.100:0/3779189959 conn(0x5612105e45a0 msgr2=0x5612106a0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f4792a00640 0 client.6988 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:11.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.389+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 shutdown_connections 2024-02-21T07:55:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.390+0000 7f47bb81b740 1 -- 172.21.15.100:0/3779189959 wait complete. 2024-02-21T07:55:11.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.393+0000 7f47bb81b740 20 client.6988 trim_cache size 0 max 16384 2024-02-21T07:55:11.396 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:11.396 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:55:11.396 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:55:11.396 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.406+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 msgr2=0x7f47940a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.406+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 0x7f47940a1660 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f47a402b9a0 tx=0x7f47a4008030 comp rx=0 tx=0).stop 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.406+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 msgr2=0x7f47ac074900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.406+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 0x7f47ac074900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f47b404fc90 tx=0x7f47b4068050 comp rx=0 tx=0).stop 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 shutdown_connections 2024-02-21T07:55:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47ac074450 0x7f47ac074900 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47ac0e5d70 0x7f47ac075db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f479409f1a0 0x7f47940a1660 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 --2- 172.21.15.100:0/1021698040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47ac006460 0x7f47ac0e4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.407+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 >> 172.21.15.100:0/1021698040 conn(0x7f47ac052e10 msgr2=0x7f47ac052380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.408+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 shutdown_connections 2024-02-21T07:55:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.408+0000 7f47b8a00640 1 -- 172.21.15.100:0/1021698040 wait complete. 2024-02-21T07:55:11.453 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:55:11.453 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:55:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.828+0000 7f7b29400640 1 Processor -- start 2024-02-21T07:55:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.828+0000 7f7b29400640 1 -- start start 2024-02-21T07:55:11.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.831+0000 7f7b29400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b240cec50 0x7f7b24188920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.831+0000 7f7b29400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.832+0000 7f7b21e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f7b24182030 0x7f7b24182c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:51284/0 (socket says 172.21.15.100:51284) 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.832+0000 7f7b22800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b240cec50 0x7f7b24188920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.832+0000 7f7b22800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7b240cec50 0x7f7b24188920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34490/0 (socket says 172.21.15.100:34490) 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b23200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b23200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42706/0 (socket says 172.21.15.100:42706) 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b29400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b241824a0 con 0x7f7b24182030 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b29400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b241857a0 con 0x7f7b24183380 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b29400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240f81f0 con 0x7f7b240cec50 2024-02-21T07:55:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b21e00640 1 -- 172.21.15.100:0/1577079196 learned_addr learned my addr 172.21.15.100:0/1577079196 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b22800640 1 -- 172.21.15.100:0/1577079196 >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 msgr2=0x7f7b24070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b22800640 1 --2- 172.21.15.100:0/1577079196 >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.833+0000 7f7b22800640 1 -- 172.21.15.100:0/1577079196 >> v1:172.21.15.156:6789/0 conn(0x7f7b24182030 legacy=0x7f7b24182c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.834+0000 7f7b22800640 1 -- 172.21.15.100:0/1577079196 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240f84d0 con 0x7f7b240cec50 2024-02-21T07:55:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.834+0000 7f7b23200640 1 --2- 172.21.15.100:0/1577079196 >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:11.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.839+0000 7f7b22800640 1 --2- 172.21.15.100:0/1577079196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24188920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b2408d470 tx=0x7f7b1402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3d7b34b5d2ce73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.842+0000 7f7b21400640 1 -- 172.21.15.100:0/1577079196 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402e070 con 0x7f7b240cec50 2024-02-21T07:55:11.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.842+0000 7f7b21400640 1 -- 172.21.15.100:0/1577079196 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b140315a0 con 0x7f7b240cec50 2024-02-21T07:55:11.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.842+0000 7f7b21400640 1 -- 172.21.15.100:0/1577079196 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14031930 con 0x7f7b240cec50 2024-02-21T07:55:11.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.843+0000 7f7b29400640 1 -- 172.21.15.100:0/1577079196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 msgr2=0x7f7b24188920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.843+0000 7f7b29400640 1 --2- 172.21.15.100:0/1577079196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24188920 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7b2408d470 tx=0x7f7b1402b840 comp rx=0 tx=0).stop 2024-02-21T07:55:11.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.845+0000 7f7b29400640 1 -- 172.21.15.100:0/1577079196 shutdown_connections 2024-02-21T07:55:11.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.845+0000 7f7b29400640 1 --2- 172.21.15.100:0/1577079196 >> v2:172.21.15.100:3300/0 conn(0x7f7b24183380 0x7f7b24070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.845+0000 7f7b29400640 1 --2- 172.21.15.100:0/1577079196 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24188920 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.845+0000 7f7b29400640 1 -- 172.21.15.100:0/1577079196 >> 172.21.15.100:0/1577079196 conn(0x7f7b240ce160 msgr2=0x7f7b240ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:11.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.846+0000 7f7b29400640 1 -- 172.21.15.100:0/1577079196 shutdown_connections 2024-02-21T07:55:11.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.847+0000 7f7b29400640 1 -- 172.21.15.100:0/1577079196 wait complete. 2024-02-21T07:55:11.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.850+0000 7f7b29400640 1 Processor -- start 2024-02-21T07:55:11.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.851+0000 7f7b29400640 1 -- start start 2024-02-21T07:55:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.859+0000 7f7b29400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b29400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 0x7f7b2416b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b29400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 0x7f7b2416d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b29400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2416cce0 con 0x7f7b24183380 2024-02-21T07:55:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b22800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b29400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24072280 con 0x7f7b240cec50 2024-02-21T07:55:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b29400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24071470 con 0x7f7b24182030 2024-02-21T07:55:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.862+0000 7f7b21e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 0x7f7b2416b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.864+0000 7f7b21e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 0x7f7b2416b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-02-21T07:55:11.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.864+0000 7f7b21e00640 1 -- 172.21.15.100:0/3621911837 learned_addr learned my addr 172.21.15.100:0/3621911837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:11.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.864+0000 7f7b23200640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 0x7f7b2416d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.867+0000 7f7b23200640 1 -- 172.21.15.100:0/3621911837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 msgr2=0x7f7b2416b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.867+0000 7f7b23200640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 0x7f7b2416b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.867+0000 7f7b23200640 1 -- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 msgr2=0x7f7b24070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.867+0000 7f7b23200640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.867+0000 7f7b23200640 1 -- 172.21.15.100:0/3621911837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c009a70 con 0x7f7b24183380 2024-02-21T07:55:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.871+0000 7f7b23200640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 0x7f7b2416d100 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00efc0 tx=0x7f7b1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.871+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00cd30 con 0x7f7b24183380 2024-02-21T07:55:11.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.872+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00f040 con 0x7f7b24183380 2024-02-21T07:55:11.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.872+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c003bd0 con 0x7f7b24183380 2024-02-21T07:55:11.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.872+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b14009400 con 0x7f7b24183380 2024-02-21T07:55:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.872+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b240719e0 con 0x7f7b24183380 2024-02-21T07:55:11.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.881+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7b1c014480 con 0x7f7b24183380 2024-02-21T07:55:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.884+0000 7f7b1aa00640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 0x7f7b000a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.885+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7b1c0ca550 con 0x7f7b24183380 2024-02-21T07:55:11.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.885+0000 7f7b22800640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 0x7f7b000a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:11.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.887+0000 7f7b22800640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 0x7f7b000a16b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b14036000 tx=0x7f7b1403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.906+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7afc005290 con 0x7f7b24183380 2024-02-21T07:55:11.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:11.928+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7b1c0942d0 con 0x7f7b24183380 2024-02-21T07:55:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.293+0000 7feb01800640 1 Processor -- start 2024-02-21T07:55:12.296 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.293+0000 7feb01800640 1 -- start start 2024-02-21T07:55:12.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.301+0000 7feb01800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feafc186b60 0x7feafc18bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.303 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.301+0000 7feb01800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc186f40 con 0x7feafc18c260 2024-02-21T07:55:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.301+0000 7feb01800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc18a9a0 con 0x7feafc0d1ab0 2024-02-21T07:55:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.301+0000 7feb01800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc0f4660 con 0x7feafc186b60 2024-02-21T07:55:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.302+0000 7feafb400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7feafc0d1ab0 0x7feafc18df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37494/0 (socket says 172.21.15.100:37494) 2024-02-21T07:55:12.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.302+0000 7feafb400640 1 -- 172.21.15.100:0/3528312215 learned_addr learned my addr 172.21.15.100:0/3528312215 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.303+0000 7feafaa00640 1 --2- 172.21.15.100:0/3528312215 >> v2:172.21.15.156:3300/0 conn(0x7feafc186b60 0x7feafc18bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.303+0000 7feaf9600640 1 -- 172.21.15.100:0/3528312215 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517436335 0 0) 0x7feafc186f40 con 0x7feafc18c260 2024-02-21T07:55:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.303+0000 7feaf9600640 1 -- 172.21.15.100:0/3528312215 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae0003520 con 0x7feafc18c260 2024-02-21T07:55:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.303+0000 7feafaa00640 1 -- 172.21.15.100:0/3528312215 >> v1:172.21.15.170:6789/0 conn(0x7feafc0d1ab0 legacy=0x7feafc18df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.304+0000 7feafaa00640 1 -- 172.21.15.100:0/3528312215 >> v1:172.21.15.100:6789/0 conn(0x7feafc18c260 legacy=0x7feafc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.304+0000 7feafaa00640 1 -- 172.21.15.100:0/3528312215 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc18ac80 con 0x7feafc186b60 2024-02-21T07:55:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.307+0000 7feafaa00640 1 --2- 172.21.15.100:0/3528312215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc186b60 0x7feafc18bd20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feae80097a0 tx=0x7feae802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43729cc5a55bad5f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.308+0000 7feaf9600640 1 -- 172.21.15.100:0/3528312215 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae802f050 con 0x7feafc186b60 2024-02-21T07:55:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.308+0000 7feaf9600640 1 -- 172.21.15.100:0/3528312215 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8031700 con 0x7feafc186b60 2024-02-21T07:55:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.308+0000 7feaf9600640 1 -- 172.21.15.100:0/3528312215 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8031a90 con 0x7feafc186b60 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 -- 172.21.15.100:0/3528312215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc186b60 msgr2=0x7feafc18bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 --2- 172.21.15.100:0/3528312215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc186b60 0x7feafc18bd20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feae80097a0 tx=0x7feae802b7a0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 -- 172.21.15.100:0/3528312215 shutdown_connections 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 --2- 172.21.15.100:0/3528312215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc186b60 0x7feafc18bd20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 -- 172.21.15.100:0/3528312215 >> 172.21.15.100:0/3528312215 conn(0x7feafc0ce1b0 msgr2=0x7feafc0ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 -- 172.21.15.100:0/3528312215 shutdown_connections 2024-02-21T07:55:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.309+0000 7feb01800640 1 -- 172.21.15.100:0/3528312215 wait complete. 2024-02-21T07:55:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.311+0000 7feb01800640 1 Processor -- start 2024-02-21T07:55:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.311+0000 7feb01800640 1 -- start start 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feafc186b60 0x7feafc16be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feafc18c260 0x7feafc2254a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc223ed0 con 0x7feafc186b60 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc224120 con 0x7feafc0d1ab0 2024-02-21T07:55:12.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feb01800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc224400 con 0x7feafc18c260 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feafaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feafaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34516/0 (socket says 172.21.15.100:34516) 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feafaa00640 1 -- 172.21.15.100:0/3716239979 learned_addr learned my addr 172.21.15.100:0/3716239979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.313+0000 7feafa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feafc186b60 0x7feafc16be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.314+0000 7feafaa00640 1 -- 172.21.15.100:0/3716239979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feafc18c260 msgr2=0x7feafc2254a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:12.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.314+0000 7feafaa00640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feafc18c260 0x7feafc2254a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.314+0000 7feafaa00640 1 -- 172.21.15.100:0/3716239979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feafc186b60 msgr2=0x7feafc16be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.314+0000 7feafaa00640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feafc186b60 0x7feafc16be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.314+0000 7feafaa00640 1 -- 172.21.15.100:0/3716239979 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009400 con 0x7feafc0d1ab0 2024-02-21T07:55:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feafaa00640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7feae8036040 tx=0x7feae80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feaf2a00640 1 -- 172.21.15.100:0/3716239979 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8031500 con 0x7feafc0d1ab0 2024-02-21T07:55:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feaf2a00640 1 -- 172.21.15.100:0/3716239979 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80339b0 con 0x7feafc0d1ab0 2024-02-21T07:55:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feaf2a00640 1 -- 172.21.15.100:0/3716239979 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae8033d60 con 0x7feafc0d1ab0 2024-02-21T07:55:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc2246e0 con 0x7feafc0d1ab0 2024-02-21T07:55:12.318 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.315+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc224ca0 con 0x7feafc0d1ab0 2024-02-21T07:55:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.320+0000 7feaf2a00640 1 -- 172.21.15.100:0/3716239979 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feae803a040 con 0x7feafc0d1ab0 2024-02-21T07:55:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.322+0000 7feaf2a00640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 0x7feadc0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.322+0000 7feb04638740 1 Processor -- start 2024-02-21T07:55:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.322+0000 7feaf2a00640 1 -- 172.21.15.100:0/3716239979 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feae80ead40 con 0x7feafc0d1ab0 2024-02-21T07:55:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.324+0000 7feafa000640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 0x7feadc0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.325+0000 7feb04638740 1 -- start start 2024-02-21T07:55:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.325+0000 7feafa000640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 0x7feadc0a15e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feafc175a10 tx=0x7feaf4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.326+0000 7feb04638740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfb7070 0x56321df76440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feb04638740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feb04638740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 0x56321dfb7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feafa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feafaa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfb7070 0x56321df76440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feafa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42722/0 (socket says 172.21.15.100:42722) 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feafa000640 1 -- 172.21.15.100:0/1002726144 learned_addr learned my addr 172.21.15.100:0/1002726144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321df37620 con 0x56321dfeb4d0 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dee98c0 con 0x56321dfb7070 2024-02-21T07:55:12.330 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dee6df0 con 0x56321df7bf90 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.327+0000 7feafb400640 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 0x56321dfb7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 -- 172.21.15.100:0/1002726144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 msgr2=0x56321dfb7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 0x56321dfb7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 -- 172.21.15.100:0/1002726144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfb7070 msgr2=0x56321df76440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfb7070 0x56321df76440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 -- 172.21.15.100:0/1002726144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56321de63b00 con 0x56321dfeb4d0 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafb400640 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 0x56321dfb7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.331 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.328+0000 7feafa000640 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7feaf400fd60 tx=0x7feaf4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d4d6f6418964a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.333 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.332+0000 7feae7400640 1 -- 172.21.15.100:0/1002726144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4020410 con 0x56321dfeb4d0 2024-02-21T07:55:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.332+0000 7feae7400640 1 -- 172.21.15.100:0/1002726144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4020570 con 0x56321dfeb4d0 2024-02-21T07:55:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.332+0000 7feae7400640 1 -- 172.21.15.100:0/1002726144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf40208e0 con 0x56321dfeb4d0 2024-02-21T07:55:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 msgr2=0x56321df7ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.334 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7feaf400fd60 tx=0x7feaf4012000 comp rx=0 tx=0).stop 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 shutdown_connections 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321df7bf90 0x56321dfb7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfeb4d0 0x56321df7ba50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 --2- 172.21.15.100:0/1002726144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfb7070 0x56321df76440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 >> 172.21.15.100:0/1002726144 conn(0x56321df434b0 msgr2=0x56321df7aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 shutdown_connections 2024-02-21T07:55:12.335 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.333+0000 7feb04638740 1 -- 172.21.15.100:0/1002726144 wait complete. 2024-02-21T07:55:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.334+0000 7feb04638740 1 -- start start 2024-02-21T07:55:12.336 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.334+0000 7feb04638740 1 Processor -- start 2024-02-21T07:55:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 0x56321dfb9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.338 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 0x56321dfaf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dee25d0 con 0x56321df7bf90 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321de87b50 con 0x56321dfeb4d0 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321de877f0 con 0x56321dfb7070 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feb04638740 10 client.0 _ll_register_callbacks cb 0x56321de9b550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38940/0 (socket says 172.21.15.100:38940) 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 -- 172.21.15.100:0/3337839218 learned_addr learned my addr 172.21.15.100:0/3337839218 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafaa00640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 0x56321dfb9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafb400640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 0x56321dfaf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 -- 172.21.15.100:0/3337839218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 msgr2=0x56321dfaf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 0x56321dfaf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 -- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 msgr2=0x56321dfb9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.339 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 0x56321dfb9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafa000640 1 -- 172.21.15.100:0/3337839218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4001c00 con 0x56321dfb7070 2024-02-21T07:55:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafb400640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 0x56321dfaf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.336+0000 7feafaa00640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 0x56321dfb9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feafa000640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feaf40012e0 tx=0x7feaf4001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ad314d5e4af3dae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.340 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feadbe00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:12.341 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4030070 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feaf401c040 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56321deb4cd0 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaf4020d20 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feb04638740 10 client.6941 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.337+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56321dee0c50 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56321deb4cd0 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feaf4033020 con 0x56321dfb7070 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 10 client.6941 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 10 client.6941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 20 client.6941 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dfe1790 0x56321dffe5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 4 client.6941 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56321ded8ce0 con 0x56321dfe1790 2024-02-21T07:55:12.342 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.338+0000 7feafaa00640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dfe1790 0x56321dffe5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.339+0000 7feafaa00640 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dfe1790 0x56321dffe5f0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84775fe2e094f264 server_cookie=5e32b16d2b73b960 in_seq=0 out_seq=0 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.339+0000 7feadbe00640 10 client.6941 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.339+0000 7feadbe00640 1 -- 172.21.15.100:0/3337839218 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56321ded8ce0 con 0x56321dfe1790 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.339+0000 7feadbe00640 10 client.6941 handle_command_reply: tid=0 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.339+0000 7feb04638740 1 client.6941 shutdown 2024-02-21T07:55:12.343 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 msgr2=0x56321dfaedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7feaf40012e0 tx=0x7feaf4001250 comp rx=0 tx=0).stop 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 shutdown_connections 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dfe1790 0x56321dffe5f0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321dfeb4d0 0x56321dfaf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfb7070 0x56321dfaedb0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 --2- 172.21.15.100:0/3337839218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321df7bf90 0x56321dfb9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 >> 172.21.15.100:0/3337839218 conn(0x56321df434b0 msgr2=0x56321dfeb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.340+0000 7feadbe00640 0 client.6941 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.341+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 shutdown_connections 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.341+0000 7feb04638740 1 -- 172.21.15.100:0/3337839218 wait complete. 2024-02-21T07:55:12.344 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.341+0000 7feb04638740 20 client.6941 trim_cache size 0 max 16384 2024-02-21T07:55:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.379+0000 7feb04638740 1 Processor -- start 2024-02-21T07:55:12.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.379+0000 7feb04638740 1 -- start start 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321df71bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dc2ae60 con 0x56321dfb7070 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dfba480 con 0x56321df7bf90 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.381+0000 7feb04638740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dfb4730 con 0x56321dfeb4d0 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38946/0 (socket says 172.21.15.100:38946) 2024-02-21T07:55:12.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 -- 172.21.15.100:0/3224561689 learned_addr learned my addr 172.21.15.100:0/3224561689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafaa00640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafa000640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321df71bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 -- 172.21.15.100:0/3224561689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 msgr2=0x56321dfb9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 -- 172.21.15.100:0/3224561689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 msgr2=0x56321df71bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321df71bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafb400640 1 -- 172.21.15.100:0/3224561689 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56321de7d530 con 0x56321dfeb4d0 2024-02-21T07:55:12.385 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.382+0000 7feafa000640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321df71bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:12.386 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.383+0000 7feafb400640 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x56321dfe5350 tx=0x7feaec007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c863083299f187d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.383+0000 7feae6a00640 1 -- 172.21.15.100:0/3224561689 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec013600 con 0x56321dfeb4d0 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.383+0000 7feae6a00640 1 -- 172.21.15.100:0/3224561689 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec013780 con 0x56321dfeb4d0 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.383+0000 7feae6a00640 1 -- 172.21.15.100:0/3224561689 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec013b30 con 0x56321dfeb4d0 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 -- 172.21.15.100:0/3224561689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 msgr2=0x56321dfb7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x56321dfe5350 tx=0x7feaec007d80 comp rx=0 tx=0).stop 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 -- 172.21.15.100:0/3224561689 shutdown_connections 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfb7870 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321df71bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 --2- 172.21.15.100:0/3224561689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 -- 172.21.15.100:0/3224561689 >> 172.21.15.100:0/3224561689 conn(0x56321df434b0 msgr2=0x56321dfafe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 -- 172.21.15.100:0/3224561689 shutdown_connections 2024-02-21T07:55:12.387 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.384+0000 7feb04638740 1 -- 172.21.15.100:0/3224561689 wait complete. 2024-02-21T07:55:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.386+0000 7feb04638740 1 -- start start 2024-02-21T07:55:12.388 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.386+0000 7feb04638740 1 Processor -- start 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321dfeaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfda730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dfaa5f0 con 0x56321dfb7070 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dfea6c0 con 0x56321df7bf90 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56321dfdac70 con 0x56321dfeb4d0 2024-02-21T07:55:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.388+0000 7feb04638740 10 client.0 _ll_register_callbacks cb 0x7feaf4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.389+0000 7feafb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfda730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.390+0000 7feafb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfda730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38960/0 (socket says 172.21.15.100:38960) 2024-02-21T07:55:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.390+0000 7feafb400640 1 -- 172.21.15.100:0/2261748602 learned_addr learned my addr 172.21.15.100:0/2261748602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.390+0000 7feafa000640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321dfeaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafaa00640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafa000640 1 -- 172.21.15.100:0/2261748602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 msgr2=0x56321dfda730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafa000640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfda730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafa000640 1 -- 172.21.15.100:0/2261748602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 msgr2=0x56321dfb0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafa000640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.391+0000 7feafa000640 1 -- 172.21.15.100:0/2261748602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec004a70 con 0x56321dfb7070 2024-02-21T07:55:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.396+0000 7feafa000640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321dfeaa80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x56321dffc580 tx=0x7feaf400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71f8b2993573f86 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.396+0000 7feadbe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.404+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4030030 con 0x56321dfb7070 2024-02-21T07:55:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.404+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feaf4031070 con 0x56321dfb7070 2024-02-21T07:55:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.404+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56321df07d30 con 0x56321dfb7070 2024-02-21T07:55:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.405+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaf402c840 con 0x56321dfb7070 2024-02-21T07:55:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.406+0000 7feb04638740 10 client.6843 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.406+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56321dea32c0 con 0x56321dfb7070 2024-02-21T07:55:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.406+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4044030 con 0x56321dfb7070 2024-02-21T07:55:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.406+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feaf4020d20 con 0x56321dfb7070 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 10 client.6843 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 10 client.6843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 20 client.6843 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dffdbc0 0x56321e052120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 4 client.6843 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56321dbe2600 con 0x56321dffdbc0 2024-02-21T07:55:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.407+0000 7feafaa00640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dffdbc0 0x56321e052120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.408+0000 7feafaa00640 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dffdbc0 0x56321e052120 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6951fca9e5ffbb6b server_cookie=1611024495140d96 in_seq=0 out_seq=0 2024-02-21T07:55:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.408+0000 7feadbe00640 10 client.6843 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:12.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.421+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7afc005ac0 con 0x7f7b24183380 2024-02-21T07:55:12.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.424+0000 7f7b1aa00640 1 -- 172.21.15.100:0/3621911837 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f7b1c018020 con 0x7f7b24183380 2024-02-21T07:55:12.426 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:55:12.426 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:55:12.426 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 msgr2=0x7f7b000a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 0x7f7b000a16b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7b14036000 tx=0x7f7b1403d040 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 msgr2=0x7f7b2416d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 0x7f7b2416d100 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00efc0 tx=0x7f7b1c00c490 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 shutdown_connections 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f7b0009f1f0 0x7f7b000a16b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b24183380 0x7f7b2416d100 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b24182030 0x7f7b2416b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 --2- 172.21.15.100:0/3621911837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b240cec50 0x7f7b24070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.427+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 >> 172.21.15.100:0/3621911837 conn(0x7f7b240ce160 msgr2=0x7f7b24186600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.428+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 shutdown_connections 2024-02-21T07:55:12.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.428+0000 7f7b29400640 1 -- 172.21.15.100:0/3621911837 wait complete. 2024-02-21T07:55:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.431+0000 7feadbe00640 1 -- 172.21.15.100:0/2261748602 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56321dbe2600 con 0x56321dffdbc0 2024-02-21T07:55:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.431+0000 7feadbe00640 10 client.6843 handle_command_reply: tid=0 2024-02-21T07:55:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.431+0000 7feb04638740 1 client.6843 shutdown 2024-02-21T07:55:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 msgr2=0x56321dfeaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321dfeaa80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x56321dffc580 tx=0x7feaf400a000 comp rx=0 tx=0).stop 2024-02-21T07:55:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 shutdown_connections 2024-02-21T07:55:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56321dffdbc0 0x56321e052120 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56321dfeb4d0 0x56321dfda730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56321dfb7070 0x56321dfeaa80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 --2- 172.21.15.100:0/2261748602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56321df7bf90 0x56321dfb0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 >> 172.21.15.100:0/2261748602 conn(0x56321df434b0 msgr2=0x56321df71bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feadbe00640 0 client.6843 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 shutdown_connections 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.432+0000 7feb04638740 1 -- 172.21.15.100:0/2261748602 wait complete. 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.433+0000 7feb04638740 20 client.6843 trim_cache size 0 max 16384 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:55:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:55:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:55:12.436 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:55:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.435+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 msgr2=0x7feadc0a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.435+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 0x7feadc0a15e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feafc175a10 tx=0x7feaf4009040 comp rx=0 tx=0).stop 2024-02-21T07:55:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.436+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 msgr2=0x7feafc0f3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.436+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7feae8036040 tx=0x7feae80046c0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 shutdown_connections 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feafc18c260 0x7feafc2254a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feadc09f120 0x7feadc0a15e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feafc186b60 0x7feafc16be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 --2- 172.21.15.100:0/3716239979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feafc0d1ab0 0x7feafc0f3590 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.437+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 >> 172.21.15.100:0/3716239979 conn(0x7feafc0ce1b0 msgr2=0x7feafc0d13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.439+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 shutdown_connections 2024-02-21T07:55:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:12.439+0000 7feb01800640 1 -- 172.21.15.100:0/3716239979 wait complete. 2024-02-21T07:55:12.453 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:12.453 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:55:12.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.849+0000 7f4c9ac00640 1 Processor -- start 2024-02-21T07:55:12.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.849+0000 7f4c9ac00640 1 -- start start 2024-02-21T07:55:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.852+0000 7f4c9ac00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4c9415cd30 0x7f4c9415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.852+0000 7f4c9ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940f5230 con 0x7f4c940f56c0 2024-02-21T07:55:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.852+0000 7f4c9ac00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940706e0 con 0x7f4c9415c950 2024-02-21T07:55:12.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.852+0000 7f4c9ac00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940709c0 con 0x7f4c9415cd30 2024-02-21T07:55:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.854+0000 7f4c93e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f4c9415c950 0x7f4c94188a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37498/0 (socket says 172.21.15.100:37498) 2024-02-21T07:55:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.854+0000 7f4c93e00640 1 -- 172.21.15.100:0/2286535001 learned_addr learned my addr 172.21.15.100:0/2286535001 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.854+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650994535 0 0) 0x7f4c940706e0 con 0x7f4c9415c950 2024-02-21T07:55:12.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.854+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c78003520 con 0x7f4c9415c950 2024-02-21T07:55:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.856+0000 7f4c93400640 1 --2- 172.21.15.100:0/2286535001 >> v2:172.21.15.156:3300/0 conn(0x7f4c9415cd30 0x7f4c9415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.856+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440246808 0 0) 0x7f4c940f5230 con 0x7f4c940f56c0 2024-02-21T07:55:12.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.856+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c940706e0 con 0x7f4c940f56c0 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1829130600 0 0) 0x7f4c940706e0 con 0x7f4c940f56c0 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 >> v2:172.21.15.156:3300/0 conn(0x7f4c9415cd30 msgr2=0x7f4c9415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 --2- 172.21.15.100:0/2286535001 >> v2:172.21.15.156:3300/0 conn(0x7f4c9415cd30 0x7f4c9415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 >> v1:172.21.15.170:6789/0 conn(0x7f4c9415c950 legacy=0x7f4c94188a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940f4900 con 0x7f4c940f56c0 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f4c84001670 con 0x7f4c940f56c0 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 >> v1:172.21.15.100:6789/0 conn(0x7f4c940f56c0 legacy=0x7f4c940f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c78003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c780047c0 0x7f4c78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c780052a0 0x7f4c7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940709c0 con 0x7f4c780052a0 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7800c260 con 0x7f4c78003ba0 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.857+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7800c420 con 0x7f4c780047c0 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c78003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 -- 172.21.15.100:0/2286535001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c780047c0 msgr2=0x7f4c78004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c780047c0 0x7f4c78004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 -- 172.21.15.100:0/2286535001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c780052a0 msgr2=0x7f4c7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c780052a0 0x7f4c7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c93e00640 1 -- 172.21.15.100:0/2286535001 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940706e0 con 0x7f4c78003ba0 2024-02-21T07:55:12.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.858+0000 7f4c98c00640 1 -- 172.21.15.100:0/2286535001 reap_dead start 2024-02-21T07:55:12.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.862+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c78003fa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c01d2f0 tx=0x7f4c780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed86bac49a885014 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.864+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c03dbd0 con 0x7f4c78003ba0 2024-02-21T07:55:12.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.864+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c03dd50 con 0x7f4c78003ba0 2024-02-21T07:55:12.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c92a00640 1 -- 172.21.15.100:0/2286535001 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c045680 con 0x7f4c78003ba0 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 -- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 msgr2=0x7f4c78003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c78003fa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c01d2f0 tx=0x7f4c780057f0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 -- 172.21.15.100:0/2286535001 shutdown_connections 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/2286535001 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c78003fa0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 -- 172.21.15.100:0/2286535001 >> 172.21.15.100:0/2286535001 conn(0x7f4c940668b0 msgr2=0x7f4c94066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.865+0000 7f4c9ac00640 1 -- 172.21.15.100:0/2286535001 shutdown_connections 2024-02-21T07:55:12.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.866+0000 7f4c9ac00640 1 -- 172.21.15.100:0/2286535001 wait complete. 2024-02-21T07:55:12.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.868+0000 7f4c9ac00640 1 Processor -- start 2024-02-21T07:55:12.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.868+0000 7f4c9ac00640 1 -- start start 2024-02-21T07:55:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c94174e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 0x7f4c940f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94185d60 con 0x7f4c941753c0 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940f8630 con 0x7f4c78003ba0 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.869+0000 7f4c9ac00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9421bce0 con 0x7f4c94175840 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.870+0000 7f4c98c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.870+0000 7f4c98c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:38966/0 (socket says 172.21.15.100:38966) 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.870+0000 7f4c98c00640 1 -- 172.21.15.100:0/280675844 learned_addr learned my addr 172.21.15.100:0/280675844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.870+0000 7f4c93400640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 0x7f4c940f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 -- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 msgr2=0x7f4c94174e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c94174e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 -- 172.21.15.100:0/280675844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 msgr2=0x7f4c940f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 0x7f4c940f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 -- 172.21.15.100:0/280675844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94182130 con 0x7f4c94175840 2024-02-21T07:55:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c93400640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 0x7f4c940f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.871+0000 7f4c98c00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c9408dbe0 tx=0x7f4c8400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.872+0000 7f4c8be00640 1 -- 172.21.15.100:0/280675844 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84007480 con 0x7f4c94175840 2024-02-21T07:55:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.872+0000 7f4c8be00640 1 -- 172.21.15.100:0/280675844 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84007600 con 0x7f4c94175840 2024-02-21T07:55:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.872+0000 7f4c8be00640 1 -- 172.21.15.100:0/280675844 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84004260 con 0x7f4c94175840 2024-02-21T07:55:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.872+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c940f79b0 con 0x7f4c94175840 2024-02-21T07:55:12.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.872+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c940f7f70 con 0x7f4c94175840 2024-02-21T07:55:12.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.876+0000 7f4c8be00640 1 -- 172.21.15.100:0/280675844 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4c840057c0 con 0x7f4c94175840 2024-02-21T07:55:12.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.877+0000 7f4c9d978740 1 Processor -- start 2024-02-21T07:55:12.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.877+0000 7f4c9d978740 1 -- start start 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d26b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d26b590 0x55c90d26c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d163210 con 0x55c90d2307e0 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d160740 con 0x55c90d22fec0 2024-02-21T07:55:12.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c9d978740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d15bf20 con 0x55c90d26b590 2024-02-21T07:55:12.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c8be00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 0x7f4c740a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c93400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d26b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c93400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34572/0 (socket says 172.21.15.100:34572) 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c93400640 1 -- 172.21.15.100:0/2680174779 learned_addr learned my addr 172.21.15.100:0/2680174779 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c98c00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 0x7f4c740a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.878+0000 7f4c93400640 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d26b590 0x55c90d26c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 -- 172.21.15.100:0/2680174779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d26b590 msgr2=0x55c90d26c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d26b590 0x55c90d26c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 -- 172.21.15.100:0/2680174779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 msgr2=0x55c90d26b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d26b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 -- 172.21.15.100:0/2680174779 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90d11ddf0 con 0x55c90d22fec0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c8be00640 1 -- 172.21.15.100:0/280675844 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4c840c8fe0 con 0x7f4c94175840 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d26b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c98c00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 0x7f4c740a1630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c840c6a30 tx=0x7f4c840720d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c93400640 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c80017820 tx=0x7f4c80007820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed486081a051ef76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c7fe00640 1 -- 172.21.15.100:0/2680174779 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80004030 con 0x55c90d22fec0 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c7fe00640 1 -- 172.21.15.100:0/2680174779 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80004190 con 0x55c90d22fec0 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.879+0000 7f4c7fe00640 1 -- 172.21.15.100:0/2680174779 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80004500 con 0x55c90d22fec0 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 -- 172.21.15.100:0/2680174779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 msgr2=0x55c90d2302a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4c80017820 tx=0x7f4c80007820 comp rx=0 tx=0).stop 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 -- 172.21.15.100:0/2680174779 shutdown_connections 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d26b590 0x55c90d26c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d26b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2680174779 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d22fec0 0x55c90d2302a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 -- 172.21.15.100:0/2680174779 >> 172.21.15.100:0/2680174779 conn(0x55c90d1f2490 msgr2=0x55c90d1f3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 -- 172.21.15.100:0/2680174779 shutdown_connections 2024-02-21T07:55:12.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.880+0000 7f4c9d978740 1 -- 172.21.15.100:0/2680174779 wait complete. 2024-02-21T07:55:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.881+0000 7f4c9d978740 1 -- start start 2024-02-21T07:55:12.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.882+0000 7f4c9d978740 1 Processor -- start 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2307e0 0x55c90d25ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2729e0 0x55c90d224c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d101150 con 0x55c90d2729e0 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d100df0 con 0x55c90d26b590 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90ceca1c0 con 0x55c90d2307e0 2024-02-21T07:55:12.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c9d978740 10 client.0 _ll_register_callbacks cb 0x55c90d1502b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34574/0 (socket says 172.21.15.100:34574) 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c93e00640 1 -- 172.21.15.100:0/2558296124 learned_addr learned my addr 172.21.15.100:0/2558296124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c93400640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2729e0 0x55c90d224c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.884+0000 7f4c93400640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2307e0 0x55c90d25ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 -- 172.21.15.100:0/2558296124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2307e0 msgr2=0x55c90d25ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2307e0 0x55c90d25ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 -- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2729e0 msgr2=0x55c90d224c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2729e0 0x55c90d224c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 -- 172.21.15.100:0/2558296124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8000e040 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c93e00640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c01d410 tx=0x7f4c8c0016c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d03cb6f9c332385b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.885+0000 7f4c7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c004d70 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4c8c045670 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c90ce5b7e0 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c8c045830 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c9d978740 10 client.7024 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c90d15a5a0 con 0x55c90d26b590 2024-02-21T07:55:12.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.886+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c90ce5b7e0 con 0x55c90d26b590 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4c8c045990 con 0x55c90d26b590 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 10 client.7024 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 10 client.7024 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 20 client.7024 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d274cd0 0x55c90d2750b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 4 client.7024 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c90ce98720 con 0x55c90d274cd0 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.887+0000 7f4c93400640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d274cd0 0x55c90d2750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.888+0000 7f4c93400640 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d274cd0 0x55c90d2750b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7efe7c316f1f0551 server_cookie=249bde4fd7d19a54 in_seq=0 out_seq=0 2024-02-21T07:55:12.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.888+0000 7f4c7cc00640 10 client.7024 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.888+0000 7f4c7cc00640 1 -- 172.21.15.100:0/2558296124 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c90ce98720 con 0x55c90d274cd0 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.888+0000 7f4c7cc00640 10 client.7024 handle_command_reply: tid=0 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 client.7024 shutdown 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 msgr2=0x55c90d260a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c01d410 tx=0x7f4c8c0016c0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 shutdown_connections 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d274cd0 0x55c90d2750b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2729e0 0x55c90d224c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d260a20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 --2- 172.21.15.100:0/2558296124 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2307e0 0x55c90d25ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 >> 172.21.15.100:0/2558296124 conn(0x55c90d22fec0 msgr2=0x55c90d26b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c7cc00640 0 client.7024 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 shutdown_connections 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.889+0000 7f4c9d978740 1 -- 172.21.15.100:0/2558296124 wait complete. 2024-02-21T07:55:12.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.890+0000 7f4c9d978740 20 client.7024 trim_cache size 0 max 16384 2024-02-21T07:55:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.915+0000 7f4c9d978740 1 Processor -- start 2024-02-21T07:55:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.915+0000 7f4c9d978740 1 -- start start 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d2307e0 0x55c90d26b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d25f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d268da0 con 0x55c90d26b590 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d25de50 con 0x55c90d2307e0 2024-02-21T07:55:12.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.917+0000 7f4c9d978740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d2750b0 con 0x55c90d2729e0 2024-02-21T07:55:12.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.918+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.920+0000 7f4c93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42792/0 (socket says 172.21.15.100:42792) 2024-02-21T07:55:12.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.920+0000 7f4c93e00640 1 -- 172.21.15.100:0/3150036757 learned_addr learned my addr 172.21.15.100:0/3150036757 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d25f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d2307e0 0x55c90d26b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 -- 172.21.15.100:0/3150036757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d2307e0 msgr2=0x55c90d26b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d2307e0 0x55c90d26b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 -- 172.21.15.100:0/3150036757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 msgr2=0x55c90d1faff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.921+0000 7f4c93400640 1 -- 172.21.15.100:0/3150036757 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c90d0f6ab0 con 0x55c90d2729e0 2024-02-21T07:55:12.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.922+0000 7f4c93400640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d25f0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55c90d1f2210 tx=0x7f4c8000b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9084f0e1cddbe9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.922+0000 7f4c7f400640 1 -- 172.21.15.100:0/3150036757 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800106b0 con 0x55c90d2729e0 2024-02-21T07:55:12.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.923+0000 7f4c7f400640 1 -- 172.21.15.100:0/3150036757 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80010850 con 0x55c90d2729e0 2024-02-21T07:55:12.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.924+0000 7f4c93e00640 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.924+0000 7f4c9d978740 1 -- 172.21.15.100:0/3150036757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 msgr2=0x55c90d25f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.924+0000 7f4c9d978740 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d25f0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55c90d1f2210 tx=0x7f4c8000b000 comp rx=0 tx=0).stop 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 -- 172.21.15.100:0/3150036757 shutdown_connections 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d25f0c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d26b590 0x55c90d1faff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 --2- 172.21.15.100:0/3150036757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d2307e0 0x55c90d26b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 -- 172.21.15.100:0/3150036757 >> 172.21.15.100:0/3150036757 conn(0x55c90d22fec0 msgr2=0x55c90d260870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.925+0000 7f4c9d978740 1 -- 172.21.15.100:0/3150036757 shutdown_connections 2024-02-21T07:55:12.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.926+0000 7f4c9d978740 1 -- 172.21.15.100:0/3150036757 wait complete. 2024-02-21T07:55:12.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.927+0000 7f4c9d978740 1 -- start start 2024-02-21T07:55:12.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.927+0000 7f4c9d978740 1 Processor -- start 2024-02-21T07:55:12.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.931+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c93400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c93400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42806/0 (socket says 172.21.15.100:42806) 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d226540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d2d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d226b80 con 0x55c90d2307e0 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c93400640 1 -- 172.21.15.100:0/1357035136 learned_addr learned my addr 172.21.15.100:0/1357035136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:12.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d1f8c30 con 0x55c90d26b590 2024-02-21T07:55:12.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c90d1f3ca0 con 0x55c90d2729e0 2024-02-21T07:55:12.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.932+0000 7f4c9d978740 10 client.0 _ll_register_callbacks cb 0x7f4c80007b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d226540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 -- 172.21.15.100:0/1357035136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 msgr2=0x55c90d2d2b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d2d2b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 -- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 msgr2=0x55c90d269cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c90d15a5a0 con 0x55c90d26b590 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93400640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c93e00640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d226540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c006c30 tx=0x7f4c8c01a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fe20d1744417ec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.933+0000 7f4c7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:12.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0011c0 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4c8c03d6d0 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c80004190 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c8c045a80 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 10 client.7030 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f4c80032040 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c006110 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4c8c006280 con 0x55c90d26b590 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 10 client.7030 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 10 client.7030 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 20 client.7030 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d1f1d80 0x55c90d263550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 4 client.7030 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.934+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f4c80004190 con 0x55c90d1f1d80 2024-02-21T07:55:12.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.935+0000 7f4c93400640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d1f1d80 0x55c90d263550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:12.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c93400640 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d1f1d80 0x55c90d263550 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1941f8a98f50f90e server_cookie=f8b27738b69c72b7 in_seq=0 out_seq=0 2024-02-21T07:55:12.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c7cc00640 10 client.7030 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:12.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c7cc00640 1 -- 172.21.15.100:0/1357035136 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f4c80004190 con 0x55c90d1f1d80 2024-02-21T07:55:12.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c7cc00640 10 client.7030 handle_command_reply: tid=0 2024-02-21T07:55:12.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 client.7030 shutdown 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 msgr2=0x55c90d226540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d226540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c006c30 tx=0x7f4c8c01a030 comp rx=0 tx=0).stop 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 shutdown_connections 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55c90d1f1d80 0x55c90d263550 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c90d2729e0 0x55c90d2d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c90d26b590 0x55c90d226540 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 --2- 172.21.15.100:0/1357035136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c90d2307e0 0x55c90d269cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 >> 172.21.15.100:0/1357035136 conn(0x55c90d22fec0 msgr2=0x55c90d25f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c7cc00640 0 client.7030 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:12.941 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 shutdown_connections 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.936+0000 7f4c9d978740 1 -- 172.21.15.100:0/1357035136 wait complete. 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9d978740 20 client.7030 trim_cache size 0 max 16384 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 msgr2=0x7f4c740a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 0x7f4c740a1630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4c840c6a30 tx=0x7f4c840720d0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 msgr2=0x7f4c940f8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4c9408dbe0 tx=0x7f4c8400c890 comp rx=0 tx=0).stop 2024-02-21T07:55:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 shutdown_connections 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c94175840 0x7f4c940f8f90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c7409f170 0x7f4c740a1630 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c941753c0 0x7f4c940f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 --2- 172.21.15.100:0/280675844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c78003ba0 0x7f4c94174e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.937+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 >> 172.21.15.100:0/280675844 conn(0x7f4c940668b0 msgr2=0x7f4c94175cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.938+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 shutdown_connections 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:12.938+0000 7f4c9ac00640 1 -- 172.21.15.100:0/280675844 wait complete. 2024-02-21T07:55:12.955 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:12.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:55:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.326+0000 7fb8d6a00640 1 Processor -- start 2024-02-21T07:55:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.326+0000 7fb8d6a00640 1 -- start start 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.329+0000 7fb8d6a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb8d00ccc10 0x7fb8d0190820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.329+0000 7fb8d6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb8d0190d60 0x7fb8d008bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.329+0000 7fb8d6a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00fab80 con 0x7fb8d0190440 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.329+0000 7fb8d6a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d018de60 con 0x7fb8d0190d60 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.330+0000 7fb8d6a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d00d5ec0 con 0x7fb8d00ccc10 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.330+0000 7fb8cfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb8d0190440 0x7fb8d00cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34766/0 (socket says 172.21.15.100:34766) 2024-02-21T07:55:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.330+0000 7fb8cfe00640 1 -- 172.21.15.100:0/1074515247 learned_addr learned my addr 172.21.15.100:0/1074515247 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:13.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.331+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/1074515247 >> v2:172.21.15.100:3300/0 conn(0x7fb8d0190d60 0x7fb8d008bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.333+0000 7fb8d4a00640 1 -- 172.21.15.100:0/1074515247 >> v2:172.21.15.156:3300/0 conn(0x7fb8d00ccc10 msgr2=0x7fb8d0190820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.333+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/1074515247 >> v2:172.21.15.156:3300/0 conn(0x7fb8d00ccc10 0x7fb8d0190820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.333+0000 7fb8d4a00640 1 -- 172.21.15.100:0/1074515247 >> v1:172.21.15.100:6789/0 conn(0x7fb8d0190440 legacy=0x7fb8d00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.333+0000 7fb8d4a00640 1 -- 172.21.15.100:0/1074515247 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00f9ae0 con 0x7fb8d0190d60 2024-02-21T07:55:13.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.335+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/1074515247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190d60 0x7fb8d008bfe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00ff390 tx=0x7fb8b802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a106313cb71f74c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.337+0000 7fb8cea00640 1 -- 172.21.15.100:0/1074515247 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8031750 con 0x7fb8d0190d60 2024-02-21T07:55:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.337+0000 7fb8cea00640 1 -- 172.21.15.100:0/1074515247 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b80318b0 con 0x7fb8d0190d60 2024-02-21T07:55:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.338+0000 7fb8cea00640 1 -- 172.21.15.100:0/1074515247 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8031c80 con 0x7fb8d0190d60 2024-02-21T07:55:13.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 -- 172.21.15.100:0/1074515247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190d60 msgr2=0x7fb8d008bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/1074515247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190d60 0x7fb8d008bfe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00ff390 tx=0x7fb8b802b7f0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 -- 172.21.15.100:0/1074515247 shutdown_connections 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/1074515247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190d60 0x7fb8d008bfe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/1074515247 >> v2:172.21.15.156:3300/0 conn(0x7fb8d00ccc10 0x7fb8d0190820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 -- 172.21.15.100:0/1074515247 >> 172.21.15.100:0/1074515247 conn(0x7fb8d00fe290 msgr2=0x7fb8d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 -- 172.21.15.100:0/1074515247 shutdown_connections 2024-02-21T07:55:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.339+0000 7fb8d6a00640 1 -- 172.21.15.100:0/1074515247 wait complete. 2024-02-21T07:55:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.344+0000 7fb8d6a00640 1 Processor -- start 2024-02-21T07:55:13.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.344+0000 7fb8d6a00640 1 -- start start 2024-02-21T07:55:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.347+0000 7fb8d6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d00ccc10 0x7fb8d00d5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.347+0000 7fb8d6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.348+0000 7fb8d6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8d0190d60 0x7fb8d0177c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.348+0000 7fb8d6a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d022d180 con 0x7fb8d0190440 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.348+0000 7fb8d6a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d022bf30 con 0x7fb8d0190d60 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.348+0000 7fb8d6a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d022c210 con 0x7fb8d00ccc10 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.349+0000 7fb8cf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.349+0000 7fb8cf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42820/0 (socket says 172.21.15.100:42820) 2024-02-21T07:55:13.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.349+0000 7fb8cf400640 1 -- 172.21.15.100:0/4035720445 learned_addr learned my addr 172.21.15.100:0/4035720445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 -- 172.21.15.100:0/4035720445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d00ccc10 msgr2=0x7fb8d00d5080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:13.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d00ccc10 0x7fb8d00d5080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 -- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8d0190d60 msgr2=0x7fb8d0177c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:13.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8d0190d60 0x7fb8d0177c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 -- 172.21.15.100:0/4035720445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009400 con 0x7fb8d0190440 2024-02-21T07:55:13.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.350+0000 7fb8cf400640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b3c0 tx=0x7fb8c000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.355+0000 7fb8c7e00640 1 -- 172.21.15.100:0/4035720445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011830 con 0x7fb8d0190440 2024-02-21T07:55:13.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.356+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d022c4f0 con 0x7fb8d0190440 2024-02-21T07:55:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.356+0000 7fb8c7e00640 1 -- 172.21.15.100:0/4035720445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0011990 con 0x7fb8d0190440 2024-02-21T07:55:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.358+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d022ce10 con 0x7fb8d0190440 2024-02-21T07:55:13.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.358+0000 7fb8c7e00640 1 -- 172.21.15.100:0/4035720445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011d40 con 0x7fb8d0190440 2024-02-21T07:55:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.373+0000 7fb8c7e00640 1 -- 172.21.15.100:0/4035720445 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb8c001b460 con 0x7fb8d0190440 2024-02-21T07:55:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.373+0000 7fb8d9619740 1 Processor -- start 2024-02-21T07:55:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.373+0000 7fb8d9619740 1 -- start start 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30789ec0 0x55cc3078a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307c5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307c6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc306bd210 con 0x55cc30789ec0 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc306ba740 con 0x55cc307c5590 2024-02-21T07:55:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.375+0000 7fb8d9619740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc306b5f20 con 0x55cc3078a7e0 2024-02-21T07:55:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.376+0000 7fb8c7e00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 0x7fb8ac0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.376+0000 7fb8c7e00640 1 -- 172.21.15.100:0/4035720445 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb8c00c9800 con 0x7fb8d0190440 2024-02-21T07:55:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.377+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 0x7fb8ac0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.379+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.379+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39002/0 (socket says 172.21.15.100:39002) 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.379+0000 7fb8cfe00640 1 -- 172.21.15.100:0/3903244040 learned_addr learned my addr 172.21.15.100:0/3903244040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.380+0000 7fb8cf400640 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.380+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 0x7fb8ac0a16b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8035000 tx=0x7fb8b8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.380+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30789ec0 0x55cc3078a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.381+0000 7fb8cf400640 1 -- 172.21.15.100:0/3903244040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 msgr2=0x55cc307c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.381+0000 7fb8cf400640 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.381+0000 7fb8cf400640 1 -- 172.21.15.100:0/3903244040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30789ec0 msgr2=0x55cc3078a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.381+0000 7fb8cf400640 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30789ec0 0x55cc3078a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.381+0000 7fb8cf400640 1 -- 172.21.15.100:0/3903244040 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc30677df0 con 0x55cc307c5590 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.384+0000 7fb8cf400640 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307c6320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00c7170 tx=0x7fb8c00971e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bbbaaf72cbd8726 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.385+0000 7fb8bfe00640 1 -- 172.21.15.100:0/3903244040 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011ea0 con 0x55cc307c5590 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.385+0000 7fb8bfe00640 1 -- 172.21.15.100:0/3903244040 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c009b430 con 0x55cc307c5590 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.385+0000 7fb8bfe00640 1 -- 172.21.15.100:0/3903244040 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c009fa80 con 0x55cc307c5590 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 -- 172.21.15.100:0/3903244040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 msgr2=0x55cc307c6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307c6320 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00c7170 tx=0x7fb8c00971e0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 -- 172.21.15.100:0/3903244040 shutdown_connections 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307c6320 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 --2- 172.21.15.100:0/3903244040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30789ec0 0x55cc3078a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 -- 172.21.15.100:0/3903244040 >> 172.21.15.100:0/3903244040 conn(0x55cc3074c490 msgr2=0x55cc3074d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 -- 172.21.15.100:0/3903244040 shutdown_connections 2024-02-21T07:55:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.387+0000 7fb8d9619740 1 -- 172.21.15.100:0/3903244040 wait complete. 2024-02-21T07:55:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.398+0000 7fb8d9619740 1 -- start start 2024-02-21T07:55:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.399+0000 7fb8d9619740 1 Processor -- start 2024-02-21T07:55:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3065b150 con 0x55cc30774b00 2024-02-21T07:55:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3065adf0 con 0x55cc307c5590 2024-02-21T07:55:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc304241c0 con 0x55cc3078a7e0 2024-02-21T07:55:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.401+0000 7fb8d9619740 10 client.0 _ll_register_callbacks cb 0x55cc306aa2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.402+0000 7fb8cf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.403+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.404+0000 7fb8d4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.404+0000 7fb8d4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42836/0 (socket says 172.21.15.100:42836) 2024-02-21T07:55:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.404+0000 7fb8d4a00640 1 -- 172.21.15.100:0/393477407 learned_addr learned my addr 172.21.15.100:0/393477407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.406+0000 7fb8cf400640 1 -- 172.21.15.100:0/393477407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 msgr2=0x55cc307cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.403+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39010/0 (socket says 172.21.15.100:39010) 2024-02-21T07:55:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.407+0000 7fb8cf400640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.407+0000 7fb8cf400640 1 -- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 msgr2=0x55cc30748bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.407+0000 7fb8cf400640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.409+0000 7fb8cf400640 1 -- 172.21.15.100:0/393477407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d022ce10 con 0x55cc307c5590 2024-02-21T07:55:13.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.410+0000 7fb8cf400640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307d1280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0093740 tx=0x7fb8c00c9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da5dc3ff1a7d128 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.410+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:13.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.410+0000 7fb8cfe00640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.413+0000 7fb8bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:13.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.413+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011ea0 con 0x55cc307c5590 2024-02-21T07:55:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.413+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb8c009fa80 con 0x55cc307c5590 2024-02-21T07:55:13.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.414+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc303b57e0 con 0x55cc307c5590 2024-02-21T07:55:13.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.417+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8c0093950 con 0x55cc307c5590 2024-02-21T07:55:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.418+0000 7fb8d9619740 10 client.7036 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.418+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cc306b45a0 con 0x55cc307c5590 2024-02-21T07:55:13.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.419+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc303b57e0 con 0x55cc307c5590 2024-02-21T07:55:13.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.420+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb8c009f5f0 con 0x55cc307c5590 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.420+0000 7fb8d9619740 10 client.7036 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.421+0000 7fb8d9619740 10 client.7036 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.421+0000 7fb8d9619740 20 client.7036 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.421+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307495d0 0x55cc307832a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.421+0000 7fb8d9619740 4 client.7036 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:13.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.421+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc303f2720 con 0x55cc307495d0 2024-02-21T07:55:13.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.423+0000 7fb8cfe00640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307495d0 0x55cc307832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.424+0000 7fb8cfe00640 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307495d0 0x55cc307832a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2103c8ba7af9640 server_cookie=ab91fd6b4ce3bf1b in_seq=0 out_seq=0 2024-02-21T07:55:13.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.426+0000 7fb8bcc00640 10 client.7036 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:13.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.430+0000 7fb8bcc00640 1 -- 172.21.15.100:0/393477407 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cc303f2720 con 0x55cc307495d0 2024-02-21T07:55:13.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.430+0000 7fb8bcc00640 10 client.7036 handle_command_reply: tid=0 2024-02-21T07:55:13.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.430+0000 7fb8d9619740 1 client.7036 shutdown 2024-02-21T07:55:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.431+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 msgr2=0x55cc307d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.431+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307d1280 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0093740 tx=0x7fb8c00c9040 comp rx=0 tx=0).stop 2024-02-21T07:55:13.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.431+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 shutdown_connections 2024-02-21T07:55:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.431+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc30748bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.431+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307495d0 0x55cc307832a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.432+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307c5590 0x55cc307d1280 secure :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0093740 tx=0x7fb8c00c9040 comp rx=0 tx=0).stop 2024-02-21T07:55:13.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.432+0000 7fb8bcc00640 0 client.7036 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.433+0000 7fb8d9619740 1 --2- 172.21.15.100:0/393477407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc307cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.434+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 >> 172.21.15.100:0/393477407 conn(0x55cc30789ec0 msgr2=0x55cc3074df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.436+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 shutdown_connections 2024-02-21T07:55:13.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.437+0000 7fb8d9619740 1 -- 172.21.15.100:0/393477407 wait complete. 2024-02-21T07:55:13.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.439+0000 7fb8d9619740 20 client.7036 trim_cache size 0 max 16384 2024-02-21T07:55:13.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.471+0000 7fb8d9619740 1 Processor -- start 2024-02-21T07:55:13.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.472+0000 7fb8d9619740 1 -- start start 2024-02-21T07:55:13.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc307495d0 0x55cc307d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc30774b00 0x55cc3077e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3076e5a0 con 0x55cc3078a7e0 2024-02-21T07:55:13.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc307c4570 con 0x55cc30774b00 2024-02-21T07:55:13.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.474+0000 7fb8d9619740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc307445e0 con 0x55cc307495d0 2024-02-21T07:55:13.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.475+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc307495d0 0x55cc307d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.476+0000 7fb8cf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc30774b00 0x55cc3077e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.476+0000 7fb8d4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.476+0000 7fb8d4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42842/0 (socket says 172.21.15.100:42842) 2024-02-21T07:55:13.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.476+0000 7fb8d4a00640 1 -- 172.21.15.100:0/819244780 learned_addr learned my addr 172.21.15.100:0/819244780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.477+0000 7fb8d4a00640 1 -- 172.21.15.100:0/819244780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc307495d0 msgr2=0x55cc307d66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.477+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc307495d0 0x55cc307d66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.477+0000 7fb8d4a00640 1 -- 172.21.15.100:0/819244780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc30774b00 msgr2=0x55cc3077e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.477+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc30774b00 0x55cc3077e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.477+0000 7fb8d4a00640 1 -- 172.21.15.100:0/819244780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc30650ab0 con 0x55cc3078a7e0 2024-02-21T07:55:13.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.479+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031db0 tx=0x7fb8b8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1978af3e1ebc9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.479+0000 7fb8bf400640 1 -- 172.21.15.100:0/819244780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803e420 con 0x55cc3078a7e0 2024-02-21T07:55:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.480+0000 7fb8bf400640 1 -- 172.21.15.100:0/819244780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b803e580 con 0x55cc3078a7e0 2024-02-21T07:55:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.480+0000 7fb8bf400640 1 -- 172.21.15.100:0/819244780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803e8f0 con 0x55cc3078a7e0 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.481+0000 7fb8d9619740 1 -- 172.21.15.100:0/819244780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 msgr2=0x55cc307c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.481+0000 7fb8d9619740 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031db0 tx=0x7fb8b8031000 comp rx=0 tx=0).stop 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.482+0000 7fb8d9619740 1 -- 172.21.15.100:0/819244780 shutdown_connections 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.482+0000 7fb8d9619740 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc3078a7e0 0x55cc307c4030 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.482+0000 7fb8d9619740 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc30774b00 0x55cc3077e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.482+0000 7fb8d9619740 1 --2- 172.21.15.100:0/819244780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc307495d0 0x55cc307d66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.482+0000 7fb8d9619740 1 -- 172.21.15.100:0/819244780 >> 172.21.15.100:0/819244780 conn(0x55cc30789ec0 msgr2=0x55cc30747fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.484+0000 7fb8d9619740 1 -- 172.21.15.100:0/819244780 shutdown_connections 2024-02-21T07:55:13.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.488+0000 7fb8d9619740 1 -- 172.21.15.100:0/819244780 wait complete. 2024-02-21T07:55:13.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.489+0000 7fb8d9619740 1 -- start start 2024-02-21T07:55:13.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.489+0000 7fb8d9619740 1 Processor -- start 2024-02-21T07:55:13.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.492+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 0x55cc307deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.492+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc307c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8d9619740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc3074ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 0x55cc307deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8cfe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 0x55cc307deff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34656/0 (socket says 172.21.15.100:34656) 2024-02-21T07:55:13.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8cfe00640 1 -- 172.21.15.100:0/939069838 learned_addr learned my addr 172.21.15.100:0/939069838 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc307825b0 con 0x55cc30774b00 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc307710a0 con 0x55cc307495d0 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc3074e480 con 0x55cc3078a7e0 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8d9619740 10 client.0 _ll_register_callbacks cb 0x7fb8c0093580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.493+0000 7fb8cf400640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc307c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.494+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc3074ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.494+0000 7fb8d4a00640 1 -- 172.21.15.100:0/939069838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 msgr2=0x55cc307deff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.495+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 0x55cc307deff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.495+0000 7fb8d4a00640 1 -- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 msgr2=0x55cc307c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.495+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc307c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.495+0000 7fb8d4a00640 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00f9ae0 con 0x55cc3078a7e0 2024-02-21T07:55:13.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.495+0000 7fb8cf400640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc307c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.496+0000 7fb8bcc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.496+0000 7fb8d4a00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc3074ad80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031d80 tx=0x7fb8b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6536e6a9d9e9198f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.496+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b803e420 con 0x55cc3078a7e0 2024-02-21T07:55:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.496+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb8b8045040 con 0x55cc3078a7e0 2024-02-21T07:55:13.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.497+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8c009b430 con 0x55cc3078a7e0 2024-02-21T07:55:13.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.497+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b805a410 con 0x55cc3078a7e0 2024-02-21T07:55:13.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.497+0000 7fb8d9619740 10 client.6971 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:13.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.498+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cc30676650 con 0x55cc3078a7e0 2024-02-21T07:55:13.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.498+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c009b430 con 0x55cc3078a7e0 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.498+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb8b805a570 con 0x55cc3078a7e0 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 10 client.6971 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 10 client.6971 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 20 client.6971 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307c5590 0x55cc3074d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 4 client.6971 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cc30441890 con 0x55cc307c5590 2024-02-21T07:55:13.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.499+0000 7fb8cfe00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307c5590 0x55cc3074d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.503+0000 7fb8cfe00640 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307c5590 0x55cc3074d4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d9f8841d2d8e1c5 server_cookie=95f43dd8d4425116 in_seq=0 out_seq=0 2024-02-21T07:55:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.505+0000 7fb8bcc00640 10 client.6971 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.505+0000 7fb8bcc00640 1 -- 172.21.15.100:0/939069838 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cc30441890 con 0x55cc307c5590 2024-02-21T07:55:13.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.505+0000 7fb8bcc00640 10 client.6971 handle_command_reply: tid=0 2024-02-21T07:55:13.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.505+0000 7fb8d9619740 1 client.6971 shutdown 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.507+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 msgr2=0x55cc3074ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.507+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc3074ad80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8031d80 tx=0x7fb8b8004730 comp rx=0 tx=0).stop 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 shutdown_connections 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cc3078a7e0 0x55cc3074ad80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cc30774b00 0x55cc307c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55cc307c5590 0x55cc3074d4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 --2- 172.21.15.100:0/939069838 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cc307495d0 0x55cc307deff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 >> 172.21.15.100:0/939069838 conn(0x55cc30789ec0 msgr2=0x55cc30747fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.510+0000 7fb8bcc00640 0 client.6971 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:13.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.511+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 shutdown_connections 2024-02-21T07:55:13.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.513+0000 7fb8d9619740 1 -- 172.21.15.100:0/939069838 wait complete. 2024-02-21T07:55:13.516 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.513+0000 7fb8d9619740 20 client.6971 trim_cache size 0 max 16384 2024-02-21T07:55:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.514+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 msgr2=0x7fb8ac0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.514+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 0x7fb8ac0a16b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8035000 tx=0x7fb8b8030000 comp rx=0 tx=0).stop 2024-02-21T07:55:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.514+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 msgr2=0x7fb8d022b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.514+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000b3c0 tx=0x7fb8c000b880 comp rx=0 tx=0).stop 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 shutdown_connections 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8d0190d60 0x7fb8d0177c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb8ac09f1f0 0x7fb8ac0a16b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8d0190440 0x7fb8d022b620 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 --2- 172.21.15.100:0/4035720445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb8d00ccc10 0x7fb8d00d5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.515+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 >> 172.21.15.100:0/4035720445 conn(0x7fb8d00fe290 msgr2=0x7fb8d017cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.517+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 shutdown_connections 2024-02-21T07:55:13.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.517+0000 7fb8d6a00640 1 -- 172.21.15.100:0/4035720445 wait complete. 2024-02-21T07:55:13.556 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:13.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:55:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.886+0000 7fd202e00640 1 Processor -- start 2024-02-21T07:55:13.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.886+0000 7fd202e00640 1 -- start start 2024-02-21T07:55:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.889+0000 7fd202e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1fc188dd0 0x7fd1fc0710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.889+0000 7fd202e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fd1fc072d60 0x7fd1fc1898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.889+0000 7fd202e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1fc06fc00 con 0x7fd1fc072900 2024-02-21T07:55:13.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.889+0000 7fd202e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc071610 con 0x7fd1fc188dd0 2024-02-21T07:55:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.889+0000 7fd202e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1fc06fe70 con 0x7fd1fc072d60 2024-02-21T07:55:13.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fbe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd1fc188dd0 0x7fd1fc0710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fb400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fd1fc072900 0x7fd1fc1891b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:37514/0 (socket says 172.21.15.100:37514) 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fb400640 1 -- 172.21.15.100:0/3187851412 learned_addr learned my addr 172.21.15.100:0/3187851412 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd200e00640 1 --2- 172.21.15.100:0/3187851412 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc072d60 0x7fd1fc1898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1faa00640 1 -- 172.21.15.100:0/3187851412 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643831721 0 0) 0x7fd1fc06fc00 con 0x7fd1fc072900 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fbe00640 1 -- 172.21.15.100:0/3187851412 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc072d60 msgr2=0x7fd1fc1898c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/3187851412 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc072d60 0x7fd1fc1898c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fbe00640 1 -- 172.21.15.100:0/3187851412 >> v1:172.21.15.170:6789/0 conn(0x7fd1fc072900 legacy=0x7fd1fc1891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.890+0000 7fd1fbe00640 1 -- 172.21.15.100:0/3187851412 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc070150 con 0x7fd1fc188dd0 2024-02-21T07:55:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.891+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/3187851412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc188dd0 0x7fd1fc0710d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc08e600 tx=0x7fd1ec02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36be25a0a038bd58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.892+0000 7fd1faa00640 1 -- 172.21.15.100:0/3187851412 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec02e070 con 0x7fd1fc188dd0 2024-02-21T07:55:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.892+0000 7fd1faa00640 1 -- 172.21.15.100:0/3187851412 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec0315a0 con 0x7fd1fc188dd0 2024-02-21T07:55:13.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.892+0000 7fd1faa00640 1 -- 172.21.15.100:0/3187851412 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec031930 con 0x7fd1fc188dd0 2024-02-21T07:55:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 -- 172.21.15.100:0/3187851412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc188dd0 msgr2=0x7fd1fc0710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 --2- 172.21.15.100:0/3187851412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc188dd0 0x7fd1fc0710d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc08e600 tx=0x7fd1ec02b840 comp rx=0 tx=0).stop 2024-02-21T07:55:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 -- 172.21.15.100:0/3187851412 shutdown_connections 2024-02-21T07:55:13.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 --2- 172.21.15.100:0/3187851412 >> v2:172.21.15.170:3300/0 conn(0x7fd1fc072d60 0x7fd1fc1898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 --2- 172.21.15.100:0/3187851412 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc188dd0 0x7fd1fc0710d0 secure :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc08e600 tx=0x7fd1ec02b840 comp rx=0 tx=0).stop 2024-02-21T07:55:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 -- 172.21.15.100:0/3187851412 >> 172.21.15.100:0/3187851412 conn(0x7fd1fc06e380 msgr2=0x7fd1fc06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 -- 172.21.15.100:0/3187851412 shutdown_connections 2024-02-21T07:55:13.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.893+0000 7fd202e00640 1 -- 172.21.15.100:0/3187851412 wait complete. 2024-02-21T07:55:13.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.895+0000 7fd202e00640 1 Processor -- start 2024-02-21T07:55:13.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.896+0000 7fd202e00640 1 -- start start 2024-02-21T07:55:13.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc072900 0x7fd1fc0f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 0x7fd1fc16dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc17a330 con 0x7fd1fc16db10 2024-02-21T07:55:13.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc17a610 con 0x7fd1fc072d60 2024-02-21T07:55:13.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.897+0000 7fd202e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc17a8f0 con 0x7fd1fc072900 2024-02-21T07:55:13.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34678/0 (socket says 172.21.15.100:34678) 2024-02-21T07:55:13.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 -- 172.21.15.100:0/2066938132 learned_addr learned my addr 172.21.15.100:0/2066938132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 -- 172.21.15.100:0/2066938132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc072900 msgr2=0x7fd1fc0f8430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:13.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc072900 0x7fd1fc0f8430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.898+0000 7fd1fb400640 1 -- 172.21.15.100:0/2066938132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 msgr2=0x7fd1fc16dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.901+0000 7fd200e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 0x7fd1fc16dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.901+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 0x7fd1fc16dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.901+0000 7fd1fb400640 1 -- 172.21.15.100:0/2066938132 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ec009400 con 0x7fd1fc072d60 2024-02-21T07:55:13.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd200e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 0x7fd1fc16dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800c4a0 tx=0x7fd1e800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd1f3e00640 1 -- 172.21.15.100:0/2066938132 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80075a0 con 0x7fd1fc072d60 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd1f3e00640 1 -- 172.21.15.100:0/2066938132 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80047e0 con 0x7fd1fc072d60 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1fc17abd0 con 0x7fd1fc072d60 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.902+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1fc17b190 con 0x7fd1fc072d60 2024-02-21T07:55:13.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.903+0000 7fd1f3e00640 1 -- 172.21.15.100:0/2066938132 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80075a0 con 0x7fd1fc072d60 2024-02-21T07:55:13.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.908+0000 7fd2059e6740 1 Processor -- start 2024-02-21T07:55:13.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.909+0000 7fd2059e6740 1 -- start start 2024-02-21T07:55:13.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.910+0000 7fd1f3e00640 1 -- 172.21.15.100:0/2066938132 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd1e80049d0 con 0x7fd1fc072d60 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfdf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 0x55642cfe0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cecf210 con 0x55642cfa4ff0 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cecc740 con 0x55642cfdfda0 2024-02-21T07:55:13.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd2059e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cec7f20 con 0x55642cfa46d0 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd200e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd200e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39048/0 (socket says 172.21.15.100:39048) 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.911+0000 7fd200e00640 1 -- 172.21.15.100:0/3567871820 learned_addr learned my addr 172.21.15.100:0/3567871820 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfdf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 -- 172.21.15.100:0/3567871820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 msgr2=0x55642cfe0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd1fb400640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 0x55642cfe0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 0x55642cfe0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 -- 172.21.15.100:0/3567871820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 msgr2=0x55642cfdf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfdf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 -- 172.21.15.100:0/3567871820 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55642ce89df0 con 0x55642cfa46d0 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfdf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd1fb400640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 0x55642cfe0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:13.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.912+0000 7fd200e00640 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c420 tx=0x7fd1f400d960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b765e71e28dfd8d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1f3e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 0x7fd1dc0a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1f0c00640 1 -- 172.21.15.100:0/3567871820 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4012070 con 0x55642cfa46d0 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1f3e00640 1 -- 172.21.15.100:0/2066938132 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd1e80c8d40 con 0x7fd1fc072d60 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1f0c00640 1 -- 172.21.15.100:0/3567871820 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4003990 con 0x55642cfa46d0 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1f0c00640 1 -- 172.21.15.100:0/3567871820 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4003d00 con 0x55642cfa46d0 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.913+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 0x7fd1dc0a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 -- 172.21.15.100:0/3567871820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 msgr2=0x55642cfa4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c420 tx=0x7fd1f400d960 comp rx=0 tx=0).stop 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 0x7fd1dc0a15c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec036000 tx=0x7fd1ec03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 -- 172.21.15.100:0/3567871820 shutdown_connections 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfdfda0 0x55642cfe0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfdf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 --2- 172.21.15.100:0/3567871820 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa46d0 0x55642cfa4ab0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 -- 172.21.15.100:0/3567871820 >> 172.21.15.100:0/3567871820 conn(0x55642cf66ca0 msgr2=0x55642cf67d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.914+0000 7fd2059e6740 1 -- 172.21.15.100:0/3567871820 shutdown_connections 2024-02-21T07:55:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.916+0000 7fd2059e6740 1 -- 172.21.15.100:0/3567871820 wait complete. 2024-02-21T07:55:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.917+0000 7fd2059e6740 1 -- start start 2024-02-21T07:55:13.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.917+0000 7fd2059e6740 1 Processor -- start 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 0x55642cf64370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfdfda0 0x55642cf98a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642ce6d150 con 0x55642cfdfda0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642ce6cdf0 con 0x55642cf995c0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.918+0000 7fd2059e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cc361c0 con 0x55642cfa4ff0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd2059e6740 10 client.0 _ll_register_callbacks cb 0x55642cebc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 0x55642cf64370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd200e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd200e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34690/0 (socket says 172.21.15.100:34690) 2024-02-21T07:55:13.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd200e00640 1 -- 172.21.15.100:0/1696557302 learned_addr learned my addr 172.21.15.100:0/1696557302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fb400640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfdfda0 0x55642cf98a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 -- 172.21.15.100:0/1696557302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 msgr2=0x55642cf9aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 -- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfdfda0 msgr2=0x55642cf98a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfdfda0 0x55642cf98a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd1fbe00640 1 -- 172.21.15.100:0/1696557302 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f400d3d0 con 0x55642cfa4ff0 2024-02-21T07:55:13.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.919+0000 7fd200e00640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 0x55642cf64370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc08dc10 tx=0x7fd1ec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85e73dc409a6f9c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd1e5600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec004030 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd1ec004190 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55642cbc77e0 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1ec004350 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd2059e6740 10 client.6983 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.920+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55642cec65a0 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55642cbc77e0 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd1ec003610 con 0x55642cfa4ff0 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 10 client.6983 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 10 client.6983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:13.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 20 client.6983 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:13.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9b0e0 0x55642cf8f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 4 client.6983 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:13.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55642cc04720 con 0x55642cf9b0e0 2024-02-21T07:55:13.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.921+0000 7fd1fb400640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9b0e0 0x55642cf8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.922+0000 7fd1e5600640 10 client.6983 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:13.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.922+0000 7fd1fb400640 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9b0e0 0x55642cf8f990 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc8db7f1a631721 server_cookie=71f0b44b1bd83bcc in_seq=0 out_seq=0 2024-02-21T07:55:13.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.922+0000 7fd1e5600640 1 -- 172.21.15.100:0/1696557302 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55642cc04720 con 0x55642cf9b0e0 2024-02-21T07:55:13.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.922+0000 7fd1e5600640 10 client.6983 handle_command_reply: tid=0 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.922+0000 7fd2059e6740 1 client.6983 shutdown 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 msgr2=0x55642cf64370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 0x55642cf64370 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc08dc10 tx=0x7fd1ec004730 comp rx=0 tx=0).stop 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 shutdown_connections 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9b0e0 0x55642cf8f990 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfdfda0 0x55642cf98a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd1e5600640 0 client.6983 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 --2- 172.21.15.100:0/1696557302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfa4ff0 0x55642cf64370 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.923+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 >> 172.21.15.100:0/1696557302 conn(0x55642cfa46d0 msgr2=0x55642cf68710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.924+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 shutdown_connections 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.924+0000 7fd2059e6740 1 -- 172.21.15.100:0/1696557302 wait complete. 2024-02-21T07:55:13.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.924+0000 7fd2059e6740 20 client.6983 trim_cache size 0 max 16384 2024-02-21T07:55:13.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.944+0000 7fd2059e6740 1 Processor -- start 2024-02-21T07:55:13.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.945+0000 7fd2059e6740 1 -- start start 2024-02-21T07:55:13.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfa4ff0 0x55642cfd8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642cf98750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cf8f990 con 0x55642cf995c0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cf652f0 con 0x55642cfa4ff0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.947+0000 7fd2059e6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cf658a0 con 0x55642cfdfda0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.948+0000 7fd1fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.948+0000 7fd1fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42894/0 (socket says 172.21.15.100:42894) 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.948+0000 7fd1fbe00640 1 -- 172.21.15.100:0/475821783 learned_addr learned my addr 172.21.15.100:0/475821783 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd200e00640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642cf98750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 -- 172.21.15.100:0/475821783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 msgr2=0x55642cf98750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642cf98750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 -- 172.21.15.100:0/475821783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfa4ff0 msgr2=0x55642cfd8770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fb400640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfa4ff0 0x55642cfd8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfa4ff0 0x55642cfd8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 -- 172.21.15.100:0/475821783 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55642cfdcf60 con 0x55642cf995c0 2024-02-21T07:55:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd200e00640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642cf98750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:13.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.949+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec004770 tx=0x7fd1ec049040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79d86032f1f510c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.951+0000 7fd1e7e00640 1 -- 172.21.15.100:0/475821783 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec05e070 con 0x55642cf995c0 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.952+0000 7fd1e7e00640 1 -- 172.21.15.100:0/475821783 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ec003610 con 0x55642cf995c0 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.952+0000 7fd1e7e00640 1 -- 172.21.15.100:0/475821783 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ec05e070 con 0x55642cf995c0 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.953+0000 7fd2059e6740 1 -- 172.21.15.100:0/475821783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 msgr2=0x55642cffa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.953+0000 7fd2059e6740 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec004770 tx=0x7fd1ec049040 comp rx=0 tx=0).stop 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.954+0000 7fd2059e6740 1 -- 172.21.15.100:0/475821783 shutdown_connections 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.954+0000 7fd2059e6740 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642cf98750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.954+0000 7fd2059e6740 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cfa4ff0 0x55642cfd8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.954+0000 7fd2059e6740 1 --2- 172.21.15.100:0/475821783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cf995c0 0x55642cffa410 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.954+0000 7fd2059e6740 1 -- 172.21.15.100:0/475821783 >> 172.21.15.100:0/475821783 conn(0x55642cfa46d0 msgr2=0x55642cf68710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.955+0000 7fd2059e6740 1 -- 172.21.15.100:0/475821783 shutdown_connections 2024-02-21T07:55:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.955+0000 7fd2059e6740 1 -- 172.21.15.100:0/475821783 wait complete. 2024-02-21T07:55:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.956+0000 7fd2059e6740 1 -- start start 2024-02-21T07:55:13.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.956+0000 7fd2059e6740 1 Processor -- start 2024-02-21T07:55:13.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.959+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf5a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.959+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfd4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd2059e6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642d033100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd1fbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf5a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd1fbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf5a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34700/0 (socket says 172.21.15.100:34700) 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd1fbe00640 1 -- 172.21.15.100:0/2876493445 learned_addr learned my addr 172.21.15.100:0/2876493445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cfd5450 con 0x55642cfa4ff0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.960+0000 7fd200e00640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642d033100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cf96cb0 con 0x55642cf995c0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55642cfd4cc0 con 0x55642cfdfda0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd2059e6740 10 client.0 _ll_register_callbacks cb 0x7fd1fc074c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:13.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfd4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 -- 172.21.15.100:0/2876493445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 msgr2=0x55642d033100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642d033100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 -- 172.21.15.100:0/2876493445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 msgr2=0x55642cf5a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf5a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.961+0000 7fd1fb400640 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55642cec65a0 con 0x55642cfa4ff0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.962+0000 7fd1fb400640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfd4780 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80c6790 tx=0x7fd1e8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d5d20da24ca0ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.962+0000 7fd1e5600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.962+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8096f80 con 0x55642cfa4ff0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.962+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd1e8096880 con 0x55642cfa4ff0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.962+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1f4003990 con 0x55642cfa4ff0 2024-02-21T07:55:13.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1e809a9d0 con 0x55642cfa4ff0 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 10 client.6888 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55642ce62ab0 con 0x55642cfa4ff0 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4003990 con 0x55642cfa4ff0 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd1e8097bb0 con 0x55642cfa4ff0 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 10 client.6888 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 10 client.6888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:13.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 20 client.6888 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9de90 0x55642cfa7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 4 client.6888 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.963+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55642cc53890 con 0x55642cf9de90 2024-02-21T07:55:13.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.964+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9de90 0x55642cfa7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.965+0000 7fd1fbe00640 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9de90 0x55642cfa7620 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5946361ebc2a7c6 server_cookie=d7ab6ee41150279e in_seq=0 out_seq=0 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.965+0000 7fd1e5600640 10 client.6888 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.965+0000 7fd1e5600640 1 -- 172.21.15.100:0/2876493445 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55642cc53890 con 0x55642cf9de90 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.965+0000 7fd1e5600640 10 client.6888 handle_command_reply: tid=0 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.965+0000 7fd2059e6740 1 client.6888 shutdown 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 msgr2=0x55642cfd4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfd4780 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80c6790 tx=0x7fd1e8009040 comp rx=0 tx=0).stop 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 shutdown_connections 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55642cf9de90 0x55642cfa7620 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55642cfdfda0 0x55642d033100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55642cfa4ff0 0x55642cfd4780 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 --2- 172.21.15.100:0/2876493445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55642cf995c0 0x55642cf5a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 >> 172.21.15.100:0/2876493445 conn(0x55642cfa46d0 msgr2=0x55642cfdf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.966+0000 7fd1e5600640 0 client.6888 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:13.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.967+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 shutdown_connections 2024-02-21T07:55:13.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.967+0000 7fd2059e6740 1 -- 172.21.15.100:0/2876493445 wait complete. 2024-02-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.967+0000 7fd2059e6740 20 client.6888 trim_cache size 0 max 16384 2024-02-21T07:55:13.970 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 msgr2=0x7fd1dc0a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 0x7fd1dc0a15c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec036000 tx=0x7fd1ec03d040 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 msgr2=0x7fd1fc0f8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800c4a0 tx=0x7fd1e800c960 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 shutdown_connections 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd1dc09f100 0x7fd1dc0a15c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1fc16db10 0x7fd1fc16dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd1fc072d60 0x7fd1fc0f8970 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 --2- 172.21.15.100:0/2066938132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1fc072900 0x7fd1fc0f8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 >> 172.21.15.100:0/2066938132 conn(0x7fd1fc06e380 msgr2=0x7fd1fc06e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.968+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 shutdown_connections 2024-02-21T07:55:13.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:13.969+0000 7fd202e00640 1 -- 172.21.15.100:0/2066938132 wait complete. 2024-02-21T07:55:14.993 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:55:14.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:55:14.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:55:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.430+0000 7f0d5b800640 1 Processor -- start 2024-02-21T07:55:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.430+0000 7f0d5b800640 1 -- start start 2024-02-21T07:55:15.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.433+0000 7f0d5b800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0d54182790 0x7f0d54182c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.434+0000 7f0d5b800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 0x7f0d540f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.434+0000 7f0d5b800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d541842a0 con 0x7f0d5408e5c0 2024-02-21T07:55:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.434+0000 7f0d5b800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5406ead0 con 0x7f0d540f7c70 2024-02-21T07:55:15.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.434+0000 7f0d5b800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d54183160 con 0x7f0d54182790 2024-02-21T07:55:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.435+0000 7f0d53e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0d54182790 0x7f0d54182c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.435+0000 7f0d53e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0d54182790 0x7f0d54182c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34712/0 (socket says 172.21.15.100:34712) 2024-02-21T07:55:15.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.435+0000 7f0d53e00640 1 -- 172.21.15.100:0/4036613028 learned_addr learned my addr 172.21.15.100:0/4036613028 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.435+0000 7f0d59800640 1 --2- 172.21.15.100:0/4036613028 >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 0x7f0d540f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.438+0000 7f0d53e00640 1 -- 172.21.15.100:0/4036613028 >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 msgr2=0x7f0d540f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.439+0000 7f0d53400640 1 -- 172.21.15.100:0/4036613028 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030141553 0 0) 0x7f0d541842a0 con 0x7f0d5408e5c0 2024-02-21T07:55:15.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.441+0000 7f0d53e00640 1 --2- 172.21.15.100:0/4036613028 >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 0x7f0d540f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.441+0000 7f0d53e00640 1 -- 172.21.15.100:0/4036613028 >> v1:172.21.15.100:6789/0 conn(0x7f0d5408e5c0 legacy=0x7f0d54181ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.441+0000 7f0d53e00640 1 -- 172.21.15.100:0/4036613028 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d541833b0 con 0x7f0d54182790 2024-02-21T07:55:15.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.442+0000 7f0d59800640 1 --2- 172.21.15.100:0/4036613028 >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 0x7f0d540f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:15.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.443+0000 7f0d53e00640 1 --2- 172.21.15.100:0/4036613028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d54182790 0x7f0d54182c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0d5408d380 tx=0x7f0d4c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e4e504935c3e75 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.444+0000 7f0d53400640 1 -- 172.21.15.100:0/4036613028 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c02c9f0 con 0x7f0d54182790 2024-02-21T07:55:15.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.444+0000 7f0d53400640 1 -- 172.21.15.100:0/4036613028 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c02cb50 con 0x7f0d54182790 2024-02-21T07:55:15.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.445+0000 7f0d5b800640 1 -- 172.21.15.100:0/4036613028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d54182790 msgr2=0x7f0d54182c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.445+0000 7f0d5b800640 1 --2- 172.21.15.100:0/4036613028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d54182790 0x7f0d54182c20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0d5408d380 tx=0x7f0d4c02be50 comp rx=0 tx=0).stop 2024-02-21T07:55:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.446+0000 7f0d5b800640 1 -- 172.21.15.100:0/4036613028 shutdown_connections 2024-02-21T07:55:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.446+0000 7f0d5b800640 1 --2- 172.21.15.100:0/4036613028 >> v2:172.21.15.100:3300/0 conn(0x7f0d540f7c70 0x7f0d540f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.446+0000 7f0d5b800640 1 --2- 172.21.15.100:0/4036613028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d54182790 0x7f0d54182c20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.446+0000 7f0d5b800640 1 -- 172.21.15.100:0/4036613028 >> 172.21.15.100:0/4036613028 conn(0x7f0d540668b0 msgr2=0x7f0d54066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.452+0000 7f0d5b800640 1 -- 172.21.15.100:0/4036613028 shutdown_connections 2024-02-21T07:55:15.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.452+0000 7f0d5b800640 1 -- 172.21.15.100:0/4036613028 wait complete. 2024-02-21T07:55:15.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.459+0000 7f0d5b800640 1 Processor -- start 2024-02-21T07:55:15.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.460+0000 7f0d5b800640 1 -- start start 2024-02-21T07:55:15.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.465+0000 7f0d5b800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.465+0000 7f0d5b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d540f7c70 0x7f0d54174420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d5b800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d5b800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540f4800 con 0x7f0d540f7c70 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d5b800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540f4dc0 con 0x7f0d5408e5c0 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d5b800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54174ea0 con 0x7f0d54182790 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34726/0 (socket says 172.21.15.100:34726) 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.470+0000 7f0d59800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.471+0000 7f0d59800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39070/0 (socket says 172.21.15.100:39070) 2024-02-21T07:55:15.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.471+0000 7f0d59800640 1 -- 172.21.15.100:0/568071386 learned_addr learned my addr 172.21.15.100:0/568071386 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.473+0000 7f0d59800640 1 -- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 msgr2=0x7f0d540cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.473+0000 7f0d59800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.473+0000 7f0d59800640 1 -- 172.21.15.100:0/568071386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d540f7c70 msgr2=0x7f0d54174420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.474+0000 7f0d59800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d540f7c70 0x7f0d54174420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.474+0000 7f0d59800640 1 -- 172.21.15.100:0/568071386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009400 con 0x7f0d54182790 2024-02-21T07:55:15.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.474+0000 7f0d58e00640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.475+0000 7f0d59800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000e860 tx=0x7f0d4000ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.476+0000 7f0d50c00640 1 -- 172.21.15.100:0/568071386 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40004020 con 0x7f0d54182790 2024-02-21T07:55:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.476+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c009b30 con 0x7f0d54182790 2024-02-21T07:55:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.476+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54175420 con 0x7f0d54182790 2024-02-21T07:55:15.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.476+0000 7f0d50c00640 1 -- 172.21.15.100:0/568071386 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d400041a0 con 0x7f0d54182790 2024-02-21T07:55:15.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.476+0000 7f0d50c00640 1 -- 172.21.15.100:0/568071386 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000c8e0 con 0x7f0d54182790 2024-02-21T07:55:15.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.484+0000 7f0d50c00640 1 -- 172.21.15.100:0/568071386 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0d4000ca40 con 0x7f0d54182790 2024-02-21T07:55:15.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.489+0000 7f0d50c00640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 0x7f0d340a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.489+0000 7f0d50c00640 1 -- 172.21.15.100:0/568071386 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d400c9a20 con 0x7f0d54182790 2024-02-21T07:55:15.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.493+0000 7f0d58e00640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 0x7f0d340a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.497+0000 7f0d58e00640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 0x7f0d340a5ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000f60 tx=0x7f0d44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.500+0000 7f0d5e46b740 1 Processor -- start 2024-02-21T07:55:15.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.507+0000 7f0d5e46b740 1 -- start start 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d89d0 0x55f8d29d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d2a14e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d2950300 con 0x55f8d29d89d0 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d2902e50 con 0x55f8d29d92f0 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.509+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d2900380 con 0x55f8d2a140a0 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.513+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.513+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34738/0 (socket says 172.21.15.100:34738) 2024-02-21T07:55:15.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.513+0000 7f0d53e00640 1 -- 172.21.15.100:0/2371979357 learned_addr learned my addr 172.21.15.100:0/2371979357 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.517+0000 7f0d53e00640 1 -- 172.21.15.100:0/2371979357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 msgr2=0x55f8d2a14e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.517+0000 7f0d53e00640 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d2a14e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.517+0000 7f0d53e00640 1 -- 172.21.15.100:0/2371979357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d89d0 msgr2=0x55f8d29d8db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.517+0000 7f0d53e00640 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d89d0 0x55f8d29d8db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.517+0000 7f0d53e00640 1 -- 172.21.15.100:0/2371979357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8d28c4c80 con 0x55f8d29d92f0 2024-02-21T07:55:15.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.518+0000 7f0d53e00640 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009f40 tx=0x7f0d4c02e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb384c4a8d695a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.518+0000 7f0d49600640 1 -- 172.21.15.100:0/2371979357 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c02c9f0 con 0x55f8d29d92f0 2024-02-21T07:55:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.518+0000 7f0d49600640 1 -- 172.21.15.100:0/2371979357 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c034610 con 0x55f8d29d92f0 2024-02-21T07:55:15.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.518+0000 7f0d49600640 1 -- 172.21.15.100:0/2371979357 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0349c0 con 0x55f8d29d92f0 2024-02-21T07:55:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.521+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2371979357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 msgr2=0x55f8d2a13b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.521+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009f40 tx=0x7f0d4c02e070 comp rx=0 tx=0).stop 2024-02-21T07:55:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.523+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2371979357 shutdown_connections 2024-02-21T07:55:15.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.523+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d2a14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.523+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29d92f0 0x55f8d2a13b60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.523+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2371979357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d89d0 0x55f8d29d8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.523+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2371979357 >> 172.21.15.100:0/2371979357 conn(0x55f8d299afa0 msgr2=0x55f8d299c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.526+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2371979357 shutdown_connections 2024-02-21T07:55:15.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.526+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2371979357 wait complete. 2024-02-21T07:55:15.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.528+0000 7f0d5e46b740 1 -- start start 2024-02-21T07:55:15.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.528+0000 7f0d5e46b740 1 Processor -- start 2024-02-21T07:55:15.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.530+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29d92f0 0x55f8d29fded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.530+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 0x55f8d2a01bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.530+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d28fbb60 con 0x55f8d2a140a0 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d28a0fd0 con 0x55f8d29df270 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d28a0c70 con 0x55f8d29d92f0 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d5e46b740 10 client.0 _ll_register_callbacks cb 0x55f8d260cc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d59800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d59800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34746/0 (socket says 172.21.15.100:34746) 2024-02-21T07:55:15.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d59800640 1 -- 172.21.15.100:0/565929490 learned_addr learned my addr 172.21.15.100:0/565929490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.531+0000 7f0d53e00640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 0x55f8d2a01bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d59800640 1 -- 172.21.15.100:0/565929490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29d92f0 msgr2=0x55f8d29fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d59800640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29d92f0 0x55f8d29fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d59800640 1 -- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 msgr2=0x55f8d2a01bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d59800640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 0x55f8d2a01bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d59800640 1 -- 172.21.15.100:0/565929490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d541833b0 con 0x55f8d29df270 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.532+0000 7f0d53e00640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 0x55f8d2a01bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.533+0000 7f0d59800640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d40097490 tx=0x7f0d40096f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d42f4aa9890553a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.533+0000 7f0d3e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.536+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4009fca0 con 0x55f8d29df270 2024-02-21T07:55:15.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.536+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d400b6070 con 0x55f8d29df270 2024-02-21T07:55:15.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.537+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8d25fb860 con 0x55f8d29df270 2024-02-21T07:55:15.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.540+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d400b6230 con 0x55f8d29df270 2024-02-21T07:55:15.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.540+0000 7f0d5e46b740 10 client.7066 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:15.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.540+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f8d28fa1e0 con 0x55f8d29df270 2024-02-21T07:55:15.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.541+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8d25fb860 con 0x55f8d29df270 2024-02-21T07:55:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.542+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d40011070 con 0x55f8d29df270 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 10 client.7066 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 10 client.7066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 20 client.7066 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29df770 0x55f8d2a08d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 4 client.7066 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.543+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8d264c410 con 0x55f8d29df770 2024-02-21T07:55:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.547+0000 7f0d58e00640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29df770 0x55f8d2a08d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.551+0000 7f0d58e00640 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29df770 0x55f8d2a08d30 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48ac69443bb58acc server_cookie=a5a9d04dc8b3eb8 in_seq=0 out_seq=0 2024-02-21T07:55:15.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.552+0000 7f0d3e000640 10 client.7066 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.553+0000 7f0d3e000640 1 -- 172.21.15.100:0/565929490 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f8d264c410 con 0x55f8d29df770 2024-02-21T07:55:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.553+0000 7f0d3e000640 10 client.7066 handle_command_reply: tid=0 2024-02-21T07:55:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.553+0000 7f0d5e46b740 1 client.7066 shutdown 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 msgr2=0x55f8d29bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0d40097490 tx=0x7f0d40096f50 comp rx=0 tx=0).stop 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 shutdown_connections 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29df770 0x55f8d2a08d30 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d29bc930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d2a140a0 0x55f8d2a01bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/565929490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29d92f0 0x55f8d29fded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.554+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 >> 172.21.15.100:0/565929490 conn(0x55f8d29d89d0 msgr2=0x55f8d299ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.555+0000 7f0d3e000640 0 client.7066 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.555+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 shutdown_connections 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.556+0000 7f0d5e46b740 1 -- 172.21.15.100:0/565929490 wait complete. 2024-02-21T07:55:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.556+0000 7f0d5e46b740 20 client.7066 trim_cache size 0 max 16384 2024-02-21T07:55:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.591+0000 7f0d5e46b740 1 Processor -- start 2024-02-21T07:55:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.591+0000 7f0d5e46b740 1 -- start start 2024-02-21T07:55:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a10360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d2a120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d299add0 con 0x55f8d29d92f0 2024-02-21T07:55:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d26440c0 con 0x55f8d29df270 2024-02-21T07:55:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.593+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d29bc1a0 con 0x55f8d2a140a0 2024-02-21T07:55:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d2a120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a10360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d59800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d53e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d2a120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34760/0 (socket says 172.21.15.100:34760) 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d53e00640 1 -- 172.21.15.100:0/2404988827 learned_addr learned my addr 172.21.15.100:0/2404988827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 -- 172.21.15.100:0/2404988827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 msgr2=0x55f8d29bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 -- 172.21.15.100:0/2404988827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 msgr2=0x55f8d2a120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d2a120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.594+0000 7f0d58e00640 1 -- 172.21.15.100:0/2404988827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8d2a09c60 con 0x55f8d29d92f0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.595+0000 7f0d58e00640 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a10360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55f8d29ff110 tx=0x7f0d44005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5760333b7ef9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.595+0000 7f0d48c00640 1 -- 172.21.15.100:0/2404988827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44001d80 con 0x55f8d29d92f0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.595+0000 7f0d48c00640 1 -- 172.21.15.100:0/2404988827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44025070 con 0x55f8d29d92f0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.595+0000 7f0d48c00640 1 -- 172.21.15.100:0/2404988827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400ecb0 con 0x55f8d29d92f0 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2404988827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 msgr2=0x55f8d2a10360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a10360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55f8d29ff110 tx=0x7f0d44005000 comp rx=0 tx=0).stop 2024-02-21T07:55:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2404988827 shutdown_connections 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d29df270 0x55f8d2a120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/2404988827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a10360 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2404988827 >> 172.21.15.100:0/2404988827 conn(0x55f8d29d89d0 msgr2=0x55f8d29bc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2404988827 shutdown_connections 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.596+0000 7f0d5e46b740 1 -- 172.21.15.100:0/2404988827 wait complete. 2024-02-21T07:55:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.597+0000 7f0d5e46b740 1 -- start start 2024-02-21T07:55:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.598+0000 7f0d5e46b740 1 Processor -- start 2024-02-21T07:55:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29df270 0x55f8d2a7e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d29bccc0 con 0x55f8d29d92f0 2024-02-21T07:55:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d2a36d90 con 0x55f8d2a140a0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8d2a7ee00 con 0x55f8d29df270 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d5e46b740 10 client.0 _ll_register_callbacks cb 0x7f0d40009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42954/0 (socket says 172.21.15.100:42954) 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 -- 172.21.15.100:0/3518765150 learned_addr learned my addr 172.21.15.100:0/3518765150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d53e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29df270 0x55f8d2a7e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d59800640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 -- 172.21.15.100:0/3518765150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29df270 msgr2=0x55f8d2a7e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29df270 0x55f8d2a7e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 -- 172.21.15.100:0/3518765150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 msgr2=0x55f8d29bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.600+0000 7f0d58e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d58e00640 1 -- 172.21.15.100:0/3518765150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4400f040 con 0x55f8d29d92f0 2024-02-21T07:55:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d59800640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d58e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0d44007fd0 tx=0x7f0d44007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7992cbc9c2b90b57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d3e000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44021760 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d440218c0 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d4c034610 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4400ecb0 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d5e46b740 10 client.6903 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.601+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f8d2896a90 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c034610 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d44005290 con 0x55f8d29d92f0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 10 client.6903 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 10 client.6903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 20 client.6903 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29f59c0 0x55f8d29bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 4 client.6903 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f8d26387b0 con 0x55f8d29f59c0 2024-02-21T07:55:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.602+0000 7f0d53e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29f59c0 0x55f8d29bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.603+0000 7f0d3e000640 10 client.6903 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.603+0000 7f0d53e00640 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29f59c0 0x55f8d29bfb80 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da3a054cc57f5f98 server_cookie=bf101ceff979fe8c in_seq=0 out_seq=0 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.604+0000 7f0d3e000640 1 -- 172.21.15.100:0/3518765150 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f8d26387b0 con 0x55f8d29f59c0 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.604+0000 7f0d3e000640 10 client.6903 handle_command_reply: tid=0 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 client.6903 shutdown 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 msgr2=0x55f8d2a04870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0d44007fd0 tx=0x7f0d44007b30 comp rx=0 tx=0).stop 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 shutdown_connections 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f8d29f59c0 0x55f8d29bfb80 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8d2a140a0 0x55f8d29bf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f8d29df270 0x55f8d2a7e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 --2- 172.21.15.100:0/3518765150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8d29d92f0 0x55f8d2a04870 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.605+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 >> 172.21.15.100:0/3518765150 conn(0x55f8d29d89d0 msgr2=0x55f8d29dce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.606+0000 7f0d3e000640 0 client.6903 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.609+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 shutdown_connections 2024-02-21T07:55:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.609+0000 7f0d5e46b740 1 -- 172.21.15.100:0/3518765150 wait complete. 2024-02-21T07:55:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.609+0000 7f0d5e46b740 20 client.6903 trim_cache size 0 max 16384 2024-02-21T07:55:15.613 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:15.613 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:55:15.613 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "a64741dd-0bdd-46b4-9996-5b3663e9231a", 2024-02-21T07:55:15.613 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:55:15.613 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 msgr2=0x7f0d340a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 0x7f0d340a5ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000f60 tx=0x7f0d44009040 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 msgr2=0x7f0d54174960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000e860 tx=0x7f0d4000ed20 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 shutdown_connections 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d54182790 0x7f0d54174960 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d340a3600 0x7f0d340a5ac0 secure :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d44000f60 tx=0x7f0d44009040 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d540f7c70 0x7f0d54174420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 --2- 172.21.15.100:0/568071386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d5408e5c0 0x7f0d540cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.612+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 >> 172.21.15.100:0/568071386 conn(0x7f0d540668b0 msgr2=0x7f0d54070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.613+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 shutdown_connections 2024-02-21T07:55:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:15.616+0000 7f0d5b800640 1 -- 172.21.15.100:0/568071386 wait complete. 2024-02-21T07:55:15.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:55:15.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:55:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.092+0000 7f958be00640 1 Processor -- start 2024-02-21T07:55:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.093+0000 7f958be00640 1 -- start start 2024-02-21T07:55:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.097+0000 7f958be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95841096f0 0x7f958410d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.098+0000 7f958be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 0x7f958410ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.098+0000 7f958aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95841096f0 0x7f958410d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.098+0000 7f958aa00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f95841096f0 0x7f958410d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39084/0 (socket says 172.21.15.100:39084) 2024-02-21T07:55:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.098+0000 7f958aa00640 1 -- 172.21.15.100:0/3424918048 learned_addr learned my addr 172.21.15.100:0/3424918048 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.101+0000 7f958b400640 1 --2- 172.21.15.100:0/3424918048 >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 0x7f958410ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.101+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958410a610 con 0x7f958410d780 2024-02-21T07:55:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.101+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584054200 con 0x7f958410a1e0 2024-02-21T07:55:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.101+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95840544e0 con 0x7f95841096f0 2024-02-21T07:55:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.102+0000 7f958aa00640 1 -- 172.21.15.100:0/3424918048 >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 msgr2=0x7f958410ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.102+0000 7f9589600640 1 -- 172.21.15.100:0/3424918048 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553323682 0 0) 0x7f957c001110 con 0x7f958410d780 2024-02-21T07:55:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.105+0000 7f958aa00640 1 --2- 172.21.15.100:0/3424918048 >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 0x7f958410ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.105+0000 7f958aa00640 1 -- 172.21.15.100:0/3424918048 >> v1:172.21.15.100:6789/0 conn(0x7f958410d780 legacy=0x7f9584109ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.105+0000 7f958aa00640 1 -- 172.21.15.100:0/3424918048 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840547c0 con 0x7f95841096f0 2024-02-21T07:55:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.105+0000 7f958b400640 1 --2- 172.21.15.100:0/3424918048 >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 0x7f958410ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.109+0000 7f958aa00640 1 --2- 172.21.15.100:0/3424918048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95841096f0 0x7f958410d240 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f958400a340 tx=0x7f957802cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e347e7517e51c4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.110+0000 7f9589600640 1 -- 172.21.15.100:0/3424918048 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578008df0 con 0x7f95841096f0 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.110+0000 7f9589600640 1 -- 172.21.15.100:0/3424918048 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957800a0d0 con 0x7f95841096f0 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.111+0000 7f9589600640 1 -- 172.21.15.100:0/3424918048 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578008df0 con 0x7f95841096f0 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.112+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95841096f0 msgr2=0x7f958410d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.112+0000 7f958be00640 1 --2- 172.21.15.100:0/3424918048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95841096f0 0x7f958410d240 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f958400a340 tx=0x7f957802cac0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 shutdown_connections 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 --2- 172.21.15.100:0/3424918048 >> v2:172.21.15.100:3300/0 conn(0x7f958410a1e0 0x7f958410ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 --2- 172.21.15.100:0/3424918048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f95841096f0 0x7f958410d240 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 >> 172.21.15.100:0/3424918048 conn(0x7f9584052de0 msgr2=0x7f95840531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 shutdown_connections 2024-02-21T07:55:16.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.116+0000 7f958be00640 1 -- 172.21.15.100:0/3424918048 wait complete. 2024-02-21T07:55:16.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.126+0000 7f958be00640 1 Processor -- start 2024-02-21T07:55:16.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.126+0000 7f958be00640 1 -- start start 2024-02-21T07:55:16.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.132+0000 7f958be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 0x7f958407d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.136+0000 7f958aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 0x7f958407d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.136+0000 7f958aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 0x7f958407d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34780/0 (socket says 172.21.15.100:34780) 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.136+0000 7f958aa00640 1 -- 172.21.15.100:0/1753515848 learned_addr learned my addr 172.21.15.100:0/1753515848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.137+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f958410a1e0 0x7f958404d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.137+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 0x7f958404dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.138+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841a2c40 con 0x7f958410d780 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.138+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840dd150 con 0x7f95841096f0 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.138+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95840dd430 con 0x7f958410a1e0 2024-02-21T07:55:16.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.138+0000 7f958b400640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 0x7f958404dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.140+0000 7f958b400640 1 -- 172.21.15.100:0/1753515848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f958410a1e0 msgr2=0x7f958404d580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:55:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.140+0000 7f958b400640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f958410a1e0 0x7f958404d580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.140+0000 7f958b400640 1 -- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 msgr2=0x7f958407d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.140+0000 7f958b400640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 0x7f958407d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.140+0000 7f958b400640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578007040 con 0x7f958410d780 2024-02-21T07:55:16.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.142+0000 7f958b400640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 0x7f958404dac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f958c04fc90 tx=0x7f958c068050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.142+0000 7f9583400640 1 -- 172.21.15.100:0/1753515848 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0716c0 con 0x7f958410d780 2024-02-21T07:55:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.142+0000 7f9583400640 1 -- 172.21.15.100:0/1753515848 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c091070 con 0x7f958410d780 2024-02-21T07:55:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.142+0000 7f9583400640 1 -- 172.21.15.100:0/1753515848 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c071b40 con 0x7f958410d780 2024-02-21T07:55:16.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.142+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95840dd710 con 0x7f958410d780 2024-02-21T07:55:16.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.149+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958404e000 con 0x7f958410d780 2024-02-21T07:55:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.161+0000 7f9583400640 1 -- 172.21.15.100:0/1753515848 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f958c093030 con 0x7f958410d780 2024-02-21T07:55:16.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.169+0000 7f9583400640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 0x7f956c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.173+0000 7f958aa00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 0x7f956c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.173+0000 7f9594bc8740 1 Processor -- start 2024-02-21T07:55:16.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.173+0000 7f9594bc8740 1 -- start start 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.174+0000 7f958aa00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 0x7f956c0a1560 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f957800a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bad9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933ba9c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933ba08150 con 0x55933bb0f960 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933ba05680 con 0x55933bada2c0 2024-02-21T07:55:16.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.175+0000 7f9594bc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933ba00e60 con 0x55933bad99a0 2024-02-21T07:55:16.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.177+0000 7f958a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bad9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.177+0000 7f958aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.177+0000 7f958aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39102/0 (socket says 172.21.15.100:39102) 2024-02-21T07:55:16.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.177+0000 7f958aa00640 1 -- 172.21.15.100:0/2724270593 learned_addr learned my addr 172.21.15.100:0/2724270593 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.177+0000 7f9583400640 1 -- 172.21.15.100:0/1753515848 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f958c115ad0 con 0x7f958410d780 2024-02-21T07:55:16.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958b400640 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933ba9c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958aa00640 1 -- 172.21.15.100:0/2724270593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 msgr2=0x55933ba9c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958aa00640 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933ba9c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958aa00640 1 -- 172.21.15.100:0/2724270593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 msgr2=0x55933bad9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958aa00640 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bad9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.178+0000 7f958aa00640 1 -- 172.21.15.100:0/2724270593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55933b9ba060 con 0x55933bad99a0 2024-02-21T07:55:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.181+0000 7f958aa00640 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f957802d0d0 tx=0x7f9578031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=294827b5db2e4a41 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.183+0000 7f9577400640 1 -- 172.21.15.100:0/2724270593 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578003b60 con 0x55933bad99a0 2024-02-21T07:55:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.183+0000 7f9577400640 1 -- 172.21.15.100:0/2724270593 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957803e040 con 0x55933bad99a0 2024-02-21T07:55:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.183+0000 7f9577400640 1 -- 172.21.15.100:0/2724270593 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957802e470 con 0x55933bad99a0 2024-02-21T07:55:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.184+0000 7f9594bc8740 1 -- 172.21.15.100:0/2724270593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 msgr2=0x55933bb0f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.184+0000 7f9594bc8740 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f957802d0d0 tx=0x7f9578031000 comp rx=0 tx=0).stop 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.184+0000 7f9594bc8740 1 -- 172.21.15.100:0/2724270593 shutdown_connections 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.184+0000 7f9594bc8740 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933ba9c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.185+0000 7f9594bc8740 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bad9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.185+0000 7f9594bc8740 1 --2- 172.21.15.100:0/2724270593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933bb0f420 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.185+0000 7f9594bc8740 1 -- 172.21.15.100:0/2724270593 >> 172.21.15.100:0/2724270593 conn(0x55933ba605a0 msgr2=0x55933baa0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.185+0000 7f9594bc8740 1 -- 172.21.15.100:0/2724270593 shutdown_connections 2024-02-21T07:55:16.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.185+0000 7f9594bc8740 1 -- 172.21.15.100:0/2724270593 wait complete. 2024-02-21T07:55:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.187+0000 7f9594bc8740 1 -- start start 2024-02-21T07:55:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.187+0000 7f9594bc8740 1 Processor -- start 2024-02-21T07:55:16.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933baa80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bac2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933b9a5ec0 con 0x55933bb0f960 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933b9a5b60 con 0x55933bada2c0 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933b76f1c0 con 0x55933bad99a0 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.192+0000 7f9594bc8740 10 client.0 _ll_register_callbacks cb 0x55933b9b9960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34798/0 (socket says 172.21.15.100:34798) 2024-02-21T07:55:16.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 -- 172.21.15.100:0/221094973 learned_addr learned my addr 172.21.15.100:0/221094973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 -- 172.21.15.100:0/221094973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 msgr2=0x55933baa80c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933baa80c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 -- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 msgr2=0x55933bac2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bac2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.193+0000 7f958a000640 1 -- 172.21.15.100:0/221094973 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95840547c0 con 0x55933bada2c0 2024-02-21T07:55:16.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.194+0000 7f958a000640 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f957c001df0 tx=0x7f957c00f5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55b59f3836fb4e59 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.194+0000 7f956be00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c005110 con 0x55933bada2c0 2024-02-21T07:55:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f957c005270 con 0x55933bada2c0 2024-02-21T07:55:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55933b7007e0 con 0x55933bada2c0 2024-02-21T07:55:16.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f957c005430 con 0x55933bada2c0 2024-02-21T07:55:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f9594bc8740 10 client.7081 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.197+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55933b9ff4e0 con 0x55933bada2c0 2024-02-21T07:55:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c022020 con 0x55933bada2c0 2024-02-21T07:55:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f957c012070 con 0x55933bada2c0 2024-02-21T07:55:16.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 10 client.7081 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 10 client.7081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 20 client.7081 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bac47c0 0x55933bac2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 4 client.7081 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:16.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.198+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55933b73d720 con 0x55933bac47c0 2024-02-21T07:55:16.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.202+0000 7f958aa00640 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bac47c0 0x55933bac2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.207+0000 7f956be00640 10 client.7081 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:16.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.208+0000 7f958aa00640 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bac47c0 0x55933bac2cb0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bdaf8cb1a9e78bd server_cookie=4ae6bb94b8b089da in_seq=0 out_seq=0 2024-02-21T07:55:16.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.212+0000 7f956be00640 1 -- 172.21.15.100:0/221094973 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55933b73d720 con 0x55933bac47c0 2024-02-21T07:55:16.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.212+0000 7f956be00640 10 client.7081 handle_command_reply: tid=0 2024-02-21T07:55:16.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.212+0000 7f9594bc8740 1 client.7081 shutdown 2024-02-21T07:55:16.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.214+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 msgr2=0x55933bae1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.214+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f957c001df0 tx=0x7f957c00f5a0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.214+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 shutdown_connections 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.214+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bac47c0 0x55933bac2cb0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bb0f960 0x55933bac2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bada2c0 0x55933bae1940 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 --2- 172.21.15.100:0/221094973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933baa80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 >> 172.21.15.100:0/221094973 conn(0x55933ba605a0 msgr2=0x55933baa1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f956be00640 0 client.7081 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 shutdown_connections 2024-02-21T07:55:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.215+0000 7f9594bc8740 1 -- 172.21.15.100:0/221094973 wait complete. 2024-02-21T07:55:16.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.216+0000 7f9594bc8740 20 client.7081 trim_cache size 0 max 16384 2024-02-21T07:55:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.241+0000 7f9594bc8740 1 Processor -- start 2024-02-21T07:55:16.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.241+0000 7f9594bc8740 1 -- start start 2024-02-21T07:55:16.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.244+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933ba8f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.244+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933bac2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.244+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 0x55933bad8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.244+0000 7f958aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933ba8f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.245+0000 7f958aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933ba8f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39118/0 (socket says 172.21.15.100:39118) 2024-02-21T07:55:16.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.246+0000 7f958aa00640 1 -- 172.21.15.100:0/3681815101 learned_addr learned my addr 172.21.15.100:0/3681815101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bafa640 con 0x55933bada2c0 2024-02-21T07:55:16.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bb13600 con 0x55933bb0f960 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bafa850 con 0x55933bad99a0 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.245+0000 7f958a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933bac2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.245+0000 7f958b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 0x55933bad8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958a000640 1 -- 172.21.15.100:0/3681815101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 msgr2=0x55933ba8f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958a000640 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933ba8f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958a000640 1 -- 172.21.15.100:0/3681815101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 msgr2=0x55933bad8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958a000640 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 0x55933bad8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958a000640 1 -- 172.21.15.100:0/3681815101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55933b99b950 con 0x55933bada2c0 2024-02-21T07:55:16.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.248+0000 7f958b400640 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 0x55933bad8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:16.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.249+0000 7f958a000640 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933bac2e00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f957c000ea0 tx=0x7f957c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f8888cefceefa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.250+0000 7f9576a00640 1 -- 172.21.15.100:0/3681815101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c0053d0 con 0x55933bada2c0 2024-02-21T07:55:16.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.250+0000 7f9576a00640 1 -- 172.21.15.100:0/3681815101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c022070 con 0x55933bada2c0 2024-02-21T07:55:16.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.251+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 msgr2=0x55933bac2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.251+0000 7f9594bc8740 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933bac2e00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f957c000ea0 tx=0x7f957c00c000 comp rx=0 tx=0).stop 2024-02-21T07:55:16.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.252+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 shutdown_connections 2024-02-21T07:55:16.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.252+0000 7f9594bc8740 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bb0f960 0x55933bad8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.252+0000 7f9594bc8740 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933bac2e00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.252+0000 7f9594bc8740 1 --2- 172.21.15.100:0/3681815101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bad99a0 0x55933ba8f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.252+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 >> 172.21.15.100:0/3681815101 conn(0x55933ba605a0 msgr2=0x55933ba9dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.253+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 shutdown_connections 2024-02-21T07:55:16.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.253+0000 7f9594bc8740 1 -- 172.21.15.100:0/3681815101 wait complete. 2024-02-21T07:55:16.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.254+0000 7f9594bc8740 1 -- start start 2024-02-21T07:55:16.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.254+0000 7f9594bc8740 1 Processor -- start 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.256+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.256+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933ba8f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.256+0000 7f9594bc8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 0x55933ba9c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.256+0000 7f9594bc8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bb0f3b0 con 0x55933bada2c0 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.256+0000 7f9594bc8740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bb88250 con 0x55933bad99a0 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f9594bc8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55933bb3b120 con 0x55933bb0f960 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f9594bc8740 10 client.0 _ll_register_callbacks cb 0x7f957c001100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:16.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f958aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f958aa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34818/0 (socket says 172.21.15.100:34818) 2024-02-21T07:55:16.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f958aa00640 1 -- 172.21.15.100:0/1211091984 learned_addr learned my addr 172.21.15.100:0/1211091984 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:16.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.257+0000 7f958b400640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 0x55933ba9c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 -- 172.21.15.100:0/1211091984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 msgr2=0x55933bb13b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 -- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 msgr2=0x55933ba8f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933ba8f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 -- 172.21.15.100:0/1211091984 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958404e000 con 0x55933bb0f960 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958aa00640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f958b400640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 0x55933ba9c540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f958c1451d0 tx=0x7f958c069fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f47b5affcef544 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f956be00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:16.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c11dae0 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f958c111a40 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f957803e040 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f958c111c00 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f9594bc8740 10 client.7007 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.258+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55933b9ff4e0 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957803e040 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f958c119170 con 0x55933bb0f960 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f9594bc8740 10 client.7007 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f9594bc8740 10 client.7007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f9594bc8740 20 client.7007 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.259+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bb0da30 0x55933bac2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:16.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.260+0000 7f9594bc8740 4 client.7007 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:55:16.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.260+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55933b78c890 con 0x55933bb0da30 2024-02-21T07:55:16.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.260+0000 7f958aa00640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bb0da30 0x55933bac2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:16.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.263+0000 7f958aa00640 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bb0da30 0x55933bac2bf0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e5959947ead5065 server_cookie=4cc2848dba10507 in_seq=0 out_seq=0 2024-02-21T07:55:16.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.264+0000 7f956be00640 10 client.7007 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.265+0000 7f956be00640 1 -- 172.21.15.100:0/1211091984 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55933b78c890 con 0x55933bb0da30 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.265+0000 7f956be00640 10 client.7007 handle_command_reply: tid=0 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 client.7007 shutdown 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 msgr2=0x55933ba9c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 0x55933ba9c540 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f958c1451d0 tx=0x7f958c069fe0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 shutdown_connections 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55933bb0da30 0x55933bac2bf0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55933bb0f960 0x55933ba9c540 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55933bada2c0 0x55933ba8f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 --2- 172.21.15.100:0/1211091984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55933bad99a0 0x55933bb13b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f956be00640 0 client.7007 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 >> 172.21.15.100:0/1211091984 conn(0x55933ba605a0 msgr2=0x55933ba9dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 shutdown_connections 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 1 -- 172.21.15.100:0/1211091984 wait complete. 2024-02-21T07:55:16.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.266+0000 7f9594bc8740 20 client.7007 trim_cache size 0 max 16384 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "a64741dd-0bdd-46b4-9996-5b3663e9231a": { 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "a64741dd-0bdd-46b4-9996-5b3663e9231a", 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:55:16.270 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.267+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 msgr2=0x7f956c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.267+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 0x7f956c0a1560 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f957800a000 comp rx=0 tx=0).stop 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.267+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 msgr2=0x7f958404dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.267+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 0x7f958404dac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f958c04fc90 tx=0x7f958c068050 comp rx=0 tx=0).stop 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 shutdown_connections 2024-02-21T07:55:16.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f956c09f0a0 0x7f956c0a1560 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f958410d780 0x7f958404dac0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f958410a1e0 0x7f958404d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 --2- 172.21.15.100:0/1753515848 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f95841096f0 0x7f958407d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 >> 172.21.15.100:0/1753515848 conn(0x7f9584052de0 msgr2=0x7f9584079350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 shutdown_connections 2024-02-21T07:55:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:16.268+0000 7f958be00640 1 -- 172.21.15.100:0/1753515848 wait complete. 2024-02-21T07:55:16.315 INFO:tasks.cephfs.filesystem:scrub status for tag:a64741dd-0bdd-46b4-9996-5b3663e9231a - {'path': '/', 'tag': 'a64741dd-0bdd-46b4-9996-5b3663e9231a', 'options': 'recursive,force'} 2024-02-21T07:55:17.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:17.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:17.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:25.700 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.696+0000 7fe7ba400640 1 Processor -- start 2024-02-21T07:55:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.698+0000 7fe7ba400640 1 -- start start 2024-02-21T07:55:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7b2a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe7b40f61d0 0x7fe7b41901a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:59302/0 (socket says 172.21.15.100:59302) 2024-02-21T07:55:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7b3400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe7b418a590 0x7fe7b40cd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:41484/0 (socket says 172.21.15.100:41484) 2024-02-21T07:55:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7b2a00640 1 -- 172.21.15.100:0/1899647793 learned_addr learned my addr 172.21.15.100:0/1899647793 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cc0e0 con 0x7fe7b40f5670 2024-02-21T07:55:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cc380 con 0x7fe7b40f61d0 2024-02-21T07:55:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.703+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cc660 con 0x7fe7b418a590 2024-02-21T07:55:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.704+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653601043 0 0) 0x7fe7b40cc380 con 0x7fe7b40f61d0 2024-02-21T07:55:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.704+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe798003520 con 0x7fe7b40f61d0 2024-02-21T07:55:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.704+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759647082 0 0) 0x7fe7b40cc0e0 con 0x7fe7b40f5670 2024-02-21T07:55:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b40cc380 con 0x7fe7b40f5670 2024-02-21T07:55:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415217226 0 0) 0x7fe7b40cc660 con 0x7fe7b418a590 2024-02-21T07:55:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b40cc0e0 con 0x7fe7b418a590 2024-02-21T07:55:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526031772 0 0) 0x7fe7b40cc380 con 0x7fe7b40f5670 2024-02-21T07:55:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 >> v1:172.21.15.170:6789/0 conn(0x7fe7b418a590 legacy=0x7fe7b40cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 >> v1:172.21.15.156:6789/0 conn(0x7fe7b40f61d0 legacy=0x7fe7b41901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40cc940 con 0x7fe7b40f5670 2024-02-21T07:55:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fe7ac0015d0 con 0x7fe7b40f5670 2024-02-21T07:55:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 >> v1:172.21.15.100:6789/0 conn(0x7fe7b40f5670 legacy=0x7fe7b41908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe798004d50 0x7fe798005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7980037d0 0x7fe798003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 0x7fe79800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0001230 con 0x7fe798004360 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79800c300 con 0x7fe798004d50 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.705+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79800c4c0 con 0x7fe7980037d0 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 0x7fe79800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3400640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe798004d50 0x7fe798005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 -- 172.21.15.100:0/1899647793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7980037d0 msgr2=0x7fe798003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7980037d0 0x7fe798003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 -- 172.21.15.100:0/1899647793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe798004d50 msgr2=0x7fe798005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe798004d50 0x7fe798005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.707+0000 7fe7b3e00640 1 -- 172.21.15.100:0/1899647793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40cc940 con 0x7fe798004360 2024-02-21T07:55:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.708+0000 7fe7b3400640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe798004d50 0x7fe798005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.719+0000 7fe7b3e00640 1 -- 172.21.15.100:0/1899647793 reap_dead start 2024-02-21T07:55:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.719+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 0x7fe79800ba20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c2e0 tx=0x7fe7980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178ea352cd09c25 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.720+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac02cb90 con 0x7fe798004360 2024-02-21T07:55:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.720+0000 7fe7b2000640 1 -- 172.21.15.100:0/1899647793 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac02ccf0 con 0x7fe798004360 2024-02-21T07:55:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.722+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 msgr2=0x7fe79800ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.722+0000 7fe7ba400640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 0x7fe79800ba20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c2e0 tx=0x7fe7980057f0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.742+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 shutdown_connections 2024-02-21T07:55:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.742+0000 7fe7ba400640 1 --2- 172.21.15.100:0/1899647793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe798004360 0x7fe79800ba20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.742+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 >> 172.21.15.100:0/1899647793 conn(0x7fe7b40ce1b0 msgr2=0x7fe7b40ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.749 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.745+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 shutdown_connections 2024-02-21T07:55:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.745+0000 7fe7ba400640 1 -- 172.21.15.100:0/1899647793 wait complete. 2024-02-21T07:55:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.754+0000 7fe7ba400640 1 Processor -- start 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.755+0000 7fe7ba400640 1 -- start start 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 0x7fe7b4221c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 0x7fe7b4175b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 0x7fe7b41760d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b42217d0 con 0x7fe7b42221a0 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b42208e0 con 0x7fe7b41871d0 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7ba400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4220bc0 con 0x7fe798004360 2024-02-21T07:55:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 0x7fe7b4175b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 0x7fe7b4175b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53580/0 (socket says 172.21.15.100:53580) 2024-02-21T07:55:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7b2a00640 1 -- 172.21.15.100:0/2735879078 learned_addr learned my addr 172.21.15.100:0/2735879078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.757+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 0x7fe7b41760d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.758+0000 7fe7b3e00640 1 -- 172.21.15.100:0/2735879078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 msgr2=0x7fe7b4221c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.758+0000 7fe7b3400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 0x7fe7b4221c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.759+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 0x7fe7b4221c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.759+0000 7fe7b3e00640 1 -- 172.21.15.100:0/2735879078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 msgr2=0x7fe7b4175b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.759+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 0x7fe7b4175b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.759+0000 7fe7b3e00640 1 -- 172.21.15.100:0/2735879078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4220ea0 con 0x7fe7b41871d0 2024-02-21T07:55:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.759+0000 7fe7b3400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 0x7fe7b4221c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.760+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 0x7fe7b41760d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ed100 tx=0x7fe7ac001890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.760+0000 7fe7ab400640 1 -- 172.21.15.100:0/2735879078 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac043070 con 0x7fe7b41871d0 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.761+0000 7fe7ab400640 1 -- 172.21.15.100:0/2735879078 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0013d0 con 0x7fe7b41871d0 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.761+0000 7fe7ab400640 1 -- 172.21.15.100:0/2735879078 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac043070 con 0x7fe7b41871d0 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.761+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b4221180 con 0x7fe7b41871d0 2024-02-21T07:55:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.761+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b42205a0 con 0x7fe7b41871d0 2024-02-21T07:55:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.771+0000 7fe7ab400640 1 -- 172.21.15.100:0/2735879078 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe7ac03b040 con 0x7fe7b41871d0 2024-02-21T07:55:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.771+0000 7fe7bd223740 1 Processor -- start 2024-02-21T07:55:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.771+0000 7fe7bd223740 1 -- start start 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039df450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56110395f620 con 0x561103a134d0 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611039118c0 con 0x5611039df070 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7bd223740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56110390edf0 con 0x5611039a3f90 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56140/0 (socket says 172.21.15.100:56140) 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3405837475 learned_addr learned my addr 172.21.15.100:0/3405837475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.774+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039df450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3405837475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 msgr2=0x5611039df450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039df450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3405837475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 msgr2=0x5611039a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3405837475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56110388bb00 con 0x5611039df070 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7ab400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 0x7fe7940a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7ab400640 1 -- 172.21.15.100:0/2735879078 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7ac0ea770 con 0x7fe7b41871d0 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00167e0 tx=0x7fe7a0001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f05c406ab10cf2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.775+0000 7fe7b3400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 0x7fe7940a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.776+0000 7fe79fe00640 1 -- 172.21.15.100:0/3405837475 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00060d0 con 0x5611039df070 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.776+0000 7fe79fe00640 1 -- 172.21.15.100:0/3405837475 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0006230 con 0x5611039df070 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.776+0000 7fe79fe00640 1 -- 172.21.15.100:0/3405837475 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00065a0 con 0x5611039df070 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 -- 172.21.15.100:0/3405837475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 msgr2=0x56110399e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00167e0 tx=0x7fe7a0001e70 comp rx=0 tx=0).stop 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 -- 172.21.15.100:0/3405837475 shutdown_connections 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039df450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.785 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3405837475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x56110399e440 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.777+0000 7fe7bd223740 1 -- 172.21.15.100:0/3405837475 >> 172.21.15.100:0/3405837475 conn(0x56110396b4b0 msgr2=0x5611039a2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.778+0000 7fe7b3400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 0x7fe7940a1670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007fd0 tx=0x7fe7a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.783+0000 7fe7bd223740 1 -- 172.21.15.100:0/3405837475 shutdown_connections 2024-02-21T07:55:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.783+0000 7fe7bd223740 1 -- 172.21.15.100:0/3405837475 wait complete. 2024-02-21T07:55:25.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.784+0000 7fe7bd223740 1 -- start start 2024-02-21T07:55:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.784+0000 7fe7bd223740 1 Processor -- start 2024-02-21T07:55:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.787+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039d9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.790 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.791 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56110390a5d0 con 0x561103a134d0 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611038afb50 con 0x5611039df070 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611038af7f0 con 0x5611039a3f90 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7bd223740 10 client.0 _ll_register_callbacks cb 0x5611038c3550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56144/0 (socket says 172.21.15.100:56144) 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3428352101 learned_addr learned my addr 172.21.15.100:0/3428352101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039d9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.792 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3428352101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 msgr2=0x5611039d9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039d9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 msgr2=0x5611039d4a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039d4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b2a00640 1 -- 172.21.15.100:0/3428352101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a0016490 con 0x5611039df070 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.788+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0006780 tx=0x7fe7a0001d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cde93953ddc3f1fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.793 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe79cc00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00047e0 con 0x5611039df070 2024-02-21T07:55:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611038dccd0 con 0x5611039df070 2024-02-21T07:55:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7a0004940 con 0x5611039df070 2024-02-21T07:55:25.794 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a0004b00 con 0x5611039df070 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe7bd223740 10 client.7099 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.789+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561103908c50 con 0x5611039df070 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.790+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a002e020 con 0x5611039df070 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.790+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7a0020070 con 0x5611039df070 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 10 client.7099 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 10 client.7099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 20 client.7099 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a16750 0x561103a26950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 4 client.7099 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561103900ce0 con 0x561103a16750 2024-02-21T07:55:25.795 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.791+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a16750 0x561103a26950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.792+0000 7fe7b3400640 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a16750 0x561103a26950 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a34bdab584dacda8 server_cookie=2bee327296abdcf5 in_seq=0 out_seq=0 2024-02-21T07:55:25.796 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.793+0000 7fe79cc00640 10 client.7099 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.794+0000 7fe79cc00640 1 -- 172.21.15.100:0/3428352101 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561103900ce0 con 0x561103a16750 2024-02-21T07:55:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.794+0000 7fe79cc00640 10 client.7099 handle_command_reply: tid=0 2024-02-21T07:55:25.798 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.795+0000 7fe7bd223740 1 client.7099 shutdown 2024-02-21T07:55:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 msgr2=0x5611039ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.803 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0006780 tx=0x7fe7a0001d60 comp rx=0 tx=0).stop 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 shutdown_connections 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a16750 0x561103a26950 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561103a134d0 0x5611039d4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x5611039ceea0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 --2- 172.21.15.100:0/3428352101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039a3f90 0x5611039d9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.800+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 >> 172.21.15.100:0/3428352101 conn(0x56110396b4b0 msgr2=0x561103a13950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.804 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.801+0000 7fe79cc00640 0 client.7099 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.801+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 shutdown_connections 2024-02-21T07:55:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.802+0000 7fe7bd223740 1 -- 172.21.15.100:0/3428352101 wait complete. 2024-02-21T07:55:25.805 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.802+0000 7fe7bd223740 20 client.7099 trim_cache size 0 max 16384 2024-02-21T07:55:25.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.829+0000 7fe7bd223740 1 Processor -- start 2024-02-21T07:55:25.832 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.829+0000 7fe7bd223740 1 -- start start 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.830+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x561103a71940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561103a134d0 0x561103a71e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7bd223740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561103652e60 con 0x5611039a3f90 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7bd223740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561103a13e30 con 0x5611039df070 2024-02-21T07:55:25.834 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7bd223740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611039d0250 con 0x561103a134d0 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7b3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7b3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53598/0 (socket says 172.21.15.100:53598) 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.831+0000 7fe7b3400640 1 -- 172.21.15.100:0/1159736239 learned_addr learned my addr 172.21.15.100:0/1159736239 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x561103a71940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3e00640 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561103a134d0 0x561103a71e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3400640 1 -- 172.21.15.100:0/1159736239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561103a134d0 msgr2=0x561103a71e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3400640 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561103a134d0 0x561103a71e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3400640 1 -- 172.21.15.100:0/1159736239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 msgr2=0x561103a71940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3400640 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x561103a71940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.832+0000 7fe7b3400640 1 -- 172.21.15.100:0/1159736239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611039dc900 con 0x5611039a3f90 2024-02-21T07:55:25.836 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.833+0000 7fe7b3400640 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007040 tx=0x7fe7a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99f2e699cc6743c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.833+0000 7fe79f400640 1 -- 172.21.15.100:0/1159736239 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40238d0 con 0x5611039a3f90 2024-02-21T07:55:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.833+0000 7fe79f400640 1 -- 172.21.15.100:0/1159736239 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40070d0 con 0x5611039a3f90 2024-02-21T07:55:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.833+0000 7fe79f400640 1 -- 172.21.15.100:0/1159736239 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007440 con 0x5611039a3f90 2024-02-21T07:55:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.835+0000 7fe7bd223740 1 -- 172.21.15.100:0/1159736239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 msgr2=0x561103a32fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.836+0000 7fe7bd223740 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007040 tx=0x7fe7a4012000 comp rx=0 tx=0).stop 2024-02-21T07:55:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 -- 172.21.15.100:0/1159736239 shutdown_connections 2024-02-21T07:55:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561103a134d0 0x561103a71e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611039df070 0x561103a71940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 --2- 172.21.15.100:0/1159736239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a32fc0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 -- 172.21.15.100:0/1159736239 >> 172.21.15.100:0/1159736239 conn(0x56110396b4b0 msgr2=0x561103999bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 -- 172.21.15.100:0/1159736239 shutdown_connections 2024-02-21T07:55:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.838+0000 7fe7bd223740 1 -- 172.21.15.100:0/1159736239 wait complete. 2024-02-21T07:55:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.840+0000 7fe7bd223740 1 -- start start 2024-02-21T07:55:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.840+0000 7fe7bd223740 1 Processor -- start 2024-02-21T07:55:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a12710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 0x5611039d32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 0x5611039d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561103a7e1b0 con 0x5611039a3f90 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561103a13330 con 0x561103a134d0 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561103a12d70 con 0x5611039df070 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.843+0000 7fe7bd223740 10 client.0 _ll_register_callbacks cb 0x7fe7a00069c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 0x5611039d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b3e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 0x5611039d24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56162/0 (socket says 172.21.15.100:56162) 2024-02-21T07:55:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b3e00640 1 -- 172.21.15.100:0/422563004 learned_addr learned my addr 172.21.15.100:0/422563004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 0x5611039d32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b3400640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 -- 172.21.15.100:0/422563004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 msgr2=0x5611039d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 0x5611039d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 -- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 msgr2=0x561103a12710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a12710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.844+0000 7fe7b2a00640 1 -- 172.21.15.100:0/422563004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40cc0e0 con 0x5611039df070 2024-02-21T07:55:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.845+0000 7fe7b2a00640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 0x5611039d32e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000f60 tx=0x7fe7a0006af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2248655cf4fecd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.845+0000 7fe79cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:25.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0007e40 con 0x5611039df070 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56110392fd30 con 0x5611039df070 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7a002f080 con 0x5611039df070 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a00049f0 con 0x5611039df070 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe7bd223740 10 client.7019 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5611038a5530 con 0x5611039df070 2024-02-21T07:55:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.846+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a003f080 con 0x5611039df070 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe7a0031040 con 0x5611039df070 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 10 client.7019 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 10 client.7019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 20 client.7019 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a33480 0x561103a6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 4 client.7019 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:55:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.847+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56110360a600 con 0x561103a33480 2024-02-21T07:55:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.850+0000 7fe7b3400640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a33480 0x561103a6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:25.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.851+0000 7fe7b3400640 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a33480 0x561103a6ade0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4804024c5e56de6f server_cookie=2894a1e7c9d4c92 in_seq=0 out_seq=0 2024-02-21T07:55:25.857 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.851+0000 7fe79cc00640 10 client.7019 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.906+0000 7fe79cc00640 1 -- 172.21.15.100:0/422563004 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56110360a600 con 0x561103a33480 2024-02-21T07:55:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.906+0000 7fe79cc00640 10 client.7019 handle_command_reply: tid=0 2024-02-21T07:55:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.908+0000 7fe7bd223740 1 client.7019 shutdown 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 msgr2=0x5611039d32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 0x5611039d32e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0000f60 tx=0x7fe7a0006af0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 shutdown_connections 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561103a33480 0x561103a6ade0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561103a134d0 0x5611039d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.915 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611039df070 0x5611039d32e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 --2- 172.21.15.100:0/422563004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611039a3f90 0x561103a12710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.912+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 >> 172.21.15.100:0/422563004 conn(0x56110396b4b0 msgr2=0x5611039a10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.916 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.913+0000 7fe79cc00640 0 client.7019 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.913+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 shutdown_connections 2024-02-21T07:55:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.914+0000 7fe7bd223740 1 -- 172.21.15.100:0/422563004 wait complete. 2024-02-21T07:55:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.914+0000 7fe7bd223740 20 client.7019 trim_cache size 0 max 16384 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 msgr2=0x7fe7940a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 0x7fe7940a1670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4007fd0 tx=0x7fe7a4009040 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 msgr2=0x7fe7b41760d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 0x7fe7b41760d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ed100 tx=0x7fe7ac001890 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 shutdown_connections 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7b41871d0 0x7fe7b41760d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe79409f1b0 0x7fe7940a1670 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7b42221a0 0x7fe7b4175b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 --2- 172.21.15.100:0/2735879078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe798004360 0x7fe7b4221c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 >> 172.21.15.100:0/2735879078 conn(0x7fe7b40ce1b0 msgr2=0x7fe7b40ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 shutdown_connections 2024-02-21T07:55:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:25.916+0000 7fe7ba400640 1 -- 172.21.15.100:0/2735879078 wait complete. 2024-02-21T07:55:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.127+0000 7f13e2600640 1 Processor -- start 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.127+0000 7f13e2600640 1 -- start start 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13e2600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f13dc070010 0x7f13dc06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13e2600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13dc0f5800 0x7f13dc0f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13e2600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0f9490 con 0x7f13dc188a90 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13e2600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc06f930 con 0x7f13dc0f5800 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13e2600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc0f96c0 con 0x7f13dc070010 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13db400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f13dc188a90 0x7f13dc0f8d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:35170/0 (socket says 172.21.15.100:35170) 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.130+0000 7f13db400640 1 -- 172.21.15.100:0/3553315420 learned_addr learned my addr 172.21.15.100:0/3553315420 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214702356 0 0) 0x7f13dc0f9490 con 0x7f13dc188a90 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c0003520 con 0x7f13dc188a90 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1474796399 0 0) 0x7f13c0003520 con 0x7f13dc188a90 2024-02-21T07:55:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 >> v2:172.21.15.170:3300/0 conn(0x7f13dc070010 msgr2=0x7f13dc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13daa00640 1 --2- 172.21.15.100:0/3553315420 >> v2:172.21.15.170:3300/0 conn(0x7f13dc070010 0x7f13dc06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 --2- 172.21.15.100:0/3553315420 >> v2:172.21.15.170:3300/0 conn(0x7f13dc070010 0x7f13dc06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.131+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 >> v2:172.21.15.100:3300/0 conn(0x7f13dc0f5800 msgr2=0x7f13dc0f5c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13dbe00640 1 --2- 172.21.15.100:0/3553315420 >> v2:172.21.15.100:3300/0 conn(0x7f13dc0f5800 0x7f13dc0f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 --2- 172.21.15.100:0/3553315420 >> v2:172.21.15.100:3300/0 conn(0x7f13dc0f5800 0x7f13dc0f5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0f99a0 con 0x7f13dc188a90 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f13cc001670 con 0x7f13dc188a90 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 >> v1:172.21.15.156:6789/0 conn(0x7f13dc188a90 legacy=0x7f13dc0f8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 0x7f13c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c00047c0 0x7f13c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c00053d0 0x7f13c000ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc06f930 con 0x7f13c0003a10 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0f96c0 con 0x7f13c00053d0 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.136+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c000bb80 con 0x7f13c00047c0 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.137+0000 7f13db400640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 0x7f13c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.137+0000 7f13daa00640 1 --2- 172.21.15.100:0/3553315420 >> v2:172.21.15.170:3300/0 conn(0x7f13dc070010 0x7f13dc06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.137+0000 7f13daa00640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c00047c0 0x7f13c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.138+0000 7f13db400640 1 -- 172.21.15.100:0/3553315420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c00047c0 msgr2=0x7f13c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.138+0000 7f13db400640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c00047c0 0x7f13c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.138+0000 7f13db400640 1 -- 172.21.15.100:0/3553315420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c00053d0 msgr2=0x7f13c000ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.138+0000 7f13db400640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13c00053d0 0x7f13c000ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.138+0000 7f13db400640 1 -- 172.21.15.100:0/3553315420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0003520 con 0x7f13c0003a10 2024-02-21T07:55:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.139+0000 7f13db400640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 0x7f13c0003e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c110 tx=0x7f13c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6db173c783b75be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.142+0000 7f13dbe00640 1 -- 172.21.15.100:0/3553315420 reap_dead start 2024-02-21T07:55:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.143+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc005ad0 con 0x7f13c0003a10 2024-02-21T07:55:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.143+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc005c30 con 0x7f13c0003a10 2024-02-21T07:55:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.143+0000 7f13da000640 1 -- 172.21.15.100:0/3553315420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc02ca70 con 0x7f13c0003a10 2024-02-21T07:55:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.144+0000 7f13e2600640 1 -- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 msgr2=0x7f13c0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.144+0000 7f13e2600640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 0x7f13c0003e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c110 tx=0x7f13c00057f0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.144+0000 7f13e2600640 1 -- 172.21.15.100:0/3553315420 shutdown_connections 2024-02-21T07:55:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.144+0000 7f13e2600640 1 --2- 172.21.15.100:0/3553315420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c0003a10 0x7f13c0003e30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.144+0000 7f13e2600640 1 -- 172.21.15.100:0/3553315420 >> 172.21.15.100:0/3553315420 conn(0x7f13dc0cf350 msgr2=0x7f13dc0cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.145+0000 7f13e2600640 1 -- 172.21.15.100:0/3553315420 shutdown_connections 2024-02-21T07:55:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.145+0000 7f13e2600640 1 -- 172.21.15.100:0/3553315420 wait complete. 2024-02-21T07:55:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.149+0000 7f13e2600640 1 Processor -- start 2024-02-21T07:55:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.149+0000 7f13e2600640 1 -- start start 2024-02-21T07:55:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.152+0000 7f13e2600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c0003a10 0x7f13dc179ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.152+0000 7f13e2600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 0x7f13dc16b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.154+0000 7f13e2600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 0x7f13dc21ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.154+0000 7f13e2600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc174880 con 0x7f13dc16b230 2024-02-21T07:55:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.155+0000 7f13e2600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc174b60 con 0x7f13dc21c590 2024-02-21T07:55:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.155+0000 7f13e2600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc174e40 con 0x7f13c0003a10 2024-02-21T07:55:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.155+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 0x7f13dc21ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.159+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 0x7f13dc21ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:43586/0 (socket says 172.21.15.100:43586) 2024-02-21T07:55:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.156+0000 7f13daa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 0x7f13dc16b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.159+0000 7f13dbe00640 1 -- 172.21.15.100:0/1647675137 learned_addr learned my addr 172.21.15.100:0/1647675137 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.159+0000 7f13db400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c0003a10 0x7f13dc179ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.162+0000 7f13daa00640 1 -- 172.21.15.100:0/1647675137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c0003a10 msgr2=0x7f13dc179ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.162+0000 7f13daa00640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c0003a10 0x7f13dc179ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.162+0000 7f13daa00640 1 -- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 msgr2=0x7f13dc21ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.162+0000 7f13daa00640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 0x7f13dc21ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.162+0000 7f13daa00640 1 -- 172.21.15.100:0/1647675137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc21bd90 con 0x7f13dc16b230 2024-02-21T07:55:39.166 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.163+0000 7f13daa00640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 0x7f13dc16b6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f13c800f870 tx=0x7f13c800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.164+0000 7f13d3400640 1 -- 172.21.15.100:0/1647675137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800dbb0 con 0x7f13dc16b230 2024-02-21T07:55:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.164+0000 7f13d3400640 1 -- 172.21.15.100:0/1647675137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800c040 con 0x7f13dc16b230 2024-02-21T07:55:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.164+0000 7f13d3400640 1 -- 172.21.15.100:0/1647675137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8013440 con 0x7f13dc16b230 2024-02-21T07:55:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.164+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc21c070 con 0x7f13dc16b230 2024-02-21T07:55:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.164+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc21d130 con 0x7f13dc16b230 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.169+0000 7f13d3400640 1 -- 172.21.15.100:0/1647675137 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f13c80135a0 con 0x7f13dc16b230 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.172+0000 7f13d3400640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 0x7f13bc0a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.172+0000 7f13d3400640 1 -- 172.21.15.100:0/1647675137 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13c80ca280 con 0x7f13dc16b230 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.172+0000 7f13e536a740 1 Processor -- start 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.172+0000 7f13db400640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 0x7f13bc0a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.174+0000 7f13db400640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 0x7f13bc0a1660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13cc034000 tx=0x7f13cc007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.193+0000 7f13e536a740 1 -- start start 2024-02-21T07:55:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312e64d0 0x55cd31276a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd31276f90 0x55cd312b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.200 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd31232620 con 0x55cd31276f90 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd311e48c0 con 0x55cd312b2070 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13e536a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd311e1df0 con 0x55cd312e64d0 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:43602/0 (socket says 172.21.15.100:43602) 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.195+0000 7f13db400640 1 -- 172.21.15.100:0/579134648 learned_addr learned my addr 172.21.15.100:0/579134648 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13daa00640 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312e64d0 0x55cd31276a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 -- 172.21.15.100:0/579134648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312e64d0 msgr2=0x55cd31276a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312e64d0 0x55cd31276a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 -- 172.21.15.100:0/579134648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd31276f90 msgr2=0x55cd312b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd31276f90 0x55cd312b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 -- 172.21.15.100:0/579134648 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd3115eb00 con 0x55cd312b2070 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.196+0000 7f13db400640 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f13cc005f80 tx=0x7f13cc02e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0c0871b7cddbf6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.197+0000 7f13c7e00640 1 -- 172.21.15.100:0/579134648 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0014b0 con 0x55cd312b2070 2024-02-21T07:55:39.201 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.197+0000 7f13c7e00640 1 -- 172.21.15.100:0/579134648 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc03a070 con 0x55cd312b2070 2024-02-21T07:55:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.197+0000 7f13c7e00640 1 -- 172.21.15.100:0/579134648 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc001610 con 0x55cd312b2070 2024-02-21T07:55:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.198+0000 7f13e536a740 1 -- 172.21.15.100:0/579134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 msgr2=0x55cd31271440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.202 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.198+0000 7f13e536a740 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f13cc005f80 tx=0x7f13cc02e000 comp rx=0 tx=0).stop 2024-02-21T07:55:39.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.201+0000 7f13e536a740 1 -- 172.21.15.100:0/579134648 shutdown_connections 2024-02-21T07:55:39.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.201+0000 7f13e536a740 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd31276f90 0x55cd312b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.201+0000 7f13e536a740 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312e64d0 0x55cd31276a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.203 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.201+0000 7f13e536a740 1 --2- 172.21.15.100:0/579134648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd31271440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.204 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.201+0000 7f13e536a740 1 -- 172.21.15.100:0/579134648 >> 172.21.15.100:0/579134648 conn(0x55cd3123e4b0 msgr2=0x55cd31275ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.202+0000 7f13e536a740 1 -- 172.21.15.100:0/579134648 shutdown_connections 2024-02-21T07:55:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.202+0000 7f13e536a740 1 -- 172.21.15.100:0/579134648 wait complete. 2024-02-21T07:55:39.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.203+0000 7f13e536a740 1 -- start start 2024-02-21T07:55:39.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.204+0000 7f13e536a740 1 Processor -- start 2024-02-21T07:55:39.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.211+0000 7f13e536a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.211+0000 7f13e536a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.212+0000 7f13e536a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.213+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.213+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51330/0 (socket says 172.21.15.100:51330) 2024-02-21T07:55:39.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.213+0000 7f13db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.214+0000 7f13db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312dd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:43618/0 (socket says 172.21.15.100:43618) 2024-02-21T07:55:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.214+0000 7f13daa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.214+0000 7f13daa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:55460/0 (socket says 172.21.15.100:55460) 2024-02-21T07:55:39.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.218+0000 7f13dbe00640 1 -- 172.21.15.100:0/1805588944 learned_addr learned my addr 172.21.15.100:0/1805588944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.218+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd311dd5d0 con 0x55cd312e64d0 2024-02-21T07:55:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.218+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd31182b50 con 0x55cd31276f90 2024-02-21T07:55:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.218+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd311827f0 con 0x55cd312b2070 2024-02-21T07:55:39.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.220+0000 7f13e536a740 10 client.0 _ll_register_callbacks cb 0x55cd31196550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.226+0000 7f13daa00640 1 -- 172.21.15.100:0/1805588944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 msgr2=0x55cd312dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.226+0000 7f13daa00640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.226+0000 7f13daa00640 1 -- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 msgr2=0x55cd312dc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.226+0000 7f13daa00640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.226+0000 7f13daa00640 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0003520 con 0x55cd312b2070 2024-02-21T07:55:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.228+0000 7f13daa00640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f13c80c7c50 tx=0x7f13c8095fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a38d244a806737f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.229+0000 7f13c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.231+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c809bf10 con 0x55cd312b2070 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.231+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13c80a0560 con 0x55cd312b2070 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd311afcd0 con 0x55cd312b2070 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13dbe00640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13c80b5250 con 0x55cd312b2070 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13e536a740 10 client.7028 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cd311dbc50 con 0x55cd312b2070 2024-02-21T07:55:39.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.233+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd311afcd0 con 0x55cd312b2070 2024-02-21T07:55:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.234+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f13c8019020 con 0x55cd312b2070 2024-02-21T07:55:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 10 client.7028 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 10 client.7028 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 20 client.7028 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312a90b0 0x55cd312a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 4 client.7028 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.235+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd311d3ce0 con 0x55cd312a90b0 2024-02-21T07:55:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.238+0000 7f13db400640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312a90b0 0x55cd312a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.239+0000 7f13db400640 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312a90b0 0x55cd312a9490 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136a48d67fff2712 server_cookie=8240438e8927c3d7 in_seq=0 out_seq=0 2024-02-21T07:55:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.244+0000 7f13c4c00640 10 client.7028 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.247+0000 7f13c4c00640 1 -- 172.21.15.100:0/1805588944 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cd311d3ce0 con 0x55cd312a90b0 2024-02-21T07:55:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.247+0000 7f13c4c00640 10 client.7028 handle_command_reply: tid=0 2024-02-21T07:55:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.247+0000 7f13e536a740 1 client.7028 shutdown 2024-02-21T07:55:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 msgr2=0x55cd312f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f13c80c7c50 tx=0x7f13c8095fc0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 shutdown_connections 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312a90b0 0x55cd312a9490 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312dc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312f7af0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 --2- 172.21.15.100:0/1805588944 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 >> 172.21.15.100:0/1805588944 conn(0x55cd3123e4b0 msgr2=0x55cd3127ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.253+0000 7f13c4c00640 0 client.7028 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.254+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 shutdown_connections 2024-02-21T07:55:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.254+0000 7f13e536a740 1 -- 172.21.15.100:0/1805588944 wait complete. 2024-02-21T07:55:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.254+0000 7f13e536a740 20 client.7028 trim_cache size 0 max 16384 2024-02-21T07:55:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.294+0000 7f13e536a740 1 Processor -- start 2024-02-21T07:55:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.294+0000 7f13e536a740 1 -- start start 2024-02-21T07:55:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.296+0000 7f13e536a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.296+0000 7f13e536a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312a2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.296+0000 7f13e536a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13e536a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd312e01a0 con 0x55cd312e64d0 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13e536a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd30f25e60 con 0x55cd31276f90 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13e536a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd312725c0 con 0x55cd312b2070 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13dbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51346/0 (socket says 172.21.15.100:51346) 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13dbe00640 1 -- 172.21.15.100:0/3111338679 learned_addr learned my addr 172.21.15.100:0/3111338679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.297+0000 7f13daa00640 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.298+0000 7f13dbe00640 1 -- 172.21.15.100:0/3111338679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 msgr2=0x55cd312a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.298+0000 7f13dbe00640 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.298+0000 7f13dbe00640 1 -- 172.21.15.100:0/3111338679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 msgr2=0x55cd312f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.298+0000 7f13dbe00640 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.298+0000 7f13dbe00640 1 -- 172.21.15.100:0/3111338679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd31178530 con 0x55cd312e64d0 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.299+0000 7f13dbe00640 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007c20 tx=0x7f13d4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4606d155bbf03c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.299+0000 7f13c7400640 1 -- 172.21.15.100:0/3111338679 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d400fd10 con 0x55cd312e64d0 2024-02-21T07:55:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.300+0000 7f13c7400640 1 -- 172.21.15.100:0/3111338679 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400fe70 con 0x55cd312e64d0 2024-02-21T07:55:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.300+0000 7f13c7400640 1 -- 172.21.15.100:0/3111338679 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4003bd0 con 0x55cd312e64d0 2024-02-21T07:55:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.302+0000 7f13e536a740 1 -- 172.21.15.100:0/3111338679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 msgr2=0x55cd3127cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.302+0000 7f13e536a740 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f13d4007c20 tx=0x7f13d4007d10 comp rx=0 tx=0).stop 2024-02-21T07:55:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 -- 172.21.15.100:0/3111338679 shutdown_connections 2024-02-21T07:55:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd3127cde0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd312b2070 0x55cd312a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 --2- 172.21.15.100:0/3111338679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd31276f90 0x55cd312f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 -- 172.21.15.100:0/3111338679 >> 172.21.15.100:0/3111338679 conn(0x55cd3123e4b0 msgr2=0x55cd3126cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.303+0000 7f13e536a740 1 -- 172.21.15.100:0/3111338679 shutdown_connections 2024-02-21T07:55:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.304+0000 7f13e536a740 1 -- 172.21.15.100:0/3111338679 wait complete. 2024-02-21T07:55:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.305+0000 7f13e536a740 1 -- start start 2024-02-21T07:55:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.306+0000 7f13e536a740 1 Processor -- start 2024-02-21T07:55:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.308+0000 7f13e536a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 0x55cd312adc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.309+0000 7f13e536a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.309+0000 7f13e536a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312df750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13daa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13daa00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:43632/0 (socket says 172.21.15.100:43632) 2024-02-21T07:55:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13daa00640 1 -- 172.21.15.100:0/1582369247 learned_addr learned my addr 172.21.15.100:0/1582369247 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13db400640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 0x55cd312adc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd312dfc90 con 0x55cd312e64d0 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd31353ed0 con 0x55cd312b2070 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd312f8fa0 con 0x55cd31276f90 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.310+0000 7f13e536a740 10 client.0 _ll_register_callbacks cb 0x7f13c0010600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.311+0000 7f13dbe00640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.311+0000 7f13daa00640 1 -- 172.21.15.100:0/1582369247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 msgr2=0x55cd312adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.312+0000 7f13daa00640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 0x55cd312adc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.312+0000 7f13daa00640 1 -- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 msgr2=0x55cd312df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.312+0000 7f13daa00640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.312+0000 7f13daa00640 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d40078c0 con 0x55cd312b2070 2024-02-21T07:55:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.313+0000 7f13db400640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 0x55cd312adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.313+0000 7f13dbe00640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.314+0000 7f13daa00640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f13c8097d50 tx=0x7f13c8096030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd24abf910d5ee9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.314+0000 7f13c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.314+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80bb030 con 0x55cd312b2070 2024-02-21T07:55:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.314+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13c80bc070 con 0x55cd312b2070 2024-02-21T07:55:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.314+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd31202d30 con 0x55cd312b2070 2024-02-21T07:55:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.315+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13c80b5250 con 0x55cd312b2070 2024-02-21T07:55:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.315+0000 7f13e536a740 10 client.7120 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.315+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55cd3119e2c0 con 0x55cd312b2070 2024-02-21T07:55:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.315+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd31202d30 con 0x55cd312b2070 2024-02-21T07:55:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.315+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f13c8011040 con 0x55cd312b2070 2024-02-21T07:55:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 10 client.7120 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 10 client.7120 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 20 client.7120 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312b18a0 0x55cd312a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 4 client.7120 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:55:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.317+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cd30edd600 con 0x55cd312b18a0 2024-02-21T07:55:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.318+0000 7f13db400640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312b18a0 0x55cd312a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.320+0000 7f13db400640 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312b18a0 0x55cd312a58c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de64c50559f638b3 server_cookie=85a8792fd8b8aadf in_seq=0 out_seq=0 2024-02-21T07:55:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.320+0000 7f13c4c00640 10 client.7120 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.377+0000 7f13c4c00640 1 -- 172.21.15.100:0/1582369247 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cd30edd600 con 0x55cd312b18a0 2024-02-21T07:55:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.377+0000 7f13c4c00640 10 client.7120 handle_command_reply: tid=0 2024-02-21T07:55:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.377+0000 7f13e536a740 1 client.7120 shutdown 2024-02-21T07:55:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.378+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 msgr2=0x55cd3127c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.378+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f13c8097d50 tx=0x7f13c8096030 comp rx=0 tx=0).stop 2024-02-21T07:55:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.378+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 shutdown_connections 2024-02-21T07:55:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55cd312b18a0 0x55cd312a58c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd312e64d0 0x55cd312df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cd312b2070 0x55cd3127c4d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 --2- 172.21.15.100:0/1582369247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55cd31276f90 0x55cd312adc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 >> 172.21.15.100:0/1582369247 conn(0x55cd3123e4b0 msgr2=0x55cd312a2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13c4c00640 0 client.7120 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 shutdown_connections 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 1 -- 172.21.15.100:0/1582369247 wait complete. 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.379+0000 7f13e536a740 20 client.7120 trim_cache size 0 max 16384 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:55:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:55:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:55:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 msgr2=0x7f13bc0a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 0x7f13bc0a1660 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f13cc034000 tx=0x7f13cc007000 comp rx=0 tx=0).stop 2024-02-21T07:55:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 msgr2=0x7f13dc16b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 0x7f13dc16b6b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f13c800f870 tx=0x7f13c800fd30 comp rx=0 tx=0).stop 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 shutdown_connections 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13dc21c590 0x7f13dc21ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13bc09f1a0 0x7f13bc0a1660 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc16b230 0x7f13dc16b6b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 --2- 172.21.15.100:0/1647675137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13c0003a10 0x7f13dc179ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.380+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 >> 172.21.15.100:0/1647675137 conn(0x7f13dc0cf350 msgr2=0x7f13dc187f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.381+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 shutdown_connections 2024-02-21T07:55:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:39.381+0000 7f13e2600640 1 -- 172.21.15.100:0/1647675137 wait complete. 2024-02-21T07:55:46.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:55:46.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:55:46.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.794+0000 7f01dd200640 1 Processor -- start 2024-02-21T07:55:46.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.795+0000 7f01dd200640 1 -- start start 2024-02-21T07:55:46.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.798+0000 7f01dd200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 0x7f01d806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.798+0000 7f01dd200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01d806ebf0 0x7f01d8190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.798+0000 7f01dd200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d818dc80 con 0x7f01d8190260 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.798+0000 7f01dd200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d806f060 con 0x7f01d806ebf0 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.798+0000 7f01dd200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d80f5b90 con 0x7f01d8070a30 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d5400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 0x7f01d806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f01d806ebf0 0x7f01d8190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d5400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 0x7f01d806e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55974/0 (socket says 172.21.15.100:55974) 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d5400640 1 -- 172.21.15.100:0/3181859451 learned_addr learned my addr 172.21.15.100:0/3181859451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d6800640 1 -- 172.21.15.100:0/3181859451 >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 msgr2=0x7f01d806e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d6800640 1 --2- 172.21.15.100:0/3181859451 >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 0x7f01d806e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d6800640 1 -- 172.21.15.100:0/3181859451 >> v1:172.21.15.170:6789/0 conn(0x7f01d8190260 legacy=0x7f01d80f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.799+0000 7f01d6800640 1 -- 172.21.15.100:0/3181859451 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80f55d0 con 0x7f01d806ebf0 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.801+0000 7f01d6800640 1 --2- 172.21.15.100:0/3181859451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d806ebf0 0x7f01d8190640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f01d808d410 tx=0x7f01c802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b763dddf1d7e096 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.801+0000 7f01d4a00640 1 -- 172.21.15.100:0/3181859451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8031710 con 0x7f01d806ebf0 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.801+0000 7f01d4a00640 1 -- 172.21.15.100:0/3181859451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c802f050 con 0x7f01d806ebf0 2024-02-21T07:55:46.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.802+0000 7f01d4a00640 1 -- 172.21.15.100:0/3181859451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8031a90 con 0x7f01d806ebf0 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.802+0000 7f01dd200640 1 -- 172.21.15.100:0/3181859451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d806ebf0 msgr2=0x7f01d8190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.802+0000 7f01dd200640 1 --2- 172.21.15.100:0/3181859451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d806ebf0 0x7f01d8190640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f01d808d410 tx=0x7f01c802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.803+0000 7f01dd200640 1 -- 172.21.15.100:0/3181859451 shutdown_connections 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.803+0000 7f01dd200640 1 --2- 172.21.15.100:0/3181859451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d806ebf0 0x7f01d8190640 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.803+0000 7f01dd200640 1 --2- 172.21.15.100:0/3181859451 >> v2:172.21.15.156:3300/0 conn(0x7f01d8070a30 0x7f01d806e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.803+0000 7f01dd200640 1 -- 172.21.15.100:0/3181859451 >> 172.21.15.100:0/3181859451 conn(0x7f01d80668b0 msgr2=0x7f01d8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.804+0000 7f01dd200640 1 -- 172.21.15.100:0/3181859451 shutdown_connections 2024-02-21T07:55:46.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.804+0000 7f01dd200640 1 -- 172.21.15.100:0/3181859451 wait complete. 2024-02-21T07:55:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.808+0000 7f01dd200640 1 Processor -- start 2024-02-21T07:55:46.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.808+0000 7f01dd200640 1 -- start start 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d806ebf0 0x7f01d8175360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01d8190260 0x7f01d822c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d822c850 con 0x7f01d8070a30 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d818f910 con 0x7f01d8190260 2024-02-21T07:55:46.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.810+0000 7f01dd200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d818fbf0 con 0x7f01d806ebf0 2024-02-21T07:55:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.811+0000 7f01d5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.811+0000 7f01d5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46408/0 (socket says 172.21.15.100:46408) 2024-02-21T07:55:46.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.811+0000 7f01d5400640 1 -- 172.21.15.100:0/779384715 learned_addr learned my addr 172.21.15.100:0/779384715 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.811+0000 7f01d5e00640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d806ebf0 0x7f01d8175360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.813+0000 7f01d6800640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01d8190260 0x7f01d822c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.817+0000 7f01d5400640 1 -- 172.21.15.100:0/779384715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d806ebf0 msgr2=0x7f01d8175360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.817+0000 7f01d5400640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d806ebf0 0x7f01d8175360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.817+0000 7f01d5400640 1 -- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01d8190260 msgr2=0x7f01d822c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.817+0000 7f01d5400640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01d8190260 0x7f01d822c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.817+0000 7f01d5400640 1 -- 172.21.15.100:0/779384715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8009400 con 0x7f01d8070a30 2024-02-21T07:55:46.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.839+0000 7f01d5400640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d7d0 tx=0x7f01c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.843+0000 7f01ce000640 1 -- 172.21.15.100:0/779384715 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40096a0 con 0x7f01d8070a30 2024-02-21T07:55:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.843+0000 7f01ce000640 1 -- 172.21.15.100:0/779384715 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4009800 con 0x7f01d8070a30 2024-02-21T07:55:46.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.843+0000 7f01ce000640 1 -- 172.21.15.100:0/779384715 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4009bb0 con 0x7f01d8070a30 2024-02-21T07:55:46.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.846+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d818fed0 con 0x7f01d8070a30 2024-02-21T07:55:46.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.846+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80cbd50 con 0x7f01d8070a30 2024-02-21T07:55:46.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.866+0000 7f01ce000640 1 -- 172.21.15.100:0/779384715 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f01c4009d10 con 0x7f01d8070a30 2024-02-21T07:55:46.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.868+0000 7f01ce000640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 0x7f01b80a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.868+0000 7f01ce000640 1 -- 172.21.15.100:0/779384715 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01c40ca300 con 0x7f01d8070a30 2024-02-21T07:55:46.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.870+0000 7f01d5e00640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 0x7f01b80a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.872+0000 7f01d5e00640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 0x7f01b80a1630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01d00012e0 tx=0x7f01d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.876+0000 7f01dff8b740 1 Processor -- start 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.888+0000 7f01dff8b740 1 -- start start 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a50a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x5571549ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557154952150 con 0x557154a1afc0 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715494f680 con 0x557154a1b8e0 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01dff8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715494ae60 con 0x557154a50f80 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53312/0 (socket says 172.21.15.100:53312) 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 -- 172.21.15.100:0/1274435417 learned_addr learned my addr 172.21.15.100:0/1274435417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 -- 172.21.15.100:0/1274435417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 msgr2=0x5571549ddef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x5571549ddef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 -- 172.21.15.100:0/1274435417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 msgr2=0x557154a50a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a50a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.890+0000 7f01d5400640 1 -- 172.21.15.100:0/1274435417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557154904060 con 0x557154a50f80 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.891+0000 7f01d5400640 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f01c40a0050 tx=0x7f01c4097de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4775de4df8d57c72 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.891+0000 7f01c2a00640 1 -- 172.21.15.100:0/1274435417 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40a0580 con 0x557154a50f80 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.891+0000 7f01c2a00640 1 -- 172.21.15.100:0/1274435417 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4095e80 con 0x557154a50f80 2024-02-21T07:55:46.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.891+0000 7f01c2a00640 1 -- 172.21.15.100:0/1274435417 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4094450 con 0x557154a50f80 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.893+0000 7f01dff8b740 1 -- 172.21.15.100:0/1274435417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 msgr2=0x557154a1b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.893+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f01c40a0050 tx=0x7f01c4097de0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 -- 172.21.15.100:0/1274435417 shutdown_connections 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x5571549ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154a1b3a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1274435417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a50a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 -- 172.21.15.100:0/1274435417 >> 172.21.15.100:0/1274435417 conn(0x5571549aa5a0 msgr2=0x5571549e1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 -- 172.21.15.100:0/1274435417 shutdown_connections 2024-02-21T07:55:46.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.894+0000 7f01dff8b740 1 -- 172.21.15.100:0/1274435417 wait complete. 2024-02-21T07:55:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.895+0000 7f01dff8b740 1 -- start start 2024-02-21T07:55:46.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.895+0000 7f01dff8b740 1 Processor -- start 2024-02-21T07:55:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a11270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 0x557154a18c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571548efec0 con 0x557154a1afc0 2024-02-21T07:55:46.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571548efb60 con 0x557154a50f80 2024-02-21T07:55:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571546b91c0 con 0x557154a1b8e0 2024-02-21T07:55:46.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.897+0000 7f01dff8b740 10 client.0 _ll_register_callbacks cb 0x557154903960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53324/0 (socket says 172.21.15.100:53324) 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5400640 1 -- 172.21.15.100:0/2812734155 learned_addr learned my addr 172.21.15.100:0/2812734155 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d6800640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 0x557154a18c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5e00640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a11270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5400640 1 -- 172.21.15.100:0/2812734155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 msgr2=0x557154a18c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.898+0000 7f01d5400640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 0x557154a18c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d5400640 1 -- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 msgr2=0x557154a11270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d5400640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a11270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d5400640 1 -- 172.21.15.100:0/2812734155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80cbd50 con 0x557154a1b8e0 2024-02-21T07:55:46.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d5e00640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a11270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d5400640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009490 tx=0x7f01c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d6732a74efdc31 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01d6800640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 0x557154a18c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01b7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4094450 con 0x557154a1b8e0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.899+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01c409b070 con 0x557154a1b8e0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.900+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55715464a7e0 con 0x557154a1b8e0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.900+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01c40945b0 con 0x557154a1b8e0 2024-02-21T07:55:46.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.900+0000 7f01dff8b740 10 client.7046 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.900+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5571549494e0 con 0x557154a1b8e0 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55715464a7e0 con 0x557154a1b8e0 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01c4097230 con 0x557154a1b8e0 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 10 client.7046 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 10 client.7046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 20 client.7046 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557154a11c70 0x5571549dca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 4 client.7046 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557154687720 con 0x557154a11c70 2024-02-21T07:55:46.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.901+0000 7f01d5e00640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557154a11c70 0x5571549dca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.902+0000 7f01b7400640 10 client.7046 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:46.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.904+0000 7f01d5e00640 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557154a11c70 0x5571549dca70 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e3e30a5b117ddc server_cookie=65b02679089cba87 in_seq=0 out_seq=0 2024-02-21T07:55:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.905+0000 7f01b7400640 1 -- 172.21.15.100:0/2812734155 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557154687720 con 0x557154a11c70 2024-02-21T07:55:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.905+0000 7f01b7400640 10 client.7046 handle_command_reply: tid=0 2024-02-21T07:55:46.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.905+0000 7f01dff8b740 1 client.7046 shutdown 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.905+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 msgr2=0x557154a13cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.905+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009490 tx=0x7f01c4000bc0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 shutdown_connections 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x557154a11c70 0x5571549dca70 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a50f80 0x557154a18c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1b8e0 0x557154a13cc0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 --2- 172.21.15.100:0/2812734155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a11270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 >> 172.21.15.100:0/2812734155 conn(0x5571549aa5a0 msgr2=0x5571549e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01b7400640 0 client.7046 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 shutdown_connections 2024-02-21T07:55:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 1 -- 172.21.15.100:0/2812734155 wait complete. 2024-02-21T07:55:46.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.906+0000 7f01dff8b740 20 client.7046 trim_cache size 0 max 16384 2024-02-21T07:55:46.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.932+0000 7f01dff8b740 1 Processor -- start 2024-02-21T07:55:46.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.933+0000 7f01dff8b740 1 -- start start 2024-02-21T07:55:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.935+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 0x557154a136d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.935+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a4b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.935+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.936+0000 7f01d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.936+0000 7f01d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46430/0 (socket says 172.21.15.100:46430) 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.936+0000 7f01d6800640 1 -- 172.21.15.100:0/367077032 learned_addr learned my addr 172.21.15.100:0/367077032 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.936+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x557154a4f690 con 0x557154a50f80 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.936+0000 7f01d5400640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a4b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.937+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557154a4be30 con 0x557154a1b8e0 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.937+0000 7f01d5e00640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 0x557154a136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.937+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571549e1e70 con 0x557154a1afc0 2024-02-21T07:55:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.937+0000 7f01d6800640 1 -- 172.21.15.100:0/367077032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 msgr2=0x557154a136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.938+0000 7f01d6800640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 0x557154a136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.938+0000 7f01d6800640 1 -- 172.21.15.100:0/367077032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 msgr2=0x557154a4b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.938+0000 7f01d6800640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a4b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.938+0000 7f01d6800640 1 -- 172.21.15.100:0/367077032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571548e5950 con 0x557154a50f80 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.938+0000 7f01d5e00640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 0x557154a136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.939+0000 7f01d6800640 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f01c8036040 tx=0x7f01c8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c57da674628878e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.939+0000 7f01c2000640 1 -- 172.21.15.100:0/367077032 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c80318c0 con 0x557154a50f80 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.940+0000 7f01c2000640 1 -- 172.21.15.100:0/367077032 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c8031a20 con 0x557154a50f80 2024-02-21T07:55:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.940+0000 7f01c2000640 1 -- 172.21.15.100:0/367077032 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8031d90 con 0x557154a50f80 2024-02-21T07:55:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 msgr2=0x557154a13ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f01c8036040 tx=0x7f01c8030000 comp rx=0 tx=0).stop 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 shutdown_connections 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a50f80 0x557154a13ca0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a4b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 --2- 172.21.15.100:0/367077032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a1afc0 0x557154a136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.941+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 >> 172.21.15.100:0/367077032 conn(0x5571549aa5a0 msgr2=0x557154a17100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.942+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 shutdown_connections 2024-02-21T07:55:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.942+0000 7f01dff8b740 1 -- 172.21.15.100:0/367077032 wait complete. 2024-02-21T07:55:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.943+0000 7f01dff8b740 1 -- start start 2024-02-21T07:55:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.943+0000 7f01dff8b740 1 Processor -- start 2024-02-21T07:55:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.946+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.946+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a73960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.946+0000 7f01dff8b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154aa9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01dff8b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571549e8800 con 0x557154a1afc0 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01d6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154aa9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01d6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154aa9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53334/0 (socket says 172.21.15.100:53334) 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01d6800640 1 -- 172.21.15.100:0/1553341936 learned_addr learned my addr 172.21.15.100:0/1553341936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557154abcea0 con 0x557154a1b8e0 2024-02-21T07:55:46.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557154a55d40 con 0x557154a50f80 2024-02-21T07:55:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.947+0000 7f01d5e00640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.948+0000 7f01dff8b740 10 client.0 _ll_register_callbacks cb 0x7f01c40977d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.949+0000 7f01d5e00640 1 -- 172.21.15.100:0/1553341936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 msgr2=0x557154aa9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.949+0000 7f01d5e00640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154aa9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.949+0000 7f01d5e00640 1 -- 172.21.15.100:0/1553341936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 msgr2=0x557154a73960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.949+0000 7f01d5e00640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a73960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.949+0000 7f01d5e00640 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d80f55d0 con 0x557154a1afc0 2024-02-21T07:55:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.950+0000 7f01d5e00640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a504f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x557154a19c50 tx=0x7f01d0001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b297289cfabb59 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:46.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.950+0000 7f01b7400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:46.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.950+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00233b0 con 0x557154a1afc0 2024-02-21T07:55:46.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.951+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557154a12790 con 0x557154a1afc0 2024-02-21T07:55:46.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.951+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01d0023510 con 0x557154a1afc0 2024-02-21T07:55:46.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.951+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d00236d0 con 0x557154a1afc0 2024-02-21T07:55:46.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.951+0000 7f01dff8b740 10 client.6945 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:46.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.951+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55715490b430 con 0x557154a1afc0 2024-02-21T07:55:46.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.952+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557154a12790 con 0x557154a1afc0 2024-02-21T07:55:46.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.952+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01d0012070 con 0x557154a1afc0 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 10 client.6945 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 10 client.6945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 20 client.6945 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5571549dee00 0x557154ac0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 4 client.6945 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:55:46.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.953+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f01c4095e80 con 0x5571549dee00 2024-02-21T07:55:46.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.963+0000 7f01d5400640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5571549dee00 0x557154ac0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:46.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.964+0000 7f01d5400640 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5571549dee00 0x557154ac0410 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c88c5d57cc73833 server_cookie=6b4a20b17229fe1b in_seq=0 out_seq=0 2024-02-21T07:55:46.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.964+0000 7f01b7400640 10 client.6945 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:46.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.977+0000 7f01b7400640 1 -- 172.21.15.100:0/1553341936 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f01c4095e80 con 0x5571549dee00 2024-02-21T07:55:46.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.977+0000 7f01b7400640 10 client.6945 handle_command_reply: tid=0 2024-02-21T07:55:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.979+0000 7f01dff8b740 1 client.6945 shutdown 2024-02-21T07:55:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.981+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 msgr2=0x557154a504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.981+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a504f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x557154a19c50 tx=0x7f01d0001400 comp rx=0 tx=0).stop 2024-02-21T07:55:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 shutdown_connections 2024-02-21T07:55:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5571549dee00 0x557154ac0410 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557154a50f80 0x557154aa9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557154a1b8e0 0x557154a73960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 --2- 172.21.15.100:0/1553341936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557154a1afc0 0x557154a504f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 >> 172.21.15.100:0/1553341936 conn(0x5571549aa5a0 msgr2=0x557154a4e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01b7400640 0 client.6945 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:46.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.982+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 shutdown_connections 2024-02-21T07:55:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.983+0000 7f01dff8b740 1 -- 172.21.15.100:0/1553341936 wait complete. 2024-02-21T07:55:46.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.983+0000 7f01dff8b740 20 client.6945 trim_cache size 0 max 16384 2024-02-21T07:55:46.986 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:46.986 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:55:46.986 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:55:46.986 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 msgr2=0x7f01b80a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 0x7f01b80a1630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01d00012e0 tx=0x7f01d0009040 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 msgr2=0x7f01d822bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d7d0 tx=0x7f01c400dc90 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 shutdown_connections 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01d8190260 0x7f01d822c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f01b809f170 0x7f01b80a1630 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f01d00012e0 tx=0x7f01d0009040 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01d8070a30 0x7f01d822bdd0 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f01c400d7d0 tx=0x7f01c400dc90 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 --2- 172.21.15.100:0/779384715 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f01d806ebf0 0x7f01d8175360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:46.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.985+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 >> 172.21.15.100:0/779384715 conn(0x7f01d80668b0 msgr2=0x7f01d80f5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.988+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 shutdown_connections 2024-02-21T07:55:46.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:46.988+0000 7f01dd200640 1 -- 172.21.15.100:0/779384715 wait complete. 2024-02-21T07:55:47.039 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:55:47.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:55:47.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:47.404 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:47.406 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:47.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.438+0000 7f1867200640 1 Processor -- start 2024-02-21T07:55:47.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.438+0000 7f1867200640 1 -- start start 2024-02-21T07:55:47.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.441+0000 7f1867200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1860183810 0x7f186006be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:47.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.441+0000 7f1867200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186006d800 con 0x7f18600f6520 2024-02-21T07:55:47.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.441+0000 7f1867200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186006c360 con 0x7f18600f5a30 2024-02-21T07:55:47.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.441+0000 7f1867200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18600f6980 con 0x7f1860183810 2024-02-21T07:55:47.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1865400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f18600f6520 0x7f1860183100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40540/0 (socket says 172.21.15.100:40540) 2024-02-21T07:55:47.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1865400640 1 -- 172.21.15.100:0/3466410090 learned_addr learned my addr 172.21.15.100:0/3466410090 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:47.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1866800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1860183810 0x7f186006be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:47.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1864a00640 1 -- 172.21.15.100:0/3466410090 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565489459 0 0) 0x7f186006d800 con 0x7f18600f6520 2024-02-21T07:55:47.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1864a00640 1 -- 172.21.15.100:0/3466410090 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1848003520 con 0x7f18600f6520 2024-02-21T07:55:47.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1866800640 1 -- 172.21.15.100:0/3466410090 >> v1:172.21.15.156:6789/0 conn(0x7f18600f5a30 legacy=0x7f18600f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:47.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1866800640 1 -- 172.21.15.100:0/3466410090 >> v1:172.21.15.100:6789/0 conn(0x7f18600f6520 legacy=0x7f1860183100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:47.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.442+0000 7f1866800640 1 -- 172.21.15.100:0/3466410090 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860183c80 con 0x7f1860183810 2024-02-21T07:55:47.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.444+0000 7f1866800640 1 --2- 172.21.15.100:0/3466410090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1860183810 0x7f186006be20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c02e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ed15615c7d561 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.444+0000 7f1864a00640 1 -- 172.21.15.100:0/3466410090 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c02ee70 con 0x7f1860183810 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.444+0000 7f1864a00640 1 -- 172.21.15.100:0/3466410090 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c036440 con 0x7f1860183810 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.444+0000 7f1864a00640 1 -- 172.21.15.100:0/3466410090 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0367d0 con 0x7f1860183810 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 -- 172.21.15.100:0/3466410090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1860183810 msgr2=0x7f186006be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 --2- 172.21.15.100:0/3466410090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1860183810 0x7f186006be20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c02e0c0 comp rx=0 tx=0).stop 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 -- 172.21.15.100:0/3466410090 shutdown_connections 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 --2- 172.21.15.100:0/3466410090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1860183810 0x7f186006be20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 -- 172.21.15.100:0/3466410090 >> 172.21.15.100:0/3466410090 conn(0x7f18600cf070 msgr2=0x7f18600cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:47.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 -- 172.21.15.100:0/3466410090 shutdown_connections 2024-02-21T07:55:47.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.446+0000 7f1867200640 1 -- 172.21.15.100:0/3466410090 wait complete. 2024-02-21T07:55:47.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.448+0000 7f1867200640 1 Processor -- start 2024-02-21T07:55:47.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.448+0000 7f1867200640 1 -- start start 2024-02-21T07:55:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.450+0000 7f1867200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18600f5a30 0x7f1860164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:47.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.450+0000 7f1867200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 0x7f1860176cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1867200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1867200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18602208c0 con 0x7f18600f6520 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1867200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601648a0 con 0x7f18600f5a30 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1867200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860164570 con 0x7f1860183810 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1866800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1866800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53348/0 (socket says 172.21.15.100:53348) 2024-02-21T07:55:47.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1866800640 1 -- 172.21.15.100:0/3490362885 learned_addr learned my addr 172.21.15.100:0/3490362885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1865e00640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18600f5a30 0x7f1860164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.451+0000 7f1865400640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 0x7f1860176cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 -- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18600f5a30 msgr2=0x7f1860164000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:47.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18600f5a30 0x7f1860164000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 -- 172.21.15.100:0/3490362885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 msgr2=0x7f1860176cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 0x7f1860176cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 -- 172.21.15.100:0/3490362885 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c009a70 con 0x7f1860183810 2024-02-21T07:55:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1865400640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 0x7f1860176cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.452+0000 7f1866800640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:47.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.455+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c03f850 con 0x7f1860183810 2024-02-21T07:55:47.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.456+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1860222ef0 con 0x7f1860183810 2024-02-21T07:55:47.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.456+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c03f9b0 con 0x7f1860183810 2024-02-21T07:55:47.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.458+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c03fd60 con 0x7f1860183810 2024-02-21T07:55:47.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.458+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18602234b0 con 0x7f1860183810 2024-02-21T07:55:47.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.461+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f185c03d070 con 0x7f1860183810 2024-02-21T07:55:47.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.465+0000 7f185a000640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 0x7f18440a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:47.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.465+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f185c0ef170 con 0x7f1860183810 2024-02-21T07:55:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.466+0000 7f1865e00640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 0x7f18440a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:47.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.467+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c005290 con 0x7f1860183810 2024-02-21T07:55:47.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.467+0000 7f1865e00640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 0x7f18440a1590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1850007fd0 tx=0x7f1850009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.473+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f185c0f0060 con 0x7f1860183810 2024-02-21T07:55:47.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.989+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f183c005810 con 0x7f1860183810 2024-02-21T07:55:47.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:47.993+0000 7f185a000640 1 -- 172.21.15.100:0/3490362885 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f185c03b090 con 0x7f1860183810 2024-02-21T07:55:47.996 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:55:47.996 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:55:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:55:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 msgr2=0x7f18440a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 0x7f18440a1590 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1850007fd0 tx=0x7f1850009040 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 msgr2=0x7f1860164d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f185c009d90 tx=0x7f185c004a40 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 shutdown_connections 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1860183810 0x7f1860164d30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f184409f0d0 0x7f18440a1590 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18600f6520 0x7f1860176cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 --2- 172.21.15.100:0/3490362885 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18600f5a30 0x7f1860164000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.002+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 >> 172.21.15.100:0/3490362885 conn(0x7f18600cf070 msgr2=0x7f1860181bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.003+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 shutdown_connections 2024-02-21T07:55:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.003+0000 7f1867200640 1 -- 172.21.15.100:0/3490362885 wait complete. 2024-02-21T07:55:48.046 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:48.047 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:55:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.387+0000 7fa5c0000640 1 Processor -- start 2024-02-21T07:55:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.390+0000 7fa5c0000640 1 -- start start 2024-02-21T07:55:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.397+0000 7fa5c0000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa5b806f990 0x7fa5b8186920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.397+0000 7fa5bd600640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa5b8071010 0x7fa5b80713f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55680/0 (socket says 172.21.15.100:55680) 2024-02-21T07:55:48.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.398+0000 7fa5bcc00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa5b8071b00 0x7fa5b806f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:33052/0 (socket says 172.21.15.100:33052) 2024-02-21T07:55:48.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.398+0000 7fa5bd600640 1 -- 172.21.15.100:0/3593209139 learned_addr learned my addr 172.21.15.100:0/3593209139 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b8071f40 con 0x7fa5b8071010 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5be000640 1 --2- 172.21.15.100:0/3593209139 >> v2:172.21.15.170:3300/0 conn(0x7fa5b806f990 0x7fa5b8186920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b806fe00 con 0x7fa5b8071b00 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b806ea40 con 0x7fa5b806f990 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865615980 0 0) 0x7fa5b806fe00 con 0x7fa5b8071b00 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.399+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a0003440 con 0x7fa5b8071b00 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185396150 0 0) 0x7fa5b8071f40 con 0x7fa5b8071010 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b806fe00 con 0x7fa5b8071010 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65731238 0 0) 0x7fa5a0003440 con 0x7fa5b8071b00 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 >> v2:172.21.15.170:3300/0 conn(0x7fa5b806f990 msgr2=0x7fa5b8186920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 --2- 172.21.15.100:0/3593209139 >> v2:172.21.15.170:3300/0 conn(0x7fa5b806f990 0x7fa5b8186920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 >> v1:172.21.15.156:6789/0 conn(0x7fa5b8071010 legacy=0x7fa5b80713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80700c0 con 0x7fa5b8071b00 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fa5a40015f0 con 0x7fa5b8071b00 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 >> v1:172.21.15.170:6789/0 conn(0x7fa5b8071b00 legacy=0x7fa5b806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a0003c40 0x7fa5a0008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.400+0000 7fa5b7e00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 0x7fa5a000ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.401+0000 7fa5b7e00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a000b540 0x7fa5a000da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.401+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b806ea40 con 0x7fa5a0003c40 2024-02-21T07:55:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.401+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000e240 con 0x7fa5a000b540 2024-02-21T07:55:48.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.401+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a000e400 con 0x7fa5a0004150 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.404+0000 7fa5be000640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a000b540 0x7fa5a000da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.404+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 0x7fa5a000ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bd600640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a0003c40 0x7fa5a0008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bcc00640 1 -- 172.21.15.100:0/3593209139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a000b540 msgr2=0x7fa5a000da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a000b540 0x7fa5a000da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bcc00640 1 -- 172.21.15.100:0/3593209139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a0003c40 msgr2=0x7fa5a0008850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5a0003c40 0x7fa5a0008850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5be000640 1 -- 172.21.15.100:0/3593209139 reap_dead start 2024-02-21T07:55:48.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.405+0000 7fa5bcc00640 1 -- 172.21.15.100:0/3593209139 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0003440 con 0x7fa5a0004150 2024-02-21T07:55:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.407+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 0x7fa5a000ae20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8050150 tx=0x7fa5a00036f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545ccdafe015e202 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.412+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4007270 con 0x7fa5a0004150 2024-02-21T07:55:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.413+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40073f0 con 0x7fa5a0004150 2024-02-21T07:55:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.413+0000 7fa5b7e00640 1 -- 172.21.15.100:0/3593209139 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4005810 con 0x7fa5a0004150 2024-02-21T07:55:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.414+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 msgr2=0x7fa5a000ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.414+0000 7fa5c0000640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 0x7fa5a000ae20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8050150 tx=0x7fa5a00036f0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.418+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 shutdown_connections 2024-02-21T07:55:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.418+0000 7fa5c0000640 1 --2- 172.21.15.100:0/3593209139 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5a0004150 0x7fa5a000ae20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.418+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 >> 172.21.15.100:0/3593209139 conn(0x7fa5b80668b0 msgr2=0x7fa5b8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.424+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 shutdown_connections 2024-02-21T07:55:48.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.424+0000 7fa5c0000640 1 -- 172.21.15.100:0/3593209139 wait complete. 2024-02-21T07:55:48.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.436+0000 7fa5c0000640 1 Processor -- start 2024-02-21T07:55:48.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.437+0000 7fa5c0000640 1 -- start start 2024-02-21T07:55:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.439+0000 7fa5c0000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a0004150 0x7fa5b821e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.439+0000 7fa5c0000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5c0000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8170f90 0x7fa5b821b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5c0000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b815de80 con 0x7fa5b8170f90 2024-02-21T07:55:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5c0000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b815e0f0 con 0x7fa5a0004150 2024-02-21T07:55:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5c0000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b815e3d0 con 0x7fa5b821e720 2024-02-21T07:55:48.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53354/0 (socket says 172.21.15.100:53354) 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.440+0000 7fa5bcc00640 1 -- 172.21.15.100:0/1930578518 learned_addr learned my addr 172.21.15.100:0/1930578518 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.441+0000 7fa5bcc00640 1 -- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a0004150 msgr2=0x7fa5b821e1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.441+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a0004150 0x7fa5b821e1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.441+0000 7fa5bcc00640 1 -- 172.21.15.100:0/1930578518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8170f90 msgr2=0x7fa5b821b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.441+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8170f90 0x7fa5b821b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.441+0000 7fa5bcc00640 1 -- 172.21.15.100:0/1930578518 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b815e6b0 con 0x7fa5b821e720 2024-02-21T07:55:48.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.442+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa5a402c1e0 tx=0x7fa5a402e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.442+0000 7fa5b5600640 1 -- 172.21.15.100:0/1930578518 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40049e0 con 0x7fa5b821e720 2024-02-21T07:55:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.442+0000 7fa5b5600640 1 -- 172.21.15.100:0/1930578518 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4007280 con 0x7fa5b821e720 2024-02-21T07:55:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.442+0000 7fa5b5600640 1 -- 172.21.15.100:0/1930578518 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4004da0 con 0x7fa5b821e720 2024-02-21T07:55:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.443+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b815e990 con 0x7fa5b821e720 2024-02-21T07:55:48.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.443+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b815ef50 con 0x7fa5b821e720 2024-02-21T07:55:48.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.448+0000 7fa5b5600640 1 -- 172.21.15.100:0/1930578518 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa5a402d500 con 0x7fa5b821e720 2024-02-21T07:55:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.450+0000 7fa5b5600640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 0x7fa5980a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.450+0000 7fa5c2d98740 1 Processor -- start 2024-02-21T07:55:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.450+0000 7fa5b5600640 1 -- 172.21.15.100:0/1930578518 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa5a40f3840 con 0x7fa5b821e720 2024-02-21T07:55:48.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.450+0000 7fa5bd600640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 0x7fa5980a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.450+0000 7fa5c2d98740 1 -- start start 2024-02-21T07:55:48.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.451+0000 7fa5bd600640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 0x7fa5980a1660 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d840 tx=0x7fa5ac00dc40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f44e5ec0 0x5611f44e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 0x5611f4521050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4419210 con 0x5611f44e5ec0 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4416740 con 0x5611f44e67e0 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4411f20 con 0x5611f4521590 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53370/0 (socket says 172.21.15.100:53370) 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 -- 172.21.15.100:0/365801189 learned_addr learned my addr 172.21.15.100:0/365801189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5bd600640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f44e5ec0 0x5611f44e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 0x5611f4521050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 -- 172.21.15.100:0/365801189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 msgr2=0x5611f4521050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 0x5611f4521050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 -- 172.21.15.100:0/365801189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f44e5ec0 msgr2=0x5611f44e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f44e5ec0 0x5611f44e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.452+0000 7fa5be000640 1 -- 172.21.15.100:0/365801189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f43d3df0 con 0x5611f4521590 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.453+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 0x5611f4521050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.453+0000 7fa5be000640 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009ec0 tx=0x7fa5b0003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e06768614851875b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.453+0000 7fa5a9c00640 1 -- 172.21.15.100:0/365801189 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0004730 con 0x5611f4521590 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.453+0000 7fa5a9c00640 1 -- 172.21.15.100:0/365801189 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0004890 con 0x5611f4521590 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.453+0000 7fa5a9c00640 1 -- 172.21.15.100:0/365801189 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0015660 con 0x5611f4521590 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 -- 172.21.15.100:0/365801189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 msgr2=0x5611f4522320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009ec0 tx=0x7fa5b0003d60 comp rx=0 tx=0).stop 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 -- 172.21.15.100:0/365801189 shutdown_connections 2024-02-21T07:55:48.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f4521590 0x5611f4522320 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f44e67e0 0x5611f4521050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/365801189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f44e5ec0 0x5611f44e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 -- 172.21.15.100:0/365801189 >> 172.21.15.100:0/365801189 conn(0x5611f44a8490 msgr2=0x5611f44a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 -- 172.21.15.100:0/365801189 shutdown_connections 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.454+0000 7fa5c2d98740 1 -- 172.21.15.100:0/365801189 wait complete. 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.455+0000 7fa5c2d98740 1 -- start start 2024-02-21T07:55:48.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.455+0000 7fa5c2d98740 1 Processor -- start 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.456+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f452b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f44a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f43b7150 con 0x5611f4528620 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f43b6df0 con 0x5611f4521590 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f41801c0 con 0x5611f44e67e0 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5c2d98740 10 client.0 _ll_register_callbacks cb 0x5611f44062b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56068/0 (socket says 172.21.15.100:56068) 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 -- 172.21.15.100:0/556548030 learned_addr learned my addr 172.21.15.100:0/556548030 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5be000640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f44a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bd600640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f452b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 -- 172.21.15.100:0/556548030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 msgr2=0x5611f452b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f452b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 -- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 msgr2=0x5611f44a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f44a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bcc00640 1 -- 172.21.15.100:0/556548030 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b0011040 con 0x5611f4521590 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5be000640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f44a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.457+0000 7fa5bd600640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f452b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40c1130 tx=0x7fa5a40c0d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90e23cefa6968be3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa59e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40c54d0 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa5a40c9b20 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611f41117e0 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a40c1690 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa5c2d98740 10 client.7147 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.458+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5611f44105a0 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5611f41117e0 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa5a4053020 con 0x5611f4521590 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 10 client.7147 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 10 client.7147 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 20 client.7147 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f4512e90 0x5611f44a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 4 client.7147 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611f414e720 con 0x5611f4512e90 2024-02-21T07:55:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.459+0000 7fa5bd600640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f4512e90 0x5611f44a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.460+0000 7fa5bd600640 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f4512e90 0x5611f44a4bc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a660c67b9dae5ec server_cookie=20fd4a65a64a16fa in_seq=0 out_seq=0 2024-02-21T07:55:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.460+0000 7fa59e000640 10 client.7147 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.461+0000 7fa59e000640 1 -- 172.21.15.100:0/556548030 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5611f414e720 con 0x5611f4512e90 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.461+0000 7fa59e000640 10 client.7147 handle_command_reply: tid=0 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.461+0000 7fa5c2d98740 1 client.7147 shutdown 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 msgr2=0x5611f44a6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40c1130 tx=0x7fa5a40c0d90 comp rx=0 tx=0).stop 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 shutdown_connections 2024-02-21T07:55:48.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f4512e90 0x5611f44a4bc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f44a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44a6ec0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/556548030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f452b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.462+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 >> 172.21.15.100:0/556548030 conn(0x5611f44e5ec0 msgr2=0x5611f44ea380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.463+0000 7fa59e000640 0 client.7147 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.463+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 shutdown_connections 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.463+0000 7fa5c2d98740 1 -- 172.21.15.100:0/556548030 wait complete. 2024-02-21T07:55:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.464+0000 7fa5c2d98740 20 client.7147 trim_cache size 0 max 16384 2024-02-21T07:55:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.500+0000 7fa5c2d98740 1 Processor -- start 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.509+0000 7fa5c2d98740 1 -- start start 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f4520f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f44dc590 con 0x5611f4528620 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f44a3c80 con 0x5611f4521590 2024-02-21T07:55:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.511+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f44e97a0 con 0x5611f44e67e0 2024-02-21T07:55:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.513+0000 7fa5bd600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.513+0000 7fa5bd600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53390/0 (socket says 172.21.15.100:53390) 2024-02-21T07:55:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.513+0000 7fa5bd600640 1 -- 172.21.15.100:0/4228626804 learned_addr learned my addr 172.21.15.100:0/4228626804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 -- 172.21.15.100:0/4228626804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 msgr2=0x5611f44c39f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44c39f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 -- 172.21.15.100:0/4228626804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 msgr2=0x5611f4520f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f4520f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 -- 172.21.15.100:0/4228626804 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611f43acab0 con 0x5611f44e67e0 2024-02-21T07:55:48.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.514+0000 7fa5bd600640 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x5611f44a8210 tx=0x7fa5ac013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631c8da342bd0806 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.515+0000 7fa5a9200640 1 -- 172.21.15.100:0/4228626804 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00fe20 con 0x5611f44e67e0 2024-02-21T07:55:48.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.515+0000 7fa5a9200640 1 -- 172.21.15.100:0/4228626804 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac022110 con 0x5611f44e67e0 2024-02-21T07:55:48.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.515+0000 7fa5a9200640 1 -- 172.21.15.100:0/4228626804 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0222a0 con 0x5611f44e67e0 2024-02-21T07:55:48.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.523+0000 7fa5c2d98740 1 -- 172.21.15.100:0/4228626804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 msgr2=0x5611f44e9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x5611f44a8210 tx=0x7fa5ac013000 comp rx=0 tx=0).stop 2024-02-21T07:55:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 -- 172.21.15.100:0/4228626804 shutdown_connections 2024-02-21T07:55:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4528620 0x5611f4520f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4521590 0x5611f44c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/4228626804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e9110 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.524+0000 7fa5c2d98740 1 -- 172.21.15.100:0/4228626804 >> 172.21.15.100:0/4228626804 conn(0x5611f44e5ec0 msgr2=0x5611f44a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.525+0000 7fa5c2d98740 1 -- 172.21.15.100:0/4228626804 shutdown_connections 2024-02-21T07:55:48.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.525+0000 7fa5c2d98740 1 -- 172.21.15.100:0/4228626804 wait complete. 2024-02-21T07:55:48.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.526+0000 7fa5c2d98740 1 -- start start 2024-02-21T07:55:48.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.527+0000 7fa5c2d98740 1 Processor -- start 2024-02-21T07:55:48.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 0x5611f44a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 0x5611f4529ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f4521fa0 con 0x5611f4521590 2024-02-21T07:55:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f44a0a70 con 0x5611f4528620 2024-02-21T07:55:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611f451d4f0 con 0x5611f44e67e0 2024-02-21T07:55:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5c2d98740 10 client.0 _ll_register_callbacks cb 0x7fa5b0009b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:48.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5bd600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5be000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 0x5611f4529ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5bd600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53392/0 (socket says 172.21.15.100:53392) 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5bd600640 1 -- 172.21.15.100:0/1313636703 learned_addr learned my addr 172.21.15.100:0/1313636703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.529+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 0x5611f44a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5be000640 1 -- 172.21.15.100:0/1313636703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 msgr2=0x5611f44e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5be000640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5be000640 1 -- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 msgr2=0x5611f44a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5be000640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 0x5611f44a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5be000640 1 -- 172.21.15.100:0/1313636703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac00d430 con 0x5611f4528620 2024-02-21T07:55:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.530+0000 7fa5bcc00640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 0x5611f44a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa5be000640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 0x5611f4529ee0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8187de0 tx=0x7fa5b0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f44cb4d6deba17e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa59e000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0015960 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa5b0015ac0 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5b0004890 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.531+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5b0015cc0 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 10 client.7150 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5611f43d2650 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0004890 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa5b0029470 con 0x5611f4528620 2024-02-21T07:55:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 10 client.7150 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 10 client.7150 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:55:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 20 client.7150 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f44a5e20 0x5611f452b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 4 client.7150 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5611f419d890 con 0x5611f44a5e20 2024-02-21T07:55:48.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.532+0000 7fa5bd600640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f44a5e20 0x5611f452b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.533+0000 7fa5bd600640 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f44a5e20 0x5611f452b210 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8226063f1451e8 server_cookie=5ce3bd5963baee40 in_seq=0 out_seq=0 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.533+0000 7fa59e000640 10 client.7150 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.533+0000 7fa59e000640 1 -- 172.21.15.100:0/1313636703 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5611f419d890 con 0x5611f44a5e20 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.533+0000 7fa59e000640 10 client.7150 handle_command_reply: tid=0 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 client.7150 shutdown 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 msgr2=0x5611f4529ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 0x5611f4529ee0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8187de0 tx=0x7fa5b0004ab0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 shutdown_connections 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x5611f44a5e20 0x5611f452b210 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5611f4528620 0x5611f4529ee0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611f4521590 0x5611f44a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 --2- 172.21.15.100:0/1313636703 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5611f44e67e0 0x5611f44e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 >> 172.21.15.100:0/1313636703 conn(0x5611f44e5ec0 msgr2=0x5611f44a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa59e000640 0 client.7150 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 shutdown_connections 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.534+0000 7fa5c2d98740 1 -- 172.21.15.100:0/1313636703 wait complete. 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.535+0000 7fa5c2d98740 20 client.7150 trim_cache size 0 max 16384 2024-02-21T07:55:48.539 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 msgr2=0x7fa5980a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 0x7fa5980a1660 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d840 tx=0x7fa5ac00dc40 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 msgr2=0x7fa5b8170a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa5a402c1e0 tx=0x7fa5a402e000 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 shutdown_connections 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa59809f1a0 0x7fa5980a1660 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5b8170f90 0x7fa5b821b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5b821e720 0x7fa5b8170a50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 --2- 172.21.15.100:0/1930578518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5a0004150 0x7fa5b821e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 >> 172.21.15.100:0/1930578518 conn(0x7fa5b80668b0 msgr2=0x7fa5b806da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:48.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 shutdown_connections 2024-02-21T07:55:48.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.536+0000 7fa5c0000640 1 -- 172.21.15.100:0/1930578518 wait complete. 2024-02-21T07:55:48.571 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:48.571 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:55:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.996+0000 7fc32f000640 1 Processor -- start 2024-02-21T07:55:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:48.996+0000 7fc32f000640 1 -- start start 2024-02-21T07:55:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.006+0000 7fc32f000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc32818bcb0 0x7fc328186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.006+0000 7fc32f000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc32818c090 0x7fc32818c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.007+0000 7fc32f000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3281896a0 con 0x7fc3280f7b80 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.007+0000 7fc32f000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280f8f60 con 0x7fc32818bcb0 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.007+0000 7fc32f000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3280f8000 con 0x7fc32818c090 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.008+0000 7fc32e600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc32818c090 0x7fc32818c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.008+0000 7fc32e600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fc32818c090 0x7fc32818c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53396/0 (socket says 172.21.15.100:53396) 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.008+0000 7fc32e600640 1 -- 172.21.15.100:0/3249940787 learned_addr learned my addr 172.21.15.100:0/3249940787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.009+0000 7fc32e600640 1 -- 172.21.15.100:0/3249940787 >> v2:172.21.15.156:3300/0 conn(0x7fc32818bcb0 msgr2=0x7fc328186630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.009+0000 7fc32e600640 1 --2- 172.21.15.100:0/3249940787 >> v2:172.21.15.156:3300/0 conn(0x7fc32818bcb0 0x7fc328186630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.009+0000 7fc32e600640 1 -- 172.21.15.100:0/3249940787 >> v1:172.21.15.100:6789/0 conn(0x7fc3280f7b80 legacy=0x7fc3280f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.013+0000 7fc32e600640 1 -- 172.21.15.100:0/3249940787 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280f82e0 con 0x7fc32818c090 2024-02-21T07:55:49.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.017+0000 7fc32e600640 1 --2- 172.21.15.100:0/3249940787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818c090 0x7fc32818c4c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc3280d25b0 tx=0x7fc3140340c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b349f8dcade33cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.019+0000 7fc327e00640 1 -- 172.21.15.100:0/3249940787 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314034e70 con 0x7fc32818c090 2024-02-21T07:55:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.019+0000 7fc327e00640 1 -- 172.21.15.100:0/3249940787 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31403c440 con 0x7fc32818c090 2024-02-21T07:55:49.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.019+0000 7fc327e00640 1 -- 172.21.15.100:0/3249940787 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31403c7d0 con 0x7fc32818c090 2024-02-21T07:55:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.020+0000 7fc32f000640 1 -- 172.21.15.100:0/3249940787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818c090 msgr2=0x7fc32818c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.020+0000 7fc32f000640 1 --2- 172.21.15.100:0/3249940787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818c090 0x7fc32818c4c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc3280d25b0 tx=0x7fc3140340c0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.023+0000 7fc32f000640 1 -- 172.21.15.100:0/3249940787 shutdown_connections 2024-02-21T07:55:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.023+0000 7fc32f000640 1 --2- 172.21.15.100:0/3249940787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818c090 0x7fc32818c4c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.023+0000 7fc32f000640 1 --2- 172.21.15.100:0/3249940787 >> v2:172.21.15.156:3300/0 conn(0x7fc32818bcb0 0x7fc328186630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.023+0000 7fc32f000640 1 -- 172.21.15.100:0/3249940787 >> 172.21.15.100:0/3249940787 conn(0x7fc3280ce150 msgr2=0x7fc3280ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.023+0000 7fc32f000640 1 -- 172.21.15.100:0/3249940787 shutdown_connections 2024-02-21T07:55:49.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.024+0000 7fc32f000640 1 -- 172.21.15.100:0/3249940787 wait complete. 2024-02-21T07:55:49.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.028+0000 7fc32f000640 1 Processor -- start 2024-02-21T07:55:49.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.028+0000 7fc32f000640 1 -- start start 2024-02-21T07:55:49.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.031+0000 7fc32f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 0x7fc32816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.032+0000 7fc32f000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818bcb0 0x7fc32821b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.032+0000 7fc32f000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.032+0000 7fc32f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32816ae20 con 0x7fc3280f7b80 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56102/0 (socket says 172.21.15.100:56102) 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32e600640 1 -- 172.21.15.100:0/2452072049 learned_addr learned my addr 172.21.15.100:0/2452072049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32821b6e0 con 0x7fc32818c090 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 0x7fc32816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.033+0000 7fc32d200640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818bcb0 0x7fc32821b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.034+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280f4a30 con 0x7fc32818bcb0 2024-02-21T07:55:49.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.035+0000 7fc32e600640 1 -- 172.21.15.100:0/2452072049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818bcb0 msgr2=0x7fc32821b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.035+0000 7fc32e600640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818bcb0 0x7fc32821b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.035+0000 7fc32e600640 1 -- 172.21.15.100:0/2452072049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 msgr2=0x7fc32816a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.035+0000 7fc32e600640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 0x7fc32816a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc32e600640 1 -- 172.21.15.100:0/2452072049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314013a10 con 0x7fc32818c090 2024-02-21T07:55:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 0x7fc32816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc32e600640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc314013d00 tx=0x7fc3140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc325600640 1 -- 172.21.15.100:0/2452072049 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31403a8d0 con 0x7fc32818c090 2024-02-21T07:55:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc325600640 1 -- 172.21.15.100:0/2452072049 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31403aa30 con 0x7fc32818c090 2024-02-21T07:55:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc325600640 1 -- 172.21.15.100:0/2452072049 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31403ade0 con 0x7fc32818c090 2024-02-21T07:55:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.036+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280f4d10 con 0x7fc32818c090 2024-02-21T07:55:49.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.037+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280f52d0 con 0x7fc32818c090 2024-02-21T07:55:49.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.040+0000 7fc325600640 1 -- 172.21.15.100:0/2452072049 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc314043040 con 0x7fc32818c090 2024-02-21T07:55:49.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.043+0000 7fc325600640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 0x7fc3080a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.044+0000 7fc325600640 1 -- 172.21.15.100:0/2452072049 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3140f43b0 con 0x7fc32818c090 2024-02-21T07:55:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.044+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 0x7fc3080a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.045+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 0x7fc3080a1560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c420 tx=0x7fc320009570 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.048+0000 7fc33340d740 1 Processor -- start 2024-02-21T07:55:49.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.048+0000 7fc33340d740 1 -- start start 2024-02-21T07:55:49.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e07200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833e07740 0x55d833e084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833cff210 con 0x55d833dcc070 2024-02-21T07:55:49.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833cfc740 con 0x55d833dcc990 2024-02-21T07:55:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.052+0000 7fc33340d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833cf7f20 con 0x55d833e07740 2024-02-21T07:55:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.053+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.053+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46520/0 (socket says 172.21.15.100:46520) 2024-02-21T07:55:49.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.053+0000 7fc32dc00640 1 -- 172.21.15.100:0/340389360 learned_addr learned my addr 172.21.15.100:0/340389360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.053+0000 7fc32d200640 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e07200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32dc00640 1 -- 172.21.15.100:0/340389360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833e07740 msgr2=0x55d833e084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32dc00640 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833e07740 0x55d833e084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32dc00640 1 -- 172.21.15.100:0/340389360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 msgr2=0x55d833e07200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32dc00640 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e07200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32dc00640 1 -- 172.21.15.100:0/340389360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d833cb9df0 con 0x55d833dcc070 2024-02-21T07:55:49.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.054+0000 7fc32d200640 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e07200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:49.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.059+0000 7fc32dc00640 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc320018850 tx=0x7fc320011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee0f5dd0ad7cbdb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.060+0000 7fc31a000640 1 -- 172.21.15.100:0/340389360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32001d070 con 0x55d833dcc070 2024-02-21T07:55:49.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.061+0000 7fc31a000640 1 -- 172.21.15.100:0/340389360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320018050 con 0x55d833dcc070 2024-02-21T07:55:49.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.062+0000 7fc31a000640 1 -- 172.21.15.100:0/340389360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32001d070 con 0x55d833dcc070 2024-02-21T07:55:49.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.064+0000 7fc33340d740 1 -- 172.21.15.100:0/340389360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 msgr2=0x55d833dcc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.065+0000 7fc33340d740 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc320018850 tx=0x7fc320011000 comp rx=0 tx=0).stop 2024-02-21T07:55:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.065+0000 7fc33340d740 1 -- 172.21.15.100:0/340389360 shutdown_connections 2024-02-21T07:55:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.065+0000 7fc33340d740 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833e07740 0x55d833e084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.066+0000 7fc33340d740 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e07200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.066+0000 7fc33340d740 1 --2- 172.21.15.100:0/340389360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dcc070 0x55d833dcc450 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.066+0000 7fc33340d740 1 -- 172.21.15.100:0/340389360 >> 172.21.15.100:0/340389360 conn(0x55d833d8e640 msgr2=0x55d833d8f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.067+0000 7fc33340d740 1 -- 172.21.15.100:0/340389360 shutdown_connections 2024-02-21T07:55:49.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.070+0000 7fc33340d740 1 -- 172.21.15.100:0/340389360 wait complete. 2024-02-21T07:55:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.071+0000 7fc33340d740 1 -- start start 2024-02-21T07:55:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.072+0000 7fc33340d740 1 Processor -- start 2024-02-21T07:55:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.075+0000 7fc33340d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.075+0000 7fc33340d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833e07740 0x55d833d8bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.075+0000 7fc33340d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc33340d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833c9d150 con 0x55d833e07740 2024-02-21T07:55:49.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc32e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc32e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56124/0 (socket says 172.21.15.100:56124) 2024-02-21T07:55:49.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc32e600640 1 -- 172.21.15.100:0/2602088691 learned_addr learned my addr 172.21.15.100:0/2602088691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc32d200640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833e07740 0x55d833d8bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833c9cdf0 con 0x55d833dba3f0 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.076+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833a661c0 con 0x55d833dcc990 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc33340d740 10 client.0 _ll_register_callbacks cb 0x55d833cec2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc32e600640 1 -- 172.21.15.100:0/2602088691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 msgr2=0x55d833db60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc32e600640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc32e600640 1 -- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833e07740 msgr2=0x55d833d8bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc32e600640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833e07740 0x55d833d8bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.077+0000 7fc32e600640 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc320018500 con 0x55d833dba3f0 2024-02-21T07:55:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.078+0000 7fc32e600640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3140ca100 tx=0x7fc3140c1f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899c33fc35c3538a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.078+0000 7fc30ea00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.078+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140ca3a0 con 0x55d833dba3f0 2024-02-21T07:55:49.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.079+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8339f77e0 con 0x55d833dba3f0 2024-02-21T07:55:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.079+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3140c12e0 con 0x55d833dba3f0 2024-02-21T07:55:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.080+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3140c14a0 con 0x55d833dba3f0 2024-02-21T07:55:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.080+0000 7fc33340d740 10 client.7159 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.080+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d833cf65a0 con 0x55d833dba3f0 2024-02-21T07:55:49.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.080+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8339f77e0 con 0x55d833dba3f0 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.083+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc3140df2a0 con 0x55d833dba3f0 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 10 client.7159 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 10 client.7159 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 20 client.7159 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833dba870 0x55d833e0dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 4 client.7159 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d833a34720 con 0x55d833dba870 2024-02-21T07:55:49.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.084+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833dba870 0x55d833e0dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.085+0000 7fc32dc00640 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833dba870 0x55d833e0dde0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6465265347db3c37 server_cookie=4f8671fac931bbba in_seq=0 out_seq=0 2024-02-21T07:55:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.085+0000 7fc30ea00640 10 client.7159 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.087+0000 7fc30ea00640 1 -- 172.21.15.100:0/2602088691 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d833a34720 con 0x55d833dba870 2024-02-21T07:55:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.087+0000 7fc30ea00640 10 client.7159 handle_command_reply: tid=0 2024-02-21T07:55:49.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.087+0000 7fc33340d740 1 client.7159 shutdown 2024-02-21T07:55:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.090+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 msgr2=0x55d833e04900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.090+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc3140ca100 tx=0x7fc3140c1f50 comp rx=0 tx=0).stop 2024-02-21T07:55:49.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.090+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 shutdown_connections 2024-02-21T07:55:49.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.090+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833dba870 0x55d833e0dde0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.090+0000 7fc30ea00640 0 client.7159 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:49.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.091+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833e04900 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.091+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833e07740 0x55d833d8bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.091+0000 7fc33340d740 1 --2- 172.21.15.100:0/2602088691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.091+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 >> 172.21.15.100:0/2602088691 conn(0x55d833dcc070 msgr2=0x55d833d900b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.092+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 shutdown_connections 2024-02-21T07:55:49.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.092+0000 7fc33340d740 1 -- 172.21.15.100:0/2602088691 wait complete. 2024-02-21T07:55:49.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.093+0000 7fc33340d740 20 client.7159 trim_cache size 0 max 16384 2024-02-21T07:55:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.121+0000 7fc33340d740 1 Processor -- start 2024-02-21T07:55:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.122+0000 7fc33340d740 1 -- start start 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 0x55d833d86700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e0db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833e07f90 con 0x55d833dba3f0 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833e075a0 con 0x55d833dcc990 2024-02-21T07:55:49.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.125+0000 7fc33340d740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833d8cf00 con 0x55d833dba870 2024-02-21T07:55:49.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.126+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.126+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46536/0 (socket says 172.21.15.100:46536) 2024-02-21T07:55:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.126+0000 7fc32dc00640 1 -- 172.21.15.100:0/3122162055 learned_addr learned my addr 172.21.15.100:0/3122162055 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.127+0000 7fc32d200640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 0x55d833d86700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.127+0000 7fc32dc00640 1 -- 172.21.15.100:0/3122162055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 msgr2=0x55d833d86700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.127+0000 7fc32e600640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e0db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.128+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 0x55d833d86700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.128+0000 7fc32dc00640 1 -- 172.21.15.100:0/3122162055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 msgr2=0x55d833e0db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.128+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e0db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.128+0000 7fc32dc00640 1 -- 172.21.15.100:0/3122162055 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d833c92ab0 con 0x55d833dba3f0 2024-02-21T07:55:49.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.128+0000 7fc32d200640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 0x55d833d86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.129+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc320025040 tx=0x7fc320013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a742848d63b3c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.130+0000 7fc319600640 1 -- 172.21.15.100:0/3122162055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32001d040 con 0x55d833dba3f0 2024-02-21T07:55:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.132+0000 7fc319600640 1 -- 172.21.15.100:0/3122162055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320000fd0 con 0x55d833dba3f0 2024-02-21T07:55:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.132+0000 7fc319600640 1 -- 172.21.15.100:0/3122162055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320011070 con 0x55d833dba3f0 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 -- 172.21.15.100:0/3122162055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 msgr2=0x55d833df9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc320025040 tx=0x7fc320013000 comp rx=0 tx=0).stop 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 -- 172.21.15.100:0/3122162055 shutdown_connections 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dcc990 0x55d833e0db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dba870 0x55d833d86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 --2- 172.21.15.100:0/3122162055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba3f0 0x55d833df9890 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.133+0000 7fc33340d740 1 -- 172.21.15.100:0/3122162055 >> 172.21.15.100:0/3122162055 conn(0x55d833dcc070 msgr2=0x55d833d8bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.134+0000 7fc33340d740 1 -- 172.21.15.100:0/3122162055 shutdown_connections 2024-02-21T07:55:49.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.134+0000 7fc33340d740 1 -- 172.21.15.100:0/3122162055 wait complete. 2024-02-21T07:55:49.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.135+0000 7fc33340d740 1 -- start start 2024-02-21T07:55:49.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.135+0000 7fc33340d740 1 Processor -- start 2024-02-21T07:55:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.138+0000 7fc33340d740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833dc0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.138+0000 7fc33340d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 0x55d833e0db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.139+0000 7fc33340d740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc33340d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833db61e0 con 0x55d833dba870 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc32e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc32e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53432/0 (socket says 172.21.15.100:53432) 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc32d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 0x55d833e0db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc32e600640 1 -- 172.21.15.100:0/3714967756 learned_addr learned my addr 172.21.15.100:0/3714967756 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.140+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833dc0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.141+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833dc0ff0 con 0x55d833dba3f0 2024-02-21T07:55:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.141+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d833db30e0 con 0x55d833dcc990 2024-02-21T07:55:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.141+0000 7fc33340d740 10 client.0 _ll_register_callbacks cb 0x7fc320009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32d200640 1 -- 172.21.15.100:0/3714967756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 msgr2=0x55d833db5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32d200640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32d200640 1 -- 172.21.15.100:0/3714967756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 msgr2=0x55d833dc0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32d200640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833dc0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32d200640 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d833cb9df0 con 0x55d833dba870 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.142+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833dc0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.143+0000 7fc32d200640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 0x55d833e0db10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55d833dfd4d0 tx=0x7fc31c015720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1685cea2fd1362 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.143+0000 7fc30ea00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:49.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.143+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c007260 con 0x55d833dba870 2024-02-21T07:55:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.144+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc31c0073c0 con 0x55d833dba870 2024-02-21T07:55:49.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.144+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc320018050 con 0x55d833dba870 2024-02-21T07:55:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.145+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc31c007580 con 0x55d833dba870 2024-02-21T07:55:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.145+0000 7fc33340d740 10 client.6972 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:49.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.145+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d833cb8650 con 0x55d833dba870 2024-02-21T07:55:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.146+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320018050 con 0x55d833dba870 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.146+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc31c006790 con 0x55d833dba870 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 10 client.6972 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 10 client.6972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 20 client.6972 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833e07740 0x55d833d8b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 4 client.6972 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:49.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d833a83890 con 0x55d833e07740 2024-02-21T07:55:49.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.147+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833e07740 0x55d833d8b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.148+0000 7fc30ea00640 10 client.6972 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:49.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.150+0000 7fc32dc00640 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833e07740 0x55d833d8b7b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8ddedb380cd61cc server_cookie=ed8d0d7bd8b01fa6 in_seq=0 out_seq=0 2024-02-21T07:55:49.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc30ea00640 1 -- 172.21.15.100:0/3714967756 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d833a83890 con 0x55d833e07740 2024-02-21T07:55:49.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc30ea00640 10 client.6972 handle_command_reply: tid=0 2024-02-21T07:55:49.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 client.6972 shutdown 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 msgr2=0x55d833e0db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 0x55d833e0db10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55d833dfd4d0 tx=0x7fc31c015720 comp rx=0 tx=0).stop 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 shutdown_connections 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d833dcc990 0x55d833db5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d833dba870 0x55d833e0db10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.151+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55d833e07740 0x55d833d8b7b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.152+0000 7fc33340d740 1 --2- 172.21.15.100:0/3714967756 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d833dba3f0 0x55d833dc0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.152+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 >> 172.21.15.100:0/3714967756 conn(0x55d833dcc070 msgr2=0x55d833e1f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.152+0000 7fc30ea00640 0 client.6972 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:55:49.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.152+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 shutdown_connections 2024-02-21T07:55:49.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.152+0000 7fc33340d740 1 -- 172.21.15.100:0/3714967756 wait complete. 2024-02-21T07:55:49.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.153+0000 7fc33340d740 20 client.6972 trim_cache size 0 max 16384 2024-02-21T07:55:49.155 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:49.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.155+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 msgr2=0x7fc3080a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.155+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 0x7fc3080a1560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc32000c420 tx=0x7fc320009570 comp rx=0 tx=0).stop 2024-02-21T07:55:49.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.155+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 msgr2=0x7fc32816e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.155+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc314013d00 tx=0x7fc3140046c0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 shutdown_connections 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc32818c090 0x7fc32816e720 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc32818bcb0 0x7fc32821b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc30809f0a0 0x7fc3080a1560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 --2- 172.21.15.100:0/2452072049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3280f7b80 0x7fc32816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.157+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 >> 172.21.15.100:0/2452072049 conn(0x7fc3280ce150 msgr2=0x7fc32817a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.163+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 shutdown_connections 2024-02-21T07:55:49.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.163+0000 7fc32f000640 1 -- 172.21.15.100:0/2452072049 wait complete. 2024-02-21T07:55:49.197 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:55:49.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:55:49.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.540+0000 7f43a2400640 1 Processor -- start 2024-02-21T07:55:49.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.540+0000 7f43a2400640 1 -- start start 2024-02-21T07:55:49.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.542+0000 7f43a2400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c0ca6a0 con 0x7f439c189ca0 2024-02-21T07:55:49.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.542+0000 7f43a2400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c0f6200 con 0x7f439c06ab60 2024-02-21T07:55:49.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.542+0000 7f43a2400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c06afc0 con 0x7f439c18a790 2024-02-21T07:55:49.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.542+0000 7f439b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f439c189ca0 0x7f439c0cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40564/0 (socket says 172.21.15.100:40564) 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.542+0000 7f439b400640 1 -- 172.21.15.100:0/3613077088 learned_addr learned my addr 172.21.15.100:0/3613077088 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741386218 0 0) 0x7f439c0ca6a0 con 0x7f439c189ca0 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4380003520 con 0x7f439c189ca0 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154162733 0 0) 0x7f439c0f6200 con 0x7f439c06ab60 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f439c0ca6a0 con 0x7f439c06ab60 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304445507 0 0) 0x7f439c06afc0 con 0x7f439c18a790 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f439c0f6200 con 0x7f439c18a790 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3872526197 0 0) 0x7f4380003520 con 0x7f439c189ca0 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 >> v1:172.21.15.170:6789/0 conn(0x7f439c18a790 legacy=0x7f439c18f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 >> v1:172.21.15.156:6789/0 conn(0x7f439c06ab60 legacy=0x7f439c18a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c0f6450 con 0x7f439c189ca0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f438c0015f0 con 0x7f439c189ca0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 >> v1:172.21.15.100:6789/0 conn(0x7f439c189ca0 legacy=0x7f439c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4380004dc0 0x7f43800051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f4380003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43800042a0 0x7f438000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438000c210 con 0x7f43800037b0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438000c380 con 0x7f43800042a0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.543+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438000c540 con 0x7f4380004dc0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439b400640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4380004dc0 0x7f43800051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f4380003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439be00640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43800042a0 0x7f438000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 -- 172.21.15.100:0/3613077088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4380004dc0 msgr2=0x7f43800051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4380004dc0 0x7f43800051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 -- 172.21.15.100:0/3613077088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43800042a0 msgr2=0x7f438000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f43800042a0 0x7f438000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439aa00640 1 -- 172.21.15.100:0/3613077088 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380003520 con 0x7f43800037b0 2024-02-21T07:55:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439be00640 1 -- 172.21.15.100:0/3613077088 reap_dead start 2024-02-21T07:55:49.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.544+0000 7f439b400640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4380004dc0 0x7f43800051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.545+0000 7f439aa00640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f4380003c30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4384001830 tx=0x7f43800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540a29f97e6c2b6c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.546+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43840052d0 con 0x7f43800037b0 2024-02-21T07:55:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.546+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438402e050 con 0x7f43800037b0 2024-02-21T07:55:49.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.546+0000 7f439a000640 1 -- 172.21.15.100:0/3613077088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384003830 con 0x7f43800037b0 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.546+0000 7f43a2400640 1 -- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 msgr2=0x7f4380003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.546+0000 7f43a2400640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f4380003c30 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4384001830 tx=0x7f43800057f0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.547+0000 7f43a2400640 1 -- 172.21.15.100:0/3613077088 shutdown_connections 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.547+0000 7f43a2400640 1 --2- 172.21.15.100:0/3613077088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f4380003c30 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.547+0000 7f43a2400640 1 -- 172.21.15.100:0/3613077088 >> 172.21.15.100:0/3613077088 conn(0x7f439c0668b0 msgr2=0x7f439c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.547+0000 7f43a2400640 1 -- 172.21.15.100:0/3613077088 shutdown_connections 2024-02-21T07:55:49.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.547+0000 7f43a2400640 1 -- 172.21.15.100:0/3613077088 wait complete. 2024-02-21T07:55:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.549+0000 7f43a2400640 1 Processor -- start 2024-02-21T07:55:49.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.549+0000 7f43a2400640 1 -- start start 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f439c2222f0 0x7f439c0f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f439c170350 0x7f439c0edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c221ed0 con 0x7f43800037b0 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c220f70 con 0x7f439c2222f0 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.550+0000 7f43a2400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c221250 con 0x7f439c170350 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46578/0 (socket says 172.21.15.100:46578) 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 -- 172.21.15.100:0/4089872227 learned_addr learned my addr 172.21.15.100:0/4089872227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439be00640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f439c170350 0x7f439c0edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439aa00640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f439c2222f0 0x7f439c0f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 -- 172.21.15.100:0/4089872227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f439c170350 msgr2=0x7f439c0edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f439c170350 0x7f439c0edc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 -- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f439c2222f0 msgr2=0x7f439c0f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f439c2222f0 0x7f439c0f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.551+0000 7f439b400640 1 -- 172.21.15.100:0/4089872227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c221530 con 0x7f43800037b0 2024-02-21T07:55:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f439b400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f438c001200 tx=0x7f438c007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f4393400640 1 -- 172.21.15.100:0/4089872227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c007ea0 con 0x7f43800037b0 2024-02-21T07:55:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f4393400640 1 -- 172.21.15.100:0/4089872227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c00f8e0 con 0x7f43800037b0 2024-02-21T07:55:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f4393400640 1 -- 172.21.15.100:0/4089872227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00fc50 con 0x7f43800037b0 2024-02-21T07:55:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c221810 con 0x7f43800037b0 2024-02-21T07:55:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.552+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c222750 con 0x7f43800037b0 2024-02-21T07:55:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.559+0000 7f4393400640 1 -- 172.21.15.100:0/4089872227 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f438c01d460 con 0x7f43800037b0 2024-02-21T07:55:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.561+0000 7f43a501c740 1 Processor -- start 2024-02-21T07:55:49.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.562+0000 7f43a501c740 1 -- start start 2024-02-21T07:55:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.562+0000 7f4393400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 0x7f43780a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.562+0000 7f4393400640 1 -- 172.21.15.100:0/4089872227 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f438c0c9a70 con 0x7f43800037b0 2024-02-21T07:55:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.563+0000 7f43a501c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 0x55e7f7dfeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f43a501c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e39860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f43a501c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f43a501c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7d29210 con 0x55e7f7dfeff0 2024-02-21T07:55:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f43a501c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7d26740 con 0x55e7f7e39da0 2024-02-21T07:55:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f43a501c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7d21f20 con 0x55e7f7dfe6d0 2024-02-21T07:55:49.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f439be00640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 0x7f43780a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f439be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f439be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56174/0 (socket says 172.21.15.100:56174) 2024-02-21T07:55:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f439be00640 1 -- 172.21.15.100:0/1701633998 learned_addr learned my addr 172.21.15.100:0/1701633998 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.564+0000 7f439b400640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 0x55e7f7dfeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.565+0000 7f439be00640 1 -- 172.21.15.100:0/1701633998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 msgr2=0x55e7f7dfeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.565+0000 7f439aa00640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e39860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439be00640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 0x55e7f7dfeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439be00640 1 -- 172.21.15.100:0/1701633998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 msgr2=0x55e7f7e39860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439be00640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e39860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439be00640 1 -- 172.21.15.100:0/1701633998 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f7ce3df0 con 0x55e7f7e39da0 2024-02-21T07:55:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439aa00640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e39860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.569+0000 7f439b400640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 0x55e7f7dfeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.570+0000 7f439be00640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 0x7f43780a1610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f439c18ab70 tx=0x7f43940020b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.570+0000 7f439be00640 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4394017fc0 tx=0x7f439401e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=254955ee4e2c4a57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.570+0000 7f438be00640 1 -- 172.21.15.100:0/1701633998 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439401e070 con 0x55e7f7e39da0 2024-02-21T07:55:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.570+0000 7f438be00640 1 -- 172.21.15.100:0/1701633998 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394006b50 con 0x55e7f7e39da0 2024-02-21T07:55:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.570+0000 7f438be00640 1 -- 172.21.15.100:0/1701633998 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394006cc0 con 0x55e7f7e39da0 2024-02-21T07:55:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 -- 172.21.15.100:0/1701633998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 msgr2=0x55e7f7e3ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4394017fc0 tx=0x7f439401e000 comp rx=0 tx=0).stop 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 -- 172.21.15.100:0/1701633998 shutdown_connections 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3ab30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e39860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 --2- 172.21.15.100:0/1701633998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfe6d0 0x55e7f7dfeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.571+0000 7f43a501c740 1 -- 172.21.15.100:0/1701633998 >> 172.21.15.100:0/1701633998 conn(0x55e7f7dc0ca0 msgr2=0x55e7f7dc1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.572+0000 7f43a501c740 1 -- 172.21.15.100:0/1701633998 shutdown_connections 2024-02-21T07:55:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.572+0000 7f43a501c740 1 -- 172.21.15.100:0/1701633998 wait complete. 2024-02-21T07:55:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.574+0000 7f43a501c740 1 -- start start 2024-02-21T07:55:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.574+0000 7f43a501c740 1 Processor -- start 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e37750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7cc7150 con 0x55e7f7e43030 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7cc6df0 con 0x55e7f7dfeff0 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7a901c0 con 0x55e7f7e39da0 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.576+0000 7f43a501c740 10 client.0 _ll_register_callbacks cb 0x55e7f7d162b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.580+0000 7f439be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.580+0000 7f439be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46588/0 (socket says 172.21.15.100:46588) 2024-02-21T07:55:49.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.580+0000 7f439be00640 1 -- 172.21.15.100:0/1875638661 learned_addr learned my addr 172.21.15.100:0/1875638661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f439be00640 1 -- 172.21.15.100:0/1875638661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 msgr2=0x55e7f7e37750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f439be00640 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e37750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f439be00640 1 -- 172.21.15.100:0/1875638661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7dfeff0 msgr2=0x55e7f7df0980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f439be00640 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df0980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f439be00640 1 -- 172.21.15.100:0/1875638661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0f6200 con 0x55e7f7e43030 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.582+0000 7f4388c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:49.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.583+0000 7f439be00640 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4394026040 tx=0x7f4394009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843cb2ab48fb799d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.584+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439401e040 con 0x55e7f7e43030 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.584+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4394014d60 con 0x55e7f7e43030 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.584+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7f7a217e0 con 0x55e7f7e43030 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.585+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439401e040 con 0x55e7f7e43030 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.585+0000 7f43a501c740 10 client.6981 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:49.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.585+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e7f7d205a0 con 0x55e7f7e43030 2024-02-21T07:55:49.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.587+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394023480 con 0x55e7f7e43030 2024-02-21T07:55:49.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.588+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f439402a030 con 0x55e7f7e43030 2024-02-21T07:55:49.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.588+0000 7f43a501c740 10 client.6981 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:49.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.588+0000 7f43a501c740 10 client.6981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:49.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.589+0000 7f43a501c740 20 client.6981 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:49.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.589+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7e434b0 0x55e7f7df8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.589+0000 7f43a501c740 4 client.6981 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:49.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.589+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7f7a217e0 con 0x55e7f7e434b0 2024-02-21T07:55:49.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.592+0000 7f439b400640 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7e434b0 0x55e7f7df8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.596+0000 7f439b400640 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7e434b0 0x55e7f7df8550 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a7726b8df43a257 server_cookie=f18c35f0922572ec in_seq=0 out_seq=0 2024-02-21T07:55:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.597+0000 7f4388c00640 10 client.6981 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:49.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.598+0000 7f4388c00640 1 -- 172.21.15.100:0/1875638661 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e7f7a217e0 con 0x55e7f7e434b0 2024-02-21T07:55:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.598+0000 7f4388c00640 10 client.6981 handle_command_reply: tid=0 2024-02-21T07:55:49.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.598+0000 7f43a501c740 1 client.6981 shutdown 2024-02-21T07:55:49.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.602+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 msgr2=0x55e7f7df7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.602+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4394026040 tx=0x7f4394009040 comp rx=0 tx=0).stop 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 shutdown_connections 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7e434b0 0x55e7f7df8550 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e43030 0x55e7f7df7b40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e37750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 --2- 172.21.15.100:0/1875638661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 >> 172.21.15.100:0/1875638661 conn(0x55e7f7dfe6d0 msgr2=0x55e7f7dc2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.608+0000 7f4388c00640 0 client.6981 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:49.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.610+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 shutdown_connections 2024-02-21T07:55:49.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.611+0000 7f43a501c740 1 -- 172.21.15.100:0/1875638661 wait complete. 2024-02-21T07:55:49.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.612+0000 7f43a501c740 20 client.6981 trim_cache size 0 max 16384 2024-02-21T07:55:49.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.666+0000 7f43a501c740 1 Processor -- start 2024-02-21T07:55:49.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.670+0000 7f43a501c740 1 -- start start 2024-02-21T07:55:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.677+0000 7f43a501c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f43a501c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f43a501c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7db05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f43a501c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7dea680 con 0x55e7f7dfeff0 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f43a501c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7e09850 con 0x55e7f7e43030 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f43a501c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7dfeab0 con 0x55e7f7e39da0 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f439aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f439aa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53470/0 (socket says 172.21.15.100:53470) 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.687+0000 7f439aa00640 1 -- 172.21.15.100:0/2308672754 learned_addr learned my addr 172.21.15.100:0/2308672754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.688+0000 7f439be00640 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7db05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.688+0000 7f439aa00640 1 -- 172.21.15.100:0/2308672754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 msgr2=0x55e7f7db05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.688+0000 7f439aa00640 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7db05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.688+0000 7f439aa00640 1 -- 172.21.15.100:0/2308672754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 msgr2=0x55e7f7df8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.688+0000 7f439aa00640 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.689+0000 7f439aa00640 1 -- 172.21.15.100:0/2308672754 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f7cbcab0 con 0x55e7f7e39da0 2024-02-21T07:55:49.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.690+0000 7f439aa00640 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4384001920 tx=0x7f438402f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19633fcd2057fc4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.692+0000 7f438b400640 1 -- 172.21.15.100:0/2308672754 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384005070 con 0x55e7f7e39da0 2024-02-21T07:55:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.694+0000 7f438b400640 1 -- 172.21.15.100:0/2308672754 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43840051d0 con 0x55e7f7e39da0 2024-02-21T07:55:49.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.696+0000 7f43a501c740 1 -- 172.21.15.100:0/2308672754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 msgr2=0x55e7f7e3a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.696+0000 7f43a501c740 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4384001920 tx=0x7f438402f000 comp rx=0 tx=0).stop 2024-02-21T07:55:49.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.695+0000 7f438b400640 1 -- 172.21.15.100:0/2308672754 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4384007030 con 0x55e7f7e39da0 2024-02-21T07:55:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.698+0000 7f43a501c740 1 -- 172.21.15.100:0/2308672754 shutdown_connections 2024-02-21T07:55:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.698+0000 7f43a501c740 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7db05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.698+0000 7f43a501c740 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7e39da0 0x55e7f7e3a180 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.698+0000 7f43a501c740 1 --2- 172.21.15.100:0/2308672754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7dfeff0 0x55e7f7df8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.698+0000 7f43a501c740 1 -- 172.21.15.100:0/2308672754 >> 172.21.15.100:0/2308672754 conn(0x55e7f7dfe6d0 msgr2=0x55e7f7df7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.708+0000 7f43a501c740 1 -- 172.21.15.100:0/2308672754 shutdown_connections 2024-02-21T07:55:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.717+0000 7f43a501c740 1 -- 172.21.15.100:0/2308672754 wait complete. 2024-02-21T07:55:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.720+0000 7f43a501c740 1 -- start start 2024-02-21T07:55:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.720+0000 7f43a501c740 1 Processor -- start 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e39da0 0x55e7f7df0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7e9dfa0 con 0x55e7f7e39da0 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7e9d810 con 0x55e7f7e43030 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f7e4a360 con 0x55e7f7dfeff0 2024-02-21T07:55:49.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.725+0000 7f43a501c740 10 client.0 _ll_register_callbacks cb 0x7f4394017670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.736+0000 7f439b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.736+0000 7f439be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.736+0000 7f439be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:56190/0 (socket says 172.21.15.100:56190) 2024-02-21T07:55:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.736+0000 7f439be00640 1 -- 172.21.15.100:0/3854700622 learned_addr learned my addr 172.21.15.100:0/3854700622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:49.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.736+0000 7f439b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:53476/0 (socket says 172.21.15.100:53476) 2024-02-21T07:55:49.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439be00640 1 -- 172.21.15.100:0/3854700622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 msgr2=0x55e7f7e35f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439be00640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439be00640 1 -- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e39da0 msgr2=0x55e7f7df0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439be00640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e39da0 0x55e7f7df0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439be00640 1 -- 172.21.15.100:0/3854700622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4380003520 con 0x55e7f7e43030 2024-02-21T07:55:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.738+0000 7f439b400640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.739+0000 7f4388c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:55:49.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.739+0000 7f439be00640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4394015010 tx=0x7f439400f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=952851433f3f6c8e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:49.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.739+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439401e040 con 0x55e7f7e43030 2024-02-21T07:55:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.741+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4394024e30 con 0x55e7f7e43030 2024-02-21T07:55:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.741+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7f7e395b0 con 0x55e7f7e43030 2024-02-21T07:55:49.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.742+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439401e040 con 0x55e7f7e43030 2024-02-21T07:55:49.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.743+0000 7f43a501c740 10 client.7174 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:49.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.743+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e7f7ce2650 con 0x55e7f7e43030 2024-02-21T07:55:49.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.744+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394023480 con 0x55e7f7e43030 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f439404a070 con 0x55e7f7e43030 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f43a501c740 10 client.7174 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f43a501c740 10 client.7174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f43a501c740 20 client.7174 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7df5170 0x55e7f7dc82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:49.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.747+0000 7f43a501c740 4 client.7174 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:55:49.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.748+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e7f7e395b0 con 0x55e7f7df5170 2024-02-21T07:55:49.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.758+0000 7f439b400640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7df5170 0x55e7f7dc82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:49.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.767+0000 7f439b400640 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7df5170 0x55e7f7dc82e0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69478cda0bc3f940 server_cookie=3d78caa1149bf98a in_seq=0 out_seq=0 2024-02-21T07:55:49.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.768+0000 7f4388c00640 10 client.7174 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.774+0000 7f4388c00640 1 -- 172.21.15.100:0/3854700622 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e7f7e395b0 con 0x55e7f7df5170 2024-02-21T07:55:49.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.774+0000 7f4388c00640 10 client.7174 handle_command_reply: tid=0 2024-02-21T07:55:49.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.775+0000 7f43a501c740 1 client.7174 shutdown 2024-02-21T07:55:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.778+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 msgr2=0x55e7f7e035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.778+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4394015010 tx=0x7f439400f000 comp rx=0 tx=0).stop 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 shutdown_connections 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e7f7df5170 0x55e7f7dc82e0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f7e43030 0x55e7f7e035a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7f7e39da0 0x55e7f7df0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 --2- 172.21.15.100:0/3854700622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e7f7dfeff0 0x55e7f7e35f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 >> 172.21.15.100:0/3854700622 conn(0x55e7f7dfe6d0 msgr2=0x55e7f7e424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.781+0000 7f4388c00640 0 client.7174 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.782+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 shutdown_connections 2024-02-21T07:55:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.782+0000 7f43a501c740 1 -- 172.21.15.100:0/3854700622 wait complete. 2024-02-21T07:55:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.782+0000 7f43a501c740 20 client.7174 trim_cache size 0 max 16384 2024-02-21T07:55:49.785 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:55:49.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.784+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 msgr2=0x7f43780a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.784+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 0x7f43780a1610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f439c18ab70 tx=0x7f43940020b0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.784+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 msgr2=0x7f439c220950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.784+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f438c001200 tx=0x7f438c007720 comp rx=0 tx=0).stop 2024-02-21T07:55:49.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 shutdown_connections 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f439c170350 0x7f439c0edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f439c2222f0 0x7f439c0f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f437809f150 0x7f43780a1610 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 --2- 172.21.15.100:0/4089872227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43800037b0 0x7f439c220950 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.785+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 >> 172.21.15.100:0/4089872227 conn(0x7f439c0668b0 msgr2=0x7f439c06f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.788+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 shutdown_connections 2024-02-21T07:55:49.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:49.788+0000 7f43a2400640 1 -- 172.21.15.100:0/4089872227 wait complete. 2024-02-21T07:55:50.851 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:55:50.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:55:50.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:55:51.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.267+0000 7fa0b7400640 1 Processor -- start 2024-02-21T07:55:51.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.268+0000 7fa0b7400640 1 -- start start 2024-02-21T07:55:51.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b7400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0b0186d90 0x7fa0b018f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b7400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0b018fc30 0x7fa0b0190a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b7400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b018e230 con 0x7fa0b018f780 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b7400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b0073100 con 0x7fa0b0186d90 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b7400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b00f85f0 con 0x7fa0b018fc30 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b5400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0b018fc30 0x7fa0b0190a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0afe00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa0b018f780 0x7fa0b0190330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55236/0 (socket says 172.21.15.100:55236) 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b5400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa0b018fc30 0x7fa0b0190a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32818/0 (socket says 172.21.15.100:32818) 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0b4a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa0b0186d90 0x7fa0b018f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.273+0000 7fa0afe00640 1 -- 172.21.15.100:0/1006197812 learned_addr learned my addr 172.21.15.100:0/1006197812 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.274+0000 7fa0b5400640 1 -- 172.21.15.100:0/1006197812 >> v2:172.21.15.156:3300/0 conn(0x7fa0b0186d90 msgr2=0x7fa0b018f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.274+0000 7fa0b5400640 1 --2- 172.21.15.100:0/1006197812 >> v2:172.21.15.156:3300/0 conn(0x7fa0b0186d90 0x7fa0b018f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.274+0000 7fa0b5400640 1 -- 172.21.15.100:0/1006197812 >> v1:172.21.15.156:6789/0 conn(0x7fa0b018f780 legacy=0x7fa0b0190330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.274+0000 7fa0af400640 1 -- 172.21.15.100:0/1006197812 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289526242 0 0) 0x7fa0b018e230 con 0x7fa0b018f780 2024-02-21T07:55:51.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.274+0000 7fa0b5400640 1 -- 172.21.15.100:0/1006197812 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b018e480 con 0x7fa0b018fc30 2024-02-21T07:55:51.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.275+0000 7fa0b5400640 1 --2- 172.21.15.100:0/1006197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018fc30 0x7fa0b0190a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa0b008f4d0 tx=0x7fa09c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd394e6245ed4a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.276+0000 7fa0af400640 1 -- 172.21.15.100:0/1006197812 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c02e070 con 0x7fa0b018fc30 2024-02-21T07:55:51.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.276+0000 7fa0af400640 1 -- 172.21.15.100:0/1006197812 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c0315a0 con 0x7fa0b018fc30 2024-02-21T07:55:51.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.276+0000 7fa0af400640 1 -- 172.21.15.100:0/1006197812 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c031930 con 0x7fa0b018fc30 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 -- 172.21.15.100:0/1006197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018fc30 msgr2=0x7fa0b0190a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 --2- 172.21.15.100:0/1006197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018fc30 0x7fa0b0190a40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa0b008f4d0 tx=0x7fa09c02b840 comp rx=0 tx=0).stop 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 -- 172.21.15.100:0/1006197812 shutdown_connections 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 --2- 172.21.15.100:0/1006197812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018fc30 0x7fa0b0190a40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 --2- 172.21.15.100:0/1006197812 >> v2:172.21.15.156:3300/0 conn(0x7fa0b0186d90 0x7fa0b018f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 -- 172.21.15.100:0/1006197812 >> 172.21.15.100:0/1006197812 conn(0x7fa0b00fbec0 msgr2=0x7fa0b00fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 -- 172.21.15.100:0/1006197812 shutdown_connections 2024-02-21T07:55:51.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.277+0000 7fa0b7400640 1 -- 172.21.15.100:0/1006197812 wait complete. 2024-02-21T07:55:51.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.281+0000 7fa0b7400640 1 Processor -- start 2024-02-21T07:55:51.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.281+0000 7fa0b7400640 1 -- start start 2024-02-21T07:55:51.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.283+0000 7fa0b7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 0x7fa0b008c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.283+0000 7fa0b7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 0x7fa0b0174750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 0x7fa0b008c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 0x7fa0b008c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38788/0 (socket says 172.21.15.100:38788) 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b018fc30 0x7fa0b02245c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b7400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b017ada0 con 0x7fa0b018fc30 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b7400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b02241a0 con 0x7fa0b0186d90 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b7400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b017d090 con 0x7fa0b018f780 2024-02-21T07:55:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b4a00640 1 -- 172.21.15.100:0/3423341561 learned_addr learned my addr 172.21.15.100:0/3423341561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0afe00640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 0x7fa0b0174750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.285+0000 7fa0b5400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b018fc30 0x7fa0b02245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 -- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 msgr2=0x7fa0b008c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 0x7fa0b008c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 -- 172.21.15.100:0/3423341561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b018fc30 msgr2=0x7fa0b02245c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b018fc30 0x7fa0b02245c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 -- 172.21.15.100:0/3423341561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009400 con 0x7fa0b018f780 2024-02-21T07:55:51.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.286+0000 7fa0afe00640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 0x7fa0b0174750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c3e0 tx=0x7fa0a000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.287+0000 7fa0acc00640 1 -- 172.21.15.100:0/3423341561 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00074e0 con 0x7fa0b018f780 2024-02-21T07:55:51.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.287+0000 7fa0acc00640 1 -- 172.21.15.100:0/3423341561 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0007640 con 0x7fa0b018f780 2024-02-21T07:55:51.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.287+0000 7fa0acc00640 1 -- 172.21.15.100:0/3423341561 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0004a20 con 0x7fa0b018f780 2024-02-21T07:55:51.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.288+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b008d120 con 0x7fa0b018f780 2024-02-21T07:55:51.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.288+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b008d6e0 con 0x7fa0b018f780 2024-02-21T07:55:51.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.292+0000 7fa0acc00640 1 -- 172.21.15.100:0/3423341561 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa0a0004c40 con 0x7fa0b018f780 2024-02-21T07:55:51.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.292+0000 7fa0ba180740 1 Processor -- start 2024-02-21T07:55:51.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.292+0000 7fa0ba180740 1 -- start start 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdc1c0 0x5603d3bdc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3c18620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b5c300 con 0x5603d3c17890 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b0ee50 con 0x5603d3bdc1c0 2024-02-21T07:55:51.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0ba180740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b0c380 con 0x5603d3bdcae0 2024-02-21T07:55:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0b5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdc1c0 0x5603d3bdc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32826/0 (socket says 172.21.15.100:32826) 2024-02-21T07:55:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.294+0000 7fa0b4a00640 1 -- 172.21.15.100:0/3597965706 learned_addr learned my addr 172.21.15.100:0/3597965706 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0afe00640 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3c18620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 -- 172.21.15.100:0/3597965706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdc1c0 msgr2=0x5603d3bdc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdc1c0 0x5603d3bdc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 -- 172.21.15.100:0/3597965706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 msgr2=0x5603d3c18620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3c18620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 -- 172.21.15.100:0/3597965706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d3ad0c80 con 0x5603d3bdcae0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80115e0 tx=0x7fa0a8009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704aba82b30c6ca6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0a5200640 1 -- 172.21.15.100:0/3597965706 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800e040 con 0x5603d3bdcae0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0a5200640 1 -- 172.21.15.100:0/3597965706 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a800f040 con 0x5603d3bdcae0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.295+0000 7fa0a5200640 1 -- 172.21.15.100:0/3597965706 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8015b40 con 0x5603d3bdcae0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.296+0000 7fa0acc00640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 0x7fa0900a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.296+0000 7fa0acc00640 1 -- 172.21.15.100:0/3423341561 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa0a00c97b0 con 0x7fa0b018f780 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.296+0000 7fa0ba180740 1 -- 172.21.15.100:0/3597965706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 msgr2=0x5603d3c17350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.296+0000 7fa0ba180740 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80115e0 tx=0x7fa0a8009750 comp rx=0 tx=0).stop 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0b5400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 0x7fa0900a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 -- 172.21.15.100:0/3597965706 shutdown_connections 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3c18620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c17350 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 --2- 172.21.15.100:0/3597965706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdc1c0 0x5603d3bdc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 -- 172.21.15.100:0/3597965706 >> 172.21.15.100:0/3597965706 conn(0x5603d3b9e790 msgr2=0x5603d3b9f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 -- 172.21.15.100:0/3597965706 shutdown_connections 2024-02-21T07:55:51.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0ba180740 1 -- 172.21.15.100:0/3597965706 wait complete. 2024-02-21T07:55:51.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.297+0000 7fa0b5400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 0x7fa0900a1630 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa09c036000 tx=0x7fa09c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.299+0000 7fa0ba180740 1 -- start start 2024-02-21T07:55:51.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.299+0000 7fa0ba180740 1 Processor -- start 2024-02-21T07:55:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c24720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bd1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bcd090 0x5603d3bd89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3b07b60 con 0x5603d3c17890 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3aacfd0 con 0x5603d3bcd090 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3aacc70 con 0x5603d3bdcae0 2024-02-21T07:55:51.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.301+0000 7fa0ba180740 10 client.0 _ll_register_callbacks cb 0x5603d3818c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.303+0000 7fa0afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bd1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.303+0000 7fa0b5400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bcd090 0x5603d3bd89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.303+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c24720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.303+0000 7fa0b4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c24720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32840/0 (socket says 172.21.15.100:32840) 2024-02-21T07:55:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.303+0000 7fa0b4a00640 1 -- 172.21.15.100:0/418180281 learned_addr learned my addr 172.21.15.100:0/418180281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 -- 172.21.15.100:0/418180281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 msgr2=0x5603d3c24720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c24720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 -- 172.21.15.100:0/418180281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bcd090 msgr2=0x5603d3bd89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bcd090 0x5603d3bd89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 -- 172.21.15.100:0/418180281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a8011230 con 0x5603d3c17890 2024-02-21T07:55:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.304+0000 7fa0afe00640 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bd1e90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00c7120 tx=0x7fa0a0096bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7d8f979cc8c66a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.305+0000 7fa099600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:51.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.306+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00c9d60 con 0x5603d3c17890 2024-02-21T07:55:51.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.306+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa0a009b3e0 con 0x5603d3c17890 2024-02-21T07:55:51.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.306+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603d3807860 con 0x5603d3c17890 2024-02-21T07:55:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.308+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0a009fa30 con 0x5603d3c17890 2024-02-21T07:55:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.308+0000 7fa0ba180740 10 client.6987 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.308+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5603d3b061e0 con 0x5603d3c17890 2024-02-21T07:55:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.309+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603d3807860 con 0x5603d3c17890 2024-02-21T07:55:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.309+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa0a001b060 con 0x5603d3c17890 2024-02-21T07:55:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.309+0000 7fa0ba180740 10 client.6987 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.309+0000 7fa0ba180740 10 client.6987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.310+0000 7fa0ba180740 20 client.6987 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.310+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3b9aec0 0x5603d3b9b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.310+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3b9aec0 0x5603d3b9b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.310+0000 7fa0ba180740 4 client.6987 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.310+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603d3858410 con 0x5603d3b9aec0 2024-02-21T07:55:51.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.311+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3b9aec0 0x5603d3b9b2d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa8d8ae93b021e7c server_cookie=7c253f6972391895 in_seq=0 out_seq=0 2024-02-21T07:55:51.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.311+0000 7fa099600640 10 client.6987 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.313+0000 7fa099600640 1 -- 172.21.15.100:0/418180281 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5603d3858410 con 0x5603d3b9aec0 2024-02-21T07:55:51.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.313+0000 7fa099600640 10 client.6987 handle_command_reply: tid=0 2024-02-21T07:55:51.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.313+0000 7fa0ba180740 1 client.6987 shutdown 2024-02-21T07:55:51.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.314+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 msgr2=0x5603d3bd1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.314+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bd1e90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00c7120 tx=0x7fa0a0096bf0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.314+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 shutdown_connections 2024-02-21T07:55:51.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.314+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3b9aec0 0x5603d3b9b2d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.315+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bcd090 0x5603d3bd89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.315+0000 7fa099600640 0 client.6987 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.315+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bd1e90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.315+0000 7fa0ba180740 1 --2- 172.21.15.100:0/418180281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bdcae0 0x5603d3c24720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.315+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 >> 172.21.15.100:0/418180281 conn(0x5603d3bdc1c0 msgr2=0x5603d3ba0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.316+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 shutdown_connections 2024-02-21T07:55:51.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.316+0000 7fa0ba180740 1 -- 172.21.15.100:0/418180281 wait complete. 2024-02-21T07:55:51.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.316+0000 7fa0ba180740 20 client.6987 trim_cache size 0 max 16384 2024-02-21T07:55:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.381+0000 7fa0ba180740 1 Processor -- start 2024-02-21T07:55:51.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.381+0000 7fa0ba180740 1 -- start start 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bcd090 0x5603d3bd1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3c17890 0x5603d3c75cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d38500c0 con 0x5603d3bdcae0 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3c31b00 con 0x5603d3c17890 2024-02-21T07:55:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.383+0000 7fa0ba180740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bca2c0 con 0x5603d3bcd090 2024-02-21T07:55:51.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.386+0000 7fa0afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.386+0000 7fa0afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44266/0 (socket says 172.21.15.100:44266) 2024-02-21T07:55:51.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.386+0000 7fa0afe00640 1 -- 172.21.15.100:0/295805886 learned_addr learned my addr 172.21.15.100:0/295805886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 -- 172.21.15.100:0/295805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bcd090 msgr2=0x5603d3bd1d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bcd090 0x5603d3bd1d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 -- 172.21.15.100:0/295805886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3c17890 msgr2=0x5603d3c75cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3c17890 0x5603d3c75cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 -- 172.21.15.100:0/295805886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603d3aa2a90 con 0x5603d3bdcae0 2024-02-21T07:55:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.387+0000 7fa0afe00640 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000cda0 tx=0x7fa0a00c8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cc509b064f563c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.388+0000 7fa09be00640 1 -- 172.21.15.100:0/295805886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000e040 con 0x5603d3bdcae0 2024-02-21T07:55:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.388+0000 7fa09be00640 1 -- 172.21.15.100:0/295805886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0097060 con 0x5603d3bdcae0 2024-02-21T07:55:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.388+0000 7fa09be00640 1 -- 172.21.15.100:0/295805886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000e040 con 0x5603d3bdcae0 2024-02-21T07:55:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.389+0000 7fa0ba180740 1 -- 172.21.15.100:0/295805886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 msgr2=0x5603d3bbf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.389+0000 7fa0ba180740 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000cda0 tx=0x7fa0a00c8000 comp rx=0 tx=0).stop 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 -- 172.21.15.100:0/295805886 shutdown_connections 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3c17890 0x5603d3c75cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3bdcae0 0x5603d3bbf9a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 --2- 172.21.15.100:0/295805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3bcd090 0x5603d3bd1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 -- 172.21.15.100:0/295805886 >> 172.21.15.100:0/295805886 conn(0x5603d3bdc1c0 msgr2=0x5603d3ba0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 -- 172.21.15.100:0/295805886 shutdown_connections 2024-02-21T07:55:51.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.390+0000 7fa0ba180740 1 -- 172.21.15.100:0/295805886 wait complete. 2024-02-21T07:55:51.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.391+0000 7fa0ba180740 1 -- start start 2024-02-21T07:55:51.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.392+0000 7fa0ba180740 1 Processor -- start 2024-02-21T07:55:51.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdcae0 0x5603d3b9a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3c09ae0 0x5603d3c74cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bc65c0 con 0x5603d3c17890 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3bd2230 con 0x5603d3bdcae0 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603d3c106b0 con 0x5603d3c09ae0 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0ba180740 10 client.0 _ll_register_callbacks cb 0x7fa0a8009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.394+0000 7fa0afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44270/0 (socket says 172.21.15.100:44270) 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 -- 172.21.15.100:0/2619377641 learned_addr learned my addr 172.21.15.100:0/2619377641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 -- 172.21.15.100:0/2619377641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3c09ae0 msgr2=0x5603d3c74cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3c09ae0 0x5603d3c74cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 -- 172.21.15.100:0/2619377641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdcae0 msgr2=0x5603d3b9a190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdcae0 0x5603d3b9a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.395+0000 7fa0afe00640 1 -- 172.21.15.100:0/2619377641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603d3b061e0 con 0x5603d3c17890 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.396+0000 7fa0afe00640 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0096f90 tx=0x7fa0a00c7020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a436c82d80525ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa099600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00968e0 con 0x5603d3c17890 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa0a009fa30 con 0x5603d3c17890 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603d3b9c410 con 0x5603d3c17890 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0a0096a40 con 0x5603d3c17890 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa0ba180740 10 client.6993 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:51.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.397+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5603d3ac86a0 con 0x5603d3c17890 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603d3b9c410 con 0x5603d3c17890 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa0a001b040 con 0x5603d3c17890 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa0ba180740 10 client.6993 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa0ba180740 10 client.6993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa0ba180740 20 client.6993 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.398+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3bd1d70 0x5603d3c751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.399+0000 7fa0ba180740 4 client.6993 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.399+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7fa0a800f040 con 0x5603d3bd1d70 2024-02-21T07:55:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.399+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3bd1d70 0x5603d3c751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.416 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:51.416 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:55:51.416 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "6e6eaae2-0fb1-4f42-a7a1-9656715bf7aa", 2024-02-21T07:55:51.416 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:55:51.416 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.400+0000 7fa0b4a00640 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3bd1d70 0x5603d3c751f0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db9be3bcc09cfd63 server_cookie=b63166fd71fe45da in_seq=0 out_seq=0 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.400+0000 7fa099600640 10 client.6993 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.403+0000 7fa099600640 1 -- 172.21.15.100:0/2619377641 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fa0a800f040 con 0x5603d3bd1d70 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.403+0000 7fa099600640 10 client.6993 handle_command_reply: tid=0 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.404+0000 7fa0ba180740 1 client.6993 shutdown 2024-02-21T07:55:51.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.405+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 msgr2=0x5603d3bc5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.405+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0096f90 tx=0x7fa0a00c7020 comp rx=0 tx=0).stop 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.408+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 shutdown_connections 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5603d3bd1d70 0x5603d3c751f0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5603d3c09ae0 0x5603d3c74cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5603d3c17890 0x5603d3bc5a00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa0ba180740 1 --2- 172.21.15.100:0/2619377641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5603d3bdcae0 0x5603d3b9a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 >> 172.21.15.100:0/2619377641 conn(0x5603d3bdc1c0 msgr2=0x5603d3c28720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.409+0000 7fa099600640 0 client.6993 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.410+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 shutdown_connections 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.410+0000 7fa0ba180740 1 -- 172.21.15.100:0/2619377641 wait complete. 2024-02-21T07:55:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.410+0000 7fa0ba180740 20 client.6993 trim_cache size 0 max 16384 2024-02-21T07:55:51.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.421+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 msgr2=0x7fa0900a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.421+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 0x7fa0900a1630 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa09c036000 tx=0x7fa09c008030 comp rx=0 tx=0).stop 2024-02-21T07:55:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.421+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 msgr2=0x7fa0b0174750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.421+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 0x7fa0b0174750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000c3e0 tx=0x7fa0a000c8a0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 shutdown_connections 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa09009f170 0x7fa0900a1630 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b018fc30 0x7fa0b02245c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0b018f780 0x7fa0b0174750 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 --2- 172.21.15.100:0/3423341561 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa0b0186d90 0x7fa0b008c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.423+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 >> 172.21.15.100:0/3423341561 conn(0x7fa0b00fbec0 msgr2=0x7fa0b00fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.424+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 shutdown_connections 2024-02-21T07:55:51.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.425+0000 7fa0b7400640 1 -- 172.21.15.100:0/3423341561 wait complete. 2024-02-21T07:55:51.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:55:51.480 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:55:51.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.923+0000 7fe5bbe00640 1 Processor -- start 2024-02-21T07:55:51.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.923+0000 7fe5bbe00640 1 -- start start 2024-02-21T07:55:51.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.925+0000 7fe5bbe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0cac60 con 0x7fe5bc17d0b0 2024-02-21T07:55:51.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.925+0000 7fe5bbe00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc0f9ab0 con 0x7fe5bc0f9680 2024-02-21T07:55:51.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.925+0000 7fe5bbe00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5bc06e830 con 0x7fe5bc0cb800 2024-02-21T07:55:51.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.926+0000 7fe5ba000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fe5bc0cb800 0x7fe5bc0f8f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:53672/0 (socket says 172.21.15.100:53672) 2024-02-21T07:55:51.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.926+0000 7fe5ba000640 1 -- 172.21.15.100:0/2862821676 learned_addr learned my addr 172.21.15.100:0/2862821676 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:51.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.926+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279384125 0 0) 0x7fe5bc06e830 con 0x7fe5bc0cb800 2024-02-21T07:55:51.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.926+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a0003520 con 0x7fe5bc0cb800 2024-02-21T07:55:51.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095305039 0 0) 0x7fe5a0003520 con 0x7fe5bc0cb800 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 >> v1:172.21.15.156:6789/0 conn(0x7fe5bc0f9680 legacy=0x7fe5bc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 >> v1:172.21.15.100:6789/0 conn(0x7fe5bc17d0b0 legacy=0x7fe5bc0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc06eb10 con 0x7fe5bc0cb800 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fe5a80016b0 con 0x7fe5bc0cb800 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.927+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 >> v1:172.21.15.170:6789/0 conn(0x7fe5bc0cb800 legacy=0x7fe5bc0f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.928+0000 7fe5b9600640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.928+0000 7fe5b9600640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5a00047c0 0x7fe5a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5baa00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5b9600640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a00052a0 0x7fe5a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000c1c0 con 0x7fe5a00047c0 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000c330 con 0x7fe5a00052a0 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000c4f0 con 0x7fe5a00039c0 2024-02-21T07:55:51.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5ba000640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5a00047c0 0x7fe5a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5bb400640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a00052a0 0x7fe5a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5baa00640 1 -- 172.21.15.100:0/2862821676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a00052a0 msgr2=0x7fe5a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.929+0000 7fe5baa00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a00052a0 0x7fe5a000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.930+0000 7fe5baa00640 1 -- 172.21.15.100:0/2862821676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5a00047c0 msgr2=0x7fe5a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.930+0000 7fe5baa00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5a00047c0 0x7fe5a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.930+0000 7fe5baa00640 1 -- 172.21.15.100:0/2862821676 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc06eb10 con 0x7fe5a00039c0 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.930+0000 7fe5ba000640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5a00047c0 0x7fe5a0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.931+0000 7fe5bb400640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5a00052a0 0x7fe5a000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.931+0000 7fe5bb400640 1 -- 172.21.15.100:0/2862821676 reap_dead start 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.932+0000 7fe5baa00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5a0003dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac001720 tx=0x7fe5a00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be076f08bc02353 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.932+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0052d0 con 0x7fe5a00039c0 2024-02-21T07:55:51.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.933+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac02e050 con 0x7fe5a00039c0 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.933+0000 7fe5b9600640 1 -- 172.21.15.100:0/2862821676 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0035f0 con 0x7fe5a00039c0 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 -- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 msgr2=0x7fe5a0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5a0003dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac001720 tx=0x7fe5a00057f0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 -- 172.21.15.100:0/2862821676 shutdown_connections 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/2862821676 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5a0003dc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 -- 172.21.15.100:0/2862821676 >> 172.21.15.100:0/2862821676 conn(0x7fe5bc0ce150 msgr2=0x7fe5bc0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 -- 172.21.15.100:0/2862821676 shutdown_connections 2024-02-21T07:55:51.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.934+0000 7fe5bbe00640 1 -- 172.21.15.100:0/2862821676 wait complete. 2024-02-21T07:55:51.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.938+0000 7fe5bbe00640 1 Processor -- start 2024-02-21T07:55:51.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.938+0000 7fe5bbe00640 1 -- start start 2024-02-21T07:55:51.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5bc21aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 0x7fe5bc0f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0ccfc0 con 0x7fe5bc21af50 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0cd2a0 con 0x7fe5bc161cf0 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.939+0000 7fe5bbe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0cd580 con 0x7fe5a00039c0 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38840/0 (socket says 172.21.15.100:38840) 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 -- 172.21.15.100:0/1318746215 learned_addr learned my addr 172.21.15.100:0/1318746215 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5baa00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5bc21aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5bb400640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 0x7fe5bc0f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 -- 172.21.15.100:0/1318746215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 msgr2=0x7fe5bc21aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5bc21aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 -- 172.21.15.100:0/1318746215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 msgr2=0x7fe5bc0f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 0x7fe5bc0f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5ba000640 1 -- 172.21.15.100:0/1318746215 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0cd860 con 0x7fe5bc161cf0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.940+0000 7fe5bb400640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 0x7fe5bc0f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5ba000640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8000c00 tx=0x7fe5a8007860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5b3400640 1 -- 172.21.15.100:0/1318746215 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800faf0 con 0x7fe5bc161cf0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5b3400640 1 -- 172.21.15.100:0/1318746215 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800fc50 con 0x7fe5bc161cf0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5b3400640 1 -- 172.21.15.100:0/1318746215 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80133f0 con 0x7fe5bc161cf0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc0cdb40 con 0x7fe5bc161cf0 2024-02-21T07:55:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.941+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0f52f0 con 0x7fe5bc161cf0 2024-02-21T07:55:51.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.946+0000 7fe5b3400640 1 -- 172.21.15.100:0/1318746215 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe5a8013550 con 0x7fe5bc161cf0 2024-02-21T07:55:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.947+0000 7fe5c4bf3740 1 Processor -- start 2024-02-21T07:55:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.948+0000 7fe5c4bf3740 1 -- start start 2024-02-21T07:55:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.948+0000 7fe5b3400640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 0x7fe59c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.948+0000 7fe5b3400640 1 -- 172.21.15.100:0/1318746215 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe5a80c9f50 con 0x7fe5bc161cf0 2024-02-21T07:55:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.949+0000 7fe5bb400640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 0x7fe59c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.949+0000 7fe5bb400640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 0x7fe59c0a16b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0d25b0 tx=0x7fe5b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c595539c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504ab0 0x55c5954c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c59543b150 con 0x55c595504190 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c595438680 con 0x55c59553a150 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c595433e60 con 0x55c595504ab0 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38842/0 (socket says 172.21.15.100:38842) 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 -- 172.21.15.100:0/3416442691 learned_addr learned my addr 172.21.15.100:0/3416442691 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5bb400640 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504ab0 0x55c5954c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 -- 172.21.15.100:0/3416442691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504ab0 msgr2=0x55c5954c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504ab0 0x55c5954c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 -- 172.21.15.100:0/3416442691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 msgr2=0x55c595539c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c595539c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.950+0000 7fe5ba000640 1 -- 172.21.15.100:0/3416442691 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5953ed060 con 0x55c59553a150 2024-02-21T07:55:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.951+0000 7fe5ba000640 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80c7830 tx=0x7fe5a8098130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabe7f59963efcd3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.952+0000 7fe5a7400640 1 -- 172.21.15.100:0/3416442691 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a809bb80 con 0x55c59553a150 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.952+0000 7fe5a7400640 1 -- 172.21.15.100:0/3416442691 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80a01d0 con 0x55c59553a150 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.952+0000 7fe5a7400640 1 -- 172.21.15.100:0/3416442691 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80940a0 con 0x55c59553a150 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.952+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3416442691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 msgr2=0x55c595504570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.952+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80c7830 tx=0x7fe5a8098130 comp rx=0 tx=0).stop 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3416442691 shutdown_connections 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504ab0 0x55c5954c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595504570 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3416442691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c595539c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3416442691 >> 172.21.15.100:0/3416442691 conn(0x55c5954935a0 msgr2=0x55c5954cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3416442691 shutdown_connections 2024-02-21T07:55:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.953+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3416442691 wait complete. 2024-02-21T07:55:51.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.954+0000 7fe5c4bf3740 1 -- start start 2024-02-21T07:55:51.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.954+0000 7fe5c4bf3740 1 Processor -- start 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c595501cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 0x55c5954f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595502350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5953d8ec0 con 0x55c595504ab0 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5953d8b60 con 0x55c59553a150 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5951a21c0 con 0x55c595504190 2024-02-21T07:55:51.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.955+0000 7fe5c4bf3740 10 client.0 _ll_register_callbacks cb 0x55c5953ec960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:51.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595502350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595502350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38852/0 (socket says 172.21.15.100:38852) 2024-02-21T07:55:51.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5bb400640 1 -- 172.21.15.100:0/486743232 learned_addr learned my addr 172.21.15.100:0/486743232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:51.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 0x55c5954f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 -- 172.21.15.100:0/486743232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 msgr2=0x55c595501cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c595501cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 -- 172.21.15.100:0/486743232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 msgr2=0x55c595502350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:51.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595502350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.956+0000 7fe5ba000640 1 -- 172.21.15.100:0/486743232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc0f52f0 con 0x55c595504ab0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.957+0000 7fe5ba000640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 0x55c5954f23c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8093e90 tx=0x7fe5a8015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be5822781f2342f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.957+0000 7fe59be00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.957+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8097080 con 0x55c595504ab0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe5a8093780 con 0x55c595504ab0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5951337e0 con 0x55c595504ab0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5a80971e0 con 0x55c595504ab0 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe5c4bf3740 10 client.7002 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5954324e0 con 0x55c595504ab0 2024-02-21T07:55:51.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.958+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5951337e0 con 0x55c595504ab0 2024-02-21T07:55:51.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.959+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe5a8012070 con 0x55c595504ab0 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 10 client.7002 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 10 client.7002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 20 client.7002 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5954c62a0 0x55c59552fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 4 client.7002 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c595170720 con 0x55c5954c62a0 2024-02-21T07:55:51.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.960+0000 7fe5baa00640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5954c62a0 0x55c59552fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:51.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.961+0000 7fe5baa00640 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5954c62a0 0x55c59552fac0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be9cd322d962c1d4 server_cookie=1cd2502f73d3db72 in_seq=0 out_seq=0 2024-02-21T07:55:51.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.961+0000 7fe59be00640 10 client.7002 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.961+0000 7fe59be00640 1 -- 172.21.15.100:0/486743232 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c595170720 con 0x55c5954c62a0 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.961+0000 7fe59be00640 10 client.7002 handle_command_reply: tid=0 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 client.7002 shutdown 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 msgr2=0x55c5954f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 0x55c5954f23c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8093e90 tx=0x7fe5a8015040 comp rx=0 tx=0).stop 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 shutdown_connections 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5954c62a0 0x55c59552fac0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c595502350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504ab0 0x55c5954f23c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/486743232 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c595501cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 >> 172.21.15.100:0/486743232 conn(0x55c5954935a0 msgr2=0x55c5954c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:51.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe59be00640 0 client.7002 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:51.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 shutdown_connections 2024-02-21T07:55:51.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/486743232 wait complete. 2024-02-21T07:55:51.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:51.962+0000 7fe5c4bf3740 20 client.7002 trim_cache size 0 max 16384 2024-02-21T07:55:52.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.019+0000 7fe5c4bf3740 1 Processor -- start 2024-02-21T07:55:52.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.019+0000 7fe5c4bf3740 1 -- start start 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c59552cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5954f2810 con 0x55c595504190 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5954c25c0 con 0x55c59553a150 2024-02-21T07:55:52.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.021+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c595539980 con 0x55c595548890 2024-02-21T07:55:52.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.024+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.024+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32904/0 (socket says 172.21.15.100:32904) 2024-02-21T07:55:52.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.024+0000 7fe5bb400640 1 -- 172.21.15.100:0/280034378 learned_addr learned my addr 172.21.15.100:0/280034378 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.025+0000 7fe5baa00640 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c59552cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.028+0000 7fe5baa00640 1 -- 172.21.15.100:0/280034378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 msgr2=0x55c5954c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.028+0000 7fe5baa00640 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.028+0000 7fe5baa00640 1 -- 172.21.15.100:0/280034378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 msgr2=0x55c5954c8da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.028+0000 7fe5baa00640 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c8da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.028+0000 7fe5baa00640 1 -- 172.21.15.100:0/280034378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5953ce950 con 0x55c595504190 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.029+0000 7fe5baa00640 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c59552cfb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac004000 tx=0x7fe5ac02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56faafccec6e1813 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.029+0000 7fe5a6a00640 1 -- 172.21.15.100:0/280034378 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac0050d0 con 0x55c595504190 2024-02-21T07:55:52.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.029+0000 7fe5a6a00640 1 -- 172.21.15.100:0/280034378 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac044b00 con 0x55c595504190 2024-02-21T07:55:52.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.029+0000 7fe5a6a00640 1 -- 172.21.15.100:0/280034378 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac044e90 con 0x55c595504190 2024-02-21T07:55:52.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.031+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/280034378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 msgr2=0x55c59552cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.031+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c59552cfb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac004000 tx=0x7fe5ac02d000 comp rx=0 tx=0).stop 2024-02-21T07:55:52.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.033+0000 7fe5bb400640 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T07:55:52.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.039+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/280034378 shutdown_connections 2024-02-21T07:55:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.039+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595548890 0x55c5954c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.039+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.039+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/280034378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595504190 0x55c59552cfb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.039+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/280034378 >> 172.21.15.100:0/280034378 conn(0x55c5954935a0 msgr2=0x55c595503810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.046+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/280034378 shutdown_connections 2024-02-21T07:55:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.048+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/280034378 wait complete. 2024-02-21T07:55:52.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.050+0000 7fe5c4bf3740 1 -- start start 2024-02-21T07:55:52.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.051+0000 7fe5c4bf3740 1 Processor -- start 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c5954ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5954c6110 con 0x55c595548890 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5954c5c10 con 0x55c59553a150 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5955b4470 con 0x55c595504190 2024-02-21T07:55:52.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.056+0000 7fe5c4bf3740 10 client.0 _ll_register_callbacks cb 0x7fe5a8097600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.068+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.068+0000 7fe5bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44324/0 (socket says 172.21.15.100:44324) 2024-02-21T07:55:52.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.068+0000 7fe5bb400640 1 -- 172.21.15.100:0/3417734275 learned_addr learned my addr 172.21.15.100:0/3417734275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5ba000640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5bb400640 1 -- 172.21.15.100:0/3417734275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 msgr2=0x55c5954ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5bb400640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c5954ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5bb400640 1 -- 172.21.15.100:0/3417734275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 msgr2=0x55c5954c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5bb400640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.069+0000 7fe5bb400640 1 -- 172.21.15.100:0/3417734275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc06eb10 con 0x55c595548890 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.070+0000 7fe5bb400640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400fd10 tx=0x7fe5b4001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c05a740de5311f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.071+0000 7fe59be00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:52.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.071+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4021410 con 0x55c595548890 2024-02-21T07:55:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.071+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe5b4021570 con 0x55c595548890 2024-02-21T07:55:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.072+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5a80a01d0 con 0x55c595548890 2024-02-21T07:55:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.072+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b4003970 con 0x55c595548890 2024-02-21T07:55:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.073+0000 7fe5c4bf3740 10 client.7008 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:52.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.073+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5953f4430 con 0x55c595548890 2024-02-21T07:55:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.073+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a80a01d0 con 0x55c595548890 2024-02-21T07:55:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.073+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe5b4012070 con 0x55c595548890 2024-02-21T07:55:52.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.073+0000 7fe5c4bf3740 10 client.7008 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:52.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5c4bf3740 10 client.7008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:52.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5c4bf3740 20 client.7008 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:52.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c59552f6c0 0x55c5955b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5c4bf3740 4 client.7008 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:55:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c5951bf890 con 0x55c59552f6c0 2024-02-21T07:55:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.074+0000 7fe5baa00640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c59552f6c0 0x55c5955b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.075+0000 7fe5baa00640 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c59552f6c0 0x55c5955b3800 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b74fee28e3fc9c13 server_cookie=643d506b59e1aefe in_seq=0 out_seq=0 2024-02-21T07:55:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.075+0000 7fe59be00640 10 client.7008 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.075+0000 7fe59be00640 1 -- 172.21.15.100:0/3417734275 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c5951bf890 con 0x55c59552f6c0 2024-02-21T07:55:52.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.075+0000 7fe59be00640 10 client.7008 handle_command_reply: tid=0 2024-02-21T07:55:52.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.076+0000 7fe5c4bf3740 1 client.7008 shutdown 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 msgr2=0x55c5955017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400fd10 tx=0x7fe5b4001330 comp rx=0 tx=0).stop 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 shutdown_connections 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c59552f6c0 0x55c5955b3800 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c595548890 0x55c5955017e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c59553a150 0x55c5954c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 --2- 172.21.15.100:0/3417734275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c595504190 0x55c5954ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.082+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 >> 172.21.15.100:0/3417734275 conn(0x55c5954935a0 msgr2=0x55c5954c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.084+0000 7fe59be00640 0 client.7008 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.085+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 shutdown_connections 2024-02-21T07:55:52.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.085+0000 7fe5c4bf3740 1 -- 172.21.15.100:0/3417734275 wait complete. 2024-02-21T07:55:52.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.088+0000 7fe5c4bf3740 20 client.7008 trim_cache size 0 max 16384 2024-02-21T07:55:52.092 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:55:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:55:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:55:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "6e6eaae2-0fb1-4f42-a7a1-9656715bf7aa": { 2024-02-21T07:55:52.092 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "6e6eaae2-0fb1-4f42-a7a1-9656715bf7aa", 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.091+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 msgr2=0x7fe59c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.091+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 0x7fe59c0a16b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0d25b0 tx=0x7fe5b4009040 comp rx=0 tx=0).stop 2024-02-21T07:55:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.091+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 msgr2=0x7fe5bc0f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.091+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8000c00 tx=0x7fe5a8007860 comp rx=0 tx=0).stop 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.092+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 shutdown_connections 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.092+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe59c09f1f0 0x7fe59c0a16b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.092+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5bc21af50 0x7fe5bc0f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.092+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe5bc161cf0 0x7fe5bc0f4870 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.092+0000 7fe5bbe00640 1 --2- 172.21.15.100:0/1318746215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5a00039c0 0x7fe5bc21aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.093+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 >> 172.21.15.100:0/1318746215 conn(0x7fe5bc0ce150 msgr2=0x7fe5bc06f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.093+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 shutdown_connections 2024-02-21T07:55:52.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:55:52.093+0000 7fe5bbe00640 1 -- 172.21.15.100:0/1318746215 wait complete. 2024-02-21T07:55:52.125 INFO:tasks.cephfs.filesystem:scrub status for tag:6e6eaae2-0fb1-4f42-a7a1-9656715bf7aa - {'path': '/', 'tag': '6e6eaae2-0fb1-4f42-a7a1-9656715bf7aa', 'options': 'recursive,force'} 2024-02-21T07:55:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.643+0000 7fc340c00640 1 Processor -- start 2024-02-21T07:55:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.643+0000 7fc340c00640 1 -- start start 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc340c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc33c185c90 0x7fc33c189030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc340c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc33c189570 0x7fc33c0f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc340c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0f6b70 con 0x7fc33c186070 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc340c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c0f5b00 con 0x7fc33c189570 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc340c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c18ce30 con 0x7fc33c185c90 2024-02-21T07:55:52.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc339e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc33c185c90 0x7fc33c189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc339400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fc33c186070 0x7fc33c0f5f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55252/0 (socket says 172.21.15.100:55252) 2024-02-21T07:55:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc339400640 1 -- 172.21.15.100:0/3379208237 learned_addr learned my addr 172.21.15.100:0/3379208237 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:55:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.646+0000 7fc33a800640 1 --2- 172.21.15.100:0/3379208237 >> v2:172.21.15.100:3300/0 conn(0x7fc33c189570 0x7fc33c0f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.647+0000 7fc338a00640 1 -- 172.21.15.100:0/3379208237 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096991077 0 0) 0x7fc33c0f6b70 con 0x7fc33c186070 2024-02-21T07:55:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.647+0000 7fc339e00640 1 -- 172.21.15.100:0/3379208237 >> v2:172.21.15.100:3300/0 conn(0x7fc33c189570 msgr2=0x7fc33c0f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.647+0000 7fc339e00640 1 --2- 172.21.15.100:0/3379208237 >> v2:172.21.15.100:3300/0 conn(0x7fc33c189570 0x7fc33c0f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.647+0000 7fc339e00640 1 -- 172.21.15.100:0/3379208237 >> v1:172.21.15.156:6789/0 conn(0x7fc33c186070 legacy=0x7fc33c0f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.647+0000 7fc339e00640 1 -- 172.21.15.100:0/3379208237 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c187b90 con 0x7fc33c185c90 2024-02-21T07:55:52.650 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.649+0000 7fc339e00640 1 --2- 172.21.15.100:0/3379208237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c189030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0d0400 tx=0x7fc32c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f6d311ef5b57f09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.649+0000 7fc338a00640 1 -- 172.21.15.100:0/3379208237 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c02e070 con 0x7fc33c185c90 2024-02-21T07:55:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.649+0000 7fc338a00640 1 -- 172.21.15.100:0/3379208237 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0315a0 con 0x7fc33c185c90 2024-02-21T07:55:52.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.649+0000 7fc338a00640 1 -- 172.21.15.100:0/3379208237 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c031930 con 0x7fc33c185c90 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 -- 172.21.15.100:0/3379208237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 msgr2=0x7fc33c189030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 --2- 172.21.15.100:0/3379208237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c189030 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0d0400 tx=0x7fc32c02b840 comp rx=0 tx=0).stop 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 -- 172.21.15.100:0/3379208237 shutdown_connections 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 --2- 172.21.15.100:0/3379208237 >> v2:172.21.15.100:3300/0 conn(0x7fc33c189570 0x7fc33c0f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 --2- 172.21.15.100:0/3379208237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c189030 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 -- 172.21.15.100:0/3379208237 >> 172.21.15.100:0/3379208237 conn(0x7fc33c0cf3d0 msgr2=0x7fc33c0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 -- 172.21.15.100:0/3379208237 shutdown_connections 2024-02-21T07:55:52.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.650+0000 7fc340c00640 1 -- 172.21.15.100:0/3379208237 wait complete. 2024-02-21T07:55:52.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.653+0000 7fc340c00640 1 Processor -- start 2024-02-21T07:55:52.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.653+0000 7fc340c00640 1 -- start start 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c170500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc33c189570 0x7fc33c173870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c1716d0 con 0x7fc33c189570 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c21f1f0 con 0x7fc33c185c90 2024-02-21T07:55:52.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.655+0000 7fc340c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c21e390 con 0x7fc33c186070 2024-02-21T07:55:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.656+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.656+0000 7fc33a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc33c189570 0x7fc33c173870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.656+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32912/0 (socket says 172.21.15.100:32912) 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.656+0000 7fc339400640 1 -- 172.21.15.100:0/844515011 learned_addr learned my addr 172.21.15.100:0/844515011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.656+0000 7fc339e00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c170500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.657+0000 7fc339400640 1 -- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 msgr2=0x7fc33c170500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.657+0000 7fc339400640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c170500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.657+0000 7fc339400640 1 -- 172.21.15.100:0/844515011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc33c189570 msgr2=0x7fc33c173870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.657+0000 7fc339400640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc33c189570 0x7fc33c173870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.657+0000 7fc339400640 1 -- 172.21.15.100:0/844515011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c009400 con 0x7fc33c186070 2024-02-21T07:55:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.658+0000 7fc339400640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c4a0 tx=0x7fc32800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.658+0000 7fc332000640 1 -- 172.21.15.100:0/844515011 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280074e0 con 0x7fc33c186070 2024-02-21T07:55:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.658+0000 7fc332000640 1 -- 172.21.15.100:0/844515011 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328007640 con 0x7fc33c186070 2024-02-21T07:55:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.658+0000 7fc332000640 1 -- 172.21.15.100:0/844515011 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328004a00 con 0x7fc33c186070 2024-02-21T07:55:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.658+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c21e670 con 0x7fc33c186070 2024-02-21T07:55:52.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.659+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c21ec30 con 0x7fc33c186070 2024-02-21T07:55:52.679 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.677+0000 7fc332000640 1 -- 172.21.15.100:0/844515011 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc328004b60 con 0x7fc33c186070 2024-02-21T07:55:52.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.679+0000 7fc332000640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 0x7fc31c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.679+0000 7fc332000640 1 -- 172.21.15.100:0/844515011 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3280c9160 con 0x7fc33c186070 2024-02-21T07:55:52.682 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.680+0000 7fc339e00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 0x7fc31c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.697+0000 7fc3437e0740 1 Processor -- start 2024-02-21T07:55:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.697+0000 7fc339e00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 0x7fc31c0a16b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc32c036000 tx=0x7fc32c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.697+0000 7fc3437e0740 1 -- start start 2024-02-21T07:55:52.704 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.702+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.703+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.703+0000 7fc339e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.705 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.703+0000 7fc339e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38920/0 (socket says 172.21.15.100:38920) 2024-02-21T07:55:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.703+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fc1a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.704+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.704+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32922/0 (socket says 172.21.15.100:32922) 2024-02-21T07:55:52.706 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.704+0000 7fc339e00640 1 -- 172.21.15.100:0/4276816734 learned_addr learned my addr 172.21.15.100:0/4276816734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.705+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fb9a620 con 0x56397fbdef90 2024-02-21T07:55:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.705+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fb4c8c0 con 0x56397fc1a070 2024-02-21T07:55:52.707 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.705+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fb49df0 con 0x56397fc4e4d0 2024-02-21T07:55:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.706+0000 7fc339400640 1 -- 172.21.15.100:0/4276816734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 msgr2=0x56397fbd9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.706+0000 7fc339400640 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.706+0000 7fc339400640 1 -- 172.21.15.100:0/4276816734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 msgr2=0x56397fc1a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.706+0000 7fc339400640 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fc1a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.708 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.706+0000 7fc339400640 1 -- 172.21.15.100:0/4276816734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56397fac6b00 con 0x56397fc4e4d0 2024-02-21T07:55:52.709 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.707+0000 7fc339e00640 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:55:52.711 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.708+0000 7fc339400640 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c6ad0 tx=0x7fc328097340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e597c3d90a8a3e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.710+0000 7fc326600640 1 -- 172.21.15.100:0/4276816734 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32809f3e0 con 0x56397fc4e4d0 2024-02-21T07:55:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.710+0000 7fc326600640 1 -- 172.21.15.100:0/4276816734 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3280c6c10 con 0x56397fc4e4d0 2024-02-21T07:55:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.710+0000 7fc326600640 1 -- 172.21.15.100:0/4276816734 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328096090 con 0x56397fc4e4d0 2024-02-21T07:55:52.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.711+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 msgr2=0x56397fbdea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.714 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.711+0000 7fc3437e0740 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc3280c6ad0 tx=0x7fc328097340 comp rx=0 tx=0).stop 2024-02-21T07:55:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.715+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 shutdown_connections 2024-02-21T07:55:52.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.715+0000 7fc3437e0740 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fc1a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.715+0000 7fc3437e0740 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbdea50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.716+0000 7fc3437e0740 1 --2- 172.21.15.100:0/4276816734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbd9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.716+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 >> 172.21.15.100:0/4276816734 conn(0x56397fba64b0 msgr2=0x56397fbddca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.718 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.716+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 shutdown_connections 2024-02-21T07:55:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.716+0000 7fc3437e0740 1 -- 172.21.15.100:0/4276816734 wait complete. 2024-02-21T07:55:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.718+0000 7fc3437e0740 1 -- start start 2024-02-21T07:55:52.720 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.718+0000 7fc3437e0740 1 Processor -- start 2024-02-21T07:55:52.722 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.721+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.721+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 0x56397fc50560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.721+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.721+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 0x56397fc50560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.721+0000 7fc339e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc339e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44356/0 (socket says 172.21.15.100:44356) 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc33a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc33a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38934/0 (socket says 172.21.15.100:38934) 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc339400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 0x56397fc50560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:32936/0 (socket says 172.21.15.100:32936) 2024-02-21T07:55:52.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc339e00640 1 -- 172.21.15.100:0/468875440 learned_addr learned my addr 172.21.15.100:0/468875440 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fb455d0 con 0x56397fbdef90 2024-02-21T07:55:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.722+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397faeab50 con 0x56397fc4e4d0 2024-02-21T07:55:52.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397faea7f0 con 0x56397fc1a070 2024-02-21T07:55:52.726 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc3437e0740 10 client.0 _ll_register_callbacks cb 0x56397fafe550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc339e00640 1 -- 172.21.15.100:0/468875440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 msgr2=0x56397fc50560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc339e00640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 0x56397fc50560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc339e00640 1 -- 172.21.15.100:0/468875440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 msgr2=0x56397fc43510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc339e00640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.723+0000 7fc339e00640 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c21ec30 con 0x56397fbdef90 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.724+0000 7fc33a800640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.724+0000 7fc339e00640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009860 tx=0x7fc32c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c9a1e5c2278f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.724+0000 7fc31aa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:55:52.727 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.726+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c045990 con 0x56397fbdef90 2024-02-21T07:55:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.726+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc32c040070 con 0x56397fbdef90 2024-02-21T07:55:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.726+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56397fb17cd0 con 0x56397fbdef90 2024-02-21T07:55:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.727+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc32c045af0 con 0x56397fbdef90 2024-02-21T07:55:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.727+0000 7fc3437e0740 10 client.7017 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:52.728 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.727+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56397fb43c50 con 0x56397fbdef90 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.727+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56397fb17cd0 con 0x56397fbdef90 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.728+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc32c04f070 con 0x56397fbdef90 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.728+0000 7fc3437e0740 10 client.7017 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.728+0000 7fc3437e0740 10 client.7017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.728+0000 7fc3437e0740 20 client.7017 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.728+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fc12f50 0x56397fc13360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.729+0000 7fc3437e0740 4 client.7017 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:55:52.731 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.729+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56397fb3bce0 con 0x56397fc12f50 2024-02-21T07:55:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.731+0000 7fc339400640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fc12f50 0x56397fc13360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.733+0000 7fc339400640 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fc12f50 0x56397fc13360 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358ac8147e810da5 server_cookie=84071225485680aa in_seq=0 out_seq=0 2024-02-21T07:55:52.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.733+0000 7fc31aa00640 10 client.7017 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.735+0000 7fc31aa00640 1 -- 172.21.15.100:0/468875440 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56397fb3bce0 con 0x56397fc12f50 2024-02-21T07:55:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.735+0000 7fc31aa00640 10 client.7017 handle_command_reply: tid=0 2024-02-21T07:55:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.736+0000 7fc3437e0740 1 client.7017 shutdown 2024-02-21T07:55:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.737+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 msgr2=0x56397fbd8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.737+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009860 tx=0x7fc32c004730 comp rx=0 tx=0).stop 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 shutdown_connections 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fc12f50 0x56397fc13360 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc4e4d0 0x56397fc43510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc1a070 0x56397fc50560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 --2- 172.21.15.100:0/468875440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbd8c00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 >> 172.21.15.100:0/468875440 conn(0x56397fba64b0 msgr2=0x56397fc4e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc31aa00640 0 client.7017 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.738+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 shutdown_connections 2024-02-21T07:55:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.739+0000 7fc3437e0740 1 -- 172.21.15.100:0/468875440 wait complete. 2024-02-21T07:55:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.739+0000 7fc3437e0740 20 client.7017 trim_cache size 0 max 16384 2024-02-21T07:55:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.781+0000 7fc3437e0740 1 Processor -- start 2024-02-21T07:55:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.782+0000 7fc3437e0740 1 -- start start 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbdcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbe33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397f88de60 con 0x56397fbdef90 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fc43cc0 con 0x56397fc1a070 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.783+0000 7fc3437e0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fc47eb0 con 0x56397fc4e4d0 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.784+0000 7fc339e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.784+0000 7fc339400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbdcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.784+0000 7fc339e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44368/0 (socket says 172.21.15.100:44368) 2024-02-21T07:55:52.786 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.784+0000 7fc339e00640 1 -- 172.21.15.100:0/857548915 learned_addr learned my addr 172.21.15.100:0/857548915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.785+0000 7fc339e00640 1 -- 172.21.15.100:0/857548915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 msgr2=0x56397fbe33b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:55:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.785+0000 7fc339e00640 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbe33b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.785+0000 7fc339e00640 1 -- 172.21.15.100:0/857548915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 msgr2=0x56397fbdcc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.785+0000 7fc339e00640 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbdcc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.787 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.785+0000 7fc339e00640 1 -- 172.21.15.100:0/857548915 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56397fae0530 con 0x56397fbdef90 2024-02-21T07:55:52.788 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.786+0000 7fc339e00640 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0318a0 tx=0x7fc32c048070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8983d83b37c50aa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.817 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.813+0000 7fc325c00640 1 -- 172.21.15.100:0/857548915 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c045790 con 0x56397fbdef90 2024-02-21T07:55:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.813+0000 7fc325c00640 1 -- 172.21.15.100:0/857548915 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c04c040 con 0x56397fbdef90 2024-02-21T07:55:52.818 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.813+0000 7fc325c00640 1 -- 172.21.15.100:0/857548915 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c045b30 con 0x56397fbdef90 2024-02-21T07:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.816+0000 7fc3437e0740 1 -- 172.21.15.100:0/857548915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 msgr2=0x56397fbdb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.816+0000 7fc3437e0740 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0318a0 tx=0x7fc32c048070 comp rx=0 tx=0).stop 2024-02-21T07:55:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.839+0000 7fc3437e0740 1 -- 172.21.15.100:0/857548915 shutdown_connections 2024-02-21T07:55:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.839+0000 7fc3437e0740 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fc4e4d0 0x56397fbe33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.839+0000 7fc3437e0740 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fbdcc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.839+0000 7fc3437e0740 1 --2- 172.21.15.100:0/857548915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fbdef90 0x56397fbdb890 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.841 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.839+0000 7fc3437e0740 1 -- 172.21.15.100:0/857548915 >> 172.21.15.100:0/857548915 conn(0x56397fba64b0 msgr2=0x56397fbe46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.840+0000 7fc3437e0740 1 -- 172.21.15.100:0/857548915 shutdown_connections 2024-02-21T07:55:52.842 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.840+0000 7fc3437e0740 1 -- 172.21.15.100:0/857548915 wait complete. 2024-02-21T07:55:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.842+0000 7fc3437e0740 1 -- start start 2024-02-21T07:55:52.848 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.846+0000 7fc3437e0740 1 Processor -- start 2024-02-21T07:55:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.848+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 0x56397fbddf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.849+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fcb9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.852 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.849+0000 7fc3437e0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.849+0000 7fc3437e0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fc43b60 con 0x56397fc4e4d0 2024-02-21T07:55:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.851+0000 7fc33a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.851+0000 7fc33a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44380/0 (socket says 172.21.15.100:44380) 2024-02-21T07:55:52.853 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.851+0000 7fc33a800640 1 -- 172.21.15.100:0/845479294 learned_addr learned my addr 172.21.15.100:0/845479294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:55:52.855 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.852+0000 7fc339e00640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 0x56397fbddf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.852+0000 7fc339400640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fcb9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.854+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fcb9df0 con 0x56397fc1a070 2024-02-21T07:55:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.854+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56397fcbd700 con 0x56397fbdef90 2024-02-21T07:55:52.856 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.854+0000 7fc3437e0740 10 client.0 _ll_register_callbacks cb 0x7fc328092ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:55:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.857+0000 7fc339e00640 1 -- 172.21.15.100:0/845479294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 msgr2=0x56397fcb9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.857+0000 7fc339e00640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fcb9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.859 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.857+0000 7fc339e00640 1 -- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 msgr2=0x56397fc0f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:55:52.862 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.860+0000 7fc339e00640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.863 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.860+0000 7fc339e00640 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56397fb43c50 con 0x56397fbdef90 2024-02-21T07:55:52.864 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.861+0000 7fc33a800640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:55:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.865+0000 7fc339e00640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 0x56397fbddf80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc32c047000 tx=0x7fc32c031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab95e55d4de1395 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:55:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.865+0000 7fc31aa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:55:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.866+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c005b90 con 0x56397fbdef90 2024-02-21T07:55:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.866+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56397fb6ad30 con 0x56397fbdef90 2024-02-21T07:55:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.866+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc32c040070 con 0x56397fbdef90 2024-02-21T07:55:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.867+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc32c005cf0 con 0x56397fbdef90 2024-02-21T07:55:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.868+0000 7fc3437e0740 10 client.7130 fetch_fsmap learned FSMap version 17 2024-02-21T07:55:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.868+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56397fb062c0 con 0x56397fbdef90 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56397fb6ad30 con 0x56397fbdef90 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc32c04f040 con 0x56397fbdef90 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 10 client.7130 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 10 client.7130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 20 client.7130 populate_metadata read hostname 'smithi100' 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fcac4c0 0x56397fca9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 4 client.7130 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:55:52.871 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.869+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56397f845600 con 0x56397fcac4c0 2024-02-21T07:55:52.872 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.870+0000 7fc339400640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fcac4c0 0x56397fca9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:55:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.872+0000 7fc339400640 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fcac4c0 0x56397fca9d90 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d444b074824a178 server_cookie=f8e7dc5198c73582 in_seq=0 out_seq=0 2024-02-21T07:55:52.875 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.874+0000 7fc31aa00640 10 client.7130 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.894+0000 7fc31aa00640 1 -- 172.21.15.100:0/845479294 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56397f845600 con 0x56397fcac4c0 2024-02-21T07:55:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.894+0000 7fc31aa00640 10 client.7130 handle_command_reply: tid=0 2024-02-21T07:55:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.894+0000 7fc3437e0740 1 client.7130 shutdown 2024-02-21T07:55:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.894+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 msgr2=0x56397fbddf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.894+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 0x56397fbddf80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc32c047000 tx=0x7fc32c031000 comp rx=0 tx=0).stop 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 shutdown_connections 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56397fcac4c0 0x56397fca9d90 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56397fc4e4d0 0x56397fc0f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56397fc1a070 0x56397fcb9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 --2- 172.21.15.100:0/845479294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56397fbdef90 0x56397fbddf80 secure :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc32c047000 tx=0x7fc32c031000 comp rx=0 tx=0).stop 2024-02-21T07:55:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 >> 172.21.15.100:0/845479294 conn(0x56397fba64b0 msgr2=0x56397fc6f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc31aa00640 0 client.7130 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 shutdown_connections 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.895+0000 7fc3437e0740 1 -- 172.21.15.100:0/845479294 wait complete. 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.896+0000 7fc3437e0740 20 client.7130 trim_cache size 0 max 16384 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:55:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:55:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:55:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 msgr2=0x7fc31c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 0x7fc31c0a16b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc32c036000 tx=0x7fc32c03d040 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 msgr2=0x7fc33c173330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c4a0 tx=0x7fc32800c960 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 shutdown_connections 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc31c09f1f0 0x7fc31c0a16b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc33c189570 0x7fc33c173870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc33c186070 0x7fc33c173330 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 --2- 172.21.15.100:0/844515011 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc33c185c90 0x7fc33c170500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 >> 172.21.15.100:0/844515011 conn(0x7fc33c0cf3d0 msgr2=0x7fc33c0cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 shutdown_connections 2024-02-21T07:55:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:55:52.897+0000 7fc340c00640 1 -- 172.21.15.100:0/844515011 wait complete. 2024-02-21T07:56:06.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.113+0000 7f86a1400640 1 Processor -- start 2024-02-21T07:56:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.114+0000 7f86a1400640 1 -- start start 2024-02-21T07:56:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.117+0000 7f86a1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f869c18a160 0x7f869c18a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.117+0000 7f86a1400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c189cd0 con 0x7f869c185ef0 2024-02-21T07:56:06.205 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.117+0000 7f86a1400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869c0ce8b0 con 0x7f869c18ab00 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.117+0000 7f86a1400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869c0ceb90 con 0x7f869c18a160 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.118+0000 7f8699e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f869c18a160 0x7f869c18a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.118+0000 7f8699e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f869c18a160 0x7f869c18a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49286/0 (socket says 172.21.15.100:49286) 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.118+0000 7f8699e00640 1 -- 172.21.15.100:0/1575661842 learned_addr learned my addr 172.21.15.100:0/1575661842 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.118+0000 7f8699e00640 1 -- 172.21.15.100:0/1575661842 >> v1:172.21.15.170:6789/0 conn(0x7f869c18ab00 legacy=0x7f869c0d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.118+0000 7f8699e00640 1 -- 172.21.15.100:0/1575661842 >> v1:172.21.15.100:6789/0 conn(0x7f869c185ef0 legacy=0x7f869c189170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.117+0000 7f869a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f869c185ef0 0x7f869c189170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58456/0 (socket says 172.21.15.100:58456) 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.119+0000 7f8699e00640 1 -- 172.21.15.100:0/1575661842 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c0cee70 con 0x7f869c18a160 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.120+0000 7f8699e00640 1 --2- 172.21.15.100:0/1575661842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c18a5c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f868c009870 tx=0x7f868c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44058df3013fad9d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.121+0000 7f8699400640 1 -- 172.21.15.100:0/1575661842 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0317e0 con 0x7f869c18a160 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.121+0000 7f8699400640 1 -- 172.21.15.100:0/1575661842 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c031940 con 0x7f869c18a160 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.121+0000 7f8699400640 1 -- 172.21.15.100:0/1575661842 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c031cd0 con 0x7f869c18a160 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.122+0000 7f86a1400640 1 -- 172.21.15.100:0/1575661842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 msgr2=0x7f869c18a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.122+0000 7f86a1400640 1 --2- 172.21.15.100:0/1575661842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c18a5c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f868c009870 tx=0x7f868c02b880 comp rx=0 tx=0).stop 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.123+0000 7f86a1400640 1 -- 172.21.15.100:0/1575661842 shutdown_connections 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.123+0000 7f86a1400640 1 --2- 172.21.15.100:0/1575661842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c18a5c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.123+0000 7f86a1400640 1 -- 172.21.15.100:0/1575661842 >> 172.21.15.100:0/1575661842 conn(0x7f869c08cfd0 msgr2=0x7f869c08d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.123+0000 7f86a1400640 1 -- 172.21.15.100:0/1575661842 shutdown_connections 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.123+0000 7f86a1400640 1 -- 172.21.15.100:0/1575661842 wait complete. 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.126+0000 7f86a1400640 1 Processor -- start 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.127+0000 7f86a1400640 1 -- start start 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c173f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f869c18ab00 0x7f869c180490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0fdd80 con 0x7f869c18a160 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0fce90 con 0x7f869c185ef0 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.128+0000 7f86a1400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869c0fd170 con 0x7f869c18ab00 2024-02-21T07:56:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f8699e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c173f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f8699e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c173f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49296/0 (socket says 172.21.15.100:49296) 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f8699e00640 1 -- 172.21.15.100:0/1133900512 learned_addr learned my addr 172.21.15.100:0/1133900512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41588/0 (socket says 172.21.15.100:41588) 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869b200640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f869c18ab00 0x7f869c180490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 -- 172.21.15.100:0/1133900512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f869c18ab00 msgr2=0x7f869c180490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f869c18ab00 0x7f869c180490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 -- 172.21.15.100:0/1133900512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 msgr2=0x7f869c173f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.129+0000 7f869a800640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c173f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.130+0000 7f869a800640 1 -- 172.21.15.100:0/1133900512 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c0094d0 con 0x7f869c185ef0 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.130+0000 7f869a800640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f868800b360 tx=0x7f868800b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.130+0000 7f8692a00640 1 -- 172.21.15.100:0/1133900512 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688022640 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.130+0000 7f8692a00640 1 -- 172.21.15.100:0/1133900512 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880227a0 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.130+0000 7f8692a00640 1 -- 172.21.15.100:0/1133900512 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688022b50 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.131+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869c0fd450 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.131+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c0fda10 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.136+0000 7f8692a00640 1 -- 172.21.15.100:0/1133900512 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8688022cb0 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.137+0000 7f86a419c740 1 Processor -- start 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.137+0000 7f86a419c740 1 -- start start 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.138+0000 7f8692a00640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 0x7f867c0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f8692a00640 1 -- 172.21.15.100:0/1133900512 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f86880da940 con 0x7f869c185ef0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f869b200640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 0x7f867c0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2b5a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2b5fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2b1b620 con 0x55aab2b9b070 2024-02-21T07:56:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2acd8c0 con 0x55aab2b5ff90 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.139+0000 7f86a419c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2acadf0 con 0x55aab2bcf4d0 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41598/0 (socket says 172.21.15.100:41598) 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 -- 172.21.15.100:0/3411417448 learned_addr learned my addr 172.21.15.100:0/3411417448 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 0x7f867c0a1630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f869c18af90 tx=0x7f869400f5a0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f8699e00640 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2b5fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 -- 172.21.15.100:0/3411417448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 msgr2=0x55aab2b5fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2b5fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 -- 172.21.15.100:0/3411417448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 msgr2=0x55aab2b5a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2b5a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 -- 172.21.15.100:0/3411417448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab2a47b00 con 0x55aab2b5ff90 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.140+0000 7f869b200640 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8694005960 tx=0x7f8694019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f57f31030e996e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.141+0000 7f8687000640 1 -- 172.21.15.100:0/3411417448 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869401f3f0 con 0x55aab2b5ff90 2024-02-21T07:56:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.141+0000 7f8687000640 1 -- 172.21.15.100:0/3411417448 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869401f550 con 0x55aab2b5ff90 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.141+0000 7f8687000640 1 -- 172.21.15.100:0/3411417448 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869401f8e0 con 0x55aab2b5ff90 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.142+0000 7f86a419c740 1 -- 172.21.15.100:0/3411417448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 msgr2=0x55aab2b9b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.142+0000 7f86a419c740 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8694005960 tx=0x7f8694019000 comp rx=0 tx=0).stop 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 -- 172.21.15.100:0/3411417448 shutdown_connections 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b9b450 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2b5fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 --2- 172.21.15.100:0/3411417448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2b5a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 -- 172.21.15.100:0/3411417448 >> 172.21.15.100:0/3411417448 conn(0x55aab2b274b0 msgr2=0x55aab2b5eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 -- 172.21.15.100:0/3411417448 shutdown_connections 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.143+0000 7f86a419c740 1 -- 172.21.15.100:0/3411417448 wait complete. 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.145+0000 7f86a419c740 1 -- start start 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.145+0000 7f86a419c740 1 Processor -- start 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.211 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b9b070 0x55aab2be0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 0x55aab2bc3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2ac65d0 con 0x55aab2bcf4d0 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2a6bb50 con 0x55aab2b9b070 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2a6b7f0 con 0x55aab2b5ff90 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.147+0000 7f86a419c740 10 client.0 _ll_register_callbacks cb 0x55aab2a7f550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58800/0 (socket says 172.21.15.100:58800) 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 -- 172.21.15.100:0/3588406625 learned_addr learned my addr 172.21.15.100:0/3588406625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869b200640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 0x55aab2bc3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f8699e00640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b9b070 0x55aab2be0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 -- 172.21.15.100:0/3588406625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b9b070 msgr2=0x55aab2be0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b9b070 0x55aab2be0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.212 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.148+0000 7f869a800640 1 -- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 msgr2=0x55aab2bc3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f869a800640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 0x55aab2bc3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f869a800640 1 -- 172.21.15.100:0/3588406625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940056f0 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f869b200640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 0x55aab2bc3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f869a800640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f86880a8410 tx=0x7f86880a8c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7f29d6ed2b418f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f867b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880ac370 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f86880b0c20 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aab2a98cd0 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86880a78d0 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f86a419c740 10 client.7139 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.149+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55aab2ac4c50 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86880d6020 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f86880a7a30 con 0x55aab2b5ff90 2024-02-21T07:56:06.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 10 client.7139 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 10 client.7139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 20 client.7139 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b903d0 0x55aab2b59520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 4 client.7139 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aab2a98cd0 con 0x55aab2b903d0 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.150+0000 7f8699e00640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b903d0 0x55aab2b59520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.151+0000 7f8699e00640 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b903d0 0x55aab2b59520 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce48192285b74f8e server_cookie=a2d84a9740b388e0 in_seq=0 out_seq=0 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.151+0000 7f867b400640 10 client.7139 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f867b400640 1 -- 172.21.15.100:0/3588406625 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aab2a98cd0 con 0x55aab2b903d0 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f867b400640 10 client.7139 handle_command_reply: tid=0 2024-02-21T07:56:06.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 client.7139 shutdown 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 msgr2=0x55aab2b8fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f86880a8410 tx=0x7f86880a8c00 comp rx=0 tx=0).stop 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 shutdown_connections 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b903d0 0x55aab2b59520 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2bcf4d0 0x55aab2bc3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b9b070 0x55aab2be0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 --2- 172.21.15.100:0/3588406625 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b5ff90 0x55aab2b8fca0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 >> 172.21.15.100:0/3588406625 conn(0x55aab2b274b0 msgr2=0x55aab2bcf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f867b400640 0 client.7139 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 shutdown_connections 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.152+0000 7f86a419c740 1 -- 172.21.15.100:0/3588406625 wait complete. 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.153+0000 7f86a419c740 20 client.7139 trim_cache size 0 max 16384 2024-02-21T07:56:06.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.183+0000 7f86a419c740 1 Processor -- start 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.183+0000 7f86a419c740 1 -- start start 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b5d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2c2e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2c34220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab280ee60 con 0x55aab2b9b070 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2b660c0 con 0x55aab2b5ff90 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.185+0000 7f86a419c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2b8fd60 con 0x55aab2bcf4d0 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.186+0000 7f869b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2c34220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.186+0000 7f869b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2c34220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:58808/0 (socket says 172.21.15.100:58808) 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.186+0000 7f869b200640 1 -- 172.21.15.100:0/4257714710 learned_addr learned my addr 172.21.15.100:0/4257714710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f869a800640 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b5d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2c2e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 -- 172.21.15.100:0/4257714710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 msgr2=0x55aab2c34220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2c34220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 -- 172.21.15.100:0/4257714710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 msgr2=0x55aab2b5d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b5d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.187+0000 7f8699e00640 1 -- 172.21.15.100:0/4257714710 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab2a61530 con 0x55aab2b9b070 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.188+0000 7f8699e00640 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2c2e150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d71b526f2983c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.189+0000 7f8686600640 1 -- 172.21.15.100:0/4257714710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c032470 con 0x55aab2b9b070 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.189+0000 7f8686600640 1 -- 172.21.15.100:0/4257714710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c0325d0 con 0x55aab2b9b070 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.189+0000 7f8686600640 1 -- 172.21.15.100:0/4257714710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c032470 con 0x55aab2b9b070 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.190+0000 7f86a419c740 1 -- 172.21.15.100:0/4257714710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 msgr2=0x55aab2c2e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.191+0000 7f86a419c740 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2c2e150 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f868c000c00 tx=0x7f868c008030 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.191+0000 7f86a419c740 1 -- 172.21.15.100:0/4257714710 shutdown_connections 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.191+0000 7f86a419c740 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2bcf4d0 0x55aab2c34220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.191+0000 7f86a419c740 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b9b070 0x55aab2c2e150 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.192+0000 7f86a419c740 1 --2- 172.21.15.100:0/4257714710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2b5ff90 0x55aab2b5d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.192+0000 7f86a419c740 1 -- 172.21.15.100:0/4257714710 >> 172.21.15.100:0/4257714710 conn(0x55aab2b274b0 msgr2=0x55aab2bc3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.197+0000 7f86a419c740 1 -- 172.21.15.100:0/4257714710 shutdown_connections 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.198+0000 7f86a419c740 1 -- 172.21.15.100:0/4257714710 wait complete. 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.199+0000 7f86a419c740 1 -- start start 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.200+0000 7f86a419c740 1 Processor -- start 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 0x55aab2c3d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b9b070 0x55aab2bc53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2b5f470 con 0x55aab2b5ff90 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2c39820 con 0x55aab2bcf4d0 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab2c399c0 con 0x55aab2b9b070 2024-02-21T07:56:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.202+0000 7f86a419c740 10 client.0 _ll_register_callbacks cb 0x7f8694005310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.203+0000 7f869b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.203+0000 7f869b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:41634/0 (socket says 172.21.15.100:41634) 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.203+0000 7f869b200640 1 -- 172.21.15.100:0/2570148371 learned_addr learned my addr 172.21.15.100:0/2570148371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869a800640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 0x55aab2c3d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f8699e00640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b9b070 0x55aab2bc53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869b200640 1 -- 172.21.15.100:0/2570148371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b9b070 msgr2=0x55aab2bc53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869b200640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b9b070 0x55aab2bc53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869b200640 1 -- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 msgr2=0x55aab2c3d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869b200640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 0x55aab2c3d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869b200640 1 -- 172.21.15.100:0/2570148371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869c0cee70 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.204+0000 7f869a800640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 0x55aab2c3d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.205+0000 7f869b200640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f869401fb50 tx=0x7f8694014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcc27c1495ba727a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.205+0000 7f867b400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.208+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869402e030 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.208+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f869402f070 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.208+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aab2aebd30 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.209+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f869400fb20 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.209+0000 7f86a419c740 10 client.7231 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.209+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55aab2a872c0 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.209+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55aab2aebd30 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f869402a800 con 0x55aab2bcf4d0 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f86a419c740 10 client.7231 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f86a419c740 10 client.7231 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f86a419c740 20 client.7231 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b97510 0x55aab2bd2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.211+0000 7f86a419c740 4 client.7231 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.212+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aab2abcce0 con 0x55aab2b97510 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.212+0000 7f869a800640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b97510 0x55aab2bd2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.213+0000 7f867b400640 10 client.7231 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.213+0000 7f869a800640 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b97510 0x55aab2bd2180 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a3a5d3e92a1637 server_cookie=cb504672d9449748 in_seq=0 out_seq=0 2024-02-21T07:56:06.246 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.243+0000 7f867b400640 1 -- 172.21.15.100:0/2570148371 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aab2abcce0 con 0x55aab2b97510 2024-02-21T07:56:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.243+0000 7f867b400640 10 client.7231 handle_command_reply: tid=0 2024-02-21T07:56:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.243+0000 7f86a419c740 1 client.7231 shutdown 2024-02-21T07:56:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.244+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 msgr2=0x55aab2c2bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.244+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f869401fb50 tx=0x7f8694014000 comp rx=0 tx=0).stop 2024-02-21T07:56:06.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.244+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 shutdown_connections 2024-02-21T07:56:06.248 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.245+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55aab2b97510 0x55aab2bd2180 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.246+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55aab2bcf4d0 0x55aab2c2bc80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.247+0000 7f867b400640 0 client.7231 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.247+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aab2b9b070 0x55aab2bc53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.250 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.248+0000 7f86a419c740 1 --2- 172.21.15.100:0/2570148371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aab2b5ff90 0x55aab2c3d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.248+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 >> 172.21.15.100:0/2570148371 conn(0x55aab2b274b0 msgr2=0x55aab2b9b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.253 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.250+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 shutdown_connections 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.252+0000 7f86a419c740 1 -- 172.21.15.100:0/2570148371 wait complete. 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.252+0000 7f86a419c740 20 client.7231 trim_cache size 0 max 16384 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:56:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 msgr2=0x7f867c0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 0x7f867c0a1630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f869c18af90 tx=0x7f869400f5a0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 msgr2=0x7f869c0d34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f868800b360 tx=0x7f868800b820 comp rx=0 tx=0).stop 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 shutdown_connections 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f869c18ab00 0x7f869c180490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f867c09f170 0x7f867c0a1630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f869c18a160 0x7f869c173f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 --2- 172.21.15.100:0/1133900512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f869c185ef0 0x7f869c0d34e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.253+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 >> 172.21.15.100:0/1133900512 conn(0x7f869c08cfd0 msgr2=0x7f869c0fb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.256+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 shutdown_connections 2024-02-21T07:56:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:06.256+0000 7f86a1400640 1 -- 172.21.15.100:0/1133900512 wait complete. 2024-02-21T07:56:17.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:17.605 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:17.607 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.514+0000 7f1416600640 1 Processor -- start 2024-02-21T07:56:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.515+0000 7f1416600640 1 -- start start 2024-02-21T07:56:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f140fe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f14100f91a0 0x7f14101900e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:55682/0 (socket says 172.21.15.100:55682) 2024-02-21T07:56:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f140ea00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f1410189480 0x7f14100f8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:41694/0 (socket says 172.21.15.100:41694) 2024-02-21T07:56:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f140fe00640 1 -- 172.21.15.100:0/324832521 learned_addr learned my addr 172.21.15.100:0/324832521 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100d1240 con 0x7f14101825f0 2024-02-21T07:56:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100d1520 con 0x7f1410189480 2024-02-21T07:56:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.519+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14100d1800 con 0x7f14100f91a0 2024-02-21T07:56:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.520+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456162234 0 0) 0x7f14100d1520 con 0x7f1410189480 2024-02-21T07:56:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.520+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f4003520 con 0x7f1410189480 2024-02-21T07:56:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.520+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532445486 0 0) 0x7f14100d1800 con 0x7f14100f91a0 2024-02-21T07:56:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.520+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14100d1520 con 0x7f14100f91a0 2024-02-21T07:56:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4030805962 0 0) 0x7f14100d1520 con 0x7f14100f91a0 2024-02-21T07:56:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 >> v1:172.21.15.156:6789/0 conn(0x7f1410189480 legacy=0x7f14100f8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 >> v1:172.21.15.100:6789/0 conn(0x7f14101825f0 legacy=0x7f14100d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100d1ae0 con 0x7f14100f91a0 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f13fc0015f0 con 0x7f14100f91a0 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 >> v1:172.21.15.170:6789/0 conn(0x7f14100f91a0 legacy=0x7f14101900e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13f4004bb0 0x7f13f4004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f13f4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4004350 0x7f13f4014230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4014ae0 con 0x7f13f4004bb0 2024-02-21T07:56:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4014c50 con 0x7f13f4003760 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4014e10 con 0x7f13f4004350 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.521+0000 7f140ea00640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f13f4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.522+0000 7f140fe00640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4004350 0x7f13f4014230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.522+0000 7f140ea00640 1 -- 172.21.15.100:0/324832521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4004350 msgr2=0x7f13f4014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.522+0000 7f140ea00640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13f4004350 0x7f13f4014230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.522+0000 7f140ea00640 1 -- 172.21.15.100:0/324832521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13f4004bb0 msgr2=0x7f13f4004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.522+0000 7f140ea00640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13f4004bb0 0x7f13f4004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.523+0000 7f140ea00640 1 -- 172.21.15.100:0/324832521 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100d1ae0 con 0x7f13f4003760 2024-02-21T07:56:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.526+0000 7f140fe00640 1 -- 172.21.15.100:0/324832521 reap_dead start 2024-02-21T07:56:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.526+0000 7f140ea00640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f13f4003be0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f14101898b0 tx=0x7f13f40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741ef3a3e7a118c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.527+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408004d60 con 0x7f13f4003760 2024-02-21T07:56:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.527+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140802c5a0 con 0x7f13f4003760 2024-02-21T07:56:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.527+0000 7f140e000640 1 -- 172.21.15.100:0/324832521 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140802c9d0 con 0x7f13f4003760 2024-02-21T07:56:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.528+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 msgr2=0x7f13f4003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.528+0000 7f1416600640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f13f4003be0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f14101898b0 tx=0x7f13f40057f0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.529+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 shutdown_connections 2024-02-21T07:56:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.530+0000 7f1416600640 1 --2- 172.21.15.100:0/324832521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f13f4003be0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.530+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 >> 172.21.15.100:0/324832521 conn(0x7f14100615c0 msgr2=0x7f14100619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.531+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 shutdown_connections 2024-02-21T07:56:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.533+0000 7f1416600640 1 -- 172.21.15.100:0/324832521 wait complete. 2024-02-21T07:56:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.536+0000 7f1416600640 1 Processor -- start 2024-02-21T07:56:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.537+0000 7f1416600640 1 -- start start 2024-02-21T07:56:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.539+0000 7f1416600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.540+0000 7f1416600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.541+0000 7f140ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.541+0000 7f140f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.541+0000 7f140f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38756/0 (socket says 172.21.15.100:38756) 2024-02-21T07:56:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.542+0000 7f140ea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60120/0 (socket says 172.21.15.100:60120) 2024-02-21T07:56:19.544 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.543+0000 7f140f400640 1 -- 172.21.15.100:0/4105136800 learned_addr learned my addr 172.21.15.100:0/4105136800 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.543+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 0x7f1410187650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.545 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.544+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14101654a0 con 0x7f14101871d0 2024-02-21T07:56:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.544+0000 7f140fe00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 0x7f1410187650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.544+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141021bd10 con 0x7f13f4003760 2024-02-21T07:56:19.546 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.544+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1410180bc0 con 0x7f141021b350 2024-02-21T07:56:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.548+0000 7f140ea00640 1 -- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 msgr2=0x7f1410164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.548+0000 7f140ea00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.548+0000 7f140ea00640 1 -- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 msgr2=0x7f1410187650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.549+0000 7f140ea00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 0x7f1410187650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.549+0000 7f140ea00640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100d2740 con 0x7f141021b350 2024-02-21T07:56:19.555 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.552+0000 7f140f400640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.554+0000 7f140ea00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1408005000 tx=0x7f1408001650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.554+0000 7f140fe00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 0x7f1410187650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:19.556 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.554+0000 7f1407400640 1 -- 172.21.15.100:0/4105136800 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408039070 con 0x7f141021b350 2024-02-21T07:56:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.555+0000 7f1407400640 1 -- 172.21.15.100:0/4105136800 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140803a040 con 0x7f141021b350 2024-02-21T07:56:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.555+0000 7f1407400640 1 -- 172.21.15.100:0/4105136800 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408007070 con 0x7f141021b350 2024-02-21T07:56:19.557 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.555+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141017ffb0 con 0x7f141021b350 2024-02-21T07:56:19.558 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.556+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1410180570 con 0x7f141021b350 2024-02-21T07:56:19.575 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.573+0000 7f1407400640 1 -- 172.21.15.100:0/4105136800 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f14080071d0 con 0x7f141021b350 2024-02-21T07:56:19.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.576+0000 7f1419214740 1 Processor -- start 2024-02-21T07:56:19.580 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.577+0000 7f1419214740 1 -- start start 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.577+0000 7f1407400640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 0x7f13f00a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.578+0000 7f1407400640 1 -- 172.21.15.100:0/4105136800 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14080eb190 con 0x7f141021b350 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.578+0000 7f140fe00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 0x7f13f00a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f56fea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f573a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f56ba620 con 0x55c5f56fef90 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f566c8c0 con 0x55c5f576e4d0 2024-02-21T07:56:19.581 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f1419214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5669df0 con 0x55c5f573a070 2024-02-21T07:56:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f140f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f140f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60126/0 (socket says 172.21.15.100:60126) 2024-02-21T07:56:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.579+0000 7f140f400640 1 -- 172.21.15.100:0/3672953843 learned_addr learned my addr 172.21.15.100:0/3672953843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:19.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.580+0000 7f140f400640 1 -- 172.21.15.100:0/3672953843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 msgr2=0x55c5f56fea50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.580+0000 7f140f400640 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f56fea50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.580+0000 7f140f400640 1 -- 172.21.15.100:0/3672953843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 msgr2=0x55c5f573a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.580+0000 7f140f400640 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f573a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.580+0000 7f140f400640 1 -- 172.21.15.100:0/3672953843 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f55e6b00 con 0x55c5f573a070 2024-02-21T07:56:19.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.582+0000 7f140fe00640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 0x7f13f00a16b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f14100f8940 tx=0x7f13fc001dc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.583+0000 7f140f400640 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1400001da0 tx=0x7f1400007e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718922627e3e14ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.583+0000 7f13fbe00640 1 -- 172.21.15.100:0/3672953843 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400001810 con 0x55c5f573a070 2024-02-21T07:56:19.585 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.584+0000 7f13fbe00640 1 -- 172.21.15.100:0/3672953843 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14000050d0 con 0x55c5f573a070 2024-02-21T07:56:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.584+0000 7f13fbe00640 1 -- 172.21.15.100:0/3672953843 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400005440 con 0x55c5f573a070 2024-02-21T07:56:19.586 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 -- 172.21.15.100:0/3672953843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 msgr2=0x55c5f56f9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1400001da0 tx=0x7f1400007e50 comp rx=0 tx=0).stop 2024-02-21T07:56:19.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 -- 172.21.15.100:0/3672953843 shutdown_connections 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f573a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f56fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 --2- 172.21.15.100:0/3672953843 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f573a070 0x55c5f56f9440 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1400001da0 tx=0x7f1400007e50 comp rx=0 tx=0).stop 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.585+0000 7f1419214740 1 -- 172.21.15.100:0/3672953843 >> 172.21.15.100:0/3672953843 conn(0x55c5f56c64b0 msgr2=0x55c5f56fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.586+0000 7f1419214740 1 -- 172.21.15.100:0/3672953843 shutdown_connections 2024-02-21T07:56:19.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.586+0000 7f1419214740 1 -- 172.21.15.100:0/3672953843 wait complete. 2024-02-21T07:56:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.588+0000 7f1419214740 1 -- start start 2024-02-21T07:56:19.590 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.589+0000 7f1419214740 1 Processor -- start 2024-02-21T07:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.592+0000 7f1419214740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.592+0000 7f1419214740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f5735c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.593+0000 7f1419214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f572e460 0x55c5f5734f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.593+0000 7f1419214740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f56655d0 con 0x55c5f56fef90 2024-02-21T07:56:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.593+0000 7f1419214740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f560ab50 con 0x55c5f576e4d0 2024-02-21T07:56:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.593+0000 7f1419214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f560a7f0 con 0x55c5f572e460 2024-02-21T07:56:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.593+0000 7f1419214740 10 client.0 _ll_register_callbacks cb 0x55c5f561e550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:19.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.594+0000 7f140f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.594+0000 7f140ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f5735c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.594+0000 7f140f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46322/0 (socket says 172.21.15.100:46322) 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.594+0000 7f140f400640 1 -- 172.21.15.100:0/1413609536 learned_addr learned my addr 172.21.15.100:0/1413609536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140fe00640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f572e460 0x55c5f5734f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140f400640 1 -- 172.21.15.100:0/1413609536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f572e460 msgr2=0x55c5f5734f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140f400640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f572e460 0x55c5f5734f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140f400640 1 -- 172.21.15.100:0/1413609536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 msgr2=0x55c5f5735c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140f400640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f5735c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.595+0000 7f140f400640 1 -- 172.21.15.100:0/1413609536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1400001970 con 0x55c5f56fef90 2024-02-21T07:56:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.596+0000 7f140f400640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1400001d70 tx=0x7f1400001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da6f4e7a196fa23 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.596+0000 7f13f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:56:19.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.597+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400001810 con 0x55c5f56fef90 2024-02-21T07:56:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.597+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1400006990 con 0x55c5f56fef90 2024-02-21T07:56:19.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.598+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f5637cd0 con 0x55c5f56fef90 2024-02-21T07:56:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.598+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14000054b0 con 0x55c5f56fef90 2024-02-21T07:56:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.598+0000 7f1419214740 10 client.7041 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:19.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.598+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5f5663c50 con 0x55c5f56fef90 2024-02-21T07:56:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.599+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5f5637cd0 con 0x55c5f56fef90 2024-02-21T07:56:19.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1400012070 con 0x55c5f56fef90 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 10 client.7041 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 10 client.7041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 20 client.7041 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f57354a0 0x55c5f5763890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 4 client.7041 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:19.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.600+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5f565bce0 con 0x55c5f57354a0 2024-02-21T07:56:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.601+0000 7f140ea00640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f57354a0 0x55c5f5763890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.603 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.602+0000 7f140ea00640 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f57354a0 0x55c5f5763890 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d17526557feb27 server_cookie=7fcc4fe0fdf1055f in_seq=0 out_seq=0 2024-02-21T07:56:19.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.602+0000 7f13f8c00640 10 client.7041 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.604+0000 7f13f8c00640 1 -- 172.21.15.100:0/1413609536 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c5f565bce0 con 0x55c5f57354a0 2024-02-21T07:56:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.604+0000 7f13f8c00640 10 client.7041 handle_command_reply: tid=0 2024-02-21T07:56:19.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.604+0000 7f1419214740 1 client.7041 shutdown 2024-02-21T07:56:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.605+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 msgr2=0x55c5f572c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.607 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.605+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1400001d70 tx=0x7f1400001020 comp rx=0 tx=0).stop 2024-02-21T07:56:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.606+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 shutdown_connections 2024-02-21T07:56:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.606+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f57354a0 0x55c5f5763890 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.606+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f572e460 0x55c5f5734f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f5735c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f1419214740 1 --2- 172.21.15.100:0/1413609536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f56fef90 0x55c5f572c800 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 >> 172.21.15.100:0/1413609536 conn(0x55c5f56c64b0 msgr2=0x55c5f576e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f13f8c00640 0 client.7041 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 shutdown_connections 2024-02-21T07:56:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.607+0000 7f1419214740 1 -- 172.21.15.100:0/1413609536 wait complete. 2024-02-21T07:56:19.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.608+0000 7f1419214740 20 client.7041 trim_cache size 0 max 16384 2024-02-21T07:56:19.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.650+0000 7f1419214740 1 Processor -- start 2024-02-21T07:56:19.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.650+0000 7f1419214740 1 -- start start 2024-02-21T07:56:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.652+0000 7f1419214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.653+0000 7f1419214740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f56f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.653+0000 7f1419214740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.653+0000 7f140f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.655 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.653+0000 7f140f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60140/0 (socket says 172.21.15.100:60140) 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f1419214740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f53ade60 con 0x55c5f572e460 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f1419214740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f57cdf70 con 0x55c5f576e4d0 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f1419214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f576db40 con 0x55c5f56fef90 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f56f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:38778/0 (socket says 172.21.15.100:38778) 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f56f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46334/0 (socket says 172.21.15.100:46334) 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 -- 172.21.15.100:0/2901676049 learned_addr learned my addr 172.21.15.100:0/2901676049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:19.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 -- 172.21.15.100:0/2901676049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 msgr2=0x55c5f5737730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 -- 172.21.15.100:0/2901676049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 msgr2=0x55c5f56f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.654+0000 7f140fe00640 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f56f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.655+0000 7f140fe00640 1 -- 172.21.15.100:0/2901676049 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f5600530 con 0x55c5f576e4d0 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.655+0000 7f140f400640 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.655+0000 7f140fe00640 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1410091830 tx=0x7f13fc016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9e2411902d0be2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.656+0000 7f13fb400640 1 -- 172.21.15.100:0/2901676049 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011ed0 con 0x55c5f576e4d0 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.656+0000 7f13fb400640 1 -- 172.21.15.100:0/2901676049 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc022400 con 0x55c5f576e4d0 2024-02-21T07:56:19.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.656+0000 7f13fb400640 1 -- 172.21.15.100:0/2901676049 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc022770 con 0x55c5f576e4d0 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 -- 172.21.15.100:0/2901676049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 msgr2=0x55c5f57cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1410091830 tx=0x7f13fc016000 comp rx=0 tx=0).stop 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 -- 172.21.15.100:0/2901676049 shutdown_connections 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57cd0c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f56f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 --2- 172.21.15.100:0/2901676049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f5737730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.659+0000 7f1419214740 1 -- 172.21.15.100:0/2901676049 >> 172.21.15.100:0/2901676049 conn(0x55c5f56c64b0 msgr2=0x55c5f573a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.660+0000 7f1419214740 1 -- 172.21.15.100:0/2901676049 shutdown_connections 2024-02-21T07:56:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.661+0000 7f1419214740 1 -- 172.21.15.100:0/2901676049 wait complete. 2024-02-21T07:56:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.662+0000 7f1419214740 1 -- start start 2024-02-21T07:56:19.668 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.662+0000 7f1419214740 1 Processor -- start 2024-02-21T07:56:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.671+0000 7f1419214740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f57ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.671+0000 7f1419214740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f57cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f140f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f57ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f1419214740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57d0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f1419214740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f572a560 con 0x55c5f572e460 2024-02-21T07:56:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f1419214740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f572e2d0 con 0x55c5f576e4d0 2024-02-21T07:56:19.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f1419214740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f57ca660 con 0x55c5f56fef90 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f140ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f57cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f140ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f57cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46350/0 (socket says 172.21.15.100:46350) 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.672+0000 7f140ea00640 1 -- 172.21.15.100:0/3432961950 learned_addr learned my addr 172.21.15.100:0/3432961950 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.673+0000 7f1419214740 10 client.0 _ll_register_callbacks cb 0x7f1400001760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.673+0000 7f140fe00640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.673+0000 7f140fe00640 1 -- 172.21.15.100:0/3432961950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 msgr2=0x55c5f57ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.673+0000 7f140fe00640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f57ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.675 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.673+0000 7f140fe00640 1 -- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 msgr2=0x55c5f57cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.674+0000 7f140fe00640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f57cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.674+0000 7f140fe00640 1 -- 172.21.15.100:0/3432961950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc00f040 con 0x55c5f576e4d0 2024-02-21T07:56:19.676 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.674+0000 7f140fe00640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57d0280 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f13fc024000 tx=0x7f1400000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bacee5b3df67976 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.674+0000 7f13f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.675+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011ed0 con 0x55c5f576e4d0 2024-02-21T07:56:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.675+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f13fc023b40 con 0x55c5f576e4d0 2024-02-21T07:56:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.676+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c5f57368b0 con 0x55c5f576e4d0 2024-02-21T07:56:19.677 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.676+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13fc023d00 con 0x55c5f576e4d0 2024-02-21T07:56:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.676+0000 7f1419214740 10 client.7246 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:19.678 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.676+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c5f56262c0 con 0x55c5f576e4d0 2024-02-21T07:56:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.677+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c5f57368b0 con 0x55c5f576e4d0 2024-02-21T07:56:19.680 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f13fc034070 con 0x55c5f576e4d0 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 10 client.7246 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 10 client.7246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 20 client.7246 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f5770940 0x55c5f57d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 4 client.7246 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.678+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c5f568ad30 con 0x55c5f5770940 2024-02-21T07:56:19.681 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.679+0000 7f140f400640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f5770940 0x55c5f57d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.682+0000 7f13f8c00640 10 client.7246 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:19.684 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.682+0000 7f140f400640 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f5770940 0x55c5f57d07c0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6059bf45c70ae9c server_cookie=e60db069013e7777 in_seq=0 out_seq=0 2024-02-21T07:56:19.712 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.711+0000 7f13f8c00640 1 -- 172.21.15.100:0/3432961950 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c5f568ad30 con 0x55c5f5770940 2024-02-21T07:56:19.713 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.711+0000 7f13f8c00640 10 client.7246 handle_command_reply: tid=0 2024-02-21T07:56:19.717 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.716+0000 7f1419214740 1 client.7246 shutdown 2024-02-21T07:56:19.723 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.720+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 msgr2=0x55c5f57d0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.720+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57d0280 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f13fc024000 tx=0x7f1400000fb0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 shutdown_connections 2024-02-21T07:56:19.724 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c5f5770940 0x55c5f57d07c0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c5f576e4d0 0x55c5f57d0280 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5f572e460 0x55c5f57cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 --2- 172.21.15.100:0/3432961950 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c5f56fef90 0x55c5f57ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.725 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.722+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 >> 172.21.15.100:0/3432961950 conn(0x55c5f56c64b0 msgr2=0x55c5f56f4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.728+0000 7f13f8c00640 0 client.7246 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:19.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.728+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 shutdown_connections 2024-02-21T07:56:19.732 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.729+0000 7f1419214740 1 -- 172.21.15.100:0/3432961950 wait complete. 2024-02-21T07:56:19.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.729+0000 7f1419214740 20 client.7246 trim_cache size 0 max 16384 2024-02-21T07:56:19.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:56:19.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:56:19.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:56:19.733 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:56:19.736 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.735+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 msgr2=0x7f13f00a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.735+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 0x7f13f00a16b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f14100f8940 tx=0x7f13fc001dc0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.735+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 msgr2=0x7f141021b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.735+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1408005000 tx=0x7f1408001650 comp rx=0 tx=0).stop 2024-02-21T07:56:19.737 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 shutdown_connections 2024-02-21T07:56:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f13f009f1f0 0x7f13f00a16b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14101871d0 0x7f1410187650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f141021b350 0x7f141021b7d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.739 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 --2- 172.21.15.100:0/4105136800 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13f4003760 0x7f1410164f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.736+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 >> 172.21.15.100:0/4105136800 conn(0x7f14100615c0 msgr2=0x7f14100fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.737+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 shutdown_connections 2024-02-21T07:56:19.740 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:19.738+0000 7f1416600640 1 -- 172.21.15.100:0/4105136800 wait complete. 2024-02-21T07:56:22.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:56:22.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:56:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.558+0000 7f5b8a000640 1 Processor -- start 2024-02-21T07:56:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.558+0000 7f5b8a000640 1 -- start start 2024-02-21T07:56:22.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.561+0000 7f5b8a000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5b84070a30 0x7f5b8406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.561+0000 7f5b8a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5b8406ebf0 0x7f5b84190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.561+0000 7f5b8a000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8418dc80 con 0x7f5b84190260 2024-02-21T07:56:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.561+0000 7f5b8a000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b8406f060 con 0x7f5b8406ebf0 2024-02-21T07:56:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.561+0000 7f5b8a000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b840f5b90 con 0x7f5b84070a30 2024-02-21T07:56:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.562+0000 7f5b83400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5b84190260 0x7f5b840f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45624/0 (socket says 172.21.15.100:45624) 2024-02-21T07:56:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.562+0000 7f5b83400640 1 -- 172.21.15.100:0/1145118548 learned_addr learned my addr 172.21.15.100:0/1145118548 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932995005 0 0) 0x7f5b8418dc80 con 0x7f5b84190260 2024-02-21T07:56:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68003520 con 0x7f5b84190260 2024-02-21T07:56:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1145118548 >> v2:172.21.15.100:3300/0 conn(0x7f5b8406ebf0 0x7f5b84190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82a00640 1 --2- 172.21.15.100:0/1145118548 >> v2:172.21.15.156:3300/0 conn(0x7f5b84070a30 0x7f5b8406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063569583 0 0) 0x7f5b68003520 con 0x7f5b84190260 2024-02-21T07:56:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 >> v2:172.21.15.156:3300/0 conn(0x7f5b84070a30 msgr2=0x7f5b8406e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 --2- 172.21.15.100:0/1145118548 >> v2:172.21.15.156:3300/0 conn(0x7f5b84070a30 0x7f5b8406e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 >> v2:172.21.15.100:3300/0 conn(0x7f5b8406ebf0 msgr2=0x7f5b84190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.563+0000 7f5b82000640 1 --2- 172.21.15.100:0/1145118548 >> v2:172.21.15.100:3300/0 conn(0x7f5b8406ebf0 0x7f5b84190640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b840f55d0 con 0x7f5b84190260 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f5b74001670 con 0x7f5b84190260 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 >> v1:172.21.15.100:6789/0 conn(0x7f5b84190260 legacy=0x7f5b840f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 0x7f5b68003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b68005360 0x7f5b6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840f5b90 con 0x7f5b68003a10 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c2a0 con 0x7f5b680047c0 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6800c460 con 0x7f5b68005360 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1145118548 >> v2:172.21.15.100:3300/0 conn(0x7f5b8406ebf0 0x7f5b84190640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b82a00640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b83400640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 0x7f5b68003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.564+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b68005360 0x7f5b6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.565+0000 7f5b83400640 1 -- 172.21.15.100:0/1145118548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b68005360 msgr2=0x7f5b6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.565+0000 7f5b83400640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b68005360 0x7f5b6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.565+0000 7f5b83400640 1 -- 172.21.15.100:0/1145118548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b680047c0 msgr2=0x7f5b68004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.565+0000 7f5b83400640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b680047c0 0x7f5b68004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.565+0000 7f5b83400640 1 -- 172.21.15.100:0/1145118548 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b68003520 con 0x7f5b68003a10 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.566+0000 7f5b83e00640 1 -- 172.21.15.100:0/1145118548 reap_dead start 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.566+0000 7f5b83400640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 0x7f5b68003e30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c190 tx=0x7f5b680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df8214922c29c24 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.566+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74005ad0 con 0x7f5b68003a10 2024-02-21T07:56:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.566+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b74005c30 con 0x7f5b68003a10 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.566+0000 7f5b82000640 1 -- 172.21.15.100:0/1145118548 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402c7d0 con 0x7f5b68003a10 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 -- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 msgr2=0x7f5b68003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 0x7f5b68003e30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400c190 tx=0x7f5b680057f0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 -- 172.21.15.100:0/1145118548 shutdown_connections 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 --2- 172.21.15.100:0/1145118548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b68003a10 0x7f5b68003e30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 -- 172.21.15.100:0/1145118548 >> 172.21.15.100:0/1145118548 conn(0x7f5b840668b0 msgr2=0x7f5b84066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.567+0000 7f5b8a000640 1 -- 172.21.15.100:0/1145118548 shutdown_connections 2024-02-21T07:56:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.568+0000 7f5b8a000640 1 -- 172.21.15.100:0/1145118548 wait complete. 2024-02-21T07:56:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.571+0000 7f5b8a000640 1 Processor -- start 2024-02-21T07:56:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.571+0000 7f5b8a000640 1 -- start start 2024-02-21T07:56:22.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b84175090 0x7f5b84223100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b84220cb0 0x7f5b84221130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84220820 con 0x7f5b84174cb0 2024-02-21T07:56:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84189d90 con 0x7f5b84175090 2024-02-21T07:56:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.573+0000 7f5b8a000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84223640 con 0x7f5b84220cb0 2024-02-21T07:56:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.574+0000 7f5b83400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.574+0000 7f5b83400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34268/0 (socket says 172.21.15.100:34268) 2024-02-21T07:56:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.574+0000 7f5b83400640 1 -- 172.21.15.100:0/2413366546 learned_addr learned my addr 172.21.15.100:0/2413366546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.574+0000 7f5b82a00640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b84175090 0x7f5b84223100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 -- 172.21.15.100:0/2413366546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b84220cb0 msgr2=0x7f5b84221130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b84220cb0 0x7f5b84221130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 -- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b84175090 msgr2=0x7f5b84223100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b84175090 0x7f5b84223100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 -- 172.21.15.100:0/2413366546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b84189210 con 0x7f5b84174cb0 2024-02-21T07:56:22.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b83400640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402c3c0 tx=0x7f5b74001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b7b400640 1 -- 172.21.15.100:0/2413366546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7403c070 con 0x7f5b84174cb0 2024-02-21T07:56:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b7b400640 1 -- 172.21.15.100:0/2413366546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7402c9e0 con 0x7f5b84174cb0 2024-02-21T07:56:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b7b400640 1 -- 172.21.15.100:0/2413366546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402cd70 con 0x7f5b84174cb0 2024-02-21T07:56:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.575+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b841894f0 con 0x7f5b84174cb0 2024-02-21T07:56:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.576+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b84189ab0 con 0x7f5b84174cb0 2024-02-21T07:56:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.580+0000 7f5b7b400640 1 -- 172.21.15.100:0/2413366546 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5b74032070 con 0x7f5b84174cb0 2024-02-21T07:56:22.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.581+0000 7f5b8cd7e740 1 Processor -- start 2024-02-21T07:56:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.581+0000 7f5b8cd7e740 1 -- start start 2024-02-21T07:56:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.581+0000 7f5b7b400640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 0x7f5b640a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.581+0000 7f5b7b400640 1 -- 172.21.15.100:0/2413366546 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5b740ea860 con 0x7f5b84174cb0 2024-02-21T07:56:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b83e00640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 0x7f5b640a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b863ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b7d8150 con 0x556b5b8d6f80 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b7d5680 con 0x556b5b8a18e0 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.582+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b7d0e60 con 0x556b5b8a0fc0 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47152/0 (socket says 172.21.15.100:47152) 2024-02-21T07:56:22.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 -- 172.21.15.100:0/1131939688 learned_addr learned my addr 172.21.15.100:0/1131939688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 -- 172.21.15.100:0/1131939688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 msgr2=0x556b5b863ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b863ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 -- 172.21.15.100:0/1131939688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 msgr2=0x556b5b8a13a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8a13a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 -- 172.21.15.100:0/1131939688 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b5b78a060 con 0x556b5b8a0fc0 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83e00640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 0x7f5b640a1630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5b84070e10 tx=0x7f5b7c003990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.583+0000 7f5b83400640 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b4770 tx=0x7f5b740b7d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efa6f2d4b488b6e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.584+0000 7f5b6f400640 1 -- 172.21.15.100:0/1131939688 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7402c550 con 0x556b5b8a0fc0 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.584+0000 7f5b6f400640 1 -- 172.21.15.100:0/1131939688 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740b8aa0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.584+0000 7f5b6f400640 1 -- 172.21.15.100:0/1131939688 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740b83a0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1131939688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 msgr2=0x556b5b8d6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b4770 tx=0x7f5b740b7d00 comp rx=0 tx=0).stop 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1131939688 shutdown_connections 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b863ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1131939688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a0fc0 0x556b5b8d6a40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.585+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1131939688 >> 172.21.15.100:0/1131939688 conn(0x556b5b8305a0 msgr2=0x556b5b867eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.587+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1131939688 shutdown_connections 2024-02-21T07:56:22.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.587+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1131939688 wait complete. 2024-02-21T07:56:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.588+0000 7f5b8cd7e740 1 -- start start 2024-02-21T07:56:22.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.589+0000 7f5b8cd7e740 1 Processor -- start 2024-02-21T07:56:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a18e0 0x556b5b862960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8e8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b83400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b775ec0 con 0x556b5b8d6f80 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b775b60 con 0x556b5b8a0fc0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b53f1c0 con 0x556b5b8a18e0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.591+0000 7f5b8cd7e740 10 client.0 _ll_register_callbacks cb 0x556b5b789960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49378/0 (socket says 172.21.15.100:49378) 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 -- 172.21.15.100:0/788874115 learned_addr learned my addr 172.21.15.100:0/788874115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83e00640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 -- 172.21.15.100:0/788874115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a18e0 msgr2=0x556b5b862960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a18e0 0x556b5b862960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 -- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 msgr2=0x556b5b8e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.592+0000 7f5b83400640 1 -- 172.21.15.100:0/788874115 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b84189ab0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.593+0000 7f5b83400640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5b740d7230 tx=0x7f5b740ea070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d0b8db5ef13b18 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.593+0000 7f5b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.593+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740bc4f0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.593+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5b740c0b40 con 0x556b5b8a0fc0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.594+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b5b4d07e0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.594+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b740b83a0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.594+0000 7f5b8cd7e740 10 client.7252 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.594+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556b5b7cf4e0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556b5b4d07e0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b740bc120 con 0x556b5b8a0fc0 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 10 client.7252 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 10 client.7252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 20 client.7252 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b8e9600 0x556b5b898d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 4 client.7252 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:22.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.595+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b5b50d720 con 0x556b5b8e9600 2024-02-21T07:56:22.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.603+0000 7f5b82a00640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b8e9600 0x556b5b898d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.618+0000 7f5b82a00640 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b8e9600 0x556b5b898d30 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec028dc9874f605 server_cookie=f0f6ae31e275b9c2 in_seq=0 out_seq=0 2024-02-21T07:56:22.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.618+0000 7f5b63e00640 10 client.7252 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:22.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.620+0000 7f5b63e00640 1 -- 172.21.15.100:0/788874115 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b5b50d720 con 0x556b5b8e9600 2024-02-21T07:56:22.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.620+0000 7f5b63e00640 10 client.7252 handle_command_reply: tid=0 2024-02-21T07:56:22.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.620+0000 7f5b8cd7e740 1 client.7252 shutdown 2024-02-21T07:56:22.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.621+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 msgr2=0x556b5b8eae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.621+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5b740d7230 tx=0x7f5b740ea070 comp rx=0 tx=0).stop 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.621+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 shutdown_connections 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.621+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b8e9600 0x556b5b898d30 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.622+0000 7f5b63e00640 0 client.7252 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.622+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8d6f80 0x556b5b8e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.622+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8a18e0 0x556b5b862960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.622+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/788874115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b8eae70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.622+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 >> 172.21.15.100:0/788874115 conn(0x556b5b8305a0 msgr2=0x556b5b8688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.625+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 shutdown_connections 2024-02-21T07:56:22.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.629+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/788874115 wait complete. 2024-02-21T07:56:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.632+0000 7f5b8cd7e740 20 client.7252 trim_cache size 0 max 16384 2024-02-21T07:56:22.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.706+0000 7f5b8cd7e740 1 Processor -- start 2024-02-21T07:56:22.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.707+0000 7f5b8cd7e740 1 -- start start 2024-02-21T07:56:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a0fc0 0x556b5b8e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b8688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b8cefe0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b8ceb50 con 0x556b5b8a18e0 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.711+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b89a610 con 0x556b5b8d6f80 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.712+0000 7f5b83e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.712+0000 7f5b83e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47156/0 (socket says 172.21.15.100:47156) 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.712+0000 7f5b83e00640 1 -- 172.21.15.100:0/1125792866 learned_addr learned my addr 172.21.15.100:0/1125792866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.713+0000 7f5b83e00640 1 -- 172.21.15.100:0/1125792866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 msgr2=0x556b5b8688a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:22.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.713+0000 7f5b82a00640 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b8688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.714+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b8688a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.714+0000 7f5b83e00640 1 -- 172.21.15.100:0/1125792866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a0fc0 msgr2=0x556b5b8e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.714+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a0fc0 0x556b5b8e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.714+0000 7f5b83e00640 1 -- 172.21.15.100:0/1125792866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b5b76b950 con 0x556b5b8d6f80 2024-02-21T07:56:22.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.715+0000 7f5b83e00640 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5b840f0e40 tx=0x7f5b7c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bad1e6cf69cbb34d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.716+0000 7f5b6ea00640 1 -- 172.21.15.100:0/1125792866 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c022420 con 0x556b5b8d6f80 2024-02-21T07:56:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.717+0000 7f5b6ea00640 1 -- 172.21.15.100:0/1125792866 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c022580 con 0x556b5b8d6f80 2024-02-21T07:56:22.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.717+0000 7f5b6ea00640 1 -- 172.21.15.100:0/1125792866 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0228f0 con 0x556b5b8d6f80 2024-02-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.720+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1125792866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 msgr2=0x556b5b89a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.720+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5b840f0e40 tx=0x7f5b7c012000 comp rx=0 tx=0).stop 2024-02-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.725+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1125792866 shutdown_connections 2024-02-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.725+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b89a0d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.725+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a18e0 0x556b5b8688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.725+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/1125792866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a0fc0 0x556b5b8e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.725+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1125792866 >> 172.21.15.100:0/1125792866 conn(0x556b5b8305a0 msgr2=0x556b5b8e8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.728+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1125792866 shutdown_connections 2024-02-21T07:56:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.728+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/1125792866 wait complete. 2024-02-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.730+0000 7f5b8cd7e740 1 -- start start 2024-02-21T07:56:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.732+0000 7f5b8cd7e740 1 Processor -- start 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 0x556b5b8db3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b8671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b86f300 con 0x556b5b8a18e0 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b8d2f20 con 0x556b5b8a0fc0 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b5b8d69e0 con 0x556b5b8d6f80 2024-02-21T07:56:22.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.735+0000 7f5b8cd7e740 10 client.0 _ll_register_callbacks cb 0x7f5b740b8260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:22.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.736+0000 7f5b83400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.736+0000 7f5b82a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 0x556b5b8db3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.736+0000 7f5b83400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49392/0 (socket says 172.21.15.100:49392) 2024-02-21T07:56:22.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.736+0000 7f5b83400640 1 -- 172.21.15.100:0/4138504481 learned_addr learned my addr 172.21.15.100:0/4138504481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:22.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.740+0000 7f5b83400640 1 -- 172.21.15.100:0/4138504481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 msgr2=0x556b5b8671d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:22.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.740+0000 7f5b83400640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b8671d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.740+0000 7f5b83400640 1 -- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 msgr2=0x556b5b8db3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:22.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.750+0000 7f5b83400640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 0x556b5b8db3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.750+0000 7f5b83400640 1 -- 172.21.15.100:0/4138504481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c01e040 con 0x556b5b8a0fc0 2024-02-21T07:56:22.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.750+0000 7f5b82a00640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 0x556b5b8db3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:22.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.752+0000 7f5b83400640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b7d40 tx=0x7f5b740e8130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856c6a478bbba392 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:22.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.752+0000 7f5b63e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:22.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.756+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740b83a0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.757+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5b740c0b40 con 0x556b5b8a0fc0 2024-02-21T07:56:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.761+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b740b8aa0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.762+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b740b64e0 con 0x556b5b8a0fc0 2024-02-21T07:56:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.762+0000 7f5b8cd7e740 10 client.7255 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.762+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556b5b791430 con 0x556b5b8a0fc0 2024-02-21T07:56:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.762+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740e5080 con 0x556b5b8a0fc0 2024-02-21T07:56:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b740b4060 con 0x556b5b8a0fc0 2024-02-21T07:56:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 10 client.7255 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 10 client.7255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 20 client.7255 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b939d20 0x556b5b8d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 4 client.7255 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556b5b55c890 con 0x556b5b939d20 2024-02-21T07:56:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.766+0000 7f5b82a00640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b939d20 0x556b5b8d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.768+0000 7f5b82a00640 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b939d20 0x556b5b8d27d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd54f1c9d24ba580 server_cookie=ace49212f0d5346 in_seq=0 out_seq=0 2024-02-21T07:56:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.768+0000 7f5b63e00640 10 client.7255 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.769+0000 7f5b63e00640 1 -- 172.21.15.100:0/4138504481 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556b5b55c890 con 0x556b5b939d20 2024-02-21T07:56:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.769+0000 7f5b63e00640 10 client.7255 handle_command_reply: tid=0 2024-02-21T07:56:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.769+0000 7f5b8cd7e740 1 client.7255 shutdown 2024-02-21T07:56:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.769+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 msgr2=0x556b5b89cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.769+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b7d40 tx=0x7f5b740e8130 comp rx=0 tx=0).stop 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 shutdown_connections 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556b5b939d20 0x556b5b8d27d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556b5b8d6f80 0x556b5b8671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b5b8a18e0 0x556b5b8db3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 --2- 172.21.15.100:0/4138504481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556b5b8a0fc0 0x556b5b89cbf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 >> 172.21.15.100:0/4138504481 conn(0x556b5b8305a0 msgr2=0x556b5b864990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b63e00640 0 client.7255 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 shutdown_connections 2024-02-21T07:56:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.770+0000 7f5b8cd7e740 1 -- 172.21.15.100:0/4138504481 wait complete. 2024-02-21T07:56:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.771+0000 7f5b8cd7e740 20 client.7255 trim_cache size 0 max 16384 2024-02-21T07:56:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:56:22.776 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:56:22.776 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:56:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 msgr2=0x7f5b640a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 0x7f5b640a1630 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5b84070e10 tx=0x7f5b7c003990 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 msgr2=0x7f5b84222bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5b7402c3c0 tx=0x7f5b74001930 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 shutdown_connections 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5b84220cb0 0x7f5b84221130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5b84175090 0x7f5b84223100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5b6409f170 0x7f5b640a1630 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 --2- 172.21.15.100:0/2413366546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b84174cb0 0x7f5b84222bc0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.775+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 >> 172.21.15.100:0/2413366546 conn(0x7f5b840668b0 msgr2=0x7f5b84071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:22.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.778+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 shutdown_connections 2024-02-21T07:56:22.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:22.778+0000 7f5b8a000640 1 -- 172.21.15.100:0/2413366546 wait complete. 2024-02-21T07:56:22.832 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:56:22.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:56:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.200+0000 7fae79c00640 1 Processor -- start 2024-02-21T07:56:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.200+0000 7fae79c00640 1 -- start start 2024-02-21T07:56:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.203+0000 7fae79c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fae740f9800 0x7fae74186510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.203+0000 7fae79c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740cb5d0 con 0x7fae741844e0 2024-02-21T07:56:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.203+0000 7fae79c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7406eec0 con 0x7fae74183f70 2024-02-21T07:56:23.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.203+0000 7fae79c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7406e390 con 0x7fae740f9800 2024-02-21T07:56:23.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.205+0000 7fae72a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fae74183f70 0x7fae7406e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:55762/0 (socket says 172.21.15.100:55762) 2024-02-21T07:56:23.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.205+0000 7fae72a00640 1 -- 172.21.15.100:0/533344908 learned_addr learned my addr 172.21.15.100:0/533344908 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:23.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.206+0000 7fae73400640 1 --2- 172.21.15.100:0/533344908 >> v2:172.21.15.156:3300/0 conn(0x7fae740f9800 0x7fae74186510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.207+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204082724 0 0) 0x7fae7406eec0 con 0x7fae74183f70 2024-02-21T07:56:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.207+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae58003520 con 0x7fae74183f70 2024-02-21T07:56:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.208+0000 7fae73400640 1 -- 172.21.15.100:0/533344908 >> v1:172.21.15.156:6789/0 conn(0x7fae74183f70 legacy=0x7fae7406e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.208+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708370699 0 0) 0x7fae58003520 con 0x7fae74183f70 2024-02-21T07:56:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.208+0000 7fae73400640 1 -- 172.21.15.100:0/533344908 >> v1:172.21.15.100:6789/0 conn(0x7fae741844e0 legacy=0x7fae740f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.208+0000 7fae73400640 1 -- 172.21.15.100:0/533344908 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae740cbb00 con 0x7fae740f9800 2024-02-21T07:56:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.212+0000 7fae73400640 1 --2- 172.21.15.100:0/533344908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae74186510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009d90 tx=0x7fae6c02bb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9c3bf421d9efcd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.212+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae60001670 con 0x7fae740f9800 2024-02-21T07:56:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.213+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c02d690 con 0x7fae740f9800 2024-02-21T07:56:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.213+0000 7fae71600640 1 -- 172.21.15.100:0/533344908 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c02da20 con 0x7fae740f9800 2024-02-21T07:56:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.214+0000 7fae79c00640 1 -- 172.21.15.100:0/533344908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 msgr2=0x7fae74186510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.214+0000 7fae79c00640 1 --2- 172.21.15.100:0/533344908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae74186510 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009d90 tx=0x7fae6c02bb50 comp rx=0 tx=0).stop 2024-02-21T07:56:23.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.215+0000 7fae79c00640 1 -- 172.21.15.100:0/533344908 shutdown_connections 2024-02-21T07:56:23.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.215+0000 7fae79c00640 1 --2- 172.21.15.100:0/533344908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae74186510 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.215+0000 7fae79c00640 1 -- 172.21.15.100:0/533344908 >> 172.21.15.100:0/533344908 conn(0x7fae740ce160 msgr2=0x7fae740ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:23.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.215+0000 7fae79c00640 1 -- 172.21.15.100:0/533344908 shutdown_connections 2024-02-21T07:56:23.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.215+0000 7fae79c00640 1 -- 172.21.15.100:0/533344908 wait complete. 2024-02-21T07:56:23.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.222+0000 7fae79c00640 1 Processor -- start 2024-02-21T07:56:23.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.222+0000 7fae79c00640 1 -- start start 2024-02-21T07:56:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae740c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae74183f70 0x7fae740ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c8820 con 0x7fae741844e0 2024-02-21T07:56:23.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740f4b60 con 0x7fae740f9800 2024-02-21T07:56:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.224+0000 7fae79c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74188eb0 con 0x7fae74183f70 2024-02-21T07:56:23.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.226+0000 7fae73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.226+0000 7fae73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34316/0 (socket says 172.21.15.100:34316) 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.226+0000 7fae73400640 1 -- 172.21.15.100:0/3160979641 learned_addr learned my addr 172.21.15.100:0/3160979641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.227+0000 7fae73400640 1 -- 172.21.15.100:0/3160979641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae74183f70 msgr2=0x7fae740ccc90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.227+0000 7fae73400640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae74183f70 0x7fae740ccc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.227+0000 7fae73400640 1 -- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 msgr2=0x7fae740c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.227+0000 7fae73400640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae740c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.227+0000 7fae73400640 1 -- 172.21.15.100:0/3160979641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009a70 con 0x7fae741844e0 2024-02-21T07:56:23.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.228+0000 7fae73400640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009eb0 tx=0x7fae6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.230+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c03b050 con 0x7fae741844e0 2024-02-21T07:56:23.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.230+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c03c040 con 0x7fae741844e0 2024-02-21T07:56:23.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.230+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c02eea0 con 0x7fae741844e0 2024-02-21T07:56:23.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.233+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74188330 con 0x7fae741844e0 2024-02-21T07:56:23.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.235+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae741888f0 con 0x7fae741844e0 2024-02-21T07:56:23.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.240+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae74067c80 con 0x7fae741844e0 2024-02-21T07:56:23.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.302+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fae6c04b410 con 0x7fae741844e0 2024-02-21T07:56:23.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.304+0000 7fae6aa00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 0x7fae540a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:23.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.305+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fae6c0ecea0 con 0x7fae741844e0 2024-02-21T07:56:23.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.306+0000 7fae72a00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 0x7fae540a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:23.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.307+0000 7fae72a00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 0x7fae540a16e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fae60005880 tx=0x7fae60001020 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:23.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.308+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fae6c0ba7d0 con 0x7fae741844e0 2024-02-21T07:56:23.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.963+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae740f4ca0 con 0x7fae741844e0 2024-02-21T07:56:23.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.966+0000 7fae6aa00640 1 -- 172.21.15.100:0/3160979641 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7fae6c0b8b40 con 0x7fae741844e0 2024-02-21T07:56:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:56:23.969 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:56:23.969 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:56:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 msgr2=0x7fae540a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 0x7fae540a16e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fae60005880 tx=0x7fae60001020 comp rx=0 tx=0).stop 2024-02-21T07:56:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 msgr2=0x7fae741729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fae6c009eb0 tx=0x7fae6c004a40 comp rx=0 tx=0).stop 2024-02-21T07:56:23.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 shutdown_connections 2024-02-21T07:56:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fae5409f220 0x7fae540a16e0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fae60005880 tx=0x7fae60001020 comp rx=0 tx=0).stop 2024-02-21T07:56:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae741844e0 0x7fae741729b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fae74183f70 0x7fae740ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 --2- 172.21.15.100:0/3160979641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae740f9800 0x7fae740c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:23.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.971+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 >> 172.21.15.100:0/3160979641 conn(0x7fae740ce160 msgr2=0x7fae7406f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.973+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 shutdown_connections 2024-02-21T07:56:23.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:23.973+0000 7fae79c00640 1 -- 172.21.15.100:0/3160979641 wait complete. 2024-02-21T07:56:24.034 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:56:24.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:56:24.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.413+0000 7fa7dc600640 1 Processor -- start 2024-02-21T07:56:24.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.413+0000 7fa7dc600640 1 -- start start 2024-02-21T07:56:24.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.416+0000 7fa7dc600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa7d408e630 0x7fa7d4070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.416+0000 7fa7dc600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa7d4070bb0 0x7fa7d4185df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.416+0000 7fa7dc600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40f4760 con 0x7fa7d4186330 2024-02-21T07:56:24.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.416+0000 7fa7dc600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d4185910 con 0x7fa7d408e630 2024-02-21T07:56:24.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.416+0000 7fa7dc600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40f4c90 con 0x7fa7d4070bb0 2024-02-21T07:56:24.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.418+0000 7fa7d9200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa7d4070bb0 0x7fa7d4185df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.418+0000 7fa7da600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa7d4186330 0x7fa7d4187ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45638/0 (socket says 172.21.15.100:45638) 2024-02-21T07:56:24.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.418+0000 7fa7da600640 1 -- 172.21.15.100:0/2699035055 learned_addr learned my addr 172.21.15.100:0/2699035055 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:24.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.419+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/2699035055 >> v2:172.21.15.100:3300/0 conn(0x7fa7d408e630 0x7fa7d4070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.423+0000 7fa7d9c00640 1 -- 172.21.15.100:0/2699035055 >> v2:172.21.15.170:3300/0 conn(0x7fa7d4070bb0 msgr2=0x7fa7d4185df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.423+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/2699035055 >> v2:172.21.15.170:3300/0 conn(0x7fa7d4070bb0 0x7fa7d4185df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.423+0000 7fa7d9c00640 1 -- 172.21.15.100:0/2699035055 >> v1:172.21.15.100:6789/0 conn(0x7fa7d4186330 legacy=0x7fa7d4187ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.423+0000 7fa7d9c00640 1 -- 172.21.15.100:0/2699035055 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40f4f70 con 0x7fa7d408e630 2024-02-21T07:56:24.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.429+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/2699035055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d408e630 0x7fa7d4070670 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40ed8e0 tx=0x7fa7cc030080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6591c882f5f95ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.429+0000 7fa7d3e00640 1 -- 172.21.15.100:0/2699035055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc030db0 con 0x7fa7d408e630 2024-02-21T07:56:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.429+0000 7fa7d3e00640 1 -- 172.21.15.100:0/2699035055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc038440 con 0x7fa7d408e630 2024-02-21T07:56:24.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.430+0000 7fa7d3e00640 1 -- 172.21.15.100:0/2699035055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0387d0 con 0x7fa7d408e630 2024-02-21T07:56:24.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.431+0000 7fa7dc600640 1 -- 172.21.15.100:0/2699035055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d408e630 msgr2=0x7fa7d4070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.431+0000 7fa7dc600640 1 --2- 172.21.15.100:0/2699035055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d408e630 0x7fa7d4070670 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40ed8e0 tx=0x7fa7cc030080 comp rx=0 tx=0).stop 2024-02-21T07:56:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.431+0000 7fa7dc600640 1 -- 172.21.15.100:0/2699035055 shutdown_connections 2024-02-21T07:56:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.431+0000 7fa7dc600640 1 --2- 172.21.15.100:0/2699035055 >> v2:172.21.15.170:3300/0 conn(0x7fa7d4070bb0 0x7fa7d4185df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.432+0000 7fa7dc600640 1 --2- 172.21.15.100:0/2699035055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d408e630 0x7fa7d4070670 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.432+0000 7fa7dc600640 1 -- 172.21.15.100:0/2699035055 >> 172.21.15.100:0/2699035055 conn(0x7fa7d40668b0 msgr2=0x7fa7d4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.432+0000 7fa7dc600640 1 -- 172.21.15.100:0/2699035055 shutdown_connections 2024-02-21T07:56:24.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.432+0000 7fa7dc600640 1 -- 172.21.15.100:0/2699035055 wait complete. 2024-02-21T07:56:24.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.436+0000 7fa7dc600640 1 Processor -- start 2024-02-21T07:56:24.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.436+0000 7fa7dc600640 1 -- start start 2024-02-21T07:56:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 0x7fa7d4187b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d4186330 0x7fa7d41880c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d41876f0 con 0x7fa7d4070bb0 2024-02-21T07:56:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40f8390 con 0x7fa7d408e630 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.438+0000 7fa7dc600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d4186800 con 0x7fa7d4186330 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 0x7fa7d4187b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34336/0 (socket says 172.21.15.100:34336) 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 0x7fa7d4187b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49418/0 (socket says 172.21.15.100:49418) 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1750912775 learned_addr learned my addr 172.21.15.100:0/1750912775 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.439+0000 7fa7da600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d4186330 0x7fa7d41880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1750912775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d4186330 msgr2=0x7fa7d41880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d4186330 0x7fa7d41880c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 msgr2=0x7fa7d4187b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 0x7fa7d4187b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1750912775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009a70 con 0x7fa7d4070bb0 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.440+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009e80 tx=0x7fa7cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.441+0000 7fa7d1600640 1 -- 172.21.15.100:0/1750912775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc010070 con 0x7fa7d4070bb0 2024-02-21T07:56:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.441+0000 7fa7d1600640 1 -- 172.21.15.100:0/1750912775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc043660 con 0x7fa7d4070bb0 2024-02-21T07:56:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.442+0000 7fa7d1600640 1 -- 172.21.15.100:0/1750912775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc010070 con 0x7fa7d4070bb0 2024-02-21T07:56:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.442+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d4186ae0 con 0x7fa7d4070bb0 2024-02-21T07:56:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.443+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d41870a0 con 0x7fa7d4070bb0 2024-02-21T07:56:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.450+0000 7fa7d1600640 1 -- 172.21.15.100:0/1750912775 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa7cc0437d0 con 0x7fa7d4070bb0 2024-02-21T07:56:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.451+0000 7fa7df3ab740 1 Processor -- start 2024-02-21T07:56:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.452+0000 7fa7df3ab740 1 -- start start 2024-02-21T07:56:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.452+0000 7fa7d1600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 0x7fa7b40a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.453+0000 7fa7d1600640 1 -- 172.21.15.100:0/1750912775 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa7cc0eb7f0 con 0x7fa7d4070bb0 2024-02-21T07:56:24.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.453+0000 7fa7da600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 0x7fa7b40a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7da600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 0x7fa7b40a1640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0007ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb86050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 0x55fabdb87320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabda7e210 con 0x55fabdb4b7e0 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabda7b740 con 0x55fabdb4aec0 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.454+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabda76f20 con 0x55fabdb86590 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.455+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.455+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49434/0 (socket says 172.21.15.100:49434) 2024-02-21T07:56:24.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.455+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1302780367 learned_addr learned my addr 172.21.15.100:0/1302780367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.455+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb86050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1302780367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 msgr2=0x55fabdb87320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7da600640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 0x55fabdb87320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 0x55fabdb87320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1302780367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 msgr2=0x55fabdb86050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb86050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1302780367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fabda38df0 con 0x55fabdb4aec0 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7da600640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 0x55fabdb87320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.456+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb86050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.457+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0c1540 tx=0x7fa7cc009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28e5a22754879d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.458+0000 7fa7c6000640 1 -- 172.21.15.100:0/1302780367 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0b9360 con 0x55fabdb4aec0 2024-02-21T07:56:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.458+0000 7fa7c6000640 1 -- 172.21.15.100:0/1302780367 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc0bd4b0 con 0x55fabdb4aec0 2024-02-21T07:56:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.458+0000 7fa7c6000640 1 -- 172.21.15.100:0/1302780367 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0c1a70 con 0x55fabdb4aec0 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1302780367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 msgr2=0x55fabdb4b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc0c1540 tx=0x7fa7cc009750 comp rx=0 tx=0).stop 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1302780367 shutdown_connections 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb86590 0x55fabdb87320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb86050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1302780367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4aec0 0x55fabdb4b2a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1302780367 >> 172.21.15.100:0/1302780367 conn(0x55fabdb0d490 msgr2=0x55fabdb0e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1302780367 shutdown_connections 2024-02-21T07:56:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.459+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1302780367 wait complete. 2024-02-21T07:56:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.460+0000 7fa7df3ab740 1 -- start start 2024-02-21T07:56:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.461+0000 7fa7df3ab740 1 Processor -- start 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 0x55fabdb49f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 0x55fabdb41500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb40b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabda1c150 con 0x55fabdb86590 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabda1bdf0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabd7e51c0 con 0x55fabdb39580 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7df3ab740 10 client.0 _ll_register_callbacks cb 0x55fabda6b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 0x55fabdb49f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 0x55fabdb49f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49436/0 (socket says 172.21.15.100:49436) 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7d9c00640 1 -- 172.21.15.100:0/1337153521 learned_addr learned my addr 172.21.15.100:0/1337153521 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.463+0000 7fa7da600640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb40b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 0x55fabdb41500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7da600640 1 -- 172.21.15.100:0/1337153521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 msgr2=0x55fabdb49f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7da600640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 0x55fabdb49f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7da600640 1 -- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 msgr2=0x55fabdb41500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7da600640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 0x55fabdb41500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7da600640 1 -- 172.21.15.100:0/1337153521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d41870a0 con 0x55fabdb39580 2024-02-21T07:56:24.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.464+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 0x55fabdb41500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.465+0000 7fa7da600640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb40b90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0001d00 tx=0x7fa7c0011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad16ce763440ced8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.465+0000 7fa7baa00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:24.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.466+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0015e50 con 0x55fabdb39580 2024-02-21T07:56:24.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.467+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa7c0022430 con 0x55fabdb39580 2024-02-21T07:56:24.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.467+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fabd7767e0 con 0x55fabdb39580 2024-02-21T07:56:24.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.468+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c00225f0 con 0x55fabdb39580 2024-02-21T07:56:24.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.468+0000 7fa7df3ab740 10 client.7175 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:24.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.468+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fabda755a0 con 0x55fabdb39580 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.469+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fabd7767e0 con 0x55fabdb39580 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa7c0029020 con 0x55fabdb39580 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 10 client.7175 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 10 client.7175 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 20 client.7175 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:24.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdb410d0 0x55fabdb0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 4 client.7175 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fabd7b3720 con 0x55fabdb410d0 2024-02-21T07:56:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.470+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdb410d0 0x55fabdb0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.472+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdb410d0 0x55fabdb0b640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7b48dbc56b875e4b server_cookie=b2dd9597979c88f4 in_seq=0 out_seq=0 2024-02-21T07:56:24.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.472+0000 7fa7baa00640 10 client.7175 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:56:24.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.473+0000 7fa7baa00640 1 -- 172.21.15.100:0/1337153521 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fabd7b3720 con 0x55fabdb410d0 2024-02-21T07:56:24.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.473+0000 7fa7baa00640 10 client.7175 handle_command_reply: tid=0 2024-02-21T07:56:24.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.473+0000 7fa7df3ab740 1 client.7175 shutdown 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 msgr2=0x55fabdb40b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb40b90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0001d00 tx=0x7fa7c0011000 comp rx=0 tx=0).stop 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 shutdown_connections 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdb410d0 0x55fabdb0b640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb40b90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb86590 0x55fabdb41500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1337153521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb4b7e0 0x55fabdb49f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 >> 172.21.15.100:0/1337153521 conn(0x55fabdb4aec0 msgr2=0x55fabdb0ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.474+0000 7fa7baa00640 0 client.7175 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.475+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 shutdown_connections 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.475+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1337153521 wait complete. 2024-02-21T07:56:24.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.475+0000 7fa7df3ab740 20 client.7175 trim_cache size 0 max 16384 2024-02-21T07:56:24.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.504+0000 7fa7df3ab740 1 Processor -- start 2024-02-21T07:56:24.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.505+0000 7fa7df3ab740 1 -- start start 2024-02-21T07:56:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 0x55fabdb0cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 0x55fabdb0e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb0ed80 con 0x55fabdb39580 2024-02-21T07:56:24.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb3d390 con 0x55fabdb86590 2024-02-21T07:56:24.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.509+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb50c80 con 0x55fabdb4b7e0 2024-02-21T07:56:24.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.510+0000 7fa7da600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.511+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 0x55fabdb0e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.511+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 0x55fabdb0e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47208/0 (socket says 172.21.15.100:47208) 2024-02-21T07:56:24.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.511+0000 7fa7d9200640 1 -- 172.21.15.100:0/3180323688 learned_addr learned my addr 172.21.15.100:0/3180323688 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:24.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.511+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 0x55fabdb0cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.513+0000 7fa7da600640 1 -- 172.21.15.100:0/3180323688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 msgr2=0x55fabdb0e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.513+0000 7fa7da600640 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 0x55fabdb0e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.513+0000 7fa7da600640 1 -- 172.21.15.100:0/3180323688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 msgr2=0x55fabdb0cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.515+0000 7fa7da600640 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 0x55fabdb0cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.515+0000 7fa7da600640 1 -- 172.21.15.100:0/3180323688 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fabda11ab0 con 0x55fabdb86590 2024-02-21T07:56:24.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.515+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 0x55fabdb0cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:24.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.516+0000 7fa7da600640 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb778d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0017010 tx=0x7fa7c0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8632121e6c6f69 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.516+0000 7fa7c5600640 1 -- 172.21.15.100:0/3180323688 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0015ca0 con 0x55fabdb86590 2024-02-21T07:56:24.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.516+0000 7fa7c5600640 1 -- 172.21.15.100:0/3180323688 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c001b050 con 0x55fabdb86590 2024-02-21T07:56:24.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.516+0000 7fa7c5600640 1 -- 172.21.15.100:0/3180323688 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0022670 con 0x55fabdb86590 2024-02-21T07:56:24.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 -- 172.21.15.100:0/3180323688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 msgr2=0x55fabdb778d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb778d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0017010 tx=0x7fa7c0013000 comp rx=0 tx=0).stop 2024-02-21T07:56:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 -- 172.21.15.100:0/3180323688 shutdown_connections 2024-02-21T07:56:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb778d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb4b7e0 0x55fabdb0e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/3180323688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb39580 0x55fabdb0cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.518+0000 7fa7df3ab740 1 -- 172.21.15.100:0/3180323688 >> 172.21.15.100:0/3180323688 conn(0x55fabdb4aec0 msgr2=0x55fabdb40980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.519+0000 7fa7df3ab740 1 -- 172.21.15.100:0/3180323688 shutdown_connections 2024-02-21T07:56:24.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.520+0000 7fa7df3ab740 1 -- 172.21.15.100:0/3180323688 wait complete. 2024-02-21T07:56:24.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.521+0000 7fa7df3ab740 1 -- start start 2024-02-21T07:56:24.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.521+0000 7fa7df3ab740 1 Processor -- start 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb56c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb08e00 con 0x55fabdb4b7e0 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb13ef0 con 0x55fabdb86590 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fabdb81ad0 con 0x55fabdb39580 2024-02-21T07:56:24.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.523+0000 7fa7df3ab740 10 client.0 _ll_register_callbacks cb 0x7fa7cc0305a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:24.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.524+0000 7fa7d9c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.525+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.525+0000 7fa7d9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34370/0 (socket says 172.21.15.100:34370) 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.525+0000 7fa7d9200640 1 -- 172.21.15.100:0/1907980092 learned_addr learned my addr 172.21.15.100:0/1907980092 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.525+0000 7fa7da600640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb56c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 -- 172.21.15.100:0/1907980092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 msgr2=0x55fabdb094f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 -- 172.21.15.100:0/1907980092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 msgr2=0x55fabdb56c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:24.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb56c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 -- 172.21.15.100:0/1907980092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fabda38df0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.526+0000 7fa7d9200640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800bfd0 tx=0x7fa7c8013900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b73e70ffed2fd3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:24.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.527+0000 7fa7baa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:56:24.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.527+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8018040 con 0x55fabdb4b7e0 2024-02-21T07:56:24.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.527+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa7c8010700 con 0x55fabdb4b7e0 2024-02-21T07:56:24.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.527+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7cc0bd4b0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.528+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c80132e0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.531+0000 7fa7df3ab740 10 client.7089 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:24.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.531+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fabda755a0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.532+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc0bd4b0 con 0x55fabdb4b7e0 2024-02-21T07:56:24.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa7c8025070 con 0x55fabdb4b7e0 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 10 client.7089 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 10 client.7089 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 20 client.7089 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdbde990 0x55fabdb85d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 4 client.7089 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:56:24.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.541+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fabd802890 con 0x55fabdbde990 2024-02-21T07:56:24.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.545+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdbde990 0x55fabdb85d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:24.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.556+0000 7fa7baa00640 10 client.7089 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.556+0000 7fa7d9c00640 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdbde990 0x55fabdb85d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdc28e7169241125 server_cookie=4a86d231888969da in_seq=0 out_seq=0 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.557+0000 7fa7baa00640 1 -- 172.21.15.100:0/1907980092 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fabd802890 con 0x55fabdbde990 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.557+0000 7fa7baa00640 10 client.7089 handle_command_reply: tid=0 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.557+0000 7fa7df3ab740 1 client.7089 shutdown 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 msgr2=0x55fabdb36420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800bfd0 tx=0x7fa7c8013900 comp rx=0 tx=0).stop 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 shutdown_connections 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fabdbde990 0x55fabdb85d90 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fabdb86590 0x55fabdb56c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fabdb4b7e0 0x55fabdb36420 secure :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800bfd0 tx=0x7fa7c8013900 comp rx=0 tx=0).stop 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 --2- 172.21.15.100:0/1907980092 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fabdb39580 0x55fabdb094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 >> 172.21.15.100:0/1907980092 conn(0x55fabdb4aec0 msgr2=0x55fabdba0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.558+0000 7fa7baa00640 0 client.7089 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:56:24.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.559+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 shutdown_connections 2024-02-21T07:56:24.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.560+0000 7fa7df3ab740 1 -- 172.21.15.100:0/1907980092 wait complete. 2024-02-21T07:56:24.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.561+0000 7fa7df3ab740 20 client.7089 trim_cache size 0 max 16384 2024-02-21T07:56:24.563 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:56:24.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.565+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 msgr2=0x7fa7b40a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.565+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 0x7fa7b40a1640 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0007fd0 tx=0x7fa7c0007ba0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.566+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 msgr2=0x7fa7d4169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009e80 tx=0x7fa7cc004a40 comp rx=0 tx=0).stop 2024-02-21T07:56:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 shutdown_connections 2024-02-21T07:56:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7d4186330 0x7fa7d41880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7d408e630 0x7fa7d4187b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa7b409f180 0x7fa7b40a1640 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 --2- 172.21.15.100:0/1750912775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4070bb0 0x7fa7d4169900 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:24.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 >> 172.21.15.100:0/1750912775 conn(0x7fa7d40668b0 msgr2=0x7fa7d4174c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:24.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 shutdown_connections 2024-02-21T07:56:24.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:24.570+0000 7fa7dc600640 1 -- 172.21.15.100:0/1750912775 wait complete. 2024-02-21T07:56:24.636 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:56:24.636 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:56:25.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.000+0000 7f0f5b400640 1 Processor -- start 2024-02-21T07:56:25.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.001+0000 7f0f5b400640 1 -- start start 2024-02-21T07:56:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.006+0000 7f0f5b400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f0f54070a30 0x7f0f5406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.006+0000 7f0f5b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 0x7f0f54190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.006+0000 7f0f5b400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5418dc80 con 0x7f0f54190260 2024-02-21T07:56:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.006+0000 7f0f5b400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5406f060 con 0x7f0f5406ebf0 2024-02-21T07:56:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.006+0000 7f0f5b400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540f5b90 con 0x7f0f54070a30 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.007+0000 7f0f58a00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f0f54190260 0x7f0f540f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:49844/0 (socket says 172.21.15.100:49844) 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.007+0000 7f0f58a00640 1 -- 172.21.15.100:0/3830842981 learned_addr learned my addr 172.21.15.100:0/3830842981 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.007+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3830842981 >> v2:172.21.15.156:3300/0 conn(0x7f0f54070a30 0x7f0f5406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.008+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168312277 0 0) 0x7f0f5418dc80 con 0x7f0f54190260 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.008+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f3c003520 con 0x7f0f54190260 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.008+0000 7f0f53e00640 1 -- 172.21.15.100:0/3830842981 >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 msgr2=0x7f0f54190640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.008+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972102288 0 0) 0x7f0f3c003520 con 0x7f0f54190260 2024-02-21T07:56:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.009+0000 7f0f59400640 1 --2- 172.21.15.100:0/3830842981 >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 0x7f0f54190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.012+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3830842981 >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 0x7f0f54190640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.012+0000 7f0f53e00640 1 -- 172.21.15.100:0/3830842981 >> v1:172.21.15.170:6789/0 conn(0x7f0f54190260 legacy=0x7f0f540f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.012+0000 7f0f53e00640 1 -- 172.21.15.100:0/3830842981 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540f55d0 con 0x7f0f54070a30 2024-02-21T07:56:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.016+0000 7f0f59400640 1 --2- 172.21.15.100:0/3830842981 >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 0x7f0f54190640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.016+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3830842981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f54070a30 0x7f0f5406e6b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f5408d410 tx=0x7f0f4002b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657995180c721145 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.018+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4002bea0 con 0x7f0f54070a30 2024-02-21T07:56:25.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.018+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4002e050 con 0x7f0f54070a30 2024-02-21T07:56:25.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.018+0000 7f0f53400640 1 -- 172.21.15.100:0/3830842981 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48001670 con 0x7f0f54070a30 2024-02-21T07:56:25.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.021+0000 7f0f5b400640 1 -- 172.21.15.100:0/3830842981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f54070a30 msgr2=0x7f0f5406e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.021+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3830842981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f54070a30 0x7f0f5406e6b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0f5408d410 tx=0x7f0f4002b6a0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 -- 172.21.15.100:0/3830842981 shutdown_connections 2024-02-21T07:56:25.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3830842981 >> v2:172.21.15.100:3300/0 conn(0x7f0f5406ebf0 0x7f0f54190640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3830842981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f54070a30 0x7f0f5406e6b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 -- 172.21.15.100:0/3830842981 >> 172.21.15.100:0/3830842981 conn(0x7f0f540668b0 msgr2=0x7f0f54066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 -- 172.21.15.100:0/3830842981 shutdown_connections 2024-02-21T07:56:25.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.024+0000 7f0f5b400640 1 -- 172.21.15.100:0/3830842981 wait complete. 2024-02-21T07:56:25.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.028+0000 7f0f5b400640 1 Processor -- start 2024-02-21T07:56:25.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.028+0000 7f0f5b400640 1 -- start start 2024-02-21T07:56:25.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.030+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5406ebf0 0x7f0f54172010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f54070a30 0x7f0f54187d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f5b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f5b400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541886d0 con 0x7f0f54190260 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f5b400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541889b0 con 0x7f0f5406ebf0 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f5b400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54188c90 con 0x7f0f54070a30 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f59400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.031+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5406ebf0 0x7f0f54172010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34390/0 (socket says 172.21.15.100:34390) 2024-02-21T07:56:25.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 -- 172.21.15.100:0/3013895853 learned_addr learned my addr 172.21.15.100:0/3013895853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f54070a30 0x7f0f54187d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 -- 172.21.15.100:0/3013895853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f54070a30 msgr2=0x7f0f54187d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f54070a30 0x7f0f54187d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 -- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5406ebf0 msgr2=0x7f0f54172010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5406ebf0 0x7f0f54172010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.032+0000 7f0f59400640 1 -- 172.21.15.100:0/3013895853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40009400 con 0x7f0f54190260 2024-02-21T07:56:25.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.033+0000 7f0f59400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00cd50 tx=0x7f0f4c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.035+0000 7f0f50c00640 1 -- 172.21.15.100:0/3013895853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00f680 con 0x7f0f54190260 2024-02-21T07:56:25.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.035+0000 7f0f50c00640 1 -- 172.21.15.100:0/3013895853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00f800 con 0x7f0f54190260 2024-02-21T07:56:25.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.035+0000 7f0f50c00640 1 -- 172.21.15.100:0/3013895853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00fbb0 con 0x7f0f54190260 2024-02-21T07:56:25.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.035+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f540cbdd0 con 0x7f0f54190260 2024-02-21T07:56:25.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.035+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540cc390 con 0x7f0f54190260 2024-02-21T07:56:25.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.045+0000 7f0f50c00640 1 -- 172.21.15.100:0/3013895853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0f4c00b040 con 0x7f0f54190260 2024-02-21T07:56:25.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.047+0000 7f0f50c00640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 0x7f0f340a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.047+0000 7f0f50c00640 1 -- 172.21.15.100:0/3013895853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0f4c0ca560 con 0x7f0f54190260 2024-02-21T07:56:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.049+0000 7f0f58a00640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 0x7f0f340a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.050+0000 7f0f58a00640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 0x7f0f340a16e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f480011e0 tx=0x7f0f48009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.057+0000 7f0f5e06b740 1 Processor -- start 2024-02-21T07:56:25.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.057+0000 7f0f5e06b740 1 -- start start 2024-02-21T07:56:25.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacb3ec0 0x55bacacb42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacef590 0x55bacacf0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacabe7210 con 0x55bacacb47e0 2024-02-21T07:56:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacabe4740 con 0x55bacacb3ec0 2024-02-21T07:56:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacabdff20 con 0x55bacacef590 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34392/0 (socket says 172.21.15.100:34392) 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f53e00640 1 -- 172.21.15.100:0/2295111651 learned_addr learned my addr 172.21.15.100:0/2295111651 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.058+0000 7f0f59400640 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacef590 0x55bacacf0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f58a00640 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacb3ec0 0x55bacacb42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f53e00640 1 -- 172.21.15.100:0/2295111651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacef590 msgr2=0x55bacacf0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f53e00640 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacef590 0x55bacacf0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f53e00640 1 -- 172.21.15.100:0/2295111651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacb3ec0 msgr2=0x55bacacb42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f53e00640 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacb3ec0 0x55bacacb42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.059+0000 7f0f53e00640 1 -- 172.21.15.100:0/2295111651 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bacaba1df0 con 0x55bacacb47e0 2024-02-21T07:56:25.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.060+0000 7f0f53e00640 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0f4002bcb0 tx=0x7f0f4002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8177a265a4b1322f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.062+0000 7f0f45200640 1 -- 172.21.15.100:0/2295111651 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400307d0 con 0x55bacacb47e0 2024-02-21T07:56:25.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.062+0000 7f0f45200640 1 -- 172.21.15.100:0/2295111651 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f40030930 con 0x55bacacb47e0 2024-02-21T07:56:25.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.062+0000 7f0f45200640 1 -- 172.21.15.100:0/2295111651 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400307d0 con 0x55bacacb47e0 2024-02-21T07:56:25.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.063+0000 7f0f5e06b740 1 -- 172.21.15.100:0/2295111651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 msgr2=0x55bacacef050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.063+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0f4002bcb0 tx=0x7f0f4002f000 comp rx=0 tx=0).stop 2024-02-21T07:56:25.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.065+0000 7f0f5e06b740 1 -- 172.21.15.100:0/2295111651 shutdown_connections 2024-02-21T07:56:25.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.065+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacef590 0x55bacacf0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.066+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacef050 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.066+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/2295111651 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacb3ec0 0x55bacacb42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.067+0000 7f0f5e06b740 1 -- 172.21.15.100:0/2295111651 >> 172.21.15.100:0/2295111651 conn(0x55bacac76490 msgr2=0x55bacac77510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.068+0000 7f0f5e06b740 1 -- 172.21.15.100:0/2295111651 shutdown_connections 2024-02-21T07:56:25.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.068+0000 7f0f5e06b740 1 -- 172.21.15.100:0/2295111651 wait complete. 2024-02-21T07:56:25.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.070+0000 7f0f5e06b740 1 -- start start 2024-02-21T07:56:25.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.070+0000 7f0f5e06b740 1 Processor -- start 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 0x55bacaca1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacae0f0 0x55bacacaaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacab85150 con 0x55bacacef590 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacab84df0 con 0x55bacacae0f0 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baca94e1c0 con 0x55bacacb47e0 2024-02-21T07:56:25.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.073+0000 7f0f5e06b740 10 client.0 _ll_register_callbacks cb 0x55bacabd42b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:25.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.074+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.074+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47240/0 (socket says 172.21.15.100:47240) 2024-02-21T07:56:25.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.074+0000 7f0f58a00640 1 -- 172.21.15.100:0/3183831514 learned_addr learned my addr 172.21.15.100:0/3183831514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.074+0000 7f0f59400640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacae0f0 0x55bacacaaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.074+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 0x55bacaca1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.075+0000 7f0f58a00640 1 -- 172.21.15.100:0/3183831514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacae0f0 msgr2=0x55bacacaaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.075+0000 7f0f58a00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacae0f0 0x55bacacaaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.075+0000 7f0f58a00640 1 -- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 msgr2=0x55bacaca1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.075+0000 7f0f58a00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 0x55bacaca1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.075+0000 7f0f58a00640 1 -- 172.21.15.100:0/3183831514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540f55d0 con 0x55bacacb47e0 2024-02-21T07:56:25.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.076+0000 7f0f58a00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005f50 tx=0x7f0f48001510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ebccb9dfef75a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.076+0000 7f0f39600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:25.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.076+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 0x55bacaca1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:25.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.076+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800ecb0 con 0x55bacacb47e0 2024-02-21T07:56:25.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.076+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0f4800ee10 con 0x55bacacb47e0 2024-02-21T07:56:25.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.078+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baca8df7e0 con 0x55bacacb47e0 2024-02-21T07:56:25.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.080+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f48013420 con 0x55bacacb47e0 2024-02-21T07:56:25.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.080+0000 7f0f5e06b740 10 client.7190 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:25.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.080+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bacabde5a0 con 0x55bacacb47e0 2024-02-21T07:56:25.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.083+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55baca8df7e0 con 0x55bacacb47e0 2024-02-21T07:56:25.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.083+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f4802a070 con 0x55bacacb47e0 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 10 client.7190 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 10 client.7190 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 20 client.7190 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacacaa180 0x55bacacec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 4 client.7190 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:25.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.084+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baca91c720 con 0x55bacacaa180 2024-02-21T07:56:25.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.085+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacacaa180 0x55bacacec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.086+0000 7f0f53e00640 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacacaa180 0x55bacacec7d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c936673500968e9 server_cookie=4cb49f5719c0e96d in_seq=0 out_seq=0 2024-02-21T07:56:25.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.086+0000 7f0f39600640 10 client.7190 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:56:25.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.087+0000 7f0f39600640 1 -- 172.21.15.100:0/3183831514 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55baca91c720 con 0x55bacacaa180 2024-02-21T07:56:25.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.087+0000 7f0f39600640 10 client.7190 handle_command_reply: tid=0 2024-02-21T07:56:25.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.087+0000 7f0f5e06b740 1 client.7190 shutdown 2024-02-21T07:56:25.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.087+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 msgr2=0x55bacaca71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005f50 tx=0x7f0f48001510 comp rx=0 tx=0).stop 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 shutdown_connections 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacacaa180 0x55bacacec7d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacae0f0 0x55bacacaaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacef590 0x55bacaca1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/3183831514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacb47e0 0x55bacaca71d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 >> 172.21.15.100:0/3183831514 conn(0x55bacacb3ec0 msgr2=0x55bacac77f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f39600640 0 client.7190 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:56:25.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 shutdown_connections 2024-02-21T07:56:25.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 1 -- 172.21.15.100:0/3183831514 wait complete. 2024-02-21T07:56:25.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.088+0000 7f0f5e06b740 20 client.7190 trim_cache size 0 max 16384 2024-02-21T07:56:25.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.160+0000 7f0f5e06b740 1 Processor -- start 2024-02-21T07:56:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.160+0000 7f0f5e06b740 1 -- start start 2024-02-21T07:56:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.166+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.166+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.168+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.168+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47242/0 (socket says 172.21.15.100:47242) 2024-02-21T07:56:25.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.168+0000 7f0f58a00640 1 -- 172.21.15.100:0/1897101187 learned_addr learned my addr 172.21.15.100:0/1897101187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.169+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacad18b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.169+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacac6e6e0 con 0x55bacacb47e0 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.169+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacaca9830 con 0x55bacacef590 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.169+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacacaacf0 con 0x55bacacae0f0 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.170+0000 7f0f53e00640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.170+0000 7f0f59400640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacad18b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.171+0000 7f0f58a00640 1 -- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 msgr2=0x55bacad18b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.171+0000 7f0f58a00640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacad18b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.171+0000 7f0f58a00640 1 -- 172.21.15.100:0/1897101187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 msgr2=0x55bacacedd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.171+0000 7f0f58a00640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacedd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.171+0000 7f0f58a00640 1 -- 172.21.15.100:0/1897101187 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bacab7aab0 con 0x55bacacae0f0 2024-02-21T07:56:25.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.172+0000 7f0f59400640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacad18b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:25.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.172+0000 7f0f53e00640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:25.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.176+0000 7f0f58a00640 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800e720 tx=0x7f0f4801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5f5bf4ab9fb2ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.176+0000 7f0f3be00640 1 -- 172.21.15.100:0/1897101187 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48013420 con 0x55bacacae0f0 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.177+0000 7f0f3be00640 1 -- 172.21.15.100:0/1897101187 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f48001660 con 0x55bacacae0f0 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.177+0000 7f0f3be00640 1 -- 172.21.15.100:0/1897101187 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48013420 con 0x55bacacae0f0 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.178+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 msgr2=0x55bacaca92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.178+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800e720 tx=0x7f0f4801f000 comp rx=0 tx=0).stop 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.181+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 shutdown_connections 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.181+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacad18b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.181+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacacedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.181+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/1897101187 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacaca92f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.181+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 >> 172.21.15.100:0/1897101187 conn(0x55bacacb3ec0 msgr2=0x55bacac74270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.183+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 shutdown_connections 2024-02-21T07:56:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.183+0000 7f0f5e06b740 1 -- 172.21.15.100:0/1897101187 wait complete. 2024-02-21T07:56:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.190+0000 7f0f5e06b740 1 -- start start 2024-02-21T07:56:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.190+0000 7f0f5e06b740 1 Processor -- start 2024-02-21T07:56:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.194+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.194+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacaca1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.194+0000 7f0f5e06b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacac7eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.195+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacac9b200 con 0x55bacacb47e0 2024-02-21T07:56:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.195+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacacfacd0 con 0x55bacacef590 2024-02-21T07:56:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.195+0000 7f0f5e06b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bacacee4d0 con 0x55bacacae0f0 2024-02-21T07:56:25.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.195+0000 7f0f5e06b740 10 client.0 _ll_register_callbacks cb 0x7f0f40035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.196+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.196+0000 7f0f58a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47250/0 (socket says 172.21.15.100:47250) 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.196+0000 7f0f58a00640 1 -- 172.21.15.100:0/179662272 learned_addr learned my addr 172.21.15.100:0/179662272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.197+0000 7f0f58a00640 1 -- 172.21.15.100:0/179662272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 msgr2=0x55bacac7eb70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.197+0000 7f0f58a00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacac7eb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.197+0000 7f0f58a00640 1 -- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 msgr2=0x55bacaca1a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:25.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.197+0000 7f0f53e00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacaca1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.198+0000 7f0f58a00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacaca1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.198+0000 7f0f58a00640 1 -- 172.21.15.100:0/179662272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540cc390 con 0x55bacacae0f0 2024-02-21T07:56:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.200+0000 7f0f39600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:25.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.200+0000 7f0f58a00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005970 tx=0x7f0f48007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab5b5086c29cd756 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.212+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800ee40 con 0x55bacacae0f0 2024-02-21T07:56:25.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.212+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0f48013630 con 0x55bacacae0f0 2024-02-21T07:56:25.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.215+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f40030930 con 0x55bacacae0f0 2024-02-21T07:56:25.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.216+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f48013950 con 0x55bacacae0f0 2024-02-21T07:56:25.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.216+0000 7f0f5e06b740 10 client.7196 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:25.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.216+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bacabde5a0 con 0x55bacacae0f0 2024-02-21T07:56:25.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.216+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f40030930 con 0x55bacacae0f0 2024-02-21T07:56:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0f4802a070 con 0x55bacacae0f0 2024-02-21T07:56:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 10 client.7196 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 10 client.7196 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:56:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 20 client.7196 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacad002d0 0x55bacad572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 4 client.7196 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:56:25.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.217+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baca96b890 con 0x55bacad002d0 2024-02-21T07:56:25.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.225+0000 7f0f53e00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacad002d0 0x55bacad572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.233+0000 7f0f53e00640 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacad002d0 0x55bacad572f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60be228342a0ae58 server_cookie=e2bf67bd7d6db000 in_seq=0 out_seq=0 2024-02-21T07:56:25.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.233+0000 7f0f39600640 10 client.7196 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.244+0000 7f0f39600640 1 -- 172.21.15.100:0/179662272 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55baca96b890 con 0x55bacad002d0 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.244+0000 7f0f39600640 10 client.7196 handle_command_reply: tid=0 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.244+0000 7f0f5e06b740 1 client.7196 shutdown 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 msgr2=0x55bacacb42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0f48005970 tx=0x7f0f48007000 comp rx=0 tx=0).stop 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 shutdown_connections 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x55bacad002d0 0x55bacad572f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f39600640 0 client.7196 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:56:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bacacef590 0x55bacac7eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55bacacb47e0 0x55bacaca1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 --2- 172.21.15.100:0/179662272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55bacacae0f0 0x55bacacb42a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.245+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 >> 172.21.15.100:0/179662272 conn(0x55bacacb3ec0 msgr2=0x55bacad18d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.248+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 shutdown_connections 2024-02-21T07:56:25.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.250+0000 7f0f5e06b740 1 -- 172.21.15.100:0/179662272 wait complete. 2024-02-21T07:56:25.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.251+0000 7f0f5e06b740 20 client.7196 trim_cache size 0 max 16384 2024-02-21T07:56:25.256 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 msgr2=0x7f0f340a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 0x7f0f340a16e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f480011e0 tx=0x7f0f48009040 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 msgr2=0x7f0f540ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00cd50 tx=0x7f0f4c00a650 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 shutdown_connections 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0f3409f220 0x7f0f340a16e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f54190260 0x7f0f540ccb90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0f54070a30 0x7f0f54187d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 --2- 172.21.15.100:0/3013895853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0f5406ebf0 0x7f0f54172010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 >> 172.21.15.100:0/3013895853 conn(0x7f0f540668b0 msgr2=0x7f0f5406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 shutdown_connections 2024-02-21T07:56:25.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.255+0000 7f0f5b400640 1 -- 172.21.15.100:0/3013895853 wait complete. 2024-02-21T07:56:25.296 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:56:25.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:56:25.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.664+0000 7fca45600640 1 Processor -- start 2024-02-21T07:56:25.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.665+0000 7fca45600640 1 -- start start 2024-02-21T07:56:25.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.673+0000 7fca45600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fca4017b5a0 0x7fca4006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.673+0000 7fca45600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca400673d0 0x7fca4006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.673+0000 7fca45600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca400700c0 con 0x7fca40186920 2024-02-21T07:56:25.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.674+0000 7fca45600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca40072020 con 0x7fca400673d0 2024-02-21T07:56:25.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.674+0000 7fca45600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4006ea40 con 0x7fca4017b5a0 2024-02-21T07:56:25.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.676+0000 7fca3e000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca400673d0 0x7fca4006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.676+0000 7fca3e000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fca400673d0 0x7fca4006f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49484/0 (socket says 172.21.15.100:49484) 2024-02-21T07:56:25.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.676+0000 7fca3e000640 1 -- 172.21.15.100:0/2396333623 learned_addr learned my addr 172.21.15.100:0/2396333623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.677+0000 7fca3ea00640 1 --2- 172.21.15.100:0/2396333623 >> v2:172.21.15.170:3300/0 conn(0x7fca4017b5a0 0x7fca4006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.678+0000 7fca3e000640 1 -- 172.21.15.100:0/2396333623 >> v2:172.21.15.170:3300/0 conn(0x7fca4017b5a0 msgr2=0x7fca4006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.678+0000 7fca3e000640 1 --2- 172.21.15.100:0/2396333623 >> v2:172.21.15.170:3300/0 conn(0x7fca4017b5a0 0x7fca4006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.678+0000 7fca3e000640 1 -- 172.21.15.100:0/2396333623 >> v1:172.21.15.156:6789/0 conn(0x7fca40186920 legacy=0x7fca40186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.678+0000 7fca3e000640 1 -- 172.21.15.100:0/2396333623 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400703a0 con 0x7fca400673d0 2024-02-21T07:56:25.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.680+0000 7fca3e000640 1 --2- 172.21.15.100:0/2396333623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca400673d0 0x7fca4006f7c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fca4008d350 tx=0x7fca2c02fe70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f492d9a1d7eb6e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.687+0000 7fca3d600640 1 -- 172.21.15.100:0/2396333623 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c030c20 con 0x7fca400673d0 2024-02-21T07:56:25.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.687+0000 7fca3d600640 1 -- 172.21.15.100:0/2396333623 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c030d80 con 0x7fca400673d0 2024-02-21T07:56:25.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.687+0000 7fca3d600640 1 -- 172.21.15.100:0/2396333623 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c038660 con 0x7fca400673d0 2024-02-21T07:56:25.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.688+0000 7fca45600640 1 -- 172.21.15.100:0/2396333623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca400673d0 msgr2=0x7fca4006f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.688+0000 7fca45600640 1 --2- 172.21.15.100:0/2396333623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca400673d0 0x7fca4006f7c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fca4008d350 tx=0x7fca2c02fe70 comp rx=0 tx=0).stop 2024-02-21T07:56:25.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.689+0000 7fca45600640 1 -- 172.21.15.100:0/2396333623 shutdown_connections 2024-02-21T07:56:25.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.689+0000 7fca45600640 1 --2- 172.21.15.100:0/2396333623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca400673d0 0x7fca4006f7c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.689+0000 7fca45600640 1 --2- 172.21.15.100:0/2396333623 >> v2:172.21.15.170:3300/0 conn(0x7fca4017b5a0 0x7fca4006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.689+0000 7fca45600640 1 -- 172.21.15.100:0/2396333623 >> 172.21.15.100:0/2396333623 conn(0x7fca400668b0 msgr2=0x7fca40066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.692+0000 7fca45600640 1 -- 172.21.15.100:0/2396333623 shutdown_connections 2024-02-21T07:56:25.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.692+0000 7fca45600640 1 -- 172.21.15.100:0/2396333623 wait complete. 2024-02-21T07:56:25.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.696+0000 7fca45600640 1 Processor -- start 2024-02-21T07:56:25.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.697+0000 7fca45600640 1 -- start start 2024-02-21T07:56:25.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca400673d0 0x7fca4015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca4017b5a0 0x7fca4020eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40210be0 con 0x7fca400673d0 2024-02-21T07:56:25.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4020fd80 con 0x7fca40186920 2024-02-21T07:56:25.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.699+0000 7fca45600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40210060 con 0x7fca4017b5a0 2024-02-21T07:56:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.700+0000 7fca3f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.700+0000 7fca3f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49486/0 (socket says 172.21.15.100:49486) 2024-02-21T07:56:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.700+0000 7fca3f400640 1 -- 172.21.15.100:0/2108931480 learned_addr learned my addr 172.21.15.100:0/2108931480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.701+0000 7fca3f400640 1 -- 172.21.15.100:0/2108931480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca4017b5a0 msgr2=0x7fca4020eff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:56:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.701+0000 7fca3f400640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca4017b5a0 0x7fca4020eff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.701+0000 7fca3f400640 1 -- 172.21.15.100:0/2108931480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca400673d0 msgr2=0x7fca4015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.701+0000 7fca3f400640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca400673d0 0x7fca4015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.701+0000 7fca3f400640 1 -- 172.21.15.100:0/2108931480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c0094d0 con 0x7fca40186920 2024-02-21T07:56:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.702+0000 7fca3f400640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c3c0 tx=0x7fca3800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.702+0000 7fca36a00640 1 -- 172.21.15.100:0/2108931480 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380052d0 con 0x7fca40186920 2024-02-21T07:56:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.703+0000 7fca36a00640 1 -- 172.21.15.100:0/2108931480 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38005430 con 0x7fca40186920 2024-02-21T07:56:25.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.703+0000 7fca36a00640 1 -- 172.21.15.100:0/2108931480 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38007260 con 0x7fca40186920 2024-02-21T07:56:25.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.703+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca40210340 con 0x7fca40186920 2024-02-21T07:56:25.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.703+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca40210900 con 0x7fca40186920 2024-02-21T07:56:25.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.710+0000 7fca48364740 1 Processor -- start 2024-02-21T07:56:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.711+0000 7fca36a00640 1 -- 172.21.15.100:0/2108931480 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fca380073c0 con 0x7fca40186920 2024-02-21T07:56:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.713+0000 7fca36a00640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 0x7fca200a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.714+0000 7fca36a00640 1 -- 172.21.15.100:0/2108931480 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fca380c8ef0 con 0x7fca40186920 2024-02-21T07:56:25.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.715+0000 7fca48364740 1 -- start start 2024-02-21T07:56:25.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.715+0000 7fca3e000640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 0x7fca200a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 0x56389e250ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e17b210 con 0x56389e2506d0 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e178740 con 0x56389e28bda0 2024-02-21T07:56:25.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.718+0000 7fca48364740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e173f20 con 0x56389e250ff0 2024-02-21T07:56:25.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.717+0000 7fca3e000640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 0x7fca200a16b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fca2c03a000 tx=0x7fca2c034000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.719+0000 7fca3f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.719+0000 7fca3f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49488/0 (socket says 172.21.15.100:49488) 2024-02-21T07:56:25.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.719+0000 7fca3f400640 1 -- 172.21.15.100:0/2332311558 learned_addr learned my addr 172.21.15.100:0/2332311558 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3e000640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3f400640 1 -- 172.21.15.100:0/2332311558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 msgr2=0x56389e28b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3ea00640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 0x56389e250ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3f400640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3f400640 1 -- 172.21.15.100:0/2332311558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 msgr2=0x56389e250ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3f400640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 0x56389e250ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3f400640 1 -- 172.21.15.100:0/2332311558 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389e135df0 con 0x56389e28bda0 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3e000640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.720+0000 7fca3ea00640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 0x56389e250ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.721+0000 7fca3f400640 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fca380c6800 tx=0x7fca38000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c71b21b6735ba5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.722+0000 7fca2b000640 1 -- 172.21.15.100:0/2332311558 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3809f170 con 0x56389e28bda0 2024-02-21T07:56:25.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.722+0000 7fca2b000640 1 -- 172.21.15.100:0/2332311558 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380c69a0 con 0x56389e28bda0 2024-02-21T07:56:25.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.722+0000 7fca2b000640 1 -- 172.21.15.100:0/2332311558 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38095e20 con 0x56389e28bda0 2024-02-21T07:56:25.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 -- 172.21.15.100:0/2332311558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 msgr2=0x56389e28cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fca380c6800 tx=0x7fca38000bc0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 -- 172.21.15.100:0/2332311558 shutdown_connections 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e28cb30 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 --2- 172.21.15.100:0/2332311558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e2506d0 0x56389e250ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.723+0000 7fca48364740 1 -- 172.21.15.100:0/2332311558 >> 172.21.15.100:0/2332311558 conn(0x56389e212ca0 msgr2=0x56389e213d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.724+0000 7fca48364740 1 -- 172.21.15.100:0/2332311558 shutdown_connections 2024-02-21T07:56:25.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.724+0000 7fca48364740 1 -- 172.21.15.100:0/2332311558 wait complete. 2024-02-21T07:56:25.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.725+0000 7fca48364740 1 -- start start 2024-02-21T07:56:25.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.726+0000 7fca48364740 1 Processor -- start 2024-02-21T07:56:25.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.729+0000 7fca48364740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e250ff0 0x56389e2490b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.729+0000 7fca48364740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 0x56389e2453b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.729+0000 7fca48364740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.730+0000 7fca3f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.731+0000 7fca3f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47282/0 (socket says 172.21.15.100:47282) 2024-02-21T07:56:25.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.731+0000 7fca3f400640 1 -- 172.21.15.100:0/4096776235 learned_addr learned my addr 172.21.15.100:0/4096776235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.730+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e250ff0 0x56389e2490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.730+0000 7fca3e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 0x56389e2453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.731+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e119150 con 0x56389e28bda0 2024-02-21T07:56:25.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.731+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e118df0 con 0x56389e250ff0 2024-02-21T07:56:25.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.731+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389dee21c0 con 0x56389e247800 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.732+0000 7fca3f400640 1 -- 172.21.15.100:0/4096776235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e250ff0 msgr2=0x56389e2490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.732+0000 7fca3f400640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e250ff0 0x56389e2490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.732+0000 7fca3f400640 1 -- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 msgr2=0x56389e2453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.732+0000 7fca3f400640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 0x56389e2453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.732+0000 7fca3f400640 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca40210900 con 0x56389e247800 2024-02-21T07:56:25.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.733+0000 7fca3e000640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 0x56389e2453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.734+0000 7fca48364740 10 client.0 _ll_register_callbacks cb 0x56389e1682b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:25.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.734+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56389de737e0 con 0x56389e247800 2024-02-21T07:56:25.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.734+0000 7fca1f400640 10 client.7199 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:25.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.734+0000 7fca3f400640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fca3800cd80 tx=0x7fca38000f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c15b36fb944a86 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.735+0000 7fca1f400640 1 -- 172.21.15.100:0/4096776235 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38096020 con 0x56389e247800 2024-02-21T07:56:25.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.735+0000 7fca1f400640 1 -- 172.21.15.100:0/4096776235 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fca38092720 con 0x56389e247800 2024-02-21T07:56:25.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.735+0000 7fca1f400640 1 -- 172.21.15.100:0/4096776235 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca38096020 con 0x56389e247800 2024-02-21T07:56:25.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.735+0000 7fca48364740 10 client.7199 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:25.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.735+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x56389e1725a0 con 0x56389e247800 2024-02-21T07:56:25.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.736+0000 7fca1f400640 1 -- 172.21.15.100:0/4096776235 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fca38092920 con 0x56389e247800 2024-02-21T07:56:25.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.736+0000 7fca48364740 10 client.7199 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:25.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.736+0000 7fca48364740 10 client.7199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:25.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.736+0000 7fca48364740 20 client.7199 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:25.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.736+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e298970 0x56389e298e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.737+0000 7fca48364740 4 client.7199 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:25.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.737+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56389deb0720 con 0x56389e298970 2024-02-21T07:56:25.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.737+0000 7fca3ea00640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e298970 0x56389e298e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.738+0000 7fca3ea00640 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e298970 0x56389e298e20 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844abb11fb569c72 server_cookie=a11b37bd7f66c7b9 in_seq=0 out_seq=0 2024-02-21T07:56:25.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.738+0000 7fca1f400640 10 client.7199 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:25.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.740+0000 7fca1f400640 1 -- 172.21.15.100:0/4096776235 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56389deb0720 con 0x56389e298970 2024-02-21T07:56:25.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.740+0000 7fca1f400640 10 client.7199 handle_command_reply: tid=0 2024-02-21T07:56:25.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.740+0000 7fca48364740 1 client.7199 shutdown 2024-02-21T07:56:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.742+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 msgr2=0x56389e298430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fca3800cd80 tx=0x7fca38000f70 comp rx=0 tx=0).stop 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 shutdown_connections 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e298970 0x56389e298e20 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e247800 0x56389e298430 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e28bda0 0x56389e2453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 --2- 172.21.15.100:0/4096776235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e250ff0 0x56389e2490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.743+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 >> 172.21.15.100:0/4096776235 conn(0x56389e2506d0 msgr2=0x56389e214710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.744+0000 7fca1f400640 0 client.7199 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.744+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 shutdown_connections 2024-02-21T07:56:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.744+0000 7fca48364740 1 -- 172.21.15.100:0/4096776235 wait complete. 2024-02-21T07:56:25.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.745+0000 7fca48364740 20 client.7199 trim_cache size 0 max 16384 2024-02-21T07:56:25.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.772+0000 7fca48364740 1 Processor -- start 2024-02-21T07:56:25.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.772+0000 7fca48364740 1 -- start start 2024-02-21T07:56:25.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.775+0000 7fca48364740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 0x56389e2560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.775+0000 7fca48364740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.776+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 0x56389e2560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.776+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 0x56389e2560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34464/0 (socket says 172.21.15.100:34464) 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.776+0000 7fca3ea00640 1 -- 172.21.15.100:0/1543810760 learned_addr learned my addr 172.21.15.100:0/1543810760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.776+0000 7fca48364740 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e249090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.776+0000 7fca3e000640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.777+0000 7fca3f400640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e249090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.777+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e21af40 con 0x56389e247800 2024-02-21T07:56:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.777+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e23e7b0 con 0x56389e28bda0 2024-02-21T07:56:25.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.777+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e211d80 con 0x56389e250ff0 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.778+0000 7fca3f400640 1 -- 172.21.15.100:0/1543810760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 msgr2=0x56389e28b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.778+0000 7fca3f400640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.778+0000 7fca3f400640 1 -- 172.21.15.100:0/1543810760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 msgr2=0x56389e2560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.778+0000 7fca3f400640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 0x56389e2560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.778+0000 7fca3f400640 1 -- 172.21.15.100:0/1543810760 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56389e10eab0 con 0x56389e28bda0 2024-02-21T07:56:25.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.779+0000 7fca3f400640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e249090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca38092e30 tx=0x7fca380b3000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b37baf1c2c6f20f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.779+0000 7fca2a600640 1 -- 172.21.15.100:0/1543810760 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38096a50 con 0x56389e28bda0 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.779+0000 7fca2a600640 1 -- 172.21.15.100:0/1543810760 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56389de737e0 con 0x56389e28bda0 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.779+0000 7fca2a600640 1 -- 172.21.15.100:0/1543810760 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e040 con 0x56389e28bda0 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.780+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 msgr2=0x56389e249090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.780+0000 7fca48364740 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e249090 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca38092e30 tx=0x7fca380b3000 comp rx=0 tx=0).stop 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.780+0000 7fca3e000640 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.781+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 shutdown_connections 2024-02-21T07:56:25.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.781+0000 7fca48364740 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e28bda0 0x56389e249090 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.781+0000 7fca48364740 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e250ff0 0x56389e28b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.781+0000 7fca48364740 1 --2- 172.21.15.100:0/1543810760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e247800 0x56389e2560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.781+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 >> 172.21.15.100:0/1543810760 conn(0x56389e2506d0 msgr2=0x56389e287d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.783+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 shutdown_connections 2024-02-21T07:56:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.783+0000 7fca48364740 1 -- 172.21.15.100:0/1543810760 wait complete. 2024-02-21T07:56:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.785+0000 7fca48364740 1 -- start start 2024-02-21T07:56:25.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.785+0000 7fca48364740 1 Processor -- start 2024-02-21T07:56:25.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.788+0000 7fca48364740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.788+0000 7fca48364740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e250ff0 0x56389e27ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.789+0000 7fca48364740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 0x56389e288b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.789+0000 7fca48364740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e2938c0 con 0x56389e250ff0 2024-02-21T07:56:25.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.789+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca3ea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49526/0 (socket says 172.21.15.100:49526) 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca3ea00640 1 -- 172.21.15.100:0/3116306190 learned_addr learned my addr 172.21.15.100:0/3116306190 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca3f400640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 0x56389e288b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e2897d0 con 0x56389e247800 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56389e244d80 con 0x56389e28bda0 2024-02-21T07:56:25.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.790+0000 7fca3e000640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e250ff0 0x56389e27ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.791+0000 7fca3f400640 1 -- 172.21.15.100:0/3116306190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 msgr2=0x56389e246700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.791+0000 7fca3f400640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.791+0000 7fca3f400640 1 -- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e250ff0 msgr2=0x56389e27ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:25.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca3f400640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e250ff0 0x56389e27ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca3f400640 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56389e1725a0 con 0x56389e28bda0 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca3f400640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 0x56389e288b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fca38007ba0 tx=0x7fca38000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12bf9647f5489db2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca1f400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca1f400640 1 -- 172.21.15.100:0/3116306190 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800e040 con 0x56389e28bda0 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.792+0000 7fca1f400640 1 -- 172.21.15.100:0/3116306190 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fca380969d0 con 0x56389e28bda0 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.793+0000 7fca1f400640 10 client.0 inactive, discarding osd_map(30..30 src has 1..30) v4 2024-02-21T07:56:25.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.793+0000 7fca3ea00640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.793+0000 7fca48364740 10 client.0 _ll_register_callbacks cb 0x7fca3800cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.793+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca380c69a0 con 0x56389e28bda0 2024-02-21T07:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.794+0000 7fca1f400640 1 -- 172.21.15.100:0/3116306190 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca38092720 con 0x56389e28bda0 2024-02-21T07:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.794+0000 7fca48364740 10 client.7202 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:25.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.794+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x56389e134650 con 0x56389e28bda0 2024-02-21T07:56:25.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.795+0000 7fca1f400640 1 -- 172.21.15.100:0/3116306190 <== mon.2 v2:172.21.15.170:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fca38092880 con 0x56389e28bda0 2024-02-21T07:56:25.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.795+0000 7fca48364740 10 client.7202 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.796+0000 7fca48364740 10 client.7202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.796+0000 7fca48364740 20 client.7202 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.796+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e23ef60 0x56389e2e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.796+0000 7fca48364740 4 client.7202 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:56:25.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.796+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fca380c69a0 con 0x56389e23ef60 2024-02-21T07:56:25.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.797+0000 7fca3ea00640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e23ef60 0x56389e2e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.801+0000 7fca1f400640 10 client.7202 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:25.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.801+0000 7fca3ea00640 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e23ef60 0x56389e2e5f10 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=972ae652a6457399 server_cookie=be965d490936646f in_seq=0 out_seq=0 2024-02-21T07:56:25.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.802+0000 7fca1f400640 1 -- 172.21.15.100:0/3116306190 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fca380c69a0 con 0x56389e23ef60 2024-02-21T07:56:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.802+0000 7fca1f400640 10 client.7202 handle_command_reply: tid=0 2024-02-21T07:56:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.803+0000 7fca48364740 1 client.7202 shutdown 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.803+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 msgr2=0x56389e288b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.803+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 0x56389e288b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fca38007ba0 tx=0x7fca38000ed0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 shutdown_connections 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x56389e23ef60 0x56389e2e5f10 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca1f400640 0 client.7202 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56389e28bda0 0x56389e288b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56389e250ff0 0x56389e27ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 --2- 172.21.15.100:0/3116306190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56389e247800 0x56389e246700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.804+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 >> 172.21.15.100:0/3116306190 conn(0x56389e2506d0 msgr2=0x56389e213f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.805+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 shutdown_connections 2024-02-21T07:56:25.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.806+0000 7fca48364740 1 -- 172.21.15.100:0/3116306190 wait complete. 2024-02-21T07:56:25.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.807+0000 7fca48364740 20 client.7202 trim_cache size 0 max 16384 2024-02-21T07:56:25.812 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:56:25.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.817+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 msgr2=0x7fca200a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.817+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 0x7fca200a16b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fca2c03a000 tx=0x7fca2c034000 comp rx=0 tx=0).stop 2024-02-21T07:56:25.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.817+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 msgr2=0x7fca4020f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:25.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.817+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c3c0 tx=0x7fca3800c880 comp rx=0 tx=0).stop 2024-02-21T07:56:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 shutdown_connections 2024-02-21T07:56:25.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fca40186920 0x7fca4020f530 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fca4017b5a0 0x7fca4020eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fca2009f1f0 0x7fca200a16b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 --2- 172.21.15.100:0/2108931480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca400673d0 0x7fca4015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 >> 172.21.15.100:0/2108931480 conn(0x7fca400668b0 msgr2=0x7fca40176970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 shutdown_connections 2024-02-21T07:56:25.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:25.820+0000 7fca45600640 1 -- 172.21.15.100:0/2108931480 wait complete. 2024-02-21T07:56:26.899 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:56:26.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:56:26.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:56:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.200+0000 7fa1f1000640 1 Processor -- start 2024-02-21T07:56:27.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.200+0000 7fa1f1000640 1 -- start start 2024-02-21T07:56:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.203+0000 7fa1f1000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 0x7fa1ec06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.204+0000 7fa1f1000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1ec08bfe0 0x7fa1ec188170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.204+0000 7fa1f1000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec1827a0 con 0x7fa1ec1886b0 2024-02-21T07:56:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.204+0000 7fa1f1000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec17ec80 con 0x7fa1ec187d90 2024-02-21T07:56:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1ea800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa1ec1886b0 0x7fa1ec070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45650/0 (socket says 172.21.15.100:45650) 2024-02-21T07:56:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1e9400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa1ec08bfe0 0x7fa1ec188170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1e9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 0x7fa1ec06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1ea800640 1 -- 172.21.15.100:0/4250739068 learned_addr learned my addr 172.21.15.100:0/4250739068 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec185760 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.205+0000 7fa1e8a00640 1 -- 172.21.15.100:0/4250739068 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262025263 0 0) 0x7fa1ec1827a0 con 0x7fa1ec1886b0 2024-02-21T07:56:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e8a00640 1 -- 172.21.15.100:0/4250739068 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d0005730 con 0x7fa1ec1886b0 2024-02-21T07:56:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e9400640 1 -- 172.21.15.100:0/4250739068 >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 msgr2=0x7fa1ec06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4250739068 >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 0x7fa1ec06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e9400640 1 -- 172.21.15.100:0/4250739068 >> v1:172.21.15.100:6789/0 conn(0x7fa1ec1886b0 legacy=0x7fa1ec070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e9400640 1 -- 172.21.15.100:0/4250739068 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec08c510 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.206+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4250739068 >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 0x7fa1ec06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:27.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.208+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4250739068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec188170 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0cf6a0 tx=0x7fa1d802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d21dd74803fc02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.209+0000 7fa1e8a00640 1 -- 172.21.15.100:0/4250739068 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d802e070 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.209+0000 7fa1e8a00640 1 -- 172.21.15.100:0/4250739068 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d80315a0 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.209+0000 7fa1e8a00640 1 -- 172.21.15.100:0/4250739068 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8031930 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 msgr2=0x7fa1ec188170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 --2- 172.21.15.100:0/4250739068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec188170 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0cf6a0 tx=0x7fa1d802b840 comp rx=0 tx=0).stop 2024-02-21T07:56:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 shutdown_connections 2024-02-21T07:56:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 --2- 172.21.15.100:0/4250739068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec188170 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 --2- 172.21.15.100:0/4250739068 >> v2:172.21.15.100:3300/0 conn(0x7fa1ec187d90 0x7fa1ec06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 >> 172.21.15.100:0/4250739068 conn(0x7fa1ec0ce6a0 msgr2=0x7fa1ec0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.210+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 shutdown_connections 2024-02-21T07:56:27.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.212+0000 7fa1f1000640 1 -- 172.21.15.100:0/4250739068 wait complete. 2024-02-21T07:56:27.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.215+0000 7fa1f1000640 1 Processor -- start 2024-02-21T07:56:27.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.216+0000 7fa1f1000640 1 -- start start 2024-02-21T07:56:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.218+0000 7fa1f1000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.219+0000 7fa1f1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 0x7fa1ec221070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.219+0000 7fa1f1000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1ec1886b0 0x7fa1ec16d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.219+0000 7fa1f1000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0f92b0 con 0x7fa1ec187d90 2024-02-21T07:56:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.219+0000 7fa1f1000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0f9590 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.219+0000 7fa1f1000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec0f9870 con 0x7fa1ec1886b0 2024-02-21T07:56:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.220+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.220+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49548/0 (socket says 172.21.15.100:49548) 2024-02-21T07:56:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.220+0000 7fa1e9e00640 1 -- 172.21.15.100:0/3718360874 learned_addr learned my addr 172.21.15.100:0/3718360874 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.220+0000 7fa1ea800640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1ec1886b0 0x7fa1ec16d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.222+0000 7fa1e9400640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 0x7fa1ec221070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9e00640 1 -- 172.21.15.100:0/3718360874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1ec1886b0 msgr2=0x7fa1ec16d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1ec1886b0 0x7fa1ec16d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9e00640 1 -- 172.21.15.100:0/3718360874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 msgr2=0x7fa1ec221070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 0x7fa1ec221070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9e00640 1 -- 172.21.15.100:0/3718360874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc009400 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.223+0000 7fa1e9400640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 0x7fa1ec221070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:27.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.225+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00e960 tx=0x7fa1dc00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.226+0000 7fa1e2000640 1 -- 172.21.15.100:0/3718360874 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00ca00 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.226+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d8009400 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.226+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec0f9e30 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.226+0000 7fa1e2000640 1 -- 172.21.15.100:0/3718360874 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1dc00cb60 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.226+0000 7fa1e2000640 1 -- 172.21.15.100:0/3718360874 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc013470 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.235+0000 7fa1f3c32740 1 Processor -- start 2024-02-21T07:56:27.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.235+0000 7fa1f3c32740 1 -- start start 2024-02-21T07:56:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a6ae0 0x55fd716e1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716e2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd71626300 con 0x55fd716e1890 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd715d8e50 con 0x55fd716a6ae0 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.237+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd715d6380 con 0x55fd716a61c0 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47322/0 (socket says 172.21.15.100:47322) 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 -- 172.21.15.100:0/1131736948 learned_addr learned my addr 172.21.15.100:0/1131736948 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1e9400640 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 -- 172.21.15.100:0/1131736948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a6ae0 msgr2=0x55fd716e1350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:27.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a6ae0 0x55fd716e1350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 -- 172.21.15.100:0/1131736948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 msgr2=0x55fd716e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1ea800640 1 -- 172.21.15.100:0/1131736948 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd7159ac80 con 0x55fd716a61c0 2024-02-21T07:56:27.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.238+0000 7fa1e9400640 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.240+0000 7fa1e2000640 1 -- 172.21.15.100:0/3718360874 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa1dc0135d0 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.239+0000 7fa1ea800640 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4002030 tx=0x7fa1e4000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b566ee9a1e318c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.240+0000 7fa1d6a00640 1 -- 172.21.15.100:0/1131736948 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400ede0 con 0x55fd716a61c0 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.240+0000 7fa1d6a00640 1 -- 172.21.15.100:0/1131736948 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e4014480 con 0x55fd716a61c0 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.240+0000 7fa1d6a00640 1 -- 172.21.15.100:0/1131736948 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4014830 con 0x55fd716a61c0 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.241+0000 7fa1f3c32740 1 -- 172.21.15.100:0/1131736948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 msgr2=0x55fd716a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.241+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4002030 tx=0x7fa1e4000f40 comp rx=0 tx=0).stop 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.242+0000 7fa1f3c32740 1 -- 172.21.15.100:0/1131736948 shutdown_connections 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.242+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.242+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a6ae0 0x55fd716e1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.242+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/1131736948 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716a61c0 0x55fd716a65a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.242+0000 7fa1f3c32740 1 -- 172.21.15.100:0/1131736948 >> 172.21.15.100:0/1131736948 conn(0x55fd71668790 msgr2=0x55fd71669810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.243+0000 7fa1e2000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 0x7fa1cc0a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.243+0000 7fa1e2000640 1 -- 172.21.15.100:0/3718360874 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1dc0c9eb0 con 0x7fa1ec08bfe0 2024-02-21T07:56:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.243+0000 7fa1f3c32740 1 -- 172.21.15.100:0/1131736948 shutdown_connections 2024-02-21T07:56:27.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.244+0000 7fa1e9400640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 0x7fa1cc0a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.244+0000 7fa1f3c32740 1 -- 172.21.15.100:0/1131736948 wait complete. 2024-02-21T07:56:27.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.253+0000 7fa1e9400640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 0x7fa1cc0a14c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8036000 tx=0x7fa1d8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.253+0000 7fa1f3c32740 1 -- start start 2024-02-21T07:56:27.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.254+0000 7fa1f3c32740 1 Processor -- start 2024-02-21T07:56:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.260+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd71697700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.260+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 0x55fd716a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.260+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd71697700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.260+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd71697700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47324/0 (socket says 172.21.15.100:47324) 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.261+0000 7fa1e9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 0x55fd716a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.261+0000 7fa1e9e00640 1 -- 172.21.15.100:0/2009115775 learned_addr learned my addr 172.21.15.100:0/2009115775 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.261+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 0x55fd716dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.262+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd715d1b60 con 0x55fd71664950 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.262+0000 7fa1ea800640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 0x55fd716dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.262+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd71576fd0 con 0x55fd716dbdb0 2024-02-21T07:56:27.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.262+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd71576c70 con 0x55fd716e1890 2024-02-21T07:56:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.263+0000 7fa1e9400640 1 -- 172.21.15.100:0/2009115775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 msgr2=0x55fd71697700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.263+0000 7fa1e9400640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd71697700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.263+0000 7fa1e9400640 1 -- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 msgr2=0x55fd716dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.263+0000 7fa1e9400640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 0x55fd716dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.263+0000 7fa1e9400640 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e400f040 con 0x55fd71664950 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.267+0000 7fa1ea800640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 0x55fd716dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.267+0000 7fa1f3c32740 10 client.0 _ll_register_callbacks cb 0x55fd712e2c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.267+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd712d1860 con 0x55fd71664950 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.268+0000 7fa1cb400640 10 client.7122 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:56:27.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.268+0000 7fa1e9400640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 0x55fd716a49a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009890 tx=0x7fa1d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd8df2e5ae71846 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.270+0000 7fa1cb400640 1 -- 172.21.15.100:0/2009115775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d804c070 con 0x55fd71664950 2024-02-21T07:56:27.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.275+0000 7fa1cb400640 1 -- 172.21.15.100:0/2009115775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1d8040040 con 0x55fd71664950 2024-02-21T07:56:27.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.275+0000 7fa1cb400640 1 -- 172.21.15.100:0/2009115775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1d8047cf0 con 0x55fd71664950 2024-02-21T07:56:27.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.279+0000 7fa1f3c32740 10 client.7122 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:27.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.279+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({fsmap=17}) v3 -- 0x55fd715d01e0 con 0x55fd71664950 2024-02-21T07:56:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.280+0000 7fa1cb400640 1 -- 172.21.15.100:0/2009115775 <== mon.0 v2:172.21.15.100:3300/0 4 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa1d8032430 con 0x55fd71664950 2024-02-21T07:56:27.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.281+0000 7fa1f3c32740 10 client.7122 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.281+0000 7fa1f3c32740 10 client.7122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.281+0000 7fa1f3c32740 20 client.7122 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.281+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716ed840 0x55fd716edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.282+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716ed840 0x55fd716edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.282+0000 7fa1f3c32740 4 client.7122 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:27.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.282+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd71322410 con 0x55fd716ed840 2024-02-21T07:56:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.283+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716ed840 0x55fd716edcf0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1e854629071068 server_cookie=e68deafc44489f78 in_seq=0 out_seq=0 2024-02-21T07:56:27.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.283+0000 7fa1cb400640 10 client.7122 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.284+0000 7fa1cb400640 1 -- 172.21.15.100:0/2009115775 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fd71322410 con 0x55fd716ed840 2024-02-21T07:56:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.284+0000 7fa1cb400640 10 client.7122 handle_command_reply: tid=0 2024-02-21T07:56:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.284+0000 7fa1f3c32740 1 client.7122 shutdown 2024-02-21T07:56:27.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.285+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 msgr2=0x55fd716a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.285+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 0x55fd716a49a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009890 tx=0x7fa1d8004730 comp rx=0 tx=0).stop 2024-02-21T07:56:27.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.285+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 shutdown_connections 2024-02-21T07:56:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716ed840 0x55fd716edcf0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716dbdb0 0x55fd716dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd71664950 0x55fd716a49a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/2009115775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd71697700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 >> 172.21.15.100:0/2009115775 conn(0x55fd716a61c0 msgr2=0x55fd716e1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.286+0000 7fa1cb400640 0 client.7122 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.287+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 shutdown_connections 2024-02-21T07:56:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.287+0000 7fa1f3c32740 1 -- 172.21.15.100:0/2009115775 wait complete. 2024-02-21T07:56:27.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.287+0000 7fa1f3c32740 20 client.7122 trim_cache size 0 max 16384 2024-02-21T07:56:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.333+0000 7fa1f3c32740 1 Processor -- start 2024-02-21T07:56:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.334+0000 7fa1f3c32740 1 -- start start 2024-02-21T07:56:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 0x55fd716df630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd71667bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd7131a0c0 con 0x55fd716dbdb0 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd716a4be0 con 0x55fd716a2780 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.336+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd716f2730 con 0x55fd716e1890 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47336/0 (socket says 172.21.15.100:47336) 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 -- 172.21.15.100:0/4262300294 learned_addr learned my addr 172.21.15.100:0/4262300294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1ea800640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd71667bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 0x55fd716df630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 -- 172.21.15.100:0/4262300294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 msgr2=0x55fd71667bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd71667bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 -- 172.21.15.100:0/4262300294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 msgr2=0x55fd716df630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 0x55fd716df630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9400640 1 -- 172.21.15.100:0/4262300294 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd7156ca90 con 0x55fd716e1890 2024-02-21T07:56:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.337+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 0x55fd716df630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.338+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa1d802be50 tx=0x7fa1d804c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2324657bc8b2802 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.338+0000 7fa1d6000640 1 -- 172.21.15.100:0/4262300294 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8047cf0 con 0x55fd716e1890 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.338+0000 7fa1d6000640 1 -- 172.21.15.100:0/4262300294 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fd712d1860 con 0x55fd716e1890 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.338+0000 7fa1d6000640 1 -- 172.21.15.100:0/4262300294 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8047e50 con 0x55fd716e1890 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4262300294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 msgr2=0x55fd7173a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa1d802be50 tx=0x7fa1d804c000 comp rx=0 tx=0).stop 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4262300294 shutdown_connections 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd71667bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716e1890 0x55fd7173a1d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4262300294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716dbdb0 0x55fd716df630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4262300294 >> 172.21.15.100:0/4262300294 conn(0x55fd716a61c0 msgr2=0x55fd71697510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4262300294 shutdown_connections 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.339+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4262300294 wait complete. 2024-02-21T07:56:27.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.341+0000 7fa1f3c32740 1 -- start start 2024-02-21T07:56:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.341+0000 7fa1f3c32740 1 Processor -- start 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716dbdb0 0x55fd716abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716da380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd716a3120 con 0x55fd716e1890 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd71747010 con 0x55fd716a2780 2024-02-21T07:56:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd716ab930 con 0x55fd716dbdb0 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.343+0000 7fa1f3c32740 10 client.0 _ll_register_callbacks cb 0x7fa1e4001a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49574/0 (socket says 172.21.15.100:49574) 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716dbdb0 0x55fd716abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 -- 172.21.15.100:0/4069507876 learned_addr learned my addr 172.21.15.100:0/4069507876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1ea800640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716da380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 -- 172.21.15.100:0/4069507876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716dbdb0 msgr2=0x55fd716abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716dbdb0 0x55fd716abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 -- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 msgr2=0x55fd716da380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716da380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.344+0000 7fa1e9e00640 1 -- 172.21.15.100:0/4069507876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd715d01e0 con 0x55fd716a2780 2024-02-21T07:56:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1e9e00640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0c7790 tx=0x7fa1dc00efd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75e60d17cd34d21e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1cb400640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc097990 con 0x55fd716a2780 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa1dc09bae0 con 0x55fd716a2780 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1e4014480 con 0x55fd716a2780 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.345+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1dc0a0130 con 0x55fd716a2780 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 10 client.7318 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fd715926a0 con 0x55fd716a2780 2024-02-21T07:56:27.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e4014480 con 0x55fd716a2780 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa1dc011070 con 0x55fd716a2780 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 10 client.7318 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 10 client.7318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 20 client.7318 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716970b0 0x55fd716aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 4 client.7318 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.346+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fd7130e7b0 con 0x55fd716970b0 2024-02-21T07:56:27.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.347+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716970b0 0x55fd716aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.348+0000 7fa1e9400640 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716970b0 0x55fd716aa470 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9169c262a70cf8ac server_cookie=8478fcbf34511fa3 in_seq=0 out_seq=0 2024-02-21T07:56:27.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.348+0000 7fa1cb400640 10 client.7318 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.350+0000 7fa1cb400640 1 -- 172.21.15.100:0/4069507876 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fd7130e7b0 con 0x55fd716970b0 2024-02-21T07:56:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.350+0000 7fa1cb400640 10 client.7318 handle_command_reply: tid=0 2024-02-21T07:56:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.351+0000 7fa1f3c32740 1 client.7318 shutdown 2024-02-21T07:56:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.352+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 msgr2=0x55fd716d6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.352+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0c7790 tx=0x7fa1dc00efd0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 shutdown_connections 2024-02-21T07:56:27.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55fd716970b0 0x55fd716aa470 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd716e1890 0x55fd716da380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd716dbdb0 0x55fd716abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 --2- 172.21.15.100:0/4069507876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd716a2780 0x55fd716d6ad0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.354+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 >> 172.21.15.100:0/4069507876 conn(0x55fd716a61c0 msgr2=0x55fd716a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.356+0000 7fa1cb400640 0 client.7318 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.358+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 shutdown_connections 2024-02-21T07:56:27.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.358+0000 7fa1f3c32740 1 -- 172.21.15.100:0/4069507876 wait complete. 2024-02-21T07:56:27.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.359+0000 7fa1f3c32740 20 client.7318 trim_cache size 0 max 16384 2024-02-21T07:56:27.365 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:56:27.365 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:56:27.365 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "34742f1c-2547-474f-90e6-e968da7a81f2", 2024-02-21T07:56:27.365 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:56:27.365 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 msgr2=0x7fa1cc0a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 0x7fa1cc0a14c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8036000 tx=0x7fa1d8008030 comp rx=0 tx=0).stop 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 msgr2=0x7fa1ec0f8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc00e960 tx=0x7fa1dc00ee20 comp rx=0 tx=0).stop 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 shutdown_connections 2024-02-21T07:56:27.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1ec1886b0 0x7fa1ec16d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa1cc09f000 0x7fa1cc0a14c0 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8036000 tx=0x7fa1d8008030 comp rx=0 tx=0).stop 2024-02-21T07:56:27.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1ec187d90 0x7fa1ec221070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 --2- 172.21.15.100:0/3718360874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1ec08bfe0 0x7fa1ec0f8bc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.361+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 >> 172.21.15.100:0/3718360874 conn(0x7fa1ec0ce6a0 msgr2=0x7fa1ec070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.366+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 shutdown_connections 2024-02-21T07:56:27.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.372+0000 7fa1f1000640 1 -- 172.21.15.100:0/3718360874 wait complete. 2024-02-21T07:56:27.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:56:27.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:56:27.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.846+0000 7f08ef200640 1 Processor -- start 2024-02-21T07:56:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.846+0000 7f08ef200640 1 -- start start 2024-02-21T07:56:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.849+0000 7f08ef200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08f01860b0 0x7f08f00fa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.849+0000 7f08ef200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f08f0188be0 0x7f08f0189030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.849+0000 7f08ef200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00fa890 con 0x7f08f0185cd0 2024-02-21T07:56:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.849+0000 7f08ef200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f006bd90 con 0x7f08f01860b0 2024-02-21T07:56:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.849+0000 7f08ef200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00f9f30 con 0x7f08f0188be0 2024-02-21T07:56:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.850+0000 7f08ede00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f08f0185cd0 0x7f08f00d4060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:49860/0 (socket says 172.21.15.100:49860) 2024-02-21T07:56:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.850+0000 7f08ede00640 1 -- 172.21.15.100:0/3289333622 learned_addr learned my addr 172.21.15.100:0/3289333622 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:27.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.850+0000 7f08ed400640 1 --2- 172.21.15.100:0/3289333622 >> v2:172.21.15.100:3300/0 conn(0x7f08f01860b0 0x7f08f00fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.851+0000 7f08ee800640 1 --2- 172.21.15.100:0/3289333622 >> v2:172.21.15.156:3300/0 conn(0x7f08f0188be0 0x7f08f0189030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.852+0000 7f08ed400640 1 -- 172.21.15.100:0/3289333622 >> v2:172.21.15.156:3300/0 conn(0x7f08f0188be0 msgr2=0x7f08f0189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.852+0000 7f08ed400640 1 --2- 172.21.15.100:0/3289333622 >> v2:172.21.15.156:3300/0 conn(0x7f08f0188be0 0x7f08f0189030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.852+0000 7f08ed400640 1 -- 172.21.15.100:0/3289333622 >> v1:172.21.15.170:6789/0 conn(0x7f08f0185cd0 legacy=0x7f08f00d4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.852+0000 7f08ed400640 1 -- 172.21.15.100:0/3289333622 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f008cff0 con 0x7f08f01860b0 2024-02-21T07:56:27.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.854+0000 7f08ed400640 1 --2- 172.21.15.100:0/3289333622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f00fa350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f08f00674d0 tx=0x7f08d802ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0eda2df3f64f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.855+0000 7f08eca00640 1 -- 172.21.15.100:0/3289333622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d802f660 con 0x7f08f01860b0 2024-02-21T07:56:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.855+0000 7f08eca00640 1 -- 172.21.15.100:0/3289333622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d802f7c0 con 0x7f08f01860b0 2024-02-21T07:56:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.855+0000 7f08eca00640 1 -- 172.21.15.100:0/3289333622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d802f660 con 0x7f08f01860b0 2024-02-21T07:56:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.856+0000 7f08ef200640 1 -- 172.21.15.100:0/3289333622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 msgr2=0x7f08f00fa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.856+0000 7f08ef200640 1 --2- 172.21.15.100:0/3289333622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f00fa350 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f08f00674d0 tx=0x7f08d802ba50 comp rx=0 tx=0).stop 2024-02-21T07:56:27.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.858+0000 7f08ef200640 1 -- 172.21.15.100:0/3289333622 shutdown_connections 2024-02-21T07:56:27.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.858+0000 7f08ef200640 1 --2- 172.21.15.100:0/3289333622 >> v2:172.21.15.156:3300/0 conn(0x7f08f0188be0 0x7f08f0189030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.858+0000 7f08ef200640 1 --2- 172.21.15.100:0/3289333622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f00fa350 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.858+0000 7f08ef200640 1 -- 172.21.15.100:0/3289333622 >> 172.21.15.100:0/3289333622 conn(0x7f08f00fe060 msgr2=0x7f08f00fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.860+0000 7f08ef200640 1 -- 172.21.15.100:0/3289333622 shutdown_connections 2024-02-21T07:56:27.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.860+0000 7f08ef200640 1 -- 172.21.15.100:0/3289333622 wait complete. 2024-02-21T07:56:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.867+0000 7f08ef200640 1 Processor -- start 2024-02-21T07:56:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.867+0000 7f08ef200640 1 -- start start 2024-02-21T07:56:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.871+0000 7f08ef200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 0x7f08f0220430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.872+0000 7f08ef200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f017f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.872+0000 7f08ef200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 0x7f08f0178260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.872+0000 7f08ef200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0220cd0 con 0x7f08f01860b0 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.872+0000 7f08ede00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 0x7f08f0220430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.873+0000 7f08ede00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 0x7f08f0220430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47346/0 (socket says 172.21.15.100:47346) 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.873+0000 7f08ede00640 1 -- 172.21.15.100:0/1984673900 learned_addr learned my addr 172.21.15.100:0/1984673900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.872+0000 7f08ef200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0220fb0 con 0x7f08f0188be0 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.873+0000 7f08ed400640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f017f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.874+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0221290 con 0x7f08f0185cd0 2024-02-21T07:56:27.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.874+0000 7f08ee800640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 0x7f08f0178260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.875+0000 7f08ed400640 1 -- 172.21.15.100:0/1984673900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 msgr2=0x7f08f0220430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.875+0000 7f08ed400640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 0x7f08f0220430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.875+0000 7f08ed400640 1 -- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 msgr2=0x7f08f0178260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.875+0000 7f08ed400640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 0x7f08f0178260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.875+0000 7f08ed400640 1 -- 172.21.15.100:0/1984673900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009400 con 0x7f08f01860b0 2024-02-21T07:56:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.879+0000 7f08ee800640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 0x7f08f0178260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:56:27.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.881+0000 7f08ed400640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f017f170 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f08d8033000 tx=0x7f08d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.882+0000 7f08e6000640 1 -- 172.21.15.100:0/1984673900 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d803d070 con 0x7f08f01860b0 2024-02-21T07:56:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.882+0000 7f08e6000640 1 -- 172.21.15.100:0/1984673900 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8003820 con 0x7f08f01860b0 2024-02-21T07:56:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.883+0000 7f08e6000640 1 -- 172.21.15.100:0/1984673900 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d802f660 con 0x7f08f01860b0 2024-02-21T07:56:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.883+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f0221570 con 0x7f08f01860b0 2024-02-21T07:56:27.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.887+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0221b30 con 0x7f08f01860b0 2024-02-21T07:56:27.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.896+0000 7f08f7a11740 1 Processor -- start 2024-02-21T07:56:27.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.903+0000 7f08e6000640 1 -- 172.21.15.100:0/1984673900 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f08d80039b0 con 0x7f08f01860b0 2024-02-21T07:56:27.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.903+0000 7f08f7a11740 1 -- start start 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.909+0000 7f08e6000640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d27c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 0x55b1e0cf2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cb50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0c29150 con 0x55b1e0cf2190 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0c26680 con 0x55b1e0d28150 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.912+0000 7f08f7a11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0c21e60 con 0x55b1e0cf2ab0 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.913+0000 7f08ede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d27c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.913+0000 7f08ede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d27c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34554/0 (socket says 172.21.15.100:34554) 2024-02-21T07:56:27.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.913+0000 7f08ede00640 1 -- 172.21.15.100:0/3905591065 learned_addr learned my addr 172.21.15.100:0/3905591065 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 0x55b1e0cf2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 -- 172.21.15.100:0/3905591065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 msgr2=0x55b1e0cb50c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cb50c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 -- 172.21.15.100:0/3905591065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 msgr2=0x55b1e0d27c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d27c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.914+0000 7f08ed400640 1 -- 172.21.15.100:0/3905591065 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e0bdb060 con 0x55b1e0d28150 2024-02-21T07:56:27.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.915+0000 7f08ed400640 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 0x55b1e0cf2570 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f08d80e92e0 tx=0x7f08d80f1ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f0c6dfd75e23dee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.916+0000 7f08dea00640 1 -- 172.21.15.100:0/3905591065 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80f3de0 con 0x55b1e0d28150 2024-02-21T07:56:27.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.917+0000 7f08dea00640 1 -- 172.21.15.100:0/3905591065 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80f6420 con 0x55b1e0d28150 2024-02-21T07:56:27.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.917+0000 7f08dea00640 1 -- 172.21.15.100:0/3905591065 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80f67b0 con 0x55b1e0d28150 2024-02-21T07:56:27.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.918+0000 7f08e6000640 1 -- 172.21.15.100:0/1984673900 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08d80eb9d0 con 0x7f08f01860b0 2024-02-21T07:56:27.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.918+0000 7f08f7a11740 1 -- 172.21.15.100:0/3905591065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 msgr2=0x55b1e0cf2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.919+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 0x55b1e0cf2570 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f08d80e92e0 tx=0x7f08d80f1ef0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.919+0000 7f08ee800640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.920+0000 7f08f7a11740 1 -- 172.21.15.100:0/3905591065 shutdown_connections 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.920+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cb50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.920+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0d28150 0x55b1e0cf2570 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.920+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3905591065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d27c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.920+0000 7f08f7a11740 1 -- 172.21.15.100:0/3905591065 >> 172.21.15.100:0/3905591065 conn(0x55b1e0c815a0 msgr2=0x55b1e0cb9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.922+0000 7f08f7a11740 1 -- 172.21.15.100:0/3905591065 shutdown_connections 2024-02-21T07:56:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.922+0000 7f08f7a11740 1 -- 172.21.15.100:0/3905591065 wait complete. 2024-02-21T07:56:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.923+0000 7f08f7a11740 1 -- start start 2024-02-21T07:56:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.924+0000 7f08f7a11740 1 Processor -- start 2024-02-21T07:56:27.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.928+0000 7f08ee800640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009f00 tx=0x7f08e800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cf08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0bc6ec0 con 0x55b1e0cf2190 2024-02-21T07:56:27.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0bc6b60 con 0x55b1e0cf2ab0 2024-02-21T07:56:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e09901c0 con 0x55b1e0d28150 2024-02-21T07:56:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08f7a11740 10 client.0 _ll_register_callbacks cb 0x55b1e0bda960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08ee800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08ee800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47362/0 (socket says 172.21.15.100:47362) 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.934+0000 7f08ee800640 1 -- 172.21.15.100:0/3693047861 learned_addr learned my addr 172.21.15.100:0/3693047861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.935+0000 7f08ee800640 1 -- 172.21.15.100:0/3693047861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2ab0 msgr2=0x55b1e0cf08c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.935+0000 7f08ee800640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cf08c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.935+0000 7f08ee800640 1 -- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 msgr2=0x55b1e0d254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.936+0000 7f08ede00640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.936+0000 7f08ee800640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.936+0000 7f08ee800640 1 -- 172.21.15.100:0/3693047861 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f0221b30 con 0x55b1e0d28150 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.939+0000 7f08ede00640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.940+0000 7f08ee800640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f08e8016aa0 tx=0x7f08e8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2c32657893f325 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:27.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.941+0000 7f08d3400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.942+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8014e20 con 0x55b1e0d28150 2024-02-21T07:56:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.951+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1e09217e0 con 0x55b1e0d28150 2024-02-21T07:56:27.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.951+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08e8021400 con 0x55b1e0d28150 2024-02-21T07:56:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.952+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e8009ba0 con 0x55b1e0d28150 2024-02-21T07:56:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.952+0000 7f08f7a11740 10 client.7226 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:27.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.952+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b1e0c204e0 con 0x55b1e0d28150 2024-02-21T07:56:27.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.952+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b1e09217e0 con 0x55b1e0d28150 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.955+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f08e80215c0 con 0x55b1e0d28150 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 10 client.7226 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 10 client.7226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 20 client.7226 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0d39b60 0x55b1e0cb36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 4 client.7226 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:27.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.958+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1e095e720 con 0x55b1e0d39b60 2024-02-21T07:56:27.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.959+0000 7f08ede00640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0d39b60 0x55b1e0cb36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.964+0000 7f08ede00640 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0d39b60 0x55b1e0cb36d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4be60f862a73632f server_cookie=97834448f7e57f0f in_seq=0 out_seq=0 2024-02-21T07:56:27.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.964+0000 7f08d3400640 10 client.7226 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.972+0000 7f08d3400640 1 -- 172.21.15.100:0/3693047861 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b1e095e720 con 0x55b1e0d39b60 2024-02-21T07:56:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.972+0000 7f08d3400640 10 client.7226 handle_command_reply: tid=0 2024-02-21T07:56:27.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.972+0000 7f08f7a11740 1 client.7226 shutdown 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.975+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 msgr2=0x55b1e0ce7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.975+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f08e8016aa0 tx=0x7f08e8004a40 comp rx=0 tx=0).stop 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 shutdown_connections 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0d39b60 0x55b1e0cb36d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0d28150 0x55b1e0ce7fa0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0cf08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 --2- 172.21.15.100:0/3693047861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0cf2190 0x55b1e0d254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 >> 172.21.15.100:0/3693047861 conn(0x55b1e0c815a0 msgr2=0x55b1e0d29de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.976+0000 7f08d3400640 0 client.7226 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.977+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 shutdown_connections 2024-02-21T07:56:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.977+0000 7f08f7a11740 1 -- 172.21.15.100:0/3693047861 wait complete. 2024-02-21T07:56:27.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:27.981+0000 7f08f7a11740 20 client.7226 trim_cache size 0 max 16384 2024-02-21T07:56:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.063+0000 7f08f7a11740 1 Processor -- start 2024-02-21T07:56:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.064+0000 7f08f7a11740 1 -- start start 2024-02-21T07:56:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.068+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0cc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.069+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d27590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.069+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.069+0000 7f08ede00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0cc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:28.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08f7a11740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0cb3990 con 0x55b1e0d28150 2024-02-21T07:56:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08f7a11740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0cc0a80 con 0x55b1e0cf2190 2024-02-21T07:56:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08f7a11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0cb36d0 con 0x55b1e0cf2ab0 2024-02-21T07:56:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08ede00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0cc04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:49618/0 (socket says 172.21.15.100:49618) 2024-02-21T07:56:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08ee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08ee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34572/0 (socket says 172.21.15.100:34572) 2024-02-21T07:56:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08ee800640 1 -- 172.21.15.100:0/674543470 learned_addr learned my addr 172.21.15.100:0/674543470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:28.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.070+0000 7f08ed400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d27590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.072+0000 7f08ee800640 1 -- 172.21.15.100:0/674543470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 msgr2=0x55b1e0d27590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.072+0000 7f08ee800640 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d27590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.072+0000 7f08ee800640 1 -- 172.21.15.100:0/674543470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 msgr2=0x55b1e0cc04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.072+0000 7f08ee800640 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0cc04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.072+0000 7f08ee800640 1 -- 172.21.15.100:0/674543470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e0bbc950 con 0x55b1e0d28150 2024-02-21T07:56:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.075+0000 7f08ed400640 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d27590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:28.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.077+0000 7f08ee800640 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f08e8016a70 tx=0x7f08e801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f27beae5817767 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.084+0000 7f08de000640 1 -- 172.21.15.100:0/674543470 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e80147a0 con 0x55b1e0d28150 2024-02-21T07:56:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.084+0000 7f08de000640 1 -- 172.21.15.100:0/674543470 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e801a040 con 0x55b1e0d28150 2024-02-21T07:56:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.084+0000 7f08de000640 1 -- 172.21.15.100:0/674543470 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8014270 con 0x55b1e0d28150 2024-02-21T07:56:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.085+0000 7f08f7a11740 1 -- 172.21.15.100:0/674543470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 msgr2=0x55b1e0d224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.085+0000 7f08f7a11740 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f08e8016a70 tx=0x7f08e801f000 comp rx=0 tx=0).stop 2024-02-21T07:56:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.086+0000 7f08f7a11740 1 -- 172.21.15.100:0/674543470 shutdown_connections 2024-02-21T07:56:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.086+0000 7f08f7a11740 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0d224c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.086+0000 7f08f7a11740 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d27590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.087+0000 7f08f7a11740 1 --2- 172.21.15.100:0/674543470 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0cc04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.087+0000 7f08f7a11740 1 -- 172.21.15.100:0/674543470 >> 172.21.15.100:0/674543470 conn(0x55b1e0c815a0 msgr2=0x55b1e0d25380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.087+0000 7f08f7a11740 1 -- 172.21.15.100:0/674543470 shutdown_connections 2024-02-21T07:56:28.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.088+0000 7f08f7a11740 1 -- 172.21.15.100:0/674543470 wait complete. 2024-02-21T07:56:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.090+0000 7f08f7a11740 1 -- start start 2024-02-21T07:56:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.091+0000 7f08f7a11740 1 Processor -- start 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0ce4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d91ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0ce4aa0 con 0x55b1e0d28150 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0cbfb50 con 0x55b1e0cf2190 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e0d98a50 con 0x55b1e0cf2ab0 2024-02-21T07:56:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.095+0000 7f08f7a11740 10 client.0 _ll_register_callbacks cb 0x7f08e8009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.096+0000 7f08ee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.096+0000 7f08ee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34584/0 (socket says 172.21.15.100:34584) 2024-02-21T07:56:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.096+0000 7f08ee800640 1 -- 172.21.15.100:0/1395490498 learned_addr learned my addr 172.21.15.100:0/1395490498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.097+0000 7f08ee800640 1 -- 172.21.15.100:0/1395490498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 msgr2=0x55b1e0d91ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.097+0000 7f08ee800640 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d91ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.097+0000 7f08ee800640 1 -- 172.21.15.100:0/1395490498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 msgr2=0x55b1e0ce4560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.097+0000 7f08ee800640 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0ce4560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.097+0000 7f08ee800640 1 -- 172.21.15.100:0/1395490498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1e0bdb060 con 0x55b1e0d28150 2024-02-21T07:56:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.100+0000 7f08ee800640 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007cb0 tx=0x7f08e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94251f7dd215b17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.101+0000 7f08d3400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:56:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.101+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8014e20 con 0x55b1e0d28150 2024-02-21T07:56:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.101+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08e8021400 con 0x55b1e0d28150 2024-02-21T07:56:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.102+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08d80f6420 con 0x55b1e0d28150 2024-02-21T07:56:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.105+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e80215c0 con 0x55b1e0d28150 2024-02-21T07:56:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.105+0000 7f08f7a11740 10 client.7140 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:28.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.105+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b1e0c204e0 con 0x55b1e0d28150 2024-02-21T07:56:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.106+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80f6420 con 0x55b1e0d28150 2024-02-21T07:56:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f08e8036450 con 0x55b1e0d28150 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 10 client.7140 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 10 client.7140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 20 client.7140 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0cc0c30 0x55b1e0cb3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 4 client.7140 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:56:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.107+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b1e09ad890 con 0x55b1e0cc0c30 2024-02-21T07:56:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.108+0000 7f08ede00640 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0cc0c30 0x55b1e0cb3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.109+0000 7f08ede00640 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0cc0c30 0x55b1e0cb3ad0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c45628c4d7e5b2 server_cookie=5553a854f95385b1 in_seq=0 out_seq=0 2024-02-21T07:56:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.109+0000 7f08d3400640 10 client.7140 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.110+0000 7f08d3400640 1 -- 172.21.15.100:0/1395490498 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b1e09ad890 con 0x55b1e0cc0c30 2024-02-21T07:56:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.110+0000 7f08d3400640 10 client.7140 handle_command_reply: tid=0 2024-02-21T07:56:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.110+0000 7f08f7a11740 1 client.7140 shutdown 2024-02-21T07:56:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.110+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 msgr2=0x55b1e0cbeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.110+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007cb0 tx=0x7f08e8014000 comp rx=0 tx=0).stop 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 shutdown_connections 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55b1e0cc0c30 0x55b1e0cb3ad0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1e0d28150 0x55b1e0cbeaa0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b1e0cf2ab0 0x55b1e0d91ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 --2- 172.21.15.100:0/1395490498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1e0cf2190 0x55b1e0ce4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.111+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 >> 172.21.15.100:0/1395490498 conn(0x55b1e0c815a0 msgr2=0x55b1e0cb92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.112+0000 7f08d3400640 0 client.7140 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.112+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 shutdown_connections 2024-02-21T07:56:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.112+0000 7f08f7a11740 1 -- 172.21.15.100:0/1395490498 wait complete. 2024-02-21T07:56:28.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.113+0000 7f08f7a11740 20 client.7140 trim_cache size 0 max 16384 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "34742f1c-2547-474f-90e6-e968da7a81f2": { 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "34742f1c-2547-474f-90e6-e968da7a81f2", 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:56:28.115 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:56:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.114+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 msgr2=0x7f08cc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.114+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009f00 tx=0x7f08e800b040 comp rx=0 tx=0).stop 2024-02-21T07:56:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.114+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 msgr2=0x7f08f017f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.114+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f017f170 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f08d8033000 tx=0x7f08d80046c0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 shutdown_connections 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08f0188be0 0x7f08f0178260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08f01860b0 0x7f08f017f170 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 --2- 172.21.15.100:0/1984673900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08f0185cd0 0x7f08f0220430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:28.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.115+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 >> 172.21.15.100:0/1984673900 conn(0x7f08f00fe060 msgr2=0x7f08f008d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:28.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.116+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 shutdown_connections 2024-02-21T07:56:28.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:28.116+0000 7f08ef200640 1 -- 172.21.15.100:0/1984673900 wait complete. 2024-02-21T07:56:28.161 INFO:tasks.cephfs.filesystem:scrub status for tag:34742f1c-2547-474f-90e6-e968da7a81f2 - {'path': '/', 'tag': '34742f1c-2547-474f-90e6-e968da7a81f2', 'options': 'recursive,force'} 2024-02-21T07:56:32.951 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.949+0000 7fcd3b200640 1 Processor -- start 2024-02-21T07:56:32.952 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.950+0000 7fcd3b200640 1 -- start start 2024-02-21T07:56:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.953+0000 7fcd3b200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcd3418a160 0x7fcd3418a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:32.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.953+0000 7fcd3b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 0x7fcd340d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.953+0000 7fcd3b200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd34189cd0 con 0x7fcd34185ef0 2024-02-21T07:56:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.953+0000 7fcd3b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340ce8b0 con 0x7fcd3418ab00 2024-02-21T07:56:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.953+0000 7fcd3b200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340ceb90 con 0x7fcd3418a160 2024-02-21T07:56:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.954+0000 7fcd33400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcd3418a160 0x7fcd3418a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.954+0000 7fcd33400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcd3418a160 0x7fcd3418a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54650/0 (socket says 172.21.15.100:54650) 2024-02-21T07:56:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.954+0000 7fcd33400640 1 -- 172.21.15.100:0/1403875346 learned_addr learned my addr 172.21.15.100:0/1403875346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.956+0000 7fcd39200640 1 --2- 172.21.15.100:0/1403875346 >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 0x7fcd340d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.956+0000 7fcd33400640 1 -- 172.21.15.100:0/1403875346 >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 msgr2=0x7fcd340d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.959+0000 7fcd33400640 1 --2- 172.21.15.100:0/1403875346 >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 0x7fcd340d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.959+0000 7fcd33400640 1 -- 172.21.15.100:0/1403875346 >> v1:172.21.15.156:6789/0 conn(0x7fcd34185ef0 legacy=0x7fcd34189170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:32.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.959+0000 7fcd33400640 1 -- 172.21.15.100:0/1403875346 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340cee70 con 0x7fcd3418a160 2024-02-21T07:56:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.961+0000 7fcd39200640 1 --2- 172.21.15.100:0/1403875346 >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 0x7fcd340d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.961+0000 7fcd33400640 1 --2- 172.21.15.100:0/1403875346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418a160 0x7fcd3418a5c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcd340f89c0 tx=0x7fcd2402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34533a5fb6eeb8b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:32.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.962+0000 7fcd32a00640 1 -- 172.21.15.100:0/1403875346 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24031800 con 0x7fcd3418a160 2024-02-21T07:56:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.962+0000 7fcd32a00640 1 -- 172.21.15.100:0/1403875346 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24031960 con 0x7fcd3418a160 2024-02-21T07:56:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.962+0000 7fcd32a00640 1 -- 172.21.15.100:0/1403875346 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24031d30 con 0x7fcd3418a160 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.963+0000 7fcd3b200640 1 -- 172.21.15.100:0/1403875346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418a160 msgr2=0x7fcd3418a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.963+0000 7fcd3b200640 1 --2- 172.21.15.100:0/1403875346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418a160 0x7fcd3418a5c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcd340f89c0 tx=0x7fcd2402b8a0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 -- 172.21.15.100:0/1403875346 shutdown_connections 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 --2- 172.21.15.100:0/1403875346 >> v2:172.21.15.100:3300/0 conn(0x7fcd3418ab00 0x7fcd340d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 --2- 172.21.15.100:0/1403875346 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418a160 0x7fcd3418a5c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 -- 172.21.15.100:0/1403875346 >> 172.21.15.100:0/1403875346 conn(0x7fcd3408cfd0 msgr2=0x7fcd3408d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 -- 172.21.15.100:0/1403875346 shutdown_connections 2024-02-21T07:56:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.964+0000 7fcd3b200640 1 -- 172.21.15.100:0/1403875346 wait complete. 2024-02-21T07:56:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.967+0000 7fcd3b200640 1 Processor -- start 2024-02-21T07:56:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.967+0000 7fcd3b200640 1 -- start start 2024-02-21T07:56:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd34185ef0 0x7fcd34167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418ab00 0x7fcd341731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3421d210 con 0x7fcd34185ef0 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3421cc50 con 0x7fcd3418a160 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.969+0000 7fcd3b200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3421cf30 con 0x7fcd3418ab00 2024-02-21T07:56:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.970+0000 7fcd33400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.970+0000 7fcd33400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:53230/0 (socket says 172.21.15.100:53230) 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.970+0000 7fcd33400640 1 -- 172.21.15.100:0/2916212229 learned_addr learned my addr 172.21.15.100:0/2916212229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.970+0000 7fcd39200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418ab00 0x7fcd341731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.971+0000 7fcd33400640 1 -- 172.21.15.100:0/2916212229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418ab00 msgr2=0x7fcd341731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.971+0000 7fcd33400640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418ab00 0x7fcd341731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.971+0000 7fcd33400640 1 -- 172.21.15.100:0/2916212229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd34185ef0 msgr2=0x7fcd34167930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.971+0000 7fcd33400640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd34185ef0 0x7fcd34167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:32.975 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.971+0000 7fcd33400640 1 -- 172.21.15.100:0/2916212229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20013a10 con 0x7fcd3418a160 2024-02-21T07:56:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.976+0000 7fcd33400640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402b8e0 tx=0x7fcd240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.977+0000 7fcd2be00640 1 -- 172.21.15.100:0/2916212229 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2403aa50 con 0x7fcd3418a160 2024-02-21T07:56:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.977+0000 7fcd2be00640 1 -- 172.21.15.100:0/2916212229 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2403abb0 con 0x7fcd3418a160 2024-02-21T07:56:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.977+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd240094d0 con 0x7fcd3418a160 2024-02-21T07:56:32.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.977+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd34172470 con 0x7fcd3418a160 2024-02-21T07:56:32.980 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:32.978+0000 7fcd2be00640 1 -- 172.21.15.100:0/2916212229 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd24044420 con 0x7fcd3418a160 2024-02-21T07:56:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.004+0000 7fcd3dfc3740 1 Processor -- start 2024-02-21T07:56:33.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.004+0000 7fcd3dfc3740 1 -- start start 2024-02-21T07:56:33.006 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.004+0000 7fcd2be00640 1 -- 172.21.15.100:0/2916212229 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fcd24042070 con 0x7fcd3418a160 2024-02-21T07:56:33.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.007+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed042a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd2be00640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 0x7fcd140a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd39200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd39200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:53236/0 (socket says 172.21.15.100:53236) 2024-02-21T07:56:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd2be00640 1 -- 172.21.15.100:0/2916212229 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcd2402e070 con 0x7fcd3418a160 2024-02-21T07:56:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.008+0000 7fcd33400640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 0x7fcd140a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.009+0000 7fcd39200640 1 -- 172.21.15.100:0/2222769829 learned_addr learned my addr 172.21.15.100:0/2222769829 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.009+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed042f90 0x5613ed07e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.010+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecffe620 con 0x5613ed0b24d0 2024-02-21T07:56:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.010+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecfb08c0 con 0x5613ed07e070 2024-02-21T07:56:33.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.010+0000 7fcd33400640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 0x7fcd140a16e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd240c17a0 tx=0x7fcd24031f70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:33.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.010+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecfaddf0 con 0x5613ed042f90 2024-02-21T07:56:33.012 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.010+0000 7fcd33e00640 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed042a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed042f90 0x5613ed07e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 -- 172.21.15.100:0/2222769829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed042f90 msgr2=0x5613ed07e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed042f90 0x5613ed07e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.013 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 -- 172.21.15.100:0/2222769829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 msgr2=0x5613ed042a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed042a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.011+0000 7fcd39200640 1 -- 172.21.15.100:0/2222769829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ecf2ab00 con 0x5613ed07e070 2024-02-21T07:56:33.014 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.012+0000 7fcd39200640 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcd20012fb0 tx=0x7fcd20009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b08ccc0f152a23b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:33.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.013+0000 7fcd28c00640 1 -- 172.21.15.100:0/2222769829 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20009bf0 con 0x5613ed07e070 2024-02-21T07:56:33.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.014+0000 7fcd28c00640 1 -- 172.21.15.100:0/2222769829 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20019040 con 0x5613ed07e070 2024-02-21T07:56:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.015+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 msgr2=0x5613ed03d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.015+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcd20012fb0 tx=0x7fcd20009190 comp rx=0 tx=0).stop 2024-02-21T07:56:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.015+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 shutdown_connections 2024-02-21T07:56:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.016+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed042f90 0x5613ed07e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.017 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.016+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed042a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.016+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2222769829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed07e070 0x5613ed03d440 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.016+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 >> 172.21.15.100:0/2222769829 conn(0x5613ed00a4b0 msgr2=0x5613ed041ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.016+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 shutdown_connections 2024-02-21T07:56:33.018 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.017+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2222769829 wait complete. 2024-02-21T07:56:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.023+0000 7fcd3dfc3740 1 -- start start 2024-02-21T07:56:33.030 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.025+0000 7fcd3dfc3740 1 Processor -- start 2024-02-21T07:56:33.033 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed03d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecfa95d0 con 0x5613ed0b24d0 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecf4eb50 con 0x5613ed042f90 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ecf4e7f0 con 0x5613ed07e070 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.031+0000 7fcd3dfc3740 10 client.0 _ll_register_callbacks cb 0x5613ecf62550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:33.034 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.032+0000 7fcd39200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.032+0000 7fcd39200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38498/0 (socket says 172.21.15.100:38498) 2024-02-21T07:56:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.032+0000 7fcd39200640 1 -- 172.21.15.100:0/3259250236 learned_addr learned my addr 172.21.15.100:0/3259250236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.033+0000 7fcd33e00640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.035 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 -- 172.21.15.100:0/3259250236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 msgr2=0x5613ed03d350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed03d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 -- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 msgr2=0x5613ed03dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 -- 172.21.15.100:0/3259250236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd20012cd0 con 0x5613ed07e070 2024-02-21T07:56:33.036 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd33e00640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f4f0 tx=0x7fcd2c00f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1604c73ecf572d73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.034+0000 7fcd1d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.035+0000 7fcd39200640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.035+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0135e0 con 0x5613ed07e070 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.035+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcd2c013740 con 0x5613ed07e070 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.035+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613ecf7bcd0 con 0x5613ed07e070 2024-02-21T07:56:33.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.035+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd2c013900 con 0x5613ed07e070 2024-02-21T07:56:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.036+0000 7fcd3dfc3740 10 client.7241 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.036+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5613ecfa7c50 con 0x5613ed07e070 2024-02-21T07:56:33.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.036+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613ecf7bcd0 con 0x5613ed07e070 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.037+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcd2c012070 con 0x5613ed07e070 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.037+0000 7fcd3dfc3740 10 client.7241 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.037+0000 7fcd3dfc3740 10 client.7241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.037+0000 7fcd3dfc3740 20 client.7241 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.038+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed077110 0x5613ed0a7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.038+0000 7fcd3dfc3740 4 client.7241 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:33.039 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.038+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613ecf9fce0 con 0x5613ed077110 2024-02-21T07:56:33.040 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.039+0000 7fcd39200640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed077110 0x5613ed0a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.040+0000 7fcd39200640 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed077110 0x5613ed0a7210 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1759f16e468baf0c server_cookie=63ee42f44f23e547 in_seq=0 out_seq=0 2024-02-21T07:56:33.041 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.040+0000 7fcd1d600640 10 client.7241 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:33.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.040+0000 7fcd1d600640 1 -- 172.21.15.100:0/3259250236 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5613ecf9fce0 con 0x5613ed077110 2024-02-21T07:56:33.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.040+0000 7fcd1d600640 10 client.7241 handle_command_reply: tid=0 2024-02-21T07:56:33.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 client.7241 shutdown 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 msgr2=0x5613ed0c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4880 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f4f0 tx=0x7fcd2c00f9b0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 shutdown_connections 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed077110 0x5613ed0a7210 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed03dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4880 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.043 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd1d600640 0 client.7241 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:33.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/3259250236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed03d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 >> 172.21.15.100:0/3259250236 conn(0x5613ed00a4b0 msgr2=0x5613ed048e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:33.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 shutdown_connections 2024-02-21T07:56:33.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.041+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/3259250236 wait complete. 2024-02-21T07:56:33.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.042+0000 7fcd3dfc3740 20 client.7241 trim_cache size 0 max 16384 2024-02-21T07:56:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.072+0000 7fcd3dfc3740 1 Processor -- start 2024-02-21T07:56:33.074 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.072+0000 7fcd3dfc3740 1 -- start start 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 0x5613ed03ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed0b24d0 0x5613ed0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613eccf1e60 con 0x5613ed07e070 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ed03eac0 con 0x5613ed042f90 2024-02-21T07:56:33.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.074+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ed0a0f30 con 0x5613ed0b24d0 2024-02-21T07:56:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.075+0000 7fcd39200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.075+0000 7fcd39200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:53254/0 (socket says 172.21.15.100:53254) 2024-02-21T07:56:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.075+0000 7fcd39200640 1 -- 172.21.15.100:0/1330912054 learned_addr learned my addr 172.21.15.100:0/1330912054 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.075+0000 7fcd39200640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed0b24d0 0x5613ed0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.077 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.075+0000 7fcd33e00640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 0x5613ed03ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd39200640 1 -- 172.21.15.100:0/1330912054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed0b24d0 msgr2=0x5613ed0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd39200640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed0b24d0 0x5613ed0c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.078 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd39200640 1 -- 172.21.15.100:0/1330912054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 msgr2=0x5613ed03ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd39200640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 0x5613ed03ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd39200640 1 -- 172.21.15.100:0/1330912054 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ecf44530 con 0x5613ed042f90 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.076+0000 7fcd33e00640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 0x5613ed03ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.077+0000 7fcd39200640 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5613ed0409a0 tx=0x7fcd20021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6175c9bf728573f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.077+0000 7fcd1fe00640 1 -- 172.21.15.100:0/1330912054 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20030580 con 0x5613ed042f90 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.077+0000 7fcd1fe00640 1 -- 172.21.15.100:0/1330912054 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd20036070 con 0x5613ed042f90 2024-02-21T07:56:33.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.077+0000 7fcd1fe00640 1 -- 172.21.15.100:0/1330912054 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd200308e0 con 0x5613ed042f90 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/1330912054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 msgr2=0x5613ed0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x5613ed0409a0 tx=0x7fcd20021000 comp rx=0 tx=0).stop 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/1330912054 shutdown_connections 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed0b24d0 0x5613ed0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed07e070 0x5613ed03ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/1330912054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0b1710 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.079+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/1330912054 >> 172.21.15.100:0/1330912054 conn(0x5613ed00a4b0 msgr2=0x5613ed0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:33.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.085+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/1330912054 shutdown_connections 2024-02-21T07:56:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.085+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/1330912054 wait complete. 2024-02-21T07:56:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.086+0000 7fcd3dfc3740 1 -- start start 2024-02-21T07:56:33.088 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.086+0000 7fcd3dfc3740 1 Processor -- start 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.093+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.093+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd3dfc3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed109d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ed0c4ea0 con 0x5613ed0b24d0 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ed0482f0 con 0x5613ed042f90 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd3dfc3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ed120250 con 0x5613ed07e070 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd3dfc3740 10 client.0 _ll_register_callbacks cb 0x7fcd20013e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd33e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd33e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:54700/0 (socket says 172.21.15.100:54700) 2024-02-21T07:56:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd33e00640 1 -- 172.21.15.100:0/2333640862 learned_addr learned my addr 172.21.15.100:0/2333640862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.094+0000 7fcd39200640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.096+0000 7fcd33e00640 1 -- 172.21.15.100:0/2333640862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 msgr2=0x5613ed0a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.096+0000 7fcd39200640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.096+0000 7fcd33e00640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.096+0000 7fcd33e00640 1 -- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 msgr2=0x5613ed109d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.096+0000 7fcd33e00640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed109d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.097+0000 7fcd33e00640 1 -- 172.21.15.100:0/2333640862 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613ecfa7c50 con 0x5613ed07e070 2024-02-21T07:56:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.097+0000 7fcd39200640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.101+0000 7fcd33e00640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f400 tx=0x7fcd2c003ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a910592bbc5dc3ae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.101+0000 7fcd1d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.101+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c007e70 con 0x5613ed07e070 2024-02-21T07:56:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.101+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcd2c013c70 con 0x5613ed07e070 2024-02-21T07:56:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.102+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613ecfced30 con 0x5613ed07e070 2024-02-21T07:56:33.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.102+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd2c014880 con 0x5613ed07e070 2024-02-21T07:56:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.105+0000 7fcd3dfc3740 10 client.7247 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.105+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fcd20028040 con 0x5613ed07e070 2024-02-21T07:56:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.106+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613ecfced30 con 0x5613ed07e070 2024-02-21T07:56:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.106+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcd2c0149e0 con 0x5613ed07e070 2024-02-21T07:56:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 10 client.7247 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 10 client.7247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:33.110 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 20 client.7247 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed0b11e0 0x5613ed047ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 4 client.7247 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:56:33.111 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.108+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5613ecca9600 con 0x5613ed0b11e0 2024-02-21T07:56:33.112 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.111+0000 7fcd39200640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed0b11e0 0x5613ed047ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.117+0000 7fcd39200640 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed0b11e0 0x5613ed047ba0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4c53c83af35768 server_cookie=d1481ab36484f98c in_seq=0 out_seq=0 2024-02-21T07:56:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.118+0000 7fcd1d600640 10 client.7247 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.234+0000 7fcd1d600640 1 -- 172.21.15.100:0/2333640862 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5613ecca9600 con 0x5613ed0b11e0 2024-02-21T07:56:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.234+0000 7fcd1d600640 10 client.7247 handle_command_reply: tid=0 2024-02-21T07:56:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.234+0000 7fcd3dfc3740 1 client.7247 shutdown 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.234+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 msgr2=0x5613ed0c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.234+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00f400 tx=0x7fcd2c003ae0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.235+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 shutdown_connections 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.235+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613ed0b11e0 0x5613ed047ba0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.235+0000 7fcd1d600640 0 client.7247 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613ed0b24d0 0x5613ed109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613ed07e070 0x5613ed0c4560 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 --2- 172.21.15.100:0/2333640862 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613ed042f90 0x5613ed0a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 >> 172.21.15.100:0/2333640862 conn(0x5613ed00a4b0 msgr2=0x5613ed110b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 shutdown_connections 2024-02-21T07:56:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.236+0000 7fcd3dfc3740 1 -- 172.21.15.100:0/2333640862 wait complete. 2024-02-21T07:56:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.237+0000 7fcd3dfc3740 20 client.7247 trim_cache size 0 max 16384 2024-02-21T07:56:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:56:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:56:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:56:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:56:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.238+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 msgr2=0x7fcd140a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.238+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 0x7fcd140a16e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcd240c17a0 tx=0x7fcd24031f70 comp rx=0 tx=0).stop 2024-02-21T07:56:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.238+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 msgr2=0x7fcd34172c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.238+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcd2402b8e0 tx=0x7fcd240046c0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 shutdown_connections 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd3418ab00 0x7fcd341731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcd3418a160 0x7fcd34172c70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcd1409f220 0x7fcd140a16e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 --2- 172.21.15.100:0/2916212229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd34185ef0 0x7fcd34167930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.239+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 >> 172.21.15.100:0/2916212229 conn(0x7fcd3408cfd0 msgr2=0x7fcd34174280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.240+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 shutdown_connections 2024-02-21T07:56:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:33.240+0000 7fcd3b200640 1 -- 172.21.15.100:0/2916212229 wait complete. 2024-02-21T07:56:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.558+0000 7f2af4200640 1 Processor -- start 2024-02-21T07:56:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.558+0000 7f2af4200640 1 -- start start 2024-02-21T07:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.561+0000 7f2af4200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2aec0ccfc0 0x7f2aec18c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.561+0000 7f2af4200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2aec18ac00 0x7f2aec18b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.561+0000 7f2af4200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0f62c0 con 0x7f2aec18bcf0 2024-02-21T07:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.561+0000 7f2af4200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec189c30 con 0x7f2aec18ac00 2024-02-21T07:56:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.561+0000 7f2af4200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec189e40 con 0x7f2aec0ccfc0 2024-02-21T07:56:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.562+0000 7f2af2200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2aec18ac00 0x7f2aec18b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2aec18ac00 0x7f2aec18b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54406/0 (socket says 172.21.15.100:54406) 2024-02-21T07:56:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 -- 172.21.15.100:0/1264720434 learned_addr learned my addr 172.21.15.100:0/1264720434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af0e00640 1 --2- 172.21.15.100:0/1264720434 >> v2:172.21.15.170:3300/0 conn(0x7f2aec0ccfc0 0x7f2aec18c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 -- 172.21.15.100:0/1264720434 >> v2:172.21.15.170:3300/0 conn(0x7f2aec0ccfc0 msgr2=0x7f2aec18c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 --2- 172.21.15.100:0/1264720434 >> v2:172.21.15.170:3300/0 conn(0x7f2aec0ccfc0 0x7f2aec18c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 -- 172.21.15.100:0/1264720434 >> v1:172.21.15.100:6789/0 conn(0x7f2aec18bcf0 legacy=0x7f2aec18c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.563+0000 7f2af2200640 1 -- 172.21.15.100:0/1264720434 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec18a120 con 0x7f2aec18ac00 2024-02-21T07:56:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.567+0000 7f2af2200640 1 --2- 172.21.15.100:0/1264720434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec18b090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2aec04fa70 tx=0x7f2ad802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd07d229c4d15f4b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.572+0000 7f2aebe00640 1 -- 172.21.15.100:0/1264720434 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80317e0 con 0x7f2aec18ac00 2024-02-21T07:56:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.573+0000 7f2aebe00640 1 -- 172.21.15.100:0/1264720434 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8031940 con 0x7f2aec18ac00 2024-02-21T07:56:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.574+0000 7f2aebe00640 1 -- 172.21.15.100:0/1264720434 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8031cd0 con 0x7f2aec18ac00 2024-02-21T07:56:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.574+0000 7f2af4200640 1 -- 172.21.15.100:0/1264720434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 msgr2=0x7f2aec18b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.574+0000 7f2af4200640 1 --2- 172.21.15.100:0/1264720434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec18b090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2aec04fa70 tx=0x7f2ad802b880 comp rx=0 tx=0).stop 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 -- 172.21.15.100:0/1264720434 shutdown_connections 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 --2- 172.21.15.100:0/1264720434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec18b090 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 --2- 172.21.15.100:0/1264720434 >> v2:172.21.15.170:3300/0 conn(0x7f2aec0ccfc0 0x7f2aec18c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 -- 172.21.15.100:0/1264720434 >> 172.21.15.100:0/1264720434 conn(0x7f2aec0ce1b0 msgr2=0x7f2aec0ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 -- 172.21.15.100:0/1264720434 shutdown_connections 2024-02-21T07:56:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.575+0000 7f2af4200640 1 -- 172.21.15.100:0/1264720434 wait complete. 2024-02-21T07:56:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.579+0000 7f2af4200640 1 Processor -- start 2024-02-21T07:56:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.580+0000 7f2af4200640 1 -- start start 2024-02-21T07:56:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aec0ccfc0 0x7f2aec15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec160660 con 0x7f2aec18bcf0 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec162460 con 0x7f2aec18ac00 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.582+0000 7f2af4200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec15fae0 con 0x7f2aec0ccfc0 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.583+0000 7f2af2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.583+0000 7f2af2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33796/0 (socket says 172.21.15.100:33796) 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.583+0000 7f2af2200640 1 -- 172.21.15.100:0/3142110101 learned_addr learned my addr 172.21.15.100:0/3142110101 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 -- 172.21.15.100:0/3142110101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aec0ccfc0 msgr2=0x7f2aec15c890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aec0ccfc0 0x7f2aec15c890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 -- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 msgr2=0x7f2aec15cdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec15cdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 -- 172.21.15.100:0/3142110101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80094d0 con 0x7f2aec18bcf0 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.584+0000 7f2af2200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2ad802b8c0 tx=0x7f2ad80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.588 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.585+0000 7f2ae9600640 1 -- 172.21.15.100:0/3142110101 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8032880 con 0x7f2aec18bcf0 2024-02-21T07:56:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.585+0000 7f2ae9600640 1 -- 172.21.15.100:0/3142110101 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80329e0 con 0x7f2aec18bcf0 2024-02-21T07:56:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.585+0000 7f2ae9600640 1 -- 172.21.15.100:0/3142110101 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8032d50 con 0x7f2aec18bcf0 2024-02-21T07:56:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.585+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec15fdc0 con 0x7f2aec18bcf0 2024-02-21T07:56:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.585+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec160380 con 0x7f2aec18bcf0 2024-02-21T07:56:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.592+0000 7f2af6f96740 1 Processor -- start 2024-02-21T07:56:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.592+0000 7f2ae9600640 1 -- 172.21.15.100:0/3142110101 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2ad804e450 con 0x7f2aec18bcf0 2024-02-21T07:56:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.592+0000 7f2af6f96740 1 -- start start 2024-02-21T07:56:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.593+0000 7f2ae9600640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 0x7f2acc0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2ae9600640 1 -- 172.21.15.100:0/3142110101 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ad80ebb00 con 0x7f2aec18bcf0 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84125b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d841260a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 0x55d84129c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84121c620 con 0x55d84129c070 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8411ce8c0 con 0x55d841260f90 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af6f96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8411cbdf0 con 0x55d8412d04d0 2024-02-21T07:56:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.594+0000 7f2af0e00640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 0x7f2acc0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.595+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d841260a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.595+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d841260a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39214/0 (socket says 172.21.15.100:39214) 2024-02-21T07:56:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.595+0000 7f2af0e00640 1 -- 172.21.15.100:0/1593457516 learned_addr learned my addr 172.21.15.100:0/1593457516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.595+0000 7f2af0e00640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 0x7f2acc0a1630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0cd3c0 tx=0x7f2ae0009d20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.595+0000 7f2af2200640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 0x55d84129c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af1800640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84125b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 -- 172.21.15.100:0/1593457516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 msgr2=0x55d841260a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d841260a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 -- 172.21.15.100:0/1593457516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 msgr2=0x55d84125b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84125b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 -- 172.21.15.100:0/1593457516 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d841148b00 con 0x55d841260f90 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af1800640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84125b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.596+0000 7f2af2200640 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 0x55d84129c450 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80e94d0 tx=0x7f2ad8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669097d4237f10bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.597+0000 7f2ade000640 1 -- 172.21.15.100:0/1593457516 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80d6ea0 con 0x55d841260f90 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.597+0000 7f2ade000640 1 -- 172.21.15.100:0/1593457516 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad80b96d0 con 0x55d841260f90 2024-02-21T07:56:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.597+0000 7f2ade000640 1 -- 172.21.15.100:0/1593457516 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80bd820 con 0x55d841260f90 2024-02-21T07:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.598+0000 7f2af6f96740 1 -- 172.21.15.100:0/1593457516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 msgr2=0x55d84129c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.598+0000 7f2af6f96740 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 0x55d84129c450 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80e94d0 tx=0x7f2ad8009240 comp rx=0 tx=0).stop 2024-02-21T07:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.599+0000 7f2af6f96740 1 -- 172.21.15.100:0/1593457516 shutdown_connections 2024-02-21T07:56:46.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.599+0000 7f2af6f96740 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d841260f90 0x55d84129c450 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.599+0000 7f2af6f96740 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d841260a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.599+0000 7f2af6f96740 1 --2- 172.21.15.100:0/1593457516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84125b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.599+0000 7f2af6f96740 1 -- 172.21.15.100:0/1593457516 >> 172.21.15.100:0/1593457516 conn(0x55d8412284b0 msgr2=0x55d84125fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.601+0000 7f2af6f96740 1 -- 172.21.15.100:0/1593457516 shutdown_connections 2024-02-21T07:56:46.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.601+0000 7f2af6f96740 1 -- 172.21.15.100:0/1593457516 wait complete. 2024-02-21T07:56:46.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.603+0000 7f2af6f96740 1 -- start start 2024-02-21T07:56:46.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.603+0000 7f2af6f96740 1 Processor -- start 2024-02-21T07:56:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 0x55d841297750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84125a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.610 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8411c75d0 con 0x55d84129c070 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84116cb50 con 0x55d8412d04d0 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84116c7f0 con 0x55d841260f90 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af6f96740 10 client.0 _ll_register_callbacks cb 0x55d841180550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.606+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.607+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33812/0 (socket says 172.21.15.100:33812) 2024-02-21T07:56:46.611 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.607+0000 7f2af0e00640 1 -- 172.21.15.100:0/2582999360 learned_addr learned my addr 172.21.15.100:0/2582999360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.607+0000 7f2af0e00640 1 -- 172.21.15.100:0/2582999360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 msgr2=0x55d841297750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:56:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af1800640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 0x55d841297750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af2200640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84125a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af0e00640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 0x55d841297750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af0e00640 1 -- 172.21.15.100:0/2582999360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 msgr2=0x55d84125a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af0e00640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84125a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af0e00640 1 -- 172.21.15.100:0/2582999360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec160380 con 0x55d84129c070 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af1800640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 0x55d841297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2af0e00640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0015700 tx=0x7f2ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4381153694c324 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.608+0000 7f2ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.609+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0016980 con 0x55d84129c070 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.609+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ae0016ae0 con 0x55d84129c070 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.609+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d841199cd0 con 0x55d84129c070 2024-02-21T07:56:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.610+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ae0016ca0 con 0x55d84129c070 2024-02-21T07:56:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.610+0000 7f2af6f96740 10 client.7158 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.610+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d8411c5c50 con 0x55d84129c070 2024-02-21T07:56:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.611+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d841199cd0 con 0x55d84129c070 2024-02-21T07:56:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.611+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ae0011050 con 0x55d84129c070 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 10 client.7158 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 10 client.7158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 20 client.7158 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412c4870 0x55d841291da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 4 client.7158 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8411bdce0 con 0x55d8412c4870 2024-02-21T07:56:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.612+0000 7f2af1800640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412c4870 0x55d841291da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.613+0000 7f2af1800640 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412c4870 0x55d841291da0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3b402866f5a1c4 server_cookie=4018801f90a66ff3 in_seq=0 out_seq=0 2024-02-21T07:56:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.613+0000 7f2ad2a00640 10 client.7158 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.614+0000 7f2ad2a00640 1 -- 172.21.15.100:0/2582999360 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8411bdce0 con 0x55d8412c4870 2024-02-21T07:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.614+0000 7f2ad2a00640 10 client.7158 handle_command_reply: tid=0 2024-02-21T07:56:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.614+0000 7f2af6f96740 1 client.7158 shutdown 2024-02-21T07:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 msgr2=0x55d84129c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0015700 tx=0x7f2ae00046c0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 shutdown_connections 2024-02-21T07:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412c4870 0x55d841291da0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84125a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2ad2a00640 0 client.7158 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d84129c070 0x55d84129c450 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2582999360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d841260f90 0x55d841297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 >> 172.21.15.100:0/2582999360 conn(0x55d8412284b0 msgr2=0x55d8412d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 shutdown_connections 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.615+0000 7f2af6f96740 1 -- 172.21.15.100:0/2582999360 wait complete. 2024-02-21T07:56:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.616+0000 7f2af6f96740 20 client.7158 trim_cache size 0 max 16384 2024-02-21T07:56:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.641+0000 7f2af6f96740 1 Processor -- start 2024-02-21T07:56:46.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.642+0000 7f2af6f96740 1 -- start start 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d8412d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412c5fa0 0x55d84132f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d840f0fe60 con 0x55d841260f90 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84132f7f0 con 0x55d8412c5fa0 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af6f96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8412906c0 con 0x55d8412d04d0 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d8412d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af0e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d8412d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:39220/0 (socket says 172.21.15.100:39220) 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af2200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412c5fa0 0x55d84132f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.644+0000 7f2af1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33826/0 (socket says 172.21.15.100:33826) 2024-02-21T07:56:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 -- 172.21.15.100:0/2332835968 learned_addr learned my addr 172.21.15.100:0/2332835968 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 -- 172.21.15.100:0/2332835968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 msgr2=0x55d8412d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d8412d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 -- 172.21.15.100:0/2332835968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412c5fa0 msgr2=0x55d84132f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412c5fa0 0x55d84132f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.645+0000 7f2af1800640 1 -- 172.21.15.100:0/2332835968 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d841162530 con 0x55d841260f90 2024-02-21T07:56:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.646+0000 7f2af1800640 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55d84125a650 tx=0x7f2ae4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a167a698b5f7b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.646+0000 7f2add600640 1 -- 172.21.15.100:0/2332835968 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400c040 con 0x55d841260f90 2024-02-21T07:56:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.646+0000 7f2add600640 1 -- 172.21.15.100:0/2332835968 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae4019070 con 0x55d841260f90 2024-02-21T07:56:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.647+0000 7f2add600640 1 -- 172.21.15.100:0/2332835968 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400c040 con 0x55d841260f90 2024-02-21T07:56:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.649+0000 7f2af6f96740 1 -- 172.21.15.100:0/2332835968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 msgr2=0x55d84129ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.649+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x55d84125a650 tx=0x7f2ae4009040 comp rx=0 tx=0).stop 2024-02-21T07:56:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 -- 172.21.15.100:0/2332835968 shutdown_connections 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412c5fa0 0x55d84132f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d8412d04d0 0x55d8412d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 --2- 172.21.15.100:0/2332835968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841260f90 0x55d84129ca60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 -- 172.21.15.100:0/2332835968 >> 172.21.15.100:0/2332835968 conn(0x55d8412284b0 msgr2=0x55d841256bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 -- 172.21.15.100:0/2332835968 shutdown_connections 2024-02-21T07:56:46.653 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.650+0000 7f2af6f96740 1 -- 172.21.15.100:0/2332835968 wait complete. 2024-02-21T07:56:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.651+0000 7f2af6f96740 1 -- start start 2024-02-21T07:56:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.652+0000 7f2af6f96740 1 Processor -- start 2024-02-21T07:56:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.654+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.654+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d84128fe10 0x55d84132b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.654+0000 7f2af6f96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841290870 0x55d8412d83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.654+0000 7f2af1800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.654+0000 7f2af1800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:54452/0 (socket says 172.21.15.100:54452) 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84128c100 con 0x55d841290870 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af1800640 1 -- 172.21.15.100:0/4213333417 learned_addr learned my addr 172.21.15.100:0/4213333417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8412979f0 con 0x55d8412d04d0 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d841289260 con 0x55d84128fe10 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af6f96740 10 client.0 _ll_register_callbacks cb 0x7f2ad8032f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:46.658 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.655+0000 7f2af2200640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841290870 0x55d8412d83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af0e00640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d84128fe10 0x55d84132b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 -- 172.21.15.100:0/4213333417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d84128fe10 msgr2=0x55d84132b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d84128fe10 0x55d84132b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 -- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841290870 msgr2=0x55d8412d83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841290870 0x55d8412d83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae40019b0 con 0x55d8412d04d0 2024-02-21T07:56:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2af1800640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55d84125a6d0 tx=0x7f2ae40013a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc31ec6f126e8707 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.656+0000 7f2ad2a00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.657+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4006e10 con 0x55d8412d04d0 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.657+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ae400c040 con 0x55d8412d04d0 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.658+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8412d00f0 con 0x55d8412d04d0 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.658+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ae4001670 con 0x55d8412d04d0 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.658+0000 7f2af6f96740 10 client.7351 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.658+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d8411882c0 con 0x55d8412d04d0 2024-02-21T07:56:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8412d00f0 con 0x55d8412d04d0 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ae40050e0 con 0x55d8412d04d0 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 10 client.7351 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 10 client.7351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 20 client.7351 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412929c0 0x55d8412d8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 4 client.7351 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.659+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8411ecd30 con 0x55d8412929c0 2024-02-21T07:56:46.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.660+0000 7f2af0e00640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412929c0 0x55d8412d8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.661+0000 7f2af0e00640 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412929c0 0x55d8412d8930 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d86fd943cc9c15f server_cookie=a33bf80edf47d451 in_seq=0 out_seq=0 2024-02-21T07:56:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.661+0000 7f2ad2a00640 10 client.7351 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.685+0000 7f2ad2a00640 1 -- 172.21.15.100:0/4213333417 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8411ecd30 con 0x55d8412929c0 2024-02-21T07:56:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.685+0000 7f2ad2a00640 10 client.7351 handle_command_reply: tid=0 2024-02-21T07:56:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.685+0000 7f2af6f96740 1 client.7351 shutdown 2024-02-21T07:56:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.685+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 msgr2=0x55d84132bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.688 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.685+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55d84125a6d0 tx=0x7f2ae40013a0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 shutdown_connections 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55d8412929c0 0x55d8412d8930 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d841290870 0x55d8412d83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d84128fe10 0x55d84132b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 --2- 172.21.15.100:0/4213333417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8412d04d0 0x55d84132bdd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 >> 172.21.15.100:0/4213333417 conn(0x55d8412284b0 msgr2=0x55d84129c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.687+0000 7f2ad2a00640 0 client.7351 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.688+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 shutdown_connections 2024-02-21T07:56:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.688+0000 7f2af6f96740 1 -- 172.21.15.100:0/4213333417 wait complete. 2024-02-21T07:56:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.688+0000 7f2af6f96740 20 client.7351 trim_cache size 0 max 16384 2024-02-21T07:56:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:56:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:56:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:56:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:56:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.690+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 msgr2=0x7f2acc0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.690+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 0x7f2acc0a1630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0cd3c0 tx=0x7f2ae0009d20 comp rx=0 tx=0).stop 2024-02-21T07:56:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.690+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 msgr2=0x7f2aec0d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.690+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2ad802b8c0 tx=0x7f2ad80046c0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 shutdown_connections 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2acc09f170 0x7f2acc0a1630 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec18bcf0 0x7f2aec0d0990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2aec18ac00 0x7f2aec15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 --2- 172.21.15.100:0/3142110101 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2aec0ccfc0 0x7f2aec15c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 >> 172.21.15.100:0/3142110101 conn(0x7f2aec0ce1b0 msgr2=0x7f2aec186bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.693+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 shutdown_connections 2024-02-21T07:56:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:46.694+0000 7f2af4200640 1 -- 172.21.15.100:0/3142110101 wait complete. 2024-02-21T07:56:47.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:47.932 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:47.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:56:58.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:56:58.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:56:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.501+0000 7f08f4000640 1 Processor -- start 2024-02-21T07:56:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.501+0000 7f08f4000640 1 -- start start 2024-02-21T07:56:58.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.505+0000 7f08f4000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f08ec08e630 0x7f08ec17e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.505+0000 7f08f4000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f08ec070670 0x7f08ec185df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.506+0000 7f08f4000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec0f4760 con 0x7f08ec070b20 2024-02-21T07:56:58.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.507+0000 7f08f4000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec186a40 con 0x7f08ec08e630 2024-02-21T07:56:58.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.507+0000 7f08f4000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0f49b0 con 0x7f08ec070670 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.507+0000 7f08f2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f08ec070b20 0x7f08ec186330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41216/0 (socket says 172.21.15.100:41216) 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.507+0000 7f08f2000640 1 -- 172.21.15.100:0/2238064016 learned_addr learned my addr 172.21.15.100:0/2238064016 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.507+0000 7f08f1600640 1 --2- 172.21.15.100:0/2238064016 >> v2:172.21.15.156:3300/0 conn(0x7f08ec08e630 0x7f08ec17e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.508+0000 7f08ebe00640 1 -- 172.21.15.100:0/2238064016 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284536772 0 0) 0x7f08ec0f4760 con 0x7f08ec070b20 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.508+0000 7f08f1600640 1 -- 172.21.15.100:0/2238064016 >> v2:172.21.15.170:3300/0 conn(0x7f08ec070670 msgr2=0x7f08ec185df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.509+0000 7f08f1600640 1 --2- 172.21.15.100:0/2238064016 >> v2:172.21.15.170:3300/0 conn(0x7f08ec070670 0x7f08ec185df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.509+0000 7f08f1600640 1 -- 172.21.15.100:0/2238064016 >> v1:172.21.15.100:6789/0 conn(0x7f08ec070b20 legacy=0x7f08ec186330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.509+0000 7f08f1600640 1 -- 172.21.15.100:0/2238064016 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0f4c90 con 0x7f08ec08e630 2024-02-21T07:56:58.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.513+0000 7f08f1600640 1 --2- 172.21.15.100:0/2238064016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec17e970 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f08ec1824d0 tx=0x7f08e002b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d213a60cc7eaaf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.513+0000 7f08ebe00640 1 -- 172.21.15.100:0/2238064016 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031750 con 0x7f08ec08e630 2024-02-21T07:56:58.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.513+0000 7f08ebe00640 1 -- 172.21.15.100:0/2238064016 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e00318b0 con 0x7f08ec08e630 2024-02-21T07:56:58.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.515+0000 7f08f4000640 1 -- 172.21.15.100:0/2238064016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 msgr2=0x7f08ec17e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.516+0000 7f08ebe00640 1 -- 172.21.15.100:0/2238064016 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031750 con 0x7f08ec08e630 2024-02-21T07:56:58.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.516+0000 7f08f4000640 1 --2- 172.21.15.100:0/2238064016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec17e970 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f08ec1824d0 tx=0x7f08e002b7f0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.519+0000 7f08f4000640 1 -- 172.21.15.100:0/2238064016 shutdown_connections 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.519+0000 7f08f4000640 1 --2- 172.21.15.100:0/2238064016 >> v2:172.21.15.170:3300/0 conn(0x7f08ec070670 0x7f08ec185df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.519+0000 7f08f4000640 1 --2- 172.21.15.100:0/2238064016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec17e970 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.519+0000 7f08f4000640 1 -- 172.21.15.100:0/2238064016 >> 172.21.15.100:0/2238064016 conn(0x7f08ec0668b0 msgr2=0x7f08ec066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.520+0000 7f08f4000640 1 -- 172.21.15.100:0/2238064016 shutdown_connections 2024-02-21T07:56:58.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.520+0000 7f08f4000640 1 -- 172.21.15.100:0/2238064016 wait complete. 2024-02-21T07:56:58.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.524+0000 7f08f4000640 1 Processor -- start 2024-02-21T07:56:58.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.524+0000 7f08f4000640 1 -- start start 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 0x7f08ec16a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec071ce0 con 0x7f08ec070670 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec071fc0 con 0x7f08ec08e630 2024-02-21T07:56:58.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.527+0000 7f08f4000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0722a0 con 0x7f08ec070b20 2024-02-21T07:56:58.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.528+0000 7f08f0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.528+0000 7f08f0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:37120/0 (socket says 172.21.15.100:37120) 2024-02-21T07:56:58.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.528+0000 7f08f0c00640 1 -- 172.21.15.100:0/2892095217 learned_addr learned my addr 172.21.15.100:0/2892095217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:58.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.529+0000 7f08f1600640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 0x7f08ec16a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f0c00640 1 -- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 msgr2=0x7f08ec14ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:56:58.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f2000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f0c00640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec14ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f0c00640 1 -- 172.21.15.100:0/2892095217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 msgr2=0x7f08ec16a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f0c00640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 0x7f08ec16a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.530+0000 7f08f0c00640 1 -- 172.21.15.100:0/2892095217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0009400 con 0x7f08ec070b20 2024-02-21T07:56:58.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.531+0000 7f08f1600640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 0x7f08ec16a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:58.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.536+0000 7f08f0c00640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f08d800b4a0 tx=0x7f08d800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.546+0000 7f08e9600640 1 -- 172.21.15.100:0/2892095217 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8010610 con 0x7f08ec070b20 2024-02-21T07:56:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.546+0000 7f08e9600640 1 -- 172.21.15.100:0/2892095217 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8010770 con 0x7f08ec070b20 2024-02-21T07:56:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.546+0000 7f08e9600640 1 -- 172.21.15.100:0/2892095217 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8010b20 con 0x7f08ec070b20 2024-02-21T07:56:58.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.547+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec072580 con 0x7f08ec070b20 2024-02-21T07:56:58.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.548+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec14a860 con 0x7f08ec070b20 2024-02-21T07:56:58.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.558+0000 7f08e9600640 1 -- 172.21.15.100:0/2892095217 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f08d8010c80 con 0x7f08ec070b20 2024-02-21T07:56:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.559+0000 7f08f6dc9740 1 Processor -- start 2024-02-21T07:56:58.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.560+0000 7f08e9600640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.560+0000 7f08e9600640 1 -- 172.21.15.100:0/2892095217 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08d80c9030 con 0x7f08ec070b20 2024-02-21T07:56:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.566+0000 7f08f6dc9740 1 -- start start 2024-02-21T07:56:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.568+0000 7f08f2000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.569+0000 7f08f2000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f08e4001560 tx=0x7f08e4012040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac18fc0 0x55669ac4ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669abdbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ab50150 con 0x55669ac198e0 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ab4d680 con 0x55669ac18fc0 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ab48e60 con 0x55669ac4ef80 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:37128/0 (socket says 172.21.15.100:37128) 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.571+0000 7f08f0c00640 1 -- 172.21.15.100:0/326418235 learned_addr learned my addr 172.21.15.100:0/326418235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f2000640 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669abdbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 -- 172.21.15.100:0/326418235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac18fc0 msgr2=0x55669ac4ea40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac18fc0 0x55669ac4ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 -- 172.21.15.100:0/326418235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 msgr2=0x55669abdbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669abdbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 -- 172.21.15.100:0/326418235 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55669ab02060 con 0x55669ac4ef80 2024-02-21T07:56:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08f0c00640 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f08d8092ee0 tx=0x7f08d8097210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce1be245d8e0354 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.572+0000 7f08ddc00640 1 -- 172.21.15.100:0/326418235 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d809f2b0 con 0x55669ac4ef80 2024-02-21T07:56:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.573+0000 7f08ddc00640 1 -- 172.21.15.100:0/326418235 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80c6e90 con 0x55669ac4ef80 2024-02-21T07:56:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.573+0000 7f08ddc00640 1 -- 172.21.15.100:0/326418235 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80aab60 con 0x55669ac4ef80 2024-02-21T07:56:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.573+0000 7f08f6dc9740 1 -- 172.21.15.100:0/326418235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 msgr2=0x55669ac193a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.573+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f08d8092ee0 tx=0x7f08d8097210 comp rx=0 tx=0).stop 2024-02-21T07:56:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 -- 172.21.15.100:0/326418235 shutdown_connections 2024-02-21T07:56:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669abdbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669ac193a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/326418235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac18fc0 0x55669ac4ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 -- 172.21.15.100:0/326418235 >> 172.21.15.100:0/326418235 conn(0x55669aba85a0 msgr2=0x55669abdfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 -- 172.21.15.100:0/326418235 shutdown_connections 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.577+0000 7f08f6dc9740 1 -- 172.21.15.100:0/326418235 wait complete. 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.579+0000 7f08f6dc9740 1 -- start start 2024-02-21T07:56:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.580+0000 7f08f6dc9740 1 Processor -- start 2024-02-21T07:56:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669ac44f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 0x55669ac47360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669aaedec0 con 0x55669ac18fc0 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669aaedb60 con 0x55669ac4ef80 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.585+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669a8b71c0 con 0x55669ac198e0 2024-02-21T07:56:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.586+0000 7f08f6dc9740 10 client.0 _ll_register_callbacks cb 0x55669ab01960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.586+0000 7f08f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669ac44f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60440/0 (socket says 172.21.15.100:60440) 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f2000640 1 -- 172.21.15.100:0/1776100348 learned_addr learned my addr 172.21.15.100:0/1776100348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 0x55669ac47360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 -- 172.21.15.100:0/1776100348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 msgr2=0x55669ac60f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 -- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 msgr2=0x55669ac44f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669ac44f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.587+0000 7f08f0c00640 1 -- 172.21.15.100:0/1776100348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec14a860 con 0x55669ac198e0 2024-02-21T07:56:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08f2000640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:56:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08f1600640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669ac44f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08f0c00640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 0x55669ac47360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f08d80c69d0 tx=0x7f08d800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5378fc700a27a498 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08d2000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d809f330 con 0x55669ac198e0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08d8097e40 con 0x55669ac198e0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.588+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55669a8487e0 con 0x55669ac198e0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.589+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08d80aab60 con 0x55669ac198e0 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.589+0000 7f08f6dc9740 10 client.7268 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.589+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55669ab474e0 con 0x55669ac198e0 2024-02-21T07:56:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80b9080 con 0x55669ac198e0 2024-02-21T07:56:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f08d8095f60 con 0x55669ac198e0 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 10 client.7268 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 10 client.7268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 20 client.7268 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669ac10bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 4 client.7268 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.590+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55669a885720 con 0x55669ac61c50 2024-02-21T07:56:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.591+0000 7f08f1600640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669ac10bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.593+0000 7f08f1600640 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669ac10bf0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84b87874c33026f server_cookie=a9126be24c8a8ff1 in_seq=0 out_seq=0 2024-02-21T07:56:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.594+0000 7f08d2000640 10 client.7268 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.594+0000 7f08d2000640 1 -- 172.21.15.100:0/1776100348 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55669a885720 con 0x55669ac61c50 2024-02-21T07:56:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.594+0000 7f08d2000640 10 client.7268 handle_command_reply: tid=0 2024-02-21T07:56:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.594+0000 7f08f6dc9740 1 client.7268 shutdown 2024-02-21T07:56:58.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.595+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 msgr2=0x55669ac47360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.595+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 0x55669ac47360 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f08d80c69d0 tx=0x7f08d800bf90 comp rx=0 tx=0).stop 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 shutdown_connections 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669ac10bf0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08d2000640 0 client.7268 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669ac60f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac198e0 0x55669ac47360 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/1776100348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669ac44f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.596+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 >> 172.21.15.100:0/1776100348 conn(0x55669aba85a0 msgr2=0x55669ac50c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.597+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 shutdown_connections 2024-02-21T07:56:58.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.598+0000 7f08f6dc9740 1 -- 172.21.15.100:0/1776100348 wait complete. 2024-02-21T07:56:58.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.599+0000 7f08f6dc9740 20 client.7268 trim_cache size 0 max 16384 2024-02-21T07:56:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.640+0000 7f08f6dc9740 1 Processor -- start 2024-02-21T07:56:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.641+0000 7f08f6dc9740 1 -- start start 2024-02-21T07:56:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.643+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669abd6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.644+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac198e0 0x55669ac5e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.644+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.644+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ac222b0 con 0x55669ac18fc0 2024-02-21T07:56:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.644+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669abdb600 con 0x55669ac198e0 2024-02-21T07:56:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.644+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669abd7440 con 0x55669ac4ef80 2024-02-21T07:56:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.646+0000 7f08f2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.646+0000 7f08f2000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:37150/0 (socket says 172.21.15.100:37150) 2024-02-21T07:56:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.646+0000 7f08f2000640 1 -- 172.21.15.100:0/2507442091 learned_addr learned my addr 172.21.15.100:0/2507442091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.647+0000 7f08f2000640 1 -- 172.21.15.100:0/2507442091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac198e0 msgr2=0x55669ac5e330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.647+0000 7f08f2000640 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac198e0 0x55669ac5e330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.647+0000 7f08f2000640 1 -- 172.21.15.100:0/2507442091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 msgr2=0x55669abd6f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.647+0000 7f08f2000640 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669abd6f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.647+0000 7f08f2000640 1 -- 172.21.15.100:0/2507442091 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55669aae3950 con 0x55669ac4ef80 2024-02-21T07:56:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.648+0000 7f08f2000640 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08e4010300 tx=0x7f08e401a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a55c7bc4202f7b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.650+0000 7f08dd200640 1 -- 172.21.15.100:0/2507442091 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e400a070 con 0x55669ac4ef80 2024-02-21T07:56:58.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.651+0000 7f08dd200640 1 -- 172.21.15.100:0/2507442091 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e401b410 con 0x55669ac4ef80 2024-02-21T07:56:58.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.651+0000 7f08dd200640 1 -- 172.21.15.100:0/2507442091 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e401b580 con 0x55669ac4ef80 2024-02-21T07:56:58.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.651+0000 7f08f6dc9740 1 -- 172.21.15.100:0/2507442091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 msgr2=0x55669acabb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.651+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f08e4010300 tx=0x7f08e401a000 comp rx=0 tx=0).stop 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 -- 172.21.15.100:0/2507442091 shutdown_connections 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac4ef80 0x55669acabb10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac198e0 0x55669ac5e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/2507442091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac18fc0 0x55669abd6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 -- 172.21.15.100:0/2507442091 >> 172.21.15.100:0/2507442091 conn(0x55669aba85a0 msgr2=0x55669ac47160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 -- 172.21.15.100:0/2507442091 shutdown_connections 2024-02-21T07:56:58.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.652+0000 7f08f6dc9740 1 -- 172.21.15.100:0/2507442091 wait complete. 2024-02-21T07:56:58.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.653+0000 7f08f6dc9740 1 -- start start 2024-02-21T07:56:58.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.654+0000 7f08f6dc9740 1 Processor -- start 2024-02-21T07:56:58.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.656+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 0x55669ac5e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.656+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669aca7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.656+0000 7f08f6dc9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ac684e0 con 0x55669ac198e0 2024-02-21T07:56:58.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669ac5e870 con 0x55669ac4ef80 2024-02-21T07:56:58.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f6dc9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669abdc300 con 0x55669ac18fc0 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f6dc9740 10 client.0 _ll_register_callbacks cb 0x55669ac505a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f2000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60446/0 (socket says 172.21.15.100:60446) 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.657+0000 7f08f2000640 1 -- 172.21.15.100:0/3696598887 learned_addr learned my addr 172.21.15.100:0/3696598887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.658+0000 7f08f0c00640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669aca7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.658+0000 7f08f1600640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 0x55669ac5e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.658+0000 7f08f2000640 1 -- 172.21.15.100:0/3696598887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 msgr2=0x55669ac5e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.658+0000 7f08f2000640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 0x55669ac5e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.658+0000 7f08f2000640 1 -- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 msgr2=0x55669aca7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:58.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.659+0000 7f08f2000640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669aca7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.659+0000 7f08f2000640 1 -- 172.21.15.100:0/3696598887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4025040 con 0x55669ac4ef80 2024-02-21T07:56:58.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.660+0000 7f08f1600640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 0x55669ac5e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:56:58.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.660+0000 7f08f2000640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f08e4012010 tx=0x7f08e4001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc60040235d190b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:58.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.661+0000 7f08d2000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.661+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e402f070 con 0x55669ac4ef80 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.661+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f08e400e8c0 con 0x55669ac4ef80 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.661+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08d80c6e90 con 0x55669ac4ef80 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.661+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08e4010c60 con 0x55669ac4ef80 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.662+0000 7f08f6dc9740 10 client.7360 fetch_fsmap learned FSMap version 17 2024-02-21T07:56:58.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.662+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55669ab09430 con 0x55669ac4ef80 2024-02-21T07:56:58.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.666+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80c6e90 con 0x55669ac4ef80 2024-02-21T07:56:58.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.666+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f08e4032030 con 0x55669ac4ef80 2024-02-21T07:56:58.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 10 client.7360 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:56:58.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 10 client.7360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:56:58.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 20 client.7360 populate_metadata read hostname 'smithi100' 2024-02-21T07:56:58.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669aca8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:58.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 4 client.7360 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:56:58.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.667+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55669a8d4890 con 0x55669ac61c50 2024-02-21T07:56:58.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.672+0000 7f08f1600640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669aca8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:58.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.674+0000 7f08f1600640 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669aca8460 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0dc76d49091cfe server_cookie=5f95a98d3707d40c in_seq=0 out_seq=0 2024-02-21T07:56:58.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.679+0000 7f08d2000640 10 client.7360 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.679+0000 7f08d2000640 1 -- 172.21.15.100:0/3696598887 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55669a8d4890 con 0x55669ac61c50 2024-02-21T07:56:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.679+0000 7f08d2000640 10 client.7360 handle_command_reply: tid=0 2024-02-21T07:56:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.679+0000 7f08f6dc9740 1 client.7360 shutdown 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.684+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 msgr2=0x55669aca7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.684+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f08e4012010 tx=0x7f08e4001400 comp rx=0 tx=0).stop 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.684+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 shutdown_connections 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55669ac61c50 0x55669aca8460 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55669ac4ef80 0x55669aca7f20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55669ac198e0 0x55669aca7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08f6dc9740 1 --2- 172.21.15.100:0/3696598887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55669ac18fc0 0x55669ac5e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 >> 172.21.15.100:0/3696598887 conn(0x55669aba85a0 msgr2=0x55669abdcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.685+0000 7f08d2000640 0 client.7360 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:56:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.687+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 shutdown_connections 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.687+0000 7f08f6dc9740 1 -- 172.21.15.100:0/3696598887 wait complete. 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.688+0000 7f08f6dc9740 20 client.7360 trim_cache size 0 max 16384 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:56:58.693 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.688+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 msgr2=0x7f08cc0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.688+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f08e4001560 tx=0x7f08e4012040 comp rx=0 tx=0).stop 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.688+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 msgr2=0x7f08ec071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.688+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f08d800b4a0 tx=0x7f08d800b960 comp rx=0 tx=0).stop 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 shutdown_connections 2024-02-21T07:56:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f08ec08e630 0x7f08ec14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f08ec070b20 0x7f08ec071330 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f08cc09f1f0 0x7f08cc0a16b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 --2- 172.21.15.100:0/2892095217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08ec070670 0x7f08ec16a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 >> 172.21.15.100:0/2892095217 conn(0x7f08ec0668b0 msgr2=0x7f08ec0f5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 shutdown_connections 2024-02-21T07:56:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:58.689+0000 7f08f4000640 1 -- 172.21.15.100:0/2892095217 wait complete. 2024-02-21T07:56:58.741 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:56:58.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:56:59.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.173+0000 7f630ca00640 1 Processor -- start 2024-02-21T07:56:59.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.173+0000 7f630ca00640 1 -- start start 2024-02-21T07:56:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.185+0000 7f630ca00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f630806d950 0x7f63080f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.186+0000 7f630ca00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630818a800 con 0x7f63080f80d0 2024-02-21T07:56:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.186+0000 7f630ca00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630806de80 con 0x7f630818a420 2024-02-21T07:56:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.186+0000 7f630ca00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63080f9b50 con 0x7f630806d950 2024-02-21T07:56:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.187+0000 7f6305e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f630818a420 0x7f6308070f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:48114/0 (socket says 172.21.15.100:48114) 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.187+0000 7f6305e00640 1 -- 172.21.15.100:0/2939231481 learned_addr learned my addr 172.21.15.100:0/2939231481 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.188+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746581233 0 0) 0x7f630806de80 con 0x7f630818a420 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.188+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62ec003520 con 0x7f630818a420 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1155347064 0 0) 0x7f62ec003520 con 0x7f630818a420 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 >> v2:172.21.15.156:3300/0 conn(0x7f630806d950 msgr2=0x7f63080f7b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 --2- 172.21.15.100:0/2939231481 >> v2:172.21.15.156:3300/0 conn(0x7f630806d950 0x7f63080f7b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 >> v1:172.21.15.100:6789/0 conn(0x7f63080f80d0 legacy=0x7f630818ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630806e160 con 0x7f630818a420 2024-02-21T07:56:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f63000019f0 con 0x7f630818a420 2024-02-21T07:56:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 >> v1:172.21.15.170:6789/0 conn(0x7f630818a420 legacy=0x7f6308070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f62ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62ec0047c0 0x7f62ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62ec009970 0x7f62ec00bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080f9b50 con 0x7f62ec0047c0 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec00c350 con 0x7f62ec009970 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec00c510 con 0x7f62ec0039c0 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6306800640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62ec009970 0x7f62ec00bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.189+0000 7f6305e00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f62ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6305e00640 1 -- 172.21.15.100:0/2939231481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62ec009970 msgr2=0x7f62ec00bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6305e00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62ec009970 0x7f62ec00bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6305e00640 1 -- 172.21.15.100:0/2939231481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62ec0047c0 msgr2=0x7f62ec004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6305e00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f62ec0047c0 0x7f62ec004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6305e00640 1 -- 172.21.15.100:0/2939231481 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630806e160 con 0x7f62ec0039c0 2024-02-21T07:56:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.190+0000 7f6306800640 1 -- 172.21.15.100:0/2939231481 reap_dead start 2024-02-21T07:56:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.195+0000 7f6305e00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f62ec003de0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f630000a870 tx=0x7f62ec0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdba6783db13b5e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.195+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000072d0 con 0x7f62ec0039c0 2024-02-21T07:56:59.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.195+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630002f070 con 0x7f62ec0039c0 2024-02-21T07:56:59.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.195+0000 7f6304a00640 1 -- 172.21.15.100:0/2939231481 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000076d0 con 0x7f62ec0039c0 2024-02-21T07:56:59.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.196+0000 7f630ca00640 1 -- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 msgr2=0x7f62ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.196+0000 7f630ca00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f62ec003de0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f630000a870 tx=0x7f62ec0057f0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.197+0000 7f630ca00640 1 -- 172.21.15.100:0/2939231481 shutdown_connections 2024-02-21T07:56:59.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.197+0000 7f630ca00640 1 --2- 172.21.15.100:0/2939231481 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f62ec003de0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.197+0000 7f630ca00640 1 -- 172.21.15.100:0/2939231481 >> 172.21.15.100:0/2939231481 conn(0x7f63080ce160 msgr2=0x7f63080ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:59.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.200+0000 7f630ca00640 1 -- 172.21.15.100:0/2939231481 shutdown_connections 2024-02-21T07:56:59.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.201+0000 7f630ca00640 1 -- 172.21.15.100:0/2939231481 wait complete. 2024-02-21T07:56:59.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.207+0000 7f630ca00640 1 Processor -- start 2024-02-21T07:56:59.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.208+0000 7f630ca00640 1 -- start start 2024-02-21T07:56:59.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080f0530 0x7f6308221a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6308221f70 0x7f6308226420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63082261d0 con 0x7f63080f0530 2024-02-21T07:56:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6308225c10 con 0x7f6308221f70 2024-02-21T07:56:59.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.211+0000 7f630ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6308225ef0 con 0x7f62ec0039c0 2024-02-21T07:56:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.212+0000 7f6305e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.213+0000 7f6305e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:37186/0 (socket says 172.21.15.100:37186) 2024-02-21T07:56:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.213+0000 7f6305e00640 1 -- 172.21.15.100:0/4166061844 learned_addr learned my addr 172.21.15.100:0/4166061844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:56:59.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.213+0000 7f6305400640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080f0530 0x7f6308221a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.213+0000 7f6306800640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6308221f70 0x7f6308226420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.214+0000 7f6305e00640 1 -- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6308221f70 msgr2=0x7f6308226420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.214+0000 7f6305e00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6308221f70 0x7f6308226420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.214+0000 7f6305e00640 1 -- 172.21.15.100:0/4166061844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080f0530 msgr2=0x7f6308221a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.214+0000 7f6305e00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080f0530 0x7f6308221a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.215+0000 7f6305e00640 1 -- 172.21.15.100:0/4166061844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308220f50 con 0x7f62ec0039c0 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.216+0000 7f6305e00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f630000a990 tx=0x7f6300001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.216+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000074e0 con 0x7f62ec0039c0 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.216+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300007640 con 0x7f62ec0039c0 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.216+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000079b0 con 0x7f62ec0039c0 2024-02-21T07:56:59.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.216+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6308221230 con 0x7f62ec0039c0 2024-02-21T07:56:59.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.217+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6308177850 con 0x7f62ec0039c0 2024-02-21T07:56:59.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.219+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63080724f0 con 0x7f62ec0039c0 2024-02-21T07:56:59.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.222+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6300031030 con 0x7f62ec0039c0 2024-02-21T07:56:59.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.224+0000 7f62fe000640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 0x7f62e80a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:56:59.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.224+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63000eb670 con 0x7f62ec0039c0 2024-02-21T07:56:59.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.224+0000 7f6305400640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 0x7f62e80a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:56:59.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.225+0000 7f6305400640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 0x7f62e80a16b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6308220cf0 tx=0x7f62f4004610 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:56:59.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.226+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63000b54a0 con 0x7f62ec0039c0 2024-02-21T07:56:59.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.767+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6308067c80 con 0x7f62ec0039c0 2024-02-21T07:56:59.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.778+0000 7f62fe000640 1 -- 172.21.15.100:0/4166061844 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f6300045090 con 0x7f62ec0039c0 2024-02-21T07:56:59.780 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:56:59.780 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:56:59.780 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:56:59.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 msgr2=0x7f62e80a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 0x7f62e80a16b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6308220cf0 tx=0x7f62f4004610 comp rx=0 tx=0).stop 2024-02-21T07:56:59.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 msgr2=0x7f6308177310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:56:59.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f630000a990 tx=0x7f6300001cb0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 shutdown_connections 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6308221f70 0x7f6308226420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f62e809f1f0 0x7f62e80a16b0 secure :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6308220cf0 tx=0x7f62f4004610 comp rx=0 tx=0).stop 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080f0530 0x7f6308221a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 --2- 172.21.15.100:0/4166061844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62ec0039c0 0x7f6308177310 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:56:59.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.782+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 >> 172.21.15.100:0/4166061844 conn(0x7f63080ce160 msgr2=0x7f63080f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:56:59.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.794+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 shutdown_connections 2024-02-21T07:56:59.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:56:59.794+0000 7f630ca00640 1 -- 172.21.15.100:0/4166061844 wait complete. 2024-02-21T07:56:59.842 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:56:59.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:56:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:59.991+0000 7f2cb7000640 1 Processor -- start 2024-02-21T07:56:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:56:59.992+0000 7f2cb7000640 1 -- start start 2024-02-21T07:57:00.003 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.002+0000 7f2cb7000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cb015da00 0x7f2cb00d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.009 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.007+0000 7f2cb7000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2cb00f95b0 0x7f2cb018bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.007+0000 7f2cb7000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00d43a0 con 0x7f2cb00d3de0 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cb7000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb00d3a30 con 0x7f2cb015da00 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cb7000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb01898e0 con 0x7f2cb00f95b0 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.004+0000 7f2cafe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cb015da00 0x7f2cb00d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cafe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2cb015da00 0x7f2cb00d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33332/0 (socket says 172.21.15.100:33332) 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cafe00640 1 -- 172.21.15.100:0/2688085422 learned_addr learned my addr 172.21.15.100:0/2688085422 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cb5000640 1 --2- 172.21.15.100:0/2688085422 >> v2:172.21.15.170:3300/0 conn(0x7f2cb00f95b0 0x7f2cb018bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cafe00640 1 -- 172.21.15.100:0/2688085422 >> v2:172.21.15.170:3300/0 conn(0x7f2cb00f95b0 msgr2=0x7f2cb018bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2688085422 >> v2:172.21.15.170:3300/0 conn(0x7f2cb00f95b0 0x7f2cb018bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.008+0000 7f2cafe00640 1 -- 172.21.15.100:0/2688085422 >> v1:172.21.15.100:6789/0 conn(0x7f2cb00d3de0 legacy=0x7f2cb00f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.011 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.007+0000 7f2caf400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2cb00d3de0 0x7f2cb00f8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:32810/0 (socket says 172.21.15.100:32810) 2024-02-21T07:57:00.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.012+0000 7f2cafe00640 1 -- 172.21.15.100:0/2688085422 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00d4680 con 0x7f2cb015da00 2024-02-21T07:57:00.019 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.017+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2688085422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb015da00 0x7f2cb00d34f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00d4270 tx=0x7f2ca802bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9352d601f977453d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.018+0000 7f2caea00640 1 -- 172.21.15.100:0/2688085422 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca802c960 con 0x7f2cb015da00 2024-02-21T07:57:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.019+0000 7f2caea00640 1 -- 172.21.15.100:0/2688085422 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca802cac0 con 0x7f2cb015da00 2024-02-21T07:57:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.019+0000 7f2caea00640 1 -- 172.21.15.100:0/2688085422 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca802ce50 con 0x7f2cb015da00 2024-02-21T07:57:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.023+0000 7f2cb7000640 1 -- 172.21.15.100:0/2688085422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb015da00 msgr2=0x7f2cb00d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.024 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.023+0000 7f2cb7000640 1 --2- 172.21.15.100:0/2688085422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb015da00 0x7f2cb00d34f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00d4270 tx=0x7f2ca802bdc0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.023+0000 7f2cb7000640 1 -- 172.21.15.100:0/2688085422 shutdown_connections 2024-02-21T07:57:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.023+0000 7f2cb7000640 1 --2- 172.21.15.100:0/2688085422 >> v2:172.21.15.170:3300/0 conn(0x7f2cb00f95b0 0x7f2cb018bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.025 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.023+0000 7f2cb7000640 1 --2- 172.21.15.100:0/2688085422 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb015da00 0x7f2cb00d34f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.024+0000 7f2cb7000640 1 -- 172.21.15.100:0/2688085422 >> 172.21.15.100:0/2688085422 conn(0x7f2cb008cfd0 msgr2=0x7f2cb008d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.038 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.037+0000 7f2cb7000640 1 -- 172.21.15.100:0/2688085422 shutdown_connections 2024-02-21T07:57:00.044 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.037+0000 7f2cb7000640 1 -- 172.21.15.100:0/2688085422 wait complete. 2024-02-21T07:57:00.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.056+0000 7f2cb7000640 1 Processor -- start 2024-02-21T07:57:00.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.059+0000 7f2cb7000640 1 -- start start 2024-02-21T07:57:00.063 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.062+0000 7f2cb7000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.065 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.064+0000 7f2cb7000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb00f95b0 0x7f2cb021f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40602/0 (socket says 172.21.15.100:40602) 2024-02-21T07:57:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cb7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb015da00 0x7f2cb0153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cb7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb021fc50 con 0x7f2cb015da00 2024-02-21T07:57:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cb7000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0154770 con 0x7f2cb00f95b0 2024-02-21T07:57:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cb7000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0154a50 con 0x7f2cb00d3de0 2024-02-21T07:57:00.069 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.065+0000 7f2cafe00640 1 -- 172.21.15.100:0/22036758 learned_addr learned my addr 172.21.15.100:0/22036758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.068+0000 7f2cb5000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb015da00 0x7f2cb0153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.070 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.068+0000 7f2caf400640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb00f95b0 0x7f2cb021f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.069+0000 7f2cafe00640 1 -- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb00f95b0 msgr2=0x7f2cb021f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.069+0000 7f2cafe00640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb00f95b0 0x7f2cb021f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.069+0000 7f2cafe00640 1 -- 172.21.15.100:0/22036758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb015da00 msgr2=0x7f2cb0153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.069+0000 7f2cafe00640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb015da00 0x7f2cb0153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.071 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.069+0000 7f2cafe00640 1 -- 172.21.15.100:0/22036758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009b30 con 0x7f2cb00d3de0 2024-02-21T07:57:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.071+0000 7f2cafe00640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.072 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.071+0000 7f2ca7e00640 1 -- 172.21.15.100:0/22036758 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca803e450 con 0x7f2cb00d3de0 2024-02-21T07:57:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.071+0000 7f2ca7e00640 1 -- 172.21.15.100:0/22036758 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca803e5f0 con 0x7f2cb00d3de0 2024-02-21T07:57:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.071+0000 7f2ca7e00640 1 -- 172.21.15.100:0/22036758 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca803e9a0 con 0x7f2cb00d3de0 2024-02-21T07:57:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.071+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb0154d30 con 0x7f2cb00d3de0 2024-02-21T07:57:00.073 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.072+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb021ff10 con 0x7f2cb00d3de0 2024-02-21T07:57:00.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.078+0000 7f2cb9dbd740 1 Processor -- start 2024-02-21T07:57:00.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.078+0000 7f2cb9dbd740 1 -- start start 2024-02-21T07:57:00.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.082+0000 7f2ca7e00640 1 -- 172.21.15.100:0/22036758 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2ca803eb00 con 0x7f2cb00d3de0 2024-02-21T07:57:00.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.086+0000 7f2ca7e00640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 0x7f2c900a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.087+0000 7f2cb5000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 0x7f2c900a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.098 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.092+0000 7f2ca7e00640 1 -- 172.21.15.100:0/22036758 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ca80ec5f0 con 0x7f2cb00d3de0 2024-02-21T07:57:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 0x556e8b9ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8b9f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 0x556e8ba30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b9b0620 con 0x556e8ba30070 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b9628c0 con 0x556e8b9f4f90 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b95fdf0 con 0x556e8ba644d0 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb5000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 0x7f2c900a16e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009ad0 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.103 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 0x556e8ba30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 0x556e8ba30450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33348/0 (socket says 172.21.15.100:33348) 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.097+0000 7f2cb5000640 1 -- 172.21.15.100:0/2392558899 learned_addr learned my addr 172.21.15.100:0/2392558899 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.098+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 0x556e8b9ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 -- 172.21.15.100:0/2392558899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 msgr2=0x556e8b9f4a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8b9f4a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 -- 172.21.15.100:0/2392558899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 msgr2=0x556e8ba30450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 0x556e8ba30450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.104 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 -- 172.21.15.100:0/2392558899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e8b8dcb00 con 0x556e8ba30070 2024-02-21T07:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.100+0000 7f2cafe00640 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 0x556e8b9ef440 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80e9f60 tx=0x7f2ca80b6430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284513637ce431de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.101+0000 7f2ca4c00640 1 -- 172.21.15.100:0/2392558899 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca803edb0 con 0x556e8ba30070 2024-02-21T07:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.101+0000 7f2ca4c00640 1 -- 172.21.15.100:0/2392558899 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca80ba7d0 con 0x556e8ba30070 2024-02-21T07:57:00.105 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.101+0000 7f2ca4c00640 1 -- 172.21.15.100:0/2392558899 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80ba0d0 con 0x556e8ba30070 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.103+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/2392558899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 msgr2=0x556e8b9ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.103+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 0x556e8b9ef440 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80e9f60 tx=0x7f2ca80b6430 comp rx=0 tx=0).stop 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.104+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/2392558899 shutdown_connections 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.104+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8b9f4f90 0x556e8ba30450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.104+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8b9f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.104+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/2392558899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8ba30070 0x556e8b9ef440 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.106 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.104+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/2392558899 >> 172.21.15.100:0/2392558899 conn(0x556e8b9bc4b0 msgr2=0x556e8b9f3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.107 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.105+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/2392558899 shutdown_connections 2024-02-21T07:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.106+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/2392558899 wait complete. 2024-02-21T07:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.107+0000 7f2cb9dbd740 1 -- start start 2024-02-21T07:57:00.109 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.108+0000 7f2cb9dbd740 1 Processor -- start 2024-02-21T07:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.111+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.111+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8ba7c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.113 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.111+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba7ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.114 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b95b5d0 con 0x556e8b9f4f90 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b900b50 con 0x556e8ba644d0 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b9007f0 con 0x556e8ba30070 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cb9dbd740 10 client.0 _ll_register_callbacks cb 0x556e8b914550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46802/0 (socket says 172.21.15.100:46802) 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cafe00640 1 -- 172.21.15.100:0/511698795 learned_addr learned my addr 172.21.15.100:0/511698795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2caf400640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8ba7c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.115 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.113+0000 7f2cb5000640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba7ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.114+0000 7f2cafe00640 1 -- 172.21.15.100:0/511698795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 msgr2=0x556e8ba7c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.114+0000 7f2cafe00640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8ba7c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.114+0000 7f2cafe00640 1 -- 172.21.15.100:0/511698795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 msgr2=0x556e8ba7ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.114+0000 7f2cafe00640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba7ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.116 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.114+0000 7f2cafe00640 1 -- 172.21.15.100:0/511698795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb021ff10 con 0x556e8b9f4f90 2024-02-21T07:57:00.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.115+0000 7f2c99600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:00.117 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.115+0000 7f2cafe00640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80b8380 tx=0x7f2ca8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a6ffd1032f3168 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.118 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.116+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80ba530 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.116+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ca80ba7d0 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.116+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e8b92dcd0 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.118+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca80be220 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.118+0000 7f2cb9dbd740 10 client.7185 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.118+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556e8b959c50 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.121+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e8b92dcd0 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.121+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ca803c070 con 0x556e8b9f4f90 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 10 client.7185 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 10 client.7185 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 20 client.7185 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8ba5bf80 0x556e8ba1c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.125 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 4 client.7185 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.122+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e8b951ce0 con 0x556e8ba5bf80 2024-02-21T07:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.123+0000 7f2caf400640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8ba5bf80 0x556e8ba1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.124+0000 7f2caf400640 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8ba5bf80 0x556e8ba1c450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdfa8c6ac04a7a0e server_cookie=e1970cd4013dead1 in_seq=0 out_seq=0 2024-02-21T07:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.124+0000 7f2c99600640 10 client.7185 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:00.126 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.125+0000 7f2c99600640 1 -- 172.21.15.100:0/511698795 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556e8b951ce0 con 0x556e8ba5bf80 2024-02-21T07:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.125+0000 7f2c99600640 10 client.7185 handle_command_reply: tid=0 2024-02-21T07:57:00.128 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.126+0000 7f2cb9dbd740 1 client.7185 shutdown 2024-02-21T07:57:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.129+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 msgr2=0x556e8ba7efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.130 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.129+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80b8380 tx=0x7f2ca8009810 comp rx=0 tx=0).stop 2024-02-21T07:57:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 shutdown_connections 2024-02-21T07:57:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8ba5bf80 0x556e8ba1c450 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba7ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.131 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8ba7c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/511698795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8ba7efa0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 >> 172.21.15.100:0/511698795 conn(0x556e8b9bc4b0 msgr2=0x556e8ba64930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2c99600640 0 client.7185 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.130+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 shutdown_connections 2024-02-21T07:57:00.132 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.131+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/511698795 wait complete. 2024-02-21T07:57:00.133 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.131+0000 7f2cb9dbd740 20 client.7185 trim_cache size 0 max 16384 2024-02-21T07:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.152+0000 7f2cb9dbd740 1 Processor -- start 2024-02-21T07:57:00.153 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.152+0000 7f2cb9dbd740 1 -- start start 2024-02-21T07:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8b9f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8b9f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.154 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8ba7a680 con 0x556e8b9f4f90 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8b6a3e60 con 0x556e8ba644d0 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8ba5a160 con 0x556e8ba30070 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33362/0 (socket says 172.21.15.100:33362) 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cb5000640 1 -- 172.21.15.100:0/706851394 learned_addr learned my addr 172.21.15.100:0/706851394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.153+0000 7f2cafe00640 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8b9f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2caf400640 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8b9f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2cb5000640 1 -- 172.21.15.100:0/706851394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 msgr2=0x556e8b9f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2cb5000640 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8b9f1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2cb5000640 1 -- 172.21.15.100:0/706851394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 msgr2=0x556e8b9f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2cb5000640 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8b9f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.154+0000 7f2cb5000640 1 -- 172.21.15.100:0/706851394 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e8b8f6530 con 0x556e8ba644d0 2024-02-21T07:57:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.155+0000 7f2cb5000640 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x556e8ba5e350 tx=0x7f2c9c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b48adc333fb4a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.155+0000 7f2c9be00640 1 -- 172.21.15.100:0/706851394 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c015d90 con 0x556e8ba644d0 2024-02-21T07:57:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.155+0000 7f2c9be00640 1 -- 172.21.15.100:0/706851394 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c02c470 con 0x556e8ba644d0 2024-02-21T07:57:00.157 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.155+0000 7f2c9be00640 1 -- 172.21.15.100:0/706851394 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c02c7e0 con 0x556e8ba644d0 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.156+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/706851394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 msgr2=0x556e8ba5d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.156+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x556e8ba5e350 tx=0x7f2c9c014000 comp rx=0 tx=0).stop 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.157+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/706851394 shutdown_connections 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.157+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba644d0 0x556e8ba5d890 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.157+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba30070 0x556e8b9f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.157+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/706851394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8b9f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.157+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/706851394 >> 172.21.15.100:0/706851394 conn(0x556e8b9bc4b0 msgr2=0x556e8ba7ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.158+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/706851394 shutdown_connections 2024-02-21T07:57:00.159 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.158+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/706851394 wait complete. 2024-02-21T07:57:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.159+0000 7f2cb9dbd740 1 -- start start 2024-02-21T07:57:00.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.159+0000 7f2cb9dbd740 1 Processor -- start 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8bad4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 0x556e8ba633f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8ba7c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8ba7c8e0 con 0x556e8b9f4f90 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8bada5b0 con 0x556e8ba30070 2024-02-21T07:57:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8ba7efc0 con 0x556e8ba644d0 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb9dbd740 10 client.0 _ll_register_callbacks cb 0x7f2c9c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8ba7c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8ba7c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40640/0 (socket says 172.21.15.100:40640) 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.161+0000 7f2cb5000640 1 -- 172.21.15.100:0/3187959220 learned_addr learned my addr 172.21.15.100:0/3187959220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.162+0000 7f2caf400640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 0x556e8ba633f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.162+0000 7f2cafe00640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8bad4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.162+0000 7f2caf400640 1 -- 172.21.15.100:0/3187959220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 msgr2=0x556e8ba7c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.162+0000 7f2caf400640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8ba7c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.167+0000 7f2caf400640 1 -- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 msgr2=0x556e8bad4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.167+0000 7f2caf400640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8bad4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.167+0000 7f2caf400640 1 -- 172.21.15.100:0/3187959220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c011bd0 con 0x556e8ba30070 2024-02-21T07:57:00.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.167+0000 7f2cafe00640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8bad4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.168+0000 7f2c99600640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.168+0000 7f2caf400640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 0x556e8ba633f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x556e8b9f2fe0 tx=0x7f2ca00075e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771d65bb79901d20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.169+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca001e070 con 0x556e8ba30070 2024-02-21T07:57:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.169+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2ca0019710 con 0x556e8ba30070 2024-02-21T07:57:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.170+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e8b980d30 con 0x556e8ba30070 2024-02-21T07:57:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.170+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca001e070 con 0x556e8ba30070 2024-02-21T07:57:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.170+0000 7f2cb9dbd740 10 client.7381 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.170+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556e8b91c2c0 con 0x556e8ba30070 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e8b980d30 con 0x556e8ba30070 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2ca0017430 con 0x556e8ba30070 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 10 client.7381 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 10 client.7381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 20 client.7381 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8b9ee8c0 0x556e8bad6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 4 client.7381 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:57:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556e8b65b600 con 0x556e8b9ee8c0 2024-02-21T07:57:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.171+0000 7f2cafe00640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8b9ee8c0 0x556e8bad6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.173+0000 7f2cafe00640 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8b9ee8c0 0x556e8bad6700 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b213b23f0dea8710 server_cookie=1f9b8696b8d48eb9 in_seq=0 out_seq=0 2024-02-21T07:57:00.174 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.173+0000 7f2c99600640 10 client.7381 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:00.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.187+0000 7fa0a0c00640 1 Processor -- start 2024-02-21T07:57:00.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.187+0000 7fa0a0c00640 1 -- start start 2024-02-21T07:57:00.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.189+0000 7fa0a0c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa09c190260 0x7fa09c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.189+0000 7fa0a0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 0x7fa09c0f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.189+0000 7fa0a0c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09c18dc80 con 0x7fa09c0f4b20 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.189+0000 7fa0a0c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0f5b90 con 0x7fa09c06edc0 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.189+0000 7fa0a0c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0f55d0 con 0x7fa09c190260 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa09c190260 0x7fa09c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa09c190260 0x7fa09c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40654/0 (socket says 172.21.15.100:40654) 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 -- 172.21.15.100:0/77043743 learned_addr learned my addr 172.21.15.100:0/77043743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa09a800640 1 --2- 172.21.15.100:0/77043743 >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 0x7fa09c0f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 -- 172.21.15.100:0/77043743 >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 msgr2=0x7fa09c0f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 --2- 172.21.15.100:0/77043743 >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 0x7fa09c0f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 -- 172.21.15.100:0/77043743 >> v1:172.21.15.156:6789/0 conn(0x7fa09c0f4b20 legacy=0x7fa09c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa099e00640 1 -- 172.21.15.100:0/77043743 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0f58b0 con 0x7fa09c190260 2024-02-21T07:57:00.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.190+0000 7fa09a800640 1 --2- 172.21.15.100:0/77043743 >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 0x7fa09c0f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:00.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.192+0000 7fa099e00640 1 --2- 172.21.15.100:0/77043743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c070a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa09c08d4e0 tx=0x7fa08c02b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9308e3e80d364a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.192+0000 7fa098a00640 1 -- 172.21.15.100:0/77043743 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031750 con 0x7fa09c190260 2024-02-21T07:57:00.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.192+0000 7fa098a00640 1 -- 172.21.15.100:0/77043743 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c0318b0 con 0x7fa09c190260 2024-02-21T07:57:00.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.192+0000 7fa098a00640 1 -- 172.21.15.100:0/77043743 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031c40 con 0x7fa09c190260 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 -- 172.21.15.100:0/77043743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 msgr2=0x7fa09c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/77043743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c070a30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa09c08d4e0 tx=0x7fa08c02b7f0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 -- 172.21.15.100:0/77043743 shutdown_connections 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/77043743 >> v2:172.21.15.100:3300/0 conn(0x7fa09c06edc0 0x7fa09c0f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/77043743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c070a30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.193+0000 7fa0a0c00640 1 -- 172.21.15.100:0/77043743 >> 172.21.15.100:0/77043743 conn(0x7fa09c0668b0 msgr2=0x7fa09c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.194+0000 7fa0a0c00640 1 -- 172.21.15.100:0/77043743 shutdown_connections 2024-02-21T07:57:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.194+0000 7fa0a0c00640 1 -- 172.21.15.100:0/77043743 wait complete. 2024-02-21T07:57:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.196+0000 7fa0a0c00640 1 Processor -- start 2024-02-21T07:57:00.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.196+0000 7fa0a0c00640 1 -- start start 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.197+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa09c0f4b20 0x7fa09c16ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.197+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c1893c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa0a0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa0a0c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c187d90 con 0x7fa09c189900 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa0a0c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c16ef80 con 0x7fa09c0f4b20 2024-02-21T07:57:00.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa0a0c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c187f70 con 0x7fa09c190260 2024-02-21T07:57:00.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa09a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa09a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46824/0 (socket says 172.21.15.100:46824) 2024-02-21T07:57:00.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.198+0000 7fa09a800640 1 -- 172.21.15.100:0/1544028728 learned_addr learned my addr 172.21.15.100:0/1544028728 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.199+0000 7fa09a800640 1 -- 172.21.15.100:0/1544028728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 msgr2=0x7fa09c1893c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:57:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.199+0000 7fa09a800640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c1893c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.199+0000 7fa09a800640 1 -- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa09c0f4b20 msgr2=0x7fa09c16ea40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:57:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.199+0000 7fa09a800640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa09c0f4b20 0x7fa09c16ea40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.199+0000 7fa09a800640 1 -- 172.21.15.100:0/1544028728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0094d0 con 0x7fa09c189900 2024-02-21T07:57:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.200+0000 7fa09a800640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d150 tx=0x7fa09400d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.200+0000 7fa092000640 1 -- 172.21.15.100:0/1544028728 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094003990 con 0x7fa09c189900 2024-02-21T07:57:00.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.200+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c188250 con 0x7fa09c189900 2024-02-21T07:57:00.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.201+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c188810 con 0x7fa09c189900 2024-02-21T07:57:00.206 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.204+0000 7f2c99600640 1 -- 172.21.15.100:0/3187959220 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556e8b65b600 con 0x556e8b9ee8c0 2024-02-21T07:57:00.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.205+0000 7fa092000640 1 -- 172.21.15.100:0/1544028728 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09400f040 con 0x7fa09c189900 2024-02-21T07:57:00.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.205+0000 7fa092000640 1 -- 172.21.15.100:0/1544028728 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094003cf0 con 0x7fa09c189900 2024-02-21T07:57:00.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.204+0000 7f2c99600640 10 client.7381 handle_command_reply: tid=0 2024-02-21T07:57:00.207 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.205+0000 7f2cb9dbd740 1 client.7381 shutdown 2024-02-21T07:57:00.208 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.207+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 msgr2=0x556e8ba633f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.209 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.207+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 0x556e8ba633f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x556e8b9f2fe0 tx=0x7f2ca00075e0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.208+0000 7fa0a3a22740 1 Processor -- start 2024-02-21T07:57:00.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.209+0000 7fa092000640 1 -- 172.21.15.100:0/1544028728 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa094004030 con 0x7fa09c189900 2024-02-21T07:57:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 shutdown_connections 2024-02-21T07:57:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x556e8b9ee8c0 0x556e8bad6700 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556e8ba644d0 0x556e8ba7c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556e8ba30070 0x556e8ba633f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.213 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 --2- 172.21.15.100:0/3187959220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556e8b9f4f90 0x556e8bad4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.209+0000 7fa0a3a22740 1 -- start start 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 0x55f56c5ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c5e6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c5e7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c4de210 con 0x55f56c5ab7e0 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c4db740 con 0x55f56c5e6590 2024-02-21T07:57:00.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.211+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c4d6f20 con 0x55f56c5aaec0 2024-02-21T07:57:00.214 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 >> 172.21.15.100:0/3187959220 conn(0x556e8b9bc4b0 msgr2=0x556e8ba5d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.215 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.212+0000 7f2c99600640 0 client.7381 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.212+0000 7fa099400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 0x55f56c5ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.212+0000 7fa099400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 0x55f56c5ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40682/0 (socket says 172.21.15.100:40682) 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.212+0000 7fa099400640 1 -- 172.21.15.100:0/3515966257 learned_addr learned my addr 172.21.15.100:0/3515966257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.212+0000 7fa099400640 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c5e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.213+0000 7fa099e00640 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c5e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.213+0000 7fa092000640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 0x7fa07c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa092000640 1 -- 172.21.15.100:0/1544028728 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa0940c9c90 con 0x7fa09c189900 2024-02-21T07:57:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.214+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 shutdown_connections 2024-02-21T07:57:00.217 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.215+0000 7f2cb9dbd740 1 -- 172.21.15.100:0/3187959220 wait complete. 2024-02-21T07:57:00.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa099e00640 1 -- 172.21.15.100:0/3515966257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 msgr2=0x55f56c5ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa099e00640 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 0x55f56c5ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa099e00640 1 -- 172.21.15.100:0/3515966257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 msgr2=0x55f56c5e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa099e00640 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c5e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa099e00640 1 -- 172.21.15.100:0/3515966257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56c498df0 con 0x55f56c5ab7e0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.214+0000 7fa09a800640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 0x7fa07c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.215+0000 7fa09a800640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 0x7fa07c0a1590 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa0940c7630 tx=0x7fa094009670 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.215+0000 7fa099e00640 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c5e6050 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0f5710 tx=0x7fa08c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828de44d58d9b6b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.216+0000 7fa086600640 1 -- 172.21.15.100:0/3515966257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c031a20 con 0x55f56c5ab7e0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.216+0000 7fa086600640 1 -- 172.21.15.100:0/3515966257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c031b80 con 0x55f56c5ab7e0 2024-02-21T07:57:00.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.216+0000 7fa086600640 1 -- 172.21.15.100:0/3515966257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c033440 con 0x55f56c5ab7e0 2024-02-21T07:57:00.219 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.218+0000 7f2cb9dbd740 20 client.7381 trim_cache size 0 max 16384 2024-02-21T07:57:00.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 -- 172.21.15.100:0/3515966257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 msgr2=0x55f56c5e6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c5e6050 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa09c0f5710 tx=0x7fa08c030000 comp rx=0 tx=0).stop 2024-02-21T07:57:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:57:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:57:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:57:00.220 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:57:00.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 -- 172.21.15.100:0/3515966257 shutdown_connections 2024-02-21T07:57:00.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c5e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c5e6050 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/3515966257 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5aaec0 0x55f56c5ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.218+0000 7fa0a3a22740 1 -- 172.21.15.100:0/3515966257 >> 172.21.15.100:0/3515966257 conn(0x55f56c56d490 msgr2=0x55f56c56e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.219+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 msgr2=0x7f2c900a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.219+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 0x7f2c900a16e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009ad0 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-02-21T07:57:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.219+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 msgr2=0x7f2cb0182750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.221 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.219+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009e50 tx=0x7f2ca8004a40 comp rx=0 tx=0).stop 2024-02-21T07:57:00.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.219+0000 7fa0a3a22740 1 -- 172.21.15.100:0/3515966257 shutdown_connections 2024-02-21T07:57:00.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.219+0000 7fa0a3a22740 1 -- 172.21.15.100:0/3515966257 wait complete. 2024-02-21T07:57:00.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.220+0000 7fa0a3a22740 1 -- start start 2024-02-21T07:57:00.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.220+0000 7fa0a3a22740 1 Processor -- start 2024-02-21T07:57:00.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.221+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5ab7e0 0x55f56c56a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.222+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e6590 0x55f56c599a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.222+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.222+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c47c150 con 0x55f56c56bcd0 2024-02-21T07:57:00.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.222+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c47bdf0 con 0x55f56c5ab7e0 2024-02-21T07:57:00.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.223+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c2451c0 con 0x55f56c5e6590 2024-02-21T07:57:00.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.222+0000 7fa099400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.223+0000 7fa099400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46850/0 (socket says 172.21.15.100:46850) 2024-02-21T07:57:00.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.223+0000 7fa099400640 1 -- 172.21.15.100:0/339544546 learned_addr learned my addr 172.21.15.100:0/339544546 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.225+0000 7fa099e00640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e6590 0x55f56c599a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.227+0000 7fa0a3a22740 10 client.0 _ll_register_callbacks cb 0x55f56c4cb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:00.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.227+0000 7fa099400640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5ab7e0 0x55f56c56a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 -- 172.21.15.100:0/339544546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e6590 msgr2=0x55f56c599a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e6590 0x55f56c599a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 -- 172.21.15.100:0/339544546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5ab7e0 msgr2=0x55f56c56a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5ab7e0 0x55f56c56a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 -- 172.21.15.100:0/339544546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c0f58b0 con 0x55f56c56bcd0 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 shutdown_connections 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2c9009f220 0x7f2c900a16e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb015da00 0x7f2cb0153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2cb00f95b0 0x7f2cb021f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 --2- 172.21.15.100:0/22036758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cb00d3de0 0x7f2cb0182750 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.230 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.229+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 >> 172.21.15.100:0/22036758 conn(0x7f2cb008cfd0 msgr2=0x7f2cb0185cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.228+0000 7fa099400640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa08801bc00 tx=0x7fa088003720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1294463d3efb3d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.229+0000 7fa07aa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:00.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.232+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa088016b70 con 0x55f56c56bcd0 2024-02-21T07:57:00.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.232+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa088016cd0 con 0x55f56c56bcd0 2024-02-21T07:57:00.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.235+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f56c1d67e0 con 0x55f56c56bcd0 2024-02-21T07:57:00.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.237+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa088016e90 con 0x55f56c56bcd0 2024-02-21T07:57:00.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.237+0000 7fa0a3a22740 10 client.7203 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:00.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.237+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f56c4d55a0 con 0x55f56c56bcd0 2024-02-21T07:57:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.244+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 shutdown_connections 2024-02-21T07:57:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:00.244+0000 7f2cb7000640 1 -- 172.21.15.100:0/22036758 wait complete. 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.241+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f56c1d67e0 con 0x55f56c56bcd0 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.241+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa0880183f0 con 0x55f56c56bcd0 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 10 client.7203 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 10 client.7203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 20 client.7203 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c59d4b0 0x55f56c596fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 4 client.7203 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:00.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.249+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f56c213720 con 0x55f56c59d4b0 2024-02-21T07:57:00.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.260+0000 7fa099e00640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c59d4b0 0x55f56c596fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.262+0000 7fa099e00640 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c59d4b0 0x55f56c596fe0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7dde0a1d015dce7 server_cookie=cca356ac3c94741d in_seq=0 out_seq=0 2024-02-21T07:57:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.263+0000 7fa07aa00640 10 client.7203 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.263+0000 7fa07aa00640 1 -- 172.21.15.100:0/339544546 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f56c213720 con 0x55f56c59d4b0 2024-02-21T07:57:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.263+0000 7fa07aa00640 10 client.7203 handle_command_reply: tid=0 2024-02-21T07:57:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.263+0000 7fa0a3a22740 1 client.7203 shutdown 2024-02-21T07:57:00.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.272+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 msgr2=0x55f56c596aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.272+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa08801bc00 tx=0x7fa088003720 comp rx=0 tx=0).stop 2024-02-21T07:57:00.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 shutdown_connections 2024-02-21T07:57:00.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c59d4b0 0x55f56c596fe0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c56bcd0 0x55f56c596aa0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e6590 0x55f56c599a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/339544546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5ab7e0 0x55f56c56a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.282+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 >> 172.21.15.100:0/339544546 conn(0x55f56c5aaec0 msgr2=0x55f56c56ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.285+0000 7fa07aa00640 0 client.7203 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:00.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.287+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 shutdown_connections 2024-02-21T07:57:00.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.287+0000 7fa0a3a22740 1 -- 172.21.15.100:0/339544546 wait complete. 2024-02-21T07:57:00.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.287+0000 7fa0a3a22740 20 client.7203 trim_cache size 0 max 16384 2024-02-21T07:57:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.326+0000 7fa0a3a22740 1 Processor -- start 2024-02-21T07:57:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.326+0000 7fa0a3a22740 1 -- start start 2024-02-21T07:57:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c58d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c599570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c5e6d80 con 0x55f56c5ab7e0 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c5aad20 con 0x55f56c5e6590 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.328+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c5e5a10 con 0x55f56c5e28f0 2024-02-21T07:57:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.329+0000 7fa099400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c58d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40692/0 (socket says 172.21.15.100:40692) 2024-02-21T07:57:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 -- 172.21.15.100:0/551961490 learned_addr learned my addr 172.21.15.100:0/551961490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099e00640 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c599570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 -- 172.21.15.100:0/551961490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 msgr2=0x55f56c599570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c599570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 -- 172.21.15.100:0/551961490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 msgr2=0x55f56c58d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c58d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.330+0000 7fa099400640 1 -- 172.21.15.100:0/551961490 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56c5e3080 con 0x55f56c5e28f0 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.333+0000 7fa099400640 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa0880188b0 tx=0x7fa08800e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db884f2235ffcbe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.335+0000 7fa085c00640 1 -- 172.21.15.100:0/551961490 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880035f0 con 0x55f56c5e28f0 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.335+0000 7fa085c00640 1 -- 172.21.15.100:0/551961490 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088003ff0 con 0x55f56c5e28f0 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.335+0000 7fa085c00640 1 -- 172.21.15.100:0/551961490 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880038c0 con 0x55f56c5e28f0 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 -- 172.21.15.100:0/551961490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 msgr2=0x55f56c64f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa0880188b0 tx=0x7fa08800e030 comp rx=0 tx=0).stop 2024-02-21T07:57:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 -- 172.21.15.100:0/551961490 shutdown_connections 2024-02-21T07:57:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5e28f0 0x55f56c64f640 secure :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa0880188b0 tx=0x7fa08800e030 comp rx=0 tx=0).stop 2024-02-21T07:57:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c599570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/551961490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c58d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.336+0000 7fa0a3a22740 1 -- 172.21.15.100:0/551961490 >> 172.21.15.100:0/551961490 conn(0x55f56c5aaec0 msgr2=0x55f56c60fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.339+0000 7fa0a3a22740 1 -- 172.21.15.100:0/551961490 shutdown_connections 2024-02-21T07:57:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.339+0000 7fa0a3a22740 1 -- 172.21.15.100:0/551961490 wait complete. 2024-02-21T07:57:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.340+0000 7fa0a3a22740 1 -- start start 2024-02-21T07:57:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.340+0000 7fa0a3a22740 1 Processor -- start 2024-02-21T07:57:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.352+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c56c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5a7590 0x55f56c5daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c56f200 con 0x55f56c5ab7e0 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c660050 con 0x55f56c5e6590 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56c5dadc0 con 0x55f56c5a7590 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa0a3a22740 10 client.0 _ll_register_callbacks cb 0x7fa08c036070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa099e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa099e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33398/0 (socket says 172.21.15.100:33398) 2024-02-21T07:57:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.353+0000 7fa099e00640 1 -- 172.21.15.100:0/1434157072 learned_addr learned my addr 172.21.15.100:0/1434157072 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099400640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c56c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 -- 172.21.15.100:0/1434157072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5a7590 msgr2=0x55f56c5daf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5a7590 0x55f56c5daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 -- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 msgr2=0x55f56c56c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c56c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 -- 172.21.15.100:0/1434157072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f56c4d55a0 con 0x55f56c5e6590 2024-02-21T07:57:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.354+0000 7fa099e00640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009930 tx=0x7fa08c02e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=942667877a16a72d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa07aa00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c050d80 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa08c004030 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa08c031b80 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa08c031f00 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa0a3a22740 10 client.7393 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.355+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f56c471ab0 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c031b80 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa08c0041f0 con 0x55f56c5e6590 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 10 client.7393 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 10 client.7393 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:57:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 20 client.7393 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c65f5b0 0x55f56c60fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 4 client.7393 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.356+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f56c262890 con 0x55f56c65f5b0 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.357+0000 7fa099400640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c65f5b0 0x55f56c60fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.357+0000 7fa099400640 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c65f5b0 0x55f56c60fcb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=486c4eee5bb3ebae server_cookie=27da8eea5c4fb9d1 in_seq=0 out_seq=0 2024-02-21T07:57:00.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.357+0000 7fa07aa00640 10 client.7393 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:00.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.358+0000 7fa07aa00640 1 -- 172.21.15.100:0/1434157072 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f56c262890 con 0x55f56c65f5b0 2024-02-21T07:57:00.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.358+0000 7fa07aa00640 10 client.7393 handle_command_reply: tid=0 2024-02-21T07:57:00.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.358+0000 7fa0a3a22740 1 client.7393 shutdown 2024-02-21T07:57:00.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.359+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 msgr2=0x55f56c649520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.359+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009930 tx=0x7fa08c02e000 comp rx=0 tx=0).stop 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 shutdown_connections 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55f56c65f5b0 0x55f56c60fcb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f56c5a7590 0x55f56c5daf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f56c5e6590 0x55f56c649520 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 --2- 172.21.15.100:0/1434157072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f56c5ab7e0 0x55f56c56c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 >> 172.21.15.100:0/1434157072 conn(0x55f56c5aaec0 msgr2=0x55f56c5e5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.360+0000 7fa07aa00640 0 client.7393 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:00.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.361+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 shutdown_connections 2024-02-21T07:57:00.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.364+0000 7fa0a3a22740 1 -- 172.21.15.100:0/1434157072 wait complete. 2024-02-21T07:57:00.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.365+0000 7fa0a3a22740 20 client.7393 trim_cache size 0 max 16384 2024-02-21T07:57:00.367 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 msgr2=0x7fa07c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 0x7fa07c0a1590 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa0940c7630 tx=0x7fa094009670 comp rx=0 tx=0).stop 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 msgr2=0x7fa09c06af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d150 tx=0x7fa09400d610 comp rx=0 tx=0).stop 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 shutdown_connections 2024-02-21T07:57:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa07c09f0d0 0x7fa07c0a1590 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa09c189900 0x7fa09c06af40 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa09c190260 0x7fa09c1893c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 --2- 172.21.15.100:0/1544028728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa09c0f4b20 0x7fa09c16ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 >> 172.21.15.100:0/1544028728 conn(0x7fa09c0668b0 msgr2=0x7fa09c071520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.369+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 shutdown_connections 2024-02-21T07:57:00.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.370+0000 7fa0a0c00640 1 -- 172.21.15.100:0/1544028728 wait complete. 2024-02-21T07:57:00.405 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:57:00.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:57:00.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.826+0000 7f0ad5a00640 1 Processor -- start 2024-02-21T07:57:00.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.829+0000 7f0ad5a00640 1 -- start start 2024-02-21T07:57:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.833+0000 7f0ad5a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0ad0186340 0x7f0ad008ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.833+0000 7f0ad5a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad00fab70 con 0x7f0ad006ab60 2024-02-21T07:57:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.834+0000 7f0ad5a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad0186720 con 0x7f0ad0189560 2024-02-21T07:57:00.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.834+0000 7f0ad5a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad008d3f0 con 0x7f0ad0186340 2024-02-21T07:57:00.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.834+0000 7f0acf400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0ad0189560 0x7f0ad00f99b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:32924/0 (socket says 172.21.15.100:32924) 2024-02-21T07:57:00.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.834+0000 7f0acf400640 1 -- 172.21.15.100:0/214189317 learned_addr learned my addr 172.21.15.100:0/214189317 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:00.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.834+0000 7f0acea00640 1 --2- 172.21.15.100:0/214189317 >> v2:172.21.15.170:3300/0 conn(0x7f0ad0186340 0x7f0ad008ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.835+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503900287 0 0) 0x7f0ac8001490 con 0x7f0ad006ab60 2024-02-21T07:57:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003520 con 0x7f0ad006ab60 2024-02-21T07:57:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775226173 0 0) 0x7f0ad0186720 con 0x7f0ad0189560 2024-02-21T07:57:00.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac8001490 con 0x7f0ad0189560 2024-02-21T07:57:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1457378225 0 0) 0x7f0ac8001490 con 0x7f0ad0189560 2024-02-21T07:57:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 >> v2:172.21.15.170:3300/0 conn(0x7f0ad0186340 msgr2=0x7f0ad008ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 --2- 172.21.15.100:0/214189317 >> v2:172.21.15.170:3300/0 conn(0x7f0ad0186340 0x7f0ad008ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 >> v1:172.21.15.100:6789/0 conn(0x7f0ad006ab60 legacy=0x7f0ad0188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00fa890 con 0x7f0ad0189560 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.836+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f0ac0001670 con 0x7f0ad0189560 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 >> v1:172.21.15.156:6789/0 conn(0x7f0ad0189560 legacy=0x7f0ad00f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 0x7f0ab4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab4003760 0x7f0ab4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab4004170 0x7f0ab400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8001740 con 0x7f0ab4004b60 2024-02-21T07:57:00.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad008d3f0 con 0x7f0ab4003760 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400c1a0 con 0x7f0ab4004170 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0acea00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 0x7f0ab4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.837+0000 7f0ace000640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab4003760 0x7f0ab4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acf400640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab4004170 0x7f0ab400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acea00640 1 -- 172.21.15.100:0/214189317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab4004170 msgr2=0x7f0ab400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acea00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ab4004170 0x7f0ab400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acea00640 1 -- 172.21.15.100:0/214189317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab4003760 msgr2=0x7f0ab4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acea00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab4003760 0x7f0ab4003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acea00640 1 -- 172.21.15.100:0/214189317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00fa890 con 0x7f0ab4004b60 2024-02-21T07:57:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.838+0000 7f0acf400640 1 -- 172.21.15.100:0/214189317 reap_dead start 2024-02-21T07:57:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.840+0000 7f0acea00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 0x7f0ab4004f40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ac0 tx=0x7f0ab40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3109c87c2fc549 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.840+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02c6b0 con 0x7f0ab4004b60 2024-02-21T07:57:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.843+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc02c810 con 0x7f0ab4004b60 2024-02-21T07:57:00.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.843+0000 7f0acd600640 1 -- 172.21.15.100:0/214189317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc02cba0 con 0x7f0ab4004b60 2024-02-21T07:57:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.844+0000 7f0ad5a00640 1 -- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 msgr2=0x7f0ab4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.844+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 0x7f0ab4004f40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ac0 tx=0x7f0ab40057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.852+0000 7f0ad5a00640 1 -- 172.21.15.100:0/214189317 shutdown_connections 2024-02-21T07:57:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.852+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/214189317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ab4004b60 0x7f0ab4004f40 secure :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ac0 tx=0x7f0ab40057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.852+0000 7f0ad5a00640 1 -- 172.21.15.100:0/214189317 >> 172.21.15.100:0/214189317 conn(0x7f0ad00fe290 msgr2=0x7f0ad00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.869+0000 7f0ad5a00640 1 -- 172.21.15.100:0/214189317 shutdown_connections 2024-02-21T07:57:00.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.870+0000 7f0ad5a00640 1 -- 172.21.15.100:0/214189317 wait complete. 2024-02-21T07:57:00.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.886+0000 7f0ad5a00640 1 Processor -- start 2024-02-21T07:57:00.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.887+0000 7f0ad5a00640 1 -- start start 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 0x7f0ad01779a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 0x7f0ad00fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad00fd800 0x7f0ad01876b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0178c10 con 0x7f0ad0175c70 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0178090 con 0x7f0ad00fd800 2024-02-21T07:57:00.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ad5a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0178370 con 0x7f0ad016b8d0 2024-02-21T07:57:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.889+0000 7f0ace000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 0x7f0ad00fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.890+0000 7f0ace000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 0x7f0ad00fd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46890/0 (socket says 172.21.15.100:46890) 2024-02-21T07:57:00.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.890+0000 7f0ace000640 1 -- 172.21.15.100:0/2420028933 learned_addr learned my addr 172.21.15.100:0/2420028933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.890+0000 7f0acea00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 0x7f0ad01779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.890+0000 7f0acf400640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad00fd800 0x7f0ad01876b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.891+0000 7f0acea00640 1 -- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad00fd800 msgr2=0x7f0ad01876b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.891+0000 7f0acea00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad00fd800 0x7f0ad01876b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.891+0000 7f0acea00640 1 -- 172.21.15.100:0/2420028933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 msgr2=0x7f0ad00fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.891+0000 7f0acea00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 0x7f0ad00fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.891+0000 7f0acea00640 1 -- 172.21.15.100:0/2420028933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0178650 con 0x7f0ad016b8d0 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.894+0000 7f0acea00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 0x7f0ad01779a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0abc033000 tx=0x7f0abc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.894+0000 7f0ac6a00640 1 -- 172.21.15.100:0/2420028933 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc004520 con 0x7f0ad016b8d0 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.894+0000 7f0ac6a00640 1 -- 172.21.15.100:0/2420028933 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc003810 con 0x7f0ad016b8d0 2024-02-21T07:57:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.894+0000 7f0ac6a00640 1 -- 172.21.15.100:0/2420028933 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc003bc0 con 0x7f0ad016b8d0 2024-02-21T07:57:00.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.895+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad0178930 con 0x7f0ad016b8d0 2024-02-21T07:57:00.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.895+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad016bcb0 con 0x7f0ad016b8d0 2024-02-21T07:57:00.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.902+0000 7f0ac6a00640 1 -- 172.21.15.100:0/2420028933 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0abc003d20 con 0x7f0ad016b8d0 2024-02-21T07:57:00.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.903+0000 7f0ad879b740 1 Processor -- start 2024-02-21T07:57:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.906+0000 7f0ad879b740 1 -- start start 2024-02-21T07:57:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.906+0000 7f0ac6a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 0x7f0ab00a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.906+0000 7f0ac6a00640 1 -- 172.21.15.100:0/2420028933 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0abc0ea7c0 con 0x7f0ad016b8d0 2024-02-21T07:57:00.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 0x56436057c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605b8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643604af210 con 0x56436057bec0 2024-02-21T07:57:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643604ac740 con 0x56436057c7e0 2024-02-21T07:57:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.908+0000 7f0ad879b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643604a7f20 con 0x5643605b7590 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.916+0000 7f0acf400640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 0x7f0ab00a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.917+0000 7f0acf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605b8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.917+0000 7f0acf400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605b8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40754/0 (socket says 172.21.15.100:40754) 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.917+0000 7f0acf400640 1 -- 172.21.15.100:0/1794159012 learned_addr learned my addr 172.21.15.100:0/1794159012 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0ace000640 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 0x56436057c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 -- 172.21.15.100:0/1794159012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 msgr2=0x5643605b8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605b8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 -- 172.21.15.100:0/1794159012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 msgr2=0x5643605b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.918+0000 7f0acea00640 1 -- 172.21.15.100:0/1794159012 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564360469df0 con 0x56436057bec0 2024-02-21T07:57:00.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.919+0000 7f0acea00640 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 0x56436057c2a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0e8130 tx=0x7f0abc0b7cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4a46983b9c75c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.923+0000 7f0acf400640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 0x7f0ab00a16e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0189940 tx=0x7f0ac0018750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.925+0000 7f0abb400640 1 -- 172.21.15.100:0/1794159012 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0c0a40 con 0x56436057bec0 2024-02-21T07:57:00.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.925+0000 7f0abb400640 1 -- 172.21.15.100:0/1794159012 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc0b6650 con 0x56436057bec0 2024-02-21T07:57:00.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.925+0000 7f0abb400640 1 -- 172.21.15.100:0/1794159012 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0e8270 con 0x56436057bec0 2024-02-21T07:57:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.927+0000 7f0ad879b740 1 -- 172.21.15.100:0/1794159012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 msgr2=0x56436057c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.927+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 0x56436057c2a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0e8130 tx=0x7f0abc0b7cb0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 -- 172.21.15.100:0/1794159012 shutdown_connections 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605b8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1794159012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057bec0 0x56436057c2a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 -- 172.21.15.100:0/1794159012 >> 172.21.15.100:0/1794159012 conn(0x56436053e490 msgr2=0x56436053f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 -- 172.21.15.100:0/1794159012 shutdown_connections 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.929+0000 7f0ad879b740 1 -- 172.21.15.100:0/1794159012 wait complete. 2024-02-21T07:57:00.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.930+0000 7f0ad879b740 1 -- start start 2024-02-21T07:57:00.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.931+0000 7f0ad879b740 1 Processor -- start 2024-02-21T07:57:00.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.937+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.937+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.938+0000 7f0acea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.938+0000 7f0acea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46912/0 (socket says 172.21.15.100:46912) 2024-02-21T07:57:00.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.938+0000 7f0acea00640 1 -- 172.21.15.100:0/1665006927 learned_addr learned my addr 172.21.15.100:0/1665006927 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.938+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 0x56436053cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.938+0000 7f0ace000640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.939+0000 7f0acf400640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 0x56436053cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.939+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436044d150 con 0x56436057c7e0 2024-02-21T07:57:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.939+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436044cdf0 con 0x56436053cab0 2024-02-21T07:57:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.939+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643602161c0 con 0x5643605b7590 2024-02-21T07:57:00.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.939+0000 7f0ad879b740 10 client.0 _ll_register_callbacks cb 0x56436049c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:00.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.940+0000 7f0acea00640 1 -- 172.21.15.100:0/1665006927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 msgr2=0x5643605c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.940+0000 7f0acea00640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0acea00640 1 -- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 msgr2=0x56436053cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0acea00640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 0x56436053cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0acea00640 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad016bcb0 con 0x56436057c7e0 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0ace000640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0acf400640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 0x56436053cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0acea00640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0b6600 tx=0x7f0abc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b2defba1d3390f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0aafe00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.941+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0c0a40 con 0x56436057c7e0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0abc0b85b0 con 0x56436057c7e0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643601a77e0 con 0x56436057c7e0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0abc0b8770 con 0x56436057c7e0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0ad879b740 10 client.7215 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5643604a65a0 con 0x56436057c7e0 2024-02-21T07:57:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.942+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643601a77e0 con 0x56436057c7e0 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0abc0d5060 con 0x56436057c7e0 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 10 client.7215 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 10 client.7215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 20 client.7215 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c2570 0x56436053a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 4 client.7215 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:00.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.943+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643601e4720 con 0x5643605c2570 2024-02-21T07:57:00.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.944+0000 7f0ace000640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c2570 0x56436053a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:00.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.948+0000 7f0ace000640 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c2570 0x56436053a0b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f48e8b5b2287a64b server_cookie=85afe5f22785a2a0 in_seq=0 out_seq=0 2024-02-21T07:57:00.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.948+0000 7f0aafe00640 10 client.7215 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:00.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.951+0000 7f0aafe00640 1 -- 172.21.15.100:0/1665006927 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5643601e4720 con 0x5643605c2570 2024-02-21T07:57:00.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.951+0000 7f0aafe00640 10 client.7215 handle_command_reply: tid=0 2024-02-21T07:57:00.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.952+0000 7f0ad879b740 1 client.7215 shutdown 2024-02-21T07:57:00.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.957+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 msgr2=0x5643605c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:00.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.957+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0b6600 tx=0x7f0abc009190 comp rx=0 tx=0).stop 2024-02-21T07:57:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.958+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 shutdown_connections 2024-02-21T07:57:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.986+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c2570 0x56436053a0b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.986+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436053cab0 0x56436053cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.986+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x5643605c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.986+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1665006927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436057c7e0 0x5643605c34d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.986+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 >> 172.21.15.100:0/1665006927 conn(0x56436057bec0 msgr2=0x56436053ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.987+0000 7f0aafe00640 0 client.7215 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.989+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 shutdown_connections 2024-02-21T07:57:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.989+0000 7f0ad879b740 1 -- 172.21.15.100:0/1665006927 wait complete. 2024-02-21T07:57:00.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:00.990+0000 7f0ad879b740 20 client.7215 trim_cache size 0 max 16384 2024-02-21T07:57:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.022+0000 7f0ad879b740 1 Processor -- start 2024-02-21T07:57:01.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.022+0000 7f0ad879b740 1 -- start start 2024-02-21T07:57:01.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x56436053db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x56436053f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643605455b0 con 0x56436053cab0 2024-02-21T07:57:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436053b390 con 0x56436057c7e0 2024-02-21T07:57:01.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ad879b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436053c040 con 0x5643605b7590 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.024+0000 7f0ace000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.025+0000 7f0ace000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33446/0 (socket says 172.21.15.100:33446) 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.025+0000 7f0ace000640 1 -- 172.21.15.100:0/474891580 learned_addr learned my addr 172.21.15.100:0/474891580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.025+0000 7f0acf400640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x56436053f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.025+0000 7f0acea00640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x56436053db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.026+0000 7f0ace000640 1 -- 172.21.15.100:0/474891580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 msgr2=0x56436053f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0ace000640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x56436053f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0ace000640 1 -- 172.21.15.100:0/474891580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 msgr2=0x56436053db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0ace000640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x56436053db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0ace000640 1 -- 172.21.15.100:0/474891580 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564360442ab0 con 0x56436057c7e0 2024-02-21T07:57:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0acea00640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x56436053db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.029+0000 7f0acf400640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x56436053f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:01.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.030+0000 7f0ace000640 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8007fd0 tx=0x7f0ac8007ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9dc57897a807cad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.030+0000 7f0abaa00640 1 -- 172.21.15.100:0/474891580 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8019110 con 0x56436057c7e0 2024-02-21T07:57:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.030+0000 7f0abaa00640 1 -- 172.21.15.100:0/474891580 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8019290 con 0x56436057c7e0 2024-02-21T07:57:01.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.030+0000 7f0abaa00640 1 -- 172.21.15.100:0/474891580 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac801dd40 con 0x56436057c7e0 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 -- 172.21.15.100:0/474891580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 msgr2=0x5643605d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8007fd0 tx=0x7f0ac8007ba0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 -- 172.21.15.100:0/474891580 shutdown_connections 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x56436053f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605d11b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 --2- 172.21.15.100:0/474891580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x56436053db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.031+0000 7f0ad879b740 1 -- 172.21.15.100:0/474891580 >> 172.21.15.100:0/474891580 conn(0x56436057bec0 msgr2=0x56436053ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.032+0000 7f0ad879b740 1 -- 172.21.15.100:0/474891580 shutdown_connections 2024-02-21T07:57:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.032+0000 7f0ad879b740 1 -- 172.21.15.100:0/474891580 wait complete. 2024-02-21T07:57:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.032+0000 7f0ad879b740 1 -- start start 2024-02-21T07:57:01.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.033+0000 7f0ad879b740 1 Processor -- start 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x5643605b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x564360546920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x56436057f5c0 con 0x56436053cab0 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643605b61a0 con 0x56436057c7e0 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643605b6890 con 0x5643605b7590 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ad879b740 10 client.0 _ll_register_callbacks cb 0x7f0abc02c280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ace000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ace000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33454/0 (socket says 172.21.15.100:33454) 2024-02-21T07:57:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.034+0000 7f0ace000640 1 -- 172.21.15.100:0/1198302493 learned_addr learned my addr 172.21.15.100:0/1198302493 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0acea00640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x5643605b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0ace000640 1 -- 172.21.15.100:0/1198302493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 msgr2=0x564360546920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0ace000640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x564360546920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0ace000640 1 -- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 msgr2=0x5643605b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0ace000640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x5643605b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0ace000640 1 -- 172.21.15.100:0/1198302493 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac8005010 con 0x56436057c7e0 2024-02-21T07:57:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.035+0000 7f0acea00640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x5643605b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:01.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.036+0000 7f0aafe00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.036+0000 7f0ace000640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8019420 tx=0x7f0abc008000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec3c23dd0ffb762 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8019d10 con 0x56436057c7e0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0ac801d130 con 0x56436057c7e0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0abc0b6650 con 0x56436057c7e0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ac8019110 con 0x56436057c7e0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0ad879b740 10 client.7405 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564360468650 con 0x56436057c7e0 2024-02-21T07:57:01.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.037+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc0b6650 con 0x56436057c7e0 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0ac801d2f0 con 0x56436057c7e0 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 10 client.7405 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 10 client.7405 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 20 client.7405 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c34e0 0x56436060a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 4 client.7405 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:01.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.038+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564360233890 con 0x5643605c34e0 2024-02-21T07:57:01.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.039+0000 7f0acea00640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c34e0 0x56436060a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.039+0000 7f0acea00640 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c34e0 0x56436060a950 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2cf3826b9a4f4e1 server_cookie=581d2191609a898a in_seq=0 out_seq=0 2024-02-21T07:57:01.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0aafe00640 10 client.7405 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:01.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0aafe00640 1 -- 172.21.15.100:0/1198302493 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564360233890 con 0x5643605c34e0 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0aafe00640 10 client.7405 handle_command_reply: tid=0 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 client.7405 shutdown 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 msgr2=0x5643605b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8019420 tx=0x7f0abc008000 comp rx=0 tx=0).stop 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 shutdown_connections 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5643605b7590 0x564360546920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x5643605c34e0 0x56436060a950 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56436057c7e0 0x5643605b6350 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 --2- 172.21.15.100:0/1198302493 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56436053cab0 0x5643605b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 >> 172.21.15.100:0/1198302493 conn(0x56436057bec0 msgr2=0x5643605c1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.040+0000 7f0aafe00640 0 client.7405 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 shutdown_connections 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad879b740 1 -- 172.21.15.100:0/1198302493 wait complete. 2024-02-21T07:57:01.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad879b740 20 client.7405 trim_cache size 0 max 16384 2024-02-21T07:57:01.044 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 msgr2=0x7f0ab00a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 0x7f0ab00a16e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0189940 tx=0x7f0ac0018750 comp rx=0 tx=0).stop 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 msgr2=0x7f0ad01779a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.041+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 0x7f0ad01779a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0abc033000 tx=0x7f0abc004730 comp rx=0 tx=0).stop 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 shutdown_connections 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ad00fd800 0x7f0ad01876b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0ab009f220 0x7f0ab00a16e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ad0175c70 0x7f0ad00fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 --2- 172.21.15.100:0/2420028933 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ad016b8d0 0x7f0ad01779a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 >> 172.21.15.100:0/2420028933 conn(0x7f0ad00fe290 msgr2=0x7f0ad008cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 shutdown_connections 2024-02-21T07:57:01.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.042+0000 7f0ad5a00640 1 -- 172.21.15.100:0/2420028933 wait complete. 2024-02-21T07:57:01.062 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:57:01.062 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:57:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.478+0000 7fb4d5000640 1 Processor -- start 2024-02-21T07:57:01.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.478+0000 7fb4d5000640 1 -- start start 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4d5000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4d0070a30 0x7fb4d006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4d5000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d018dc80 con 0x7fb4d006ebf0 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4d5000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d00f55d0 con 0x7fb4d0190260 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4d5000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d006f060 con 0x7fb4d0070a30 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4c7e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb4d0070a30 0x7fb4d006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.481+0000 7fb4cde00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fb4d0190260 0x7fb4d00f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:38626/0 (socket says 172.21.15.100:38626) 2024-02-21T07:57:01.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.482+0000 7fb4cde00640 1 -- 172.21.15.100:0/3793804811 learned_addr learned my addr 172.21.15.100:0/3793804811 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:01.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.482+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3793804811 >> v1:172.21.15.170:6789/0 conn(0x7fb4d0190260 legacy=0x7fb4d00f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.482+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3793804811 >> v1:172.21.15.100:6789/0 conn(0x7fb4d006ebf0 legacy=0x7fb4d0190640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.482+0000 7fb4cd400640 1 -- 172.21.15.100:0/3793804811 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111157377 0 0) 0x7fb4d00f55d0 con 0x7fb4d0190260 2024-02-21T07:57:01.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.482+0000 7fb4c7e00640 1 -- 172.21.15.100:0/3793804811 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00f58b0 con 0x7fb4d0070a30 2024-02-21T07:57:01.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.484+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/3793804811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0070a30 0x7fb4d006e6b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c654703889db04a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.484+0000 7fb4cd400640 1 -- 172.21.15.100:0/3793804811 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b802e070 con 0x7fb4d0070a30 2024-02-21T07:57:01.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4cd400640 1 -- 172.21.15.100:0/3793804811 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b80315a0 con 0x7fb4d0070a30 2024-02-21T07:57:01.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4cd400640 1 -- 172.21.15.100:0/3793804811 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8031930 con 0x7fb4d0070a30 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4d5000640 1 -- 172.21.15.100:0/3793804811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0070a30 msgr2=0x7fb4d006e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4d5000640 1 --2- 172.21.15.100:0/3793804811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0070a30 0x7fb4d006e6b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80097a0 tx=0x7fb4b802b840 comp rx=0 tx=0).stop 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4d5000640 1 -- 172.21.15.100:0/3793804811 shutdown_connections 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4d5000640 1 --2- 172.21.15.100:0/3793804811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0070a30 0x7fb4d006e6b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.485+0000 7fb4d5000640 1 -- 172.21.15.100:0/3793804811 >> 172.21.15.100:0/3793804811 conn(0x7fb4d00668b0 msgr2=0x7fb4d0066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.486+0000 7fb4d5000640 1 -- 172.21.15.100:0/3793804811 shutdown_connections 2024-02-21T07:57:01.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.486+0000 7fb4d5000640 1 -- 172.21.15.100:0/3793804811 wait complete. 2024-02-21T07:57:01.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.488+0000 7fb4d5000640 1 Processor -- start 2024-02-21T07:57:01.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.488+0000 7fb4d5000640 1 -- start start 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d006ebf0 0x7fb4d0185a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 0x7fb4d01889c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00f8b90 con 0x7fb4d0221860 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00f7d30 con 0x7fb4d006ebf0 2024-02-21T07:57:01.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.490+0000 7fb4d5000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00f8010 con 0x7fb4d0190260 2024-02-21T07:57:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.491+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.491+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46950/0 (socket says 172.21.15.100:46950) 2024-02-21T07:57:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.491+0000 7fb4ce800640 1 -- 172.21.15.100:0/534860003 learned_addr learned my addr 172.21.15.100:0/534860003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.492+0000 7fb4ce800640 1 -- 172.21.15.100:0/534860003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 msgr2=0x7fb4d01889c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:57:01.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.492+0000 7fb4cde00640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d006ebf0 0x7fb4d0185a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.495+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 0x7fb4d01889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.495+0000 7fb4ce800640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 0x7fb4d01889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.495+0000 7fb4ce800640 1 -- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d006ebf0 msgr2=0x7fb4d0185a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.495+0000 7fb4ce800640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d006ebf0 0x7fb4d0185a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.495+0000 7fb4ce800640 1 -- 172.21.15.100:0/534860003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009400 con 0x7fb4d0221860 2024-02-21T07:57:01.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.500+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 0x7fb4d01889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.501+0000 7fb4ce800640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800c3c0 tx=0x7fb4c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.502+0000 7fb4c6000640 1 -- 172.21.15.100:0/534860003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80052d0 con 0x7fb4d0221860 2024-02-21T07:57:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.502+0000 7fb4c6000640 1 -- 172.21.15.100:0/534860003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8005430 con 0x7fb4d0221860 2024-02-21T07:57:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.502+0000 7fb4c6000640 1 -- 172.21.15.100:0/534860003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8007260 con 0x7fb4d0221860 2024-02-21T07:57:01.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.502+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d00f82f0 con 0x7fb4d0221860 2024-02-21T07:57:01.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.502+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d00f88b0 con 0x7fb4d0221860 2024-02-21T07:57:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.509+0000 7fb4c6000640 1 -- 172.21.15.100:0/534860003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb4c80073c0 con 0x7fb4d0221860 2024-02-21T07:57:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.512+0000 7fb4c6000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 0x7fb4ac0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.512+0000 7fb4c6000640 1 -- 172.21.15.100:0/534860003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb4c80c8ec0 con 0x7fb4d0221860 2024-02-21T07:57:01.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.514+0000 7fb4d7dc0740 1 Processor -- start 2024-02-21T07:57:01.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.515+0000 7fb4cde00640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 0x7fb4ac0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.518+0000 7fb4d7dc0740 1 -- start start 2024-02-21T07:57:01.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4cde00640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 0x7fb4ac0a16b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00012e0 tx=0x7fb4c0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfbec0 0x55775ecfc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed37050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ec2f210 con 0x55775ed37590 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ec2c740 con 0x55775ecfbec0 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ec27f20 con 0x55775ecfc7e0 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.520+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46954/0 (socket says 172.21.15.100:46954) 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 -- 172.21.15.100:0/2383832785 learned_addr learned my addr 172.21.15.100:0/2383832785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 -- 172.21.15.100:0/2383832785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 msgr2=0x55775ed37050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed37050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 -- 172.21.15.100:0/2383832785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfbec0 msgr2=0x55775ecfc2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfbec0 0x55775ecfc2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.521+0000 7fb4ce800640 1 -- 172.21.15.100:0/2383832785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775ebe9df0 con 0x55775ed37590 2024-02-21T07:57:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.522+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80c67d0 tx=0x7fb4c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fd48ed0589b52e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.522+0000 7fb4bea00640 1 -- 172.21.15.100:0/2383832785 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c809aaf0 con 0x55775ed37590 2024-02-21T07:57:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.523+0000 7fb4bea00640 1 -- 172.21.15.100:0/2383832785 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c809f140 con 0x55775ed37590 2024-02-21T07:57:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.523+0000 7fb4bea00640 1 -- 172.21.15.100:0/2383832785 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c809aaf0 con 0x55775ed37590 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.523+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2383832785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 msgr2=0x55775ed38320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.523+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80c67d0 tx=0x7fb4c8000bc0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2383832785 shutdown_connections 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed38320 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed37050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2383832785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfbec0 0x55775ecfc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2383832785 >> 172.21.15.100:0/2383832785 conn(0x55775ecbe490 msgr2=0x55775ecbf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2383832785 shutdown_connections 2024-02-21T07:57:01.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.524+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2383832785 wait complete. 2024-02-21T07:57:01.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.526+0000 7fb4d7dc0740 1 -- start start 2024-02-21T07:57:01.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.526+0000 7fb4d7dc0740 1 Processor -- start 2024-02-21T07:57:01.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.529+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ece2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.529+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.529+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.530+0000 7fb4cde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ece2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.530+0000 7fb4cde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ece2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40816/0 (socket says 172.21.15.100:40816) 2024-02-21T07:57:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.530+0000 7fb4c7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.530+0000 7fb4c7e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33470/0 (socket says 172.21.15.100:33470) 2024-02-21T07:57:01.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.534+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.535+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ebcd150 con 0x55775ecf6880 2024-02-21T07:57:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.535+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ebccdf0 con 0x55775ed37590 2024-02-21T07:57:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.535+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775e9961c0 con 0x55775ecfc7e0 2024-02-21T07:57:01.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.535+0000 7fb4d7dc0740 10 client.0 _ll_register_callbacks cb 0x55775ec1c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:01.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.536+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46958/0 (socket says 172.21.15.100:46958) 2024-02-21T07:57:01.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.539+0000 7fb4ce800640 1 -- 172.21.15.100:0/2223453984 learned_addr learned my addr 172.21.15.100:0/2223453984 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.541+0000 7fb4ce800640 1 -- 172.21.15.100:0/2223453984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 msgr2=0x55775ece2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.541+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ece2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.541+0000 7fb4ce800640 1 -- 172.21.15.100:0/2223453984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 msgr2=0x55775ed251a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.542+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.543+0000 7fb4ce800640 1 -- 172.21.15.100:0/2223453984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d00f88b0 con 0x55775ecf6880 2024-02-21T07:57:01.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.543+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:01.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.544+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80c67d0 tx=0x7fb4c80055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21523ef8b80002cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.544+0000 7fb4b3400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:01.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.545+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c80b4020 con 0x55775ecf6880 2024-02-21T07:57:01.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.545+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb4c8095ff0 con 0x55775ecf6880 2024-02-21T07:57:01.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.546+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55775e9277e0 con 0x55775ecf6880 2024-02-21T07:57:01.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.549+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c80b4020 con 0x55775ecf6880 2024-02-21T07:57:01.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.549+0000 7fb4d7dc0740 10 client.7230 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:01.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.552+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55775ec265a0 con 0x55775ecf6880 2024-02-21T07:57:01.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.556+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55775e9277e0 con 0x55775ecf6880 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.556+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4c8092660 con 0x55775ecf6880 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 10 client.7230 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 10 client.7230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 20 client.7230 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecf6d00 0x55775ed557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 4 client.7230 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:01.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.559+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55775e964720 con 0x55775ecf6d00 2024-02-21T07:57:01.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.565+0000 7fb4cde00640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecf6d00 0x55775ed557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.566+0000 7fb4cde00640 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecf6d00 0x55775ed557a0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c721bbd1d2e5c1c server_cookie=c070bc915119117 in_seq=0 out_seq=0 2024-02-21T07:57:01.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.566+0000 7fb4b3400640 10 client.7230 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:01.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.568+0000 7fb4b3400640 1 -- 172.21.15.100:0/2223453984 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55775e964720 con 0x55775ecf6d00 2024-02-21T07:57:01.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.568+0000 7fb4b3400640 10 client.7230 handle_command_reply: tid=0 2024-02-21T07:57:01.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.569+0000 7fb4d7dc0740 1 client.7230 shutdown 2024-02-21T07:57:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.573+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 msgr2=0x55775ed54d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.573+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80c67d0 tx=0x7fb4c80055e0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 shutdown_connections 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecf6d00 0x55775ed557a0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed54d90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ed37590 0x55775ed251a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2223453984 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ece2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 >> 172.21.15.100:0/2223453984 conn(0x55775ecfbec0 msgr2=0x55775ecbf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.574+0000 7fb4b3400640 0 client.7230 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:01.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.578+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 shutdown_connections 2024-02-21T07:57:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.578+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2223453984 wait complete. 2024-02-21T07:57:01.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.578+0000 7fb4d7dc0740 20 client.7230 trim_cache size 0 max 16384 2024-02-21T07:57:01.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.603+0000 7fb4d7dc0740 1 Processor -- start 2024-02-21T07:57:01.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.603+0000 7fb4d7dc0740 1 -- start start 2024-02-21T07:57:01.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfc7e0 0x55775ecb9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ed37590 0x55775ed3cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ecf6fa0 con 0x55775ecf6880 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ed07060 con 0x55775ecfc7e0 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.605+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ecba1e0 con 0x55775ed37590 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46968/0 (socket says 172.21.15.100:46968) 2024-02-21T07:57:01.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 -- 172.21.15.100:0/1357360895 learned_addr learned my addr 172.21.15.100:0/1357360895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 -- 172.21.15.100:0/1357360895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ed37590 msgr2=0x55775ed3cce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ed37590 0x55775ed3cce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 -- 172.21.15.100:0/1357360895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfc7e0 msgr2=0x55775ecb9be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfc7e0 0x55775ecb9be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.607+0000 7fb4cde00640 1 -- 172.21.15.100:0/1357360895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775ebc2ab0 con 0x55775ecf6880 2024-02-21T07:57:01.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.608+0000 7fb4cde00640 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0005df0 tx=0x7fb4c0016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890fd914baac958f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.611+0000 7fb4be000640 1 -- 172.21.15.100:0/1357360895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c000ddc0 con 0x55775ecf6880 2024-02-21T07:57:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.611+0000 7fb4be000640 1 -- 172.21.15.100:0/1357360895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55775e964720 con 0x55775ecf6880 2024-02-21T07:57:01.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.611+0000 7fb4be000640 1 -- 172.21.15.100:0/1357360895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0007650 con 0x55775ecf6880 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.613+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/1357360895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 msgr2=0x55775ed36fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.613+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0005df0 tx=0x7fb4c0016040 comp rx=0 tx=0).stop 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/1357360895 shutdown_connections 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ed37590 0x55775ed3cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecfc7e0 0x55775ecb9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/1357360895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ecf6880 0x55775ed36fc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/1357360895 >> 172.21.15.100:0/1357360895 conn(0x55775ecfbec0 msgr2=0x55775ecbff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/1357360895 shutdown_connections 2024-02-21T07:57:01.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.614+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/1357360895 wait complete. 2024-02-21T07:57:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.618+0000 7fb4d7dc0740 1 -- start start 2024-02-21T07:57:01.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.618+0000 7fb4d7dc0740 1 Processor -- start 2024-02-21T07:57:01.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecf6880 0x55775ecb9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed3c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ed32be0 con 0x55775ed37590 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ed3cae0 con 0x55775ecf6880 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775ed3c930 con 0x55775ecfc7e0 2024-02-21T07:57:01.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.627+0000 7fb4d7dc0740 10 client.0 _ll_register_callbacks cb 0x7fb4c8092c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.629+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.629+0000 7fb4ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46982/0 (socket says 172.21.15.100:46982) 2024-02-21T07:57:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.629+0000 7fb4ce800640 1 -- 172.21.15.100:0/2437232940 learned_addr learned my addr 172.21.15.100:0/2437232940 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.629+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed3c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.629+0000 7fb4c7e00640 1 -- 172.21.15.100:0/2437232940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecf6880 msgr2=0x55775ecb9be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4cde00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecf6880 0x55775ecb9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecf6880 0x55775ecb9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4c7e00640 1 -- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 msgr2=0x55775ed9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4c7e00640 1 -- 172.21.15.100:0/2437232940 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c001c040 con 0x55775ecfc7e0 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.631+0000 7fb4ce800640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:01.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.632+0000 7fb4c7e00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed3c3f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0074ae0 tx=0x7fb4b8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de88ff086e1fcf0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:01.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4b3400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:01.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8042070 con 0x55775ecfc7e0 2024-02-21T07:57:01.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb4b8031c20 con 0x55775ecfc7e0 2024-02-21T07:57:01.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4c809f140 con 0x55775ecfc7e0 2024-02-21T07:57:01.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b8031de0 con 0x55775ecfc7e0 2024-02-21T07:57:01.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4d7dc0740 10 client.7331 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:01.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55775ebe8650 con 0x55775ecfc7e0 2024-02-21T07:57:01.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.633+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c809f140 con 0x55775ecfc7e0 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4b8003610 con 0x55775ecfc7e0 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 10 client.7331 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 10 client.7331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 20 client.7331 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecbf960 0x55775ecbdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 4 client.7331 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55775e9b3890 con 0x55775ecbf960 2024-02-21T07:57:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.634+0000 7fb4cde00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecbf960 0x55775ecbdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:01.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.635+0000 7fb4cde00640 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecbf960 0x55775ecbdb60 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec03b5e19f28bbe9 server_cookie=b4056aefcf4c7f39 in_seq=0 out_seq=0 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.635+0000 7fb4b3400640 10 client.7331 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.635+0000 7fb4b3400640 1 -- 172.21.15.100:0/2437232940 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55775e9b3890 con 0x55775ecbf960 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.635+0000 7fb4b3400640 10 client.7331 handle_command_reply: tid=0 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.635+0000 7fb4d7dc0740 1 client.7331 shutdown 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 msgr2=0x55775ed3c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed3c3f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0074ae0 tx=0x7fb4b8004730 comp rx=0 tx=0).stop 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 shutdown_connections 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55775ecbf960 0x55775ecbdb60 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55775ed37590 0x55775ed9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55775ecfc7e0 0x55775ed3c3f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 --2- 172.21.15.100:0/2437232940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55775ecf6880 0x55775ecb9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 >> 172.21.15.100:0/2437232940 conn(0x55775ecfbec0 msgr2=0x55775ecbff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4b3400640 0 client.7331 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 shutdown_connections 2024-02-21T07:57:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.636+0000 7fb4d7dc0740 1 -- 172.21.15.100:0/2437232940 wait complete. 2024-02-21T07:57:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.637+0000 7fb4d7dc0740 20 client.7331 trim_cache size 0 max 16384 2024-02-21T07:57:01.639 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:01.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.637+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 msgr2=0x7fb4ac0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.637+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 0x7fb4ac0a16b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00012e0 tx=0x7fb4c0009040 comp rx=0 tx=0).stop 2024-02-21T07:57:01.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.637+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 msgr2=0x7fb4d0221cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:01.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.637+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb4c800c3c0 tx=0x7fb4c800c880 comp rx=0 tx=0).stop 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 shutdown_connections 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb4ac09f1f0 0x7fb4ac0a16b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4d0221860 0x7fb4d0221cf0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4d0190260 0x7fb4d01889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 --2- 172.21.15.100:0/534860003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb4d006ebf0 0x7fb4d0185a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 >> 172.21.15.100:0/534860003 conn(0x7fb4d00668b0 msgr2=0x7fb4d0071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 shutdown_connections 2024-02-21T07:57:01.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:01.638+0000 7fb4d5000640 1 -- 172.21.15.100:0/534860003 wait complete. 2024-02-21T07:57:02.675 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:57:02.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:57:02.676 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:57:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.022+0000 7f33bd800640 1 Processor -- start 2024-02-21T07:57:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.022+0000 7f33bd800640 1 -- start start 2024-02-21T07:57:03.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.026+0000 7f33bd800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f33b80f9650 0x7f33b80f9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.026+0000 7f33bd800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b815df60 con 0x7f33b815db80 2024-02-21T07:57:03.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.026+0000 7f33bd800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b818cdf0 con 0x7f33b80d45e0 2024-02-21T07:57:03.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.026+0000 7f33bd800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80fab80 con 0x7f33b80f9650 2024-02-21T07:57:03.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.027+0000 7f33b6000640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f33b80d45e0 0x7f33b80d4a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:32938/0 (socket says 172.21.15.100:32938) 2024-02-21T07:57:03.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.027+0000 7f33b6000640 1 -- 172.21.15.100:0/885122801 learned_addr learned my addr 172.21.15.100:0/885122801 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:03.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.027+0000 7f33b7400640 1 --2- 172.21.15.100:0/885122801 >> v2:172.21.15.156:3300/0 conn(0x7f33b80f9650 0x7f33b80f9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.028+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744480220 0 0) 0x7f33b818cdf0 con 0x7f33b80d45e0 2024-02-21T07:57:03.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.028+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f339c003520 con 0x7f33b80d45e0 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.029+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944097670 0 0) 0x7f339c003520 con 0x7f33b80d45e0 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 >> v2:172.21.15.156:3300/0 conn(0x7f33b80f9650 msgr2=0x7f33b80f9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 --2- 172.21.15.100:0/885122801 >> v2:172.21.15.156:3300/0 conn(0x7f33b80f9650 0x7f33b80f9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 >> v1:172.21.15.100:6789/0 conn(0x7f33b815db80 legacy=0x7f33b818c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80fae60 con 0x7f33b80d45e0 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f33a4001650 con 0x7f33b80d45e0 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 >> v1:172.21.15.156:6789/0 conn(0x7f33b80d45e0 legacy=0x7f33b80d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339c003970 0x7f339c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0047c0 0x7f339c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 0x7f339c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80fab80 con 0x7f339c003970 2024-02-21T07:57:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00c1f0 con 0x7f339c0052a0 2024-02-21T07:57:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.031+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00c3b0 con 0x7f339c0047c0 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.032+0000 7f33b7400640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 0x7f339c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.032+0000 7f33b6a00640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339c003970 0x7f339c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.033+0000 7f33b7400640 1 -- 172.21.15.100:0/885122801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0047c0 msgr2=0x7f339c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.033+0000 7f33b7400640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0047c0 0x7f339c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.033+0000 7f33b7400640 1 -- 172.21.15.100:0/885122801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339c003970 msgr2=0x7f339c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.033+0000 7f33b7400640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339c003970 0x7f339c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.033+0000 7f33b7400640 1 -- 172.21.15.100:0/885122801 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80fae60 con 0x7f339c0052a0 2024-02-21T07:57:03.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.034+0000 7f33b7400640 1 -- 172.21.15.100:0/885122801 reap_dead start 2024-02-21T07:57:03.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.035+0000 7f33b7400640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 0x7f339c00b980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f33b0007330 tx=0x7f339c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a3b62dfb8c7cc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.035+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b002ccd0 con 0x7f339c0052a0 2024-02-21T07:57:03.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.035+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b002ce30 con 0x7f339c0052a0 2024-02-21T07:57:03.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.035+0000 7f33b5600640 1 -- 172.21.15.100:0/885122801 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0003bd0 con 0x7f339c0052a0 2024-02-21T07:57:03.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 -- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 msgr2=0x7f339c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 0x7f339c00b980 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f33b0007330 tx=0x7f339c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 -- 172.21.15.100:0/885122801 shutdown_connections 2024-02-21T07:57:03.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 --2- 172.21.15.100:0/885122801 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f339c0052a0 0x7f339c00b980 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 -- 172.21.15.100:0/885122801 >> 172.21.15.100:0/885122801 conn(0x7f33b80d28e0 msgr2=0x7f33b80d2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 -- 172.21.15.100:0/885122801 shutdown_connections 2024-02-21T07:57:03.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.036+0000 7f33bd800640 1 -- 172.21.15.100:0/885122801 wait complete. 2024-02-21T07:57:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.039+0000 7f33bd800640 1 Processor -- start 2024-02-21T07:57:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.042+0000 7f33bd800640 1 -- start start 2024-02-21T07:57:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 0x7f33b8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 0x7f33b817c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 0x7f33b817c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b817b480 con 0x7f33b8179dc0 2024-02-21T07:57:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80d2240 con 0x7f33b817a240 2024-02-21T07:57:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33bd800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b80d2520 con 0x7f339c0052a0 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33b7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 0x7f33b817c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33b7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 0x7f33b817c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33490/0 (socket says 172.21.15.100:33490) 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33b7400640 1 -- 172.21.15.100:0/1547400770 learned_addr learned my addr 172.21.15.100:0/1547400770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 0x7f33b8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.044+0000 7f33b6000640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 0x7f33b817c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6a00640 1 -- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 msgr2=0x7f33b817c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 0x7f33b817c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6a00640 1 -- 172.21.15.100:0/1547400770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 msgr2=0x7f33b817c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 0x7f33b817c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6a00640 1 -- 172.21.15.100:0/1547400770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b817b690 con 0x7f339c0052a0 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.045+0000 7f33b6000640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 0x7f33b817c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.046+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 0x7f33b8153980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f33b8050150 tx=0x7f33a800e910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.047+0000 7f33aea00640 1 -- 172.21.15.100:0/1547400770 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80052e0 con 0x7f339c0052a0 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.047+0000 7f33aea00640 1 -- 172.21.15.100:0/1547400770 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8005460 con 0x7f339c0052a0 2024-02-21T07:57:03.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.047+0000 7f33aea00640 1 -- 172.21.15.100:0/1547400770 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8003830 con 0x7f339c0052a0 2024-02-21T07:57:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.048+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b817b970 con 0x7f339c0052a0 2024-02-21T07:57:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.048+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b8153ec0 con 0x7f339c0052a0 2024-02-21T07:57:03.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.052+0000 7f33aea00640 1 -- 172.21.15.100:0/1547400770 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f33a8003990 con 0x7f339c0052a0 2024-02-21T07:57:03.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.052+0000 7f33c057a740 1 Processor -- start 2024-02-21T07:57:03.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.052+0000 7f33c057a740 1 -- start start 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.053+0000 7f33aea00640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 0x7f33980a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.053+0000 7f33aea00640 1 -- 172.21.15.100:0/1547400770 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f33a80c9680 con 0x7f339c0052a0 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b7400640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 0x7f33980a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401a9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x5560401aa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560400ee300 con 0x5560401a9890 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560400a0e50 con 0x55604016eae0 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33c057a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604009e380 con 0x55604016e1c0 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40858/0 (socket says 172.21.15.100:40858) 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 -- 172.21.15.100:0/905933876 learned_addr learned my addr 172.21.15.100:0/905933876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6000640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 -- 172.21.15.100:0/905933876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 msgr2=0x5560401a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 -- 172.21.15.100:0/905933876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 msgr2=0x5560401aa620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b7400640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x5560401aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x5560401aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.054+0000 7f33b6a00640 1 -- 172.21.15.100:0/905933876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556040062c80 con 0x55604016e1c0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33b7400640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x5560401aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33b6a00640 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f33a80936b0 tx=0x7f33a8096c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed36dc56a49fb9f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33b7400640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 0x7f33980a1660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33b002ce00 tx=0x7f33b002e070 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33a3400640 1 -- 172.21.15.100:0/905933876 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a809b170 con 0x55604016e1c0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33a3400640 1 -- 172.21.15.100:0/905933876 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a809f960 con 0x55604016e1c0 2024-02-21T07:57:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.055+0000 7f33a3400640 1 -- 172.21.15.100:0/905933876 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80938c0 con 0x55604016e1c0 2024-02-21T07:57:03.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 -- 172.21.15.100:0/905933876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 msgr2=0x55604016e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f33a80936b0 tx=0x7f33a8096c70 comp rx=0 tx=0).stop 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 -- 172.21.15.100:0/905933876 shutdown_connections 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x5560401aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 --2- 172.21.15.100:0/905933876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55604016e1c0 0x55604016e5a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 -- 172.21.15.100:0/905933876 >> 172.21.15.100:0/905933876 conn(0x556040130790 msgr2=0x556040131810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 -- 172.21.15.100:0/905933876 shutdown_connections 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.056+0000 7f33c057a740 1 -- 172.21.15.100:0/905933876 wait complete. 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.057+0000 7f33c057a740 1 -- start start 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.057+0000 7f33c057a740 1 Processor -- start 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x55604012c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556040099b60 con 0x5560401a9890 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604003efd0 con 0x55604016eae0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604003ec70 con 0x5560401668a0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.058+0000 7f33c057a740 10 client.0 _ll_register_callbacks cb 0x55603fdaac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47030/0 (socket says 172.21.15.100:47030) 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 -- 172.21.15.100:0/1564964429 learned_addr learned my addr 172.21.15.100:0/1564964429 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b7400640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x55604012c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 -- 172.21.15.100:0/1564964429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 msgr2=0x55604012c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x55604012c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 -- 172.21.15.100:0/1564964429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 msgr2=0x5560401b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6000640 1 -- 172.21.15.100:0/1564964429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b8153ec0 con 0x5560401a9890 2024-02-21T07:57:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.059+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f33b6000640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f33a4007730 tx=0x7f33a4004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76d3075855f7f84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f3397e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4004e60 con 0x5560401a9890 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f33a40119e0 con 0x5560401a9890 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55603fd99860 con 0x5560401a9890 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33a4011bf0 con 0x5560401a9890 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f33c057a740 10 client.7245 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:03.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5560400981e0 con 0x5560401a9890 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.060+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55603fd99860 con 0x5560401a9890 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33a4011d50 con 0x5560401a9890 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 10 client.7245 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 10 client.7245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 20 client.7245 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55604016ae90 0x5560401b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 4 client.7245 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55603fdea410 con 0x55604016ae90 2024-02-21T07:57:03.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.061+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55604016ae90 0x5560401b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.062+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55604016ae90 0x5560401b6280 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389b34194886d93c server_cookie=f8e5fbdba260330a in_seq=0 out_seq=0 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.062+0000 7f3397e00640 10 client.7245 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.063+0000 7f3397e00640 1 -- 172.21.15.100:0/1564964429 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55603fdea410 con 0x55604016ae90 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.063+0000 7f3397e00640 10 client.7245 handle_command_reply: tid=0 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.063+0000 7f33c057a740 1 client.7245 shutdown 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.063+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 msgr2=0x556040162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.063+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f33a4007730 tx=0x7f33a4004c70 comp rx=0 tx=0).stop 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 shutdown_connections 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55604016ae90 0x5560401b6280 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x55604012c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560401a9890 0x556040162b10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 --2- 172.21.15.100:0/1564964429 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x5560401b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f3397e00640 0 client.7245 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 >> 172.21.15.100:0/1564964429 conn(0x55604016e1c0 msgr2=0x5560401a9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 shutdown_connections 2024-02-21T07:57:03.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 1 -- 172.21.15.100:0/1564964429 wait complete. 2024-02-21T07:57:03.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.064+0000 7f33c057a740 20 client.7245 trim_cache size 0 max 16384 2024-02-21T07:57:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.084+0000 7f33c057a740 1 Processor -- start 2024-02-21T07:57:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.084+0000 7f33c057a740 1 -- start start 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556040131b20 0x556040208a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55603fde20c0 con 0x55604016eae0 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556040163720 con 0x5560401668a0 2024-02-21T07:57:03.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33c057a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604012ef00 con 0x556040131b20 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33524/0 (socket says 172.21.15.100:33524) 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47044/0 (socket says 172.21.15.100:47044) 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b6a00640 1 -- 172.21.15.100:0/2238231973 learned_addr learned my addr 172.21.15.100:0/2238231973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.085+0000 7f33b7400640 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556040131b20 0x556040208a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 -- 172.21.15.100:0/2238231973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556040131b20 msgr2=0x556040208a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556040131b20 0x556040208a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 -- 172.21.15.100:0/2238231973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 msgr2=0x5560401a9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 -- 172.21.15.100:0/2238231973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556040034a90 con 0x55604016eae0 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6a00640 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33b6000640 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f33a400a000 tx=0x7f33a400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1fc1476b173dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33a2a00640 1 -- 172.21.15.100:0/2238231973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011620 con 0x55604016eae0 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33a2a00640 1 -- 172.21.15.100:0/2238231973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4001c20 con 0x55604016eae0 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.086+0000 7f33a2a00640 1 -- 172.21.15.100:0/2238231973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40119e0 con 0x55604016eae0 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 -- 172.21.15.100:0/2238231973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 msgr2=0x5560401631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f33a400a000 tx=0x7f33a400c000 comp rx=0 tx=0).stop 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 -- 172.21.15.100:0/2238231973 shutdown_connections 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556040131b20 0x556040208a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55604016eae0 0x5560401631e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 --2- 172.21.15.100:0/2238231973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5560401668a0 0x5560401a9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 -- 172.21.15.100:0/2238231973 >> 172.21.15.100:0/2238231973 conn(0x55604016e1c0 msgr2=0x556040132200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 -- 172.21.15.100:0/2238231973 shutdown_connections 2024-02-21T07:57:03.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.087+0000 7f33c057a740 1 -- 172.21.15.100:0/2238231973 wait complete. 2024-02-21T07:57:03.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.088+0000 7f33c057a740 1 -- start start 2024-02-21T07:57:03.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.088+0000 7f33c057a740 1 Processor -- start 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x5560401648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x55604015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x556040164e20 con 0x556040131b20 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604015fbb0 con 0x55604016eae0 2024-02-21T07:57:03.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55604019ede0 con 0x5560401668a0 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.089+0000 7f33c057a740 10 client.0 _ll_register_callbacks cb 0x7f33a80934f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x5560401648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47048/0 (socket says 172.21.15.100:47048) 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 -- 172.21.15.100:0/1802736845 learned_addr learned my addr 172.21.15.100:0/1802736845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b7400640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x55604015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 -- 172.21.15.100:0/1802736845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 msgr2=0x5560401648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x5560401648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 -- 172.21.15.100:0/1802736845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 msgr2=0x55604015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x55604015eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 -- 172.21.15.100:0/1802736845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80b2040 con 0x556040131b20 2024-02-21T07:57:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33b6a00640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f33a8096f50 tx=0x7f33a801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cad2fc6e988664 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f3397e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a809b170 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f33a8095550 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.090+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33a809f960 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33a80938c0 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 10 client.7251 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5560400981e0 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a809f960 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f33a80ad020 con 0x556040131b20 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 10 client.7251 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 10 client.7251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 20 client.7251 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5560402058e0 0x5560401a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 4 client.7251 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55603fdd67b0 con 0x5560402058e0 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.091+0000 7f33b6000640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5560402058e0 0x5560401a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.092+0000 7f33b6000640 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5560402058e0 0x5560401a7010 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c689ab6cd6876f00 server_cookie=da7229f2907aa828 in_seq=0 out_seq=0 2024-02-21T07:57:03.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.092+0000 7f3397e00640 10 client.7251 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.093+0000 7f3397e00640 1 -- 172.21.15.100:0/1802736845 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55603fdd67b0 con 0x5560402058e0 2024-02-21T07:57:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.093+0000 7f3397e00640 10 client.7251 handle_command_reply: tid=0 2024-02-21T07:57:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.093+0000 7f33c057a740 1 client.7251 shutdown 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.093+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 msgr2=0x55604016e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.093+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f33a8096f50 tx=0x7f33a801f040 comp rx=0 tx=0).stop 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 shutdown_connections 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5560402058e0 0x5560401a7010 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55604016eae0 0x55604015eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5560401668a0 0x5560401648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 --2- 172.21.15.100:0/1802736845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556040131b20 0x55604016e5a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 >> 172.21.15.100:0/1802736845 conn(0x55604016e1c0 msgr2=0x5560401c38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f3397e00640 0 client.7251 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 shutdown_connections 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 1 -- 172.21.15.100:0/1802736845 wait complete. 2024-02-21T07:57:03.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.094+0000 7f33c057a740 20 client.7251 trim_cache size 0 max 16384 2024-02-21T07:57:03.099 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:57:03.099 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:57:03.099 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "38d9a138-dde8-4e6c-aefb-33a135a4a6b4", 2024-02-21T07:57:03.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:57:03.099 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 msgr2=0x7f33980a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 0x7f33980a1660 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f33b002ce00 tx=0x7f33b002e070 comp rx=0 tx=0).stop 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 msgr2=0x7f33b8153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 0x7f33b8153980 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f33b8050150 tx=0x7f33a800e910 comp rx=0 tx=0).stop 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 shutdown_connections 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f33b817a240 0x7f33b817c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f339809f1a0 0x7f33980a1660 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33b8179dc0 0x7f33b817c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 --2- 172.21.15.100:0/1547400770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f339c0052a0 0x7f33b8153980 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.095+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 >> 172.21.15.100:0/1547400770 conn(0x7f33b80d28e0 msgr2=0x7f33b80cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.096+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 shutdown_connections 2024-02-21T07:57:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.096+0000 7f33bd800640 1 -- 172.21.15.100:0/1547400770 wait complete. 2024-02-21T07:57:03.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:57:03.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:57:03.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.475+0000 7f98cea00640 1 Processor -- start 2024-02-21T07:57:03.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.476+0000 7f98cea00640 1 -- start start 2024-02-21T07:57:03.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.479+0000 7f98cea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f98c8183e70 0x7f98c8188e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.479+0000 7f98cea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8188900 con 0x7f98c8182fc0 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.479+0000 7f98cea00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c8186650 con 0x7f98c8187240 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.479+0000 7f98cea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c8187a10 con 0x7f98c8183e70 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.480+0000 7f98cca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f98c8183e70 0x7f98c8188e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.480+0000 7f98c7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f98c8182fc0 0x7f98c8186b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:32834/0 (socket says 172.21.15.100:32834) 2024-02-21T07:57:03.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.480+0000 7f98c7e00640 1 -- 172.21.15.100:0/2175511157 learned_addr learned my addr 172.21.15.100:0/2175511157 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.481+0000 7f98c6a00640 1 -- 172.21.15.100:0/2175511157 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127088173 0 0) 0x7f98c8188900 con 0x7f98c8182fc0 2024-02-21T07:57:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.481+0000 7f98c6a00640 1 -- 172.21.15.100:0/2175511157 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac003520 con 0x7f98c8182fc0 2024-02-21T07:57:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.481+0000 7f98cca00640 1 -- 172.21.15.100:0/2175511157 >> v1:172.21.15.156:6789/0 conn(0x7f98c8187240 legacy=0x7f98c8183760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.481+0000 7f98cca00640 1 -- 172.21.15.100:0/2175511157 >> v1:172.21.15.100:6789/0 conn(0x7f98c8182fc0 legacy=0x7f98c8186b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.482+0000 7f98cca00640 1 -- 172.21.15.100:0/2175511157 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8187cf0 con 0x7f98c8183e70 2024-02-21T07:57:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.483+0000 7f98cca00640 1 --2- 172.21.15.100:0/2175511157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8188e70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009d90 tx=0x7f98c002e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ba345ca4a227a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.484+0000 7f98c6a00640 1 -- 172.21.15.100:0/2175511157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c002ede0 con 0x7f98c8183e70 2024-02-21T07:57:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.484+0000 7f98c6a00640 1 -- 172.21.15.100:0/2175511157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0036440 con 0x7f98c8183e70 2024-02-21T07:57:03.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.484+0000 7f98c6a00640 1 -- 172.21.15.100:0/2175511157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00367d0 con 0x7f98c8183e70 2024-02-21T07:57:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 -- 172.21.15.100:0/2175511157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 msgr2=0x7f98c8188e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 --2- 172.21.15.100:0/2175511157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8188e70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009d90 tx=0x7f98c002e030 comp rx=0 tx=0).stop 2024-02-21T07:57:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 -- 172.21.15.100:0/2175511157 shutdown_connections 2024-02-21T07:57:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 --2- 172.21.15.100:0/2175511157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8188e70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 -- 172.21.15.100:0/2175511157 >> 172.21.15.100:0/2175511157 conn(0x7f98c80cf400 msgr2=0x7f98c80cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 -- 172.21.15.100:0/2175511157 shutdown_connections 2024-02-21T07:57:03.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.485+0000 7f98cea00640 1 -- 172.21.15.100:0/2175511157 wait complete. 2024-02-21T07:57:03.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.488+0000 7f98cea00640 1 Processor -- start 2024-02-21T07:57:03.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.488+0000 7f98cea00640 1 -- start start 2024-02-21T07:57:03.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c8182fc0 0x7f98c8169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 0x7f98c8181a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80f3670 con 0x7f98c8183e70 2024-02-21T07:57:03.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8185120 con 0x7f98c8182fc0 2024-02-21T07:57:03.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cea00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80f3910 con 0x7f98c8187240 2024-02-21T07:57:03.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98c7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 0x7f98c8181a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 0x7f98c8181a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40896/0 (socket says 172.21.15.100:40896) 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98c7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47060/0 (socket says 172.21.15.100:47060) 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.489+0000 7f98cca00640 1 -- 172.21.15.100:0/360393491 learned_addr learned my addr 172.21.15.100:0/360393491 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7e00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c8182fc0 0x7f98c8169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7400640 1 -- 172.21.15.100:0/360393491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 msgr2=0x7f98c8181a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7400640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 0x7f98c8181a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7400640 1 -- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c8182fc0 msgr2=0x7f98c8169b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7400640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c8182fc0 0x7f98c8169b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.490+0000 7f98c7400640 1 -- 172.21.15.100:0/360393491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0009a70 con 0x7f98c8183e70 2024-02-21T07:57:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.491+0000 7f98c7400640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f98b400c390 tx=0x7f98b400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.492+0000 7f98bfe00640 1 -- 172.21.15.100:0/360393491 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40052d0 con 0x7f98c8183e70 2024-02-21T07:57:03.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.492+0000 7f98bfe00640 1 -- 172.21.15.100:0/360393491 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b4005430 con 0x7f98c8183e70 2024-02-21T07:57:03.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.492+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c80f3bf0 con 0x7f98c8183e70 2024-02-21T07:57:03.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.492+0000 7f98bfe00640 1 -- 172.21.15.100:0/360393491 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b4003830 con 0x7f98c8183e70 2024-02-21T07:57:03.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.492+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80f41b0 con 0x7f98c8183e70 2024-02-21T07:57:03.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.495+0000 7f98bfe00640 1 -- 172.21.15.100:0/360393491 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f98b4003990 con 0x7f98c8183e70 2024-02-21T07:57:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.496+0000 7f98d1778740 1 Processor -- start 2024-02-21T07:57:03.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.497+0000 7f98d1778740 1 -- start start 2024-02-21T07:57:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.497+0000 7f98bfe00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 0x7f98a80a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.497+0000 7f98bfe00640 1 -- 172.21.15.100:0/360393491 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f98b40c9070 con 0x7f98c8183e70 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e429be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e4294b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e428b7150 con 0x562e429887d0 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e428b4680 con 0x562e429890f0 2024-02-21T07:57:03.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.498+0000 7f98d1778740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e428afe60 con 0x562e429be790 2024-02-21T07:57:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.499+0000 7f98cca00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 0x7f98a80a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40906/0 (socket says 172.21.15.100:40906) 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 -- 172.21.15.100:0/481406683 learned_addr learned my addr 172.21.15.100:0/481406683 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 -- 172.21.15.100:0/481406683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 msgr2=0x562e4294b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e4294b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 -- 172.21.15.100:0/481406683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 msgr2=0x562e429be250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e429be250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.501+0000 7f98c7400640 1 -- 172.21.15.100:0/481406683 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e42869060 con 0x562e429be790 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.502+0000 7f98c7400640 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f98b40c6980 tx=0x7f98b4096570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2bb2c86d1e6667d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.509+0000 7f98b3e00640 1 -- 172.21.15.100:0/481406683 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b409f2f0 con 0x562e429be790 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.510+0000 7f98b3e00640 1 -- 172.21.15.100:0/481406683 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b4094e50 con 0x562e429be790 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.512+0000 7f98d1778740 1 -- 172.21.15.100:0/481406683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 msgr2=0x562e42988bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.512+0000 7f98d1778740 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f98b40c6980 tx=0x7f98b4096570 comp rx=0 tx=0).stop 2024-02-21T07:57:03.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 -- 172.21.15.100:0/481406683 shutdown_connections 2024-02-21T07:57:03.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e4294b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42988bb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 --2- 172.21.15.100:0/481406683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e429be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 -- 172.21.15.100:0/481406683 >> 172.21.15.100:0/481406683 conn(0x562e4290f5a0 msgr2=0x562e4294f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98cca00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 0x7f98a80a1660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f98c002e070 tx=0x7f98c0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 -- 172.21.15.100:0/481406683 shutdown_connections 2024-02-21T07:57:03.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.518+0000 7f98d1778740 1 -- 172.21.15.100:0/481406683 wait complete. 2024-02-21T07:57:03.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.520+0000 7f98d1778740 1 -- start start 2024-02-21T07:57:03.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.520+0000 7f98d1778740 1 Processor -- start 2024-02-21T07:57:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e429c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429890f0 0x562e42990790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42854ec0 con 0x562e429be790 2024-02-21T07:57:03.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42854b60 con 0x562e429887d0 2024-02-21T07:57:03.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4261e1c0 con 0x562e429890f0 2024-02-21T07:57:03.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.525+0000 7f98d1778740 10 client.0 _ll_register_callbacks cb 0x562e42868960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:03.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.535+0000 7f98cca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47068/0 (socket says 172.21.15.100:47068) 2024-02-21T07:57:03.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 -- 172.21.15.100:0/652505574 learned_addr learned my addr 172.21.15.100:0/652505574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 -- 172.21.15.100:0/652505574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429890f0 msgr2=0x562e42990790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429890f0 0x562e42990790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 -- 172.21.15.100:0/652505574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 msgr2=0x562e429c2750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e429c2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.536+0000 7f98cca00640 1 -- 172.21.15.100:0/652505574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80f41b0 con 0x562e429be790 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.538+0000 7f98cca00640 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f98c0036d70 tx=0x7f98c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceaa9f8f0d30012 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.539+0000 7f98b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.539+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c002eea0 con 0x562e429be790 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.539+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f98c0043e00 con 0x562e429be790 2024-02-21T07:57:03.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.540+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e425af7e0 con 0x562e429be790 2024-02-21T07:57:03.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.541+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98c0036e60 con 0x562e429be790 2024-02-21T07:57:03.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.542+0000 7f98d1778740 10 client.7263 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:03.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.542+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562e428ae4e0 con 0x562e429be790 2024-02-21T07:57:03.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.543+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e425af7e0 con 0x562e429be790 2024-02-21T07:57:03.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.544+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f98c0054070 con 0x562e429be790 2024-02-21T07:57:03.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.545+0000 7f98d1778740 10 client.7263 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:03.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.545+0000 7f98d1778740 10 client.7263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.545+0000 7f98d1778740 20 client.7263 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.545+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e429b04d0 0x562e429a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.545+0000 7f98d1778740 4 client.7263 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.546+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e425ec720 con 0x562e429b04d0 2024-02-21T07:57:03.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.547+0000 7f98c7e00640 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e429b04d0 0x562e429a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.548+0000 7f98c7e00640 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e429b04d0 0x562e429a7c60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15aac614a6fd48 server_cookie=d3f3727357f399c9 in_seq=0 out_seq=0 2024-02-21T07:57:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.548+0000 7f98b0c00640 10 client.7263 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.556+0000 7f98b0c00640 1 -- 172.21.15.100:0/652505574 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562e425ec720 con 0x562e429b04d0 2024-02-21T07:57:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.556+0000 7f98b0c00640 10 client.7263 handle_command_reply: tid=0 2024-02-21T07:57:03.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.556+0000 7f98d1778740 1 client.7263 shutdown 2024-02-21T07:57:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.562+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 msgr2=0x562e429c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.562+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f98c0036d70 tx=0x7f98c0004ab0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 shutdown_connections 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e429b04d0 0x562e429a7c60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429be790 0x562e429c1c30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429890f0 0x562e42990790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 --2- 172.21.15.100:0/652505574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e429c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.565+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 >> 172.21.15.100:0/652505574 conn(0x562e4290f5a0 msgr2=0x562e42956ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.566+0000 7f98b0c00640 0 client.7263 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.566+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 shutdown_connections 2024-02-21T07:57:03.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.567+0000 7f98d1778740 1 -- 172.21.15.100:0/652505574 wait complete. 2024-02-21T07:57:03.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.567+0000 7f98d1778740 20 client.7263 trim_cache size 0 max 16384 2024-02-21T07:57:03.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.620+0000 7f98d1778740 1 Processor -- start 2024-02-21T07:57:03.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.621+0000 7f98d1778740 1 -- start start 2024-02-21T07:57:03.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.623+0000 7f98d1778740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e4294f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.624+0000 7f98d1778740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 0x562e429b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.624+0000 7f98d1778740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98cca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98cca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:40922/0 (socket says 172.21.15.100:40922) 2024-02-21T07:57:03.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98cca00640 1 -- 172.21.15.100:0/2567493106 learned_addr learned my addr 172.21.15.100:0/2567493106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42982d30 con 0x562e429890f0 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e429b0ba0 con 0x562e429887d0 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e4294e3c0 con 0x562e429be790 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.626+0000 7f98c7400640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 0x562e429b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.628+0000 7f98c7e00640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e4294f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.628+0000 7f98cca00640 1 -- 172.21.15.100:0/2567493106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 msgr2=0x562e4294f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.628+0000 7f98cca00640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e4294f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.628+0000 7f98cca00640 1 -- 172.21.15.100:0/2567493106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 msgr2=0x562e429b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.630+0000 7f98cca00640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 0x562e429b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.630+0000 7f98cca00640 1 -- 172.21.15.100:0/2567493106 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e4284a950 con 0x562e429be790 2024-02-21T07:57:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.630+0000 7f98c7400640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 0x562e429b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:03.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.631+0000 7f98cca00640 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f98c0043840 tx=0x7f98c0046040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aafd8f49ada0c454 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.631+0000 7f98b3400640 1 -- 172.21.15.100:0/2567493106 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0036e60 con 0x562e429be790 2024-02-21T07:57:03.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.631+0000 7f98b3400640 1 -- 172.21.15.100:0/2567493106 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0043c00 con 0x562e429be790 2024-02-21T07:57:03.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.631+0000 7f98b3400640 1 -- 172.21.15.100:0/2567493106 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c00448f0 con 0x562e429be790 2024-02-21T07:57:03.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.634+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 msgr2=0x562e42a2e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f98c0043840 tx=0x7f98c0046040 comp rx=0 tx=0).stop 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 shutdown_connections 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e42a2e3f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429890f0 0x562e429b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 --2- 172.21.15.100:0/2567493106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429887d0 0x562e4294f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.638+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 >> 172.21.15.100:0/2567493106 conn(0x562e4290f5a0 msgr2=0x562e429415a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.639+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 shutdown_connections 2024-02-21T07:57:03.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.639+0000 7f98d1778740 1 -- 172.21.15.100:0/2567493106 wait complete. 2024-02-21T07:57:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.642+0000 7f98d1778740 1 -- start start 2024-02-21T07:57:03.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.643+0000 7f98d1778740 1 Processor -- start 2024-02-21T07:57:03.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.649+0000 7f98d1778740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e42a37360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.650+0000 7f98d1778740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.650+0000 7f98d1778740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e4294a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.650+0000 7f98d1778740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42a33a40 con 0x562e429887d0 2024-02-21T07:57:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.650+0000 7f98d1778740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42a36ed0 con 0x562e429890f0 2024-02-21T07:57:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.651+0000 7f98d1778740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e42a33830 con 0x562e429be790 2024-02-21T07:57:03.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.651+0000 7f98c7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.651+0000 7f98c7400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:33586/0 (socket says 172.21.15.100:33586) 2024-02-21T07:57:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.652+0000 7f98c7400640 1 -- 172.21.15.100:0/603438736 learned_addr learned my addr 172.21.15.100:0/603438736 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.652+0000 7f98d1778740 10 client.0 _ll_register_callbacks cb 0x7f98ac0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.652+0000 7f98cca00640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e4294a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.652+0000 7f98c7e00640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e42a37360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.653+0000 7f98c7400640 1 -- 172.21.15.100:0/603438736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 msgr2=0x562e4294a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.653+0000 7f98c7400640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e4294a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.653+0000 7f98c7400640 1 -- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 msgr2=0x562e42a37360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.654+0000 7f98c7400640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e42a37360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.654+0000 7f98c7400640 1 -- 172.21.15.100:0/603438736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e428ae4e0 con 0x562e429890f0 2024-02-21T07:57:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.654+0000 7f98c7e00640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e42a37360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.655+0000 7f98b0c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:03.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.655+0000 7f98c7400640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f98b4096850 tx=0x7f98b401e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b0965da9fd7e649 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.655+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b409f2f0 con 0x562e429890f0 2024-02-21T07:57:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.655+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98b4094e50 con 0x562e429890f0 2024-02-21T07:57:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.656+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f98b409aca0 con 0x562e429890f0 2024-02-21T07:57:03.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.656+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98b40928a0 con 0x562e429890f0 2024-02-21T07:57:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.656+0000 7f98d1778740 10 client.7441 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:03.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.656+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562e42870430 con 0x562e429890f0 2024-02-21T07:57:03.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.658+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b4094e50 con 0x562e429890f0 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.659+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f98b4092a00 con 0x562e429890f0 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 10 client.7441 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 10 client.7441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 20 client.7441 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e42a2dd00 0x562e429cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 4 client.7441 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:57:03.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.661+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562e4263b890 con 0x562e42a2dd00 2024-02-21T07:57:03.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.668+0000 7f98c7e00640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e42a2dd00 0x562e429cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.670+0000 7f98c7e00640 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e42a2dd00 0x562e429cc9d0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4743ccd24b9408c server_cookie=1e8f38431f312f03 in_seq=0 out_seq=0 2024-02-21T07:57:03.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.670+0000 7f98b0c00640 10 client.7441 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.670+0000 7f98b0c00640 1 -- 172.21.15.100:0/603438736 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562e4263b890 con 0x562e42a2dd00 2024-02-21T07:57:03.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.670+0000 7f98b0c00640 10 client.7441 handle_command_reply: tid=0 2024-02-21T07:57:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.672+0000 7f98d1778740 1 client.7441 shutdown 2024-02-21T07:57:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.673+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 msgr2=0x562e429a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.673+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f98b4096850 tx=0x7f98b401e040 comp rx=0 tx=0).stop 2024-02-21T07:57:03.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 shutdown_connections 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x562e42a2dd00 0x562e429cc9d0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562e429be790 0x562e4294a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e429890f0 0x562e429a7930 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 --2- 172.21.15.100:0/603438736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e429887d0 0x562e42a37360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 >> 172.21.15.100:0/603438736 conn(0x562e4290f5a0 msgr2=0x562e429c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.674+0000 7f98b0c00640 0 client.7441 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:03.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.677+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 shutdown_connections 2024-02-21T07:57:03.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.678+0000 7f98d1778740 1 -- 172.21.15.100:0/603438736 wait complete. 2024-02-21T07:57:03.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.678+0000 7f98d1778740 20 client.7441 trim_cache size 0 max 16384 2024-02-21T07:57:03.680 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:57:03.680 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: "38d9a138-dde8-4e6c-aefb-33a135a4a6b4": { 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "38d9a138-dde8-4e6c-aefb-33a135a4a6b4", 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:57:03.681 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.680+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 msgr2=0x7f98a80a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.680+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 0x7f98a80a1660 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f98c002e070 tx=0x7f98c0032000 comp rx=0 tx=0).stop 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.680+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 msgr2=0x7f98c8181540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.680+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f98b400c390 tx=0x7f98b400c850 comp rx=0 tx=0).stop 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 shutdown_connections 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f98c8187240 0x7f98c8181a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f98a809f1a0 0x7f98a80a1660 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98c8183e70 0x7f98c8181540 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 --2- 172.21.15.100:0/360393491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98c8182fc0 0x7f98c8169b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:03.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 >> 172.21.15.100:0/360393491 conn(0x7f98c80cf400 msgr2=0x7f98c81869c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:03.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 shutdown_connections 2024-02-21T07:57:03.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:03.681+0000 7f98cea00640 1 -- 172.21.15.100:0/360393491 wait complete. 2024-02-21T07:57:03.718 INFO:tasks.cephfs.filesystem:scrub status for tag:38d9a138-dde8-4e6c-aefb-33a135a4a6b4 - {'path': '/', 'tag': '38d9a138-dde8-4e6c-aefb-33a135a4a6b4', 'options': 'recursive,force'} 2024-02-21T07:57:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.589+0000 7f17e1400640 1 Processor -- start 2024-02-21T07:57:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.590+0000 7f17e1400640 1 -- start start 2024-02-21T07:57:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.594+0000 7f17e1400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17dc182840 0x7f17dc186630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.594+0000 7f17e1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17dc0d0e90 0x7f17dc1886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.594+0000 7f17e1400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17dc187ef0 con 0x7f17dc186b70 2024-02-21T07:57:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.594+0000 7f17e1400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc0fec50 con 0x7f17dc0d0e90 2024-02-21T07:57:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.594+0000 7f17e1400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17dc182c20 con 0x7f17dc182840 2024-02-21T07:57:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.595+0000 7f17dbe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17dc182840 0x7f17dc186630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.595+0000 7f17dbe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f17dc182840 0x7f17dc186630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60940/0 (socket says 172.21.15.100:60940) 2024-02-21T07:57:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.595+0000 7f17dbe00640 1 -- 172.21.15.100:0/637967767 learned_addr learned my addr 172.21.15.100:0/637967767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.595+0000 7f17e0a00640 1 --2- 172.21.15.100:0/637967767 >> v2:172.21.15.100:3300/0 conn(0x7f17dc0d0e90 0x7f17dc1886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.595+0000 7f17daa00640 1 -- 172.21.15.100:0/637967767 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014026871 0 0) 0x7f17dc187ef0 con 0x7f17dc186b70 2024-02-21T07:57:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.596+0000 7f17daa00640 1 -- 172.21.15.100:0/637967767 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c0003520 con 0x7f17dc186b70 2024-02-21T07:57:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.596+0000 7f17dbe00640 1 -- 172.21.15.100:0/637967767 >> v2:172.21.15.100:3300/0 conn(0x7f17dc0d0e90 msgr2=0x7f17dc1886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.596+0000 7f17dbe00640 1 --2- 172.21.15.100:0/637967767 >> v2:172.21.15.100:3300/0 conn(0x7f17dc0d0e90 0x7f17dc1886c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.596+0000 7f17dbe00640 1 -- 172.21.15.100:0/637967767 >> v1:172.21.15.156:6789/0 conn(0x7f17dc186b70 legacy=0x7f17dc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.596+0000 7f17dbe00640 1 -- 172.21.15.100:0/637967767 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc187000 con 0x7f17dc182840 2024-02-21T07:57:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.599+0000 7f17dbe00640 1 --2- 172.21.15.100:0/637967767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc186630 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0fed90 tx=0x7f17cc02b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a2a1178771ea02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.599+0000 7f17daa00640 1 -- 172.21.15.100:0/637967767 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0317f0 con 0x7f17dc182840 2024-02-21T07:57:13.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.599+0000 7f17daa00640 1 -- 172.21.15.100:0/637967767 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc031950 con 0x7f17dc182840 2024-02-21T07:57:13.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.599+0000 7f17daa00640 1 -- 172.21.15.100:0/637967767 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc031ce0 con 0x7f17dc182840 2024-02-21T07:57:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.602+0000 7f17e1400640 1 -- 172.21.15.100:0/637967767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 msgr2=0x7f17dc186630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.602+0000 7f17e1400640 1 --2- 172.21.15.100:0/637967767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc186630 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0fed90 tx=0x7f17cc02b890 comp rx=0 tx=0).stop 2024-02-21T07:57:13.605 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 -- 172.21.15.100:0/637967767 shutdown_connections 2024-02-21T07:57:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 --2- 172.21.15.100:0/637967767 >> v2:172.21.15.100:3300/0 conn(0x7f17dc0d0e90 0x7f17dc1886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 --2- 172.21.15.100:0/637967767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc186630 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 -- 172.21.15.100:0/637967767 >> 172.21.15.100:0/637967767 conn(0x7f17dc0615c0 msgr2=0x7f17dc0619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 -- 172.21.15.100:0/637967767 shutdown_connections 2024-02-21T07:57:13.613 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.604+0000 7f17e1400640 1 -- 172.21.15.100:0/637967767 wait complete. 2024-02-21T07:57:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.614+0000 7f17e1400640 1 Processor -- start 2024-02-21T07:57:13.616 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.615+0000 7f17e1400640 1 -- start start 2024-02-21T07:57:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc16ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 0x7f17dc21d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc221790 con 0x7f17dc21ccd0 2024-02-21T07:57:13.618 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc220ef0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.619 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17e1400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc2211d0 con 0x7f17dc182840 2024-02-21T07:57:13.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17dbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.620 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17dbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55818/0 (socket says 172.21.15.100:55818) 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.617+0000 7f17dbe00640 1 -- 172.21.15.100:0/1539887475 learned_addr learned my addr 172.21.15.100:0/1539887475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17e0a00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 0x7f17dc21d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17db400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc16ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 -- 172.21.15.100:0/1539887475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 msgr2=0x7f17dc16ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc16ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 -- 172.21.15.100:0/1539887475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 msgr2=0x7f17dc21d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 0x7f17dc21d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 -- 172.21.15.100:0/1539887475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc0094d0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17e0a00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 0x7f17dc21d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.618+0000 7f17dbe00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000c00 tx=0x7f17cc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.621 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.619+0000 7f17d3e00640 1 -- 172.21.15.100:0/1539887475 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc032890 con 0x7f17dc0d0e90 2024-02-21T07:57:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.619+0000 7f17d3e00640 1 -- 172.21.15.100:0/1539887475 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc0329f0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.619+0000 7f17d3e00640 1 -- 172.21.15.100:0/1539887475 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc032da0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.619+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17dc2214b0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.622 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.619+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc21c7b0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.625+0000 7f17d3e00640 1 -- 172.21.15.100:0/1539887475 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f17cc04e450 con 0x7f17dc0d0e90 2024-02-21T07:57:13.626 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.625+0000 7f17e57b2740 1 Processor -- start 2024-02-21T07:57:13.627 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.625+0000 7f17e57b2740 1 -- start start 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17d3e00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 0x7f17bc0a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ffa8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c35ffe3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ff5b620 con 0x55c35ffa89b0 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ff0d8c0 con 0x55c360017ef0 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.626+0000 7f17e57b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ff0adf0 con 0x55c35ffe3a90 2024-02-21T07:57:13.628 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17d3e00640 1 -- 172.21.15.100:0/1539887475 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f17cc0ebdc0 con 0x7f17dc0d0e90 2024-02-21T07:57:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.629 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17dbe00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 0x7f17bc0a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60962/0 (socket says 172.21.15.100:60962) 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 -- 172.21.15.100:0/3734128211 learned_addr learned my addr 172.21.15.100:0/3734128211 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c35ffe3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17db400640 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ffa8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 -- 172.21.15.100:0/3734128211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 msgr2=0x55c35ffa8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ffa8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17dbe00640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 0x7f17bc0a1610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0b5d00 tx=0x7f17cc0091c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 -- 172.21.15.100:0/3734128211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 msgr2=0x55c35ffe3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c35ffe3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.627+0000 7f17e0a00640 1 -- 172.21.15.100:0/3734128211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c35fe87b00 con 0x55c35ffe3a90 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.628+0000 7f17e0a00640 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17d4015d20 tx=0x7f17d4009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98ada9c20013c03b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.628+0000 7f17c7e00640 1 -- 172.21.15.100:0/3734128211 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400e040 con 0x55c35ffe3a90 2024-02-21T07:57:13.630 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.628+0000 7f17c7e00640 1 -- 172.21.15.100:0/3734128211 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d4015e10 con 0x55c35ffe3a90 2024-02-21T07:57:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.628+0000 7f17c7e00640 1 -- 172.21.15.100:0/3734128211 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d401a640 con 0x55c35ffe3a90 2024-02-21T07:57:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 -- 172.21.15.100:0/3734128211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 msgr2=0x55c35ffa2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.631 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f17d4015d20 tx=0x7f17d4009750 comp rx=0 tx=0).stop 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 -- 172.21.15.100:0/3734128211 shutdown_connections 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c35ffe3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ffa8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 --2- 172.21.15.100:0/3734128211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffe3a90 0x55c35ffa2e60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 -- 172.21.15.100:0/3734128211 >> 172.21.15.100:0/3734128211 conn(0x55c35ff674b0 msgr2=0x55c35ffa76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 -- 172.21.15.100:0/3734128211 shutdown_connections 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.629+0000 7f17e57b2740 1 -- 172.21.15.100:0/3734128211 wait complete. 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.630+0000 7f17e57b2740 1 -- start start 2024-02-21T07:57:13.632 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.631+0000 7f17e57b2740 1 Processor -- start 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360026a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffd6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ff065d0 con 0x55c35ffa89b0 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35feabb50 con 0x55c35ffe3a90 2024-02-21T07:57:13.635 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35feab7f0 con 0x55c360017ef0 2024-02-21T07:57:13.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e57b2740 10 client.0 _ll_register_callbacks cb 0x55c35febf550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360026a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17db400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:55836/0 (socket says 172.21.15.100:55836) 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17db400640 1 -- 172.21.15.100:0/2030178308 learned_addr learned my addr 172.21.15.100:0/2030178308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.634+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffd6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 -- 172.21.15.100:0/2030178308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 msgr2=0x55c35ffd6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffd6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 -- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 msgr2=0x55c360026a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360026a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 -- 172.21.15.100:0/2030178308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d40159a0 con 0x55c35ffe3a90 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360026a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17db400640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f17c8001dd0 tx=0x7f17c8011620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5965c47eeaf92c02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011e50 con 0x55c35ffe3a90 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c35fed8cd0 con 0x55c35ffe3a90 2024-02-21T07:57:13.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.635+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f17c80052e0 con 0x55c35ffe3a90 2024-02-21T07:57:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.637+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17c80054a0 con 0x55c35ffe3a90 2024-02-21T07:57:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.637+0000 7f17e57b2740 10 client.7453 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:13.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.637+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c35ff04c50 con 0x55c35ffe3a90 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c35fed8cd0 con 0x55c35ffe3a90 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f17c80035f0 con 0x55c35ffe3a90 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 10 client.7453 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 10 client.7453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 20 client.7453 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c360028d60 0x55c36002b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 4 client.7453 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.638+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c35fefcce0 con 0x55c360028d60 2024-02-21T07:57:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.639+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c360028d60 0x55c36002b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.640+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c360028d60 0x55c36002b8d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04dfb82be423370 server_cookie=30e7a5dcacd67cb3 in_seq=0 out_seq=0 2024-02-21T07:57:13.642 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.640+0000 7f17c4c00640 10 client.7453 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.642+0000 7f17c4c00640 1 -- 172.21.15.100:0/2030178308 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c35fefcce0 con 0x55c360028d60 2024-02-21T07:57:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.642+0000 7f17c4c00640 10 client.7453 handle_command_reply: tid=0 2024-02-21T07:57:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.642+0000 7f17e57b2740 1 client.7453 shutdown 2024-02-21T07:57:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.642+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 msgr2=0x55c35ffcd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.642+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f17c8001dd0 tx=0x7f17c8011620 comp rx=0 tx=0).stop 2024-02-21T07:57:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 shutdown_connections 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c360028d60 0x55c36002b8d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffd6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffe3a90 0x55c35ffcd1e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2030178308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360026a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 >> 172.21.15.100:0/2030178308 conn(0x55c35ff674b0 msgr2=0x55c360018370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17c4c00640 0 client.7453 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 shutdown_connections 2024-02-21T07:57:13.648 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.643+0000 7f17e57b2740 1 -- 172.21.15.100:0/2030178308 wait complete. 2024-02-21T07:57:13.649 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.644+0000 7f17e57b2740 20 client.7453 trim_cache size 0 max 16384 2024-02-21T07:57:13.662 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.661+0000 7f17e57b2740 1 Processor -- start 2024-02-21T07:57:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.661+0000 7f17e57b2740 1 -- start start 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 0x55c360027130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffd3a00 0x55c360037da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35fc4ee60 con 0x55c35ffd3a00 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ffe9530 con 0x55c35ffa89b0 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e57b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ffdc9d0 con 0x55c360017ef0 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17db400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17db400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:60976/0 (socket says 172.21.15.100:60976) 2024-02-21T07:57:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17db400640 1 -- 172.21.15.100:0/4238390082 learned_addr learned my addr 172.21.15.100:0/4238390082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.662+0000 7f17e0a00640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 0x55c360027130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17e0a00640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffd3a00 0x55c360037da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 -- 172.21.15.100:0/4238390082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 msgr2=0x55c360027130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 0x55c360027130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 -- 172.21.15.100:0/4238390082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffd3a00 msgr2=0x55c360037da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffd3a00 0x55c360037da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 -- 172.21.15.100:0/4238390082 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c35ffe8200 con 0x55c360017ef0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17e0a00640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 0x55c360027130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17db400640 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f17c8012010 tx=0x7f17c800c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f6d81057eb49bc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17c7400640 1 -- 172.21.15.100:0/4238390082 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011e50 con 0x55c360017ef0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17c7400640 1 -- 172.21.15.100:0/4238390082 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c802b070 con 0x55c360017ef0 2024-02-21T07:57:13.666 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.663+0000 7f17c7400640 1 -- 172.21.15.100:0/4238390082 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8003e20 con 0x55c360017ef0 2024-02-21T07:57:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 -- 172.21.15.100:0/4238390082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 msgr2=0x55c35ffa7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f17c8012010 tx=0x7f17c800c000 comp rx=0 tx=0).stop 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 -- 172.21.15.100:0/4238390082 shutdown_connections 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffd3a00 0x55c360037da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c360017ef0 0x55c35ffa7680 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 --2- 172.21.15.100:0/4238390082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c35ffa89b0 0x55c360027130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 -- 172.21.15.100:0/4238390082 >> 172.21.15.100:0/4238390082 conn(0x55c35ff674b0 msgr2=0x55c3600269e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 -- 172.21.15.100:0/4238390082 shutdown_connections 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.664+0000 7f17e57b2740 1 -- 172.21.15.100:0/4238390082 wait complete. 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.665+0000 7f17e57b2740 1 -- start start 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.665+0000 7f17e57b2740 1 Processor -- start 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.666+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360083070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.666+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 0x55c35ffd6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e57b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ff997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e57b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c35ffc69b0 con 0x55c35ffa89b0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e57b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360083b60 con 0x55c360017ef0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e57b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c360068550 con 0x55c35ffd3a00 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e57b2740 10 client.0 _ll_register_callbacks cb 0x7f17d40152d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360083070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 0x55c35ffd6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e0a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360083070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41394/0 (socket says 172.21.15.100:41394) 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e0a00640 1 -- 172.21.15.100:0/2643611070 learned_addr learned my addr 172.21.15.100:0/2643611070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ff997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 -- 172.21.15.100:0/2643611070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 msgr2=0x55c35ff997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ff997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 -- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 msgr2=0x55c360083070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360083070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.667+0000 7f17db400640 1 -- 172.21.15.100:0/2643611070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c35fe87b00 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17db400640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 0x55c35ffd6490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f17c8011660 tx=0x7f17c8001150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8750a70962f5001 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c8011ed0 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c35ff2bd30 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f17c80035f0 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17c8001af0 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17e57b2740 10 client.7376 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c35ff04c50 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c35ff2bd30 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.668+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f17c80052e0 con 0x55c35ffd3a00 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 10 client.7376 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:13.673 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 10 client.7376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 20 client.7376 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c35ffa5ed0 0x55c3600678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 4 client.7376 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c35fc06600 con 0x55c35ffa5ed0 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c35ffa5ed0 0x55c3600678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17e0a00640 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c35ffa5ed0 0x55c3600678b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40269907cb785b11 server_cookie=1e16d460614725e9 in_seq=0 out_seq=0 2024-02-21T07:57:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.669+0000 7f17c4c00640 10 client.7376 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.692+0000 7f17c4c00640 1 -- 172.21.15.100:0/2643611070 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c35fc06600 con 0x55c35ffa5ed0 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.692+0000 7f17c4c00640 10 client.7376 handle_command_reply: tid=0 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 client.7376 shutdown 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 msgr2=0x55c35ffd6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 0x55c35ffd6490 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f17c8011660 tx=0x7f17c8001150 comp rx=0 tx=0).stop 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 shutdown_connections 2024-02-21T07:57:13.695 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55c35ffa5ed0 0x55c3600678b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c360017ef0 0x55c35ff997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c35ffd3a00 0x55c35ffd6490 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17c4c00640 0 client.7376 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 --2- 172.21.15.100:0/2643611070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c35ffa89b0 0x55c360083070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 >> 172.21.15.100:0/2643611070 conn(0x55c35ff674b0 msgr2=0x55c360017510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 shutdown_connections 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 1 -- 172.21.15.100:0/2643611070 wait complete. 2024-02-21T07:57:13.696 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.693+0000 7f17e57b2740 20 client.7376 trim_cache size 0 max 16384 2024-02-21T07:57:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:57:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:57:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:57:13.697 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 msgr2=0x7f17bc0a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 0x7f17bc0a1610 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0b5d00 tx=0x7f17cc0091c0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 msgr2=0x7f17dc16e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f17cc000c00 tx=0x7f17cc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 shutdown_connections 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f17bc09f150 0x7f17bc0a1610 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17dc21ccd0 0x7f17dc21d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.698 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f17dc182840 0x7f17dc16ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 --2- 172.21.15.100:0/1539887475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17dc0d0e90 0x7f17dc16e720 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 >> 172.21.15.100:0/1539887475 conn(0x7f17dc0615c0 msgr2=0x7f17dc17b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 shutdown_connections 2024-02-21T07:57:13.699 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:13.694+0000 7f17e1400640 1 -- 172.21.15.100:0/1539887475 wait complete. 2024-02-21T07:57:18.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:57:18.435 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:57:18.438 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:57:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.946+0000 7f758be00640 1 Processor -- start 2024-02-21T07:57:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.947+0000 7f758be00640 1 -- start start 2024-02-21T07:57:26.954 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.952+0000 7f758be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7584184620 con 0x7f7584183b10 2024-02-21T07:57:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.952+0000 7f758be00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7584184900 con 0x7f75841860b0 2024-02-21T07:57:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.952+0000 7f758be00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7584184be0 con 0x7f7584183ef0 2024-02-21T07:57:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.952+0000 7f7588a00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7584183ef0 0x7f75841869d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:51500/0 (socket says 172.21.15.100:51500) 2024-02-21T07:57:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.952+0000 7f7588a00640 1 -- 172.21.15.100:0/3674641063 learned_addr learned my addr 172.21.15.100:0/3674641063 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145571699 0 0) 0x7f7584184be0 con 0x7f7584183ef0 2024-02-21T07:57:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c003520 con 0x7f7584183ef0 2024-02-21T07:57:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211738257 0 0) 0x7f756c003520 con 0x7f7584183ef0 2024-02-21T07:57:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 >> v1:172.21.15.156:6789/0 conn(0x7f75841860b0 legacy=0x7f75841870e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 >> v1:172.21.15.100:6789/0 conn(0x7f7584183b10 legacy=0x7f75841859a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584184ec0 con 0x7f7584183ef0 2024-02-21T07:57:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.954+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f7570001670 con 0x7f7584183ef0 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 >> v1:172.21.15.170:6789/0 conn(0x7f7584183ef0 legacy=0x7f75841869d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f756c0039c0 0x7f756c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 0x7f756c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0053d0 0x7f756c00fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0106f0 con 0x7f756c0047c0 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c010860 con 0x7f756c0053d0 2024-02-21T07:57:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c009970 con 0x7f756c0039c0 2024-02-21T07:57:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7589e00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0053d0 0x7f756c00fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.955+0000 7f7588a00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 0x7f756c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7589400640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f756c0039c0 0x7f756c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7588a00640 1 -- 172.21.15.100:0/3674641063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f756c0039c0 msgr2=0x7f756c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7588a00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f756c0039c0 0x7f756c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7588a00640 1 -- 172.21.15.100:0/3674641063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0053d0 msgr2=0x7f756c00fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7588a00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0053d0 0x7f756c00fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.956+0000 7f7588a00640 1 -- 172.21.15.100:0/3674641063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584184ec0 con 0x7f756c0047c0 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.957+0000 7f7589e00640 1 -- 172.21.15.100:0/3674641063 reap_dead start 2024-02-21T07:57:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.959+0000 7f7588a00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 0x7f756c004c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f757000c1e0 tx=0x7f756c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbd152cda7e862a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.959+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757002cb20 con 0x7f756c0047c0 2024-02-21T07:57:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.960+0000 7f7583e00640 1 -- 172.21.15.100:0/3674641063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757002cca0 con 0x7f756c0047c0 2024-02-21T07:57:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.961+0000 7f758be00640 1 -- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 msgr2=0x7f756c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.961+0000 7f758be00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 0x7f756c004c40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f757000c1e0 tx=0x7f756c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.962+0000 7f758be00640 1 -- 172.21.15.100:0/3674641063 shutdown_connections 2024-02-21T07:57:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.962+0000 7f758be00640 1 --2- 172.21.15.100:0/3674641063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f756c0047c0 0x7f756c004c40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.962+0000 7f758be00640 1 -- 172.21.15.100:0/3674641063 >> 172.21.15.100:0/3674641063 conn(0x7f75840ce1b0 msgr2=0x7f75840ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.963+0000 7f758be00640 1 -- 172.21.15.100:0/3674641063 shutdown_connections 2024-02-21T07:57:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.963+0000 7f758be00640 1 -- 172.21.15.100:0/3674641063 wait complete. 2024-02-21T07:57:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.974+0000 7f758be00640 1 Processor -- start 2024-02-21T07:57:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.974+0000 7f758be00640 1 -- start start 2024-02-21T07:57:26.979 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.977+0000 7f758be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0047c0 0x7f7584168090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.981 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.977+0000 7f758be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.979+0000 7f758be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 0x7f7584217a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.979+0000 7f758be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758416bb40 con 0x7f75842175b0 2024-02-21T07:57:26.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.979+0000 7f758be00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758416b6b0 con 0x7f756c0047c0 2024-02-21T07:57:26.982 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.979+0000 7f758be00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75841685d0 con 0x7f75840f4900 2024-02-21T07:57:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.980+0000 7f7588a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.980+0000 7f7588a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48506/0 (socket says 172.21.15.100:48506) 2024-02-21T07:57:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.980+0000 7f7588a00640 1 -- 172.21.15.100:0/723257682 learned_addr learned my addr 172.21.15.100:0/723257682 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.980+0000 7f7589400640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0047c0 0x7f7584168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.983 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.981+0000 7f7589e00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 0x7f7584217a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.984+0000 7f7588a00640 1 -- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0047c0 msgr2=0x7f7584168090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.984+0000 7f7588a00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0047c0 0x7f7584168090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.986 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.984+0000 7f7588a00640 1 -- 172.21.15.100:0/723257682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 msgr2=0x7f7584217a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:26.990 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.988+0000 7f7588a00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 0x7f7584217a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.988+0000 7f7588a00640 1 -- 172.21.15.100:0/723257682 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758416a4e0 con 0x7f75840f4900 2024-02-21T07:57:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.988+0000 7f7589e00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 0x7f7584217a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:26.991 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.988+0000 7f7588a00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f757000c300 tx=0x7f7570001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.989+0000 7f7581600640 1 -- 172.21.15.100:0/723257682 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757002cb20 con 0x7f75840f4900 2024-02-21T07:57:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.989+0000 7f7581600640 1 -- 172.21.15.100:0/723257682 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757003a070 con 0x7f75840f4900 2024-02-21T07:57:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.989+0000 7f7581600640 1 -- 172.21.15.100:0/723257682 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570035670 con 0x7f75840f4900 2024-02-21T07:57:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.990+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758416a7c0 con 0x7f75840f4900 2024-02-21T07:57:26.992 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.990+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758416ad80 con 0x7f75840f4900 2024-02-21T07:57:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.994+0000 7f7581600640 1 -- 172.21.15.100:0/723257682 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7570032070 con 0x7f75840f4900 2024-02-21T07:57:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.995+0000 7f758eb96740 1 Processor -- start 2024-02-21T07:57:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.996+0000 7f7581600640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 0x7f75640a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.996+0000 7f7581600640 1 -- 172.21.15.100:0/723257682 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f75700eb960 con 0x7f75840f4900 2024-02-21T07:57:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.997+0000 7f758eb96740 1 -- start start 2024-02-21T07:57:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.998+0000 7f7589e00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 0x7f75640a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d1078a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 0x55e0d10b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d1034620 con 0x55e0d1078f90 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0fe68c0 con 0x55e0d10e84d0 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f758eb96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0fe3df0 con 0x55e0d10b4070 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f7589400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f7589400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48512/0 (socket says 172.21.15.100:48512) 2024-02-21T07:57:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:26.999+0000 7f7589400640 1 -- 172.21.15.100:0/3958549130 learned_addr learned my addr 172.21.15.100:0/3958549130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.003+0000 7f7588a00640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d1078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.004+0000 7f7589e00640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 0x55e0d10b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.004+0000 7f7589400640 1 -- 172.21.15.100:0/3958549130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 msgr2=0x55e0d1078a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.004+0000 7f7589400640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d1078a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.004+0000 7f7589400640 1 -- 172.21.15.100:0/3958549130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 msgr2=0x55e0d10b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.005+0000 7f7589400640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 0x55e0d10b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.005+0000 7f7589400640 1 -- 172.21.15.100:0/3958549130 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d0f60b00 con 0x55e0d10b4070 2024-02-21T07:57:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.005+0000 7f7589e00640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 0x55e0d10b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.005+0000 7f7589e00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 0x7f75640a16b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f75840ed7e0 tx=0x7f757c009610 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.006+0000 7f7589400640 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7578001560 tx=0x7f7578001a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b87f5a488008cf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.008+0000 7f7575c00640 1 -- 172.21.15.100:0/3958549130 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578001d30 con 0x55e0d10b4070 2024-02-21T07:57:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.008+0000 7f7575c00640 1 -- 172.21.15.100:0/3958549130 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75780052e0 con 0x55e0d10b4070 2024-02-21T07:57:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.008+0000 7f7575c00640 1 -- 172.21.15.100:0/3958549130 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578011830 con 0x55e0d10b4070 2024-02-21T07:57:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.010+0000 7f758eb96740 1 -- 172.21.15.100:0/3958549130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 msgr2=0x55e0d1073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.010+0000 7f758eb96740 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7578001560 tx=0x7f7578001a20 comp rx=0 tx=0).stop 2024-02-21T07:57:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.014+0000 7f758eb96740 1 -- 172.21.15.100:0/3958549130 shutdown_connections 2024-02-21T07:57:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.014+0000 7f758eb96740 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d1078f90 0x55e0d10b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.014+0000 7f758eb96740 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d1078a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.014+0000 7f758eb96740 1 --2- 172.21.15.100:0/3958549130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d1073440 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.014+0000 7f758eb96740 1 -- 172.21.15.100:0/3958549130 >> 172.21.15.100:0/3958549130 conn(0x55e0d10404b0 msgr2=0x55e0d1077ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.034+0000 7f758eb96740 1 -- 172.21.15.100:0/3958549130 shutdown_connections 2024-02-21T07:57:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.034+0000 7f758eb96740 1 -- 172.21.15.100:0/3958549130 wait complete. 2024-02-21T07:57:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.036+0000 7f758eb96740 1 -- start start 2024-02-21T07:57:27.042 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.036+0000 7f758eb96740 1 Processor -- start 2024-02-21T07:57:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 0x55e0d10dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0fdf5d0 con 0x55e0d10b4070 2024-02-21T07:57:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0f84b50 con 0x55e0d10e84d0 2024-02-21T07:57:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0f847f0 con 0x55e0d1078f90 2024-02-21T07:57:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.055+0000 7f758eb96740 10 client.0 _ll_register_callbacks cb 0x55e0d0f98550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.056+0000 7f7589e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.056+0000 7f7589400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.057+0000 7f7589400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48514/0 (socket says 172.21.15.100:48514) 2024-02-21T07:57:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.057+0000 7f7589400640 1 -- 172.21.15.100:0/622783817 learned_addr learned my addr 172.21.15.100:0/622783817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.058+0000 7f7588a00640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 0x55e0d10dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.059+0000 7f7589400640 1 -- 172.21.15.100:0/622783817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 msgr2=0x55e0d10ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.059+0000 7f7589400640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10ea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.059+0000 7f7589400640 1 -- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 msgr2=0x55e0d10dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.059+0000 7f7589400640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 0x55e0d10dfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.059+0000 7f7589400640 1 -- 172.21.15.100:0/622783817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757800f040 con 0x55e0d1078f90 2024-02-21T07:57:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.064+0000 7f7588a00640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 0x55e0d10dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.069+0000 7f7589400640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7578011620 tx=0x7f7578001190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d4ba20f2bcc2d47 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:27.076 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.070+0000 7f756a000640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.073+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780078d0 con 0x55e0d1078f90 2024-02-21T07:57:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.073+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7578011da0 con 0x55e0d1078f90 2024-02-21T07:57:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.077+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d0fb1cd0 con 0x55e0d1078f90 2024-02-21T07:57:27.083 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.081+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7578001d30 con 0x55e0d1078f90 2024-02-21T07:57:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.081+0000 7f758eb96740 10 client.7388 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.081+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e0d0fddc50 con 0x55e0d1078f90 2024-02-21T07:57:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.081+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0d0fb1cd0 con 0x55e0d1078f90 2024-02-21T07:57:27.084 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7578007020 con 0x55e0d1078f90 2024-02-21T07:57:27.085 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 10 client.7388 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 10 client.7388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:27.086 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 20 client.7388 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10e95a0 0x55e0d10e9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 4 client.7388 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:27.087 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.082+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0d0fd5ce0 con 0x55e0d10e95a0 2024-02-21T07:57:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.084+0000 7f7588a00640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10e95a0 0x55e0d10e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.085+0000 7f756a000640 10 client.7388 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:27.091 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.088+0000 7f7588a00640 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10e95a0 0x55e0d10e9980 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a4ecc8ced73a465 server_cookie=a01e7ec263b09b82 in_seq=0 out_seq=0 2024-02-21T07:57:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.090+0000 7f756a000640 1 -- 172.21.15.100:0/622783817 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0d0fd5ce0 con 0x55e0d10e95a0 2024-02-21T07:57:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.090+0000 7f756a000640 10 client.7388 handle_command_reply: tid=0 2024-02-21T07:57:27.092 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.090+0000 7f758eb96740 1 client.7388 shutdown 2024-02-21T07:57:27.097 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 msgr2=0x55e0d10dcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.099 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7578011620 tx=0x7f7578001190 comp rx=0 tx=0).stop 2024-02-21T07:57:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 shutdown_connections 2024-02-21T07:57:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10e95a0 0x55e0d10e9980 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.100 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10b4070 0x55e0d10dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 --2- 172.21.15.100:0/622783817 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d1078f90 0x55e0d10dcdc0 secure :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7578011620 tx=0x7f7578001190 comp rx=0 tx=0).stop 2024-02-21T07:57:27.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.095+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 >> 172.21.15.100:0/622783817 conn(0x55e0d10404b0 msgr2=0x55e0d10e8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:27.101 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.096+0000 7f756a000640 0 client.7388 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.103+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 shutdown_connections 2024-02-21T07:57:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.103+0000 7f758eb96740 1 -- 172.21.15.100:0/622783817 wait complete. 2024-02-21T07:57:27.108 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.103+0000 7f758eb96740 20 client.7388 trim_cache size 0 max 16384 2024-02-21T07:57:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.146+0000 7f758eb96740 1 Processor -- start 2024-02-21T07:57:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.146+0000 7f758eb96740 1 -- start start 2024-02-21T07:57:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.148+0000 7f758eb96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.149+0000 7f758eb96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10e84d0 0x55e0d1073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.149+0000 7f758eb96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.149+0000 7f758eb96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d0d27e60 con 0x55e0d10e84d0 2024-02-21T07:57:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f758eb96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d10a8450 con 0x55e0d10b4070 2024-02-21T07:57:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f7589e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f758eb96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d10783a0 con 0x55e0d107f8c0 2024-02-21T07:57:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f7589e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48528/0 (socket says 172.21.15.100:48528) 2024-02-21T07:57:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f7589e00640 1 -- 172.21.15.100:0/1888214562 learned_addr learned my addr 172.21.15.100:0/1888214562 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.150+0000 7f7589400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.153+0000 7f7589e00640 1 -- 172.21.15.100:0/1888214562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10b4070 msgr2=0x55e0d10e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.153+0000 7f7589e00640 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.153+0000 7f7589e00640 1 -- 172.21.15.100:0/1888214562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10e84d0 msgr2=0x55e0d1073e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.153+0000 7f7589e00640 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10e84d0 0x55e0d1073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.153+0000 7f7589e00640 1 -- 172.21.15.100:0/1888214562 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d0f7a530 con 0x55e0d107f8c0 2024-02-21T07:57:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.154+0000 7f7589e00640 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f75840ce160 tx=0x7f757c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6bb17890f55b95 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.155+0000 7f7575200640 1 -- 172.21.15.100:0/1888214562 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c020050 con 0x55e0d107f8c0 2024-02-21T07:57:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.156+0000 7f7575200640 1 -- 172.21.15.100:0/1888214562 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c021040 con 0x55e0d107f8c0 2024-02-21T07:57:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.156+0000 7f7575200640 1 -- 172.21.15.100:0/1888214562 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c020050 con 0x55e0d107f8c0 2024-02-21T07:57:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.157+0000 7f758eb96740 1 -- 172.21.15.100:0/1888214562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 msgr2=0x55e0d10eb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.157+0000 7f758eb96740 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f75840ce160 tx=0x7f757c015000 comp rx=0 tx=0).stop 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 -- 172.21.15.100:0/1888214562 shutdown_connections 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d107f8c0 0x55e0d10eb1e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d10e84d0 0x55e0d1073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 --2- 172.21.15.100:0/1888214562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 -- 172.21.15.100:0/1888214562 >> 172.21.15.100:0/1888214562 conn(0x55e0d10404b0 msgr2=0x55e0d10e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 -- 172.21.15.100:0/1888214562 shutdown_connections 2024-02-21T07:57:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.160+0000 7f758eb96740 1 -- 172.21.15.100:0/1888214562 wait complete. 2024-02-21T07:57:27.165 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.161+0000 7f758eb96740 1 -- start start 2024-02-21T07:57:27.167 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.163+0000 7f758eb96740 1 Processor -- start 2024-02-21T07:57:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d107f8c0 0x55e0d1074a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.168 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d1153c00 con 0x55e0d107f8c0 2024-02-21T07:57:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d10a7c50 con 0x55e0d10e84d0 2024-02-21T07:57:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d10f0510 con 0x55e0d10b4070 2024-02-21T07:57:27.169 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.166+0000 7f758eb96740 10 client.0 _ll_register_callbacks cb 0x7f7578001290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:47352/0 (socket says 172.21.15.100:47352) 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 -- 172.21.15.100:0/2109157297 learned_addr learned my addr 172.21.15.100:0/2109157297 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 -- 172.21.15.100:0/2109157297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 msgr2=0x55e0d10e7de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 -- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d107f8c0 msgr2=0x55e0d1074a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.167+0000 7f7589e00640 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d107f8c0 0x55e0d1074a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.170 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.168+0000 7f7589e00640 1 -- 172.21.15.100:0/2109157297 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c00d7a0 con 0x55e0d10e84d0 2024-02-21T07:57:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.168+0000 7f7589e00640 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f757c027040 tx=0x7f757c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12a861cb8eec0c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.168+0000 7f756a000640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.168+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c013070 con 0x55e0d10e84d0 2024-02-21T07:57:27.171 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.168+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f757c01bd00 con 0x55e0d10e84d0 2024-02-21T07:57:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.170+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d1004d30 con 0x55e0d10e84d0 2024-02-21T07:57:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.170+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f757c019400 con 0x55e0d10e84d0 2024-02-21T07:57:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.170+0000 7f758eb96740 10 client.7474 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:27.172 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.170+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e0d0fa02c0 con 0x55e0d10e84d0 2024-02-21T07:57:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.171+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0d1004d30 con 0x55e0d10e84d0 2024-02-21T07:57:27.175 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.172+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f757c00a040 con 0x55e0d10e84d0 2024-02-21T07:57:27.176 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 10 client.7474 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 10 client.7474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 20 client.7474 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10d6af0 0x55e0d1150780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 4 client.7474 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.173+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0d0cdf600 con 0x55e0d10d6af0 2024-02-21T07:57:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.174+0000 7f7589400640 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10d6af0 0x55e0d1150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.182+0000 7f7589400640 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10d6af0 0x55e0d1150780 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55f00f1f2f22dc5b server_cookie=4f8d20bab68c3d9b in_seq=0 out_seq=0 2024-02-21T07:57:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.182+0000 7f756a000640 10 client.7474 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.228+0000 7f756a000640 1 -- 172.21.15.100:0/2109157297 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0d0cdf600 con 0x55e0d10d6af0 2024-02-21T07:57:27.231 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.228+0000 7f756a000640 10 client.7474 handle_command_reply: tid=0 2024-02-21T07:57:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.228+0000 7f758eb96740 1 client.7474 shutdown 2024-02-21T07:57:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.228+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 msgr2=0x55e0d10752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.232 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.228+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f757c027040 tx=0x7f757c004af0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.233+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 shutdown_connections 2024-02-21T07:57:27.236 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.233+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e0d10d6af0 0x55e0d1150780 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.234+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0d10e84d0 0x55e0d10752a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.234+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e0d10b4070 0x55e0d10e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.234+0000 7f758eb96740 1 --2- 172.21.15.100:0/2109157297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e0d107f8c0 0x55e0d1074a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.234+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 >> 172.21.15.100:0/2109157297 conn(0x55e0d10404b0 msgr2=0x55e0d1077c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.234+0000 7f756a000640 0 client.7474 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:27.237 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.235+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 shutdown_connections 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.235+0000 7f758eb96740 1 -- 172.21.15.100:0/2109157297 wait complete. 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.235+0000 7f758eb96740 20 client.7474 trim_cache size 0 max 16384 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:57:27.238 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:57:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.236+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 msgr2=0x7f75640a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.236+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 0x7f75640a16b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f75840ed7e0 tx=0x7f757c009610 comp rx=0 tx=0).stop 2024-02-21T07:57:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.236+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 msgr2=0x7f75841892f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:27.239 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.236+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f757000c300 tx=0x7f7570001930 comp rx=0 tx=0).stop 2024-02-21T07:57:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 shutdown_connections 2024-02-21T07:57:27.242 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f756409f1f0 0x7f75640a16b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75842175b0 0x7f7584217a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f75840f4900 0x7f75841892f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 --2- 172.21.15.100:0/723257682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f756c0047c0 0x7f7584168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 >> 172.21.15.100:0/723257682 conn(0x7f75840ce1b0 msgr2=0x7f758416d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 shutdown_connections 2024-02-21T07:57:27.243 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:27.240+0000 7f758be00640 1 -- 172.21.15.100:0/723257682 wait complete. 2024-02-21T07:57:33.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:57:33.721 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:57:34.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.112+0000 7faad1600640 1 Processor -- start 2024-02-21T07:57:34.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.115+0000 7faad1600640 1 -- start start 2024-02-21T07:57:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.124+0000 7faad1600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faacc1868b0 0x7faacc186d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.124+0000 7faad1600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faacc187250 0x7faacc06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.124+0000 7faad1600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc06eed0 con 0x7faacc17b3f0 2024-02-21T07:57:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.124+0000 7faad1600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc071f20 con 0x7faacc1868b0 2024-02-21T07:57:34.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.124+0000 7faad1600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc185720 con 0x7faacc187250 2024-02-21T07:57:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.126+0000 7faad0c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faacc187250 0x7faacc06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.126+0000 7faad0c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7faacc187250 0x7faacc06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52024/0 (socket says 172.21.15.100:52024) 2024-02-21T07:57:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.126+0000 7faad0c00640 1 -- 172.21.15.100:0/1927972907 learned_addr learned my addr 172.21.15.100:0/1927972907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.126+0000 7faacb400640 1 --2- 172.21.15.100:0/1927972907 >> v2:172.21.15.100:3300/0 conn(0x7faacc1868b0 0x7faacc186d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.126+0000 7faad0c00640 1 -- 172.21.15.100:0/1927972907 >> v2:172.21.15.100:3300/0 conn(0x7faacc1868b0 msgr2=0x7faacc186d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.127+0000 7faad0c00640 1 --2- 172.21.15.100:0/1927972907 >> v2:172.21.15.100:3300/0 conn(0x7faacc1868b0 0x7faacc186d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.127+0000 7faad0c00640 1 -- 172.21.15.100:0/1927972907 >> v1:172.21.15.170:6789/0 conn(0x7faacc17b3f0 legacy=0x7faacc185010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.129+0000 7faacaa00640 1 -- 172.21.15.100:0/1927972907 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998832216 0 0) 0x7faacc06eed0 con 0x7faacc17b3f0 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.129+0000 7faad0c00640 1 -- 172.21.15.100:0/1927972907 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc06e910 con 0x7faacc187250 2024-02-21T07:57:34.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.131+0000 7faad0c00640 1 --2- 172.21.15.100:0/1927972907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc187250 0x7faacc06d950 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faacc08de50 tx=0x7faabc02fca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f11cb08760c6841 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.135+0000 7faacaa00640 1 -- 172.21.15.100:0/1927972907 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc030a50 con 0x7faacc187250 2024-02-21T07:57:34.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.135+0000 7faacaa00640 1 -- 172.21.15.100:0/1927972907 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc030bb0 con 0x7faacc187250 2024-02-21T07:57:34.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.135+0000 7faacaa00640 1 -- 172.21.15.100:0/1927972907 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc038440 con 0x7faacc187250 2024-02-21T07:57:34.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.136+0000 7faad1600640 1 -- 172.21.15.100:0/1927972907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc187250 msgr2=0x7faacc06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.136+0000 7faad1600640 1 --2- 172.21.15.100:0/1927972907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc187250 0x7faacc06d950 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7faacc08de50 tx=0x7faabc02fca0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 -- 172.21.15.100:0/1927972907 shutdown_connections 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 --2- 172.21.15.100:0/1927972907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc187250 0x7faacc06d950 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 --2- 172.21.15.100:0/1927972907 >> v2:172.21.15.100:3300/0 conn(0x7faacc1868b0 0x7faacc186d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 -- 172.21.15.100:0/1927972907 >> 172.21.15.100:0/1927972907 conn(0x7faacc0ce150 msgr2=0x7faacc0ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 -- 172.21.15.100:0/1927972907 shutdown_connections 2024-02-21T07:57:34.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.137+0000 7faad1600640 1 -- 172.21.15.100:0/1927972907 wait complete. 2024-02-21T07:57:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.144+0000 7faad1600640 1 Processor -- start 2024-02-21T07:57:34.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.146+0000 7faad1600640 1 -- start start 2024-02-21T07:57:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.149+0000 7faad1600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 0x7faacc0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.149+0000 7faad1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faacc1868b0 0x7faacc179a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.150+0000 7faad1600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 0x7faacc0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.150+0000 7faad1600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c97d0 con 0x7faacc1868b0 2024-02-21T07:57:34.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.150+0000 7faad1600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c9ab0 con 0x7faacc187250 2024-02-21T07:57:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.150+0000 7faad1600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc0c9d90 con 0x7faacc17b3f0 2024-02-21T07:57:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.151+0000 7faacbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 0x7faacc0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.151+0000 7faacbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 0x7faacc0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52030/0 (socket says 172.21.15.100:52030) 2024-02-21T07:57:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.151+0000 7faacbe00640 1 -- 172.21.15.100:0/2813662853 learned_addr learned my addr 172.21.15.100:0/2813662853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.152+0000 7faad0c00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 0x7faacc0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.156+0000 7faad0c00640 1 -- 172.21.15.100:0/2813662853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 msgr2=0x7faacc0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.156+0000 7faad0c00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 0x7faacc0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.156+0000 7faad0c00640 1 -- 172.21.15.100:0/2813662853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faacc1868b0 msgr2=0x7faacc179a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.156+0000 7faad0c00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faacc1868b0 0x7faacc179a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.156+0000 7faad0c00640 1 -- 172.21.15.100:0/2813662853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0094d0 con 0x7faacc187250 2024-02-21T07:57:34.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.157+0000 7faad0c00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 0x7faacc0c8bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faabc037000 tx=0x7faabc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.158+0000 7faac3e00640 1 -- 172.21.15.100:0/2813662853 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc0133d0 con 0x7faacc187250 2024-02-21T07:57:34.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.158+0000 7faac3e00640 1 -- 172.21.15.100:0/2813662853 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc013530 con 0x7faacc187250 2024-02-21T07:57:34.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.158+0000 7faac3e00640 1 -- 172.21.15.100:0/2813662853 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc038680 con 0x7faacc187250 2024-02-21T07:57:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.159+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0ca070 con 0x7faacc187250 2024-02-21T07:57:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.160+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0cc9a0 con 0x7faacc187250 2024-02-21T07:57:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.169+0000 7faac3e00640 1 -- 172.21.15.100:0/2813662853 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7faabc070060 con 0x7faacc187250 2024-02-21T07:57:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.170+0000 7faad586f740 1 Processor -- start 2024-02-21T07:57:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.171+0000 7faad586f740 1 -- start start 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482af2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faac3e00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 0x7faaac0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482abd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4829f4150 con 0x55e482abdab0 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4829f1680 con 0x55e482abd190 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faad586f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4829ece60 con 0x55e482af3150 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.172+0000 7faac3e00640 1 -- 172.21.15.100:0/2813662853 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faabc06e070 con 0x7faacc187250 2024-02-21T07:57:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52154/0 (socket says 172.21.15.100:52154) 2024-02-21T07:57:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 -- 172.21.15.100:0/1953024069 learned_addr learned my addr 172.21.15.100:0/1953024069 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faacb400640 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482abd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faacb400640 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482af2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 -- 172.21.15.100:0/1953024069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 msgr2=0x55e482abd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482abd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 -- 172.21.15.100:0/1953024069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 msgr2=0x55e482af2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482af2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.173+0000 7faad0c00640 1 -- 172.21.15.100:0/1953024069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4829a6060 con 0x55e482abdab0 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.174+0000 7faad0c00640 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faabc02fce0 tx=0x7faabc0b55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f040a65807d2e603 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.175+0000 7faab7e00640 1 -- 172.21.15.100:0/1953024069 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc06d030 con 0x55e482abdab0 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.175+0000 7faab7e00640 1 -- 172.21.15.100:0/1953024069 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc097e90 con 0x55e482abdab0 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.175+0000 7faab7e00640 1 -- 172.21.15.100:0/1953024069 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faabc097cb0 con 0x55e482abdab0 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.175+0000 7faad586f740 1 -- 172.21.15.100:0/1953024069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 msgr2=0x55e482a800c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.175+0000 7faad586f740 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7faabc02fce0 tx=0x7faabc0b55c0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.176+0000 7faad586f740 1 -- 172.21.15.100:0/1953024069 shutdown_connections 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.176+0000 7faad586f740 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482a800c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.176+0000 7faad586f740 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482abd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.176+0000 7faad586f740 1 --2- 172.21.15.100:0/1953024069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482af2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.176+0000 7faad586f740 1 -- 172.21.15.100:0/1953024069 >> 172.21.15.100:0/1953024069 conn(0x55e482a4c5a0 msgr2=0x55e482a84080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.177+0000 7faacbe00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 0x7faaac0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.178+0000 7faad586f740 1 -- 172.21.15.100:0/1953024069 shutdown_connections 2024-02-21T07:57:34.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.179+0000 7faad586f740 1 -- 172.21.15.100:0/1953024069 wait complete. 2024-02-21T07:57:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.181+0000 7faad586f740 1 -- start start 2024-02-21T07:57:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.181+0000 7faad586f740 1 Processor -- start 2024-02-21T07:57:34.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.181+0000 7faacbe00640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 0x7faaac0a16b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faac4001fc0 tx=0x7faac4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.182+0000 7faad586f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.182+0000 7faad586f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482aac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad586f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ac7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad586f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482991ec0 con 0x55e482abdab0 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad586f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482991b60 con 0x55e482abd190 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad586f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e48275b1c0 con 0x55e482af3150 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad586f740 10 client.0 _ll_register_callbacks cb 0x55e4829a5960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482aac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60582/0 (socket says 172.21.15.100:60582) 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 -- 172.21.15.100:0/859399689 learned_addr learned my addr 172.21.15.100:0/859399689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faad0c00640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ac7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 -- 172.21.15.100:0/859399689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 msgr2=0x55e482ac7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ac7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 -- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 msgr2=0x55e482aac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482aac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.183+0000 7faacbe00640 1 -- 172.21.15.100:0/859399689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0cc9a0 con 0x55e482abd190 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faacbe00640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faac40149b0 tx=0x7faac4001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5d693f89ddb3b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4013930 con 0x55e482abd190 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faac401c040 con 0x55e482abd190 2024-02-21T07:57:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4826ec7e0 con 0x55e482abd190 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.184+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7faac4013a90 con 0x55e482abd190 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 10 client.7483 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e4829eb4e0 con 0x55e482abd190 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4826ec7e0 con 0x55e482abd190 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faac4012070 con 0x55e482abd190 2024-02-21T07:57:34.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 10 client.7483 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 10 client.7483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 20 client.7483 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482ab45c0 0x55e482b08170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 4 client.7483 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.185+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e482729720 con 0x55e482ab45c0 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.186+0000 7faacb400640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482ab45c0 0x55e482b08170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.186+0000 7faacb400640 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482ab45c0 0x55e482b08170 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6573882572123ba6 server_cookie=537ae58504fac3ac in_seq=0 out_seq=0 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.186+0000 7faab4c00640 10 client.7483 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.187+0000 7faab4c00640 1 -- 172.21.15.100:0/859399689 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e482729720 con 0x55e482ab45c0 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.187+0000 7faab4c00640 10 client.7483 handle_command_reply: tid=0 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 client.7483 shutdown 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 msgr2=0x55e482a801e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faac40149b0 tx=0x7faac4001250 comp rx=0 tx=0).stop 2024-02-21T07:57:34.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 shutdown_connections 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482ab45c0 0x55e482b08170 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ac7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482aac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faab4c00640 0 client.7483 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 --2- 172.21.15.100:0/859399689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abd190 0x55e482a801e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 >> 172.21.15.100:0/859399689 conn(0x55e482a4c5a0 msgr2=0x55e482aea630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 shutdown_connections 2024-02-21T07:57:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.188+0000 7faad586f740 1 -- 172.21.15.100:0/859399689 wait complete. 2024-02-21T07:57:34.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.189+0000 7faad586f740 20 client.7483 trim_cache size 0 max 16384 2024-02-21T07:57:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.221+0000 7faad586f740 1 Processor -- start 2024-02-21T07:57:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.221+0000 7faad586f740 1 -- start start 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482ac7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482af3150 0x55e482ac6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482a84040 con 0x55e482abdab0 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482a82390 con 0x55e482af3150 2024-02-21T07:57:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faad586f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482af5130 con 0x55e482abd190 2024-02-21T07:57:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faacbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faacbe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52062/0 (socket says 172.21.15.100:52062) 2024-02-21T07:57:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faacbe00640 1 -- 172.21.15.100:0/1265936915 learned_addr learned my addr 172.21.15.100:0/1265936915 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.223+0000 7faacb400640 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482ac7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 -- 172.21.15.100:0/1265936915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482af3150 msgr2=0x55e482ac6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482af3150 0x55e482ac6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 -- 172.21.15.100:0/1265936915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 msgr2=0x55e482ac7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482ac7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 -- 172.21.15.100:0/1265936915 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e482987950 con 0x55e482abd190 2024-02-21T07:57:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faacbe00640 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faac4001c90 tx=0x7faac4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879b953a50582768 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.224+0000 7faab7400640 1 -- 172.21.15.100:0/1265936915 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4013980 con 0x55e482abd190 2024-02-21T07:57:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.225+0000 7faab7400640 1 -- 172.21.15.100:0/1265936915 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4032480 con 0x55e482abd190 2024-02-21T07:57:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.225+0000 7faab7400640 1 -- 172.21.15.100:0/1265936915 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4032830 con 0x55e482abd190 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 -- 172.21.15.100:0/1265936915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 msgr2=0x55e482a81e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7faac4001c90 tx=0x7faac4016000 comp rx=0 tx=0).stop 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 -- 172.21.15.100:0/1265936915 shutdown_connections 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482af3150 0x55e482ac6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abdab0 0x55e482ac7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 --2- 172.21.15.100:0/1265936915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482abd190 0x55e482a81e50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.226+0000 7faad586f740 1 -- 172.21.15.100:0/1265936915 >> 172.21.15.100:0/1265936915 conn(0x55e482a4c5a0 msgr2=0x55e482a81560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.227+0000 7faad586f740 1 -- 172.21.15.100:0/1265936915 shutdown_connections 2024-02-21T07:57:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.227+0000 7faad586f740 1 -- 172.21.15.100:0/1265936915 wait complete. 2024-02-21T07:57:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.228+0000 7faad586f740 1 -- start start 2024-02-21T07:57:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.228+0000 7faad586f740 1 Processor -- start 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.231+0000 7faad586f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.231+0000 7faad586f740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abdab0 0x55e482b0c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.231+0000 7faad586f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ab67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.232+0000 7faad586f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482ac5d20 con 0x55e482abd190 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.232+0000 7faad586f740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482b0c2c0 con 0x55e482abdab0 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.232+0000 7faad586f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e482ab5200 con 0x55e482af3150 2024-02-21T07:57:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.232+0000 7faad586f740 10 client.0 _ll_register_callbacks cb 0x55e482af87d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:34.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.235+0000 7faacbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.237+0000 7faacbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52172/0 (socket says 172.21.15.100:52172) 2024-02-21T07:57:34.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.237+0000 7faacbe00640 1 -- 172.21.15.100:0/484263687 learned_addr learned my addr 172.21.15.100:0/484263687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.238+0000 7faacbe00640 1 -- 172.21.15.100:0/484263687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 msgr2=0x55e482ab67e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:34.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.238+0000 7faacbe00640 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ab67e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.238+0000 7faacbe00640 1 -- 172.21.15.100:0/484263687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abdab0 msgr2=0x55e482b0c710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:34.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.238+0000 7faacbe00640 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abdab0 0x55e482b0c710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.238+0000 7faacbe00640 1 -- 172.21.15.100:0/484263687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4829eb4e0 con 0x55e482abd190 2024-02-21T07:57:34.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.240+0000 7faacbe00640 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7faac4001700 tx=0x7faac4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c542c51c306384 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.242+0000 7faab4c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.242+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4032a00 con 0x55e482abd190 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.242+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faac4032b60 con 0x55e482abd190 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.242+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faabc097e90 con 0x55e482abd190 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.243+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7faac4032d20 con 0x55e482abd190 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.243+0000 7faad586f740 10 client.7311 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:34.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.243+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e4829ad430 con 0x55e482abd190 2024-02-21T07:57:34.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.244+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4049020 con 0x55e482abd190 2024-02-21T07:57:34.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faac403a040 con 0x55e482abd190 2024-02-21T07:57:34.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 10 client.7311 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:34.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 10 client.7311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:34.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 20 client.7311 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:34.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482b15dd0 0x55e482ac4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 4 client.7311 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:57:34.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.245+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e482778890 con 0x55e482b15dd0 2024-02-21T07:57:34.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.247+0000 7faacb400640 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482b15dd0 0x55e482ac4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.249+0000 7faacb400640 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482b15dd0 0x55e482ac4e70 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b23d9ebb13851 server_cookie=7f83a03537097b1 in_seq=0 out_seq=0 2024-02-21T07:57:34.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.249+0000 7faab4c00640 10 client.7311 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:34.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.249+0000 7faab4c00640 1 -- 172.21.15.100:0/484263687 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e482778890 con 0x55e482b15dd0 2024-02-21T07:57:34.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.249+0000 7faab4c00640 10 client.7311 handle_command_reply: tid=0 2024-02-21T07:57:34.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.250+0000 7faad586f740 1 client.7311 shutdown 2024-02-21T07:57:34.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.250+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 msgr2=0x55e482ac57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.250+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7faac4001700 tx=0x7faac4014000 comp rx=0 tx=0).stop 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 shutdown_connections 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55e482b15dd0 0x55e482ac4e70 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e482af3150 0x55e482ab67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e482abdab0 0x55e482b0c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 --2- 172.21.15.100:0/484263687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e482abd190 0x55e482ac57e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.252+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 >> 172.21.15.100:0/484263687 conn(0x55e482a4c5a0 msgr2=0x55e482ac6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.253+0000 7faab4c00640 0 client.7311 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:34.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.253+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 shutdown_connections 2024-02-21T07:57:34.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.254+0000 7faad586f740 1 -- 172.21.15.100:0/484263687 wait complete. 2024-02-21T07:57:34.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.255+0000 7faad586f740 20 client.7311 trim_cache size 0 max 16384 2024-02-21T07:57:34.256 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:57:34.256 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:57:34.257 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:57:34.257 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:57:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.256+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 msgr2=0x7faaac0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.256+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 0x7faaac0a16b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faac4001fc0 tx=0x7faac4009040 comp rx=0 tx=0).stop 2024-02-21T07:57:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 msgr2=0x7faacc0c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 0x7faacc0c8bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7faabc037000 tx=0x7faabc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 shutdown_connections 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faacc187250 0x7faacc0c8bf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7faaac09f1f0 0x7faaac0a16b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faacc1868b0 0x7faacc179a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 --2- 172.21.15.100:0/2813662853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faacc17b3f0 0x7faacc0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 >> 172.21.15.100:0/2813662853 conn(0x7faacc0ce150 msgr2=0x7faacc06d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 shutdown_connections 2024-02-21T07:57:34.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.257+0000 7faad1600640 1 -- 172.21.15.100:0/2813662853 wait complete. 2024-02-21T07:57:34.287 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:57:34.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:57:34.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.644+0000 7f5dcec00640 1 Processor -- start 2024-02-21T07:57:34.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.644+0000 7f5dcec00640 1 -- start start 2024-02-21T07:57:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.647+0000 7f5dcec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dc8186d60 0x7f5dc806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.647+0000 7f5dcec00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5dc818e2b0 0x7f5dc818e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.649+0000 7f5dc7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dc8186d60 0x7f5dc806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.649+0000 7f5dc7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5dc8186d60 0x7f5dc806ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52174/0 (socket says 172.21.15.100:52174) 2024-02-21T07:57:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dc7e00640 1 -- 172.21.15.100:0/811922585 learned_addr learned my addr 172.21.15.100:0/811922585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dcec00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.170:3300/0 conn(0x7f5dc8190800 0x7f5dc8190c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc806c2f0 con 0x7f5dc8186d60 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc806c780 con 0x7f5dc818e2b0 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc806b400 con 0x7f5dc8190800 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dc7400640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.156:3300/0 conn(0x7f5dc818e2b0 0x7f5dc818e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.650+0000 7f5dccc00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.170:3300/0 conn(0x7f5dc8190800 0x7f5dc8190c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.651+0000 7f5dc7e00640 1 -- 172.21.15.100:0/811922585 >> v2:172.21.15.170:3300/0 conn(0x7f5dc8190800 msgr2=0x7f5dc8190c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.651+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.170:3300/0 conn(0x7f5dc8190800 0x7f5dc8190c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.651+0000 7f5dc7e00640 1 -- 172.21.15.100:0/811922585 >> v2:172.21.15.156:3300/0 conn(0x7f5dc818e2b0 msgr2=0x7f5dc818e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.651+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.156:3300/0 conn(0x7f5dc818e2b0 0x7f5dc818e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.651+0000 7f5dc7e00640 1 -- 172.21.15.100:0/811922585 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc806b6e0 con 0x7f5dc8186d60 2024-02-21T07:57:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.653+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/811922585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc8186d60 0x7f5dc806ab60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8190310 tx=0x7f5db802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6534d8ff4c8778c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.653+0000 7f5dc6a00640 1 -- 172.21.15.100:0/811922585 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db80317f0 con 0x7f5dc8186d60 2024-02-21T07:57:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.653+0000 7f5dc6a00640 1 -- 172.21.15.100:0/811922585 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8031950 con 0x7f5dc8186d60 2024-02-21T07:57:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.654+0000 7f5dc6a00640 1 -- 172.21.15.100:0/811922585 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8031ce0 con 0x7f5dc8186d60 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.654+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc8186d60 msgr2=0x7f5dc806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.654+0000 7f5dcec00640 1 --2- 172.21.15.100:0/811922585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc8186d60 0x7f5dc806ab60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8190310 tx=0x7f5db802b890 comp rx=0 tx=0).stop 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.655+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 shutdown_connections 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.655+0000 7f5dcec00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.170:3300/0 conn(0x7f5dc8190800 0x7f5dc8190c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.655+0000 7f5dcec00640 1 --2- 172.21.15.100:0/811922585 >> v2:172.21.15.156:3300/0 conn(0x7f5dc818e2b0 0x7f5dc818e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.655+0000 7f5dcec00640 1 --2- 172.21.15.100:0/811922585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc8186d60 0x7f5dc806ab60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.655+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 >> 172.21.15.100:0/811922585 conn(0x7f5dc80d2540 msgr2=0x7f5dc80d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.657+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 shutdown_connections 2024-02-21T07:57:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.657+0000 7f5dcec00640 1 -- 172.21.15.100:0/811922585 wait complete. 2024-02-21T07:57:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.659+0000 7f5dcec00640 1 Processor -- start 2024-02-21T07:57:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.660+0000 7f5dcec00640 1 -- start start 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc818e2b0 0x7f5dc80f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc8190800 0x7f5dc81780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc8176790 con 0x7f5dc818e2b0 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80f9050 con 0x7f5dc8190800 2024-02-21T07:57:34.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dcec00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc80d0f30 con 0x7f5dc8186d60 2024-02-21T07:57:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.662+0000 7f5dc7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52078/0 (socket says 172.21.15.100:52078) 2024-02-21T07:57:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dccc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc8190800 0x7f5dc81780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 -- 172.21.15.100:0/1890421343 learned_addr learned my addr 172.21.15.100:0/1890421343 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7400640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc818e2b0 0x7f5dc80f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 -- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc8190800 msgr2=0x7f5dc81780c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc8190800 0x7f5dc81780c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 -- 172.21.15.100:0/1890421343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc818e2b0 msgr2=0x7f5dc80f8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc818e2b0 0x7f5dc80f8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 -- 172.21.15.100:0/1890421343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80094d0 con 0x7f5dc8186d60 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.663+0000 7f5dc7e00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5db802b8d0 tx=0x7f5db80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.664+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8032890 con 0x7f5dc8186d60 2024-02-21T07:57:34.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.664+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db80329f0 con 0x7f5dc8186d60 2024-02-21T07:57:34.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.664+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8032da0 con 0x7f5dc8186d60 2024-02-21T07:57:34.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.664+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc80d1210 con 0x7f5dc8186d60 2024-02-21T07:57:34.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.664+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc80d17d0 con 0x7f5dc8186d60 2024-02-21T07:57:34.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.665+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da0005290 con 0x7f5dc8186d60 2024-02-21T07:57:34.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.667+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5db804e450 con 0x7f5dc8186d60 2024-02-21T07:57:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.668+0000 7f5dbfe00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 0x7f5da80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.668+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5db80ebfd0 con 0x7f5dc8186d60 2024-02-21T07:57:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.669+0000 7f5dc7400640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 0x7f5da80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.669+0000 7f5dc7400640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 0x7f5da80a1560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8091440 tx=0x7f5db4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:34.671+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5db80b5cc0 con 0x7f5dc8186d60 2024-02-21T07:57:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.130+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5da00058f0 con 0x7f5dc8186d60 2024-02-21T07:57:35.139 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:57:35.140 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:50:06.308250+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:57:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.135+0000 7f5dbfe00640 1 -- 172.21.15.100:0/1890421343 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11339 (secure 0 0 0) 0x7f5da00058f0 con 0x7f5dc8186d60 2024-02-21T07:57:35.140 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 17 2024-02-21T07:57:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 msgr2=0x7f5da80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 0x7f5da80a1560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8091440 tx=0x7f5db4009190 comp rx=0 tx=0).stop 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 msgr2=0x7f5dc8176250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5db802b8d0 tx=0x7f5db80046c0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 shutdown_connections 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5dc8190800 0x7f5dc81780c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5da809f0a0 0x7f5da80a1560 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5dc818e2b0 0x7f5dc80f8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 --2- 172.21.15.100:0/1890421343 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5dc8186d60 0x7f5dc8176250 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.142+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 >> 172.21.15.100:0/1890421343 conn(0x7f5dc80d2540 msgr2=0x7f5dc80cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.143+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 shutdown_connections 2024-02-21T07:57:35.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.143+0000 7f5dcec00640 1 -- 172.21.15.100:0/1890421343 wait complete. 2024-02-21T07:57:35.195 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:57:35.196 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:57:35.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.585+0000 7f71b2800640 1 Processor -- start 2024-02-21T07:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.585+0000 7f71b2800640 1 -- start start 2024-02-21T07:57:35.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.588+0000 7f71b2800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f71ac071450 0x7f71ac0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.588+0000 7f71b2800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0f8920 con 0x7f71ac184b30 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.588+0000 7f71b2800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac188e00 con 0x7f71ac1623e0 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.588+0000 7f71b2800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac06dc90 con 0x7f71ac071450 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.588+0000 7f71aaa00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f71ac184b30 0x7f71ac184fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:57334/0 (socket says 172.21.15.100:57334) 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71aaa00640 1 -- 172.21.15.100:0/2057796326 learned_addr learned my addr 172.21.15.100:0/2057796326 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71abe00640 1 --2- 172.21.15.100:0/2057796326 >> v2:172.21.15.156:3300/0 conn(0x7f71ac071450 0x7f71ac0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71aa000640 1 -- 172.21.15.100:0/2057796326 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071139691 0 0) 0x7f7198001110 con 0x7f71ac184b30 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71aa000640 1 -- 172.21.15.100:0/2057796326 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003520 con 0x7f71ac184b30 2024-02-21T07:57:35.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71abe00640 1 -- 172.21.15.100:0/2057796326 >> v1:172.21.15.170:6789/0 conn(0x7f71ac1623e0 legacy=0x7f71ac0f8210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:35.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71abe00640 1 -- 172.21.15.100:0/2057796326 >> v1:172.21.15.156:6789/0 conn(0x7f71ac184b30 legacy=0x7f71ac184fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.589+0000 7f71abe00640 1 -- 172.21.15.100:0/2057796326 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac1890e0 con 0x7f71ac071450 2024-02-21T07:57:35.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.591+0000 7f71abe00640 1 --2- 172.21.15.100:0/2057796326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac0718c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b51ef87734349ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.591+0000 7f71aa000640 1 -- 172.21.15.100:0/2057796326 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a402cb60 con 0x7f71ac071450 2024-02-21T07:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.591+0000 7f71aa000640 1 -- 172.21.15.100:0/2057796326 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a402ccc0 con 0x7f71ac071450 2024-02-21T07:57:35.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.591+0000 7f71aa000640 1 -- 172.21.15.100:0/2057796326 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4034660 con 0x7f71ac071450 2024-02-21T07:57:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.593+0000 7f71b2800640 1 -- 172.21.15.100:0/2057796326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 msgr2=0x7f71ac0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.593+0000 7f71b2800640 1 --2- 172.21.15.100:0/2057796326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac0718c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.593+0000 7f71b2800640 1 -- 172.21.15.100:0/2057796326 shutdown_connections 2024-02-21T07:57:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.593+0000 7f71b2800640 1 --2- 172.21.15.100:0/2057796326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac0718c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.593+0000 7f71b2800640 1 -- 172.21.15.100:0/2057796326 >> 172.21.15.100:0/2057796326 conn(0x7f71ac0fc040 msgr2=0x7f71ac0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.594+0000 7f71b2800640 1 -- 172.21.15.100:0/2057796326 shutdown_connections 2024-02-21T07:57:35.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.594+0000 7f71b2800640 1 -- 172.21.15.100:0/2057796326 wait complete. 2024-02-21T07:57:35.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.598+0000 7f71b2800640 1 Processor -- start 2024-02-21T07:57:35.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.599+0000 7f71b2800640 1 -- start start 2024-02-21T07:57:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.601+0000 7f71b2800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.603+0000 7f71b2800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.603+0000 7f71b2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 0x7f71ac06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.603+0000 7f71b2800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac06cbe0 con 0x7f71ac184b30 2024-02-21T07:57:35.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.603+0000 7f71b2800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac06da80 con 0x7f71ac071450 2024-02-21T07:57:35.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.603+0000 7f71b2800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac21f970 con 0x7f71ac1623e0 2024-02-21T07:57:35.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.604+0000 7f71aaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.604+0000 7f71aaa00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52092/0 (socket says 172.21.15.100:52092) 2024-02-21T07:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.604+0000 7f71aaa00640 1 -- 172.21.15.100:0/3451708640 learned_addr learned my addr 172.21.15.100:0/3451708640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.605+0000 7f71aaa00640 1 -- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 msgr2=0x7f71ac15ecb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.605+0000 7f71ab400640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.605+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac15ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.605+0000 7f71aaa00640 1 -- 172.21.15.100:0/3451708640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 msgr2=0x7f71ac06d540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.606+0000 7f71abe00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 0x7f71ac06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.606+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 0x7f71ac06d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.606+0000 7f71aaa00640 1 -- 172.21.15.100:0/3451708640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4009a70 con 0x7f71ac1623e0 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.606+0000 7f71ab400640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.606+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f719800c390 tx=0x7f719800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.607+0000 7f71abe00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 0x7f71ac06d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:35.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.607+0000 7f71a3400640 1 -- 172.21.15.100:0/3451708640 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198005ce0 con 0x7f71ac1623e0 2024-02-21T07:57:35.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.607+0000 7f71a3400640 1 -- 172.21.15.100:0/3451708640 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7198005e40 con 0x7f71ac1623e0 2024-02-21T07:57:35.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.607+0000 7f71a3400640 1 -- 172.21.15.100:0/3451708640 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980072f0 con 0x7f71ac1623e0 2024-02-21T07:57:35.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.608+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac1773b0 con 0x7f71ac1623e0 2024-02-21T07:57:35.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.608+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac177970 con 0x7f71ac1623e0 2024-02-21T07:57:35.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.613+0000 7f71a3400640 1 -- 172.21.15.100:0/3451708640 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7198007450 con 0x7f71ac1623e0 2024-02-21T07:57:35.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.614+0000 7f71b5479740 1 Processor -- start 2024-02-21T07:57:35.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.614+0000 7f71b5479740 1 -- start start 2024-02-21T07:57:35.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.614+0000 7f71a3400640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 0x7f718c0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.615+0000 7f71a3400640 1 -- 172.21.15.100:0/3451708640 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f71980c8fe0 con 0x7f71ac1623e0 2024-02-21T07:57:35.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.615+0000 7f71abe00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 0x7f718c0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71abe00640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 0x7f718c0a1630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd01596ec0 0x55fd015972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71ab400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd01596ec0 0x55fd015972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd014ca210 con 0x55fd015d2590 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd014c7740 con 0x55fd015977e0 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.616+0000 7f71b5479740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd014c2f20 con 0x55fd01596ec0 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.617+0000 7f71abe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.617+0000 7f71abe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52208/0 (socket says 172.21.15.100:52208) 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.617+0000 7f71abe00640 1 -- 172.21.15.100:0/288108258 learned_addr learned my addr 172.21.15.100:0/288108258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.617+0000 7f71aaa00640 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 -- 172.21.15.100:0/288108258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd01596ec0 msgr2=0x55fd015972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd01596ec0 0x55fd015972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 -- 172.21.15.100:0/288108258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 msgr2=0x55fd015d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 -- 172.21.15.100:0/288108258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd01484df0 con 0x55fd015d2590 2024-02-21T07:57:35.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.618+0000 7f71abe00640 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009e80 tx=0x7f71a402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aba537bb2950353 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.619+0000 7f7197e00640 1 -- 172.21.15.100:0/288108258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4034e90 con 0x55fd015d2590 2024-02-21T07:57:35.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.619+0000 7f7197e00640 1 -- 172.21.15.100:0/288108258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a404c450 con 0x55fd015d2590 2024-02-21T07:57:35.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.619+0000 7f7197e00640 1 -- 172.21.15.100:0/288108258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a404c7e0 con 0x55fd015d2590 2024-02-21T07:57:35.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.620+0000 7f71b5479740 1 -- 172.21.15.100:0/288108258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 msgr2=0x55fd015d3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.620+0000 7f71b5479740 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009e80 tx=0x7f71a402e000 comp rx=0 tx=0).stop 2024-02-21T07:57:35.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.622+0000 7f71b5479740 1 -- 172.21.15.100:0/288108258 shutdown_connections 2024-02-21T07:57:35.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.622+0000 7f71b5479740 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015d3320 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.623+0000 7f71b5479740 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.623+0000 7f71b5479740 1 --2- 172.21.15.100:0/288108258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd01596ec0 0x55fd015972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.623+0000 7f71b5479740 1 -- 172.21.15.100:0/288108258 >> 172.21.15.100:0/288108258 conn(0x55fd01559490 msgr2=0x55fd0155a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.623+0000 7f71b5479740 1 -- 172.21.15.100:0/288108258 shutdown_connections 2024-02-21T07:57:35.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.623+0000 7f71b5479740 1 -- 172.21.15.100:0/288108258 wait complete. 2024-02-21T07:57:35.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.624+0000 7f71b5479740 1 -- start start 2024-02-21T07:57:35.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.625+0000 7f71b5479740 1 Processor -- start 2024-02-21T07:57:35.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.628+0000 7f71b5479740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd01585240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.628+0000 7f71b5479740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.628+0000 7f71b5479740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd015db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71ab400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd01585240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71b5479740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd01468150 con 0x55fd015d2590 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71b5479740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd01467df0 con 0x55fd015977e0 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71b5479740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd012311c0 con 0x55fd015cf3c0 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71b5479740 10 client.0 _ll_register_callbacks cb 0x55fd014b72b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd015db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd015db720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52110/0 (socket says 172.21.15.100:52110) 2024-02-21T07:57:35.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.629+0000 7f71abe00640 1 -- 172.21.15.100:0/1148184892 learned_addr learned my addr 172.21.15.100:0/1148184892 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:35.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.630+0000 7f71aaa00640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.637+0000 7f71aaa00640 1 -- 172.21.15.100:0/1148184892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 msgr2=0x55fd015db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.637+0000 7f71aaa00640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd015db720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.637+0000 7f71aaa00640 1 -- 172.21.15.100:0/1148184892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 msgr2=0x55fd01585240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.637+0000 7f71aaa00640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd01585240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.637+0000 7f71aaa00640 1 -- 172.21.15.100:0/1148184892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac1890e0 con 0x55fd015d2590 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.638+0000 7f71ab400640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd01585240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.638+0000 7f7194c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.638+0000 7f71aaa00640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015ccb60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f71980c69b0 tx=0x7f719809f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c61e4464c1d753d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.639+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980ae070 con 0x55fd015d2590 2024-02-21T07:57:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.639+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd011c27e0 con 0x55fd015d2590 2024-02-21T07:57:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.639+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f71980aad70 con 0x55fd015d2590 2024-02-21T07:57:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.643+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71980c6ea0 con 0x55fd015d2590 2024-02-21T07:57:35.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.643+0000 7f71b5479740 10 client.7323 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:35.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.643+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fd014c15a0 con 0x55fd015d2590 2024-02-21T07:57:35.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.644+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fd011c27e0 con 0x55fd015d2590 2024-02-21T07:57:35.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.645+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7198095f70 con 0x55fd015d2590 2024-02-21T07:57:35.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 10 client.7323 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 10 client.7323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:57:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 20 client.7323 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd015cf840 0x55fd015dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 4 client.7323 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:35.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.646+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd011ff720 con 0x55fd015cf840 2024-02-21T07:57:35.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.650+0000 7f71ab400640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd015cf840 0x55fd015dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.652+0000 7f71ab400640 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd015cf840 0x55fd015dc130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a51bff350db29adf server_cookie=955d270bd7ead239 in_seq=0 out_seq=0 2024-02-21T07:57:35.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.652+0000 7f7194c00640 10 client.7323 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:35.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.654+0000 7f7194c00640 1 -- 172.21.15.100:0/1148184892 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fd011ff720 con 0x55fd015cf840 2024-02-21T07:57:35.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.654+0000 7f7194c00640 10 client.7323 handle_command_reply: tid=0 2024-02-21T07:57:35.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.654+0000 7f71b5479740 1 client.7323 shutdown 2024-02-21T07:57:35.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.654+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 msgr2=0x55fd015ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.654+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015ccb60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f71980c69b0 tx=0x7f719809f2c0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 shutdown_connections 2024-02-21T07:57:35.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd015cf840 0x55fd015dc130 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd015db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015d2590 0x55fd015ccb60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 --2- 172.21.15.100:0/1148184892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd01585240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.658+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 >> 172.21.15.100:0/1148184892 conn(0x55fd01596ec0 msgr2=0x55fd0155af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.659+0000 7f7194c00640 0 client.7323 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.675+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 shutdown_connections 2024-02-21T07:57:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.675+0000 7f71b5479740 1 -- 172.21.15.100:0/1148184892 wait complete. 2024-02-21T07:57:35.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.676+0000 7f71b5479740 20 client.7323 trim_cache size 0 max 16384 2024-02-21T07:57:35.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.720+0000 7f71b5479740 1 Processor -- start 2024-02-21T07:57:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.721+0000 7f71b5479740 1 -- start start 2024-02-21T07:57:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 0x55fd0158f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd015966d0 con 0x55fd015cf3c0 2024-02-21T07:57:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd0157e7e0 con 0x55fd015977e0 2024-02-21T07:57:35.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.723+0000 7f71b5479740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd01585330 con 0x55fd015d2590 2024-02-21T07:57:35.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.724+0000 7f71ab400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.724+0000 7f71aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.724+0000 7f71aaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52224/0 (socket says 172.21.15.100:52224) 2024-02-21T07:57:35.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.724+0000 7f71abe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 0x55fd0158f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.724+0000 7f71aaa00640 1 -- 172.21.15.100:0/1461695313 learned_addr learned my addr 172.21.15.100:0/1461695313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:35.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.725+0000 7f71abe00640 1 -- 172.21.15.100:0/1461695313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 msgr2=0x55fd015cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.725+0000 7f71abe00640 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.725+0000 7f71abe00640 1 -- 172.21.15.100:0/1461695313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 msgr2=0x55fd0158edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.729+0000 7f71abe00640 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.729+0000 7f71abe00640 1 -- 172.21.15.100:0/1461695313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd0145dab0 con 0x55fd015d2590 2024-02-21T07:57:35.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.729+0000 7f71aaa00640 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:35.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.733+0000 7f71abe00640 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 0x55fd0158f300 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009e80 tx=0x7f71a4040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ef4a4a483004ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.735+0000 7f7197400640 1 -- 172.21.15.100:0/1461695313 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4034e90 con 0x55fd015d2590 2024-02-21T07:57:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.735+0000 7f7197400640 1 -- 172.21.15.100:0/1461695313 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4063040 con 0x55fd015d2590 2024-02-21T07:57:35.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.735+0000 7f7197400640 1 -- 172.21.15.100:0/1461695313 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a4003bb0 con 0x55fd015d2590 2024-02-21T07:57:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.736+0000 7f71b5479740 1 -- 172.21.15.100:0/1461695313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 msgr2=0x55fd0158f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.736+0000 7f71b5479740 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 0x55fd0158f300 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009e80 tx=0x7f71a4040000 comp rx=0 tx=0).stop 2024-02-21T07:57:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.737+0000 7f71b5479740 1 -- 172.21.15.100:0/1461695313 shutdown_connections 2024-02-21T07:57:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.737+0000 7f71b5479740 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015d2590 0x55fd0158f300 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.737+0000 7f71b5479740 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015cf3c0 0x55fd0158edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.737+0000 7f71b5479740 1 --2- 172.21.15.100:0/1461695313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015977e0 0x55fd015cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.737+0000 7f71b5479740 1 -- 172.21.15.100:0/1461695313 >> 172.21.15.100:0/1461695313 conn(0x55fd01596ec0 msgr2=0x55fd015c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.746+0000 7f71b5479740 1 -- 172.21.15.100:0/1461695313 shutdown_connections 2024-02-21T07:57:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.746+0000 7f71b5479740 1 -- 172.21.15.100:0/1461695313 wait complete. 2024-02-21T07:57:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.747+0000 7f71b5479740 1 -- start start 2024-02-21T07:57:35.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.748+0000 7f71b5479740 1 Processor -- start 2024-02-21T07:57:35.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.751+0000 7f71b5479740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.751+0000 7f71b5479740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd01633c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71b5479740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015d2590 0x55fd015d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71b5479740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd015d0f90 con 0x55fd015977e0 2024-02-21T07:57:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71b5479740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd015d1130 con 0x55fd015d2590 2024-02-21T07:57:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71b5479740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd01636310 con 0x55fd015cf3c0 2024-02-21T07:57:35.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71b5479740 10 client.0 _ll_register_callbacks cb 0x7f71a4043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71ab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52226/0 (socket says 172.21.15.100:52226) 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.752+0000 7f71ab400640 1 -- 172.21.15.100:0/3524230457 learned_addr learned my addr 172.21.15.100:0/3524230457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.753+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd01633c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.753+0000 7f71abe00640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015d2590 0x55fd015d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.753+0000 7f71aaa00640 1 -- 172.21.15.100:0/3524230457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015d2590 msgr2=0x55fd015d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.753+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015d2590 0x55fd015d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.753+0000 7f71aaa00640 1 -- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 msgr2=0x55fd0158bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:35.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.754+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.754+0000 7f71aaa00640 1 -- 172.21.15.100:0/3524230457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd014c15a0 con 0x55fd015cf3c0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.754+0000 7f7194c00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.754+0000 7f71ab400640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.754+0000 7f71aaa00640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd01633c30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7198092f80 tx=0x7f7198000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f11ad7c6ee30fdf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71980ae040 con 0x55fd015cf3c0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f71980aad70 con 0x55fd015cf3c0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71a404c450 con 0x55fd015cf3c0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71980c6ea0 con 0x55fd015cf3c0 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f71b5479740 10 client.7430 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:35.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fd01484df0 con 0x55fd015cf3c0 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.755+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a404c450 con 0x55fd015cf3c0 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7198095520 con 0x55fd015cf3c0 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 10 client.7430 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 10 client.7430 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 20 client.7430 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd01551540 0x55fd01587c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 4 client.7430 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:35.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.756+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fd0124e890 con 0x55fd01551540 2024-02-21T07:57:35.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.757+0000 7f71ab400640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd01551540 0x55fd01587c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.762+0000 7f71ab400640 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd01551540 0x55fd01587c10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=12b68fb8545149ae server_cookie=df2538490c935721 in_seq=0 out_seq=0 2024-02-21T07:57:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.762+0000 7f7194c00640 10 client.7430 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.762+0000 7f7194c00640 1 -- 172.21.15.100:0/3524230457 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fd0124e890 con 0x55fd01551540 2024-02-21T07:57:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.763+0000 7f7194c00640 10 client.7430 handle_command_reply: tid=0 2024-02-21T07:57:35.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.763+0000 7f71b5479740 1 client.7430 shutdown 2024-02-21T07:57:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.765+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 msgr2=0x55fd01633c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.765+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd01633c30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7198092f80 tx=0x7f7198000bc0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.766+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 shutdown_connections 2024-02-21T07:57:35.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.766+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x55fd01551540 0x55fd01587c10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fd015d2590 0x55fd015d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55fd015cf3c0 0x55fd01633c30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f71b5479740 1 --2- 172.21.15.100:0/3524230457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fd015977e0 0x55fd0158bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 >> 172.21.15.100:0/3524230457 conn(0x55fd01596ec0 msgr2=0x55fd015c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f7194c00640 0 client.7430 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:57:35.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.767+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 shutdown_connections 2024-02-21T07:57:35.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.768+0000 7f71b5479740 1 -- 172.21.15.100:0/3524230457 wait complete. 2024-02-21T07:57:35.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.769+0000 7f71b5479740 20 client.7430 trim_cache size 0 max 16384 2024-02-21T07:57:35.772 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:35.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.779+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 msgr2=0x7f718c0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.779+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 0x7f718c0a1630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a4030000 comp rx=0 tx=0).stop 2024-02-21T07:57:35.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.780+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 msgr2=0x7f71ac06d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:35.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.780+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f719800c390 tx=0x7f719800c850 comp rx=0 tx=0).stop 2024-02-21T07:57:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 shutdown_connections 2024-02-21T07:57:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f718c09f170 0x7f718c0a1630 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ac184b30 0x7f71ac06d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ac1623e0 0x7f71ac06d000 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 --2- 172.21.15.100:0/3451708640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71ac071450 0x7f71ac15ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.782+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 >> 172.21.15.100:0/3451708640 conn(0x7f71ac0fc040 msgr2=0x7f71ac17c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.785+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 shutdown_connections 2024-02-21T07:57:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:35.785+0000 7f71b2800640 1 -- 172.21.15.100:0/3451708640 wait complete. 2024-02-21T07:57:35.844 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:57:35.844 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:57:36.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.181+0000 7fb141400640 1 Processor -- start 2024-02-21T07:57:36.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.182+0000 7fb141400640 1 -- start start 2024-02-21T07:57:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.184+0000 7fb141400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb13c071b00 0x7fb13c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.184+0000 7fb141400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fb13c06f7c0 0x7fb13c186920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.185+0000 7fb141400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c071f40 con 0x7fb13c071010 2024-02-21T07:57:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.185+0000 7fb141400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c06ea40 con 0x7fb13c071b00 2024-02-21T07:57:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.185+0000 7fb141400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0700c0 con 0x7fb13c06f7c0 2024-02-21T07:57:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.185+0000 7fb139e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb13c071b00 0x7fb13c06f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fb13c071b00 0x7fb13c06f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60704/0 (socket says 172.21.15.100:60704) 2024-02-21T07:57:36.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 -- 172.21.15.100:0/2344888137 learned_addr learned my addr 172.21.15.100:0/2344888137 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb13b200640 1 --2- 172.21.15.100:0/2344888137 >> v2:172.21.15.170:3300/0 conn(0x7fb13c06f7c0 0x7fb13c186920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 -- 172.21.15.100:0/2344888137 >> v2:172.21.15.170:3300/0 conn(0x7fb13c06f7c0 msgr2=0x7fb13c186920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 --2- 172.21.15.100:0/2344888137 >> v2:172.21.15.170:3300/0 conn(0x7fb13c06f7c0 0x7fb13c186920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 -- 172.21.15.100:0/2344888137 >> v1:172.21.15.170:6789/0 conn(0x7fb13c071010 legacy=0x7fb13c0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.186+0000 7fb139e00640 1 -- 172.21.15.100:0/2344888137 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0703a0 con 0x7fb13c071b00 2024-02-21T07:57:36.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.188+0000 7fb139e00640 1 --2- 172.21.15.100:0/2344888137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c071b00 0x7fb13c06f280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb13c08e020 tx=0x7fb12802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e000b1589af744fd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.189+0000 7fb139400640 1 -- 172.21.15.100:0/2344888137 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128007ce0 con 0x7fb13c071b00 2024-02-21T07:57:36.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.189+0000 7fb139400640 1 -- 172.21.15.100:0/2344888137 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128007e40 con 0x7fb13c071b00 2024-02-21T07:57:36.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.189+0000 7fb139400640 1 -- 172.21.15.100:0/2344888137 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280092f0 con 0x7fb13c071b00 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 -- 172.21.15.100:0/2344888137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c071b00 msgr2=0x7fb13c06f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 --2- 172.21.15.100:0/2344888137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c071b00 0x7fb13c06f280 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb13c08e020 tx=0x7fb12802b9a0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 -- 172.21.15.100:0/2344888137 shutdown_connections 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 --2- 172.21.15.100:0/2344888137 >> v2:172.21.15.170:3300/0 conn(0x7fb13c06f7c0 0x7fb13c186920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 --2- 172.21.15.100:0/2344888137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c071b00 0x7fb13c06f280 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.190+0000 7fb141400640 1 -- 172.21.15.100:0/2344888137 >> 172.21.15.100:0/2344888137 conn(0x7fb13c0668b0 msgr2=0x7fb13c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.192+0000 7fb141400640 1 -- 172.21.15.100:0/2344888137 shutdown_connections 2024-02-21T07:57:36.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.192+0000 7fb141400640 1 -- 172.21.15.100:0/2344888137 wait complete. 2024-02-21T07:57:36.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.195+0000 7fb141400640 1 Processor -- start 2024-02-21T07:57:36.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.195+0000 7fb141400640 1 -- start start 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c06f7c0 0x7fb13c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb13c071010 0x7fb13c0f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c182ba0 con 0x7fb13c071010 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c182e80 con 0x7fb13c06f7c0 2024-02-21T07:57:36.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.198+0000 7fb141400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c183160 con 0x7fb13c071b00 2024-02-21T07:57:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.200+0000 7fb139e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb13c071010 0x7fb13c0f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.200+0000 7fb13b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.200+0000 7fb13b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52140/0 (socket says 172.21.15.100:52140) 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.200+0000 7fb13b200640 1 -- 172.21.15.100:0/3862355912 learned_addr learned my addr 172.21.15.100:0/3862355912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13a800640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c06f7c0 0x7fb13c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 -- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c06f7c0 msgr2=0x7fb13c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c06f7c0 0x7fb13c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 -- 172.21.15.100:0/3862355912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb13c071010 msgr2=0x7fb13c0f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb13c071010 0x7fb13c0f1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 -- 172.21.15.100:0/3862355912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12800d040 con 0x7fb13c071b00 2024-02-21T07:57:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.201+0000 7fb13b200640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb1340070b0 tx=0x7fb1340085d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.203+0000 7fb132a00640 1 -- 172.21.15.100:0/3862355912 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134010070 con 0x7fb13c071b00 2024-02-21T07:57:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.203+0000 7fb132a00640 1 -- 172.21.15.100:0/3862355912 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb134008e00 con 0x7fb13c071b00 2024-02-21T07:57:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.203+0000 7fb132a00640 1 -- 172.21.15.100:0/3862355912 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134009ea0 con 0x7fb13c071b00 2024-02-21T07:57:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.205+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c183440 con 0x7fb13c071b00 2024-02-21T07:57:36.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.205+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0f2c20 con 0x7fb13c071b00 2024-02-21T07:57:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.217+0000 7fb132a00640 1 -- 172.21.15.100:0/3862355912 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb134014030 con 0x7fb13c071b00 2024-02-21T07:57:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.218+0000 7fb1441b9740 1 Processor -- start 2024-02-21T07:57:36.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.219+0000 7fb132a00640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 0x7fb11c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.220+0000 7fb1441b9740 1 -- start start 2024-02-21T07:57:36.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.220+0000 7fb132a00640 1 -- 172.21.15.100:0/3862355912 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb1340c99d0 con 0x7fb13c071b00 2024-02-21T07:57:36.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.220+0000 7fb139e00640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 0x7fb11c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb139e00640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 0x7fb11c0a16b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb128035000 tx=0x7fb128009000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 0x564eac9cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eac9cd7e0 0x564eaca08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eaca09320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac900210 con 0x564eaca08590 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac8fd740 con 0x564eac9cd7e0 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.221+0000 7fb1441b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac8f8f20 con 0x564eac9ccec0 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 0x564eac9cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 0x564eac9cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52144/0 (socket says 172.21.15.100:52144) 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13a800640 1 -- 172.21.15.100:0/2065837883 learned_addr learned my addr 172.21.15.100:0/2065837883 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eaca09320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb139e00640 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eac9cd7e0 0x564eaca08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 -- 172.21.15.100:0/2065837883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 msgr2=0x564eac9cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 0x564eac9cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 -- 172.21.15.100:0/2065837883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eac9cd7e0 msgr2=0x564eaca08050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eac9cd7e0 0x564eaca08050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.222+0000 7fb13b200640 1 -- 172.21.15.100:0/2065837883 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eac8badf0 con 0x564eaca08590 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.223+0000 7fb13b200640 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eaca09320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb1340c7340 tx=0x7fb1340955f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c90870b56e3a36e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.223+0000 7fb127000640 1 -- 172.21.15.100:0/2065837883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13409b600 con 0x564eaca08590 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.223+0000 7fb127000640 1 -- 172.21.15.100:0/2065837883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13409fc50 con 0x564eaca08590 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.223+0000 7fb127000640 1 -- 172.21.15.100:0/2065837883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1340b60c0 con 0x564eaca08590 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 -- 172.21.15.100:0/2065837883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 msgr2=0x564eaca09320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eaca09320 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb1340c7340 tx=0x7fb1340955f0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 -- 172.21.15.100:0/2065837883 shutdown_connections 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eaca09320 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eac9cd7e0 0x564eaca08050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2065837883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9ccec0 0x564eac9cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 -- 172.21.15.100:0/2065837883 >> 172.21.15.100:0/2065837883 conn(0x564eac98f490 msgr2=0x564eac990510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 -- 172.21.15.100:0/2065837883 shutdown_connections 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.224+0000 7fb1441b9740 1 -- 172.21.15.100:0/2065837883 wait complete. 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.225+0000 7fb1441b9740 1 -- start start 2024-02-21T07:57:36.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.225+0000 7fb1441b9740 1 Processor -- start 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 0x564eac9b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 0x564eac9fc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac89e150 con 0x564eaca08590 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac89ddf0 con 0x564eaca11fc0 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac6671c0 con 0x564eac9cd7e0 2024-02-21T07:57:36.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb1441b9740 10 client.0 _ll_register_callbacks cb 0x564eac8ed2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.226+0000 7fb139e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52266/0 (socket says 172.21.15.100:52266) 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 -- 172.21.15.100:0/4075243427 learned_addr learned my addr 172.21.15.100:0/4075243427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb13a800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 0x564eac9b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb13b200640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 0x564eac9fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 -- 172.21.15.100:0/4075243427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 msgr2=0x564eac9b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 0x564eac9b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 -- 172.21.15.100:0/4075243427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 msgr2=0x564eac9fc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 0x564eac9fc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 -- 172.21.15.100:0/4075243427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0f2c20 con 0x564eaca08590 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb13a800640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 0x564eac9b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb13b200640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 0x564eac9fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb139e00640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb128007130 tx=0x7fb12802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8922b8c7e89a1a06 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.227+0000 7fb11b400640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12804d040 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eac5f87e0 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb128030e30 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb128047840 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 10 client.7335 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564eac8f75a0 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564eac5f87e0 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb128042070 con 0x564eaca08590 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 10 client.7335 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 10 client.7335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 20 client.7335 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.228+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eac98cc90 0x564eac98d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.229+0000 7fb1441b9740 4 client.7335 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:36.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.229+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eac635720 con 0x564eac98cc90 2024-02-21T07:57:36.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.230+0000 7fb13a800640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eac98cc90 0x564eac98d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.230+0000 7fb13a800640 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eac98cc90 0x564eac98d070 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4b0412acc4e4be7 server_cookie=964559d46d061a9c in_seq=0 out_seq=0 2024-02-21T07:57:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.230+0000 7fb11b400640 10 client.7335 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:36.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb11b400640 1 -- 172.21.15.100:0/4075243427 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564eac635720 con 0x564eac98cc90 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb11b400640 10 client.7335 handle_command_reply: tid=0 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 client.7335 shutdown 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 msgr2=0x564eac9c6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb128007130 tx=0x7fb12802e000 comp rx=0 tx=0).stop 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 shutdown_connections 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eac98cc90 0x564eac98d070 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca11fc0 0x564eac9fc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eaca08590 0x564eac9c6870 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.232+0000 7fb1441b9740 1 --2- 172.21.15.100:0/4075243427 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eac9cd7e0 0x564eac9b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.233+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 >> 172.21.15.100:0/4075243427 conn(0x564eac9ccec0 msgr2=0x564eac990f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.233+0000 7fb11b400640 0 client.7335 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:36.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.233+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 shutdown_connections 2024-02-21T07:57:36.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.233+0000 7fb1441b9740 1 -- 172.21.15.100:0/4075243427 wait complete. 2024-02-21T07:57:36.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.233+0000 7fb1441b9740 20 client.7335 trim_cache size 0 max 16384 2024-02-21T07:57:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.250+0000 7fb1441b9740 1 Processor -- start 2024-02-21T07:57:36.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.250+0000 7fb1441b9740 1 -- start start 2024-02-21T07:57:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.251+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eaca12400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.251+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb1441b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eaca073a0 con 0x564eac9cd7e0 2024-02-21T07:57:36.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb1441b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac9c2f00 con 0x564eaca08590 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb1441b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac9cd2a0 con 0x564eaca11fc0 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60734/0 (socket says 172.21.15.100:60734) 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 -- 172.21.15.100:0/890583814 learned_addr learned my addr 172.21.15.100:0/890583814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb13b200640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb13a800640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eaca12400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 -- 172.21.15.100:0/890583814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 msgr2=0x564eac9c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.252+0000 7fb139e00640 1 -- 172.21.15.100:0/890583814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 msgr2=0x564eaca12400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.253+0000 7fb139e00640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eaca12400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.253+0000 7fb139e00640 1 -- 172.21.15.100:0/890583814 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eac893ab0 con 0x564eaca08590 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.253+0000 7fb13a800640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eaca12400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.253+0000 7fb139e00640 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb128030cf0 tx=0x7fb12803b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9114b8610a594f66 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.254+0000 7fb126600640 1 -- 172.21.15.100:0/890583814 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12804d040 con 0x564eaca08590 2024-02-21T07:57:36.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.255+0000 7fb126600640 1 -- 172.21.15.100:0/890583814 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12803f040 con 0x564eaca08590 2024-02-21T07:57:36.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.255+0000 7fb126600640 1 -- 172.21.15.100:0/890583814 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128047840 con 0x564eaca08590 2024-02-21T07:57:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 -- 172.21.15.100:0/890583814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 msgr2=0x564eaca06710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb128030cf0 tx=0x7fb12803b050 comp rx=0 tx=0).stop 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 -- 172.21.15.100:0/890583814 shutdown_connections 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca06710 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 --2- 172.21.15.100:0/890583814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eaca12400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 -- 172.21.15.100:0/890583814 >> 172.21.15.100:0/890583814 conn(0x564eac9ccec0 msgr2=0x564eac9b8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 -- 172.21.15.100:0/890583814 shutdown_connections 2024-02-21T07:57:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.257+0000 7fb1441b9740 1 -- 172.21.15.100:0/890583814 wait complete. 2024-02-21T07:57:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.259+0000 7fb1441b9740 1 -- start start 2024-02-21T07:57:36.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.259+0000 7fb1441b9740 1 Processor -- start 2024-02-21T07:57:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eac98ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca68bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac98b880 con 0x564eac9cd7e0 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eaca083b0 con 0x564eaca08590 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eac9d8dc0 con 0x564eaca11fc0 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.261+0000 7fb1441b9740 10 client.0 _ll_register_callbacks cb 0x7fb13400b350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52166/0 (socket says 172.21.15.100:52166) 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 -- 172.21.15.100:0/2594033341 learned_addr learned my addr 172.21.15.100:0/2594033341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb139e00640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca68bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 -- 172.21.15.100:0/2594033341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 msgr2=0x564eaca68bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca68bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.262+0000 7fb13b200640 1 -- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 msgr2=0x564eac98ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb13a800640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eac98ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb13b200640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eac98ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb13b200640 1 -- 172.21.15.100:0/2594033341 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c00e040 con 0x564eaca11fc0 2024-02-21T07:57:36.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb13a800640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eac98ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb13b200640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb134009430 tx=0x7fb134008f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d12be8b9f1b0f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb11b400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.263+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134068040 con 0x564eaca11fc0 2024-02-21T07:57:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb13409b600 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb13409fc50 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13409b170 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 10 client.7448 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564eac8f75a0 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13409fc50 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb134063d20 con 0x564eaca11fc0 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 10 client.7448 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 10 client.7448 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.264+0000 7fb1441b9740 20 client.7448 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.265+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eaca06f90 0x564eac9d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.265+0000 7fb1441b9740 4 client.7448 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.265+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564eac684890 con 0x564eaca06f90 2024-02-21T07:57:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.265+0000 7fb13a800640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eaca06f90 0x564eac9d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb13a800640 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eaca06f90 0x564eac9d18c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b690ea996df32554 server_cookie=a419ed88340df6d4 in_seq=0 out_seq=0 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb11b400640 10 client.7448 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb11b400640 1 -- 172.21.15.100:0/2594033341 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564eac684890 con 0x564eaca06f90 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb11b400640 10 client.7448 handle_command_reply: tid=0 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 client.7448 shutdown 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 msgr2=0x564eac9d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb134009430 tx=0x7fb134008f70 comp rx=0 tx=0).stop 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 shutdown_connections 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564eaca11fc0 0x564eac9d1380 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x564eaca06f90 0x564eac9d18c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.266+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eaca08590 0x564eaca68bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb1441b9740 1 --2- 172.21.15.100:0/2594033341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564eac9cd7e0 0x564eac98ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb11b400640 0 client.7448 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 >> 172.21.15.100:0/2594033341 conn(0x564eac9ccec0 msgr2=0x564eac98c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 shutdown_connections 2024-02-21T07:57:36.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb1441b9740 1 -- 172.21.15.100:0/2594033341 wait complete. 2024-02-21T07:57:36.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.267+0000 7fb1441b9740 20 client.7448 trim_cache size 0 max 16384 2024-02-21T07:57:36.272 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 msgr2=0x7fb11c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 0x7fb11c0a16b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb128035000 tx=0x7fb128009000 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 msgr2=0x7fb13c0f31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb1340070b0 tx=0x7fb1340085d0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 shutdown_connections 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb13c071b00 0x7fb13c0f31d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb11c09f1f0 0x7fb11c0a16b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb13c071010 0x7fb13c0f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 --2- 172.21.15.100:0/3862355912 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb13c06f7c0 0x7fb13c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 >> 172.21.15.100:0/3862355912 conn(0x7fb13c0668b0 msgr2=0x7fb13c179280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 shutdown_connections 2024-02-21T07:57:36.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.268+0000 7fb141400640 1 -- 172.21.15.100:0/3862355912 wait complete. 2024-02-21T07:57:36.294 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:57:36.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:57:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.696+0000 7fdd33a00640 1 Processor -- start 2024-02-21T07:57:36.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.696+0000 7fdd33a00640 1 -- start start 2024-02-21T07:57:36.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd33a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd2c06edc0 0x7fdd2c190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd33a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c18dc80 con 0x7fdd2c070a30 2024-02-21T07:57:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd33a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c0f55d0 con 0x7fdd2c190260 2024-02-21T07:57:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd33a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0f5b90 con 0x7fdd2c06edc0 2024-02-21T07:57:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd31000640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fdd2c190260 0x7fdd2c0f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:42832/0 (socket says 172.21.15.100:42832) 2024-02-21T07:57:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd31000640 1 -- 172.21.15.100:0/2344042282 learned_addr learned my addr 172.21.15.100:0/2344042282 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:36.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.699+0000 7fdd31a00640 1 --2- 172.21.15.100:0/2344042282 >> v2:172.21.15.100:3300/0 conn(0x7fdd2c06edc0 0x7fdd2c190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346576736 0 0) 0x7fdd2c0f55d0 con 0x7fdd2c190260 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd14003520 con 0x7fdd2c190260 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449580762 0 0) 0x7fdd2c18dc80 con 0x7fdd2c070a30 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd31a00640 1 -- 172.21.15.100:0/2344042282 >> v1:172.21.15.170:6789/0 conn(0x7fdd2c190260 legacy=0x7fdd2c0f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd31a00640 1 -- 172.21.15.100:0/2344042282 >> v1:172.21.15.100:6789/0 conn(0x7fdd2c070a30 legacy=0x7fdd2c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.700+0000 7fdd31a00640 1 -- 172.21.15.100:0/2344042282 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0f58b0 con 0x7fdd2c06edc0 2024-02-21T07:57:36.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.701+0000 7fdd31a00640 1 --2- 172.21.15.100:0/2344042282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c06edc0 0x7fdd2c190640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b75df5e2160ff2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.702+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2402cbd0 con 0x7fdd2c06edc0 2024-02-21T07:57:36.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.702+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2402cd30 con 0x7fdd2c06edc0 2024-02-21T07:57:36.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.702+0000 7fdd2b400640 1 -- 172.21.15.100:0/2344042282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2402cea0 con 0x7fdd2c06edc0 2024-02-21T07:57:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 -- 172.21.15.100:0/2344042282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c06edc0 msgr2=0x7fdd2c190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 --2- 172.21.15.100:0/2344042282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c06edc0 0x7fdd2c190640 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009d90 tx=0x7fdd2402be20 comp rx=0 tx=0).stop 2024-02-21T07:57:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 -- 172.21.15.100:0/2344042282 shutdown_connections 2024-02-21T07:57:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 --2- 172.21.15.100:0/2344042282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c06edc0 0x7fdd2c190640 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 -- 172.21.15.100:0/2344042282 >> 172.21.15.100:0/2344042282 conn(0x7fdd2c0668b0 msgr2=0x7fdd2c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 -- 172.21.15.100:0/2344042282 shutdown_connections 2024-02-21T07:57:36.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.703+0000 7fdd33a00640 1 -- 172.21.15.100:0/2344042282 wait complete. 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.706+0000 7fdd33a00640 1 Processor -- start 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.707+0000 7fdd33a00640 1 -- start start 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2c070a30 0x7fdd2c16d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 0x7fdd2c189550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c187d20 con 0x7fdd2c16de00 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c188b80 con 0x7fdd2c070a30 2024-02-21T07:57:36.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.709+0000 7fdd33a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c187f70 con 0x7fdd2c190260 2024-02-21T07:57:36.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.710+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.710+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52176/0 (socket says 172.21.15.100:52176) 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.710+0000 7fdd2be00640 1 -- 172.21.15.100:0/372239917 learned_addr learned my addr 172.21.15.100:0/372239917 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.710+0000 7fdd31000640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2c070a30 0x7fdd2c16d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.711+0000 7fdd2be00640 1 -- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2c070a30 msgr2=0x7fdd2c16d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.711+0000 7fdd2be00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2c070a30 0x7fdd2c16d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.711+0000 7fdd2be00640 1 -- 172.21.15.100:0/372239917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 msgr2=0x7fdd2c189550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:57:36.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.711+0000 7fdd31a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 0x7fdd2c189550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.712+0000 7fdd2be00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 0x7fdd2c189550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.712+0000 7fdd2be00640 1 -- 172.21.15.100:0/372239917 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009a70 con 0x7fdd2c190260 2024-02-21T07:57:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.712+0000 7fdd31a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 0x7fdd2c189550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.712+0000 7fdd2be00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000c3f0 tx=0x7fdd2000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.713+0000 7fdd28c00640 1 -- 172.21.15.100:0/372239917 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200035f0 con 0x7fdd2c190260 2024-02-21T07:57:36.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.713+0000 7fdd28c00640 1 -- 172.21.15.100:0/372239917 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20003770 con 0x7fdd2c190260 2024-02-21T07:57:36.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.713+0000 7fdd28c00640 1 -- 172.21.15.100:0/372239917 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20003b20 con 0x7fdd2c190260 2024-02-21T07:57:36.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.713+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c188250 con 0x7fdd2c190260 2024-02-21T07:57:36.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.713+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c188810 con 0x7fdd2c190260 2024-02-21T07:57:36.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.717+0000 7fdd28c00640 1 -- 172.21.15.100:0/372239917 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fdd20003c80 con 0x7fdd2c190260 2024-02-21T07:57:36.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.718+0000 7fdd28c00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 0x7fdd0c0a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.718+0000 7fdd28c00640 1 -- 172.21.15.100:0/372239917 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdd200c9040 con 0x7fdd2c190260 2024-02-21T07:57:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.719+0000 7fdd31000640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 0x7fdd0c0a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.719+0000 7fdd31000640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 0x7fdd0c0a16b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdd180011e0 tx=0x7fdd18007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.720+0000 7fdd367cc740 1 Processor -- start 2024-02-21T07:57:36.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.720+0000 7fdd367cc740 1 -- start start 2024-02-21T07:57:36.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcecec0 0x561abbced2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 0x561abbd28050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbc20210 con 0x561abbd28590 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbc1d740 con 0x561abbced7e0 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd367cc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbc18f20 con 0x561abbcecec0 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd31a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.721+0000 7fdd31a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52328/0 (socket says 172.21.15.100:52328) 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd31a00640 1 -- 172.21.15.100:0/1212644122 learned_addr learned my addr 172.21.15.100:0/1212644122 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 0x561abbd28050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd31000640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcecec0 0x561abbced2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 -- 172.21.15.100:0/1212644122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcecec0 msgr2=0x561abbced2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcecec0 0x561abbced2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 -- 172.21.15.100:0/1212644122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 msgr2=0x561abbd29320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 -- 172.21.15.100:0/1212644122 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abbbdadf0 con 0x561abbced7e0 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd31a00640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.722+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 0x561abbd28050 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdd200c69b0 tx=0x7fdd20096a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20025cf27641e8a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.723+0000 7fdd1d600640 1 -- 172.21.15.100:0/1212644122 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200c6ea0 con 0x561abbced7e0 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.723+0000 7fdd1d600640 1 -- 172.21.15.100:0/1212644122 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2009ac70 con 0x561abbced7e0 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.723+0000 7fdd1d600640 1 -- 172.21.15.100:0/1212644122 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200aad70 con 0x561abbced7e0 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 -- 172.21.15.100:0/1212644122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 msgr2=0x561abbd28050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 0x561abbd28050 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdd200c69b0 tx=0x7fdd20096a20 comp rx=0 tx=0).stop 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 -- 172.21.15.100:0/1212644122 shutdown_connections 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbd28590 0x561abbd29320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbced7e0 0x561abbd28050 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1212644122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcecec0 0x561abbced2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 -- 172.21.15.100:0/1212644122 >> 172.21.15.100:0/1212644122 conn(0x561abbcaf490 msgr2=0x561abbcb0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 -- 172.21.15.100:0/1212644122 shutdown_connections 2024-02-21T07:57:36.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.724+0000 7fdd367cc740 1 -- 172.21.15.100:0/1212644122 wait complete. 2024-02-21T07:57:36.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.725+0000 7fdd367cc740 1 -- start start 2024-02-21T07:57:36.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.726+0000 7fdd367cc740 1 Processor -- start 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.727+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.727+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbce3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcd7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd367cc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbbbe150 con 0x561abbced7e0 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd367cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbbbddf0 con 0x561abbcac880 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd367cc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abb9871c0 con 0x561abbd28590 2024-02-21T07:57:36.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd367cc740 10 client.0 _ll_register_callbacks cb 0x561abbc0d2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:36.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd31000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd31000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52342/0 (socket says 172.21.15.100:52342) 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd31000640 1 -- 172.21.15.100:0/2148584320 learned_addr learned my addr 172.21.15.100:0/2148584320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.728+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbce3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 -- 172.21.15.100:0/2148584320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 msgr2=0x561abbce3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbce3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 -- 172.21.15.100:0/2148584320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 msgr2=0x561abbcd7970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcd7970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 -- 172.21.15.100:0/2148584320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c188810 con 0x561abbced7e0 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd31000640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdd180063b0 tx=0x7fdd18001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0aa05b57244b09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.729+0000 7fdd12000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18026070 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdd1801b070 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561abb9187e0 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd18001c60 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd367cc740 10 client.7350 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.730+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561abbc175a0 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561abb9187e0 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd18029020 con 0x561abbced7e0 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 10 client.7350 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 10 client.7350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:36.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 20 client.7350 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:36.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbce3180 0x561abbd34b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 4 client.7350 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:36.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.731+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561abb955720 con 0x561abbce3180 2024-02-21T07:57:36.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.732+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbce3180 0x561abbd34b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.732+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbce3180 0x561abbd34b20 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8672fd2fb4ced3af server_cookie=a706d8b8c8e592f in_seq=0 out_seq=0 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.732+0000 7fdd12000640 10 client.7350 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd12000640 1 -- 172.21.15.100:0/2148584320 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561abb955720 con 0x561abbce3180 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd12000640 10 client.7350 handle_command_reply: tid=0 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 client.7350 shutdown 2024-02-21T07:57:36.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 msgr2=0x561abbce57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdd180063b0 tx=0x7fdd18001150 comp rx=0 tx=0).stop 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 shutdown_connections 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbce3180 0x561abbd34b20 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcd7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbce3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd12000640 0 client.7350 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2148584320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce57c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.733+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 >> 172.21.15.100:0/2148584320 conn(0x561abbcecec0 msgr2=0x561abbcb0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.734+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 shutdown_connections 2024-02-21T07:57:36.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.734+0000 7fdd367cc740 1 -- 172.21.15.100:0/2148584320 wait complete. 2024-02-21T07:57:36.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.734+0000 7fdd367cc740 20 client.7350 trim_cache size 0 max 16384 2024-02-21T07:57:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.753+0000 7fdd367cc740 1 Processor -- start 2024-02-21T07:57:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.753+0000 7fdd367cc740 1 -- start start 2024-02-21T07:57:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcb10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbcf8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbcac1f0 con 0x561abbced7e0 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbcaf110 con 0x561abbcac880 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd367cc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbcaee30 con 0x561abbd28590 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52358/0 (socket says 172.21.15.100:52358) 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd31000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcb10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd2be00640 1 -- 172.21.15.100:0/2723903667 learned_addr learned my addr 172.21.15.100:0/2723903667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.755+0000 7fdd31a00640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbcf8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.756+0000 7fdd2be00640 1 -- 172.21.15.100:0/2723903667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 msgr2=0x561abbcf8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbcf8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd2be00640 1 -- 172.21.15.100:0/2723903667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 msgr2=0x561abbcb10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcb10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd2be00640 1 -- 172.21.15.100:0/2723903667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561abbbb3ab0 con 0x561abbced7e0 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd31000640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcb10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd31a00640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbcf8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:36.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.760+0000 7fdd2be00640 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd200c6a30 tx=0x7fdd2001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1615986c6f3ded2b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.761+0000 7fdd1cc00640 1 -- 172.21.15.100:0/2723903667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200b4040 con 0x561abbced7e0 2024-02-21T07:57:36.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.761+0000 7fdd1cc00640 1 -- 172.21.15.100:0/2723903667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2009f340 con 0x561abbced7e0 2024-02-21T07:57:36.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.761+0000 7fdd1cc00640 1 -- 172.21.15.100:0/2723903667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200c6ea0 con 0x561abbced7e0 2024-02-21T07:57:36.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.762+0000 7fdd367cc740 1 -- 172.21.15.100:0/2723903667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 msgr2=0x561abbcb0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.762+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd200c6a30 tx=0x7fdd2001d000 comp rx=0 tx=0).stop 2024-02-21T07:57:36.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.765+0000 7fdd367cc740 1 -- 172.21.15.100:0/2723903667 shutdown_connections 2024-02-21T07:57:36.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.765+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbd28590 0x561abbcf8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.765+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbcb0670 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.765+0000 7fdd367cc740 1 --2- 172.21.15.100:0/2723903667 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbcac880 0x561abbcb10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.765+0000 7fdd367cc740 1 -- 172.21.15.100:0/2723903667 >> 172.21.15.100:0/2723903667 conn(0x561abbcecec0 msgr2=0x561abbcaabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.768+0000 7fdd367cc740 1 -- 172.21.15.100:0/2723903667 shutdown_connections 2024-02-21T07:57:36.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.768+0000 7fdd367cc740 1 -- 172.21.15.100:0/2723903667 wait complete. 2024-02-21T07:57:36.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.771+0000 7fdd367cc740 1 -- start start 2024-02-21T07:57:36.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.772+0000 7fdd367cc740 1 Processor -- start 2024-02-21T07:57:36.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.775+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 0x561abbd28d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.776+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.776+0000 7fdd367cc740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbd28590 0x561abbd38ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd367cc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbcf0c00 con 0x561abbced7e0 2024-02-21T07:57:36.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd367cc740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbd20940 con 0x561abbd28590 2024-02-21T07:57:36.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd367cc740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561abbce53b0 con 0x561abbcac880 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52370/0 (socket says 172.21.15.100:52370) 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 -- 172.21.15.100:0/1904656770 learned_addr learned my addr 172.21.15.100:0/1904656770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd31000640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 0x561abbd28d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd31a00640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbd28590 0x561abbd38ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd367cc740 10 client.0 _ll_register_callbacks cb 0x7fdd200010d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 -- 172.21.15.100:0/1904656770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 msgr2=0x561abbd28d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 0x561abbd28d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 -- 172.21.15.100:0/1904656770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbd28590 msgr2=0x561abbd38ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbd28590 0x561abbd38ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.777+0000 7fdd2be00640 1 -- 172.21.15.100:0/1904656770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561abbc175a0 con 0x561abbced7e0 2024-02-21T07:57:36.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.778+0000 7fdd31000640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 0x561abbd28d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:36.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.779+0000 7fdd2be00640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd200050a0 tx=0x7fdd20000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680fcf3f2ba0d832 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:36.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.779+0000 7fdd12000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:57:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.779+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200c6ea0 con 0x561abbced7e0 2024-02-21T07:57:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.779+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdd200c6020 con 0x561abbced7e0 2024-02-21T07:57:36.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.780+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd2009ac70 con 0x561abbced7e0 2024-02-21T07:57:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.784+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd20097220 con 0x561abbced7e0 2024-02-21T07:57:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.784+0000 7fdd367cc740 10 client.7356 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:36.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.784+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7fdd24030070 con 0x561abbced7e0 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.785+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2009ac70 con 0x561abbced7e0 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.785+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd20095f70 con 0x561abbced7e0 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 10 client.7356 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 10 client.7356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 20 client.7356 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbcaaf00 0x561abbcf04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 4 client.7356 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:57:36.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561abb9a4890 con 0x561abbcaaf00 2024-02-21T07:57:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.786+0000 7fdd31000640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbcaaf00 0x561abbcf04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.787+0000 7fdd12000640 10 client.7356 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.787+0000 7fdd31000640 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbcaaf00 0x561abbcf04b0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=535c2fe7c52aed2b server_cookie=b9de38a4f13b9a8a in_seq=0 out_seq=0 2024-02-21T07:57:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd12000640 1 -- 172.21.15.100:0/1904656770 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561abb9a4890 con 0x561abbcaaf00 2024-02-21T07:57:36.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd12000640 10 client.7356 handle_command_reply: tid=0 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 client.7356 shutdown 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 msgr2=0x561abbce1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd200050a0 tx=0x7fdd20000fb0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 shutdown_connections 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x561abbcaaf00 0x561abbcf04b0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561abbd28590 0x561abbd38ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561abbced7e0 0x561abbce1ee0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 --2- 172.21.15.100:0/1904656770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561abbcac880 0x561abbd28d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 >> 172.21.15.100:0/1904656770 conn(0x561abbcecec0 msgr2=0x561abbce38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.788+0000 7fdd12000640 0 client.7356 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.789+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 shutdown_connections 2024-02-21T07:57:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.789+0000 7fdd367cc740 1 -- 172.21.15.100:0/1904656770 wait complete. 2024-02-21T07:57:36.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.790+0000 7fdd367cc740 20 client.7356 trim_cache size 0 max 16384 2024-02-21T07:57:36.792 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:57:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.793+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 msgr2=0x7fdd0c0a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.793+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 0x7fdd0c0a16b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdd180011e0 tx=0x7fdd18007d30 comp rx=0 tx=0).stop 2024-02-21T07:57:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 msgr2=0x7fdd2c189010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:36.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000c3f0 tx=0x7fdd2000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 shutdown_connections 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fdd0c09f1f0 0x7fdd0c0a16b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd2c16de00 0x7fdd2c189550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd2c190260 0x7fdd2c189010 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000c3f0 tx=0x7fdd2000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 --2- 172.21.15.100:0/372239917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd2c070a30 0x7fdd2c16d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:36.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.794+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 >> 172.21.15.100:0/372239917 conn(0x7fdd2c0668b0 msgr2=0x7fdd2c0715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:36.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.804+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 shutdown_connections 2024-02-21T07:57:36.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:36.804+0000 7fdd33a00640 1 -- 172.21.15.100:0/372239917 wait complete. 2024-02-21T07:57:37.833 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:57:37.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:57:37.834 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.271+0000 7f6cff000640 1 Processor -- start 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.271+0000 7f6cff000640 1 -- start start 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cff000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6cf818be10 0x7f6cf80fca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cff000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 0x7f6cf80d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cff000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf80fbd30 con 0x7f6cf80d5da0 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cff000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80d4420 con 0x7f6cf80fcfa0 2024-02-21T07:57:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cff000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf80fd420 con 0x7f6cf818be10 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cfdc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6cf818be10 0x7f6cf80fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cfdc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6cf818be10 0x7f6cf80fca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52210/0 (socket says 172.21.15.100:52210) 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cfdc00640 1 -- 172.21.15.100:0/1138886679 learned_addr learned my addr 172.21.15.100:0/1138886679 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.274+0000 7f6cfd200640 1 --2- 172.21.15.100:0/1138886679 >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 0x7f6cf80d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.275+0000 7f6cfdc00640 1 -- 172.21.15.100:0/1138886679 >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 msgr2=0x7f6cf80d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.275+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/1138886679 >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 0x7f6cf80d5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.275+0000 7f6cfdc00640 1 -- 172.21.15.100:0/1138886679 >> v1:172.21.15.156:6789/0 conn(0x7f6cf80d5da0 legacy=0x7f6cf818c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.275+0000 7f6cfdc00640 1 -- 172.21.15.100:0/1138886679 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8189890 con 0x7f6cf818be10 2024-02-21T07:57:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.275+0000 7f6cfd200640 1 --2- 172.21.15.100:0/1138886679 >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 0x7f6cf80d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.278+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/1138886679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf80fca60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80922b0 tx=0x7f6cec02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e243c574190f5e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.279+0000 7f6cf7e00640 1 -- 172.21.15.100:0/1138886679 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec031800 con 0x7f6cf818be10 2024-02-21T07:57:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.279+0000 7f6cf7e00640 1 -- 172.21.15.100:0/1138886679 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec031960 con 0x7f6cf818be10 2024-02-21T07:57:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.279+0000 7f6cf7e00640 1 -- 172.21.15.100:0/1138886679 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec031cf0 con 0x7f6cf818be10 2024-02-21T07:57:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.281+0000 7f6cff000640 1 -- 172.21.15.100:0/1138886679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 msgr2=0x7f6cf80fca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.281+0000 7f6cff000640 1 --2- 172.21.15.100:0/1138886679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf80fca60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80922b0 tx=0x7f6cec02b8a0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 -- 172.21.15.100:0/1138886679 shutdown_connections 2024-02-21T07:57:38.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 --2- 172.21.15.100:0/1138886679 >> v2:172.21.15.156:3300/0 conn(0x7f6cf80fcfa0 0x7f6cf80d5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 --2- 172.21.15.100:0/1138886679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf80fca60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 -- 172.21.15.100:0/1138886679 >> 172.21.15.100:0/1138886679 conn(0x7f6cf80fdf30 msgr2=0x7f6cf80fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 -- 172.21.15.100:0/1138886679 shutdown_connections 2024-02-21T07:57:38.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.285+0000 7f6cff000640 1 -- 172.21.15.100:0/1138886679 wait complete. 2024-02-21T07:57:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.292+0000 7f6cff000640 1 Processor -- start 2024-02-21T07:57:38.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.292+0000 7f6cff000640 1 -- start start 2024-02-21T07:57:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 0x7f6cf818b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 0x7f6cf81698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf8189f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8189b50 con 0x7f6cf80fcfa0 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8188600 con 0x7f6cf80d5da0 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cff000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81888e0 con 0x7f6cf818be10 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 0x7f6cf81698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 0x7f6cf81698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52372/0 (socket says 172.21.15.100:52372) 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cfd200640 1 -- 172.21.15.100:0/2735509910 learned_addr learned my addr 172.21.15.100:0/2735509910 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf8189f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.296+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 0x7f6cf818b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 -- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 msgr2=0x7f6cf818b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 0x7f6cf818b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 -- 172.21.15.100:0/2735509910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 msgr2=0x7f6cf81698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 0x7f6cf81698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 -- 172.21.15.100:0/2735509910 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009400 con 0x7f6cf818be10 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 0x7f6cf818b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf8189f70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c700 tx=0x7f6cf000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cf5600640 1 -- 172.21.15.100:0/2735509910 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003b70 con 0x7f6cf818be10 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cf5600640 1 -- 172.21.15.100:0/2735509910 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf0003cd0 con 0x7f6cf818be10 2024-02-21T07:57:38.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.297+0000 7f6cf5600640 1 -- 172.21.15.100:0/2735509910 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0005310 con 0x7f6cf818be10 2024-02-21T07:57:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.299+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec0094d0 con 0x7f6cf818be10 2024-02-21T07:57:38.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.299+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf8188ea0 con 0x7f6cf818be10 2024-02-21T07:57:38.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.304+0000 7f6d033c3740 1 Processor -- start 2024-02-21T07:57:38.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.306+0000 7f6cf5600640 1 -- 172.21.15.100:0/2735509910 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6cf0005470 con 0x7f6cf818be10 2024-02-21T07:57:38.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.306+0000 7f6d033c3740 1 -- start start 2024-02-21T07:57:38.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.307+0000 7f6cf5600640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 0x7f6cd80a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6cf5600640 1 -- 172.21.15.100:0/2735509910 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6cf00c98f0 con 0x7f6cf818be10 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 0x7f6cd80a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 0x558c7dbad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbe8a60 0x558c7dbe97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7db2d300 con 0x558c7dbad390 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dadfe50 con 0x558c7dbe8a60 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6d033c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dadd380 con 0x558c7dbadcb0 2024-02-21T07:57:38.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52218/0 (socket says 172.21.15.100:52218) 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.308+0000 7f6cfd200640 1 -- 172.21.15.100:0/3715171529 learned_addr learned my addr 172.21.15.100:0/3715171529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 0x558c7dbad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 0x7f6cd80a15e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80cdd70 tx=0x7f6ce4009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 -- 172.21.15.100:0/3715171529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbe8a60 msgr2=0x558c7dbe97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbe8a60 0x558c7dbe97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 -- 172.21.15.100:0/3715171529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 msgr2=0x558c7dbad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 0x558c7dbad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 -- 172.21.15.100:0/3715171529 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c7daa1c80 con 0x558c7dbadcb0 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 0x558c7dbad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:38.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cfd200640 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4014580 tx=0x7f6ce401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a689e8e3b60c7447 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.309+0000 7f6cea000640 1 -- 172.21.15.100:0/3715171529 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40206e0 con 0x558c7dbadcb0 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.310+0000 7f6cea000640 1 -- 172.21.15.100:0/3715171529 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4020840 con 0x558c7dbadcb0 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.310+0000 7f6cea000640 1 -- 172.21.15.100:0/3715171529 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4020c10 con 0x558c7dbadcb0 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 -- 172.21.15.100:0/3715171529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 msgr2=0x558c7dbe8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4014580 tx=0x7f6ce401c000 comp rx=0 tx=0).stop 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 -- 172.21.15.100:0/3715171529 shutdown_connections 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbe8a60 0x558c7dbe97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8520 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 --2- 172.21.15.100:0/3715171529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbad390 0x558c7dbad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 -- 172.21.15.100:0/3715171529 >> 172.21.15.100:0/3715171529 conn(0x558c7db6f960 msgr2=0x558c7db709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 -- 172.21.15.100:0/3715171529 shutdown_connections 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.311+0000 7f6d033c3740 1 -- 172.21.15.100:0/3715171529 wait complete. 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.312+0000 7f6d033c3740 1 -- start start 2024-02-21T07:57:38.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.312+0000 7f6d033c3740 1 Processor -- start 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 0x558c7dbf0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7db9f100 0x558c7dbe5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dad8b60 con 0x558c7dbadcb0 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7da7dfd0 con 0x558c7db9f100 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.313+0000 7f6d033c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7da7dc70 con 0x558c7dbe8a60 2024-02-21T07:57:38.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6d033c3740 10 client.0 _ll_register_callbacks cb 0x558c7d7e9c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52222/0 (socket says 172.21.15.100:52222) 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 -- 172.21.15.100:0/289946065 learned_addr learned my addr 172.21.15.100:0/289946065 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfe600640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7db9f100 0x558c7dbe5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 0x558c7dbf0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 -- 172.21.15.100:0/289946065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7db9f100 msgr2=0x558c7dbe5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7db9f100 0x558c7dbe5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 -- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 msgr2=0x558c7dbf0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 0x558c7dbf0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfd200640 1 -- 172.21.15.100:0/289946065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce4011da0 con 0x558c7dbe8a60 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.314+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 0x558c7dbf0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cfd200640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4014a40 tx=0x7f6ce4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f72de929f3854c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce40206e0 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6ce4020e40 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c7d7d8860 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce402ac50 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6d033c3740 10 client.7475 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558c7dad71e0 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.315+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558c7d7d8860 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6ce4005990 con 0x558c7dbe8a60 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 10 client.7475 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 10 client.7475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:38.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 20 client.7475 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:38.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7db6c560 0x558c7dbf53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 4 client.7475 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:38.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c7d829410 con 0x558c7db6c560 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.316+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7db6c560 0x558c7dbf53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.317+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7db6c560 0x558c7dbf53b0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32afe46728b97210 server_cookie=48aff4710cf3ccd2 in_seq=0 out_seq=0 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.317+0000 7f6cdea00640 10 client.7475 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.317+0000 7f6cdea00640 1 -- 172.21.15.100:0/289946065 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558c7d829410 con 0x558c7db6c560 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.317+0000 7f6cdea00640 10 client.7475 handle_command_reply: tid=0 2024-02-21T07:57:38.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 client.7475 shutdown 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 msgr2=0x558c7dbe7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4014a40 tx=0x7f6ce4004730 comp rx=0 tx=0).stop 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 shutdown_connections 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7db6c560 0x558c7dbf53b0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7db9f100 0x558c7dbe5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7dbe8a60 0x558c7dbe7a60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 --2- 172.21.15.100:0/289946065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbadcb0 0x558c7dbf0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 >> 172.21.15.100:0/289946065 conn(0x558c7dbad390 msgr2=0x558c7db713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6cdea00640 0 client.7475 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 shutdown_connections 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 1 -- 172.21.15.100:0/289946065 wait complete. 2024-02-21T07:57:38.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.318+0000 7f6d033c3740 20 client.7475 trim_cache size 0 max 16384 2024-02-21T07:57:38.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.363+0000 7f6d033c3740 1 Processor -- start 2024-02-21T07:57:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.363+0000 7f6d033c3740 1 -- start start 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7dbe6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7d8210c0 con 0x558c7dbe8a60 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7db6bf10 con 0x558c7dbadcb0 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.370+0000 7f6d033c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7db70f30 con 0x558c7db9f100 2024-02-21T07:57:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.371+0000 7f6cfd200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.371+0000 7f6cfe600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.371+0000 7f6cfe600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52404/0 (socket says 172.21.15.100:52404) 2024-02-21T07:57:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.371+0000 7f6cfe600640 1 -- 172.21.15.100:0/660252067 learned_addr learned my addr 172.21.15.100:0/660252067 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.374+0000 7f6cfe600640 1 -- 172.21.15.100:0/660252067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 msgr2=0x558c7dbe6510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:57:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.374+0000 7f6cfe600640 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7dbe6510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.374+0000 7f6cfe600640 1 -- 172.21.15.100:0/660252067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 msgr2=0x558c7dbe8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.374+0000 7f6cfe600640 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.374+0000 7f6cfe600640 1 -- 172.21.15.100:0/660252067 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c7da73a90 con 0x558c7dbe8a60 2024-02-21T07:57:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.376+0000 7f6cfe600640 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00937a0 tx=0x7f6cf0082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acccd106422d3c2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.377+0000 7f6ce9600640 1 -- 172.21.15.100:0/660252067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00b60b0 con 0x558c7dbe8a60 2024-02-21T07:57:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.377+0000 7f6ce9600640 1 -- 172.21.15.100:0/660252067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf00973d0 con 0x558c7dbe8a60 2024-02-21T07:57:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.377+0000 7f6ce9600640 1 -- 172.21.15.100:0/660252067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf009b520 con 0x558c7dbe8a60 2024-02-21T07:57:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 -- 172.21.15.100:0/660252067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 msgr2=0x558c7db6b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00937a0 tx=0x7f6cf0082040 comp rx=0 tx=0).stop 2024-02-21T07:57:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 -- 172.21.15.100:0/660252067 shutdown_connections 2024-02-21T07:57:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7db6b9d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbe8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.378+0000 7f6d033c3740 1 --2- 172.21.15.100:0/660252067 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7dbe6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.379+0000 7f6d033c3740 1 -- 172.21.15.100:0/660252067 >> 172.21.15.100:0/660252067 conn(0x558c7dbad390 msgr2=0x558c7dbb1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.379+0000 7f6d033c3740 1 -- 172.21.15.100:0/660252067 shutdown_connections 2024-02-21T07:57:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.379+0000 7f6d033c3740 1 -- 172.21.15.100:0/660252067 wait complete. 2024-02-21T07:57:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.380+0000 7f6d033c3740 1 -- start start 2024-02-21T07:57:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.381+0000 7f6d033c3740 1 Processor -- start 2024-02-21T07:57:38.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbf10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7dbe8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dba5210 con 0x558c7dbe8a60 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dc50a50 con 0x558c7dbadcb0 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c7dbb0d40 con 0x558c7db9f100 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.383+0000 7f6d033c3740 10 client.0 _ll_register_callbacks cb 0x7f6ce4014440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfdc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52230/0 (socket says 172.21.15.100:52230) 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfdc00640 1 -- 172.21.15.100:0/2752729874 learned_addr learned my addr 172.21.15.100:0/2752729874 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbf10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7dbe8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.384+0000 7f6cfdc00640 1 -- 172.21.15.100:0/2752729874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 msgr2=0x558c7dbf10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbf10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfdc00640 1 -- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 msgr2=0x558c7dbe8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7dbe8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfdc00640 1 -- 172.21.15.100:0/2752729874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf8188ea0 con 0x558c7db9f100 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfe600640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7dbe8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:57:38.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbf10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cfdc00640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009960 tx=0x7f6cec02e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e77432115d38eb76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.385+0000 7f6cdea00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:38.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec004230 con 0x558c7db9f100 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6cec03f040 con 0x558c7db9f100 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c7db6f760 con 0x558c7db9f100 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cec004390 con 0x558c7db9f100 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6d033c3740 10 client.7478 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.386+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558c7da996a0 con 0x558c7db9f100 2024-02-21T07:57:38.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.387+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558c7db6f760 con 0x558c7db9f100 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.389+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6cec030070 con 0x558c7db9f100 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.389+0000 7f6d033c3740 10 client.7478 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.389+0000 7f6d033c3740 10 client.7478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.389+0000 7f6d033c3740 20 client.7478 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.389+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7dbf1880 0x558c7dc4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.390+0000 7f6d033c3740 4 client.7478 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:57:38.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.390+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f6ce4020840 con 0x558c7dbf1880 2024-02-21T07:57:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.390+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7dbf1880 0x558c7dc4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.391+0000 7f6cdea00640 10 client.7478 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.391+0000 7f6cfd200640 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7dbf1880 0x558c7dc4aa00 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7403570abe83896d server_cookie=aa84be83b7df189c in_seq=0 out_seq=0 2024-02-21T07:57:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.395+0000 7f6cdea00640 1 -- 172.21.15.100:0/2752729874 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f6ce4020840 con 0x558c7dbf1880 2024-02-21T07:57:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.395+0000 7f6cdea00640 10 client.7478 handle_command_reply: tid=0 2024-02-21T07:57:38.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.395+0000 7f6d033c3740 1 client.7478 shutdown 2024-02-21T07:57:38.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.395+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 msgr2=0x558c7db6b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.395+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009960 tx=0x7f6cec02e000 comp rx=0 tx=0).stop 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 shutdown_connections 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x558c7dbf1880 0x558c7dc4aa00 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c7dbe8a60 0x558c7dbe8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558c7dbadcb0 0x558c7dbf10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 --2- 172.21.15.100:0/2752729874 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558c7db9f100 0x558c7db6b9d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 >> 172.21.15.100:0/2752729874 conn(0x558c7dbad390 msgr2=0x558c7db77b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6cdea00640 0 client.7478 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 shutdown_connections 2024-02-21T07:57:38.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.396+0000 7f6d033c3740 1 -- 172.21.15.100:0/2752729874 wait complete. 2024-02-21T07:57:38.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.397+0000 7f6d033c3740 20 client.7478 trim_cache size 0 max 16384 2024-02-21T07:57:38.400 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:57:38.400 INFO:teuthology.orchestra.run.smithi100.stdout: "return_code": 0, 2024-02-21T07:57:38.401 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_tag": "2627c2f9-dfb2-4862-a0a8-d251dca8db53", 2024-02-21T07:57:38.401 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": "asynchronous" 2024-02-21T07:57:38.401 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:57:38.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.400+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 msgr2=0x7f6cd80a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.400+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 0x7f6cd80a15e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80cdd70 tx=0x7f6ce4009190 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.400+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 msgr2=0x7f6cf8189f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.400+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf8189f70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000c700 tx=0x7f6cf000cbc0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.400+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 shutdown_connections 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.401+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cf818be10 0x7f6cf8189f70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.401+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6cd809f120 0x7f6cd80a15e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.401+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cf80fcfa0 0x7f6cf81698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.401+0000 7f6cff000640 1 --2- 172.21.15.100:0/2735509910 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cf80d5da0 0x7f6cf818b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.401+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 >> 172.21.15.100:0/2735509910 conn(0x7f6cf80fdf30 msgr2=0x7f6cf806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.405+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 shutdown_connections 2024-02-21T07:57:38.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.405+0000 7f6cff000640 1 -- 172.21.15.100:0/2735509910 wait complete. 2024-02-21T07:57:38.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:57:38.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:57:38.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.736+0000 7f6bb9e00640 1 Processor -- start 2024-02-21T07:57:38.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.736+0000 7f6bb9e00640 1 -- start start 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.737+0000 7f6bb9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bb418b250 0x7f6bb418b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.737+0000 7f6bb9e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb41868b0 con 0x7f6bb418c310 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.737+0000 7f6bb9e00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb4189ed0 con 0x7f6bb418bf30 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.737+0000 7f6bb9e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb418ae30 con 0x7f6bb418b250 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb2a00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f6bb418bf30 0x7f6bb40ee100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:42842/0 (socket says 172.21.15.100:42842) 2024-02-21T07:57:38.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb2a00640 1 -- 172.21.15.100:0/965500636 learned_addr learned my addr 172.21.15.100:0/965500636 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:38.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481844806 0 0) 0x7f6bb4189ed0 con 0x7f6bb418bf30 2024-02-21T07:57:38.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98003520 con 0x7f6bb418bf30 2024-02-21T07:57:38.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135814166 0 0) 0x7f6bb41868b0 con 0x7f6bb418c310 2024-02-21T07:57:38.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.738+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb4189ed0 con 0x7f6bb418c310 2024-02-21T07:57:38.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009527815 0 0) 0x7f6b98003520 con 0x7f6bb418bf30 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 >> v2:172.21.15.100:3300/0 conn(0x7f6bb418b250 msgr2=0x7f6bb418b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> v2:172.21.15.100:3300/0 conn(0x7f6bb418b250 0x7f6bb418b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 --2- 172.21.15.100:0/965500636 >> v2:172.21.15.100:3300/0 conn(0x7f6bb418b250 0x7f6bb418b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 >> v1:172.21.15.100:6789/0 conn(0x7f6bb418c310 legacy=0x7f6bb418c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb418a1b0 con 0x7f6bb418bf30 2024-02-21T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f6ba4001670 con 0x7f6bb418bf30 2024-02-21T07:57:38.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.739+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> v2:172.21.15.100:3300/0 conn(0x7f6bb418b250 0x7f6bb418b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:38.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 >> v1:172.21.15.170:6789/0 conn(0x7f6bb418bf30 legacy=0x7f6bb40ee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b98003b00 0x7f6b98003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 0x7f6b98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b980052a0 0x7f6b9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0015b0 con 0x7f6b980047c0 2024-02-21T07:57:38.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb418ae30 con 0x7f6b980052a0 2024-02-21T07:57:38.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9800c1d0 con 0x7f6b98003b00 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 0x7f6b98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.740+0000 7f6bb3400640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b980052a0 0x7f6b9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b98003b00 0x7f6b98003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2000640 1 -- 172.21.15.100:0/965500636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b98003b00 msgr2=0x7f6b98003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b98003b00 0x7f6b98003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2000640 1 -- 172.21.15.100:0/965500636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b980052a0 msgr2=0x7f6b9800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b980052a0 0x7f6b9800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2000640 1 -- 172.21.15.100:0/965500636 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98003520 con 0x7f6b980047c0 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b98003b00 0x7f6b98003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:38.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.741+0000 7f6bb3400640 1 -- 172.21.15.100:0/965500636 reap_dead start 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.742+0000 7f6bb2000640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 0x7f6b98004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0014230 tx=0x7f6b980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d048ee6d87dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.743+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0034b00 con 0x7f6b980047c0 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.744+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0034c60 con 0x7f6b980047c0 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.744+0000 7f6bb1600640 1 -- 172.21.15.100:0/965500636 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0010ae0 con 0x7f6b980047c0 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 -- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 msgr2=0x7f6b98004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 0x7f6b98004c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0014230 tx=0x7f6b980057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 -- 172.21.15.100:0/965500636 shutdown_connections 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/965500636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b980047c0 0x7f6b98004c40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 -- 172.21.15.100:0/965500636 >> 172.21.15.100:0/965500636 conn(0x7f6bb40cf400 msgr2=0x7f6bb40cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 -- 172.21.15.100:0/965500636 shutdown_connections 2024-02-21T07:57:38.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.745+0000 7f6bb9e00640 1 -- 172.21.15.100:0/965500636 wait complete. 2024-02-21T07:57:38.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.749+0000 7f6bb9e00640 1 Processor -- start 2024-02-21T07:57:38.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.749+0000 7f6bb9e00640 1 -- start start 2024-02-21T07:57:38.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb4188360 0x7f6bb408bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb408c520 0x7f6bb4170120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb406fbc0 con 0x7f6bb4188360 2024-02-21T07:57:38.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4185c20 con 0x7f6bb408c520 2024-02-21T07:57:38.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.751+0000 7f6bb9e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4169fe0 con 0x7f6b980047c0 2024-02-21T07:57:38.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52254/0 (socket says 172.21.15.100:52254) 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 -- 172.21.15.100:0/1359526489 learned_addr learned my addr 172.21.15.100:0/1359526489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb3400640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb408c520 0x7f6bb4170120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2000640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb4188360 0x7f6bb408bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 -- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb408c520 msgr2=0x7f6bb4170120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb408c520 0x7f6bb4170120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 -- 172.21.15.100:0/1359526489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb4188360 msgr2=0x7f6bb408bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb4188360 0x7f6bb408bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.752+0000 7f6bb2a00640 1 -- 172.21.15.100:0/1359526489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4170da0 con 0x7f6b980047c0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.753+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400e820 tx=0x7f6ba400ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.753+0000 7f6bab400640 1 -- 172.21.15.100:0/1359526489 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4004dc0 con 0x7f6b980047c0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.753+0000 7f6bab400640 1 -- 172.21.15.100:0/1359526489 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba400eed0 con 0x7f6b980047c0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.753+0000 7f6bab400640 1 -- 172.21.15.100:0/1359526489 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4007310 con 0x7f6b980047c0 2024-02-21T07:57:38.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.753+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40cd840 con 0x7f6b980047c0 2024-02-21T07:57:38.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.758+0000 7f6bab400640 1 -- 172.21.15.100:0/1359526489 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6ba4007470 con 0x7f6b980047c0 2024-02-21T07:57:38.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.768+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40cde00 con 0x7f6b980047c0 2024-02-21T07:57:38.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.782+0000 7f6bab400640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 0x7f6b940a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.782+0000 7f6bab400640 1 -- 172.21.15.100:0/1359526489 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6ba4093490 con 0x7f6b980047c0 2024-02-21T07:57:38.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.782+0000 7f6bb2000640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 0x7f6b940a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.789+0000 7f6bb2000640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 0x7f6b940a1660 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ba003d000 tx=0x7f6ba0038000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.792+0000 7f6bbcc2c740 1 Processor -- start 2024-02-21T07:57:38.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.793+0000 7f6bbcc2c740 1 -- start start 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc73cf80 0x55dadc7073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc7078e0 0x55dadc6c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc63e150 con 0x55dadc73cf80 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc63b680 con 0x55dadc7078e0 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc636e60 con 0x55dadc706fc0 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:52256/0 (socket says 172.21.15.100:52256) 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.808+0000 7f6bb2a00640 1 -- 172.21.15.100:0/4225997202 learned_addr learned my addr 172.21.15.100:0/4225997202 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 -- 172.21.15.100:0/4225997202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc7078e0 msgr2=0x55dadc6c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb3400640 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc7078e0 0x55dadc6c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc7078e0 0x55dadc6c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 -- 172.21.15.100:0/4225997202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc73cf80 msgr2=0x55dadc7073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc73cf80 0x55dadc7073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 -- 172.21.15.100:0/4225997202 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dadc5f0060 con 0x55dadc706fc0 2024-02-21T07:57:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.809+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400e7f0 tx=0x7f6ba4097a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9e7cb0a9c742 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.810+0000 7f6b9f400640 1 -- 172.21.15.100:0/4225997202 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40954d0 con 0x55dadc706fc0 2024-02-21T07:57:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.810+0000 7f6b9f400640 1 -- 172.21.15.100:0/4225997202 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4007720 con 0x55dadc706fc0 2024-02-21T07:57:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.810+0000 7f6b9f400640 1 -- 172.21.15.100:0/4225997202 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40c90d0 con 0x55dadc706fc0 2024-02-21T07:57:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.811+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/4225997202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 msgr2=0x55dadc73ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.811+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400e7f0 tx=0x7f6ba4097a10 comp rx=0 tx=0).stop 2024-02-21T07:57:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.812+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/4225997202 shutdown_connections 2024-02-21T07:57:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.812+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc7078e0 0x55dadc6c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.812+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc73cf80 0x55dadc7073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.812+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/4225997202 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc73ca40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.812+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/4225997202 >> 172.21.15.100:0/4225997202 conn(0x55dadc6965a0 msgr2=0x55dadc6cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.813+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/4225997202 shutdown_connections 2024-02-21T07:57:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.813+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/4225997202 wait complete. 2024-02-21T07:57:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.815+0000 7f6bbcc2c740 1 -- start start 2024-02-21T07:57:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.815+0000 7f6bbcc2c740 1 Processor -- start 2024-02-21T07:57:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.820+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.821+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.821+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.821+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60888/0 (socket says 172.21.15.100:60888) 2024-02-21T07:57:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.821+0000 7f6bb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.821+0000 7f6bb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6fc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52452/0 (socket says 172.21.15.100:52452) 2024-02-21T07:57:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bb2a00640 1 -- 172.21.15.100:0/264745353 learned_addr learned my addr 172.21.15.100:0/264745353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc73cf80 0x55dadc6c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc5dbec0 con 0x55dadc7078e0 2024-02-21T07:57:38.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc5dbb60 con 0x55dadc706fc0 2024-02-21T07:57:38.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc3a51c0 con 0x55dadc73cf80 2024-02-21T07:57:38.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.822+0000 7f6bbcc2c740 10 client.0 _ll_register_callbacks cb 0x55dadc5ef960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb3400640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc73cf80 0x55dadc6c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb2a00640 1 -- 172.21.15.100:0/264745353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc73cf80 msgr2=0x55dadc6c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc73cf80 0x55dadc6c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb2a00640 1 -- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 msgr2=0x55dadc6fc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6fc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.823+0000 7f6bb2a00640 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40cde00 con 0x55dadc706fc0 2024-02-21T07:57:38.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.824+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b6060 tx=0x7f6ba40c6f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=330ebfe7ce77e8bc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.824+0000 7f6b93e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:38.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.825+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40c92d0 con 0x55dadc706fc0 2024-02-21T07:57:38.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.825+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6ba409f4e0 con 0x55dadc706fc0 2024-02-21T07:57:38.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.826+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dadc3367e0 con 0x55dadc706fc0 2024-02-21T07:57:38.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.831+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ba409f6a0 con 0x55dadc706fc0 2024-02-21T07:57:38.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.831+0000 7f6bbcc2c740 10 client.7552 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:38.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.831+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55dadc6354e0 con 0x55dadc706fc0 2024-02-21T07:57:38.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.832+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dadc3367e0 con 0x55dadc706fc0 2024-02-21T07:57:38.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6ba4096620 con 0x55dadc706fc0 2024-02-21T07:57:38.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 10 client.7552 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:38.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 10 client.7552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:38.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 20 client.7552 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:38.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc6fce30 0x55dadc752490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 4 client.7552 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:38.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.836+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dadc373720 con 0x55dadc6fce30 2024-02-21T07:57:38.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.838+0000 7f6bb2000640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc6fce30 0x55dadc752490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.845+0000 7f6b93e00640 10 client.7552 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.845+0000 7f6bb2000640 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc6fce30 0x55dadc752490 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4726d7d171e5999 server_cookie=fe3d49c65a7bbdcd in_seq=0 out_seq=0 2024-02-21T07:57:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.847+0000 7f6b93e00640 1 -- 172.21.15.100:0/264745353 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dadc373720 con 0x55dadc6fce30 2024-02-21T07:57:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.847+0000 7f6b93e00640 10 client.7552 handle_command_reply: tid=0 2024-02-21T07:57:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.848+0000 7f6bbcc2c740 1 client.7552 shutdown 2024-02-21T07:57:38.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.853+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 msgr2=0x55dadc73e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.853+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40b6060 tx=0x7f6ba40c6f60 comp rx=0 tx=0).stop 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 shutdown_connections 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc6fce30 0x55dadc752490 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc73cf80 0x55dadc6c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6b93e00640 0 client.7552 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6fc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/264745353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc706fc0 0x55dadc73e930 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.857+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 >> 172.21.15.100:0/264745353 conn(0x55dadc6965a0 msgr2=0x55dadc73c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.858+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 shutdown_connections 2024-02-21T07:57:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.859+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/264745353 wait complete. 2024-02-21T07:57:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.859+0000 7f6bbcc2c740 20 client.7552 trim_cache size 0 max 16384 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.904+0000 7f6bbcc2c740 1 Processor -- start 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.905+0000 7f6bbcc2c740 1 -- start start 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc74fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc70e070 con 0x55dadc7078e0 2024-02-21T07:57:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc6f6660 con 0x55dadc73cf80 2024-02-21T07:57:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.906+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc711160 con 0x55dadc706fc0 2024-02-21T07:57:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.907+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.907+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60900/0 (socket says 172.21.15.100:60900) 2024-02-21T07:57:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.907+0000 7f6bb2a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc74fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.907+0000 7f6bb3400640 1 -- 172.21.15.100:0/2667157865 learned_addr learned my addr 172.21.15.100:0/2667157865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 -- 172.21.15.100:0/2667157865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 msgr2=0x55dadc74fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc74fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 -- 172.21.15.100:0/2667157865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 msgr2=0x55dadc6cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 -- 172.21.15.100:0/2667157865 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dadc5d1950 con 0x55dadc73cf80 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.908+0000 7f6bb3400640 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40f7960 tx=0x7f6bac003d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54872b619a46cbfc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.909+0000 7f6b9ea00640 1 -- 172.21.15.100:0/2667157865 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0018e0 con 0x55dadc73cf80 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.909+0000 7f6b9ea00640 1 -- 172.21.15.100:0/2667157865 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac005790 con 0x55dadc73cf80 2024-02-21T07:57:38.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.909+0000 7f6b9ea00640 1 -- 172.21.15.100:0/2667157865 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0176a0 con 0x55dadc73cf80 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/2667157865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 msgr2=0x55dadc710c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f6bb40f7960 tx=0x7f6bac003d40 comp rx=0 tx=0).stop 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/2667157865 shutdown_connections 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc710c20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/2667157865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc74fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.910+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/2667157865 >> 172.21.15.100:0/2667157865 conn(0x55dadc6965a0 msgr2=0x55dadc6fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.911+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/2667157865 shutdown_connections 2024-02-21T07:57:38.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.912+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/2667157865 wait complete. 2024-02-21T07:57:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.914+0000 7f6bbcc2c740 1 -- start start 2024-02-21T07:57:38.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.914+0000 7f6bbcc2c740 1 Processor -- start 2024-02-21T07:57:38.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc6cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc6c8c90 con 0x55dadc7078e0 2024-02-21T07:57:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc700050 con 0x55dadc73cf80 2024-02-21T07:57:38.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dadc6d51d0 con 0x55dadc706fc0 2024-02-21T07:57:38.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.918+0000 7f6bbcc2c740 10 client.0 _ll_register_callbacks cb 0x7f6ba4096bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:38.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.923+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.924+0000 7f6bb3400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:60902/0 (socket says 172.21.15.100:60902) 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.924+0000 7f6bb3400640 1 -- 172.21.15.100:0/1372466860 learned_addr learned my addr 172.21.15.100:0/1372466860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.924+0000 7f6bb2000640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.924+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc6cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 -- 172.21.15.100:0/1372466860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 msgr2=0x55dadc6cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc6cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 -- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 msgr2=0x55dadc6cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 -- 172.21.15.100:0/1372466860 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac002040 con 0x55dadc73cf80 2024-02-21T07:57:38.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6bb3400640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6bac000f80 tx=0x7f6bac001ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2495954a1ea2ae37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.925+0000 7f6b93e00640 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.926+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac017df0 con 0x55dadc73cf80 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.926+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ba4007720 con 0x55dadc73cf80 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.926+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mon.1 v2:172.21.15.156:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6bac006b10 con 0x55dadc73cf80 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.927+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bac006cd0 con 0x55dadc73cf80 2024-02-21T07:57:38.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.928+0000 7f6bbcc2c740 10 client.7558 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:38.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.928+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55dadc5f7430 con 0x55dadc73cf80 2024-02-21T07:57:38.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.933+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mon.1 v2:172.21.15.156:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4007720 con 0x55dadc73cf80 2024-02-21T07:57:38.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.933+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mon.1 v2:172.21.15.156:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6bac007020 con 0x55dadc73cf80 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 10 client.7558 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 10 client.7558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 20 client.7558 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc760150 0x55dadc7a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 4 client.7558 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:57:38.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.935+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dadc3c2890 con 0x55dadc760150 2024-02-21T07:57:38.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.938+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc760150 0x55dadc7a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:38.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.939+0000 7f6bb2a00640 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc760150 0x55dadc7a1d90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6948c71aad26bf6 server_cookie=307768361cd8769f in_seq=0 out_seq=0 2024-02-21T07:57:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.940+0000 7f6b93e00640 10 client.7558 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.940+0000 7f6b93e00640 1 -- 172.21.15.100:0/1372466860 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55dadc3c2890 con 0x55dadc760150 2024-02-21T07:57:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.940+0000 7f6b93e00640 10 client.7558 handle_command_reply: tid=0 2024-02-21T07:57:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.941+0000 7f6bbcc2c740 1 client.7558 shutdown 2024-02-21T07:57:38.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.941+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 msgr2=0x55dadc7a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.941+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6bac000f80 tx=0x7f6bac001ad0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.942+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 shutdown_connections 2024-02-21T07:57:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.942+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55dadc760150 0x55dadc7a1d90 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.943+0000 7f6b93e00640 0 client.7558 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.943+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dadc73cf80 0x55dadc7a1850 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.943+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dadc7078e0 0x55dadc6cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.943+0000 7f6bbcc2c740 1 --2- 172.21.15.100:0/1372466860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55dadc706fc0 0x55dadc6cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.943+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 >> 172.21.15.100:0/1372466860 conn(0x55dadc6965a0 msgr2=0x55dadc7349b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.944+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 shutdown_connections 2024-02-21T07:57:38.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.944+0000 7f6bbcc2c740 1 -- 172.21.15.100:0/1372466860 wait complete. 2024-02-21T07:57:38.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.944+0000 7f6bbcc2c740 20 client.7558 trim_cache size 0 max 16384 2024-02-21T07:57:38.946 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": { 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "2627c2f9-dfb2-4862-a0a8-d251dca8db53": { 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "path": "/", 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "tag": "2627c2f9-dfb2-4862-a0a8-d251dca8db53", 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: "options": "recursive,force" 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:57:38.947 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:57:38.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.946+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 msgr2=0x7f6b940a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.946+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 0x7f6b940a1660 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6ba003d000 tx=0x7f6ba0038000 comp rx=0 tx=0).stop 2024-02-21T07:57:38.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 msgr2=0x7f6bb4169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:38.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400e820 tx=0x7f6ba400ec20 comp rx=0 tx=0).stop 2024-02-21T07:57:38.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 shutdown_connections 2024-02-21T07:57:38.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bb408c520 0x7f6bb4170120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6b9409f1a0 0x7f6b940a1660 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.949+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bb4188360 0x7f6bb408bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.950+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1359526489 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b980047c0 0x7f6bb4169aa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:38.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.950+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 >> 172.21.15.100:0/1359526489 conn(0x7f6bb40cf400 msgr2=0x7f6bb40f6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:38.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.950+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 shutdown_connections 2024-02-21T07:57:38.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:57:38.952+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1359526489 wait complete. 2024-02-21T07:57:38.993 INFO:tasks.cephfs.filesystem:scrub status for tag:2627c2f9-dfb2-4862-a0a8-d251dca8db53 - {'path': '/', 'tag': '2627c2f9-dfb2-4862-a0a8-d251dca8db53', 'options': 'recursive,force'} 2024-02-21T07:57:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.476+0000 7f6917200640 1 Processor -- start 2024-02-21T07:57:40.479 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.477+0000 7f6917200640 1 -- start start 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6917200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f69180620b0 0x7f69181009d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6917200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f69180fd290 0x7f69180fd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6917200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918102020 con 0x7f69180615c0 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6917200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6918062510 con 0x7f69180620b0 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6917200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6918100f10 con 0x7f69180fd290 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6915e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f69180615c0 0x7f69180619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:42068/0 (socket says 172.21.15.100:42068) 2024-02-21T07:57:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.485+0000 7f6915e00640 1 -- 172.21.15.100:0/2055634900 learned_addr learned my addr 172.21.15.100:0/2055634900 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6915400640 1 --2- 172.21.15.100:0/2055634900 >> v2:172.21.15.156:3300/0 conn(0x7f69180620b0 0x7f69181009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071457938 0 0) 0x7f6918102020 con 0x7f69180615c0 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68fc003520 con 0x7f69180615c0 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6916800640 1 --2- 172.21.15.100:0/2055634900 >> v2:172.21.15.170:3300/0 conn(0x7f69180fd290 0x7f69180fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 564453541 0 0) 0x7f68fc003520 con 0x7f69180615c0 2024-02-21T07:57:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 >> v2:172.21.15.170:3300/0 conn(0x7f69180fd290 msgr2=0x7f69180fd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 --2- 172.21.15.100:0/2055634900 >> v2:172.21.15.170:3300/0 conn(0x7f69180fd290 0x7f69180fd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 >> v2:172.21.15.156:3300/0 conn(0x7f69180620b0 msgr2=0x7f69181009d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.486+0000 7f6914a00640 1 --2- 172.21.15.100:0/2055634900 >> v2:172.21.15.156:3300/0 conn(0x7f69180620b0 0x7f69181009d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918101130 con 0x7f69180615c0 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f69100019f0 con 0x7f69180615c0 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 >> v1:172.21.15.156:6789/0 conn(0x7f69180615c0 legacy=0x7f69180619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc003a40 0x7f68fc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68fc0047c0 0x7f68fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 0x7f68fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918062510 con 0x7f68fc003a40 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918100f10 con 0x7f68fc005180 2024-02-21T07:57:40.489 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00c080 con 0x7f68fc0047c0 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6916800640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 0x7f68fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6915400640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68fc0047c0 0x7f68fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.487+0000 7f6915e00640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc003a40 0x7f68fc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.488+0000 7f6916800640 1 -- 172.21.15.100:0/2055634900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68fc0047c0 msgr2=0x7f68fc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.488+0000 7f6916800640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68fc0047c0 0x7f68fc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.488+0000 7f6916800640 1 -- 172.21.15.100:0/2055634900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc003a40 msgr2=0x7f68fc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.488+0000 7f6916800640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc003a40 0x7f68fc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.490 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.488+0000 7f6916800640 1 -- 172.21.15.100:0/2055634900 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc003520 con 0x7f68fc005180 2024-02-21T07:57:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.489+0000 7f6916800640 1 -- 172.21.15.100:0/2055634900 reap_dead start 2024-02-21T07:57:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.490+0000 7f6916800640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 0x7f68fc00b980 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f690400ba30 tx=0x7f68fc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9072fca798891ea1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.491+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904004220 con 0x7f68fc005180 2024-02-21T07:57:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.491+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904004380 con 0x7f68fc005180 2024-02-21T07:57:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.491+0000 7f6914a00640 1 -- 172.21.15.100:0/2055634900 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904003850 con 0x7f68fc005180 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.492+0000 7f6917200640 1 -- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 msgr2=0x7f68fc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.492+0000 7f6917200640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 0x7f68fc00b980 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f690400ba30 tx=0x7f68fc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.493+0000 7f6917200640 1 -- 172.21.15.100:0/2055634900 shutdown_connections 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.493+0000 7f6917200640 1 --2- 172.21.15.100:0/2055634900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f68fc005180 0x7f68fc00b980 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.493+0000 7f6917200640 1 -- 172.21.15.100:0/2055634900 >> 172.21.15.100:0/2055634900 conn(0x7f69180fef30 msgr2=0x7f69180ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.493+0000 7f6917200640 1 -- 172.21.15.100:0/2055634900 shutdown_connections 2024-02-21T07:57:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.493+0000 7f6917200640 1 -- 172.21.15.100:0/2055634900 wait complete. 2024-02-21T07:57:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.497+0000 7f6917200640 1 Processor -- start 2024-02-21T07:57:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.498+0000 7f6917200640 1 -- start start 2024-02-21T07:57:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc005180 0x7f6918223790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69181631e0 0x7f691818bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918223cd0 con 0x7f68fc005180 2024-02-21T07:57:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69180d2510 con 0x7f6918162820 2024-02-21T07:57:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.500+0000 7f6917200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691818aca0 con 0x7f69181631e0 2024-02-21T07:57:40.502 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.501+0000 7f6916800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69181631e0 0x7f691818bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.501+0000 7f6915400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.501+0000 7f6915400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34884/0 (socket says 172.21.15.100:34884) 2024-02-21T07:57:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.501+0000 7f6915400640 1 -- 172.21.15.100:0/3445502902 learned_addr learned my addr 172.21.15.100:0/3445502902 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.502+0000 7f6915400640 1 -- 172.21.15.100:0/3445502902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69181631e0 msgr2=0x7f691818bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.502+0000 7f6915400640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69181631e0 0x7f691818bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.502+0000 7f6915400640 1 -- 172.21.15.100:0/3445502902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc005180 msgr2=0x7f6918223790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.502+0000 7f6915400640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc005180 0x7f6918223790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.502+0000 7f6915400640 1 -- 172.21.15.100:0/3445502902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691818af80 con 0x7f6918162820 2024-02-21T07:57:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.503+0000 7f6915400640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f69080118e0 tx=0x7f6908011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.504+0000 7f690e000640 1 -- 172.21.15.100:0/3445502902 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800faf0 con 0x7f6918162820 2024-02-21T07:57:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.504+0000 7f690e000640 1 -- 172.21.15.100:0/3445502902 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690800fc50 con 0x7f6918162820 2024-02-21T07:57:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.504+0000 7f690e000640 1 -- 172.21.15.100:0/3445502902 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908014440 con 0x7f6918162820 2024-02-21T07:57:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.504+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691818b260 con 0x7f6918162820 2024-02-21T07:57:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.504+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691818b820 con 0x7f6918162820 2024-02-21T07:57:40.509 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.508+0000 7f690e000640 1 -- 172.21.15.100:0/3445502902 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f69080145a0 con 0x7f6918162820 2024-02-21T07:57:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.510+0000 7f690e000640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 0x7f68f80a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.510+0000 7f690e000640 1 -- 172.21.15.100:0/3445502902 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f69080ca4d0 con 0x7f6918162820 2024-02-21T07:57:40.511 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.510+0000 7f6915e00640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 0x7f68f80a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.511+0000 7f691fffa740 1 Processor -- start 2024-02-21T07:57:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.511+0000 7f691fffa740 1 -- start start 2024-02-21T07:57:40.512 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.511+0000 7f6915e00640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 0x7f68f80a16b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f69100013d0 tx=0x7f6910001ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 0x5558a8792650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 0x5558a8797c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f6915e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 0x5558a8792650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a8753620 con 0x5558a87d3280 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a87058c0 con 0x5558a87981a0 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.513+0000 7f691fffa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a8702df0 con 0x5558a88076e0 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 0x5558a8792650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36834/0 (socket says 172.21.15.100:36834) 2024-02-21T07:57:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915e00640 1 -- 172.21.15.100:0/2237581749 learned_addr learned my addr 172.21.15.100:0/2237581749 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 0x5558a8797c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 -- 172.21.15.100:0/2237581749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 msgr2=0x5558a87d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 -- 172.21.15.100:0/2237581749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 msgr2=0x5558a8792650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 0x5558a8792650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.514+0000 7f6915400640 1 -- 172.21.15.100:0/2237581749 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558a867fb00 con 0x5558a88076e0 2024-02-21T07:57:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.515+0000 7f6915400640 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 0x5558a8797c60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f69080c7e40 tx=0x7f6908097a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b4cbeef2a1afe3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.516+0000 7f6902a00640 1 -- 172.21.15.100:0/2237581749 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690809c100 con 0x5558a88076e0 2024-02-21T07:57:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.516+0000 7f6902a00640 1 -- 172.21.15.100:0/2237581749 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69080a0750 con 0x5558a88076e0 2024-02-21T07:57:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.516+0000 7f6902a00640 1 -- 172.21.15.100:0/2237581749 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690809c100 con 0x5558a88076e0 2024-02-21T07:57:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.517+0000 7f691fffa740 1 -- 172.21.15.100:0/2237581749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 msgr2=0x5558a8797c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.517+0000 7f691fffa740 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 0x5558a8797c60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f69080c7e40 tx=0x7f6908097a20 comp rx=0 tx=0).stop 2024-02-21T07:57:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 -- 172.21.15.100:0/2237581749 shutdown_connections 2024-02-21T07:57:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a88076e0 0x5558a8797c60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 --2- 172.21.15.100:0/2237581749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87d3280 0x5558a8792650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 -- 172.21.15.100:0/2237581749 >> 172.21.15.100:0/2237581749 conn(0x5558a875f4b0 msgr2=0x5558a8796eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 -- 172.21.15.100:0/2237581749 shutdown_connections 2024-02-21T07:57:40.520 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.518+0000 7f691fffa740 1 -- 172.21.15.100:0/2237581749 wait complete. 2024-02-21T07:57:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.520+0000 7f691fffa740 1 -- start start 2024-02-21T07:57:40.521 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.520+0000 7f691fffa740 1 Processor -- start 2024-02-21T07:57:40.523 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 0x5558a87ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a87c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a86fe5d0 con 0x5558a88076e0 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a86a3b50 con 0x5558a87981a0 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a86a37f0 con 0x5558a87d3280 2024-02-21T07:57:40.524 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.522+0000 7f691fffa740 10 client.0 _ll_register_callbacks cb 0x5558a86b7550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.525 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:34916/0 (socket says 172.21.15.100:34916) 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915e00640 1 -- 172.21.15.100:0/363459853 learned_addr learned my addr 172.21.15.100:0/363459853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 0x5558a87ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 -- 172.21.15.100:0/363459853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 msgr2=0x5558a87c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 -- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 msgr2=0x5558a87c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a87c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.523+0000 7f6915400640 1 -- 172.21.15.100:0/363459853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691818b820 con 0x5558a87d3280 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.524+0000 7f6915400640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 0x5558a87ce870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f69080118b0 tx=0x7f69080ca000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725053d0261d67a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.524+0000 7f68f7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.524+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69080a04c0 con 0x5558a87d3280 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.524+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f69080c5070 con 0x5558a87d3280 2024-02-21T07:57:40.526 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.524+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558a86d0cd0 con 0x5558a87d3280 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f690809c100 con 0x5558a87d3280 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 10 client.7499 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5558a86fcc50 con 0x5558a87d3280 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558a86d0cd0 con 0x5558a87d3280 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f69080be070 con 0x5558a87d3280 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 10 client.7499 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 10 client.7499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 20 client.7499 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a88087a0 0x5558a87fb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 4 client.7499 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.525+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558a86f4ce0 con 0x5558a88087a0 2024-02-21T07:57:40.528 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.526+0000 7f6915e00640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a88087a0 0x5558a87fb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.527+0000 7f6915e00640 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a88087a0 0x5558a87fb410 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e889c83fbcd750 server_cookie=132c64f1427d17a1 in_seq=0 out_seq=0 2024-02-21T07:57:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.527+0000 7f68f7400640 10 client.7499 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:40.529 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f68f7400640 1 -- 172.21.15.100:0/363459853 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5558a86f4ce0 con 0x5558a88087a0 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f68f7400640 10 client.7499 handle_command_reply: tid=0 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 client.7499 shutdown 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 msgr2=0x5558a87ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 0x5558a87ce870 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f69080118b0 tx=0x7f69080ca000 comp rx=0 tx=0).stop 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 shutdown_connections 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a88087a0 0x5558a87fb410 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a87c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87d3280 0x5558a87ce870 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 --2- 172.21.15.100:0/363459853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.530 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.528+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 >> 172.21.15.100:0/363459853 conn(0x5558a875f4b0 msgr2=0x5558a8807b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.529+0000 7f68f7400640 0 client.7499 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.529+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 shutdown_connections 2024-02-21T07:57:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.529+0000 7f691fffa740 1 -- 172.21.15.100:0/363459853 wait complete. 2024-02-21T07:57:40.531 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.529+0000 7f691fffa740 20 client.7499 trim_cache size 0 max 16384 2024-02-21T07:57:40.565 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.561+0000 7f691fffa740 1 Processor -- start 2024-02-21T07:57:40.568 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.567+0000 7f691fffa740 1 -- start start 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a8808560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a8446e60 con 0x5558a88076e0 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a87fde10 con 0x5558a87981a0 2024-02-21T07:57:40.576 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.574+0000 7f691fffa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a8797330 con 0x5558a87f5150 2024-02-21T07:57:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.575+0000 7f6916800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.582 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.575+0000 7f6916800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:56848/0 (socket says 172.21.15.100:56848) 2024-02-21T07:57:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.575+0000 7f6916800640 1 -- 172.21.15.100:0/1616088626 learned_addr learned my addr 172.21.15.100:0/1616088626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 -- 172.21.15.100:0/1616088626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 msgr2=0x5558a87cd0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:57:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87cd0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 -- 172.21.15.100:0/1616088626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 msgr2=0x5558a8808560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.583 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a8808560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 -- 172.21.15.100:0/1616088626 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558a8699530 con 0x5558a87f5150 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.579+0000 7f6916800640 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f690400bb20 tx=0x7f69040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a1e722b015cb10 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.580+0000 7f6902000640 1 -- 172.21.15.100:0/1616088626 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690403f070 con 0x5558a87f5150 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.580+0000 7f6902000640 1 -- 172.21.15.100:0/1616088626 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904044420 con 0x5558a87f5150 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 -- 172.21.15.100:0/1616088626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 msgr2=0x5558a87cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f6902000640 1 -- 172.21.15.100:0/1616088626 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690403f070 con 0x5558a87f5150 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f690400bb20 tx=0x7f69040046c0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 -- 172.21.15.100:0/1616088626 shutdown_connections 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a87f5150 0x5558a87cefa0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a88076e0 0x5558a8808560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 --2- 172.21.15.100:0/1616088626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87981a0 0x5558a87cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.584 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.581+0000 7f691fffa740 1 -- 172.21.15.100:0/1616088626 >> 172.21.15.100:0/1616088626 conn(0x5558a875f4b0 msgr2=0x5558a879d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.588+0000 7f691fffa740 1 -- 172.21.15.100:0/1616088626 shutdown_connections 2024-02-21T07:57:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.588+0000 7f691fffa740 1 -- 172.21.15.100:0/1616088626 wait complete. 2024-02-21T07:57:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.590+0000 7f691fffa740 1 -- start start 2024-02-21T07:57:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.590+0000 7f691fffa740 1 Processor -- start 2024-02-21T07:57:40.598 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.596+0000 7f691fffa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f6915e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.599 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f6915e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36850/0 (socket says 172.21.15.100:36850) 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 0x5558a886eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 0x5558a87eda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a87c2a90 con 0x5558a87f5150 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a87934f0 con 0x5558a87fc980 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558a87cf290 con 0x5558a8828ac0 2024-02-21T07:57:40.600 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.598+0000 7f691fffa740 10 client.0 _ll_register_callbacks cb 0x7f69080941c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:57:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.599+0000 7f6915e00640 1 -- 172.21.15.100:0/3458261973 learned_addr learned my addr 172.21.15.100:0/3458261973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:57:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.599+0000 7f6916800640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 0x5558a87eda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.601 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.599+0000 7f6916800640 1 -- 172.21.15.100:0/3458261973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 msgr2=0x5558a886eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6915400640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 0x5558a886eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6916800640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 0x5558a886eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6916800640 1 -- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 msgr2=0x5558a881fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6916800640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6916800640 1 -- 172.21.15.100:0/3458261973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc003520 con 0x5558a8828ac0 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6915e00640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.600+0000 7f6915400640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 0x5558a886eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.601+0000 7f6916800640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 0x5558a87eda90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6904043000 tx=0x7f6904030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=accbc8ff3ac55525 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:57:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.601+0000 7f68f7400640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.602+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904030930 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.602+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6904030a90 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.602+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558a8723d30 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.603+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6904030c50 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.603+0000 7f691fffa740 10 client.7505 fetch_fsmap learned FSMap version 17 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.603+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5558a86bf2c0 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558a8723d30 con 0x5558a8828ac0 2024-02-21T07:57:40.606 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6904039400 con 0x5558a8828ac0 2024-02-21T07:57:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 10 client.7505 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T07:57:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 10 client.7505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:57:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 20 client.7505 populate_metadata read hostname 'smithi100' 2024-02-21T07:57:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a87fce30 0x5558a879d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:57:40.608 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 4 client.7505 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:57:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.604+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5558a83fe600 con 0x5558a87fce30 2024-02-21T07:57:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.605+0000 7f6915e00640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a87fce30 0x5558a879d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:57:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.606+0000 7f68f7400640 10 client.7505 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.608+0000 7f6915e00640 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a87fce30 0x5558a879d8f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb7dd26d752399e server_cookie=8beef82fbc16674f in_seq=0 out_seq=0 2024-02-21T07:57:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f68f7400640 1 -- 172.21.15.100:0/3458261973 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5558a83fe600 con 0x5558a87fce30 2024-02-21T07:57:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f68f7400640 10 client.7505 handle_command_reply: tid=0 2024-02-21T07:57:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 client.7505 shutdown 2024-02-21T07:57:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 msgr2=0x5558a87eda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 0x5558a87eda90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6904043000 tx=0x7f6904030000 comp rx=0 tx=0).stop 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 shutdown_connections 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5558a87fce30 0x5558a879d8f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558a8828ac0 0x5558a87eda90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5558a87fc980 0x5558a886eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f68f7400640 0 client.7505 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 --2- 172.21.15.100:0/3458261973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558a87f5150 0x5558a881fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 >> 172.21.15.100:0/3458261973 conn(0x5558a875f4b0 msgr2=0x5558a87978a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 shutdown_connections 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.634+0000 7f691fffa740 1 -- 172.21.15.100:0/3458261973 wait complete. 2024-02-21T07:57:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f691fffa740 20 client.7505 trim_cache size 0 max 16384 2024-02-21T07:57:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:{ 2024-02-21T07:57:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "message": "", 2024-02-21T07:57:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout: "return_code": 0 2024-02-21T07:57:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stdout:} 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 msgr2=0x7f68f80a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 0x7f68f80a16b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f69100013d0 tx=0x7f6910001ed0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 msgr2=0x7f6918162ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f69080118e0 tx=0x7f6908011da0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 shutdown_connections 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69181631e0 0x7f691818bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6918162820 0x7f6918162ca0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f68f809f1f0 0x7f68f80a16b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 --2- 172.21.15.100:0/3445502902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68fc005180 0x7f6918223790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.635+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 >> 172.21.15.100:0/3445502902 conn(0x7f69180fef30 msgr2=0x7f691817c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.636+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 shutdown_connections 2024-02-21T07:57:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi100.front.sepia.ceph.com.smithi100.stderr:2024-02-21T07:57:40.636+0000 7f6917200640 1 -- 172.21.15.100:0/3445502902 wait complete. 2024-02-21T07:57:41.556 INFO:tasks.workunit.client.0.smithi100.stdout:stopping iogen 2024-02-21T07:57:41.556 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'stopping iogen' 2024-02-21T07:57:41.556 INFO:tasks.workunit.client.0.smithi100.stderr:+ ./iogen -k 2024-02-21T07:57:41.560 INFO:tasks.workunit.client.0.smithi100.stdout:OK 2024-02-21T07:57:41.560 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo OK 2024-02-21T07:57:43.714 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-21T07:57:43.714 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-21T07:57:44.128 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-02-21T07:57:44.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-21T07:57:45.909 DEBUG:teuthology.parallel:result is None 2024-02-21T07:57:45.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-21T07:57:46.015 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-21T07:57:46.015 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-02-21T07:57:46.025 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:57:46.047 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-02-21T07:57:46.056 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-02-21T07:57:48.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:57:48.747 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:57:48.749 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:08.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:58:08.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:58:09.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.212+0000 7fe90e600640 1 Processor -- start 2024-02-21T07:58:09.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.212+0000 7fe90e600640 1 -- start start 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.214+0000 7fe90e600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe90806ab60 0x7fe9081871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.214+0000 7fe90e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080ca6a0 con 0x7fe90818a080 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.214+0000 7fe90e600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080f6200 con 0x7fe908189ca0 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.214+0000 7fe90e600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90818abe0 con 0x7fe90806ab60 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe907e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe90818a080 0x7fe90818a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55944/0 (socket says 172.21.15.100:55944) 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe8ffe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe90806ab60 0x7fe9081871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe907e00640 1 -- 172.21.15.100:0/2985929228 learned_addr learned my addr 172.21.15.100:0/2985929228 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322461748 0 0) 0x7fe9080ca6a0 con 0x7fe90818a080 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ec003520 con 0x7fe90818a080 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900466143 0 0) 0x7fe9080f6200 con 0x7fe908189ca0 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9080ca6a0 con 0x7fe908189ca0 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe8ffe00640 1 -- 172.21.15.100:0/2985929228 >> v1:172.21.15.170:6789/0 conn(0x7fe908189ca0 legacy=0x7fe9080cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe8ffe00640 1 -- 172.21.15.100:0/2985929228 >> v1:172.21.15.100:6789/0 conn(0x7fe90818a080 legacy=0x7fe90818a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.215+0000 7fe8ffe00640 1 -- 172.21.15.100:0/2985929228 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90806afc0 con 0x7fe90806ab60 2024-02-21T07:58:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.216+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/2985929228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe90806ab60 0x7fe9081871c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bed5bf528acaac5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.216+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0030610 con 0x7fe90806ab60 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.216+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0030770 con 0x7fe90806ab60 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.216+0000 7fe906a00640 1 -- 172.21.15.100:0/2985929228 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0030b00 con 0x7fe90806ab60 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 -- 172.21.15.100:0/2985929228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe90806ab60 msgr2=0x7fe9081871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 --2- 172.21.15.100:0/2985929228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe90806ab60 0x7fe9081871c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00097a0 tx=0x7fe8f002b960 comp rx=0 tx=0).stop 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 -- 172.21.15.100:0/2985929228 shutdown_connections 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 --2- 172.21.15.100:0/2985929228 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe90806ab60 0x7fe9081871c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 -- 172.21.15.100:0/2985929228 >> 172.21.15.100:0/2985929228 conn(0x7fe9080668b0 msgr2=0x7fe908066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 -- 172.21.15.100:0/2985929228 shutdown_connections 2024-02-21T07:58:09.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.217+0000 7fe90e600640 1 -- 172.21.15.100:0/2985929228 wait complete. 2024-02-21T07:58:09.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.219+0000 7fe90e600640 1 Processor -- start 2024-02-21T07:58:09.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.219+0000 7fe90e600640 1 -- start start 2024-02-21T07:58:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 0x7fe90816cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080f3dd0 con 0x7fe90818a080 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90821de20 con 0x7fe908189ca0 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.220+0000 7fe90e600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080f3530 con 0x7fe90806ab60 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33602/0 (socket says 172.21.15.100:33602) 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 -- 172.21.15.100:0/1250133526 learned_addr learned my addr 172.21.15.100:0/1250133526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35230/0 (socket says 172.21.15.100:35230) 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907400640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 0x7fe90816cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 -- 172.21.15.100:0/1250133526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 msgr2=0x7fe90816cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 0x7fe90816cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 -- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 msgr2=0x7fe9080f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907e00640 1 -- 172.21.15.100:0/1250133526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009400 con 0x7fe90818a080 2024-02-21T07:58:09.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.221+0000 7fe907400640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 0x7fe90816cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe907e00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe90000caa0 tx=0x7fe90000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe8ff400640 1 -- 172.21.15.100:0/1250133526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000ac00 con 0x7fe90818a080 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe8ff400640 1 -- 172.21.15.100:0/1250133526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000ad80 con 0x7fe90818a080 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe8ff400640 1 -- 172.21.15.100:0/1250133526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900012640 con 0x7fe90818a080 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080f3810 con 0x7fe90818a080 2024-02-21T07:58:09.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.222+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90821e0c0 con 0x7fe90818a080 2024-02-21T07:58:09.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.225+0000 7fe8ff400640 1 -- 172.21.15.100:0/1250133526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe900007070 con 0x7fe90818a080 2024-02-21T07:58:09.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.226+0000 7fe9113b9740 1 Processor -- start 2024-02-21T07:58:09.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.226+0000 7fe9113b9740 1 -- start start 2024-02-21T07:58:09.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.227+0000 7fe8ff400640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 0x7fe8e40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.227+0000 7fe8ff400640 1 -- 172.21.15.100:0/1250133526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9000c9b20 con 0x7fe90818a080 2024-02-21T07:58:09.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.227+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 0x7fe8e40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c745a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c745a8e0 0x5613c741cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7391150 con 0x5613c748ff80 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c738e680 con 0x5613c745a8e0 2024-02-21T07:58:09.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe9113b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7389e60 con 0x5613c7459fc0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:47364/0 (socket says 172.21.15.100:47364) 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 -- 172.21.15.100:0/1988688804 learned_addr learned my addr 172.21.15.100:0/1988688804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 0x7fe8e40a1560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0036000 tx=0x7fe8f0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c745a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907e00640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c745a8e0 0x5613c741cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 -- 172.21.15.100:0/1988688804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c745a8e0 msgr2=0x5613c741cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c745a8e0 0x5613c741cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 -- 172.21.15.100:0/1988688804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 msgr2=0x5613c745a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c745a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 -- 172.21.15.100:0/1988688804 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c7343060 con 0x5613c7459fc0 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c745a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:09.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.228+0000 7fe907400640 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001b20 tx=0x7fe8f8007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5421c51999c9ac3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.229+0000 7fe8f7e00640 1 -- 172.21.15.100:0/1988688804 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8001d30 con 0x5613c7459fc0 2024-02-21T07:58:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.229+0000 7fe8f7e00640 1 -- 172.21.15.100:0/1988688804 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800fe50 con 0x5613c7459fc0 2024-02-21T07:58:09.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.229+0000 7fe8f7e00640 1 -- 172.21.15.100:0/1988688804 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80052d0 con 0x5613c7459fc0 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.229+0000 7fe9113b9740 1 -- 172.21.15.100:0/1988688804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 msgr2=0x5613c748fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.229+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001b20 tx=0x7fe8f8007d20 comp rx=0 tx=0).stop 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 -- 172.21.15.100:0/1988688804 shutdown_connections 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c745a8e0 0x5613c741cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c745a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1988688804 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c7459fc0 0x5613c748fa40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 -- 172.21.15.100:0/1988688804 >> 172.21.15.100:0/1988688804 conn(0x5613c73e95a0 msgr2=0x5613c7420eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 -- 172.21.15.100:0/1988688804 shutdown_connections 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 -- 172.21.15.100:0/1988688804 wait complete. 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.230+0000 7fe9113b9740 1 -- start start 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.231+0000 7fe9113b9740 1 Processor -- start 2024-02-21T07:58:09.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c74a22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c7457f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c732eec0 con 0x5613c748ff80 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c732eb60 con 0x5613c7459fc0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c70f81c0 con 0x5613c745a8e0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe9113b9740 10 client.0 _ll_register_callbacks cb 0x5613c7342960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe907e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe907400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c74a22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c7457f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe907e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33628/0 (socket says 172.21.15.100:33628) 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.232+0000 7fe907e00640 1 -- 172.21.15.100:0/2832855742 learned_addr learned my addr 172.21.15.100:0/2832855742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 -- 172.21.15.100:0/2832855742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 msgr2=0x5613c7457f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c7457f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 -- 172.21.15.100:0/2832855742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 msgr2=0x5613c74a22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c74a22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 -- 172.21.15.100:0/2832855742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9080ca6a0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe907e00640 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe90000cfd0 tx=0x7fe900097770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50579f338fccb865 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe8f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90009fb10 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9000af1f0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613c70897e0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9000b6070 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe9113b9740 10 client.7401 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5613c73884e0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.233+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613c70897e0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe9000b61d0 con 0x5613c748ff80 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 10 client.7401 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:09.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 10 client.7401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 20 client.7401 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c74586c0 0x5613c741be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 4 client.7401 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613c70c6720 con 0x5613c74586c0 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.234+0000 7fe907400640 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c74586c0 0x5613c741be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe8f4c00640 10 client.7401 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:09.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe907400640 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c74586c0 0x5613c741be10 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cff74188a40530c4 server_cookie=a283adfa5c19ec27 in_seq=0 out_seq=0 2024-02-21T07:58:09.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe8f4c00640 1 -- 172.21.15.100:0/2832855742 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5613c70c6720 con 0x5613c74586c0 2024-02-21T07:58:09.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe8f4c00640 10 client.7401 handle_command_reply: tid=0 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 client.7401 shutdown 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 msgr2=0x5613c74a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe90000cfd0 tx=0x7fe900097770 comp rx=0 tx=0).stop 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 shutdown_connections 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c74586c0 0x5613c741be10 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.235+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c748ff80 0x5613c74a1840 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c7457f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 1 --2- 172.21.15.100:0/2832855742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c74a22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 >> 172.21.15.100:0/2832855742 conn(0x5613c73e95a0 msgr2=0x5613c748f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe8f4c00640 0 client.7401 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 shutdown_connections 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 1 -- 172.21.15.100:0/2832855742 wait complete. 2024-02-21T07:58:09.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.236+0000 7fe9113b9740 20 client.7401 trim_cache size 0 max 16384 2024-02-21T07:58:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.251+0000 7fe9113b9740 1 Processor -- start 2024-02-21T07:58:09.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.252+0000 7fe9113b9740 1 -- start start 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c741fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c748ff80 0x5613c7417ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7458440 con 0x5613c7459fc0 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7457f50 con 0x5613c748ff80 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe9113b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7463540 con 0x5613c745a8e0 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33644/0 (socket says 172.21.15.100:33644) 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 -- 172.21.15.100:0/3004638770 learned_addr learned my addr 172.21.15.100:0/3004638770 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c741fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907e00640 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c748ff80 0x5613c7417ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 -- 172.21.15.100:0/3004638770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 msgr2=0x5613c741fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c741fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 -- 172.21.15.100:0/3004638770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c748ff80 msgr2=0x5613c7417ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c748ff80 0x5613c7417ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.253+0000 7fe907400640 1 -- 172.21.15.100:0/3004638770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613c7324950 con 0x5613c7459fc0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe907400640 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001eb0 tx=0x7fe8f800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d7eee8a3b01ab7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe8f7400640 1 -- 172.21.15.100:0/3004638770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8023040 con 0x5613c7459fc0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe8f7400640 1 -- 172.21.15.100:0/3004638770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f8024040 con 0x5613c7459fc0 2024-02-21T07:58:09.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe8f7400640 1 -- 172.21.15.100:0/3004638770 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80017d0 con 0x5613c7459fc0 2024-02-21T07:58:09.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe9113b9740 1 -- 172.21.15.100:0/3004638770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 msgr2=0x5613c74897e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.254+0000 7fe9113b9740 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8001eb0 tx=0x7fe8f800a000 comp rx=0 tx=0).stop 2024-02-21T07:58:09.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 -- 172.21.15.100:0/3004638770 shutdown_connections 2024-02-21T07:58:09.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c748ff80 0x5613c7417ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c745a8e0 0x5613c741fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 --2- 172.21.15.100:0/3004638770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c7459fc0 0x5613c74897e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 -- 172.21.15.100:0/3004638770 >> 172.21.15.100:0/3004638770 conn(0x5613c73e95a0 msgr2=0x5613c74586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 -- 172.21.15.100:0/3004638770 shutdown_connections 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 -- 172.21.15.100:0/3004638770 wait complete. 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.255+0000 7fe9113b9740 1 -- start start 2024-02-21T07:58:09.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.256+0000 7fe9113b9740 1 Processor -- start 2024-02-21T07:58:09.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c7486b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c748ff80 0x5613c745d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c7505dc0 con 0x5613c745a8e0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c74608d0 con 0x5613c7459fc0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613c74b2cb0 con 0x5613c748ff80 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe9113b9740 10 client.0 _ll_register_callbacks cb 0x7fe9000971f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe907400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c7486b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33650/0 (socket says 172.21.15.100:33650) 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe8ffe00640 1 -- 172.21.15.100:0/1280546821 learned_addr learned my addr 172.21.15.100:0/1280546821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.257+0000 7fe907e00640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c748ff80 0x5613c745d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 -- 172.21.15.100:0/1280546821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c748ff80 msgr2=0x5613c745d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c748ff80 0x5613c745d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 -- 172.21.15.100:0/1280546821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 msgr2=0x5613c7486b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c7486b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 -- 172.21.15.100:0/1280546821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613c7343060 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe907400640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c7486b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8ffe00640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00098c0 tx=0x7fe8f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df13a21987ca162 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f003e040 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe8f0054450 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe8f800fe50 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8f0054610 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe9113b9740 10 client.7407 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.258+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5613c734a430 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800fe50 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe8f0052070 con 0x5613c745a8e0 2024-02-21T07:58:09.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 10 client.7407 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 10 client.7407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 20 client.7407 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c741c3b0 0x5613c741dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 4 client.7407 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5613c7115890 con 0x5613c741c3b0 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.259+0000 7fe907400640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c741c3b0 0x5613c741dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe907400640 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c741c3b0 0x5613c741dfe0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68054553c4017794 server_cookie=c47200cb1f5f75ac in_seq=0 out_seq=0 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe8f4c00640 10 client.7407 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe8f4c00640 1 -- 172.21.15.100:0/1280546821 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5613c7115890 con 0x5613c741c3b0 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe8f4c00640 10 client.7407 handle_command_reply: tid=0 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 client.7407 shutdown 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 msgr2=0x5613c749ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00098c0 tx=0x7fe8f0004730 comp rx=0 tx=0).stop 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 shutdown_connections 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x5613c741c3b0 0x5613c741dfe0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5613c748ff80 0x5613c745d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5613c745a8e0 0x5613c749ea10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 --2- 172.21.15.100:0/1280546821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613c7459fc0 0x5613c7486b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe8f4c00640 0 client.7407 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 >> 172.21.15.100:0/1280546821 conn(0x5613c73e95a0 msgr2=0x5613c741ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 shutdown_connections 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 1 -- 172.21.15.100:0/1280546821 wait complete. 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.260+0000 7fe9113b9740 20 client.7407 trim_cache size 0 max 16384 2024-02-21T07:58:09.266 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "status": "no active scrubs running", 2024-02-21T07:58:09.267 INFO:teuthology.orchestra.run.smithi100.stdout: "scrubs": {} 2024-02-21T07:58:09.267 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 msgr2=0x7fe8e40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 0x7fe8e40a1560 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0036000 tx=0x7fe8f0008030 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 msgr2=0x7fe9080f2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe90000caa0 tx=0x7fe90000cf60 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 shutdown_connections 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe8e409f0a0 0x7fe8e40a1560 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe90818a080 0x7fe9080f2e80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe908189ca0 0x7fe9080f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 --2- 172.21.15.100:0/1250133526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe90806ab60 0x7fe90816cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 >> 172.21.15.100:0/1250133526 conn(0x7fe9080668b0 msgr2=0x7fe90817e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 shutdown_connections 2024-02-21T07:58:09.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.261+0000 7fe90e600640 1 -- 172.21.15.100:0/1250133526 wait complete. 2024-02-21T07:58:09.278 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:58:09.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:58:09.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.465+0000 7f637ca00640 1 Processor -- start 2024-02-21T07:58:09.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.465+0000 7f637ca00640 1 -- start start 2024-02-21T07:58:09.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f637817c040 0x7f63780706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6378070f30 0x7f63780713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6378188c00 0x7f6378189090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780f4ec0 con 0x7f637817c040 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780f6450 con 0x7f6378070f30 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f637ca00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63780f50d0 con 0x7f6378188c00 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.467+0000 7f6375e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f637817c040 0x7f63780706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f637817c040 0x7f63780706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33652/0 (socket says 172.21.15.100:33652) 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 -- 172.21.15.100:0/49451025 learned_addr learned my addr 172.21.15.100:0/49451025 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f636fe00640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.156:3300/0 conn(0x7f6378070f30 0x7f63780713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6376800640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.170:3300/0 conn(0x7f6378188c00 0x7f6378189090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 -- 172.21.15.100:0/49451025 >> v2:172.21.15.170:3300/0 conn(0x7f6378188c00 msgr2=0x7f6378189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.170:3300/0 conn(0x7f6378188c00 0x7f6378189090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 -- 172.21.15.100:0/49451025 >> v2:172.21.15.156:3300/0 conn(0x7f6378070f30 msgr2=0x7f63780713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.156:3300/0 conn(0x7f6378070f30 0x7f63780713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.468+0000 7f6375e00640 1 -- 172.21.15.100:0/49451025 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780f53b0 con 0x7f637817c040 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.469+0000 7f6375e00640 1 --2- 172.21.15.100:0/49451025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637817c040 0x7f63780706b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f637808e620 tx=0x7f636802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac6efe34a458f0a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.469+0000 7f6375400640 1 -- 172.21.15.100:0/49451025 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368030860 con 0x7f637817c040 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.469+0000 7f6375400640 1 -- 172.21.15.100:0/49451025 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63680309c0 con 0x7f637817c040 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.469+0000 7f6375400640 1 -- 172.21.15.100:0/49451025 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368030d50 con 0x7f637817c040 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 -- 172.21.15.100:0/49451025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637817c040 msgr2=0x7f63780706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 --2- 172.21.15.100:0/49451025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637817c040 0x7f63780706b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f637808e620 tx=0x7f636802b9a0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 -- 172.21.15.100:0/49451025 shutdown_connections 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.170:3300/0 conn(0x7f6378188c00 0x7f6378189090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 --2- 172.21.15.100:0/49451025 >> v2:172.21.15.156:3300/0 conn(0x7f6378070f30 0x7f63780713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 --2- 172.21.15.100:0/49451025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637817c040 0x7f63780706b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 -- 172.21.15.100:0/49451025 >> 172.21.15.100:0/49451025 conn(0x7f63780ce160 msgr2=0x7f63780ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 -- 172.21.15.100:0/49451025 shutdown_connections 2024-02-21T07:58:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.470+0000 7f637ca00640 1 -- 172.21.15.100:0/49451025 wait complete. 2024-02-21T07:58:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.472+0000 7f637ca00640 1 Processor -- start 2024-02-21T07:58:09.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.472+0000 7f637ca00640 1 -- start start 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.473+0000 7f637ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.473+0000 7f637ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.473+0000 7f637ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6378188c00 0x7f63781642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f637ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378167be0 con 0x7f6378070f30 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f637ca00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378166580 con 0x7f637817c040 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f637ca00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6378166860 con 0x7f6378188c00 2024-02-21T07:58:09.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f6375e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:35278/0 (socket says 172.21.15.100:35278) 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 -- 172.21.15.100:0/2255880104 learned_addr learned my addr 172.21.15.100:0/2255880104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f6375e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33662/0 (socket says 172.21.15.100:33662) 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f6376800640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6378188c00 0x7f63781642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 -- 172.21.15.100:0/2255880104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6378188c00 msgr2=0x7f63781642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6378188c00 0x7f63781642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 -- 172.21.15.100:0/2255880104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 msgr2=0x7f63780cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f636fe00640 1 -- 172.21.15.100:0/2255880104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63680094d0 con 0x7f637817c040 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.474+0000 7f6375e00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f636fe00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f636000e890 tx=0x7f636000ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000c940 con 0x7f637817c040 2024-02-21T07:58:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000caa0 con 0x7f637817c040 2024-02-21T07:58:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000ce30 con 0x7f637817c040 2024-02-21T07:58:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6378166b40 con 0x7f637817c040 2024-02-21T07:58:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.475+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6378167100 con 0x7f637817c040 2024-02-21T07:58:09.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.476+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6378067c80 con 0x7f637817c040 2024-02-21T07:58:09.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.478+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6360013470 con 0x7f637817c040 2024-02-21T07:58:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.480+0000 7f636e000640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 0x7f63540a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.480+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63600ca490 con 0x7f637817c040 2024-02-21T07:58:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.480+0000 7f6375e00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 0x7f63540a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.481+0000 7f6375e00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 0x7f63540a15e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6368036000 tx=0x7f6368008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.482+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f63600942c0 con 0x7f637817c040 2024-02-21T07:58:09.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.700+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63780ed570 con 0x7f637817c040 2024-02-21T07:58:09.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.702+0000 7f636e000640 1 -- 172.21.15.100:0/2255880104 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11340 (secure 0 0 0) 0x7f6360017090 con 0x7f637817c040 2024-02-21T07:58:09.704 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:09.704 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:57:46.332710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:58:09.705 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-02-21T07:58:09.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 msgr2=0x7f63540a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 0x7f63540a15e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6368036000 tx=0x7f6368008030 comp rx=0 tx=0).stop 2024-02-21T07:58:09.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 msgr2=0x7f6378163d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f636000e890 tx=0x7f636000ed50 comp rx=0 tx=0).stop 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 shutdown_connections 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6378188c00 0x7f63781642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f637817c040 0x7f6378163d90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f635409f120 0x7f63540a15e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 --2- 172.21.15.100:0/2255880104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6378070f30 0x7f63780cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.704+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 >> 172.21.15.100:0/2255880104 conn(0x7f63780ce160 msgr2=0x7f637806f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.705+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 shutdown_connections 2024-02-21T07:58:09.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.705+0000 7f637ca00640 1 -- 172.21.15.100:0/2255880104 wait complete. 2024-02-21T07:58:09.725 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:58:09.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:58:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.932+0000 7fa896800640 1 Processor -- start 2024-02-21T07:58:09.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.932+0000 7fa896800640 1 -- start start 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa890186280 0x7fa890189dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa890070a70 0x7fa89018a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa89018a850 0x7fa89018be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900f5580 con 0x7fa890070a70 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900f5860 con 0x7fa890186280 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa896800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8900f5b40 con 0x7fa89018a850 2024-02-21T07:58:09.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa886a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa890070a70 0x7fa89018a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa886a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa890070a70 0x7fa89018a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47766/0 (socket says 172.21.15.100:47766) 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa886a00640 1 -- 172.21.15.100:0/3690812391 learned_addr learned my addr 172.21.15.100:0/3690812391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa88f400640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.156:3300/0 conn(0x7fa890186280 0x7fa890189dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.934+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.170:3300/0 conn(0x7fa89018a850 0x7fa89018be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.935+0000 7fa886a00640 1 -- 172.21.15.100:0/3690812391 >> v2:172.21.15.170:3300/0 conn(0x7fa89018a850 msgr2=0x7fa89018be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.935+0000 7fa886a00640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.170:3300/0 conn(0x7fa89018a850 0x7fa89018be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.935+0000 7fa886a00640 1 -- 172.21.15.100:0/3690812391 >> v2:172.21.15.156:3300/0 conn(0x7fa890186280 msgr2=0x7fa890189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.935+0000 7fa886a00640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.156:3300/0 conn(0x7fa890186280 0x7fa890189dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.935+0000 7fa886a00640 1 -- 172.21.15.100:0/3690812391 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900f5e20 con 0x7fa890070a70 2024-02-21T07:58:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.936+0000 7fa886a00640 1 --2- 172.21.15.100:0/3690812391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa89018a310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa890074b10 tx=0x7fa87802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe32b064eaee8313 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.936+0000 7fa88ea00640 1 -- 172.21.15.100:0/3690812391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878031890 con 0x7fa890070a70 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.936+0000 7fa88ea00640 1 -- 172.21.15.100:0/3690812391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780319f0 con 0x7fa890070a70 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.936+0000 7fa88ea00640 1 -- 172.21.15.100:0/3690812391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878031d80 con 0x7fa890070a70 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 -- 172.21.15.100:0/3690812391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 msgr2=0x7fa89018a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 --2- 172.21.15.100:0/3690812391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa89018a310 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa890074b10 tx=0x7fa87802b930 comp rx=0 tx=0).stop 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 -- 172.21.15.100:0/3690812391 shutdown_connections 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.170:3300/0 conn(0x7fa89018a850 0x7fa89018be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 --2- 172.21.15.100:0/3690812391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa89018a310 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 --2- 172.21.15.100:0/3690812391 >> v2:172.21.15.156:3300/0 conn(0x7fa890186280 0x7fa890189dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 -- 172.21.15.100:0/3690812391 >> 172.21.15.100:0/3690812391 conn(0x7fa8900668b0 msgr2=0x7fa890066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 -- 172.21.15.100:0/3690812391 shutdown_connections 2024-02-21T07:58:09.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.937+0000 7fa896800640 1 -- 172.21.15.100:0/3690812391 wait complete. 2024-02-21T07:58:09.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.940+0000 7fa896800640 1 Processor -- start 2024-02-21T07:58:09.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.940+0000 7fa896800640 1 -- start start 2024-02-21T07:58:09.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa890186280 0x7fa89016f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89018a850 0x7fa89021ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900f9000 con 0x7fa890070a70 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900f80a0 con 0x7fa89018a850 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa896800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900f8380 con 0x7fa890186280 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47778/0 (socket says 172.21.15.100:47778) 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 -- 172.21.15.100:0/3808112994 learned_addr learned my addr 172.21.15.100:0/3808112994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa886a00640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa890186280 0x7fa89016f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89018a850 0x7fa89021ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 -- 172.21.15.100:0/3808112994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa890186280 msgr2=0x7fa89016f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa890186280 0x7fa89016f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 -- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89018a850 msgr2=0x7fa89021ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89018a850 0x7fa89021ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.942+0000 7fa88f400640 1 -- 172.21.15.100:0/3808112994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094d0 con 0x7fa890070a70 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa88f400640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa88000e890 tx=0x7fa88000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa887e00640 1 -- 172.21.15.100:0/3808112994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000c940 con 0x7fa890070a70 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa887e00640 1 -- 172.21.15.100:0/3808112994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000caa0 con 0x7fa890070a70 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa887e00640 1 -- 172.21.15.100:0/3808112994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000ce30 con 0x7fa890070a70 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900f8660 con 0x7fa890070a70 2024-02-21T07:58:09.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.943+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900f8c20 con 0x7fa890070a70 2024-02-21T07:58:09.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.948+0000 7fa887e00640 1 -- 172.21.15.100:0/3808112994 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa880013470 con 0x7fa890070a70 2024-02-21T07:58:09.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.948+0000 7fa8995b2740 1 Processor -- start 2024-02-21T07:58:09.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.948+0000 7fa8995b2740 1 -- start start 2024-02-21T07:58:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.949+0000 7fa887e00640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 0x7fa86c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.949+0000 7fa887e00640 1 -- 172.21.15.100:0/3808112994 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa8800c9e00 con 0x7fa890070a70 2024-02-21T07:58:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.949+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 0x7fa86c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 0x564a5f2ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2f5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2f6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f1ed210 con 0x564a5f2f5590 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f1ea740 con 0x564a5f2ba7e0 2024-02-21T07:58:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa8995b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f1e5f20 con 0x564a5f2b9ec0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 0x7fa86c0a1560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8880073f0 tx=0x7fa88800b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 0x564a5f2ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa886a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47786/0 (socket says 172.21.15.100:47786) 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88fe00640 1 -- 172.21.15.100:0/3568712152 learned_addr learned my addr 172.21.15.100:0/3568712152 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88f400640 1 -- 172.21.15.100:0/3568712152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 msgr2=0x564a5f2f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88f400640 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88f400640 1 -- 172.21.15.100:0/3568712152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 msgr2=0x564a5f2f6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.950+0000 7fa88f400640 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2f6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.951+0000 7fa88f400640 1 -- 172.21.15.100:0/3568712152 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a5f1a7df0 con 0x564a5f2b9ec0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.951+0000 7fa88f400640 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 0x564a5f2ba2a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa8800c7770 tx=0x7fa880095a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=449dd5c89a06b270 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.951+0000 7fa87fe00640 1 -- 172.21.15.100:0/3568712152 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88009ba30 con 0x564a5f2b9ec0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.951+0000 7fa87fe00640 1 -- 172.21.15.100:0/3568712152 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800b6040 con 0x564a5f2b9ec0 2024-02-21T07:58:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.951+0000 7fa87fe00640 1 -- 172.21.15.100:0/3568712152 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8800a0080 con 0x564a5f2b9ec0 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 -- 172.21.15.100:0/3568712152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 msgr2=0x564a5f2ba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 0x564a5f2ba2a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa8800c7770 tx=0x7fa880095a20 comp rx=0 tx=0).stop 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 -- 172.21.15.100:0/3568712152 shutdown_connections 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2f6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3568712152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b9ec0 0x564a5f2ba2a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 -- 172.21.15.100:0/3568712152 >> 172.21.15.100:0/3568712152 conn(0x564a5f27c490 msgr2=0x564a5f27d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 -- 172.21.15.100:0/3568712152 shutdown_connections 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.952+0000 7fa8995b2740 1 -- 172.21.15.100:0/3568712152 wait complete. 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.953+0000 7fa8995b2740 1 -- start start 2024-02-21T07:58:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.953+0000 7fa8995b2740 1 Processor -- start 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 0x564a5f279240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f18b150 con 0x564a5f2f5590 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f18adf0 con 0x564a5f2ba7e0 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5ef541c0 con 0x564a5f2b07d0 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa8995b2740 10 client.0 _ll_register_callbacks cb 0x564a5f1da2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.954+0000 7fa886a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 0x564a5f279240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa886a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47798/0 (socket says 172.21.15.100:47798) 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa886a00640 1 -- 172.21.15.100:0/2456835409 learned_addr learned my addr 172.21.15.100:0/2456835409 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 -- 172.21.15.100:0/2456835409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 msgr2=0x564a5f2aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 -- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 msgr2=0x564a5f2a7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 -- 172.21.15.100:0/2456835409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8900f8c20 con 0x564a5f2b07d0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa886a00640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa88fe00640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 0x564a5f279240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa888009ea0 tx=0x7fa888004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60bf27c1489aec45 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.955+0000 7fa87cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888016450 con 0x564a5f2b07d0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a5eee57e0 con 0x564a5f2b07d0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa888023440 con 0x564a5f2b07d0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa888023650 con 0x564a5f2b07d0 2024-02-21T07:58:09.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 10 client.7541 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564a5f1e45a0 con 0x564a5f2b07d0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564a5eee57e0 con 0x564a5f2b07d0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa888014070 con 0x564a5f2b07d0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 10 client.7541 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 10 client.7541 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 20 client.7541 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f2aff60 0x564a5f301c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 4 client.7541 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.956+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a5ef22720 con 0x564a5f2aff60 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.957+0000 7fa88f400640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f2aff60 0x564a5f301c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.957+0000 7fa88f400640 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f2aff60 0x564a5f301c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b22aaa4d55882a7 server_cookie=411b174f2ec37337 in_seq=0 out_seq=0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.957+0000 7fa87cc00640 10 client.7541 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa87cc00640 1 -- 172.21.15.100:0/2456835409 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a5ef22720 con 0x564a5f2aff60 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa87cc00640 10 client.7541 handle_command_reply: tid=0 2024-02-21T07:58:09.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 client.7541 shutdown 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 msgr2=0x564a5f279240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 0x564a5f279240 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa888009ea0 tx=0x7fa888004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 shutdown_connections 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f2aff60 0x564a5f301c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2b07d0 0x564a5f279240 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f2a7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 --2- 172.21.15.100:0/2456835409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2ba7e0 0x564a5f2aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 >> 172.21.15.100:0/2456835409 conn(0x564a5f2b9ec0 msgr2=0x564a5f27df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa87cc00640 0 client.7541 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 shutdown_connections 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 1 -- 172.21.15.100:0/2456835409 wait complete. 2024-02-21T07:58:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.958+0000 7fa8995b2740 20 client.7541 trim_cache size 0 max 16384 2024-02-21T07:58:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.971+0000 7fa8995b2740 1 Processor -- start 2024-02-21T07:58:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.971+0000 7fa8995b2740 1 -- start start 2024-02-21T07:58:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f27d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f2b0670 con 0x564a5f2f5590 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f2f4030 con 0x564a5f2b07d0 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa8995b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f27c110 con 0x564a5f2ba7e0 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.972+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47806/0 (socket says 172.21.15.100:47806) 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 -- 172.21.15.100:0/3239208469 learned_addr learned my addr 172.21.15.100:0/3239208469 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa886a00640 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f27d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 -- 172.21.15.100:0/3239208469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 msgr2=0x564a5f27d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f27d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 -- 172.21.15.100:0/3239208469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 msgr2=0x564a5f27a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 -- 172.21.15.100:0/3239208469 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a5f180ab0 con 0x564a5f2f5590 2024-02-21T07:58:09.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa88fe00640 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa888004ab0 tx=0x7fa888022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f78ac1078f237c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa87f400640 1 -- 172.21.15.100:0/3239208469 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888017c60 con 0x564a5f2f5590 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa87f400640 1 -- 172.21.15.100:0/3239208469 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88800f050 con 0x564a5f2f5590 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.973+0000 7fa87f400640 1 -- 172.21.15.100:0/3239208469 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa888023800 con 0x564a5f2f5590 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 -- 172.21.15.100:0/3239208469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 msgr2=0x564a5f34fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa888004ab0 tx=0x7fa888022000 comp rx=0 tx=0).stop 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 -- 172.21.15.100:0/3239208469 shutdown_connections 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34fbc0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f27d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 --2- 172.21.15.100:0/3239208469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 -- 172.21.15.100:0/3239208469 >> 172.21.15.100:0/3239208469 conn(0x564a5f2b9ec0 msgr2=0x564a5f2a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 -- 172.21.15.100:0/3239208469 shutdown_connections 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.974+0000 7fa8995b2740 1 -- 172.21.15.100:0/3239208469 wait complete. 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.975+0000 7fa8995b2740 1 -- start start 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.975+0000 7fa8995b2740 1 Processor -- start 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f2b3060 con 0x564a5f2f5590 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f2aca50 con 0x564a5f2b07d0 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a5f2bcf40 con 0x564a5f2ba7e0 2024-02-21T07:58:09.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa8995b2740 10 client.0 _ll_register_callbacks cb 0x7fa8800046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.976+0000 7fa886a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa88fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50218/0 (socket says 172.21.15.100:50218) 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 -- 172.21.15.100:0/1211109393 learned_addr learned my addr 172.21.15.100:0/1211109393 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa88f400640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 -- 172.21.15.100:0/1211109393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 msgr2=0x564a5f27a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 -- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 msgr2=0x564a5f34f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 -- 172.21.15.100:0/1211109393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a5f1e45a0 con 0x564a5f2ba7e0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa886a00640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa8900679b0 tx=0x7fa878004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d00fe4f646e9e12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.977+0000 7fa87cc00640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87803ac50 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8800b6040 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa87803f040 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa87803adb0 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 10 client.7547 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x564a5f1a6650 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8800b6040 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa878044460 con 0x564a5f2ba7e0 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 10 client.7547 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 10 client.7547 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T07:58:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 20 client.7547 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f30e0f0 0x564a5f2ea940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 4 client.7547 mds_command: new command op to 4349 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.978+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 --> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564a5ef71890 con 0x564a5f30e0f0 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa88f400640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f30e0f0 0x564a5f2ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa88f400640 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f30e0f0 0x564a5f2ea940 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38d99856c7db4bc3 server_cookie=1fb9edcb506e4185 in_seq=0 out_seq=0 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa87cc00640 10 client.7547 ms_handle_connect on v2:172.21.15.100:6834/224612086 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa87cc00640 1 -- 172.21.15.100:0/1211109393 <== mds.2 v2:172.21.15.100:6834/224612086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564a5ef71890 con 0x564a5f30e0f0 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa87cc00640 10 client.7547 handle_command_reply: tid=0 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa8995b2740 1 client.7547 shutdown 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 msgr2=0x564a5f2ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.979+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa8900679b0 tx=0x7fa878004730 comp rx=0 tx=0).stop 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 shutdown_connections 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:6834/224612086,v1:172.21.15.100:6835/224612086] conn(0x564a5f30e0f0 0x564a5f2ea940 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564a5f2f5590 0x564a5f34f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x564a5f2ba7e0 0x564a5f2ad730 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 --2- 172.21.15.100:0/1211109393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564a5f2b07d0 0x564a5f27a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa87cc00640 0 client.7547 ms_handle_reset on v2:172.21.15.100:6834/224612086 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 >> 172.21.15.100:0/1211109393 conn(0x564a5f2b9ec0 msgr2=0x564a5f27d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 shutdown_connections 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 1 -- 172.21.15.100:0/1211109393 wait complete. 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa8995b2740 20 client.7547 trim_cache size 0 max 16384 2024-02-21T07:58:09.988 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:58:09.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 msgr2=0x7fa86c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 0x7fa86c0a1560 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa8880073f0 tx=0x7fa88800b040 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 msgr2=0x7fa8900f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.980+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa88000e890 tx=0x7fa88000ed50 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 shutdown_connections 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa89018a850 0x7fa89021ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa890186280 0x7fa89016f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa86c09f0a0 0x7fa86c0a1560 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 --2- 172.21.15.100:0/3808112994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa890070a70 0x7fa8900f79b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 >> 172.21.15.100:0/3808112994 conn(0x7fa8900668b0 msgr2=0x7fa890073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 shutdown_connections 2024-02-21T07:58:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:09.981+0000 7fa896800640 1 -- 172.21.15.100:0/3808112994 wait complete. 2024-02-21T07:58:10.000 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:58:10.000 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:58:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.192+0000 7f5f4c000640 1 Processor -- start 2024-02-21T07:58:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.192+0000 7f5f4c000640 1 -- start start 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 0x7f5f44189dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f44070a70 0x7f5f4418a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 0x7f5f4418be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440f5580 con 0x7f5f44070a70 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440f5860 con 0x7f5f44186280 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4c000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f440f5b40 con 0x7f5f4418a850 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f48c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f44070a70 0x7f5f4418a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f49600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 0x7f5f44189dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f48c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f44070a70 0x7f5f4418a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47824/0 (socket says 172.21.15.100:47824) 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f48c00640 1 -- 172.21.15.100:0/3728619768 learned_addr learned my addr 172.21.15.100:0/3728619768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.194+0000 7f5f4a000640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 0x7f5f4418be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f48c00640 1 -- 172.21.15.100:0/3728619768 >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 msgr2=0x7f5f4418be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f48c00640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 0x7f5f4418be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f48c00640 1 -- 172.21.15.100:0/3728619768 >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 msgr2=0x7f5f44189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f48c00640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 0x7f5f44189dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f48c00640 1 -- 172.21.15.100:0/3728619768 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440f5e20 con 0x7f5f44070a70 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f4a000640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 0x7f5f4418be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.195+0000 7f5f49600640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 0x7f5f44189dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.196+0000 7f5f48c00640 1 --2- 172.21.15.100:0/3728619768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4418a310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5f44074b10 tx=0x7f5f3002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856bcba4ba605f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.196+0000 7f5f43e00640 1 -- 172.21.15.100:0/3728619768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30030800 con 0x7f5f44070a70 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.196+0000 7f5f43e00640 1 -- 172.21.15.100:0/3728619768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30030960 con 0x7f5f44070a70 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.196+0000 7f5f43e00640 1 -- 172.21.15.100:0/3728619768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30030cf0 con 0x7f5f44070a70 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 -- 172.21.15.100:0/3728619768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 msgr2=0x7f5f4418a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3728619768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4418a310 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5f44074b10 tx=0x7f5f3002b940 comp rx=0 tx=0).stop 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 -- 172.21.15.100:0/3728619768 shutdown_connections 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.170:3300/0 conn(0x7f5f4418a850 0x7f5f4418be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3728619768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4418a310 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3728619768 >> v2:172.21.15.156:3300/0 conn(0x7f5f44186280 0x7f5f44189dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 -- 172.21.15.100:0/3728619768 >> 172.21.15.100:0/3728619768 conn(0x7f5f440668b0 msgr2=0x7f5f44066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 -- 172.21.15.100:0/3728619768 shutdown_connections 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.197+0000 7f5f4c000640 1 -- 172.21.15.100:0/3728619768 wait complete. 2024-02-21T07:58:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.199+0000 7f5f4c000640 1 Processor -- start 2024-02-21T07:58:10.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.199+0000 7f5f4c000640 1 -- start start 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f44186280 0x7f5f4421fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f4418a850 0x7f5f44220370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4421f9e0 con 0x7f5f44070a70 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44177ad0 con 0x7f5f4418a850 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f4c000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f44177db0 con 0x7f5f44186280 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f49600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f49600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47838/0 (socket says 172.21.15.100:47838) 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.200+0000 7f5f49600640 1 -- 172.21.15.100:0/3979658271 learned_addr learned my addr 172.21.15.100:0/3979658271 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f48c00640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f44186280 0x7f5f4421fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f4a000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f4418a850 0x7f5f44220370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 -- 172.21.15.100:0/3979658271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f44186280 msgr2=0x7f5f4421fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f44186280 0x7f5f4421fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 -- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f4418a850 msgr2=0x7f5f44220370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f4418a850 0x7f5f44220370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 -- 172.21.15.100:0/3979658271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009400 con 0x7f5f44070a70 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f49600640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e980 tx=0x7f5f3800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f41600640 1 -- 172.21.15.100:0/3979658271 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380096e0 con 0x7f5f44070a70 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f41600640 1 -- 172.21.15.100:0/3979658271 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3800c940 con 0x7f5f44070a70 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f41600640 1 -- 172.21.15.100:0/3979658271 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800ccd0 con 0x7f5f44070a70 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.201+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c009a70 con 0x7f5f44070a70 2024-02-21T07:58:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.202+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f300094d0 con 0x7f5f44070a70 2024-02-21T07:58:10.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.205+0000 7f5f41600640 1 -- 172.21.15.100:0/3979658271 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5f38013470 con 0x7f5f44070a70 2024-02-21T07:58:10.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.206+0000 7f5f4ed84740 1 Processor -- start 2024-02-21T07:58:10.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.206+0000 7f5f4ed84740 1 -- start start 2024-02-21T07:58:10.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.207+0000 7f5f41600640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 0x7f5f240a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.207+0000 7f5f41600640 1 -- 172.21.15.100:0/3979658271 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5f380c9d10 con 0x7f5f44070a70 2024-02-21T07:58:10.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.207+0000 7f5f4a000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 0x7f5f240a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a4e7e0 0x562b25a89050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a89590 0x562b25a8a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25981210 con 0x562b25a4dec0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2597e740 con 0x562b25a89590 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25979f20 con 0x562b25a4e7e0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4a000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 0x7f5f240a1560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0114e0 tx=0x7f5f3c00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f49600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f49600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47854/0 (socket says 172.21.15.100:47854) 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f49600640 1 -- 172.21.15.100:0/2558384176 learned_addr learned my addr 172.21.15.100:0/2558384176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f48c00640 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a4e7e0 0x562b25a89050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.208+0000 7f5f4a000640 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a89590 0x562b25a8a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 -- 172.21.15.100:0/2558384176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a4e7e0 msgr2=0x562b25a89050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a4e7e0 0x562b25a89050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 -- 172.21.15.100:0/2558384176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a89590 msgr2=0x562b25a8a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a89590 0x562b25a8a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 -- 172.21.15.100:0/2558384176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b2593bdf0 con 0x562b25a4dec0 2024-02-21T07:58:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f49600640 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5f38093c50 tx=0x7f5f380977f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f9c5c9206cd485 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f35c00640 1 -- 172.21.15.100:0/2558384176 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3809ff90 con 0x562b25a4dec0 2024-02-21T07:58:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f35c00640 1 -- 172.21.15.100:0/2558384176 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38095af0 con 0x562b25a4dec0 2024-02-21T07:58:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.209+0000 7f5f35c00640 1 -- 172.21.15.100:0/2558384176 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380c7b70 con 0x562b25a4dec0 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2558384176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 msgr2=0x562b25a4e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f5f38093c50 tx=0x7f5f380977f0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2558384176 shutdown_connections 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a89590 0x562b25a8a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a4e7e0 0x562b25a89050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2558384176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4dec0 0x562b25a4e2a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2558384176 >> 172.21.15.100:0/2558384176 conn(0x562b25a10490 msgr2=0x562b25a11510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2558384176 shutdown_connections 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.210+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2558384176 wait complete. 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.211+0000 7f5f4ed84740 1 -- start start 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.211+0000 7f5f4ed84740 1 Processor -- start 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a4e7e0 0x562b25a3dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a3f060 0x562b25a92960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2591f150 con 0x562b25a89590 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b2591edf0 con 0x562b25a4e7e0 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b256e81c0 con 0x562b25a3f060 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.212+0000 7f5f4ed84740 10 client.0 _ll_register_callbacks cb 0x562b2596e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47862/0 (socket says 172.21.15.100:47862) 2024-02-21T07:58:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 -- 172.21.15.100:0/2204778696 learned_addr learned my addr 172.21.15.100:0/2204778696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f4a000640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a3f060 0x562b25a92960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f49600640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a4e7e0 0x562b25a3dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 -- 172.21.15.100:0/2204778696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a3f060 msgr2=0x562b25a92960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a3f060 0x562b25a92960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 -- 172.21.15.100:0/2204778696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a4e7e0 msgr2=0x562b25a3dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a4e7e0 0x562b25a3dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 -- 172.21.15.100:0/2204778696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f300094d0 con 0x562b25a89590 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f48c00640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009930 tx=0x7f5f30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb3312cfdf8aa49 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f2a000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30039860 con 0x562b25a89590 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.213+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5f3003e040 con 0x562b25a89590 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b256797e0 con 0x562b25a89590 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f300399c0 con 0x562b25a89590 2024-02-21T07:58:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 10 client.7443 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x562b259785a0 con 0x562b25a89590 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b256797e0 con 0x562b25a89590 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5f30039b20 con 0x562b25a89590 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 10 client.7443 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 10 client.7443 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 20 client.7443 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f440 0x562b25a95910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 4 client.7443 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.214+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b256b6720 con 0x562b25a3f440 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.215+0000 7f5f49600640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f440 0x562b25a95910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.215+0000 7f5f49600640 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f440 0x562b25a95910 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c40f2400ebd0033d server_cookie=10a7587ff2a967bc in_seq=0 out_seq=0 2024-02-21T07:58:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.215+0000 7f5f2a000640 10 client.7443 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f2a000640 1 -- 172.21.15.100:0/2204778696 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562b256b6720 con 0x562b25a3f440 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f2a000640 10 client.7443 handle_command_reply: tid=0 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 client.7443 shutdown 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 msgr2=0x562b25a3bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009930 tx=0x7f5f30004730 comp rx=0 tx=0).stop 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 shutdown_connections 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a3f060 0x562b25a92960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a89590 0x562b25a3bd60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f440 0x562b25a95910 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/2204778696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a4e7e0 0x562b25a3dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 >> 172.21.15.100:0/2204778696 conn(0x562b25a4dec0 msgr2=0x562b25a11f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f2a000640 0 client.7443 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 shutdown_connections 2024-02-21T07:58:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 1 -- 172.21.15.100:0/2204778696 wait complete. 2024-02-21T07:58:10.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.216+0000 7f5f4ed84740 20 client.7443 trim_cache size 0 max 16384 2024-02-21T07:58:10.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.229+0000 7f5f4ed84740 1 Processor -- start 2024-02-21T07:58:10.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.229+0000 7f5f4ed84740 1 -- start start 2024-02-21T07:58:10.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a35170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25ae1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25a4e2a0 con 0x562b25a4e7e0 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25a87c70 con 0x562b25a3f060 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25a3ea50 con 0x562b25a89590 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a35170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f49600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f49600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:52632/0 (socket says 172.21.15.100:52632) 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f49600640 1 -- 172.21.15.100:0/915243108 learned_addr learned my addr 172.21.15.100:0/915243108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.230+0000 7f5f4a000640 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25ae1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 -- 172.21.15.100:0/915243108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 msgr2=0x562b25ae1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25ae1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 -- 172.21.15.100:0/915243108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 msgr2=0x562b25a35170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a35170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 -- 172.21.15.100:0/915243108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b25914ab0 con 0x562b25a3f060 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f48c00640 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a35170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f49600640 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5f3809bb00 tx=0x7f5f38082000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad8fa2fa2bedc97c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f35200640 1 -- 172.21.15.100:0/915243108 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380975c0 con 0x562b25a3f060 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f35200640 1 -- 172.21.15.100:0/915243108 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38093e60 con 0x562b25a3f060 2024-02-21T07:58:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.231+0000 7f5f35200640 1 -- 172.21.15.100:0/915243108 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380c7d70 con 0x562b25a3f060 2024-02-21T07:58:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 -- 172.21.15.100:0/915243108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 msgr2=0x562b25a3c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5f3809bb00 tx=0x7f5f38082000 comp rx=0 tx=0).stop 2024-02-21T07:58:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 -- 172.21.15.100:0/915243108 shutdown_connections 2024-02-21T07:58:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25ae1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a35170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/915243108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a3c1d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 -- 172.21.15.100:0/915243108 >> 172.21.15.100:0/915243108 conn(0x562b25a4dec0 msgr2=0x562b25a0ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 -- 172.21.15.100:0/915243108 shutdown_connections 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.232+0000 7f5f4ed84740 1 -- 172.21.15.100:0/915243108 wait complete. 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.233+0000 7f5f4ed84740 1 -- start start 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.233+0000 7f5f4ed84740 1 Processor -- start 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a88f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25a3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25a358d0 con 0x562b25a4e7e0 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25a81550 con 0x562b25a3f060 2024-02-21T07:58:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b25add2d0 con 0x562b25a89590 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.234+0000 7f5f4ed84740 10 client.0 _ll_register_callbacks cb 0x7f5f300096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47866/0 (socket says 172.21.15.100:47866) 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f4a000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25a3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 -- 172.21.15.100:0/4286190426 learned_addr learned my addr 172.21.15.100:0/4286190426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f49600640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a88f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 -- 172.21.15.100:0/4286190426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 msgr2=0x562b25a3e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25a3e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 -- 172.21.15.100:0/4286190426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 msgr2=0x562b25a88f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a88f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 -- 172.21.15.100:0/4286190426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b259785a0 con 0x562b25a4e7e0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f48c00640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5f300090b0 tx=0x7f5f3003b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5d4339205d52ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f2a000640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:58:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3005b070 con 0x562b25a4e7e0 2024-02-21T07:58:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5f3003e040 con 0x562b25a4e7e0 2024-02-21T07:58:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.235+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b25a52940 con 0x562b25a4e7e0 2024-02-21T07:58:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f3002c040 con 0x562b25a4e7e0 2024-02-21T07:58:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 10 client.7449 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x562b2593bdf0 con 0x562b25a4e7e0 2024-02-21T07:58:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b25a52940 con 0x562b25a4e7e0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5f3005e020 con 0x562b25a4e7e0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 10 client.7449 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 10 client.7449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 20 client.7449 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f9a0 0x562b25a7e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 4 client.7449 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 --> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f5f38095af0 con 0x562b25a3f9a0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.236+0000 7f5f49600640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f9a0 0x562b25a7e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f49600640 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f9a0 0x562b25a7e0a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=68f85977ed93f89b server_cookie=8dc14305df2bceaf in_seq=0 out_seq=0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f2a000640 10 client.7449 ms_handle_connect on v2:172.21.15.100:6836/1627545450 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f2a000640 1 -- 172.21.15.100:0/4286190426 <== mds.1 v2:172.21.15.100:6836/1627545450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f5f38095af0 con 0x562b25a3f9a0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f2a000640 10 client.7449 handle_command_reply: tid=0 2024-02-21T07:58:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 client.7449 shutdown 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 msgr2=0x562b25a3d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5f300090b0 tx=0x7f5f3003b040 comp rx=0 tx=0).stop 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 shutdown_connections 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562b25a89590 0x562b25a3e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562b25a4e7e0 0x562b25a3d9d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.100:6836/1627545450,v1:172.21.15.100:6837/1627545450] conn(0x562b25a3f9a0 0x562b25a7e0a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 --2- 172.21.15.100:0/4286190426 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562b25a3f060 0x562b25a88f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f2a000640 0 client.7449 ms_handle_reset on v2:172.21.15.100:6836/1627545450 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 >> 172.21.15.100:0/4286190426 conn(0x562b25a4dec0 msgr2=0x562b25a114d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 shutdown_connections 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.237+0000 7f5f4ed84740 1 -- 172.21.15.100:0/4286190426 wait complete. 2024-02-21T07:58:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4ed84740 20 client.7449 trim_cache size 0 max 16384 2024-02-21T07:58:10.245 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:58:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 msgr2=0x7f5f240a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 0x7f5f240a1560 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0114e0 tx=0x7f5f3c00b040 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 msgr2=0x7f5f4416f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800e980 tx=0x7f5f3800ed80 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 shutdown_connections 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f4418a850 0x7f5f44220370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f44186280 0x7f5f4421fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5f2409f0a0 0x7f5f240a1560 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 --2- 172.21.15.100:0/3979658271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f44070a70 0x7f5f4416f230 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 >> 172.21.15.100:0/3979658271 conn(0x7f5f440668b0 msgr2=0x7f5f4408bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 shutdown_connections 2024-02-21T07:58:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.238+0000 7f5f4c000640 1 -- 172.21.15.100:0/3979658271 wait complete. 2024-02-21T07:58:10.256 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:58:10.256 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:58:10.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.451+0000 7fa83f400640 1 Processor -- start 2024-02-21T07:58:10.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.451+0000 7fa83f400640 1 -- start start 2024-02-21T07:58:10.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa83f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fa83806da30 0x7fa83806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa83f400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380f5580 con 0x7fa838070a70 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa83f400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380f5860 con 0x7fa838186280 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa83f400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8381898e0 con 0x7fa83806da30 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa837e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa838070a70 0x7fa83818a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34224/0 (socket says 172.21.15.100:34224) 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa837e00640 1 -- 172.21.15.100:0/2213409780 learned_addr learned my addr 172.21.15.100:0/2213409780 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.453+0000 7fa83d400640 1 --2- 172.21.15.100:0/2213409780 >> v2:172.21.15.170:3300/0 conn(0x7fa83806da30 0x7fa83806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148912952 0 0) 0x7fa8380f5580 con 0x7fa838070a70 2024-02-21T07:58:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa820003520 con 0x7fa838070a70 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242156708 0 0) 0x7fa8380f5860 con 0x7fa838186280 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa83d400640 1 -- 172.21.15.100:0/2213409780 >> v1:172.21.15.156:6789/0 conn(0x7fa838186280 legacy=0x7fa838189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa83d400640 1 -- 172.21.15.100:0/2213409780 >> v1:172.21.15.100:6789/0 conn(0x7fa838070a70 legacy=0x7fa83818a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.454+0000 7fa83d400640 1 -- 172.21.15.100:0/2213409780 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380f5b40 con 0x7fa83806da30 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.455+0000 7fa83d400640 1 --2- 172.21.15.100:0/2213409780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83806de40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa830009d90 tx=0x7fa83002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e71de7f69c5beff5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.455+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83002cc60 con 0x7fa83806da30 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.455+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83002cdc0 con 0x7fa83806da30 2024-02-21T07:58:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.455+0000 7fa837400640 1 -- 172.21.15.100:0/2213409780 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830034640 con 0x7fa83806da30 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 -- 172.21.15.100:0/2213409780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 msgr2=0x7fa83806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 --2- 172.21.15.100:0/2213409780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83806de40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa830009d90 tx=0x7fa83002beb0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 -- 172.21.15.100:0/2213409780 shutdown_connections 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 --2- 172.21.15.100:0/2213409780 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83806de40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 -- 172.21.15.100:0/2213409780 >> 172.21.15.100:0/2213409780 conn(0x7fa8380668b0 msgr2=0x7fa838066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 -- 172.21.15.100:0/2213409780 shutdown_connections 2024-02-21T07:58:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.456+0000 7fa83f400640 1 -- 172.21.15.100:0/2213409780 wait complete. 2024-02-21T07:58:10.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.458+0000 7fa83f400640 1 Processor -- start 2024-02-21T07:58:10.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.458+0000 7fa83f400640 1 -- start start 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83821fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa838186280 0x7fa838169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838184030 con 0x7fa838070a70 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838184280 con 0x7fa838186280 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa83f400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838184560 con 0x7fa83806da30 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.459+0000 7fa837e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa837e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47874/0 (socket says 172.21.15.100:47874) 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa837e00640 1 -- 172.21.15.100:0/3650124442 learned_addr learned my addr 172.21.15.100:0/3650124442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83821fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83d400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa838186280 0x7fa838169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 -- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa838186280 msgr2=0x7fa838169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa838186280 0x7fa838169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 -- 172.21.15.100:0/3650124442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 msgr2=0x7fa838185320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 -- 172.21.15.100:0/3650124442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830009a70 con 0x7fa83806da30 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa837e00640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.460+0000 7fa83ca00640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83821fb10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c3e0 tx=0x7fa82c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.461+0000 7fa834c00640 1 -- 172.21.15.100:0/3650124442 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0035f0 con 0x7fa83806da30 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.461+0000 7fa834c00640 1 -- 172.21.15.100:0/3650124442 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c003770 con 0x7fa83806da30 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.461+0000 7fa834c00640 1 -- 172.21.15.100:0/3650124442 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c003b20 con 0x7fa83806da30 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.461+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838184840 con 0x7fa83806da30 2024-02-21T07:58:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.461+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa838184e00 con 0x7fa83806da30 2024-02-21T07:58:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.464+0000 7fa834c00640 1 -- 172.21.15.100:0/3650124442 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa82c003c80 con 0x7fa83806da30 2024-02-21T07:58:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.465+0000 7fa8421af740 1 Processor -- start 2024-02-21T07:58:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.465+0000 7fa8421af740 1 -- start start 2024-02-21T07:58:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.466+0000 7fa834c00640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 0x7fa8180a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.466+0000 7fa834c00640 1 -- 172.21.15.100:0/3650124442 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa82c0c8fa0 con 0x7fa83806da30 2024-02-21T07:58:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa83d400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 0x7fa8180a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b410050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b411320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b308210 con 0x55f72b410590 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b305740 con 0x55f72b3d4ec0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa8421af740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b300f20 con 0x55f72b3d57e0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa83ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa837e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b410050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa837e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b410050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50296/0 (socket says 172.21.15.100:50296) 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa837e00640 1 -- 172.21.15.100:0/2251527322 learned_addr learned my addr 172.21.15.100:0/2251527322 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa83ca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:52656/0 (socket says 172.21.15.100:52656) 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.467+0000 7fa83d400640 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b411320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83d400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 0x7fa8180a1560 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa830036000 tx=0x7fa830030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 -- 172.21.15.100:0/2251527322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 msgr2=0x55f72b410050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b410050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 -- 172.21.15.100:0/2251527322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 msgr2=0x55f72b411320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b411320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 -- 172.21.15.100:0/2251527322 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72b2c2df0 con 0x55f72b3d4ec0 2024-02-21T07:58:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0c6910 tx=0x7fa82c096520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53c6b405e5907844 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa829200640 1 -- 172.21.15.100:0/2251527322 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c09f220 con 0x55f72b3d4ec0 2024-02-21T07:58:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa829200640 1 -- 172.21.15.100:0/2251527322 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c094c60 con 0x55f72b3d4ec0 2024-02-21T07:58:10.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.468+0000 7fa829200640 1 -- 172.21.15.100:0/2251527322 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c093230 con 0x55f72b3d4ec0 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 -- 172.21.15.100:0/2251527322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 msgr2=0x55f72b3d52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0c6910 tx=0x7fa82c096520 comp rx=0 tx=0).stop 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 -- 172.21.15.100:0/2251527322 shutdown_connections 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b411320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b410050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 --2- 172.21.15.100:0/2251527322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d4ec0 0x55f72b3d52a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 -- 172.21.15.100:0/2251527322 >> 172.21.15.100:0/2251527322 conn(0x55f72b397490 msgr2=0x55f72b398510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 -- 172.21.15.100:0/2251527322 shutdown_connections 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.469+0000 7fa8421af740 1 -- 172.21.15.100:0/2251527322 wait complete. 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.470+0000 7fa8421af740 1 -- start start 2024-02-21T07:58:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.470+0000 7fa8421af740 1 Processor -- start 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b3949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b2a6150 con 0x55f72b410590 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b2a5df0 con 0x55f72b3bf640 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.471+0000 7fa8421af740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b06f1c0 con 0x55f72b3d57e0 2024-02-21T07:58:10.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa8421af740 10 client.0 _ll_register_callbacks cb 0x55f72b2f52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47900/0 (socket says 172.21.15.100:47900) 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 -- 172.21.15.100:0/2655686720 learned_addr learned my addr 172.21.15.100:0/2655686720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa83d400640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b3949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 -- 172.21.15.100:0/2655686720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 msgr2=0x55f72b3949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b3949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 -- 172.21.15.100:0/2655686720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 msgr2=0x55f72b3bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa837e00640 1 -- 172.21.15.100:0/2655686720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa838184e00 con 0x55f72b410590 2024-02-21T07:58:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.472+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b3949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa837e00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa8240128f0 tx=0x7fa824012db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec384a7b19479 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa81d600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824005ac0 con 0x55f72b410590 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa824005c20 con 0x55f72b410590 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72b0007e0 con 0x55f72b410590 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa824005de0 con 0x55f72b410590 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa8421af740 10 client.7461 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f72b2ff5a0 con 0x55f72b410590 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.473+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f72b0007e0 con 0x55f72b410590 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa8240070d0 con 0x55f72b410590 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 10 client.7461 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 10 client.7461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 20 client.7461 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b41cff0 0x55f72b41d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 4 client.7461 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:58:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f72b03d720 con 0x55f72b41cff0 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b41cff0 0x55f72b41d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa83ca00640 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b41cff0 0x55f72b41d3d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53136a20f2ecec5a server_cookie=64dd530269777fe in_seq=0 out_seq=0 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.474+0000 7fa81d600640 10 client.7461 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa81d600640 1 -- 172.21.15.100:0/2655686720 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f72b03d720 con 0x55f72b41cff0 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa81d600640 10 client.7461 handle_command_reply: tid=0 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 client.7461 shutdown 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 msgr2=0x55f72b3c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa8240128f0 tx=0x7fa824012db0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 shutdown_connections 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b41cff0 0x55f72b41d3d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b3c9b30 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 --2- 172.21.15.100:0/2655686720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b3949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa81d600640 0 client.7461 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 >> 172.21.15.100:0/2655686720 conn(0x55f72b3d4ec0 msgr2=0x55f72b398f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.475+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 shutdown_connections 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.476+0000 7fa8421af740 1 -- 172.21.15.100:0/2655686720 wait complete. 2024-02-21T07:58:10.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.476+0000 7fa8421af740 20 client.7461 trim_cache size 0 max 16384 2024-02-21T07:58:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.488+0000 7fa8421af740 1 Processor -- start 2024-02-21T07:58:10.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.488+0000 7fa8421af740 1 -- start start 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d57e0 0x55f72b410970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b410590 0x55f72b3930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b3b2670 con 0x55f72b3bf640 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b421e30 con 0x55f72b3d57e0 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.489+0000 7fa8421af740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b3b28c0 con 0x55f72b410590 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47902/0 (socket says 172.21.15.100:47902) 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 -- 172.21.15.100:0/292479725 learned_addr learned my addr 172.21.15.100:0/292479725 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa837e00640 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d57e0 0x55f72b410970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83d400640 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b410590 0x55f72b3930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 -- 172.21.15.100:0/292479725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b410590 msgr2=0x55f72b3930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b410590 0x55f72b3930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 -- 172.21.15.100:0/292479725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d57e0 msgr2=0x55f72b410970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d57e0 0x55f72b410970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 -- 172.21.15.100:0/292479725 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f72b29bab0 con 0x55f72b3bf640 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa83ca00640 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0968c0 tx=0x7fa82c0c8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928f6b72c1734a1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.490+0000 7fa81fe00640 1 -- 172.21.15.100:0/292479725 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c094ec0 con 0x55f72b3bf640 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa81fe00640 1 -- 172.21.15.100:0/292479725 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c093230 con 0x55f72b3bf640 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa81fe00640 1 -- 172.21.15.100:0/292479725 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c09bda0 con 0x55f72b3bf640 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 -- 172.21.15.100:0/292479725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 msgr2=0x55f72b3c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0968c0 tx=0x7fa82c0c8000 comp rx=0 tx=0).stop 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 -- 172.21.15.100:0/292479725 shutdown_connections 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b410590 0x55f72b3930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3d57e0 0x55f72b410970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 --2- 172.21.15.100:0/292479725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b3bf640 0x55f72b3c6960 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 -- 172.21.15.100:0/292479725 >> 172.21.15.100:0/292479725 conn(0x55f72b3d4ec0 msgr2=0x55f72b398f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 -- 172.21.15.100:0/292479725 shutdown_connections 2024-02-21T07:58:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.491+0000 7fa8421af740 1 -- 172.21.15.100:0/292479725 wait complete. 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.492+0000 7fa8421af740 1 -- start start 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.492+0000 7fa8421af740 1 Processor -- start 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.493+0000 7fa8421af740 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3948e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.493+0000 7fa8421af740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b465570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa8421af740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa8421af740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b477b40 con 0x55f72b410590 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa8421af740 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b474640 con 0x55f72b3bf640 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa8421af740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f72b39f0b0 con 0x55f72b3d57e0 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa8421af740 10 client.0 _ll_register_callbacks cb 0x7fa82c001080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b465570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47912/0 (socket says 172.21.15.100:47912) 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83d400640 1 -- 172.21.15.100:0/618661038 learned_addr learned my addr 172.21.15.100:0/618661038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83ca00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 -- 172.21.15.100:0/618661038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 msgr2=0x55f72b3948e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3948e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 -- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 msgr2=0x55f72b477f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa837e00640 1 -- 172.21.15.100:0/618661038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f72b2c2df0 con 0x55f72b3d57e0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83ca00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.494+0000 7fa83d400640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa837e00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b465570 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa824012df0 tx=0x7fa824001150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ea630ffa76daf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa81d600640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82400b070 con 0x55f72b3d57e0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mon.2 v2:172.21.15.170:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa824007ab0 con 0x55f72b3d57e0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa82c094c60 con 0x55f72b3d57e0 2024-02-21T07:58:10.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8240124d0 con 0x55f72b3d57e0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa8421af740 10 client.7583 fetch_fsmap learned FSMap version 18 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f72b2c1650 con 0x55f72b3d57e0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.495+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mon.2 v2:172.21.15.170:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c094c60 con 0x55f72b3d57e0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mon.2 v2:172.21.15.170:3300/0 5 ==== fsmap(e 18) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa824005ac0 con 0x55f72b3d57e0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 10 client.7583 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 10 client.7583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 20 client.7583 populate_metadata read hostname 'smithi100' 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b402630 0x55f72b39e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 4 client.7583 mds_command: new command op to 4354 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 --> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f72b08c890 con 0x55f72b402630 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa83ca00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b402630 0x55f72b39e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.496+0000 7fa83ca00640 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b402630 0x55f72b39e770 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8391500963f9dbb server_cookie=7da537c75d4eff4b in_seq=0 out_seq=0 2024-02-21T07:58:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa81d600640 10 client.7583 ms_handle_connect on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa81d600640 1 -- 172.21.15.100:0/618661038 <== mds.0 v2:172.21.15.100:6838/1953723394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f72b08c890 con 0x55f72b402630 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa81d600640 10 client.7583 handle_command_reply: tid=0 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 client.7583 shutdown 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 msgr2=0x55f72b465570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b465570 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa824012df0 tx=0x7fa824001150 comp rx=0 tx=0).stop 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 shutdown_connections 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:6838/1953723394,v1:172.21.15.100:6839/1953723394] conn(0x55f72b402630 0x55f72b39e770 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f72b410590 0x55f72b477f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55f72b3d57e0 0x55f72b465570 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa81d600640 0 client.7583 ms_handle_reset on v2:172.21.15.100:6838/1953723394 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 --2- 172.21.15.100:0/618661038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f72b3bf640 0x55f72b3948e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 >> 172.21.15.100:0/618661038 conn(0x55f72b3d4ec0 msgr2=0x55f72b3c9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 shutdown_connections 2024-02-21T07:58:10.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 1 -- 172.21.15.100:0/618661038 wait complete. 2024-02-21T07:58:10.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.497+0000 7fa8421af740 20 client.7583 trim_cache size 0 max 16384 2024-02-21T07:58:10.505 INFO:teuthology.orchestra.run.smithi100.stdout:[] 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 msgr2=0x7fa8180a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 0x7fa8180a1560 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa830036000 tx=0x7fa830030000 comp rx=0 tx=0).stop 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 msgr2=0x7fa83821fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83821fb10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c3e0 tx=0x7fa82c00c8a0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 shutdown_connections 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa838186280 0x7fa838169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa81809f0a0 0x7fa8180a1560 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa838070a70 0x7fa838185320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 --2- 172.21.15.100:0/3650124442 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa83806da30 0x7fa83821fb10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 >> 172.21.15.100:0/3650124442 conn(0x7fa8380668b0 msgr2=0x7fa8380f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 shutdown_connections 2024-02-21T07:58:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:10.498+0000 7fa83f400640 1 -- 172.21.15.100:0/3650124442 wait complete. 2024-02-21T07:58:11.519 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-02-21T07:58:11.519 INFO:tasks.fwd_scrub:done joining 2024-02-21T07:58:11.520 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-02-21T07:58:11.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:58:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.751+0000 7f0c73400640 1 Processor -- start 2024-02-21T07:58:11.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.751+0000 7f0c73400640 1 -- start start 2024-02-21T07:58:11.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c73400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0c6c1844e0 0x7f0c6c0f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c73400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c06eec0 con 0x7f0c6c0f9630 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c73400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0f9ac0 con 0x7f0c6c183f70 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c73400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c06e390 con 0x7f0c6c1844e0 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c70a00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0c6c183f70 0x7f0c6c06e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:54820/0 (socket says 172.21.15.100:54820) 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c70a00640 1 -- 172.21.15.100:0/1667876922 learned_addr learned my addr 172.21.15.100:0/1667876922 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c71400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0c6c0f9630 0x7f0c6c0ca5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34230/0 (socket says 172.21.15.100:34230) 2024-02-21T07:58:11.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.753+0000 7f0c63e00640 1 --2- 172.21.15.100:0/1667876922 >> v2:172.21.15.170:3300/0 conn(0x7f0c6c1844e0 0x7f0c6c0f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986050019 0 0) 0x7f0c6c06eec0 con 0x7f0c6c0f9630 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c50003520 con 0x7f0c6c0f9630 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c63e00640 1 -- 172.21.15.100:0/1667876922 >> v1:172.21.15.156:6789/0 conn(0x7f0c6c183f70 legacy=0x7f0c6c06e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067687251 0 0) 0x7f0c6c0f9ac0 con 0x7f0c6c183f70 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c63e00640 1 -- 172.21.15.100:0/1667876922 >> v1:172.21.15.100:6789/0 conn(0x7f0c6c0f9630 legacy=0x7f0c6c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.754+0000 7f0c63e00640 1 -- 172.21.15.100:0/1667876922 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c187520 con 0x7f0c6c1844e0 2024-02-21T07:58:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.755+0000 7f0c63e00640 1 --2- 172.21.15.100:0/1667876922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f90f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097a0 tx=0x7f0c5402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8390cd0aa0c9f708 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5402e070 con 0x7f0c6c1844e0 2024-02-21T07:58:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540315a0 con 0x7f0c6c1844e0 2024-02-21T07:58:11.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c6be00640 1 -- 172.21.15.100:0/1667876922 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54031930 con 0x7f0c6c1844e0 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 -- 172.21.15.100:0/1667876922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c1844e0 msgr2=0x7f0c6c0f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 --2- 172.21.15.100:0/1667876922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f90f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097a0 tx=0x7f0c5402b840 comp rx=0 tx=0).stop 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 -- 172.21.15.100:0/1667876922 shutdown_connections 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 --2- 172.21.15.100:0/1667876922 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f90f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 -- 172.21.15.100:0/1667876922 >> 172.21.15.100:0/1667876922 conn(0x7f0c6c0ce160 msgr2=0x7f0c6c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 -- 172.21.15.100:0/1667876922 shutdown_connections 2024-02-21T07:58:11.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.756+0000 7f0c73400640 1 -- 172.21.15.100:0/1667876922 wait complete. 2024-02-21T07:58:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.758+0000 7f0c73400640 1 Processor -- start 2024-02-21T07:58:11.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.758+0000 7f0c73400640 1 -- start start 2024-02-21T07:58:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c183f70 0x7f0c6c177f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:11.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c2159f0 con 0x7f0c6c0f9630 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c214e70 con 0x7f0c6c1844e0 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c73400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c215150 con 0x7f0c6c183f70 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47916/0 (socket says 172.21.15.100:47916) 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 -- 172.21.15.100:0/3260437795 learned_addr learned my addr 172.21.15.100:0/3260437795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c63e00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c183f70 0x7f0c6c177f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c71400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 -- 172.21.15.100:0/3260437795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c183f70 msgr2=0x7f0c6c177f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c183f70 0x7f0c6c177f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 -- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c6c1844e0 msgr2=0x7f0c6c0f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.760+0000 7f0c70a00640 1 -- 172.21.15.100:0/3260437795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c54009400 con 0x7f0c6c0f9630 2024-02-21T07:58:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c70a00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c3f0 tx=0x7f0c5c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c0074e0 con 0x7f0c6c0f9630 2024-02-21T07:58:11.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c007640 con 0x7f0c6c0f9630 2024-02-21T07:58:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c215430 con 0x7f0c6c0f9630 2024-02-21T07:58:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c004a20 con 0x7f0c6c0f9630 2024-02-21T07:58:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.761+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c214a60 con 0x7f0c6c0f9630 2024-02-21T07:58:11.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.762+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c0f5250 con 0x7f0c6c0f9630 2024-02-21T07:58:11.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.764+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0c5c004b80 con 0x7f0c6c0f9630 2024-02-21T07:58:11.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.765+0000 7f0c69600640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 0x7f0c480a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.766+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c5c0c9890 con 0x7f0c6c0f9630 2024-02-21T07:58:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.766+0000 7f0c63e00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 0x7f0c480a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:11.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.766+0000 7f0c63e00640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 0x7f0c480a1560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c54036000 tx=0x7f0c5403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:11.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.770+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c6c0f5250 con 0x7f0c6c0f9630 2024-02-21T07:58:11.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.964+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6c0f5250 con 0x7f0c6c0f9630 2024-02-21T07:58:11.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.969+0000 7f0c69600640 1 -- 172.21.15.100:0/3260437795 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7f0c6c0f5250 con 0x7f0c6c0f9630 2024-02-21T07:58:11.971 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:11.972 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:58:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 msgr2=0x7f0c480a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 0x7f0c480a1560 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0c54036000 tx=0x7f0c5403d040 comp rx=0 tx=0).stop 2024-02-21T07:58:11.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 msgr2=0x7f0c6c214080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c3f0 tx=0x7f0c5c00c8b0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 shutdown_connections 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0c6c1844e0 0x7f0c6c0f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c6c183f70 0x7f0c6c177f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0c4809f0a0 0x7f0c480a1560 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 --2- 172.21.15.100:0/3260437795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c0f9630 0x7f0c6c214080 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 >> 172.21.15.100:0/3260437795 conn(0x7f0c6c0ce160 msgr2=0x7f0c6c0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 shutdown_connections 2024-02-21T07:58:11.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:11.971+0000 7f0c73400640 1 -- 172.21.15.100:0/3260437795 wait complete. 2024-02-21T07:58:11.994 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:58:11.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:58:12.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.203+0000 7f92e7800640 1 Processor -- start 2024-02-21T07:58:12.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.203+0000 7f92e7800640 1 -- start start 2024-02-21T07:58:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.205+0000 7f92e7800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 0x7f92e00d6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e7800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e018a5c0 0x7f92e01889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e7800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e018a9f0 con 0x7f92e0186300 2024-02-21T07:58:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e7800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e00d6d50 con 0x7f92e0185f20 2024-02-21T07:58:12.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e7800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e006d080 con 0x7f92e018a5c0 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e5800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f92e018a5c0 0x7f92e01889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92d7e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f92e0186300 0x7f92e0189eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:54824/0 (socket says 172.21.15.100:54824) 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92d7e00640 1 -- 172.21.15.100:0/2515004785 learned_addr learned my addr 172.21.15.100:0/2515004785 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92e4e00640 1 --2- 172.21.15.100:0/2515004785 >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 0x7f92e00d6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92dfe00640 1 -- 172.21.15.100:0/2515004785 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731773375 0 0) 0x7f92c8001110 con 0x7f92e0186300 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.206+0000 7f92dfe00640 1 -- 172.21.15.100:0/2515004785 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c4003520 con 0x7f92e0186300 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.207+0000 7f92e5800640 1 -- 172.21.15.100:0/2515004785 >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 msgr2=0x7f92e00d6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.207+0000 7f92e5800640 1 --2- 172.21.15.100:0/2515004785 >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 0x7f92e00d6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.207+0000 7f92e5800640 1 -- 172.21.15.100:0/2515004785 >> v1:172.21.15.156:6789/0 conn(0x7f92e0186300 legacy=0x7f92e0189eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.207+0000 7f92e5800640 1 -- 172.21.15.100:0/2515004785 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e006bd00 con 0x7f92e018a5c0 2024-02-21T07:58:12.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.207+0000 7f92e4e00640 1 --2- 172.21.15.100:0/2515004785 >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 0x7f92e00d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92e5800640 1 --2- 172.21.15.100:0/2515004785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e018a5c0 0x7f92e01889c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f92e00d38f0 tx=0x7f92d802bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28fd0eed57cb4b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92dfe00640 1 -- 172.21.15.100:0/2515004785 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d802cb50 con 0x7f92e018a5c0 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92dfe00640 1 -- 172.21.15.100:0/2515004785 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d802ccb0 con 0x7f92e018a5c0 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92dfe00640 1 -- 172.21.15.100:0/2515004785 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8034660 con 0x7f92e018a5c0 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92e7800640 1 -- 172.21.15.100:0/2515004785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e018a5c0 msgr2=0x7f92e01889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.208+0000 7f92e7800640 1 --2- 172.21.15.100:0/2515004785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e018a5c0 0x7f92e01889c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f92e00d38f0 tx=0x7f92d802bda0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 -- 172.21.15.100:0/2515004785 shutdown_connections 2024-02-21T07:58:12.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 --2- 172.21.15.100:0/2515004785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e018a5c0 0x7f92e01889c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 --2- 172.21.15.100:0/2515004785 >> v2:172.21.15.100:3300/0 conn(0x7f92e0185f20 0x7f92e00d6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 -- 172.21.15.100:0/2515004785 >> 172.21.15.100:0/2515004785 conn(0x7f92e00fe270 msgr2=0x7f92e00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:12.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 -- 172.21.15.100:0/2515004785 shutdown_connections 2024-02-21T07:58:12.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.209+0000 7f92e7800640 1 -- 172.21.15.100:0/2515004785 wait complete. 2024-02-21T07:58:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.211+0000 7f92e7800640 1 Processor -- start 2024-02-21T07:58:12.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.211+0000 7f92e7800640 1 -- start start 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e0185f20 0x7f92e00fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92e0186300 0x7f92e0178ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00fc5b0 con 0x7f92e018a5c0 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e0184240 con 0x7f92e0185f20 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e7800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00fc7f0 con 0x7f92e0186300 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47940/0 (socket says 172.21.15.100:47940) 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e5800640 1 -- 172.21.15.100:0/1684775864 learned_addr learned my addr 172.21.15.100:0/1684775864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92e4e00640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e0185f20 0x7f92e00fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.212+0000 7f92d7e00640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92e0186300 0x7f92e0178ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 -- 172.21.15.100:0/1684775864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92e0186300 msgr2=0x7f92e0178ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92e0186300 0x7f92e0178ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 -- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e0185f20 msgr2=0x7f92e00fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e0185f20 0x7f92e00fc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 -- 172.21.15.100:0/1684775864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009400 con 0x7f92e018a5c0 2024-02-21T07:58:12.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e5800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009e80 tx=0x7f92d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8040650 con 0x7f92e018a5c0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d80407d0 con 0x7f92e018a5c0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d8009a70 con 0x7f92e018a5c0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.213+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8040b80 con 0x7f92e018a5c0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.214+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e00fcdb0 con 0x7f92e018a5c0 2024-02-21T07:58:12.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.215+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e0067c80 con 0x7f92e018a5c0 2024-02-21T07:58:12.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.216+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f92d8040ce0 con 0x7f92e018a5c0 2024-02-21T07:58:12.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.218+0000 7f92dd600640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 0x7f92bc0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.218+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f92d80ecc10 con 0x7f92e018a5c0 2024-02-21T07:58:12.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.218+0000 7f92e4e00640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 0x7f92bc0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.219+0000 7f92e4e00640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 0x7f92bc0a1590 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009c30 tx=0x7f92d0009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.220+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f92d80b6990 con 0x7f92e018a5c0 2024-02-21T07:58:12.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.418+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92e018b280 con 0x7f92e018a5c0 2024-02-21T07:58:12.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.419+0000 7f92dd600640 1 -- 172.21.15.100:0/1684775864 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92d8039020 con 0x7f92e018a5c0 2024-02-21T07:58:12.422 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:58:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.421+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 msgr2=0x7f92bc0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.421+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 0x7f92bc0a1590 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009c30 tx=0x7f92d0009190 comp rx=0 tx=0).stop 2024-02-21T07:58:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.421+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 msgr2=0x7f92e0178ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.421+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f92d8009e80 tx=0x7f92d8004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 shutdown_connections 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f92bc09f0d0 0x7f92bc0a1590 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92e018a5c0 0x7f92e0178ff0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f92e0186300 0x7f92e0178ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 --2- 172.21.15.100:0/1684775864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92e0185f20 0x7f92e00fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 >> 172.21.15.100:0/1684775864 conn(0x7f92e00fe270 msgr2=0x7f92e0182370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 shutdown_connections 2024-02-21T07:58:12.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.422+0000 7f92e7800640 1 -- 172.21.15.100:0/1684775864 wait complete. 2024-02-21T07:58:12.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:58:12.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.654+0000 7fa53d800640 1 Processor -- start 2024-02-21T07:58:12.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.654+0000 7fa53d800640 1 -- start start 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa53d800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa538189ca0 0x7fa53806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa53d800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380ca6a0 con 0x7fa5381871c0 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa53d800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5380f6200 con 0x7fa53818a080 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa53d800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53818abe0 con 0x7fa538189ca0 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa536a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fa538189ca0 0x7fa53806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa537400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7fa53818a080 0x7fa53818a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:60996/0 (socket says 172.21.15.100:60996) 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa52fe00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fa5381871c0 0x7fa5380cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:54840/0 (socket says 172.21.15.100:54840) 2024-02-21T07:58:12.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa537400640 1 -- 172.21.15.100:0/3112548686 learned_addr learned my addr 172.21.15.100:0/3112548686 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:12.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa536a00640 1 -- 172.21.15.100:0/3112548686 >> v1:172.21.15.170:6789/0 conn(0x7fa53818a080 legacy=0x7fa53818a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa536a00640 1 -- 172.21.15.100:0/3112548686 >> v1:172.21.15.156:6789/0 conn(0x7fa5381871c0 legacy=0x7fa5380cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa536a00640 1 -- 172.21.15.100:0/3112548686 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5380f6450 con 0x7fa538189ca0 2024-02-21T07:58:12.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.657+0000 7fa536000640 1 -- 172.21.15.100:0/3112548686 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405461678 0 0) 0x7fa5380ca6a0 con 0x7fa5381871c0 2024-02-21T07:58:12.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.658+0000 7fa536a00640 1 --2- 172.21.15.100:0/3112548686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53806ab60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa5280097a0 tx=0x7fa52802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d990df52064728b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.658+0000 7fa536000640 1 -- 172.21.15.100:0/3112548686 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528030610 con 0x7fa538189ca0 2024-02-21T07:58:12.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa536000640 1 -- 172.21.15.100:0/3112548686 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528030770 con 0x7fa538189ca0 2024-02-21T07:58:12.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa536000640 1 -- 172.21.15.100:0/3112548686 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528030b00 con 0x7fa538189ca0 2024-02-21T07:58:12.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 -- 172.21.15.100:0/3112548686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 msgr2=0x7fa53806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 --2- 172.21.15.100:0/3112548686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53806ab60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa5280097a0 tx=0x7fa52802b960 comp rx=0 tx=0).stop 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 -- 172.21.15.100:0/3112548686 shutdown_connections 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 --2- 172.21.15.100:0/3112548686 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53806ab60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 -- 172.21.15.100:0/3112548686 >> 172.21.15.100:0/3112548686 conn(0x7fa5380668b0 msgr2=0x7fa538066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 -- 172.21.15.100:0/3112548686 shutdown_connections 2024-02-21T07:58:12.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.659+0000 7fa53d800640 1 -- 172.21.15.100:0/3112548686 wait complete. 2024-02-21T07:58:12.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.661+0000 7fa53d800640 1 Processor -- start 2024-02-21T07:58:12.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.661+0000 7fa53d800640 1 -- start start 2024-02-21T07:58:12.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.662+0000 7fa53d800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5381871c0 0x7fa538173fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa53d800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53821af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa53d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa53d800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381744f0 con 0x7fa53818a080 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa53d800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53821aa90 con 0x7fa538189ca0 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa53d800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53821f0d0 con 0x7fa5381871c0 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47950/0 (socket says 172.21.15.100:47950) 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 -- 172.21.15.100:0/3148085071 learned_addr learned my addr 172.21.15.100:0/3148085071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa52fe00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53821af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa536a00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5381871c0 0x7fa538173fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 -- 172.21.15.100:0/3148085071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5381871c0 msgr2=0x7fa538173fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5381871c0 0x7fa538173fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 -- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 msgr2=0x7fa53821af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53821af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa537400640 1 -- 172.21.15.100:0/3148085071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009400 con 0x7fa53818a080 2024-02-21T07:58:12.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.663+0000 7fa52fe00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53821af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:12.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa537400640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ca80 tx=0x7fa53000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ac30 con 0x7fa53818a080 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000ad90 con 0x7fa53818a080 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530012600 con 0x7fa53818a080 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53821f3b0 con 0x7fa53818a080 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.664+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53821a720 con 0x7fa53818a080 2024-02-21T07:58:12.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.665+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53808e1c0 con 0x7fa53818a080 2024-02-21T07:58:12.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.667+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa530007070 con 0x7fa53818a080 2024-02-21T07:58:12.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.669+0000 7fa52ea00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 0x7fa5140a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:12.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.669+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa5300c9a70 con 0x7fa53818a080 2024-02-21T07:58:12.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.669+0000 7fa536a00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 0x7fa5140a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:12.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.670+0000 7fa536a00640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 0x7fa5140a15e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa528036000 tx=0x7fa528008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:12.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.672+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa53004d8c0 con 0x7fa53818a080 2024-02-21T07:58:12.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.868+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa53821ac00 con 0x7fa53818a080 2024-02-21T07:58:12.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.869+0000 7fa52ea00640 1 -- 172.21.15.100:0/3148085071 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa530093760 con 0x7fa53818a080 2024-02-21T07:58:12.871 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:58:12.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 msgr2=0x7fa5140a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 0x7fa5140a15e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa528036000 tx=0x7fa528008030 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 msgr2=0x7fa53821b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa53000ca80 tx=0x7fa53000cf40 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 shutdown_connections 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fa51409f120 0x7fa5140a15e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa53818a080 0x7fa53821b460 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538189ca0 0x7fa53821af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 --2- 172.21.15.100:0/3148085071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5381871c0 0x7fa538173fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 >> 172.21.15.100:0/3148085071 conn(0x7fa5380668b0 msgr2=0x7fa53818a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 shutdown_connections 2024-02-21T07:58:12.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:12.871+0000 7fa53d800640 1 -- 172.21.15.100:0/3148085071 wait complete. 2024-02-21T07:58:12.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:58:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.104+0000 7fcfd9400640 1 Processor -- start 2024-02-21T07:58:13.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.104+0000 7fcfd9400640 1 -- start start 2024-02-21T07:58:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd9400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fcfd40fc630 0x7fcfd40d5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd9400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd41897c0 con 0x7fcfd4182850 2024-02-21T07:58:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd9400640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd4182c30 con 0x7fcfd4189ca0 2024-02-21T07:58:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd9400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd418a150 con 0x7fcfd40fc630 2024-02-21T07:58:13.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcfd4182850 0x7fcfd406c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34242/0 (socket says 172.21.15.100:34242) 2024-02-21T07:58:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd3e00640 1 -- 172.21.15.100:0/3288425107 learned_addr learned my addr 172.21.15.100:0/3288425107 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:13.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd8a00640 1 --2- 172.21.15.100:0/3288425107 >> v2:172.21.15.170:3300/0 conn(0x7fcfd40fc630 0x7fcfd40d5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331033236 0 0) 0x7fcfd41897c0 con 0x7fcfd4182850 2024-02-21T07:58:13.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb8003520 con 0x7fcfd4182850 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045730436 0 0) 0x7fcfd4182c30 con 0x7fcfd4189ca0 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd8a00640 1 -- 172.21.15.100:0/3288425107 >> v1:172.21.15.156:6789/0 conn(0x7fcfd4189ca0 legacy=0x7fcfd40fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd8a00640 1 -- 172.21.15.100:0/3288425107 >> v1:172.21.15.100:6789/0 conn(0x7fcfd4182850 legacy=0x7fcfd406c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.107+0000 7fcfd8a00640 1 -- 172.21.15.100:0/3288425107 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40fcd60 con 0x7fcfd40fc630 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.108+0000 7fcfd8a00640 1 --2- 172.21.15.100:0/3288425107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd40fc630 0x7fcfd40d5d50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6986269426c3e14 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.108+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc02cbd0 con 0x7fcfd40fc630 2024-02-21T07:58:13.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.108+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc02cd30 con 0x7fcfd40fc630 2024-02-21T07:58:13.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.108+0000 7fcfd2a00640 1 -- 172.21.15.100:0/3288425107 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc02cea0 con 0x7fcfd40fc630 2024-02-21T07:58:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 -- 172.21.15.100:0/3288425107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd40fc630 msgr2=0x7fcfd40d5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 --2- 172.21.15.100:0/3288425107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd40fc630 0x7fcfd40d5d50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009d90 tx=0x7fcfcc02be20 comp rx=0 tx=0).stop 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 -- 172.21.15.100:0/3288425107 shutdown_connections 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 --2- 172.21.15.100:0/3288425107 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd40fc630 0x7fcfd40d5d50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 -- 172.21.15.100:0/3288425107 >> 172.21.15.100:0/3288425107 conn(0x7fcfd40fe020 msgr2=0x7fcfd40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 -- 172.21.15.100:0/3288425107 shutdown_connections 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.109+0000 7fcfd9400640 1 -- 172.21.15.100:0/3288425107 wait complete. 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.111+0000 7fcfd9400640 1 Processor -- start 2024-02-21T07:58:13.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.111+0000 7fcfd9400640 1 -- start start 2024-02-21T07:58:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd4182850 0x7fcfd416afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd4189ca0 0x7fcfd40cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4186df0 con 0x7fcfd40fc630 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40cda50 con 0x7fcfd4182850 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd9400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40f8d20 con 0x7fcfd4189ca0 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47964/0 (socket says 172.21.15.100:47964) 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd3e00640 1 -- 172.21.15.100:0/4150910647 learned_addr learned my addr 172.21.15.100:0/4150910647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd8a00640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd4189ca0 0x7fcfd40cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.112+0000 7fcfd3400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd4182850 0x7fcfd416afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 -- 172.21.15.100:0/4150910647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd4189ca0 msgr2=0x7fcfd40cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd4189ca0 0x7fcfd40cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 -- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd4182850 msgr2=0x7fcfd416afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd4182850 0x7fcfd416afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 -- 172.21.15.100:0/4150910647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc009a70 con 0x7fcfd40fc630 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd3e00640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c500 tx=0x7fcfc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4005ce0 con 0x7fcfd40fc630 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4005e40 con 0x7fcfd40fc630 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4007330 con 0x7fcfd40fc630 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.113+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd40f9000 con 0x7fcfd40fc630 2024-02-21T07:58:13.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.114+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd40f95c0 con 0x7fcfd40fc630 2024-02-21T07:58:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.115+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd40751d0 con 0x7fcfd40fc630 2024-02-21T07:58:13.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.116+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fcfc4007550 con 0x7fcfd40fc630 2024-02-21T07:58:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.118+0000 7fcfcbe00640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 0x7fcfb00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.118+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcfc40c9080 con 0x7fcfd40fc630 2024-02-21T07:58:13.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.118+0000 7fcfd3400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 0x7fcfb00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.119+0000 7fcfd3400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 0x7fcfb00a1560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4175410 tx=0x7fcfbc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.123+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfc4092f40 con 0x7fcfd40fc630 2024-02-21T07:58:13.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.318+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfd40d45f0 con 0x7fcfd40fc630 2024-02-21T07:58:13.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.318+0000 7fcfcbe00640 1 -- 172.21.15.100:0/4150910647 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfc4017020 con 0x7fcfd40fc630 2024-02-21T07:58:13.320 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:58:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 msgr2=0x7fcfb00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 0x7fcfb00a1560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4175410 tx=0x7fcfbc009040 comp rx=0 tx=0).stop 2024-02-21T07:58:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 msgr2=0x7fcfd41868b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400c500 tx=0x7fcfc400c9c0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 shutdown_connections 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcfd4189ca0 0x7fcfd40cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd4182850 0x7fcfd416afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fcfb009f0a0 0x7fcfb00a1560 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 --2- 172.21.15.100:0/4150910647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfd40fc630 0x7fcfd41868b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 >> 172.21.15.100:0/4150910647 conn(0x7fcfd40fe020 msgr2=0x7fcfd40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 shutdown_connections 2024-02-21T07:58:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.320+0000 7fcfd9400640 1 -- 172.21.15.100:0/4150910647 wait complete. 2024-02-21T07:58:13.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:58:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.562+0000 7f8bb6800640 1 Processor -- start 2024-02-21T07:58:13.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.563+0000 7f8bb6800640 1 -- start start 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb6800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bb00c9b80 0x7f8bb0188e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb6800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb00f8510 con 0x7f8bb0188a30 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb6800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb00f87f0 con 0x7f8bb00f9890 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb6800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb00f9470 con 0x7f8bb00c9b80 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb5400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8bb0188a30 0x7f8bb00c9470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:54856/0 (socket says 172.21.15.100:54856) 2024-02-21T07:58:13.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb5e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f8bb00c9b80 0x7f8bb0188e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bb5400640 1 -- 172.21.15.100:0/842696585 learned_addr learned my addr 172.21.15.100:0/842696585 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103257949 0 0) 0x7f8bb00f8510 con 0x7f8bb0188a30 2024-02-21T07:58:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.565+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b98005730 con 0x7f8bb0188a30 2024-02-21T07:58:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.566+0000 7f8bb5e00640 1 -- 172.21.15.100:0/842696585 >> v1:172.21.15.170:6789/0 conn(0x7f8bb00f9890 legacy=0x7f8bb0071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.566+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180270095 0 0) 0x7f8bb00f87f0 con 0x7f8bb00f9890 2024-02-21T07:58:13.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.566+0000 7f8bb5e00640 1 -- 172.21.15.100:0/842696585 >> v1:172.21.15.156:6789/0 conn(0x7f8bb0188a30 legacy=0x7f8bb00c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.566+0000 7f8bb5e00640 1 -- 172.21.15.100:0/842696585 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb00f8ad0 con 0x7f8bb00c9b80 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.567+0000 7f8bb5e00640 1 --2- 172.21.15.100:0/842696585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb00c9b80 0x7f8bb0188e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009d90 tx=0x7f8ba802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f605e1c0237027 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.567+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba802cc60 con 0x7f8bb00c9b80 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.567+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba802cdc0 con 0x7f8bb00c9b80 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.567+0000 7f8bafe00640 1 -- 172.21.15.100:0/842696585 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8034660 con 0x7f8bb00c9b80 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 -- 172.21.15.100:0/842696585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb00c9b80 msgr2=0x7f8bb0188e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 --2- 172.21.15.100:0/842696585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb00c9b80 0x7f8bb0188e10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009d90 tx=0x7f8ba802beb0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 -- 172.21.15.100:0/842696585 shutdown_connections 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 --2- 172.21.15.100:0/842696585 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb00c9b80 0x7f8bb0188e10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 -- 172.21.15.100:0/842696585 >> 172.21.15.100:0/842696585 conn(0x7f8bb00ce150 msgr2=0x7f8bb00ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:13.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 -- 172.21.15.100:0/842696585 shutdown_connections 2024-02-21T07:58:13.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.568+0000 7f8bb6800640 1 -- 172.21.15.100:0/842696585 wait complete. 2024-02-21T07:58:13.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.570+0000 7f8bb6800640 1 Processor -- start 2024-02-21T07:58:13.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.570+0000 7f8bb6800640 1 -- start start 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 0x7f8bb0217c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb016b620 0x7f8bb00f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00f5aa0 con 0x7f8bb0181e80 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0182840 con 0x7f8bb0188a30 2024-02-21T07:58:13.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb6800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb016baa0 con 0x7f8bb016b620 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47976/0 (socket says 172.21.15.100:47976) 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb5e00640 1 -- 172.21.15.100:0/2943160308 learned_addr learned my addr 172.21.15.100:0/2943160308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb4a00640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb016b620 0x7f8bb00f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.571+0000 7f8bb5400640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 0x7f8bb0217c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 -- 172.21.15.100:0/2943160308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb016b620 msgr2=0x7f8bb00f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb016b620 0x7f8bb00f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 -- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 msgr2=0x7f8bb0217c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 0x7f8bb0217c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 -- 172.21.15.100:0/2943160308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8009a70 con 0x7f8bb0181e80 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5400640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 0x7f8bb0217c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:13.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bb5e00640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009d90 tx=0x7f8ba8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.572+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8040650 con 0x7f8bb0181e80 2024-02-21T07:58:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.573+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba80407d0 con 0x7f8bb0181e80 2024-02-21T07:58:13.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.573+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8040b80 con 0x7f8bb0181e80 2024-02-21T07:58:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.573+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb00f4b40 con 0x7f8bb0181e80 2024-02-21T07:58:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.573+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb00f5100 con 0x7f8bb0181e80 2024-02-21T07:58:13.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.574+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb00751d0 con 0x7f8bb0181e80 2024-02-21T07:58:13.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.576+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8ba8040ce0 con 0x7f8bb0181e80 2024-02-21T07:58:13.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.577+0000 7f8bad600640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 0x7f8b900a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.577+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8ba80ec760 con 0x7f8bb0181e80 2024-02-21T07:58:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.578+0000 7f8bb5400640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 0x7f8b900a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:13.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.578+0000 7f8bb5400640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 0x7f8b900a1560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:13.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.581+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ba80b6570 con 0x7f8bb0181e80 2024-02-21T07:58:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.775+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8bb00f7dc0 con 0x7f8bb0181e80 2024-02-21T07:58:13.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.776+0000 7f8bad600640 1 -- 172.21.15.100:0/2943160308 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8ba8009450 con 0x7f8bb0181e80 2024-02-21T07:58:13.777 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:58:13.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 msgr2=0x7f8b900a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 0x7f8b900a1560 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40011e0 tx=0x7f8ba4007d30 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 msgr2=0x7f8bb0182300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009d90 tx=0x7f8ba8004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 shutdown_connections 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8b9009f0a0 0x7f8b900a1560 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bb0181e80 0x7f8bb0182300 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8bb016b620 0x7f8bb00f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 --2- 172.21.15.100:0/2943160308 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8bb0188a30 0x7f8bb0217c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 >> 172.21.15.100:0/2943160308 conn(0x7f8bb00ce150 msgr2=0x7f8bb00706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.779+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 shutdown_connections 2024-02-21T07:58:13.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:13.780+0000 7f8bb6800640 1 -- 172.21.15.100:0/2943160308 wait complete. 2024-02-21T07:58:13.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-02-21T07:58:14.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.009+0000 7f1083c00640 1 Processor -- start 2024-02-21T07:58:14.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.010+0000 7f1083c00640 1 -- start start 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1083c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f107c0fc110 0x7f107c18c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1083c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c06bea0 con 0x7f107c18bf30 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1083c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c06bb70 con 0x7f107c18c850 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1083c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c0fc6d0 con 0x7f107c0fc110 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f107be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f107c0fc110 0x7f107c18c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1081200640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f107c18bf30 0x7f107c164390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:54858/0 (socket says 172.21.15.100:54858) 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f1081200640 1 -- 172.21.15.100:0/4005720092 learned_addr learned my addr 172.21.15.100:0/4005720092 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.012+0000 7f107b400640 1 -- 172.21.15.100:0/4005720092 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975198883 0 0) 0x7f107c06bb70 con 0x7f107c18c850 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.013+0000 7f107be00640 1 -- 172.21.15.100:0/4005720092 >> v1:172.21.15.170:6789/0 conn(0x7f107c18c850 legacy=0x7f107c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.013+0000 7f107be00640 1 -- 172.21.15.100:0/4005720092 >> v1:172.21.15.156:6789/0 conn(0x7f107c18bf30 legacy=0x7f107c164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:14.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.013+0000 7f107be00640 1 -- 172.21.15.100:0/4005720092 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c0fc9b0 con 0x7f107c0fc110 2024-02-21T07:58:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.014+0000 7f107be00640 1 --2- 172.21.15.100:0/4005720092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c0fc110 0x7f107c18c310 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1064009d90 tx=0x7f106402bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9011d3cdc48c02df server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.014+0000 7f107b400640 1 -- 172.21.15.100:0/4005720092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106402ca20 con 0x7f107c0fc110 2024-02-21T07:58:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.014+0000 7f107b400640 1 -- 172.21.15.100:0/4005720092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106402cb80 con 0x7f107c0fc110 2024-02-21T07:58:14.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.014+0000 7f107b400640 1 -- 172.21.15.100:0/4005720092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064034440 con 0x7f107c0fc110 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 -- 172.21.15.100:0/4005720092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c0fc110 msgr2=0x7f107c18c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 --2- 172.21.15.100:0/4005720092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c0fc110 0x7f107c18c310 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1064009d90 tx=0x7f106402bcf0 comp rx=0 tx=0).stop 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 -- 172.21.15.100:0/4005720092 shutdown_connections 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 --2- 172.21.15.100:0/4005720092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c0fc110 0x7f107c18c310 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 -- 172.21.15.100:0/4005720092 >> 172.21.15.100:0/4005720092 conn(0x7f107c0fe210 msgr2=0x7f107c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:14.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 -- 172.21.15.100:0/4005720092 shutdown_connections 2024-02-21T07:58:14.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.015+0000 7f1083c00640 1 -- 172.21.15.100:0/4005720092 wait complete. 2024-02-21T07:58:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.017+0000 7f1083c00640 1 Processor -- start 2024-02-21T07:58:14.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.017+0000 7f1083c00640 1 -- start start 2024-02-21T07:58:14.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 0x7f107c21ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:14.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 0x7f107c17bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:14.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:14.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c21f8f0 con 0x7f107c18c850 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c0f8b40 con 0x7f107c18bf30 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.018+0000 7f1083c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c21f3c0 con 0x7f107c0fc110 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 0x7f107c21ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 0x7f107c17bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48000/0 (socket says 172.21.15.100:48000) 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081c00640 1 -- 172.21.15.100:0/3571176445 learned_addr learned my addr 172.21.15.100:0/3571176445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 0x7f107c21ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50386/0 (socket says 172.21.15.100:50386) 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 -- 172.21.15.100:0/3571176445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 msgr2=0x7f107c21ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 0x7f107c21ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 -- 172.21.15.100:0/3571176445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 msgr2=0x7f107c0f9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f107be00640 1 -- 172.21.15.100:0/3571176445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064009a70 con 0x7f107c18bf30 2024-02-21T07:58:14.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.019+0000 7f1081c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f107be00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 0x7f107c17bce0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1064033000 tx=0x7f1064004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:14.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064040650 con 0x7f107c18bf30 2024-02-21T07:58:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10640407b0 con 0x7f107c18bf30 2024-02-21T07:58:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064040b40 con 0x7f107c18bf30 2024-02-21T07:58:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c0f8e00 con 0x7f107c18bf30 2024-02-21T07:58:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.020+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c0f93c0 con 0x7f107c18bf30 2024-02-21T07:58:14.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.021+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c067c80 con 0x7f107c18bf30 2024-02-21T07:58:14.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.023+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1064040ca0 con 0x7f107c18bf30 2024-02-21T07:58:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.024+0000 7f1078c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 0x7f10580a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.025+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f10640ecc20 con 0x7f107c18bf30 2024-02-21T07:58:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.025+0000 7f1081200640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 0x7f10580a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:14.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.026+0000 7f1081200640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 0x7f10580a14e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f106c000f60 tx=0x7f106c007e00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:14.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.027+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10640ece60 con 0x7f107c18bf30 2024-02-21T07:58:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.257+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f107c0cd350 con 0x7f107c18bf30 2024-02-21T07:58:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.266+0000 7f1078c00640 1 -- 172.21.15.100:0/3571176445 <== mon.1 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) v1 ==== 81+0+723603 (secure 0 0 0) 0x7f10640ece60 con 0x7f107c18bf30 2024-02-21T07:58:14.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 7, 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "active_gid": 4111, 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "active_name": "y", 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addrs": { 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:6800", 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1289369955 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:6801", 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 1289369955 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "active_addr": "172.21.15.156:6801/1289369955", 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "active_change": "2024-02-21T07:45:11.884622+0000", 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "active_mgr_features": 4540701547738038271, 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "available": true, 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "standbys": [ 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.284 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 4109, 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "z", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.286 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.287 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.288 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.289 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-02-21T07:58:14.292 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.294 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-02-21T07:58:14.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.296 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.297 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-02-21T07:58:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-02-21T07:58:14.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-02-21T07:58:14.301 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-02-21T07:58:14.302 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-02-21T07:58:14.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-02-21T07:58:14.304 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-02-21T07:58:14.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-02-21T07:58:14.306 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.307 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.308 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.309 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.310 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.312 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.317 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.319 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-02-21T07:58:14.320 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.322 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.323 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.324 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.325 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.326 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.327 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.328 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.334 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.336 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.338 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.340 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-02-21T07:58:14.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-02-21T07:58:14.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-02-21T07:58:14.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-02-21T07:58:14.344 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-02-21T07:58:14.345 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T07:58:14.346 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.348 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.350 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.351 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.354 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.355 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T07:58:14.356 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.357 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.359 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.360 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.361 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.362 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.365 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.366 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.367 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.368 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.371 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.372 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.373 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.374 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.375 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.376 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.378 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.379 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-02-21T07:58:14.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.383 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.385 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.386 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.387 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.391 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.393 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.394 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.397 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.398 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.400 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T07:58:14.401 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T07:58:14.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T07:58:14.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T07:58:14.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-02-21T07:58:14.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.407 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.409 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.411 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.413 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.415 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.417 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.420 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.421 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.422 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.423 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.424 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.426 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.430 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.431 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.433 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.437 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.438 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.439 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.440 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.441 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.443 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.446 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:14.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.450 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.451 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.467 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.469 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.470 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.471 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.472 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-02-21T07:58:14.473 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.474 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T07:58:14.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T07:58:14.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.478 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.480 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.482 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.488 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.491 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.492 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.494 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.495 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.496 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-02-21T07:58:14.499 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-02-21T07:58:14.500 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.501 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.503 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.504 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-02-21T07:58:14.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.508 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T07:58:14.510 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.517 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.520 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.524 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.525 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.526 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:14.527 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.529 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.530 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.532 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-02-21T07:58:14.534 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.536 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.537 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.538 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.539 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.540 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.541 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.542 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.546 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.547 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.548 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.549 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.550 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.551 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-02-21T07:58:14.552 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.553 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:14.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.556 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.557 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.558 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.559 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.560 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.561 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.562 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.563 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T07:58:14.564 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.565 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.566 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.567 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.568 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.569 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.570 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.571 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.572 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.573 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.574 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.575 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:14.576 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.578 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.579 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.580 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.581 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.582 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.583 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.585 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-02-21T07:58:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:14.587 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.588 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.589 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.590 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.591 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.592 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.593 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.594 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.595 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.596 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.597 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.598 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.599 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.600 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "drive_group_interval": { 2024-02-21T07:58:14.601 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "drive_group_interval", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300.0", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.602 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.603 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.604 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.605 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.606 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.607 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-02-21T07:58:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-02-21T07:58:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-02-21T07:58:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-02-21T07:58:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-02-21T07:58:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-02-21T07:58:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.623 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-02-21T07:58:14.625 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.626 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.627 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.628 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.629 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.630 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.631 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.632 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.633 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.634 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.635 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.636 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.637 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.638 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.639 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.640 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.642 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T07:58:14.643 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.644 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.645 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.648 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.649 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-02-21T07:58:14.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-02-21T07:58:14.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.652 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-02-21T07:58:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-02-21T07:58:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.669 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-02-21T07:58:14.670 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.671 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.672 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.673 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.674 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.675 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.676 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.677 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.678 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.680 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.681 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.682 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.683 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.684 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.685 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.685 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.687 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.688 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.691 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.692 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.693 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.695 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.696 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-02-21T07:58:14.697 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "gid": 4117, 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "x", 2024-02-21T07:58:14.699 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr_features": 4540701547738038271, 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.700 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.701 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.702 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.703 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.704 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.705 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.706 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-02-21T07:58:14.707 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.708 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.709 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-02-21T07:58:14.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.712 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.714 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.715 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:14.716 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-02-21T07:58:14.717 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.718 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.719 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.720 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.721 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.724 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.725 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.726 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.727 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.728 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-02-21T07:58:14.729 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.730 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-02-21T07:58:14.731 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-02-21T07:58:14.732 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-02-21T07:58:14.733 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.734 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.735 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.736 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.737 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-02-21T07:58:14.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.739 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.746 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-02-21T07:58:14.747 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-02-21T07:58:14.748 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-02-21T07:58:14.749 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.750 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.751 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.752 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.753 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.754 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.755 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.756 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.757 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.758 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.759 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T07:58:14.760 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.761 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.763 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.764 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.765 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-02-21T07:58:14.766 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.767 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.768 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.769 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.772 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.774 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.775 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.776 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.777 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.778 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-02-21T07:58:14.779 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-02-21T07:58:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.781 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.782 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.783 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.784 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.785 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.786 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.787 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.788 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T07:58:14.789 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T07:58:14.790 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.791 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.792 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.793 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.794 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.795 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.796 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.797 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.798 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.799 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.801 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.802 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T07:58:14.803 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.804 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.807 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.808 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.809 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.810 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.811 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.816 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.819 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.820 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T07:58:14.821 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T07:58:14.822 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T07:58:14.823 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.825 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.828 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T07:58:14.829 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T07:58:14.830 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T07:58:14.831 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.832 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T07:58:14.833 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T07:58:14.834 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.836 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.837 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.838 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.839 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.840 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.841 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.842 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.843 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.844 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.845 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.846 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.847 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:14.850 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.851 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.852 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.853 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.854 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.855 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-02-21T07:58:14.856 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T07:58:14.857 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.858 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.859 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.860 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-02-21T07:58:14.861 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.862 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.864 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.865 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.866 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.867 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.868 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.869 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.870 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.871 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-02-21T07:58:14.872 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-02-21T07:58:14.873 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.874 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.875 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.876 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.877 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.878 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.879 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.880 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.881 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.882 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:14.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.884 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.885 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-02-21T07:58:14.886 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.888 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.889 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.890 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.891 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.892 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.893 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-02-21T07:58:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.898 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.899 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.900 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.901 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.904 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.905 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.906 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.907 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.908 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.909 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.910 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.912 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.913 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.914 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.915 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.916 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.917 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.918 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.919 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-02-21T07:58:14.920 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.921 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.922 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.923 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.924 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.926 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.927 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.928 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.929 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.930 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.931 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.932 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.933 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.934 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.935 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.936 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.937 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.938 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.939 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.940 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.941 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.942 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.943 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.944 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.945 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.946 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-02-21T07:58:14.948 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.949 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.950 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.951 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.967 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.968 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.969 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.970 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.971 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.972 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.973 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.974 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.975 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.976 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.977 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.979 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.981 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.982 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.983 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.984 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.985 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.986 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.987 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T07:58:14.988 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.989 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.990 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:14.991 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:14.992 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.993 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.994 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:14.995 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.996 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.997 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:14.998 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:14.999 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.000 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-02-21T07:58:15.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:15.002 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.003 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.004 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.006 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.007 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.008 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:15.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.011 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.012 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.014 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.015 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-02-21T07:58:15.016 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "drive_group_interval": { 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "drive_group_interval", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300.0", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.017 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.018 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.020 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-02-21T07:58:15.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.024 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.025 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.026 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.027 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.028 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.029 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.030 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.032 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.033 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.034 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.035 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.037 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.038 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.041 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.042 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.043 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.044 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-02-21T07:58:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-02-21T07:58:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-02-21T07:58:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-02-21T07:58:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-02-21T07:58:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-02-21T07:58:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "modules": [ 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "iostat", 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "nfs", 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "restful" 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "available_modules": [ 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "alerts", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.116 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.117 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.119 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.120 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.121 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_destination": { 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_destination", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.122 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email address to send alerts to", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_from_name": { 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_from_name", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "Ceph", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.123 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Email From: name", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_host": { 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_host", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.124 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP server", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_password": { 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_password", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.125 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Password to authenticate with", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_port": { 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_port", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.126 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "465", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP port", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_sender": { 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_sender", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.127 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SMTP envelope sender", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_ssl": { 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_ssl", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.128 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "smtp_user": { 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "smtp_user", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "User to authenticate as", 2024-02-21T07:58:15.129 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "balancer", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "active": { 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "active", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.130 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_time": { 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_time", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0000", 2024-02-21T07:58:15.131 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "begin_weekday": { 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "begin_weekday", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.132 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_max_iterations": { 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_max_iterations", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "25", 2024-02-21T07:58:15.133 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "250", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_metrics": { 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_metrics", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.134 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_compat_step": { 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crush_compat_step", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.5", 2024-02-21T07:58:15.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0.001", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "0.999", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "aggressiveness of optimization", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "end_time": { 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_time", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.136 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2359", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "end_weekday": { 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "end_weekday", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.137 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "0", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "6", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.138 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.139 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.141 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.142 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min_score": { 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_score", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T07:58:15.143 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "upmap", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: "crush-compat", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "none", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "read", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap-read" 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Balancer mode", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_ids": { 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_ids", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.145 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.146 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_deviation": { 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_deviation", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.147 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "upmap_max_optimizations": { 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "upmap_max_optimizations", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.148 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm", 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.149 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_down_multiplier": { 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_down_multiplier", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.150 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_refresh_rate": { 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_refresh_rate", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "20", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.151 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "agent_starting_port": { 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "agent_starting_port", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4721", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_ptrace": { 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_ptrace", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_interval": { 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_interval", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "autotune_memory_target_ratio": { 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0.7", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm_log_destination": { 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cephadm_log_destination", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "file", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "file,syslog", 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "syslog" 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.156 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "cgroups_split": { 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cgroups_split", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.157 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "config_checks_enabled": { 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_checks_enabled", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.158 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "config_dashboard": { 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "config_dashboard", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T07:58:15.159 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_alertmanager": { 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_alertmanager", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.160 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_base": { 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_base", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.161 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Container image name, without the tag", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_elasticsearch": { 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_elasticsearch", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "elasticsearch container image", 2024-02-21T07:58:15.162 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_grafana": { 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_grafana", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.163 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_haproxy": { 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_haproxy", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "HAproxy container image", 2024-02-21T07:58:15.164 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_agent": { 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_agent", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.165 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger agent container image", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_collector": { 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_collector", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.166 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger collector container image", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_jaeger_query": { 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_jaeger_query", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.167 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Jaeger query container image", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_keepalived": { 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_keepalived", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Keepalived container image", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_loki": { 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_loki", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Loki container image", 2024-02-21T07:58:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_node_exporter": { 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_node_exporter", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_nvmeof": { 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_nvmeof", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Nvme-of container image", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_prometheus": { 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_prometheus", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Prometheus container image", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_promtail": { 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_promtail", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Promtail container image", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.173 INFO:teuthology.orchestra.run.smithi100.stdout: "container_image_snmp_gateway": { 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_image_snmp_gateway", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "SNMP Gateway container image", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.174 INFO:teuthology.orchestra.run.smithi100.stdout: "container_init": { 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "container_init", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "daemon_cache_timeout": { 2024-02-21T07:58:15.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "daemon_cache_timeout", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.176 INFO:teuthology.orchestra.run.smithi100.stdout: "default_cephadm_command_timeout": { 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "900", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.177 INFO:teuthology.orchestra.run.smithi100.stdout: "default_registry": { 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "default_registry", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "docker.io", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "device_cache_timeout": { 2024-02-21T07:58:15.178 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_cache_timeout", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1800", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache device inventory", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "device_enhanced_scan": { 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_enhanced_scan", 2024-02-21T07:58:15.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "facts_cache_timeout": { 2024-02-21T07:58:15.180 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "facts_cache_timeout", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "seconds to cache host facts data", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "host_check_interval": { 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "host_check_interval", 2024-02-21T07:58:15.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to perform a host check", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "hw_monitoring": { 2024-02-21T07:58:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hw_monitoring", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "inventory_list_all": { 2024-02-21T07:58:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "inventory_list_all", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "log_refresh_metadata": { 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_refresh_metadata", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "*", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: "max_count_per_host": { 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_count_per_host", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of daemons per service per host", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.193 INFO:teuthology.orchestra.run.smithi100.stdout: "max_osd_draining_count": { 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_osd_draining_count", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "migration_current": { 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "migration_current", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "internal - do not modify", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.195 INFO:teuthology.orchestra.run.smithi100.stdout: "mode": { 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mode", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "root", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm-package", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "root" 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T07:58:15.196 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "oob_default_addr": { 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "oob_default_addr", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "169.254.1.1", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.197 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "prometheus_alerts_path": { 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus_alerts_path", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.198 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_insecure": { 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_insecure", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.199 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_password": { 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_password", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.200 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_url": { 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_url", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "registry_username": { 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "registry_username", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.202 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "secure_monitoring_stack": { 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "secure_monitoring_stack", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.203 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "service_discovery_port": { 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "service_discovery_port", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.204 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8765", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "cephadm service discovery port", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "ssh_config_file": { 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssh_config_file", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.205 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "use_agent": { 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_agent", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.206 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "use_repo_digest": { 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "use_repo_digest", 2024-02-21T07:58:15.207 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_failed_host_check": { 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_failed_host_check", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.208 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_daemons": { 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_daemons", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.209 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_on_stray_hosts": { 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_on_stray_hosts", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.210 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crash", 2024-02-21T07:58:15.211 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.212 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.213 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.214 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.215 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.216 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "retain_interval": { 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retain_interval", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "31536000", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.217 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_recent_interval": { 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_recent_interval", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1209600", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dashboard", 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.219 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.220 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.221 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_ENABLED": { 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.222 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.223 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.224 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.225 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.226 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.227 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.228 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_URL": { 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_URL", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.243 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.244 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.246 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.247 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.250 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T07:58:15.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T07:58:15.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.253 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "45", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T07:58:15.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.255 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "admin", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.256 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.257 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.258 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.259 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.260 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "cross_origin_url": { 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cross_origin_url", 2024-02-21T07:58:15.261 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "crt_file": { 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "crt_file", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.262 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "debug": { 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "debug", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.263 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Enable/disable debug options", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "jwt_token_ttl": { 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "jwt_token_ttl", 2024-02-21T07:58:15.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "28800", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.265 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.266 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.267 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.268 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.269 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.270 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "motd": { 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "motd", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.271 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "The message of the day", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect_resolve_ip_addr": { 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.272 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.273 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8080", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.274 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.275 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl_server_port": { 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl_server_port", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8443", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.276 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "redirect", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: "redirect" 2024-02-21T07:58:15.277 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.278 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "url_prefix": { 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url_prefix", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.279 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_monitoring": { 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_monitoring", 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.280 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "monitor device health metrics", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.281 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.283 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.284 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.285 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "mark_out_threshold": { 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mark_out_threshold", 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "2419200", 2024-02-21T07:58:15.286 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "pool_name": { 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pool_name", 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.288 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "device_health_metrics", 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.289 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "retention_period": { 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "retention_period", 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.290 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15552000", 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long to retain device health metrics", 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_frequency": { 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_frequency", 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.292 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.293 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: "self_heal": { 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "self_heal", 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.294 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T07:58:15.295 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.296 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "warn_threshold": { 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "warn_threshold", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.297 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "7257600", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "diskprediction_local", 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.298 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.299 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.300 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.301 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.302 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.303 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "predict_interval": { 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predict_interval", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "86400", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.304 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "predictor_model": { 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "predictor_model", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "prophetstor", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.305 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "600", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.306 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "influx", 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": false, 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "influxdb python module not found", 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.307 INFO:teuthology.orchestra.run.smithi100.stdout: "batch_size": { 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "batch_size", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5000", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.308 INFO:teuthology.orchestra.run.smithi100.stdout: "database": { 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "database", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "ceph", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": { 2024-02-21T07:58:15.309 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "hostname", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server hostname", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.310 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "30", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "5", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.311 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.312 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.313 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.314 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.315 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "password": { 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "password", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.316 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "password of InfluxDB server user", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "port": { 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "port", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.317 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "8086", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "InfluxDB server port", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "ssl": { 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "ssl", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.318 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "false", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "threads": { 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threads", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.319 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "32", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "username": { 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "username", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.320 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "username of InfluxDB server user", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "verify_ssl": { 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "verify_ssl", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.321 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "true", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.322 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "insights", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.323 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.324 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.326 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.327 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "iostat", 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.328 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.329 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.330 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.331 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "localpool", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "failure_domain": { 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "failure_domain", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "host", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "failure domain for any created local pool", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.337 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.338 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.339 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min_size": { 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "min_size", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.340 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default min_size for any created local pool", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "num_rep": { 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "num_rep", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default replica count for any created local pool", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.341 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_num": { 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_num", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "128", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.342 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "prefix": { 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prefix", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "name prefix for any created local pool", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.343 INFO:teuthology.orchestra.run.smithi100.stdout: "subtree": { 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "subtree", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "rack", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.344 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mds_autoscaler", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.345 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.346 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.347 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.348 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.349 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirroring", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.350 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.351 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.352 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.353 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.354 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "nfs", 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.356 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.357 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.358 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.359 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.360 INFO:teuthology.orchestra.run.smithi100.stdout: "fail_fs": { 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "fail_fs", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.361 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.362 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.363 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.364 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.365 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator": { 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "orchestrator", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.366 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "cephadm", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "rook", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "test_orchestrator" 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Orchestrator backend", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.367 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_perf_query", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.368 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "osd_support", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "pg_autoscaler", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "threshold": { 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "threshold", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "3.0", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1.0", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "scaling threshold", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T07:58:15.385 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "progress", 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_pg_recovery_event": { 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_pg_recovery_event", 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.386 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.387 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.388 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.391 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.392 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "max_completed_events": { 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_completed_events", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.393 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "50", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "number of past completed events to remember", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "sleep_interval": { 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "sleep_interval", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.394 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "5", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "how long the module is going to sleep", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "prometheus", 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.395 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "cache": { 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "cache", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.396 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "exclude_perf_counters": { 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "exclude_perf_counters", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.397 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.398 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.399 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.400 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.401 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.402 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools": { 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.404 INFO:teuthology.orchestra.run.smithi100.stdout: "scrape_interval": { 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "scrape_interval", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15.0", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.405 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "::", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.406 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "9283", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.407 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "stale_cache_strategy": { 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stale_cache_strategy", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "log", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.408 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_behaviour": { 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_behaviour", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "default", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "default", 2024-02-21T07:58:15.409 INFO:teuthology.orchestra.run.smithi100.stdout: "error" 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "standby_error_status_code": { 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "standby_error_status_code", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "500", 2024-02-21T07:58:15.410 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "400", 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "599", 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.411 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.412 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.413 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.414 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.415 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.416 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_snap_create": { 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_snap_create", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.417 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "mirror_snapshot_schedule": { 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.418 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "trash_purge_schedule": { 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "trash_purge_schedule", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.419 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "restful", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "enable_auth": { 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enable_auth", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.421 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "key_file": { 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "key_file", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.422 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.423 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.424 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.426 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "server_addr": { 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_addr", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.428 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "server_port": { 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "server_port", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.429 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rgw", 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.430 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.431 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.433 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.434 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rook", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.435 INFO:teuthology.orchestra.run.smithi100.stdout: "drive_group_interval": { 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "drive_group_interval", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "300.0", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.436 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.438 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.439 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.440 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "storage_class": { 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "storage_class", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.441 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "local", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "selftest", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.442 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.443 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.444 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.445 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.446 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.447 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "roption1": { 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption1", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.448 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "roption2": { 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "roption2", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "xyz", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.449 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption1": { 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption1", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.450 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption2": { 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption2", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption3": { 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption3", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "float", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.452 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption4": { 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption4", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.453 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption5": { 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption5", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.454 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption6": { 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption6", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.455 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "rwoption7": { 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rwoption7", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "1", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "42", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.456 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "testkey": { 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testkey", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.457 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "testlkey": { 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testlkey", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.458 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "testnewline": { 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "testnewline", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.459 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snap_schedule", 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.460 INFO:teuthology.orchestra.run.smithi100.stdout: "allow_m_granularity": { 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "allow_m_granularity", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "dump_on_update": { 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "dump_on_update", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "dump database to debug log on update", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.462 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.463 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.464 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.465 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.466 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "stats", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.468 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.469 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.470 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.471 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.472 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "status", 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.473 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.474 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.475 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.476 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.478 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telegraf", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "address": { 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "address", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.479 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "15", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.480 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.481 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.482 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.483 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.484 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.485 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "telemetry", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_basic": { 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_basic", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.486 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_crash": { 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_crash", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.487 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_device": { 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_device", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "True", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.488 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_ident": { 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_ident", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.489 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "channel_perf": { 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "channel_perf", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.490 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "contact": { 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "contact", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.491 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "description": { 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "description", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.492 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "device_url": { 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "device_url", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.493 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "enabled": { 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "enabled", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.494 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "24", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "8", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.495 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "last_opt_revision": { 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "last_opt_revision", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "1", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.496 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard": { 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.497 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "leaderboard_description": { 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "leaderboard_description", 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.498 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.499 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.500 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.502 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.503 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "organization": { 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "organization", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.504 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "proxy": { 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "proxy", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.505 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "url": { 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "url", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.506 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "test_orchestrator", 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.508 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.510 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.511 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.512 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.513 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.514 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.515 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.516 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "max_concurrent_clones": { 2024-02-21T07:58:15.517 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "max_concurrent_clones", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "4", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "periodic_async_work": { 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "periodic_async_work", 2024-02-21T07:58:15.518 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Periodically check for async work", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "snapshot_clone_delay": { 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "snapshot_clone_delay", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.519 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "0", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "can_run": true, 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "error_string": "", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "module_options": { 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "discovery_interval": { 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "discovery_interval", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "uint", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "100", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.521 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "identifier": { 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "identifier", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.522 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "interval": { 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "interval", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "secs", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "60", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.523 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "log_level": { 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_level", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.524 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster": { 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.525 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_cluster_level": { 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_cluster_level", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.526 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "info", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [ 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "critical", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "debug", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "error", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "info", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "warning" 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.527 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "log_to_file": { 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "log_to_file", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "bool", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 1, 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "False", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.528 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_host": { 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_host", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.529 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_port": { 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_port", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "int", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "10051", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.530 INFO:teuthology.orchestra.run.smithi100.stdout: "zabbix_sender": { 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "zabbix_sender", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "str", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "level": "advanced", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "flags": 0, 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "min": "", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "max": "", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "enum_allowed": [], 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "desc": "", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "long_desc": "", 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "tags": [], 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: "see_also": [] 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.531 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "services": {}, 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "always_on_modules": { 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus": [ 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-02-21T07:58:15.532 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific": [ 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy": [ 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-02-21T07:58:15.533 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "reef": [ 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-02-21T07:58:15.534 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "squid": [ 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "balancer", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "crash", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "devicehealth", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "orchestrator", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "pg_autoscaler", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "progress", 2024-02-21T07:58:15.535 INFO:teuthology.orchestra.run.smithi100.stdout: "rbd_support", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "status", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "telemetry", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "volumes" 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "last_failure_osd_epoch": 0, 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "active_clients": [ 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "devicehealth", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:0", 2024-02-21T07:58:15.536 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3210185241 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "libcephsqlite", 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:0", 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 3371307134 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "rbd_support", 2024-02-21T07:58:15.537 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:0", 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 816802110 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "volumes", 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.156:0", 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2296534502 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.538 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.539 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.539 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-02-21T07:58:15.539 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:15.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 msgr2=0x7f10580a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 0x7f10580a14e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f106c000f60 tx=0x7f106c007e00 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 msgr2=0x7f107c17bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 0x7f107c17bce0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1064033000 tx=0x7f1064004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 shutdown_connections 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f105809f020 0x7f10580a14e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f107c18c850 0x7f107c0f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f107c18bf30 0x7f107c17bce0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 --2- 172.21.15.100:0/3571176445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f107c0fc110 0x7f107c21ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 >> 172.21.15.100:0/3571176445 conn(0x7f107c0fe210 msgr2=0x7f107c0d38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 shutdown_connections 2024-02-21T07:58:15.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:14.276+0000 7f1083c00640 1 -- 172.21.15.100:0/3571176445 wait complete. 2024-02-21T07:58:15.547 DEBUG:tasks.check_counter:Getting stats from a 2024-02-21T07:58:15.547 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2759, 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2668, 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1288493, 2024-02-21T07:58:15.757 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 4372256, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 28, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 4, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.561595194, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.218411534, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.149608370, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.121770290, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2668, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.033943783, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000762347 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1030, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000251815, 2024-02-21T07:58:15.758 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000244 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 659600, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 154992 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1614, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1705, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 463971, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 3220870, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 251, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 8, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.529296554, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.122913162, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.296794761, 2024-02-21T07:58:15.759 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.082935633, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1703, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1.699163170, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000997747 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 443, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000116288, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000262 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 56768, 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 366560 2024-02-21T07:58:15.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 5841, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 6430, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1997977, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 6467499, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 13, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.961842165, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 1.113975632, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.618728776, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.246540178, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 6429, 2024-02-21T07:58:15.761 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 5.164699419, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000803344 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5869, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011284230, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000001922 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 926992, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 704688 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-02-21T07:58:15.762 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2191, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.916704141, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001331220 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2315, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.123833330, 2024-02-21T07:58:15.763 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000053491 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 164, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 163, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.311001231, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001907983 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 1, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:15.764 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 386, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 26, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 4, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 7, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 15, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 20, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 5, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 2, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 2, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 285, 2024-02-21T07:58:15.765 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 271, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 39, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 2, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 5, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 1, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 523, 2024-02-21T07:58:15.766 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 523, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 191, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 20, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 171, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 332, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 3, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 23, 2024-02-21T07:58:15.767 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 177, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 1370, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 1328, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 6, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 47 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-02-21T07:58:15.768 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 6, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 2, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 20, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 18, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 20, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 2, 2024-02-21T07:58:15.769 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 2108, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 2024, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 2024, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 84, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 40, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 53, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 52, 2024-02-21T07:58:15.770 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 52, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 1, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 1, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 1, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 11228524, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 11419764, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 954, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 5.440764132, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005703107 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-02-21T07:58:15.771 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 23, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 65, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 42, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 22, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 3, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 24, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 64, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 40, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 2, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 36, 2024-02-21T07:58:15.772 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 34, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 54696, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215392 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 208, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 3, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 164, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 22, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 8, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 22, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.024182808, 2024-02-21T07:58:15.773 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001099218 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 93, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.031301944, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000336580 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.774 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001802399, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001802399 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:15.775 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000129567, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000129567 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:15.776 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.020358414, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002035841 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.777 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.778 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.017327250, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004331812 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004850175, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002425087 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.779 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.127277095, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.031819273 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:15.780 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002219897, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001109948 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.781 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-02-21T07:58:15.782 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.028094118, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003511764 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.783 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 16, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.053457564, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003341097 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.784 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 23, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 23, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 719, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-02-21T07:58:15.785 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:15.786 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:15.787 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 327747, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 134, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:15.788 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 127, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 102595, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 1093, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:15.789 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 5384, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 7799056, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 30, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 5384, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5384, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 60.087498230, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.011160382 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-02-21T07:58:15.790 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5384, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 6258 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 5384, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 571, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 4813, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 366, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 63, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 28, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 962, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 171, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-02-21T07:58:15.791 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 3108, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 543, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 105, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-02-21T07:58:15.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-02-21T07:58:15.793 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 30, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-02-21T07:58:15.794 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 7, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 896, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 16 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-02-21T07:58:15.795 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 514, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 8, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 2594, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 18, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.796 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 10209, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2711878, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 10209, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 10209, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2711878, 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:15.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 5384, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 7801002, 2024-02-21T07:58:15.798 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 5384, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 7801002, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:15.799 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 5384, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 5384, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 5384, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 5384, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:15.800 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 18, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1946, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 18, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 8, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1946, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:15.801 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55bd4cece6e0": { 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2108, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 7225460, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2108, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 954, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 7225460, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:15.802 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:15.803 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:15.804 INFO:tasks.check_counter:Daemon mds.a mds.exported=2 2024-02-21T07:58:15.804 INFO:tasks.check_counter:Daemon mds.a mds.imported=1 2024-02-21T07:58:15.804 DEBUG:tasks.check_counter:Getting stats from d 2024-02-21T07:58:15.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok perf dump 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 521, 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 596, 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 126809, 2024-02-21T07:58:16.023 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 116336, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 8, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.176951943, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.105891555, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.058982553, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.005498614, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 597, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.166106378, 2024-02-21T07:58:16.024 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000278235 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1063, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000339336, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000319 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 331, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 317, 2024-02-21T07:58:16.025 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 677178, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 175746, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 4, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.088275496, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.033576786, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.045467540, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.012454516, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 319, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.102564804, 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000321519 2024-02-21T07:58:16.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 113, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000084279, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000745 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 639088, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 129920 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 48, 2024-02-21T07:58:16.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 209, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 7624, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 728617, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 49, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.065711971, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.019221468, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.039205855, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000196778, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 203, 2024-02-21T07:58:16.028 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.062575589, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000308254 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 42, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000007403, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000176 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 321120 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-02-21T07:58:16.029 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 33, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001425224, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000043188 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:16.030 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000019462, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000009731 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.031 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 10, 2024-02-21T07:58:16.032 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 10, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 10, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 1, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:16.033 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:16.034 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-02-21T07:58:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.036 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 1, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-02-21T07:58:16.037 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-02-21T07:58:16.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 2, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 2, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-02-21T07:58:16.039 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4194892, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:16.040 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001653909, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001653909 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 13, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 13, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 0, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 11, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 12, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 1, 2024-02-21T07:58:16.041 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 10, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 10, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 47984, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 207200 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-02-21T07:58:16.042 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.044 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-02-21T07:58:16.055 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 221783, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 66, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 127, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.060 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 50040, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 198, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.061 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 35, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 10710, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 27, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 35, 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-02-21T07:58:16.063 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 35, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.264993145, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.007571232 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 35, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 57 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 35, 2024-02-21T07:58:16.064 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 35, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 1, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 5, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-02-21T07:58:16.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 6, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:16.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-02-21T07:58:16.067 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-02-21T07:58:16.068 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 30, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 8, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 8, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-02-21T07:58:16.069 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 14, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 1 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-02-21T07:58:16.070 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.071 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 896, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 716808, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 896, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 896, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 716808, 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.072 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 35, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 10710, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 35, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 10710, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:16.074 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 35, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 35, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 35, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 35, 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.075 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.076 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x565128d7a6e0": { 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 588, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-02-21T07:58:16.078 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 588, 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.079 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:16.080 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-02-21T07:58:16.081 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-02-21T07:58:16.081 DEBUG:tasks.check_counter:Getting stats from g 2024-02-21T07:58:16.081 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok perf dump 2024-02-21T07:58:16.301 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:16.301 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1347, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1349, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 4600719, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 419058, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.254937694, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.062450383, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.069270454, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.090923827, 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.302 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1348, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.282215015, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000209358 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.303 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 504, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 496, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 698742, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 213249, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.111846341, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.026740212, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.041528191, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.041009209, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 495, 2024-02-21T07:58:16.304 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.118955865, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000240314 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 628944, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 125792 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.305 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 833, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 988, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3241267, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 579077, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.181204345, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.043680182, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.041963136, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.078042414, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 987, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.194052233, 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000196608 2024-02-21T07:58:16.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 321568 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.307 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3941, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.211771224, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000053735 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.308 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-02-21T07:58:16.309 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 48, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 2, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 46, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 44, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-02-21T07:58:16.310 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-02-21T07:58:16.311 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:16.312 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-02-21T07:58:16.313 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-02-21T07:58:16.314 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:16.315 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 2108, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-02-21T07:58:16.316 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 52, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 11228524, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 11419764, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 11419165, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 2108 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 14, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 36, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 22, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 10, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 13, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 3, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 48, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 55, 2024-02-21T07:58:16.318 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 7, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 49304, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215392 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-02-21T07:58:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.320 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.321 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.322 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.323 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.324 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.325 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.326 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.327 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.329 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-02-21T07:58:16.330 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.331 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 1987, 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:16.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.333 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.334 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.335 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 189531, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 54, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 127, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.336 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 82555, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 774, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 2456, 2024-02-21T07:58:16.337 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 26, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 4, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 2456, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2456, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.591934435, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001055347 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2456, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2457 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.338 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 2456, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 2456, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 1488, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 965, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-02-21T07:58:16.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 2, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:16.340 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-02-21T07:58:16.341 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 30, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 5, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 5, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 2, 2024-02-21T07:58:16.342 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 0, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T07:58:16.343 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2680, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 8286503, 2024-02-21T07:58:16.344 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2680, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2680, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 8286503, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.345 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2456, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 7225470, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2456, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 7225470, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.346 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2456, 2024-02-21T07:58:16.347 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 2456, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2456, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2456, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.348 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.349 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55e473880a00": { 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.350 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.351 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:16.352 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-02-21T07:58:16.352 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-02-21T07:58:16.352 DEBUG:tasks.check_counter:Getting stats from j 2024-02-21T07:58:16.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.j.asok perf dump 2024-02-21T07:58:16.568 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 155, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 161, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 62424, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 136581, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 15, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.058227149, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.020526852, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.019271196, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.006960123, 2024-02-21T07:58:16.569 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 157, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.105445925, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000671630 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 134, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000032743, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000244 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1936, 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 2736 2024-02-21T07:58:16.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2811, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1669, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1284635, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 936662, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 43, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.445617727, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.228999885, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.292321009, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.020431610, 2024-02-21T07:58:16.571 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1671, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.600300697, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000359246 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3290, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001108943, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000337 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 649504, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 152800 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.572 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 49, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 213, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 15233, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 370193, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 9, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.053893632, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.033780837, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.016475181, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.001036412, 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 212, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.071875254, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000339034 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 48, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000011304, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000235 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 8640, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 334704 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-02-21T07:58:16.574 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 130, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.020619405, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000158610 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:16.575 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 17, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000695780, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000040928 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 11, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 8, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.019195355, 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002399419 2024-02-21T07:58:16.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 3, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 19, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 19, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 18, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 8, 2024-02-21T07:58:16.577 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 2, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 2, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 4, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 21, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 11, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 4, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 1, 2024-02-21T07:58:16.578 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 2, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 5, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 74, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 74, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 20, 2024-02-21T07:58:16.579 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 20, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 54, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 4, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 5, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 4, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 2, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 7 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.580 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 5, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 2, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 2, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-02-21T07:58:16.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 1, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-02-21T07:58:16.582 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 21, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 21, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-02-21T07:58:16.583 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4226953, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 16, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.052324556, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003270284 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.584 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 22, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 28, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 6, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 20, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 25, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 5, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 19, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 31, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 12, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 2, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 10, 2024-02-21T07:58:16.585 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 8, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 49792, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 207200 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 18, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 1, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 11, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 14, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 5, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.586 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003917228, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001305742 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.587 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000762963, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000762963 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000122454, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000122454 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-02-21T07:58:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000479867, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000479867 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.594 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-02-21T07:58:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.013912843, 2024-02-21T07:58:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.006956421 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 2, 2024-02-21T07:58:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 1, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 4, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 4, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 724, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.602 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 283375, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 96, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.603 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 127, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 88530, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 439, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.604 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 151, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 45864, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 27, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 151, 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-02-21T07:58:16.605 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 151, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.521986790, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003456866 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 151, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 182 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 151, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 75, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 76, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-02-21T07:58:16.606 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 1, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 17, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 12, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 16, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 74, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-02-21T07:58:16.608 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-02-21T07:58:16.609 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 30, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 10, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 10, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 28, 2024-02-21T07:58:16.610 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 4 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-02-21T07:58:16.611 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 4, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 2, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 4, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 2, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.612 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 3011, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1073959, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 3011, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 3011, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1073959, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.613 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 151, 2024-02-21T07:58:16.614 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 46082, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 151, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 46082, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-02-21T07:58:16.615 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 151, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 151, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 151, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 151, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.616 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 218, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.617 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 218, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55803a3dc6e0": { 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-02-21T07:58:16.618 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 21, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 32649, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 21, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 16, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 32649, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-02-21T07:58:16.619 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.620 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-02-21T07:58:16.620 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:16.621 INFO:tasks.check_counter:Daemon mds.j mds.exported=1 2024-02-21T07:58:16.622 INFO:tasks.check_counter:Daemon mds.j mds.imported=2 2024-02-21T07:58:16.622 DEBUG:tasks.check_counter:Getting stats from b 2024-02-21T07:58:16.622 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 216, 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 209, 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 600176, 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 124896, 2024-02-21T07:58:16.739 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.032156948, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.009847927, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.018341742, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.004504231, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 209, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.012880159, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000061627 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.740 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 600176, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 124896 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 2, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 159, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 267, 2024-02-21T07:58:16.741 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 105232, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.009680405, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007010490, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.001367342, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 158, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.005578932, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000035309 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.742 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 104960 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 0, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 0, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 131, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:16.743 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.000424179, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000015206, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000330054, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000682534, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000682534 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.744 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.745 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.746 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.747 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 148967, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 29, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.748 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2024-02-21T07:58:16.749 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 213, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 568657, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.750 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 213, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 213, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 568657, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.751 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-02-21T07:58:16.752 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.b 2024-02-21T07:58:16.752 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.b 2024-02-21T07:58:16.752 DEBUG:tasks.check_counter:Getting stats from e 2024-02-21T07:58:16.753 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok perf dump 2024-02-21T07:58:16.859 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-02-21T07:58:16.859 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.859 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 0, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 0, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 0, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.001714977, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000000000, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000342818, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.860 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.861 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 215, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 209, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 599808, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 124896, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.032161657, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.009610777, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.019967247, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.004360174, 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.862 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 209, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.011991850, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000057377 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 599808, 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 124896 2024-02-21T07:58:16.863 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 159, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 160, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 105267, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.010500934, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007662270, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.001451504, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.864 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 158, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.006453183, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000040842 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:16.865 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 105136 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.866 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.867 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.868 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 148984, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 30, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.869 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.870 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 212, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 568432, 2024-02-21T07:58:16.871 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 212, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 212, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 568432, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.872 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-02-21T07:58:16.873 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-02-21T07:58:16.874 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-02-21T07:58:16.874 DEBUG:tasks.check_counter:Getting stats from h 2024-02-21T07:58:16.874 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok perf dump 2024-02-21T07:58:16.979 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-02-21T07:58:16.979 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:16.979 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1, 2024-02-21T07:58:16.979 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 3, 2024-02-21T07:58:16.979 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 107, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 272, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.001695183, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000044787, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000416139, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000435416, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000217708 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.980 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 158, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 160, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 105091, 2024-02-21T07:58:16.981 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.008912047, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.006208322, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.001368272, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 157, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.004866599, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000030997 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.982 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 104960 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 215, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 209, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 599808, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 124896, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.029324585, 2024-02-21T07:58:16.983 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.008452965, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.018766725, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.004160612, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 209, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.011884196, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000056862 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.984 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 599808, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 124896 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:16.985 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:16.986 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:16.987 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 149001, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 31, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2024-02-21T07:58:16.988 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:16.989 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 212, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 568432, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:16.990 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 212, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 212, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 568432, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:16.991 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-02-21T07:58:16.992 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.h 2024-02-21T07:58:16.992 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.h 2024-02-21T07:58:16.993 DEBUG:tasks.check_counter:Getting stats from k 2024-02-21T07:58:16.993 DEBUG:teuthology.orchestra.run.smithi156:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.k.asok perf dump 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 4, 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 4, 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 1568, 2024-02-21T07:58:17.099 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 448, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.003452493, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000068216, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.002212565, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.003977900, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001325966 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.100 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 448 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 211, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 207, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 598240, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 124448, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.027999293, 2024-02-21T07:58:17.101 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.008915885, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.016597939, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.004512008, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 206, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.006182419, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000030011 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 598240, 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 124448 2024-02-21T07:58:17.102 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 158, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 160, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 105091, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.008585092, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.006594688, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000729424, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 157, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.004842767, 2024-02-21T07:58:17.103 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000030845 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 104960 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2024-02-21T07:58:17.104 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:17.105 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:17.106 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 148967, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 29, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:17.107 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2024-02-21T07:58:17.108 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 212, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 568432, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 212, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2024-02-21T07:58:17.109 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 212, 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 568432, 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout: } 2024-02-21T07:58:17.110 INFO:teuthology.orchestra.run.smithi156.stdout:} 2024-02-21T07:58:17.111 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-02-21T07:58:17.111 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-02-21T07:58:17.111 DEBUG:tasks.check_counter:Getting stats from c 2024-02-21T07:58:17.111 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 0, 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2, 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 0, 2024-02-21T07:58:17.385 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 131, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.001868795, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.000013478, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.000364225, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000304775, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000304775 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.386 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 1, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 159, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 160, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 105267, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.387 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.007870315, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005640376, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.000856508, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 158, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.005680110, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000035950 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 105136 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 216, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 210, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 600080, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 125520, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.030685028, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.008355481, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.017222995, 2024-02-21T07:58:17.389 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.005367269, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 210, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.012120820, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000057718 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 600080, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 125520 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.390 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:17.391 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:17.392 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 148967, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 29, 2024-02-21T07:58:17.393 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:17.394 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 213, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 568562, 2024-02-21T07:58:17.395 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 213, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 213, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 568562, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.396 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-02-21T07:58:17.397 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.c 2024-02-21T07:58:17.397 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.c 2024-02-21T07:58:17.398 DEBUG:tasks.check_counter:Getting stats from f 2024-02-21T07:58:17.398 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok perf dump 2024-02-21T07:58:17.507 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-02-21T07:58:17.507 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:17.507 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 3, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 4, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 1232, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 448, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 0, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.004331916, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.000088101, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.003478499, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.508 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 3, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.005781704, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001927234 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 1232, 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 448 2024-02-21T07:58:17.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 2, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 160, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 267, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 182912, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.008208851, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005607625, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.001233864, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T07:58:17.510 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 159, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.007359519, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000046286 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 182640 2024-02-21T07:58:17.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 212, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 208, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 598512, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 125072, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 2, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 1, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.027567769, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.009474579, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.014289655, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.004346486, 2024-02-21T07:58:17.512 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 207, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.007364302, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000035576 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 598512, 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 125072 2024-02-21T07:58:17.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:17.514 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:17.515 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:17.516 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 150015, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 31, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-02-21T07:58:17.517 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 928, 2024-02-21T07:58:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 213, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 568562, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.519 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 213, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 213, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 568562, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.520 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-02-21T07:58:17.521 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-02-21T07:58:17.522 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-02-21T07:58:17.522 DEBUG:tasks.check_counter:Getting stats from i 2024-02-21T07:58:17.522 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok perf dump 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 750, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 752, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 197711, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 233314, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.629 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.054439869, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.015608757, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.014986530, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.017667842, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 750, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.020719093, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000027625 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 7, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 163, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 2242, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 355315, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 3, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.010113789, 2024-02-21T07:58:17.631 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005795362, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.003149092, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000064236, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 162, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.010300828, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000063585 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.632 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 354688 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 969, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 961, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 879712, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 358262, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 3, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.101608079, 2024-02-21T07:58:17.633 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.029219167, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.036773559, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.030726837, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 960, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.034419010, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000035853 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.634 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 629056, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 126256 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2989, 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.079646004, 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000026646 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-02-21T07:58:17.636 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 0, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 0, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.637 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 0, 2024-02-21T07:58:17.638 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 1, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:17.639 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 0, 2024-02-21T07:58:17.640 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:17.641 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 0 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-02-21T07:58:17.642 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T07:58:17.643 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 2, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-02-21T07:58:17.644 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 2, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 2, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 4194892, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 4194352, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.645 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 2 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 3, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 3, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 0, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 1, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 1, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 0, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 0, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 0, 2024-02-21T07:58:17.646 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 44820, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 215392 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 0, 2024-02-21T07:58:17.647 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.649 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.650 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-02-21T07:58:17.651 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.652 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.653 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.654 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-02-21T07:58:17.655 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.656 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.657 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.658 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 0, 2024-02-21T07:58:17.660 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:17.661 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:17.662 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 181303, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 46, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-02-21T07:58:17.664 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 127, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 8320, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 13, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:17.665 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 1498, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 21, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 3, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 1498, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1498, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2.939929117, 2024-02-21T07:58:17.666 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001962569 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1498, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1499 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 1498, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 1498, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 0, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 746, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 0, 2024-02-21T07:58:17.667 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 750, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 0, 2024-02-21T07:58:17.668 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-02-21T07:58:17.669 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-02-21T07:58:17.670 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 30, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 2, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 4, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 4, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 0, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 2, 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 0 2024-02-21T07:58:17.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 0, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-02-21T07:58:17.672 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.673 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 1722, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 911654, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 1722, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 1722, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 911654, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.674 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 1498, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 593, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 1498, 2024-02-21T07:58:17.675 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 593, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.676 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 1498, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 1498, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 1498, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 1498, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:17.677 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.678 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x55aaf4e3c960": { 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-02-21T07:58:17.679 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.680 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-02-21T07:58:17.681 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-02-21T07:58:17.681 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-02-21T07:58:17.682 DEBUG:tasks.check_counter:Getting stats from l 2024-02-21T07:58:17.682 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.l.asok perf dump 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 2237, 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2240, 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 662862, 2024-02-21T07:58:17.789 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 695845, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 7, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.151459549, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.045559297, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.039416811, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.055501696, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2238, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.054409308, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000024311 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.790 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 3, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 162, 2024-02-21T07:58:17.791 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 716, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 430828, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 3, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.008377722, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005637231, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.001400755, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000057689, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 159, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.006652276, 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000041838 2024-02-21T07:58:17.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 430144 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 231, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 222, 2024-02-21T07:58:17.793 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 631774, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 127524, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.033805174, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.010369618, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.020471897, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.004932332, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 222, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.015629454, 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000070402 2024-02-21T07:58:17.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 630624, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 126704 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-02-21T07:58:17.795 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 3744, 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.086065426, 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000022987 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-02-21T07:58:17.796 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 0, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 0, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.797 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 9, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 9, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 0, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 9, 2024-02-21T07:58:17.798 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 3, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-02-21T07:58:17.799 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-02-21T07:58:17.800 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 0, 2024-02-21T07:58:17.801 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 0 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 0, 2024-02-21T07:58:17.802 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-02-21T07:58:17.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 21, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 2, 2024-02-21T07:58:17.804 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 2, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 4226953, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 4225302, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 21 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.805 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 9, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 19, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 10, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 7, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 15, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 8, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 9, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 19, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 10, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 0, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 0, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 0, 2024-02-21T07:58:17.806 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 47056, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 215392 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.807 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.808 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.809 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.810 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-02-21T07:58:17.812 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.813 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.814 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-02-21T07:58:17.815 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-02-21T07:58:17.816 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.818 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 1, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 2, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 1, 2024-02-21T07:58:17.819 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 2, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 2877, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T07:58:17.820 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T07:58:17.821 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-02-21T07:58:17.822 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 181343, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 47, 2024-02-21T07:58:17.823 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 7344, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 127, 2024-02-21T07:58:17.824 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 35261, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 139, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-02-21T07:58:17.825 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 2240, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 21, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 3, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 2240, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2240, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.062974324, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000474542 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-02-21T07:58:17.826 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 2240, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 2241 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 2240, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 2240, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 0, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 1474, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 0, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 764, 2024-02-21T07:58:17.827 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 0, 2024-02-21T07:58:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-02-21T07:58:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-02-21T07:58:17.830 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 30, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 2, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 4, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 4, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 0, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 2, 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 0 2024-02-21T07:58:17.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 0, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-02-21T07:58:17.832 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 2464, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 1059679, 2024-02-21T07:58:17.833 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 2464, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2464, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 1059679, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-02-21T07:58:17.834 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 2240, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 32654, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2240, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 32654, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.835 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.836 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 2240, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 2240, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 2240, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 2240, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-02-21T07:58:17.837 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.838 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x562043b4e960": { 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-02-21T07:58:17.839 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-02-21T07:58:17.840 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-02-21T07:58:17.842 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-02-21T07:58:17.842 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-02-21T07:58:17.842 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-21T07:58:17.852 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-21T07:58:17.852 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:58:17.852 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:58:17.918 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-02-21T07:58:17.918 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:58:17.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:58:18.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.187+0000 7ff965e00640 1 Processor -- start 2024-02-21T07:58:18.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.188+0000 7ff965e00640 1 -- start start 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff965e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7ff9601844e0 0x7ff9600f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff965e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff9600f9630 0x7ff9600ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff965e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96006eec0 con 0x7ff960183f70 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff965e00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96006e390 con 0x7ff9601844e0 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff965e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600f9ac0 con 0x7ff9600f9630 2024-02-21T07:58:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff960183f70 0x7ff96006e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34256/0 (socket says 172.21.15.100:34256) 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95ea00640 1 -- 172.21.15.100:0/2967672017 learned_addr learned my addr 172.21.15.100:0/2967672017 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95f400640 1 --2- 172.21.15.100:0/2967672017 >> v2:172.21.15.170:3300/0 conn(0x7ff9600f9630 0x7ff9600ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95e000640 1 --2- 172.21.15.100:0/2967672017 >> v2:172.21.15.156:3300/0 conn(0x7ff9601844e0 0x7ff9600f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95f400640 1 -- 172.21.15.100:0/2967672017 >> v2:172.21.15.156:3300/0 conn(0x7ff9601844e0 msgr2=0x7ff9600f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95f400640 1 --2- 172.21.15.100:0/2967672017 >> v2:172.21.15.156:3300/0 conn(0x7ff9601844e0 0x7ff9600f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.191+0000 7ff95f400640 1 -- 172.21.15.100:0/2967672017 >> v1:172.21.15.100:6789/0 conn(0x7ff960183f70 legacy=0x7ff96006e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.190+0000 7ff95d600640 1 -- 172.21.15.100:0/2967672017 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834383110 0 0) 0x7ff96006eec0 con 0x7ff960183f70 2024-02-21T07:58:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.191+0000 7ff95f400640 1 -- 172.21.15.100:0/2967672017 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960187520 con 0x7ff9600f9630 2024-02-21T07:58:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.192+0000 7ff95f400640 1 --2- 172.21.15.100:0/2967672017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9600f9630 0x7ff9600ca5c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff9600732f0 tx=0x7ff95802bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af6dfca9fe1eefe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.192+0000 7ff95d600640 1 -- 172.21.15.100:0/2967672017 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95802cb50 con 0x7ff9600f9630 2024-02-21T07:58:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.192+0000 7ff95d600640 1 -- 172.21.15.100:0/2967672017 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95802ccb0 con 0x7ff9600f9630 2024-02-21T07:58:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.192+0000 7ff95d600640 1 -- 172.21.15.100:0/2967672017 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958034660 con 0x7ff9600f9630 2024-02-21T07:58:18.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 -- 172.21.15.100:0/2967672017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9600f9630 msgr2=0x7ff9600ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 --2- 172.21.15.100:0/2967672017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9600f9630 0x7ff9600ca5c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff9600732f0 tx=0x7ff95802bda0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 -- 172.21.15.100:0/2967672017 shutdown_connections 2024-02-21T07:58:18.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 --2- 172.21.15.100:0/2967672017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9600f9630 0x7ff9600ca5c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 --2- 172.21.15.100:0/2967672017 >> v2:172.21.15.156:3300/0 conn(0x7ff9601844e0 0x7ff9600f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 -- 172.21.15.100:0/2967672017 >> 172.21.15.100:0/2967672017 conn(0x7ff9600ce160 msgr2=0x7ff9600ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 -- 172.21.15.100:0/2967672017 shutdown_connections 2024-02-21T07:58:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.193+0000 7ff965e00640 1 -- 172.21.15.100:0/2967672017 wait complete. 2024-02-21T07:58:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.195+0000 7ff965e00640 1 Processor -- start 2024-02-21T07:58:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.195+0000 7ff965e00640 1 -- start start 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff960183f70 0x7ff960212b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9601844e0 0x7ff960213090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960213730 con 0x7ff9600f9630 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960213a10 con 0x7ff960183f70 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff965e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960213cf0 con 0x7ff9601844e0 2024-02-21T07:58:18.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff95ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.196+0000 7ff95ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48002/0 (socket says 172.21.15.100:48002) 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 -- 172.21.15.100:0/2187031511 learned_addr learned my addr 172.21.15.100:0/2187031511 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95e000640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff960183f70 0x7ff960212b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95f400640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9601844e0 0x7ff960213090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 -- 172.21.15.100:0/2187031511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9601844e0 msgr2=0x7ff960213090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9601844e0 0x7ff960213090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 -- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff960183f70 msgr2=0x7ff960212b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff960183f70 0x7ff960212b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 -- 172.21.15.100:0/2187031511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009a70 con 0x7ff9600f9630 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.197+0000 7ff95ea00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff95000c3f0 tx=0x7ff95000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.198+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500074e0 con 0x7ff9600f9630 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.198+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff950007640 con 0x7ff9600f9630 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.198+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff960213fd0 con 0x7ff9600f9630 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.198+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950004a00 con 0x7ff9600f9630 2024-02-21T07:58:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.198+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff960214590 con 0x7ff9600f9630 2024-02-21T07:58:18.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.199+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff960067c80 con 0x7ff9600f9630 2024-02-21T07:58:18.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.201+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff950004b60 con 0x7ff9600f9630 2024-02-21T07:58:18.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.202+0000 7ff957400640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 0x7ff9400a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.202+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff9500c9910 con 0x7ff9600f9630 2024-02-21T07:58:18.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.203+0000 7ff95e000640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 0x7ff9400a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.203+0000 7ff95e000640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 0x7ff9400a1560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff9600eccd0 tx=0x7ff94c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.207+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff950093600 con 0x7ff9600f9630 2024-02-21T07:58:18.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.405+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9600f51c0 con 0x7ff9600f9630 2024-02-21T07:58:18.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.407+0000 7ff957400640 1 -- 172.21.15.100:0/2187031511 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7ff950095530 con 0x7ff9600f9630 2024-02-21T07:58:18.409 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:18.409 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:58:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 msgr2=0x7ff9400a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 0x7ff9400a1560 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff9600eccd0 tx=0x7ff94c009190 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 msgr2=0x7ff9601758d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff95000c3f0 tx=0x7ff95000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 shutdown_connections 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9601844e0 0x7ff960213090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff960183f70 0x7ff960212b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff94009f0a0 0x7ff9400a1560 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 --2- 172.21.15.100:0/2187031511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9600f9630 0x7ff9601758d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 >> 172.21.15.100:0/2187031511 conn(0x7ff9600ce160 msgr2=0x7ff9600f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 shutdown_connections 2024-02-21T07:58:18.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.410+0000 7ff965e00640 1 -- 172.21.15.100:0/2187031511 wait complete. 2024-02-21T07:58:18.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:45:19.971603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:45:24.188294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:45:24.701198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:45:28.341392+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:58:18.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:58:18.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.643+0000 7eff8f800640 1 Processor -- start 2024-02-21T07:58:18.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.644+0000 7eff8f800640 1 -- start start 2024-02-21T07:58:18.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8f800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7eff880709f0 0x7eff880f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8f800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 0x7eff8808d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8f800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff880f6e90 con 0x7eff88182970 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8f800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff880f5dc0 con 0x7eff8808d1b0 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8f800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff88070e70 con 0x7eff880709f0 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8d800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 0x7eff8808d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff87e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7eff880709f0 0x7eff880f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8d800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 0x7eff8808d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48016/0 (socket says 172.21.15.100:48016) 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.646+0000 7eff8d800640 1 -- 172.21.15.100:0/1868035560 learned_addr learned my addr 172.21.15.100:0/1868035560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.647+0000 7eff87e00640 1 -- 172.21.15.100:0/1868035560 >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 msgr2=0x7eff8808d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.647+0000 7eff87e00640 1 --2- 172.21.15.100:0/1868035560 >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 0x7eff8808d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.647+0000 7eff87e00640 1 -- 172.21.15.100:0/1868035560 >> v1:172.21.15.170:6789/0 conn(0x7eff88182970 legacy=0x7eff880702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.647+0000 7eff87e00640 1 -- 172.21.15.100:0/1868035560 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880f5fa0 con 0x7eff880709f0 2024-02-21T07:58:18.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.647+0000 7eff87400640 1 -- 172.21.15.100:0/1868035560 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514541828 0 0) 0x7eff880f6e90 con 0x7eff88182970 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.648+0000 7eff87e00640 1 --2- 172.21.15.100:0/1868035560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff880709f0 0x7eff880f5880 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff8808f440 tx=0x7eff7002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26753ac29af52e78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.648+0000 7eff87400640 1 -- 172.21.15.100:0/1868035560 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70031710 con 0x7eff880709f0 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.648+0000 7eff87400640 1 -- 172.21.15.100:0/1868035560 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7002f050 con 0x7eff880709f0 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.648+0000 7eff87400640 1 -- 172.21.15.100:0/1868035560 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70031a90 con 0x7eff880709f0 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 -- 172.21.15.100:0/1868035560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff880709f0 msgr2=0x7eff880f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 --2- 172.21.15.100:0/1868035560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff880709f0 0x7eff880f5880 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7eff8808f440 tx=0x7eff7002b7b0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 -- 172.21.15.100:0/1868035560 shutdown_connections 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 --2- 172.21.15.100:0/1868035560 >> v2:172.21.15.100:3300/0 conn(0x7eff8808d1b0 0x7eff8808d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 --2- 172.21.15.100:0/1868035560 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff880709f0 0x7eff880f5880 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 -- 172.21.15.100:0/1868035560 >> 172.21.15.100:0/1868035560 conn(0x7eff880cf3d0 msgr2=0x7eff880cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 -- 172.21.15.100:0/1868035560 shutdown_connections 2024-02-21T07:58:18.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.649+0000 7eff8f800640 1 -- 172.21.15.100:0/1868035560 wait complete. 2024-02-21T07:58:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.651+0000 7eff8f800640 1 Processor -- start 2024-02-21T07:58:18.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.651+0000 7eff8f800640 1 -- start start 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 0x7eff880ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff88182970 0x7eff880f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff880f2450 con 0x7eff880709f0 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff880f2730 con 0x7eff8808d1b0 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8f800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff880f2a10 con 0x7eff88182970 2024-02-21T07:58:18.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.652+0000 7eff8ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48030/0 (socket says 172.21.15.100:48030) 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 -- 172.21.15.100:0/1924879943 learned_addr learned my addr 172.21.15.100:0/1924879943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8d800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff88182970 0x7eff880f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff87e00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 0x7eff880ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 -- 172.21.15.100:0/1924879943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff88182970 msgr2=0x7eff880f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff88182970 0x7eff880f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 -- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 msgr2=0x7eff880ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 0x7eff880ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 -- 172.21.15.100:0/1924879943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70009400 con 0x7eff880709f0 2024-02-21T07:58:18.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff87e00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 0x7eff880ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.653+0000 7eff8ce00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c460 tx=0x7eff7800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.654+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78005480 con 0x7eff880709f0 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.654+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff780035f0 con 0x7eff880709f0 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.654+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780039a0 con 0x7eff880709f0 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.654+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff880f2cf0 con 0x7eff880709f0 2024-02-21T07:58:18.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.654+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff880f32b0 con 0x7eff880709f0 2024-02-21T07:58:18.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.655+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff88068390 con 0x7eff880709f0 2024-02-21T07:58:18.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.657+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7eff78003b00 con 0x7eff880709f0 2024-02-21T07:58:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.658+0000 7eff84c00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 0x7eff640a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.658+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7eff780c9730 con 0x7eff880709f0 2024-02-21T07:58:18.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.658+0000 7eff87e00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 0x7eff640a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:18.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.659+0000 7eff87e00640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 0x7eff640a1560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff70035000 tx=0x7eff70008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:18.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.662+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff78093420 con 0x7eff880709f0 2024-02-21T07:58:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.859+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff880d3880 con 0x7eff880709f0 2024-02-21T07:58:18.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.860+0000 7eff84c00640 1 -- 172.21.15.100:0/1924879943 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff78095350 con 0x7eff880709f0 2024-02-21T07:58:18.863 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-02-21T07:58:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 msgr2=0x7eff640a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 0x7eff640a1560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff70035000 tx=0x7eff70008030 comp rx=0 tx=0).stop 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 msgr2=0x7eff88176190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7eff7800c460 tx=0x7eff7800c920 comp rx=0 tx=0).stop 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 shutdown_connections 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff88182970 0x7eff880f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff8808d1b0 0x7eff880ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7eff6409f0a0 0x7eff640a1560 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 --2- 172.21.15.100:0/1924879943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff880709f0 0x7eff88176190 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 >> 172.21.15.100:0/1924879943 conn(0x7eff880cf3d0 msgr2=0x7eff88071610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 shutdown_connections 2024-02-21T07:58:18.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:18.863+0000 7eff8f800640 1 -- 172.21.15.100:0/1924879943 wait complete. 2024-02-21T07:58:18.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:58:19.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:19.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:19.073 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:19.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.095+0000 7fc58d200640 1 Processor -- start 2024-02-21T07:58:19.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.095+0000 7fc58d200640 1 -- start start 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.096+0000 7fc58d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc58806ab60 0x7fc5881871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.096+0000 7fc58d200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880ca6a0 con 0x7fc588189ca0 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.096+0000 7fc58d200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880f6200 con 0x7fc58818a080 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc58d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58818abe0 con 0x7fc58806ab60 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc58806ab60 0x7fc5881871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc588189ca0 0x7fc5880cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34258/0 (socket says 172.21.15.100:34258) 2024-02-21T07:58:19.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585e00640 1 -- 172.21.15.100:0/2189274745 learned_addr learned my addr 172.21.15.100:0/2189274745 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585400640 1 -- 172.21.15.100:0/2189274745 >> v1:172.21.15.170:6789/0 conn(0x7fc58818a080 legacy=0x7fc58818a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585400640 1 -- 172.21.15.100:0/2189274745 >> v1:172.21.15.100:6789/0 conn(0x7fc588189ca0 legacy=0x7fc5880cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc584a00640 1 -- 172.21.15.100:0/2189274745 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141783124 0 0) 0x7fc5880f6200 con 0x7fc58818a080 2024-02-21T07:58:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.097+0000 7fc585400640 1 -- 172.21.15.100:0/2189274745 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58806afc0 con 0x7fc58806ab60 2024-02-21T07:58:19.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.098+0000 7fc585400640 1 --2- 172.21.15.100:0/2189274745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc5881871c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc5740097a0 tx=0x7fc57402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe24a9ac399b3d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.099+0000 7fc584a00640 1 -- 172.21.15.100:0/2189274745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574030610 con 0x7fc58806ab60 2024-02-21T07:58:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.099+0000 7fc584a00640 1 -- 172.21.15.100:0/2189274745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574030770 con 0x7fc58806ab60 2024-02-21T07:58:19.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.099+0000 7fc584a00640 1 -- 172.21.15.100:0/2189274745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574030b00 con 0x7fc58806ab60 2024-02-21T07:58:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.099+0000 7fc58d200640 1 -- 172.21.15.100:0/2189274745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 msgr2=0x7fc5881871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.099+0000 7fc58d200640 1 --2- 172.21.15.100:0/2189274745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc5881871c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc5740097a0 tx=0x7fc57402b960 comp rx=0 tx=0).stop 2024-02-21T07:58:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.100+0000 7fc58d200640 1 -- 172.21.15.100:0/2189274745 shutdown_connections 2024-02-21T07:58:19.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.100+0000 7fc58d200640 1 --2- 172.21.15.100:0/2189274745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc5881871c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.100+0000 7fc58d200640 1 -- 172.21.15.100:0/2189274745 >> 172.21.15.100:0/2189274745 conn(0x7fc5880668b0 msgr2=0x7fc588066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.100+0000 7fc58d200640 1 -- 172.21.15.100:0/2189274745 shutdown_connections 2024-02-21T07:58:19.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.100+0000 7fc58d200640 1 -- 172.21.15.100:0/2189274745 wait complete. 2024-02-21T07:58:19.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.102+0000 7fc58d200640 1 Processor -- start 2024-02-21T07:58:19.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.103+0000 7fc58d200640 1 -- start start 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc588189ca0 0x7fc588163060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58816b560 con 0x7fc58806ab60 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58816b840 con 0x7fc588189ca0 2024-02-21T07:58:19.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc58d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58816bb20 con 0x7fc58818a080 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc585e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc586800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc585e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48040/0 (socket says 172.21.15.100:48040) 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc585e00640 1 -- 172.21.15.100:0/1674901854 learned_addr learned my addr 172.21.15.100:0/1674901854 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc586800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:50422/0 (socket says 172.21.15.100:50422) 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.104+0000 7fc585400640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc588189ca0 0x7fc588163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 -- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc588189ca0 msgr2=0x7fc588163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc588189ca0 0x7fc588163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 -- 172.21.15.100:0/1674901854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 msgr2=0x7fc588162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 -- 172.21.15.100:0/1674901854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009400 con 0x7fc58818a080 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc585e00640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc586800640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c750 tx=0x7fc58000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580003b70 con 0x7fc58818a080 2024-02-21T07:58:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580003cf0 con 0x7fc58818a080 2024-02-21T07:58:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5800052b0 con 0x7fc58818a080 2024-02-21T07:58:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58816be00 con 0x7fc58818a080 2024-02-21T07:58:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.105+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58816b030 con 0x7fc58818a080 2024-02-21T07:58:19.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.106+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58808e1c0 con 0x7fc58818a080 2024-02-21T07:58:19.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.109+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc580005410 con 0x7fc58818a080 2024-02-21T07:58:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.110+0000 7fc57e000640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 0x7fc5680a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.110+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5800c98a0 con 0x7fc58818a080 2024-02-21T07:58:19.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.110+0000 7fc585e00640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 0x7fc5680a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.111+0000 7fc585e00640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 0x7fc5680a1560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc578004e60 tx=0x7fc578007f10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.114+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc580093590 con 0x7fc58818a080 2024-02-21T07:58:19.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.310+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc588067c80 con 0x7fc58818a080 2024-02-21T07:58:19.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.311+0000 7fc57e000640 1 -- 172.21.15.100:0/1674901854 <== mon.2 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc580003e60 con 0x7fc58818a080 2024-02-21T07:58:19.313 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 msgr2=0x7fc5680a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 0x7fc5680a1560 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc578004e60 tx=0x7fc578007f10 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 msgr2=0x7fc58821c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c750 tx=0x7fc58000cc10 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 shutdown_connections 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc58818a080 0x7fc58821c520 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc588189ca0 0x7fc588163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc56809f0a0 0x7fc5680a1560 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 --2- 172.21.15.100:0/1674901854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc58806ab60 0x7fc588162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.314+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 >> 172.21.15.100:0/1674901854 conn(0x7fc5880668b0 msgr2=0x7fc5880f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.315+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 shutdown_connections 2024-02-21T07:58:19.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.315+0000 7fc58d200640 1 -- 172.21.15.100:0/1674901854 wait complete. 2024-02-21T07:58:19.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:58:19.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.552+0000 7fbb33600640 1 Processor -- start 2024-02-21T07:58:19.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.552+0000 7fbb33600640 1 -- start start 2024-02-21T07:58:19.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fbb2c1871c0 0x7fbb2c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 0x7fbb2c18a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ca6a0 con 0x7fbb2c189ca0 2024-02-21T07:58:19.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0f6450 con 0x7fbb2c1871c0 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.554+0000 7fbb33600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2c0ca8d0 con 0x7fbb2c18a080 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48044/0 (socket says 172.21.15.100:48044) 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 -- 172.21.15.100:0/3606124507 learned_addr learned my addr 172.21.15.100:0/3606124507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb31600640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 0x7fbb2c18a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb2be00640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.156:3300/0 conn(0x7fbb2c1871c0 0x7fbb2c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 -- 172.21.15.100:0/3606124507 >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 msgr2=0x7fbb2c18a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 0x7fbb2c18a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 -- 172.21.15.100:0/3606124507 >> v2:172.21.15.156:3300/0 conn(0x7fbb2c1871c0 msgr2=0x7fbb2c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.156:3300/0 conn(0x7fbb2c1871c0 0x7fbb2c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb30c00640 1 -- 172.21.15.100:0/3606124507 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0cabb0 con 0x7fbb2c189ca0 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.555+0000 7fbb31600640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 0x7fbb2c18a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.556+0000 7fbb30c00640 1 --2- 172.21.15.100:0/3606124507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c067a70 tx=0x7fbb2002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3637d4a43f38c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.556+0000 7fbb2b400640 1 -- 172.21.15.100:0/3606124507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20031880 con 0x7fbb2c189ca0 2024-02-21T07:58:19.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb2b400640 1 -- 172.21.15.100:0/3606124507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb200319e0 con 0x7fbb2c189ca0 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb2b400640 1 -- 172.21.15.100:0/3606124507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20031d70 con 0x7fbb2c189ca0 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 -- 172.21.15.100:0/3606124507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c189ca0 msgr2=0x7fbb2c06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 --2- 172.21.15.100:0/3606124507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c067a70 tx=0x7fbb2002b920 comp rx=0 tx=0).stop 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 -- 172.21.15.100:0/3606124507 shutdown_connections 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.170:3300/0 conn(0x7fbb2c18a080 0x7fbb2c18a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 --2- 172.21.15.100:0/3606124507 >> v2:172.21.15.156:3300/0 conn(0x7fbb2c1871c0 0x7fbb2c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 --2- 172.21.15.100:0/3606124507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 -- 172.21.15.100:0/3606124507 >> 172.21.15.100:0/3606124507 conn(0x7fbb2c0668b0 msgr2=0x7fbb2c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:19.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 -- 172.21.15.100:0/3606124507 shutdown_connections 2024-02-21T07:58:19.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.557+0000 7fbb33600640 1 -- 172.21.15.100:0/3606124507 wait complete. 2024-02-21T07:58:19.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.559+0000 7fbb33600640 1 Processor -- start 2024-02-21T07:58:19.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.560+0000 7fbb33600640 1 -- start start 2024-02-21T07:58:19.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c1871c0 0x7fbb2c188ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c181550 con 0x7fbb2c18a080 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c187c40 con 0x7fbb2c189ca0 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb33600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c187f20 con 0x7fbb2c1871c0 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb31600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb30c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c1871c0 0x7fbb2c188ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb31600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48046/0 (socket says 172.21.15.100:48046) 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb31600640 1 -- 172.21.15.100:0/925752574 learned_addr learned my addr 172.21.15.100:0/925752574 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.561+0000 7fbb2be00640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 -- 172.21.15.100:0/925752574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c1871c0 msgr2=0x7fbb2c188ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c1871c0 0x7fbb2c188ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 -- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2c189ca0 msgr2=0x7fbb2c06ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 -- 172.21.15.100:0/925752574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200094d0 con 0x7fbb2c18a080 2024-02-21T07:58:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb31600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb24007ef0 tx=0x7fbb2400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24003b90 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400f040 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400de80 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c188200 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.562+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c1887c0 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.564+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c08e1c0 con 0x7fbb2c18a080 2024-02-21T07:58:19.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.565+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbb24004030 con 0x7fbb2c18a080 2024-02-21T07:58:19.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.567+0000 7fbb28c00640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 0x7fbb0c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:19.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.567+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbb240c9dd0 con 0x7fbb2c18a080 2024-02-21T07:58:19.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.567+0000 7fbb30c00640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 0x7fbb0c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:19.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.568+0000 7fbb30c00640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 0x7fbb0c0a1590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb20036000 tx=0x7fbb2003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:19.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.571+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb24093c00 con 0x7fbb2c18a080 2024-02-21T07:58:19.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.771+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb2c067c80 con 0x7fbb2c18a080 2024-02-21T07:58:19.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.772+0000 7fbb28c00640 1 -- 172.21.15.100:0/925752574 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb2401a0a0 con 0x7fbb2c18a080 2024-02-21T07:58:19.774 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.774+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 msgr2=0x7fbb0c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.774+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 0x7fbb0c0a1590 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb20036000 tx=0x7fbb2003c040 comp rx=0 tx=0).stop 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.774+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 msgr2=0x7fbb2c1770d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.774+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbb24007ef0 tx=0x7fbb2400d4a0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 shutdown_connections 2024-02-21T07:58:19.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fbb0c09f0d0 0x7fbb0c0a1590 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c18a080 0x7fbb2c1770d0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbb2c189ca0 0x7fbb2c06ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 --2- 172.21.15.100:0/925752574 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbb2c1871c0 0x7fbb2c188ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 >> 172.21.15.100:0/925752574 conn(0x7fbb2c0668b0 msgr2=0x7fbb2c06f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 shutdown_connections 2024-02-21T07:58:19.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:19.775+0000 7fbb33600640 1 -- 172.21.15.100:0/925752574 wait complete. 2024-02-21T07:58:19.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:58:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.005+0000 7f4a53a00640 1 Processor -- start 2024-02-21T07:58:20.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.005+0000 7f4a53a00640 1 -- start start 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.007+0000 7f4a53a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a4c06edc0 0x7f4a4c190640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.007+0000 7f4a53a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c18dc80 con 0x7f4a4c190260 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.007+0000 7f4a53a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0f55d0 con 0x7f4a4c070a30 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a53a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0f5b90 con 0x7f4a4c06edc0 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4a4c190260 0x7f4a4c0f4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56484/0 (socket says 172.21.15.100:56484) 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51000640 1 -- 172.21.15.100:0/752463401 learned_addr learned my addr 172.21.15.100:0/752463401 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:20.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51a00640 1 --2- 172.21.15.100:0/752463401 >> v2:172.21.15.100:3300/0 conn(0x7f4a4c06edc0 0x7f4a4c190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811764292 0 0) 0x7f4a4c0f55d0 con 0x7f4a4c070a30 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a34003520 con 0x7f4a4c070a30 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127956320 0 0) 0x7f4a4c18dc80 con 0x7f4a4c190260 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a4c0f55d0 con 0x7f4a4c190260 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51a00640 1 -- 172.21.15.100:0/752463401 >> v1:172.21.15.170:6789/0 conn(0x7f4a4c070a30 legacy=0x7f4a4c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51a00640 1 -- 172.21.15.100:0/752463401 >> v1:172.21.15.100:6789/0 conn(0x7f4a4c190260 legacy=0x7f4a4c0f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.008+0000 7f4a51a00640 1 -- 172.21.15.100:0/752463401 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0f58b0 con 0x7f4a4c06edc0 2024-02-21T07:58:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.009+0000 7f4a51a00640 1 --2- 172.21.15.100:0/752463401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c06edc0 0x7f4a4c190640 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009d90 tx=0x7f4a4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570ea521a8c5b68 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4402cbd0 con 0x7f4a4c06edc0 2024-02-21T07:58:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4402cd30 con 0x7f4a4c06edc0 2024-02-21T07:58:20.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a4b400640 1 -- 172.21.15.100:0/752463401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4402cea0 con 0x7f4a4c06edc0 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a53a00640 1 -- 172.21.15.100:0/752463401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c06edc0 msgr2=0x7f4a4c190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a53a00640 1 --2- 172.21.15.100:0/752463401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c06edc0 0x7f4a4c190640 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009d90 tx=0x7f4a4402be20 comp rx=0 tx=0).stop 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a53a00640 1 -- 172.21.15.100:0/752463401 shutdown_connections 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a53a00640 1 --2- 172.21.15.100:0/752463401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c06edc0 0x7f4a4c190640 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.010+0000 7f4a53a00640 1 -- 172.21.15.100:0/752463401 >> 172.21.15.100:0/752463401 conn(0x7f4a4c0668b0 msgr2=0x7f4a4c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.011+0000 7f4a53a00640 1 -- 172.21.15.100:0/752463401 shutdown_connections 2024-02-21T07:58:20.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.011+0000 7f4a53a00640 1 -- 172.21.15.100:0/752463401 wait complete. 2024-02-21T07:58:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.012+0000 7f4a53a00640 1 Processor -- start 2024-02-21T07:58:20.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.013+0000 7f4a53a00640 1 -- start start 2024-02-21T07:58:20.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 0x7f4a4c16e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a4c0efcf0 0x7f4a4c0f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c2244b0 con 0x7f4a4c190260 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0ef860 con 0x7f4a4c0efcf0 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a53a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c16e810 con 0x7f4a4c070a30 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a4be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a51000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 0x7f4a4c16e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a4be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54682/0 (socket says 172.21.15.100:54682) 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a4be00640 1 -- 172.21.15.100:0/1567032347 learned_addr learned my addr 172.21.15.100:0/1567032347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.014+0000 7f4a51a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a4c0efcf0 0x7f4a4c0f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 -- 172.21.15.100:0/1567032347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 msgr2=0x7f4a4c16e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 0x7f4a4c16e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 -- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a4c0efcf0 msgr2=0x7f4a4c0f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a4c0efcf0 0x7f4a4c0f0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 -- 172.21.15.100:0/1567032347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009a70 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a51000640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 0x7f4a4c16e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a4be00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c3a0 tx=0x7f4a3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a380052d0 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38005430 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38003830 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c188d60 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.015+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c0ef210 con 0x7f4a4c190260 2024-02-21T07:58:20.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.016+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c18a0d0 con 0x7f4a4c190260 2024-02-21T07:58:20.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.018+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4a38003990 con 0x7f4a4c190260 2024-02-21T07:58:20.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.020+0000 7f4a48c00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 0x7f4a2c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.020+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4a380c8fe0 con 0x7f4a4c190260 2024-02-21T07:58:20.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.020+0000 7f4a51000640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 0x7f4a2c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.021+0000 7f4a51000640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 0x7f4a2c0a1590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005880 tx=0x7f4a40009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.024+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4a38092dc0 con 0x7f4a4c190260 2024-02-21T07:58:20.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.221+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4a4c0ef9a0 con 0x7f4a4c190260 2024-02-21T07:58:20.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.222+0000 7f4a48c00640 1 -- 172.21.15.100:0/1567032347 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4a380170a0 con 0x7f4a4c190260 2024-02-21T07:58:20.223 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-02-21T07:58:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 msgr2=0x7f4a2c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 0x7f4a2c0a1590 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a40005880 tx=0x7f4a40009040 comp rx=0 tx=0).stop 2024-02-21T07:58:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 msgr2=0x7f4a4c1896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800c3a0 tx=0x7f4a3800c860 comp rx=0 tx=0).stop 2024-02-21T07:58:20.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 shutdown_connections 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.224+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4a4c0efcf0 0x7f4a4c0f0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4a2c09f0d0 0x7f4a2c0a1590 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a4c190260 0x7f4a4c1896b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 --2- 172.21.15.100:0/1567032347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4a4c070a30 0x7f4a4c16e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 >> 172.21.15.100:0/1567032347 conn(0x7f4a4c0668b0 msgr2=0x7f4a4c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 shutdown_connections 2024-02-21T07:58:20.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.225+0000 7f4a53a00640 1 -- 172.21.15.100:0/1567032347 wait complete. 2024-02-21T07:58:20.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:58:20.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.454+0000 7f3865000640 1 Processor -- start 2024-02-21T07:58:20.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.454+0000 7f3865000640 1 -- start start 2024-02-21T07:58:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f3865000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f386006da30 0x7f386006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f3865000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600f5580 con 0x7f3860186280 2024-02-21T07:58:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f3865000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38600f5860 con 0x7f3860070a70 2024-02-21T07:58:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f3865000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38601898e0 con 0x7f386006da30 2024-02-21T07:58:20.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f385de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3860186280 0x7f3860189dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56498/0 (socket says 172.21.15.100:56498) 2024-02-21T07:58:20.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f385de00640 1 -- 172.21.15.100:0/1512144701 learned_addr learned my addr 172.21.15.100:0/1512144701 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:20.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.456+0000 7f385e800640 1 --2- 172.21.15.100:0/1512144701 >> v2:172.21.15.170:3300/0 conn(0x7f386006da30 0x7f386006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633197840 0 0) 0x7f38600f5580 con 0x7f3860186280 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3840003520 con 0x7f3860186280 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152184651 0 0) 0x7f38600f5860 con 0x7f3860070a70 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38600f5580 con 0x7f3860070a70 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385e800640 1 -- 172.21.15.100:0/1512144701 >> v1:172.21.15.156:6789/0 conn(0x7f3860070a70 legacy=0x7f386018a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385e800640 1 -- 172.21.15.100:0/1512144701 >> v1:172.21.15.100:6789/0 conn(0x7f3860186280 legacy=0x7f3860189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.457+0000 7f385e800640 1 -- 172.21.15.100:0/1512144701 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600f5b40 con 0x7f386006da30 2024-02-21T07:58:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.458+0000 7f385e800640 1 --2- 172.21.15.100:0/1512144701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f386006da30 0x7f386006de40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f38580097a0 tx=0x7f385802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f8ac19e7f4c9a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.458+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858031830 con 0x7f386006da30 2024-02-21T07:58:20.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.458+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858031990 con 0x7f386006da30 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.458+0000 7f385ca00640 1 -- 172.21.15.100:0/1512144701 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858031d20 con 0x7f386006da30 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 -- 172.21.15.100:0/1512144701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f386006da30 msgr2=0x7f386006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 --2- 172.21.15.100:0/1512144701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f386006da30 0x7f386006de40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f38580097a0 tx=0x7f385802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 -- 172.21.15.100:0/1512144701 shutdown_connections 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 --2- 172.21.15.100:0/1512144701 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f386006da30 0x7f386006de40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 -- 172.21.15.100:0/1512144701 >> 172.21.15.100:0/1512144701 conn(0x7f38600668b0 msgr2=0x7f3860066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 -- 172.21.15.100:0/1512144701 shutdown_connections 2024-02-21T07:58:20.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.459+0000 7f3865000640 1 -- 172.21.15.100:0/1512144701 wait complete. 2024-02-21T07:58:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.461+0000 7f3865000640 1 Processor -- start 2024-02-21T07:58:20.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.461+0000 7f3865000640 1 -- start start 2024-02-21T07:58:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3860070a70 0x7f386021f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 0x7f386017b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860213a00 con 0x7f386006da30 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386017aa00 con 0x7f3860070a70 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.462+0000 7f3865000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386017ace0 con 0x7f3860186280 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54698/0 (socket says 172.21.15.100:54698) 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 -- 172.21.15.100:0/3062618082 learned_addr learned my addr 172.21.15.100:0/3062618082 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385e800640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 0x7f386017b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385d400640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3860070a70 0x7f386021f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 -- 172.21.15.100:0/3062618082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 msgr2=0x7f386017b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 0x7f386017b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 -- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3860070a70 msgr2=0x7f386021f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3860070a70 0x7f386021f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385de00640 1 -- 172.21.15.100:0/3062618082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009400 con 0x7f386006da30 2024-02-21T07:58:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.463+0000 7f385e800640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 0x7f386017b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f385de00640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f385000c3c0 tx=0x7f385000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850005da0 con 0x7f386006da30 2024-02-21T07:58:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38500070d0 con 0x7f386006da30 2024-02-21T07:58:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850007460 con 0x7f386006da30 2024-02-21T07:58:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386017afc0 con 0x7f386006da30 2024-02-21T07:58:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.464+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386016f690 con 0x7f386006da30 2024-02-21T07:58:20.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.465+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386017b4e0 con 0x7f386006da30 2024-02-21T07:58:20.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.467+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f38500075c0 con 0x7f386006da30 2024-02-21T07:58:20.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.469+0000 7f3856000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 0x7f383c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:20.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.469+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f38500c9150 con 0x7f386006da30 2024-02-21T07:58:20.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.469+0000 7f385d400640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 0x7f383c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:20.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.470+0000 7f385d400640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 0x7f383c0a1560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3860215db0 tx=0x7f3848009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:20.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.472+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f386017b4e0 con 0x7f386006da30 2024-02-21T07:58:20.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.688+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f386017b4e0 con 0x7f386006da30 2024-02-21T07:58:20.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.689+0000 7f3856000640 1 -- 172.21.15.100:0/3062618082 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f386017b4e0 con 0x7f386006da30 2024-02-21T07:58:20.691 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 msgr2=0x7f383c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 0x7f383c0a1560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3860215db0 tx=0x7f3848009040 comp rx=0 tx=0).stop 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 msgr2=0x7f386016f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f385000c3c0 tx=0x7f385000c880 comp rx=0 tx=0).stop 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 shutdown_connections 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3860186280 0x7f386017b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3860070a70 0x7f386021f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f383c09f0a0 0x7f383c0a1560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 --2- 172.21.15.100:0/3062618082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f386006da30 0x7f386016f150 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.692+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 >> 172.21.15.100:0/3062618082 conn(0x7f38600668b0 msgr2=0x7f38600f76b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.693+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 shutdown_connections 2024-02-21T07:58:20.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:20.693+0000 7f3865000640 1 -- 172.21.15.100:0/3062618082 wait complete. 2024-02-21T07:58:20.712 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-21T07:58:20.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:58:20.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-21T07:58:20.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:58:20.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:58:20.861 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-21T07:58:20.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:58:20.915 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-02-21T07:58:20.979 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T07:58:20.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:58:20.981 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T07:58:21.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:58:21.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-02-21T07:58:21.174 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-21T07:58:21.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T07:58:21.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:58:21.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.371+0000 7febb4a00640 1 Processor -- start 2024-02-21T07:58:21.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.371+0000 7febb4a00640 1 -- start start 2024-02-21T07:58:21.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febb4a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7febb0072f00 0x7febb006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febb4a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7febb006d7c0 0x7febb006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febb4a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb006dcf0 con 0x7febb0185e10 2024-02-21T07:58:21.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febb4a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb00f43a0 con 0x7febb0072f00 2024-02-21T07:58:21.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febb4a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb0070af0 con 0x7febb006d7c0 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febade00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7febb0072f00 0x7febb006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febade00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7febb0072f00 0x7febb006f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54700/0 (socket says 172.21.15.100:54700) 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febade00640 1 -- 172.21.15.100:0/49669288 learned_addr learned my addr 172.21.15.100:0/49669288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febae800640 1 --1- 172.21.15.100:0/49669288 >> v1:172.21.15.100:6789/0 conn(0x7febb0185e10 0x7febb00703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56512/0 (socket says 172.21.15.100:56512) 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.373+0000 7febaf200640 1 --2- 172.21.15.100:0/49669288 >> v2:172.21.15.170:3300/0 conn(0x7febb006d7c0 0x7febb006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.374+0000 7febad400640 1 -- 172.21.15.100:0/49669288 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717955960 0 0) 0x7febb006dcf0 con 0x7febb0185e10 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.374+0000 7febade00640 1 -- 172.21.15.100:0/49669288 >> v2:172.21.15.170:3300/0 conn(0x7febb006d7c0 msgr2=0x7febb006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.374+0000 7febade00640 1 --2- 172.21.15.100:0/49669288 >> v2:172.21.15.170:3300/0 conn(0x7febb006d7c0 0x7febb006fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.374+0000 7febade00640 1 -- 172.21.15.100:0/49669288 >> v1:172.21.15.100:6789/0 conn(0x7febb0185e10 legacy=0x7febb00703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.374+0000 7febade00640 1 -- 172.21.15.100:0/49669288 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0189670 con 0x7febb0072f00 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.375+0000 7febade00640 1 --2- 172.21.15.100:0/49669288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb006f600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7febb00f6470 tx=0x7feb9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77911f19d312168 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.375+0000 7febad400640 1 -- 172.21.15.100:0/49669288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0317e0 con 0x7febb0072f00 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.375+0000 7febad400640 1 -- 172.21.15.100:0/49669288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c031940 con 0x7febb0072f00 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.375+0000 7febad400640 1 -- 172.21.15.100:0/49669288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c031cd0 con 0x7febb0072f00 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 -- 172.21.15.100:0/49669288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 msgr2=0x7febb006f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 --2- 172.21.15.100:0/49669288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb006f600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7febb00f6470 tx=0x7feb9c02b880 comp rx=0 tx=0).stop 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 -- 172.21.15.100:0/49669288 shutdown_connections 2024-02-21T07:58:21.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 --2- 172.21.15.100:0/49669288 >> v2:172.21.15.170:3300/0 conn(0x7febb006d7c0 0x7febb006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 --2- 172.21.15.100:0/49669288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb006f600 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 -- 172.21.15.100:0/49669288 >> 172.21.15.100:0/49669288 conn(0x7febb00f64a0 msgr2=0x7febb00f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 -- 172.21.15.100:0/49669288 shutdown_connections 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.376+0000 7febb4a00640 1 -- 172.21.15.100:0/49669288 wait complete. 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.378+0000 7febb4a00640 1 Processor -- start 2024-02-21T07:58:21.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.378+0000 7febb4a00640 1 -- start start 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb006d7c0 0x7febb016be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febb0185e10 0x7febb01839e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb00ee900 con 0x7febb0072f00 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb01869e0 con 0x7febb0185e10 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.379+0000 7febb4a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb016c3a0 con 0x7febb006d7c0 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54702/0 (socket says 172.21.15.100:54702) 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 -- 172.21.15.100:0/1683548555 learned_addr learned my addr 172.21.15.100:0/1683548555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febae800640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb006d7c0 0x7febb016be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febaf200640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febb0185e10 0x7febb01839e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 -- 172.21.15.100:0/1683548555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb006d7c0 msgr2=0x7febb016be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb006d7c0 0x7febb016be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 -- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febb0185e10 msgr2=0x7febb01839e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febb0185e10 0x7febb01839e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 -- 172.21.15.100:0/1683548555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0094d0 con 0x7febb0072f00 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.380+0000 7febade00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.381+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c032880 con 0x7febb0072f00 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.381+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0329e0 con 0x7febb0072f00 2024-02-21T07:58:21.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.381+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c032d90 con 0x7febb0072f00 2024-02-21T07:58:21.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.381+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb01840c0 con 0x7febb0072f00 2024-02-21T07:58:21.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.381+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb0184680 con 0x7febb0072f00 2024-02-21T07:58:21.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.382+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb0186b50 con 0x7febb0072f00 2024-02-21T07:58:21.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.384+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feb9c04e450 con 0x7febb0072f00 2024-02-21T07:58:21.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.385+0000 7feba6a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 0x7feb900a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.385+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb9c0ebc10 con 0x7febb0072f00 2024-02-21T07:58:21.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.386+0000 7febae800640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 0x7feb900a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.386+0000 7febae800640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 0x7feb900a1560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feba0007f70 tx=0x7feba0007f00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.389+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb9c0b5990 con 0x7febb0072f00 2024-02-21T07:58:21.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.581+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7febb006e590 con 0x7feb9009f0a0 2024-02-21T07:58:21.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.595+0000 7feba6a00640 1 -- 172.21.15.100:0/1683548555 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+420605 (secure 0 0 0) 0x7feba0004c70 con 0x7feb9009f0a0 2024-02-21T07:58:21.602 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:21.604 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:58:21.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 msgr2=0x7feb900a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 0x7feb900a1560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feba0007f70 tx=0x7feba0007f00 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 msgr2=0x7febb01834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7feb9c000c00 tx=0x7feb9c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 shutdown_connections 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febb0185e10 0x7febb01839e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb9009f0a0 0x7feb900a1560 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb0072f00 0x7febb01834a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 --2- 172.21.15.100:0/1683548555 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febb006d7c0 0x7febb016be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 >> 172.21.15.100:0/1683548555 conn(0x7febb00f64a0 msgr2=0x7febb00703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 shutdown_connections 2024-02-21T07:58:21.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.601+0000 7febb4a00640 1 -- 172.21.15.100:0/1683548555 wait complete. 2024-02-21T07:58:21.621 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-02-21T07:58:20.089238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3662778,"num_objects":78,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5816,"num_read_kb":10139,"num_write":755942,"num_write_kb":194947101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72890,"ondisk_log_size":72890,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3117696,"kb_used_data":6624,"kb_used_omap":18,"kb_used_meta":3110957,"kb_avail":1129344384,"statfs":{"total":1159641169920,"available":1156448649216,"internally_reserved":0,"allocated":6782976,"data_stored":9184040,"data_compressed":1002998,"data_compressed_allocated":1376256,"data_compressed_original":6144000,"omap_allocated":19141,"internal_metadata":3185620283},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4295213369,"num_objects":-1028,"num_object_clones":0,"num_object_copies":-4108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1028,"num_whiteouts":0,"num_read":90,"num_read_kb":59,"num_write":1038,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003348"},"pg_stats":[{"pgid":"2.1f","version":"30'109","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.687409+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:57:46.687409+0000","last_peered":"2024-02-21T07:57:46.687409+0000","last_clean":"2024-02-21T07:57:46.687409+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:57:46.687409+0000","last_undegraded":"2024-02-21T07:57:46.687409+0000","last_fullsized":"2024-02-21T07:57:46.687409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":57,"num_write":210,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"30'5","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859091+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:55:29.859091+0000","last_peered":"2024-02-21T07:55:29.859091+0000","last_clean":"2024-02-21T07:55:29.859091+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:55:29.859091+0000","last_undegraded":"2024-02-21T07:55:29.859091+0000","last_fullsized":"2024-02-21T07:55:29.859091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'2349","reported_seq":2379,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733484+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:58:07.733484+0000","last_peered":"2024-02-21T07:58:07.733484+0000","last_clean":"2024-02-21T07:58:07.733484+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:58:07.733484+0000","last_undegraded":"2024-02-21T07:58:07.733484+0000","last_fullsized":"2024-02-21T07:58:07.733484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25104,"num_write_kb":6480128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"30'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:30.027684+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:57:30.027684+0000","last_peered":"2024-02-21T07:57:30.027684+0000","last_clean":"2024-02-21T07:57:30.027684+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:57:30.027684+0000","last_undegraded":"2024-02-21T07:57:30.027684+0000","last_fullsized":"2024-02-21T07:57:30.027684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683193+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:55:54.683193+0000","last_peered":"2024-02-21T07:55:54.683193+0000","last_clean":"2024-02-21T07:55:54.683193+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:55:54.683193+0000","last_undegraded":"2024-02-21T07:55:54.683193+0000","last_fullsized":"2024-02-21T07:55:54.683193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'2450","reported_seq":2473,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.756048+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:58:07.756048+0000","last_peered":"2024-02-21T07:58:07.756048+0000","last_clean":"2024-02-21T07:58:07.756048+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:58:07.756048+0000","last_undegraded":"2024-02-21T07:58:07.756048+0000","last_fullsized":"2024-02-21T07:58:07.756048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26394,"num_write_kb":6774912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"30'6","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426615+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:57:46.426615+0000","last_peered":"2024-02-21T07:57:46.426615+0000","last_clean":"2024-02-21T07:57:46.426615+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:57:46.426615+0000","last_undegraded":"2024-02-21T07:57:46.426615+0000","last_fullsized":"2024-02-21T07:57:46.426615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.012104+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:55:29.012104+0000","last_peered":"2024-02-21T07:55:29.012104+0000","last_clean":"2024-02-21T07:55:29.012104+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:55:29.012104+0000","last_undegraded":"2024-02-21T07:55:29.012104+0000","last_fullsized":"2024-02-21T07:55:29.012104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1816","reported_seq":1857,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782324+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:58:07.782324+0000","last_peered":"2024-02-21T07:58:07.782324+0000","last_clean":"2024-02-21T07:58:07.782324+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:58:07.782324+0000","last_undegraded":"2024-02-21T07:58:07.782324+0000","last_fullsized":"2024-02-21T07:58:07.782324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19208,"num_write_kb":5027530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.425159+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:57:46.425159+0000","last_peered":"2024-02-21T07:57:46.425159+0000","last_clean":"2024-02-21T07:57:46.425159+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:57:46.425159+0000","last_undegraded":"2024-02-21T07:57:46.425159+0000","last_fullsized":"2024-02-21T07:57:46.425159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:59.075455+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:57:59.075455+0000","last_peered":"2024-02-21T07:57:59.075455+0000","last_clean":"2024-02-21T07:57:59.075455+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:57:59.075455+0000","last_undegraded":"2024-02-21T07:57:59.075455+0000","last_fullsized":"2024-02-21T07:57:59.075455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1978","reported_seq":2001,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.789935+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:58:07.789935+0000","last_peered":"2024-02-21T07:58:07.789935+0000","last_clean":"2024-02-21T07:58:07.789935+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:58:07.789935+0000","last_undegraded":"2024-02-21T07:58:07.789935+0000","last_fullsized":"2024-02-21T07:58:07.789935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21148,"num_write_kb":5478976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.017379+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:54:09.017379+0000","last_peered":"2024-02-21T07:54:09.017379+0000","last_clean":"2024-02-21T07:54:09.017379+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:54:09.017379+0000","last_undegraded":"2024-02-21T07:54:09.017379+0000","last_fullsized":"2024-02-21T07:54:09.017379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"30'54","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426547+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:57:46.426547+0000","last_peered":"2024-02-21T07:57:46.426547+0000","last_clean":"2024-02-21T07:57:46.426547+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:57:46.426547+0000","last_undegraded":"2024-02-21T07:57:46.426547+0000","last_fullsized":"2024-02-21T07:57:46.426547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"30'2241","reported_seq":2264,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820476+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:58:07.820476+0000","last_peered":"2024-02-21T07:58:07.820476+0000","last_clean":"2024-02-21T07:58:07.820476+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:58:07.820476+0000","last_undegraded":"2024-02-21T07:58:07.820476+0000","last_fullsized":"2024-02-21T07:58:07.820476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23912,"num_write_kb":6167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.804264+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:54:29.804264+0000","last_peered":"2024-02-21T07:54:29.804264+0000","last_clean":"2024-02-21T07:54:29.804264+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:54:29.804264+0000","last_undegraded":"2024-02-21T07:54:29.804264+0000","last_fullsized":"2024-02-21T07:54:29.804264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:44.800645+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:57:44.800645+0000","last_peered":"2024-02-21T07:57:44.800645+0000","last_clean":"2024-02-21T07:57:44.800645+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:57:44.800645+0000","last_undegraded":"2024-02-21T07:57:44.800645+0000","last_fullsized":"2024-02-21T07:57:44.800645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.620008+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:58:07.620008+0000","last_peered":"2024-02-21T07:58:07.620008+0000","last_clean":"2024-02-21T07:58:07.620008+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:58:07.620008+0000","last_undegraded":"2024-02-21T07:58:07.620008+0000","last_fullsized":"2024-02-21T07:58:07.620008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":23651,"num_write_kb":6110913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027473+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:54:09.027473+0000","last_peered":"2024-02-21T07:54:09.027473+0000","last_clean":"2024-02-21T07:54:09.027473+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:54:09.027473+0000","last_undegraded":"2024-02-21T07:54:09.027473+0000","last_fullsized":"2024-02-21T07:54:09.027473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.429810+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:57:46.429810+0000","last_peered":"2024-02-21T07:57:46.429810+0000","last_clean":"2024-02-21T07:57:46.429810+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:57:46.429810+0000","last_undegraded":"2024-02-21T07:57:46.429810+0000","last_fullsized":"2024-02-21T07:57:46.429810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'2353","reported_seq":2393,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739796+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:58:07.739796+0000","last_peered":"2024-02-21T07:58:07.739796+0000","last_clean":"2024-02-21T07:58:07.739796+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:58:07.739796+0000","last_undegraded":"2024-02-21T07:58:07.739796+0000","last_fullsized":"2024-02-21T07:58:07.739796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25161,"num_write_kb":6532545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"30'4","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:20.034801+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:56:20.034801+0000","last_peered":"2024-02-21T07:56:20.034801+0000","last_clean":"2024-02-21T07:56:20.034801+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:56:20.034801+0000","last_undegraded":"2024-02-21T07:56:20.034801+0000","last_fullsized":"2024-02-21T07:56:20.034801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:08.996967+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:54:08.996967+0000","last_peered":"2024-02-21T07:54:08.996967+0000","last_clean":"2024-02-21T07:54:08.996967+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:54:08.996967+0000","last_undegraded":"2024-02-21T07:54:08.996967+0000","last_fullsized":"2024-02-21T07:54:08.996967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"30'2033","reported_seq":2056,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.600262+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:58:07.600262+0000","last_peered":"2024-02-21T07:58:07.600262+0000","last_clean":"2024-02-21T07:58:07.600262+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:58:07.600262+0000","last_undegraded":"2024-02-21T07:58:07.600262+0000","last_fullsized":"2024-02-21T07:58:07.600262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21864,"num_write_kb":5639616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.525799+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:54:09.525799+0000","last_peered":"2024-02-21T07:54:09.525799+0000","last_clean":"2024-02-21T07:54:09.525799+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:54:09.525799+0000","last_undegraded":"2024-02-21T07:54:09.525799+0000","last_fullsized":"2024-02-21T07:54:09.525799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'52","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.394892+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:57:38.394892+0000","last_peered":"2024-02-21T07:57:38.394892+0000","last_clean":"2024-02-21T07:57:38.394892+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:57:38.394892+0000","last_undegraded":"2024-02-21T07:57:38.394892+0000","last_fullsized":"2024-02-21T07:57:38.394892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":19,"num_write":102,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"30'1849","reported_seq":1873,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739803+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:58:07.739803+0000","last_peered":"2024-02-21T07:58:07.739803+0000","last_clean":"2024-02-21T07:58:07.739803+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:58:07.739803+0000","last_undegraded":"2024-02-21T07:58:07.739803+0000","last_fullsized":"2024-02-21T07:58:07.739803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19868,"num_write_kb":5174912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764767+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:54:09.764767+0000","last_peered":"2024-02-21T07:54:09.764767+0000","last_clean":"2024-02-21T07:54:09.764767+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:54:09.764767+0000","last_undegraded":"2024-02-21T07:54:09.764767+0000","last_fullsized":"2024-02-21T07:54:09.764767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'77","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.687804+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:58:02.687804+0000","last_peered":"2024-02-21T07:58:02.687804+0000","last_clean":"2024-02-21T07:58:02.687804+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:58:02.687804+0000","last_undegraded":"2024-02-21T07:58:02.687804+0000","last_fullsized":"2024-02-21T07:58:02.687804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"30'2041","reported_seq":2065,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.718088+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:58:07.718088+0000","last_peered":"2024-02-21T07:58:07.718088+0000","last_clean":"2024-02-21T07:58:07.718088+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:58:07.718088+0000","last_undegraded":"2024-02-21T07:58:07.718088+0000","last_fullsized":"2024-02-21T07:58:07.718088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21885,"num_write_kb":5740224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.592062+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:57:46.592062+0000","last_peered":"2024-02-21T07:57:46.592062+0000","last_clean":"2024-02-21T07:57:46.592062+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:57:46.592062+0000","last_undegraded":"2024-02-21T07:57:46.592062+0000","last_fullsized":"2024-02-21T07:57:46.592062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:50.024901+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:55:50.024901+0000","last_peered":"2024-02-21T07:55:50.024901+0000","last_clean":"2024-02-21T07:55:50.024901+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:55:50.024901+0000","last_undegraded":"2024-02-21T07:55:50.024901+0000","last_fullsized":"2024-02-21T07:55:50.024901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"30'2741","reported_seq":2765,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.802965+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:58:07.802965+0000","last_peered":"2024-02-21T07:58:07.802965+0000","last_clean":"2024-02-21T07:58:07.802965+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:58:07.802965+0000","last_undegraded":"2024-02-21T07:58:07.802965+0000","last_fullsized":"2024-02-21T07:58:07.802965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28989,"num_write_kb":7541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.435662+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:57:46.435662+0000","last_peered":"2024-02-21T07:57:46.435662+0000","last_clean":"2024-02-21T07:57:46.435662+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:57:46.435662+0000","last_undegraded":"2024-02-21T07:57:46.435662+0000","last_fullsized":"2024-02-21T07:57:46.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.871861+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:55:54.871861+0000","last_peered":"2024-02-21T07:55:54.871861+0000","last_clean":"2024-02-21T07:55:54.871861+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:55:54.871861+0000","last_undegraded":"2024-02-21T07:55:54.871861+0000","last_fullsized":"2024-02-21T07:55:54.871861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"30'2464","reported_seq":2539,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.741906+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:58:07.741906+0000","last_peered":"2024-02-21T07:58:07.741906+0000","last_clean":"2024-02-21T07:58:07.741906+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:58:07.741906+0000","last_undegraded":"2024-02-21T07:58:07.741906+0000","last_fullsized":"2024-02-21T07:58:07.741906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":26392,"num_write_kb":6842521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.021766+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:55:54.021766+0000","last_peered":"2024-02-21T07:55:54.021766+0000","last_clean":"2024-02-21T07:55:54.021766+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:55:54.021766+0000","last_undegraded":"2024-02-21T07:55:54.021766+0000","last_fullsized":"2024-02-21T07:55:54.021766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.031796+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:55:54.031796+0000","last_peered":"2024-02-21T07:55:54.031796+0000","last_clean":"2024-02-21T07:55:54.031796+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:55:54.031796+0000","last_undegraded":"2024-02-21T07:55:54.031796+0000","last_fullsized":"2024-02-21T07:55:54.031796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"30'2384","reported_seq":2425,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.804283+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:58:07.804283+0000","last_peered":"2024-02-21T07:58:07.804283+0000","last_clean":"2024-02-21T07:58:07.804283+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:58:07.804283+0000","last_undegraded":"2024-02-21T07:58:07.804283+0000","last_fullsized":"2024-02-21T07:58:07.804283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25350,"num_write_kb":6611464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045880+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:55:29.045880+0000","last_peered":"2024-02-21T07:55:29.045880+0000","last_clean":"2024-02-21T07:55:29.045880+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:55:29.045880+0000","last_undegraded":"2024-02-21T07:55:29.045880+0000","last_fullsized":"2024-02-21T07:55:29.045880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'13","reported_seq":795,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:13.556100+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:58:13.556100+0000","last_peered":"2024-02-21T07:58:13.556100+0000","last_clean":"2024-02-21T07:58:13.556100+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:58:13.556100+0000","last_undegraded":"2024-02-21T07:58:13.556100+0000","last_fullsized":"2024-02-21T07:58:13.556100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":751,"num_read_kb":752,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"30'2406","reported_seq":2436,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796313+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:58:07.796313+0000","last_peered":"2024-02-21T07:58:07.796313+0000","last_clean":"2024-02-21T07:58:07.796313+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:58:07.796313+0000","last_undegraded":"2024-02-21T07:58:07.796313+0000","last_fullsized":"2024-02-21T07:58:07.796313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25497,"num_write_kb":6630592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:55.218164+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:55:55.218164+0000","last_peered":"2024-02-21T07:55:55.218164+0000","last_clean":"2024-02-21T07:55:55.218164+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:55:55.218164+0000","last_undegraded":"2024-02-21T07:55:55.218164+0000","last_fullsized":"2024-02-21T07:55:55.218164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026692+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:55:29.026692+0000","last_peered":"2024-02-21T07:55:29.026692+0000","last_clean":"2024-02-21T07:55:29.026692+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:55:29.026692+0000","last_undegraded":"2024-02-21T07:55:29.026692+0000","last_fullsized":"2024-02-21T07:55:29.026692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'2270","reported_seq":2293,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.769251+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:58:07.769251+0000","last_peered":"2024-02-21T07:58:07.769251+0000","last_clean":"2024-02-21T07:58:07.769251+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:58:07.769251+0000","last_undegraded":"2024-02-21T07:58:07.769251+0000","last_fullsized":"2024-02-21T07:58:07.769251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":6335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.905255+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:55:54.905255+0000","last_peered":"2024-02-21T07:55:54.905255+0000","last_clean":"2024-02-21T07:55:54.905255+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:55:54.905255+0000","last_undegraded":"2024-02-21T07:55:54.905255+0000","last_fullsized":"2024-02-21T07:55:54.905255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.037294+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:55:54.037294+0000","last_peered":"2024-02-21T07:55:54.037294+0000","last_clean":"2024-02-21T07:55:54.037294+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:55:54.037294+0000","last_undegraded":"2024-02-21T07:55:54.037294+0000","last_fullsized":"2024-02-21T07:55:54.037294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:24.026223+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:55:24.026223+0000","last_peered":"2024-02-21T07:55:24.026223+0000","last_clean":"2024-02-21T07:55:24.026223+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:55:24.026223+0000","last_undegraded":"2024-02-21T07:55:24.026223+0000","last_fullsized":"2024-02-21T07:55:24.026223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"30'2060","reported_seq":2118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.726474+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:58:07.726474+0000","last_peered":"2024-02-21T07:58:07.726474+0000","last_clean":"2024-02-21T07:58:07.726474+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:58:07.726474+0000","last_undegraded":"2024-02-21T07:58:07.726474+0000","last_fullsized":"2024-02-21T07:58:07.726474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22073,"num_write_kb":5629259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020805+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:54:29.020805+0000","last_peered":"2024-02-21T07:54:29.020805+0000","last_clean":"2024-02-21T07:54:29.020805+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:54:29.020805+0000","last_undegraded":"2024-02-21T07:54:29.020805+0000","last_fullsized":"2024-02-21T07:54:29.020805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.048015+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:56:44.048015+0000","last_peered":"2024-02-21T07:56:44.048015+0000","last_clean":"2024-02-21T07:56:44.048015+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:56:44.048015+0000","last_undegraded":"2024-02-21T07:56:44.048015+0000","last_fullsized":"2024-02-21T07:56:44.048015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"30'2311","reported_seq":2334,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733562+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:58:07.733562+0000","last_peered":"2024-02-21T07:58:07.733562+0000","last_clean":"2024-02-21T07:58:07.733562+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:58:07.733562+0000","last_undegraded":"2024-02-21T07:58:07.733562+0000","last_fullsized":"2024-02-21T07:58:07.733562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24846,"num_write_kb":6393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020785+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:54:29.020785+0000","last_peered":"2024-02-21T07:54:29.020785+0000","last_clean":"2024-02-21T07:54:29.020785+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:54:29.020785+0000","last_undegraded":"2024-02-21T07:54:29.020785+0000","last_fullsized":"2024-02-21T07:54:29.020785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"30'47","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.413600+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:57:38.413600+0000","last_peered":"2024-02-21T07:57:38.413600+0000","last_clean":"2024-02-21T07:57:38.413600+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:57:38.413600+0000","last_undegraded":"2024-02-21T07:57:38.413600+0000","last_fullsized":"2024-02-21T07:57:38.413600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":18,"num_write":93,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'2089","reported_seq":2119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.671207+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:58:07.671207+0000","last_peered":"2024-02-21T07:58:07.671207+0000","last_clean":"2024-02-21T07:58:07.671207+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:58:07.671207+0000","last_undegraded":"2024-02-21T07:58:07.671207+0000","last_fullsized":"2024-02-21T07:58:07.671207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22313,"num_write_kb":5873984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020816+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:54:29.020816+0000","last_peered":"2024-02-21T07:54:29.020816+0000","last_clean":"2024-02-21T07:54:29.020816+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:54:29.020816+0000","last_undegraded":"2024-02-21T07:54:29.020816+0000","last_fullsized":"2024-02-21T07:54:29.020816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042194+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:54:30.042194+0000","last_peered":"2024-02-21T07:54:30.042194+0000","last_clean":"2024-02-21T07:54:30.042194+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:54:30.042194+0000","last_undegraded":"2024-02-21T07:54:30.042194+0000","last_fullsized":"2024-02-21T07:54:30.042194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"30'1828","reported_seq":1851,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782512+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:58:07.782512+0000","last_peered":"2024-02-21T07:58:07.782512+0000","last_clean":"2024-02-21T07:58:07.782512+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:58:07.782512+0000","last_undegraded":"2024-02-21T07:58:07.782512+0000","last_fullsized":"2024-02-21T07:58:07.782512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19636,"num_write_kb":5096256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.031015+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:54:29.031015+0000","last_peered":"2024-02-21T07:54:29.031015+0000","last_clean":"2024-02-21T07:54:29.031015+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:54:29.031015+0000","last_undegraded":"2024-02-21T07:54:29.031015+0000","last_fullsized":"2024-02-21T07:54:29.031015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:25.006321+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:54:25.006321+0000","last_peered":"2024-02-21T07:54:25.006321+0000","last_clean":"2024-02-21T07:54:25.006321+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:54:25.006321+0000","last_undegraded":"2024-02-21T07:54:25.006321+0000","last_fullsized":"2024-02-21T07:54:25.006321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"30'2224","reported_seq":2282,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733641+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:58:07.733641+0000","last_peered":"2024-02-21T07:58:07.733641+0000","last_clean":"2024-02-21T07:58:07.733641+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:58:07.733641+0000","last_undegraded":"2024-02-21T07:58:07.733641+0000","last_fullsized":"2024-02-21T07:58:07.733641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":23814,"num_write_kb":6166061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.037449+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:54:49.037449+0000","last_peered":"2024-02-21T07:54:49.037449+0000","last_clean":"2024-02-21T07:54:49.037449+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:54:49.037449+0000","last_undegraded":"2024-02-21T07:54:49.037449+0000","last_fullsized":"2024-02-21T07:54:49.037449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"30'111","reported_seq":179,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:40.624401+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:57:40.624401+0000","last_peered":"2024-02-21T07:57:40.624401+0000","last_clean":"2024-02-21T07:57:40.624401+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:57:40.624401+0000","last_undegraded":"2024-02-21T07:57:40.624401+0000","last_fullsized":"2024-02-21T07:57:40.624401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":37,"num_write":210,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"30'2326","reported_seq":2368,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.824206+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:58:07.824206+0000","last_peered":"2024-02-21T07:58:07.824206+0000","last_clean":"2024-02-21T07:58:07.824206+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:58:07.824206+0000","last_undegraded":"2024-02-21T07:58:07.824206+0000","last_fullsized":"2024-02-21T07:58:07.824206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":25096,"num_write_kb":6462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.023243+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:54:49.023243+0000","last_peered":"2024-02-21T07:54:49.023243+0000","last_clean":"2024-02-21T07:54:49.023243+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:54:49.023243+0000","last_undegraded":"2024-02-21T07:54:49.023243+0000","last_fullsized":"2024-02-21T07:54:49.023243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":783,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.566167+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:58:17.566167+0000","last_peered":"2024-02-21T07:58:17.566167+0000","last_clean":"2024-02-21T07:58:17.566167+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:58:17.566167+0000","last_undegraded":"2024-02-21T07:58:17.566167+0000","last_fullsized":"2024-02-21T07:58:17.566167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"30'2447","reported_seq":2500,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.813049+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:58:07.813049+0000","last_peered":"2024-02-21T07:58:07.813049+0000","last_clean":"2024-02-21T07:58:07.813049+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:58:07.813049+0000","last_undegraded":"2024-02-21T07:58:07.813049+0000","last_fullsized":"2024-02-21T07:58:07.813049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2447,"log_dups_size":0,"ondisk_log_size":2447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":25865,"num_write_kb":6637076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"30'19","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.567604+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:57:46.567604+0000","last_peered":"2024-02-21T07:57:46.567604+0000","last_clean":"2024-02-21T07:57:46.567604+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:57:46.567604+0000","last_undegraded":"2024-02-21T07:57:46.567604+0000","last_fullsized":"2024-02-21T07:57:46.567604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"30'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.068511+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:57:09.068511+0000","last_peered":"2024-02-21T07:57:09.068511+0000","last_clean":"2024-02-21T07:57:09.068511+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:57:09.068511+0000","last_undegraded":"2024-02-21T07:57:09.068511+0000","last_fullsized":"2024-02-21T07:57:09.068511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2095","reported_seq":2152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.708515+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:58:07.708515+0000","last_peered":"2024-02-21T07:58:07.708515+0000","last_clean":"2024-02-21T07:58:07.708515+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:58:07.708515+0000","last_undegraded":"2024-02-21T07:58:07.708515+0000","last_fullsized":"2024-02-21T07:58:07.708515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22512,"num_write_kb":5792019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:10.380887+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:57:10.380887+0000","last_peered":"2024-02-21T07:57:10.380887+0000","last_clean":"2024-02-21T07:57:10.380887+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:57:10.380887+0000","last_undegraded":"2024-02-21T07:57:10.380887+0000","last_fullsized":"2024-02-21T07:57:10.380887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'57","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.399451+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:57:38.399451+0000","last_peered":"2024-02-21T07:57:38.399451+0000","last_clean":"2024-02-21T07:57:38.399451+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:57:38.399451+0000","last_undegraded":"2024-02-21T07:57:38.399451+0000","last_fullsized":"2024-02-21T07:57:38.399451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":20,"num_write":108,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"30'2154","reported_seq":2177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796003+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:58:07.796003+0000","last_peered":"2024-02-21T07:58:07.796003+0000","last_clean":"2024-02-21T07:58:07.796003+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:58:07.796003+0000","last_undegraded":"2024-02-21T07:58:07.796003+0000","last_fullsized":"2024-02-21T07:58:07.796003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":5940672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.016643+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:55:10.016643+0000","last_peered":"2024-02-21T07:55:10.016643+0000","last_clean":"2024-02-21T07:55:10.016643+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:55:10.016643+0000","last_undegraded":"2024-02-21T07:55:10.016643+0000","last_fullsized":"2024-02-21T07:55:10.016643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'757","reported_seq":2156,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.828091+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:58:17.828091+0000","last_peered":"2024-02-21T07:58:17.828091+0000","last_clean":"2024-02-21T07:58:17.828091+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:58:17.828091+0000","last_undegraded":"2024-02-21T07:58:17.828091+0000","last_fullsized":"2024-02-21T07:58:17.828091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":4919,"num_write":757,"num_write_kb":4594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"30'2054","reported_seq":2095,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782529+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:58:07.782529+0000","last_peered":"2024-02-21T07:58:07.782529+0000","last_clean":"2024-02-21T07:58:07.782529+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:58:07.782529+0000","last_undegraded":"2024-02-21T07:58:07.782529+0000","last_fullsized":"2024-02-21T07:58:07.782529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":21761,"num_write_kb":5639370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000237+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:54:49.000237+0000","last_peered":"2024-02-21T07:54:49.000237+0000","last_clean":"2024-02-21T07:54:49.000237+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:54:49.000237+0000","last_undegraded":"2024-02-21T07:54:49.000237+0000","last_fullsized":"2024-02-21T07:54:49.000237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"30'58","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:03.690539+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:58:03.690539+0000","last_peered":"2024-02-21T07:58:03.690539+0000","last_clean":"2024-02-21T07:58:03.690539+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:58:03.690539+0000","last_undegraded":"2024-02-21T07:58:03.690539+0000","last_fullsized":"2024-02-21T07:58:03.690539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":65,"num_read_kb":20,"num_write":105,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"30'2000","reported_seq":2057,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.805914+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:58:07.805914+0000","last_peered":"2024-02-21T07:58:07.805914+0000","last_clean":"2024-02-21T07:58:07.805914+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:58:07.805914+0000","last_undegraded":"2024-02-21T07:58:07.805914+0000","last_fullsized":"2024-02-21T07:58:07.805914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":21494,"num_write_kb":5470657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.793458+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:57:34.793458+0000","last_peered":"2024-02-21T07:57:34.793458+0000","last_clean":"2024-02-21T07:57:34.793458+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:57:34.793458+0000","last_undegraded":"2024-02-21T07:57:34.793458+0000","last_fullsized":"2024-02-21T07:57:34.793458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.025014+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:55:09.025014+0000","last_peered":"2024-02-21T07:55:09.025014+0000","last_clean":"2024-02-21T07:55:09.025014+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:55:09.025014+0000","last_undegraded":"2024-02-21T07:55:09.025014+0000","last_fullsized":"2024-02-21T07:55:09.025014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.786901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:58:07.786901+0000","last_peered":"2024-02-21T07:58:07.786901+0000","last_clean":"2024-02-21T07:58:07.786901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:58:07.786901+0000","last_undegraded":"2024-02-21T07:58:07.786901+0000","last_fullsized":"2024-02-21T07:58:07.786901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24168,"num_write_kb":6241728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.009169+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:55:09.009169+0000","last_peered":"2024-02-21T07:55:09.009169+0000","last_clean":"2024-02-21T07:55:09.009169+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:55:09.009169+0000","last_undegraded":"2024-02-21T07:55:09.009169+0000","last_fullsized":"2024-02-21T07:55:09.009169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"30'9","reported_seq":789,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.424032+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:58:17.424032+0000","last_peered":"2024-02-21T07:58:17.424032+0000","last_clean":"2024-02-21T07:58:17.424032+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:58:17.424032+0000","last_undegraded":"2024-02-21T07:58:17.424032+0000","last_fullsized":"2024-02-21T07:58:17.424032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":749,"num_read_kb":749,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"30'2195","reported_seq":2218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.772697+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:58:07.772697+0000","last_peered":"2024-02-21T07:58:07.772697+0000","last_clean":"2024-02-21T07:58:07.772697+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:58:07.772697+0000","last_undegraded":"2024-02-21T07:58:07.772697+0000","last_fullsized":"2024-02-21T07:58:07.772697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":6089984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1963","reported_seq":1987,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820640+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:58:07.820640+0000","last_peered":"2024-02-21T07:58:07.820640+0000","last_clean":"2024-02-21T07:58:07.820640+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:58:07.820640+0000","last_undegraded":"2024-02-21T07:58:07.820640+0000","last_fullsized":"2024-02-21T07:58:07.820640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21157,"num_write_kb":5478016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.839758+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:55:09.839758+0000","last_peered":"2024-02-21T07:55:09.839758+0000","last_clean":"2024-02-21T07:55:09.839758+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:55:09.839758+0000","last_undegraded":"2024-02-21T07:55:09.839758+0000","last_fullsized":"2024-02-21T07:55:09.839758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.041150+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:55:09.041150+0000","last_peered":"2024-02-21T07:55:09.041150+0000","last_clean":"2024-02-21T07:55:09.041150+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:55:09.041150+0000","last_undegraded":"2024-02-21T07:55:09.041150+0000","last_fullsized":"2024-02-21T07:55:09.041150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'2123","reported_seq":2147,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.673299+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:58:07.673299+0000","last_peered":"2024-02-21T07:58:07.673299+0000","last_clean":"2024-02-21T07:58:07.673299+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:58:07.673299+0000","last_undegraded":"2024-02-21T07:58:07.673299+0000","last_fullsized":"2024-02-21T07:58:07.673299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22656,"num_write_kb":5874432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.851290+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:55:09.851290+0000","last_peered":"2024-02-21T07:55:09.851290+0000","last_clean":"2024-02-21T07:55:09.851290+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:55:09.851290+0000","last_undegraded":"2024-02-21T07:55:09.851290+0000","last_fullsized":"2024-02-21T07:55:09.851290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.431540+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:57:46.431540+0000","last_peered":"2024-02-21T07:57:46.431540+0000","last_clean":"2024-02-21T07:57:46.431540+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:57:46.431540+0000","last_undegraded":"2024-02-21T07:57:46.431540+0000","last_fullsized":"2024-02-21T07:57:46.431540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017432+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:55:29.017432+0000","last_peered":"2024-02-21T07:55:29.017432+0000","last_clean":"2024-02-21T07:55:29.017432+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:55:29.017432+0000","last_undegraded":"2024-02-21T07:55:29.017432+0000","last_fullsized":"2024-02-21T07:55:29.017432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045903+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:55:29.045903+0000","last_peered":"2024-02-21T07:55:29.045903+0000","last_clean":"2024-02-21T07:55:29.045903+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:55:29.045903+0000","last_undegraded":"2024-02-21T07:55:29.045903+0000","last_fullsized":"2024-02-21T07:55:29.045903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2454","reported_seq":2477,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.742250+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:58:07.742250+0000","last_peered":"2024-02-21T07:58:07.742250+0000","last_clean":"2024-02-21T07:58:07.742250+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:58:07.742250+0000","last_undegraded":"2024-02-21T07:58:07.742250+0000","last_fullsized":"2024-02-21T07:58:07.742250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2454,"log_dups_size":0,"ondisk_log_size":2454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26408,"num_write_kb":6832640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'382","reported_seq":1552,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:18.425981+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:58:18.425981+0000","last_peered":"2024-02-21T07:58:18.425981+0000","last_clean":"2024-02-21T07:58:18.425981+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:58:18.425981+0000","last_undegraded":"2024-02-21T07:58:18.425981+0000","last_fullsized":"2024-02-21T07:58:18.425981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3066336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1139,"num_read_kb":3040,"num_write":379,"num_write_kb":3192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:30.023297+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:55:30.023297+0000","last_peered":"2024-02-21T07:55:30.023297+0000","last_clean":"2024-02-21T07:55:30.023297+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:55:30.023297+0000","last_undegraded":"2024-02-21T07:55:30.023297+0000","last_fullsized":"2024-02-21T07:55:30.023297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2254","reported_seq":2294,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.754893+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:58:07.754893+0000","last_peered":"2024-02-21T07:58:07.754893+0000","last_clean":"2024-02-21T07:58:07.754893+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:58:07.754893+0000","last_undegraded":"2024-02-21T07:58:07.754893+0000","last_fullsized":"2024-02-21T07:58:07.754893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":24317,"num_write_kb":6228160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048058+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:55:54.048058+0000","last_peered":"2024-02-21T07:55:54.048058+0000","last_clean":"2024-02-21T07:55:54.048058+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:55:54.048058+0000","last_undegraded":"2024-02-21T07:55:54.048058+0000","last_fullsized":"2024-02-21T07:55:54.048058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"30'12","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.038521+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:55:54.038521+0000","last_peered":"2024-02-21T07:55:54.038521+0000","last_clean":"2024-02-21T07:55:54.038521+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:55:54.038521+0000","last_undegraded":"2024-02-21T07:55:54.038521+0000","last_fullsized":"2024-02-21T07:55:54.038521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"30'14","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.344995+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:58:02.344995+0000","last_peered":"2024-02-21T07:58:02.344995+0000","last_clean":"2024-02-21T07:58:02.344995+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:58:02.344995+0000","last_undegraded":"2024-02-21T07:58:02.344995+0000","last_fullsized":"2024-02-21T07:58:02.344995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683133+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:55:54.683133+0000","last_peered":"2024-02-21T07:55:54.683133+0000","last_clean":"2024-02-21T07:55:54.683133+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:55:54.683133+0000","last_undegraded":"2024-02-21T07:55:54.683133+0000","last_fullsized":"2024-02-21T07:55:54.683133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.992212+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:54:09.992212+0000","last_peered":"2024-02-21T07:54:09.992212+0000","last_clean":"2024-02-21T07:54:09.992212+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:54:09.992212+0000","last_undegraded":"2024-02-21T07:54:09.992212+0000","last_fullsized":"2024-02-21T07:54:09.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:19.050175+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:56:19.050175+0000","last_peered":"2024-02-21T07:56:19.050175+0000","last_clean":"2024-02-21T07:56:19.050175+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:56:19.050175+0000","last_undegraded":"2024-02-21T07:56:19.050175+0000","last_fullsized":"2024-02-21T07:56:19.050175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"30'15","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027357+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:54:09.027357+0000","last_peered":"2024-02-21T07:54:09.027357+0000","last_clean":"2024-02-21T07:54:09.027357+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:54:09.027357+0000","last_undegraded":"2024-02-21T07:54:09.027357+0000","last_fullsized":"2024-02-21T07:54:09.027357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764753+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:54:09.764753+0000","last_peered":"2024-02-21T07:54:09.764753+0000","last_clean":"2024-02-21T07:54:09.764753+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:54:09.764753+0000","last_undegraded":"2024-02-21T07:54:09.764753+0000","last_fullsized":"2024-02-21T07:54:09.764753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027618+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:54:09.027618+0000","last_peered":"2024-02-21T07:54:09.027618+0000","last_clean":"2024-02-21T07:54:09.027618+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:54:09.027618+0000","last_undegraded":"2024-02-21T07:54:09.027618+0000","last_fullsized":"2024-02-21T07:54:09.027618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.984134+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:56:44.984134+0000","last_peered":"2024-02-21T07:56:44.984134+0000","last_clean":"2024-02-21T07:56:44.984134+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:56:44.984134+0000","last_undegraded":"2024-02-21T07:56:44.984134+0000","last_fullsized":"2024-02-21T07:56:44.984134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:28.998739+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:54:28.998739+0000","last_peered":"2024-02-21T07:54:28.998739+0000","last_clean":"2024-02-21T07:54:28.998739+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:54:28.998739+0000","last_undegraded":"2024-02-21T07:54:28.998739+0000","last_fullsized":"2024-02-21T07:54:28.998739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042162+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:54:30.042162+0000","last_peered":"2024-02-21T07:54:30.042162+0000","last_clean":"2024-02-21T07:54:30.042162+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:54:30.042162+0000","last_undegraded":"2024-02-21T07:54:30.042162+0000","last_fullsized":"2024-02-21T07:54:30.042162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030830+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:54:29.030830+0000","last_peered":"2024-02-21T07:54:29.030830+0000","last_clean":"2024-02-21T07:54:29.030830+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:54:29.030830+0000","last_undegraded":"2024-02-21T07:54:29.030830+0000","last_fullsized":"2024-02-21T07:54:29.030830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"30'7","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030443+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:54:29.030443+0000","last_peered":"2024-02-21T07:54:29.030443+0000","last_clean":"2024-02-21T07:54:29.030443+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:54:29.030443+0000","last_undegraded":"2024-02-21T07:54:29.030443+0000","last_fullsized":"2024-02-21T07:54:29.030443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.822291+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:54:49.822291+0000","last_peered":"2024-02-21T07:54:49.822291+0000","last_clean":"2024-02-21T07:54:49.822291+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:54:49.822291+0000","last_undegraded":"2024-02-21T07:54:49.822291+0000","last_fullsized":"2024-02-21T07:54:49.822291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.055257+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:57:09.055257+0000","last_peered":"2024-02-21T07:57:09.055257+0000","last_clean":"2024-02-21T07:57:09.055257+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:57:09.055257+0000","last_undegraded":"2024-02-21T07:57:09.055257+0000","last_fullsized":"2024-02-21T07:57:09.055257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000212+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:54:49.000212+0000","last_peered":"2024-02-21T07:54:49.000212+0000","last_clean":"2024-02-21T07:54:49.000212+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:54:49.000212+0000","last_undegraded":"2024-02-21T07:54:49.000212+0000","last_fullsized":"2024-02-21T07:54:49.000212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617208+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:54:49.617208+0000","last_peered":"2024-02-21T07:54:49.617208+0000","last_clean":"2024-02-21T07:54:49.617208+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:54:49.617208+0000","last_undegraded":"2024-02-21T07:54:49.617208+0000","last_fullsized":"2024-02-21T07:54:49.617208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617233+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:54:49.617233+0000","last_peered":"2024-02-21T07:54:49.617233+0000","last_clean":"2024-02-21T07:54:49.617233+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:54:49.617233+0000","last_undegraded":"2024-02-21T07:54:49.617233+0000","last_fullsized":"2024-02-21T07:54:49.617233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"30'10","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.198152+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:55:10.198152+0000","last_peered":"2024-02-21T07:55:10.198152+0000","last_clean":"2024-02-21T07:55:10.198152+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:55:10.198152+0000","last_undegraded":"2024-02-21T07:55:10.198152+0000","last_fullsized":"2024-02-21T07:55:10.198152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.434916+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:57:46.434916+0000","last_peered":"2024-02-21T07:57:46.434916+0000","last_clean":"2024-02-21T07:57:46.434916+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:57:46.434916+0000","last_undegraded":"2024-02-21T07:57:46.434916+0000","last_fullsized":"2024-02-21T07:57:46.434916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.024979+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:55:09.024979+0000","last_peered":"2024-02-21T07:55:09.024979+0000","last_clean":"2024-02-21T07:55:09.024979+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:55:09.024979+0000","last_undegraded":"2024-02-21T07:55:09.024979+0000","last_fullsized":"2024-02-21T07:55:09.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.013613+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:55:09.013613+0000","last_peered":"2024-02-21T07:55:09.013613+0000","last_clean":"2024-02-21T07:55:09.013613+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:55:09.013613+0000","last_undegraded":"2024-02-21T07:55:09.013613+0000","last_fullsized":"2024-02-21T07:55:09.013613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"30'13","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.039759+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:57:34.039759+0000","last_peered":"2024-02-21T07:57:34.039759+0000","last_clean":"2024-02-21T07:57:34.039759+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:57:34.039759+0000","last_undegraded":"2024-02-21T07:57:34.039759+0000","last_fullsized":"2024-02-21T07:57:34.039759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859041+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:55:29.859041+0000","last_peered":"2024-02-21T07:55:29.859041+0000","last_clean":"2024-02-21T07:55:29.859041+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:55:29.859041+0000","last_undegraded":"2024-02-21T07:55:29.859041+0000","last_fullsized":"2024-02-21T07:55:29.859041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026716+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:55:29.026716+0000","last_peered":"2024-02-21T07:55:29.026716+0000","last_clean":"2024-02-21T07:55:29.026716+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:55:29.026716+0000","last_undegraded":"2024-02-21T07:55:29.026716+0000","last_fullsized":"2024-02-21T07:55:29.026716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017415+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:55:29.017415+0000","last_peered":"2024-02-21T07:55:29.017415+0000","last_clean":"2024-02-21T07:55:29.017415+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:55:29.017415+0000","last_undegraded":"2024-02-21T07:55:29.017415+0000","last_fullsized":"2024-02-21T07:55:29.017415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.574348+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:57:46.574348+0000","last_peered":"2024-02-21T07:57:46.574348+0000","last_clean":"2024-02-21T07:57:46.574348+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:57:46.574348+0000","last_undegraded":"2024-02-21T07:57:46.574348+0000","last_fullsized":"2024-02-21T07:57:46.574348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.034016+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:55:29.034016+0000","last_peered":"2024-02-21T07:55:29.034016+0000","last_clean":"2024-02-21T07:55:29.034016+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:55:29.034016+0000","last_undegraded":"2024-02-21T07:55:29.034016+0000","last_fullsized":"2024-02-21T07:55:29.034016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683159+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:55:54.683159+0000","last_peered":"2024-02-21T07:55:54.683159+0000","last_clean":"2024-02-21T07:55:54.683159+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:55:54.683159+0000","last_undegraded":"2024-02-21T07:55:54.683159+0000","last_fullsized":"2024-02-21T07:55:54.683159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'4","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683176+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:55:54.683176+0000","last_peered":"2024-02-21T07:55:54.683176+0000","last_clean":"2024-02-21T07:55:54.683176+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:55:54.683176+0000","last_undegraded":"2024-02-21T07:55:54.683176+0000","last_fullsized":"2024-02-21T07:55:54.683176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048097+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:55:54.048097+0000","last_peered":"2024-02-21T07:55:54.048097+0000","last_clean":"2024-02-21T07:55:54.048097+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:55:54.048097+0000","last_undegraded":"2024-02-21T07:55:54.048097+0000","last_fullsized":"2024-02-21T07:55:54.048097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":753511,"num_write_kb":194935703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70426,"ondisk_log_size":70426,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3072176,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":5322,"num_read_kb":9662,"num_write":2211,"num_write_kb":8460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2834432,"data_stored":6144352,"data_compressed":766850,"data_compressed_allocated":1040384,"data_compressed_original":4505600,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94177980,"statfs":{"total":96636764160,"available":96438251520,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":198179268},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":2.1349999999999998,"15min":1.4990000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":18.609999999999999,"5min":18.609999999999999,"15min":41.207999999999998},"last":0.44},{"interface":"front","average":{"1min":1.883,"5min":1.532,"15min":1.25},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.26600000000000001},"max":{"1min":12.308999999999999,"5min":13.135999999999999,"15min":24.315999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.442,"15min":0.504},"min":{"1min":0.254,"5min":0.247,"15min":0.19900000000000001},"max":{"1min":0.63400000000000001,"5min":1.2669999999999999,"15min":1.9950000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.50700000000000001},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.048,"5min":1.8240000000000001,"15min":2.1419999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":3.089,"15min":3.089},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.218},"max":{"1min":0.75,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.76600000000000001,"5min":1.5880000000000001,"15min":2.0190000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":1.0029999999999999,"5min":1.8819999999999999,"15min":3.1059999999999999},"last":0.30199999999999999}]},{"osd":5,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.86699999999999999,"5min":1.6910000000000001,"15min":2.234},"last":0.504},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.28100000000000003,"5min":0.252,"15min":0.249},"max":{"1min":1.087,"5min":7.2640000000000002,"15min":7.2640000000000002},"last":0.432}]},{"osd":6,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.2970000000000002,"15min":1.631},"min":{"1min":0.40400000000000003,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":13.577,"5min":24.452000000000002,"15min":24.452000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.3380000000000001,"15min":1.6870000000000001},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.378},"max":{"1min":13.609,"5min":25.504000000000001,"15min":25.504000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.32800000000000001},"max":{"1min":1.0860000000000001,"5min":1.9870000000000001,"15min":3.1429999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.0649999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"last":0.38800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":1.665,"5min":1.665,"15min":3.0800000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.314},"max":{"1min":0.95199999999999996,"5min":1.9370000000000001,"15min":3.1989999999999998},"last":0.41199999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":3.6850000000000001,"15min":2.1760000000000002},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":7.5229999999999997,"5min":102.712,"15min":102.712},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.4379999999999999,"5min":2.8109999999999999,"15min":1.7170000000000001},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.48599999999999999},"max":{"1min":4.9980000000000002,"5min":27.137,"15min":27.137},"last":0.54800000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.214,"5min":1.972,"15min":3.2250000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.46100000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161940,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94209900,"statfs":{"total":96636764160,"available":96470937600,"internally_reserved":0,"allocated":339968,"data_stored":153098,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":165476800},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.8540000000000001,"15min":1.264},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":18.68,"5min":18.68,"15min":18.68},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.367,"5min":1.631,"15min":1.3480000000000001},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.4400000000000004,"5min":9.0079999999999991,"15min":13.788},"last":0.745}]},{"osd":1,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.34300000000000003},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.583},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.49399999999999999},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.2749999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.2629999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.9119999999999999,"15min":1.4099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39000000000000001,"15min":0.32600000000000001},"max":{"1min":5.6280000000000001,"5min":15.042999999999999,"15min":15.042999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.855,"5min":2.9950000000000001,"15min":1.669},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":13.597,"5min":52.374000000000002,"15min":52.374000000000002},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":1.4530000000000001,"5min":2.004,"15min":2.004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.24399999999999999},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.9199999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":1.167,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.421,"5min":1.694,"15min":1.897},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.51500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.27000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":1.0509999999999999},"last":0.67800000000000005}]},{"osd":8,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":1.228,"5min":1.857,"15min":1.857},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4750000000000001,"5min":1.958,"15min":1.958},"last":0.88400000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.698,"15min":1.73},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":26.867000000000001,"5min":26.867000000000001,"15min":26.867000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":4.8319999999999999,"5min":3.702,"15min":2.5569999999999999},"min":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.609000000000002,"5min":23.939,"15min":60.792000000000002},"last":0.871}]},{"osd":11,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.84299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444190,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368780,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":368446,"kb_avail":94003060,"statfs":{"total":96636764160,"available":96259133440,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":377289152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":5.3689999999999998,"15min":3.9129999999999998},"min":{"1min":0.57099999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":66.947999999999993},"last":0.874},{"interface":"front","average":{"1min":2.8740000000000001,"5min":4.423,"15min":3.1179999999999999},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":11.470000000000001,"5min":31.988,"15min":31.988},"last":1.804}]},{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":3.161,"15min":2.242},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":12.119,"5min":24.472000000000001,"15min":27.088999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.9749999999999996,"5min":4.5949999999999998,"15min":3.2799999999999998},"min":{"1min":0.59299999999999997,"5min":0.438,"15min":0.40799999999999997},"max":{"1min":44.505000000000003,"5min":44.505000000000003,"15min":66.670000000000002},"last":0.76000000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":3.206,"15min":2.3639999999999999},"min":{"1min":0.54600000000000004,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":10.294,"5min":30.081,"15min":30.081},"last":1.0009999999999999},{"interface":"front","average":{"1min":2.6360000000000001,"5min":3.306,"15min":2.3319999999999999},"min":{"1min":0.59699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":11.983000000000001,"5min":24.379999999999999,"15min":24.379999999999999},"last":1.167}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.3899999999999997,"5min":5.399,"15min":4.1059999999999999},"min":{"1min":0.66300000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":44.453000000000003,"5min":44.453000000000003,"15min":66.914000000000001},"last":1.284},{"interface":"front","average":{"1min":3.3170000000000002,"5min":5.4950000000000001,"15min":3.702},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.42699999999999999},"max":{"1min":10.785,"5min":30.513999999999999,"15min":30.513999999999999},"last":1.7130000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":3.5089999999999999,"15min":2.5299999999999998},"min":{"1min":0.56299999999999994,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.077,"5min":24.928999999999998,"15min":27.155999999999999},"last":1.081},{"interface":"front","average":{"1min":5.149,"5min":4.9880000000000004,"15min":3.5600000000000001},"min":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.496},"max":{"1min":44.542999999999999,"5min":44.542999999999999,"15min":66.802999999999997},"last":1.1180000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":3.4990000000000001,"15min":2.5470000000000002},"min":{"1min":0.64300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.154999999999999,"5min":24.510000000000002,"15min":26.954000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":2.4630000000000001,"5min":3.613,"15min":2.827},"min":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.51700000000000002},"max":{"1min":10.346,"5min":30.129999999999999,"15min":37.783000000000001},"last":1.242}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2839999999999998,"5min":5.1349999999999998,"15min":3.6930000000000001},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.50800000000000001},"max":{"1min":44.610999999999997,"5min":44.610999999999997,"15min":66.879000000000005},"last":1.208},{"interface":"front","average":{"1min":2.8759999999999999,"5min":3.7909999999999999,"15min":2.7170000000000001},"min":{"1min":0.68200000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":14.105,"5min":24.895,"15min":27.056999999999999},"last":1.4990000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2320000000000002,"5min":5.4660000000000002,"15min":3.8359999999999999},"min":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.53200000000000003},"max":{"1min":44.578000000000003,"5min":44.578000000000003,"15min":66.841999999999999},"last":1.48},{"interface":"front","average":{"1min":2.6389999999999998,"5min":3.7400000000000002,"15min":2.9540000000000002},"min":{"1min":0.82899999999999996,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":10.667999999999999,"5min":30.167999999999999,"15min":37.670999999999999},"last":1.3819999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":3.8079999999999998,"15min":2.77},"min":{"1min":0.70799999999999996,"5min":0.51100000000000001,"15min":0.45700000000000002},"max":{"1min":14.147,"5min":24.959,"15min":27.123000000000001},"last":1.764},{"interface":"front","average":{"1min":5.1989999999999998,"5min":5.3330000000000002,"15min":3.8809999999999998},"min":{"1min":0.751,"5min":0.66000000000000003,"15min":0.59999999999999998},"max":{"1min":44.643999999999998,"5min":44.643999999999998,"15min":66.760999999999996},"last":1.421}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.6709999999999998,"5min":3.8260000000000001,"15min":3.036},"min":{"1min":0.86499999999999999,"5min":0.77400000000000002,"15min":0.59399999999999997},"max":{"1min":10.712999999999999,"5min":30.198,"15min":37.747999999999998},"last":1.5900000000000001},{"interface":"front","average":{"1min":3.0339999999999998,"5min":3.851,"15min":2.8010000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":14.041,"5min":24.858000000000001,"15min":27.023},"last":1.871}]}]},{"osd":8,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179984,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.857,"15min":1.9650000000000001},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.952,"5min":26.353999999999999,"15min":205.21299999999999},"last":0.752},{"interface":"front","average":{"1min":2.4079999999999999,"5min":4.0979999999999999,"15min":2.1139999999999999},"min":{"1min":0.378,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.4779999999999998,"5min":65.656999999999996,"15min":65.656999999999996},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.071,"5min":1.3779999999999999,"15min":3.8900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":1.4179999999999999,"15min":3.024},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.46100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83499999999999996,"5min":2.0489999999999999,"15min":3.4990000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":1.484,"15min":3.794},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.9129999999999998,"15min":1.7929999999999999},"min":{"1min":0.48599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":13.1,"5min":23.033999999999999,"15min":23.033999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.7310000000000001,"5min":2.919,"15min":1.782},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.42299999999999999},"max":{"1min":13.138999999999999,"5min":23.047999999999998,"15min":23.047999999999998},"last":0.627}]},{"osd":4,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.58999999999999997},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":1.1279999999999999,"5min":1.242,"15min":3.3260000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.497,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0529999999999999,"5min":1.133,"15min":3.839},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27000000000000002},"max":{"1min":0.94299999999999995,"5min":1.359,"15min":2.9809999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":1.651,"15min":4.0069999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":2.2930000000000001,"5min":2.601,"15min":1.8240000000000001},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":13.859,"5min":19.280000000000001,"15min":19.280000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":4.5190000000000001,"5min":2.8199999999999998,"15min":1.7809999999999999},"min":{"1min":0.51300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.779,"5min":15.593999999999999,"15min":15.593999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.198,"15min":4.1059999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":1.4139999999999999,"15min":3.968},"last":0.63800000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":5.9560000000000004,"5min":5.1479999999999997,"15min":2.9540000000000002},"min":{"1min":0.60999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":28.902999999999999,"5min":71.158000000000001,"15min":71.158000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":4.7270000000000003,"5min":3.444,"15min":2.262},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.49199999999999999},"max":{"1min":27.178999999999998,"5min":27.178999999999998,"15min":27.178999999999998},"last":0.95799999999999996}]},{"osd":10,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":1.1319999999999999,"15min":1.855},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.2030000000000001,"15min":1.746},"last":0.76900000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.67800000000000005},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":1.887,"15min":4.3360000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77000000000000002,"5min":1.619,"15min":4.0720000000000001},"last":0.69899999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444190,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280012,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091828,"statfs":{"total":96636764160,"available":96350031872,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":286325194},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":4.1180000000000003,"5min":3.0129999999999999,"15min":1.7789999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":21.872,"5min":43.918999999999997,"15min":43.918999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.052,"15min":1.831},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.32900000000000001},"max":{"1min":21.887,"5min":43.935000000000002,"15min":43.935000000000002},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.224,"15min":0.20599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":1.1299999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":2.3140000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41299999999999998,"15min":0.48499999999999999},"min":{"1min":0.312,"5min":0.252,"15min":0.252},"max":{"1min":0.85799999999999998,"5min":1.196,"15min":1.77},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.958,"15min":1.425},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":8.1379999999999999,"5min":15.101000000000001,"15min":15.101000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":3.3479999999999999,"5min":3.1989999999999998,"15min":2.1680000000000001},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.28699999999999998},"max":{"1min":22.602,"5min":32.689999999999998,"15min":41.405000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38500000000000001,"15min":0.41099999999999998},"min":{"1min":0.307,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.8740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47599999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.60699999999999998,"5min":0.98099999999999998,"15min":13.967000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.61099999999999999},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.88900000000000001,"15min":13.952999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1989999999999998,"5min":2.504,"15min":1.8759999999999999},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":7.7069999999999999,"5min":23.959,"15min":23.959},"last":0.77500000000000002},{"interface":"front","average":{"1min":6.1200000000000001,"5min":3.806,"15min":2.3370000000000002},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":82.087000000000003,"5min":82.087000000000003,"15min":82.087000000000003},"last":0.747}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.1579999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.4930000000000001},"last":0.86599999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":3.524,"5min":2.577,"15min":1.95},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":13.708,"5min":16.113,"15min":27.177},"last":0.80700000000000005},{"interface":"front","average":{"1min":3.3530000000000002,"5min":3.25,"15min":2.327},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":33.146000000000001,"5min":33.146000000000001,"15min":34.470999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":2.5019999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":1.798,"5min":1.798,"15min":2.4580000000000002},"last":0.83299999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":327680,"data_stored":154436,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":5.5010000000000003,"15min":3.7109999999999999},"min":{"1min":0.46300000000000002,"5min":0.34499999999999997,"15min":0.313},"max":{"1min":17.585000000000001,"5min":91.042000000000002,"15min":91.042000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":3.137,"5min":6.2519999999999998,"15min":4.9219999999999997},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.39800000000000002},"max":{"1min":13.849,"5min":88.256,"15min":115.06999999999999},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":2.778,"15min":2.1619999999999999},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.32500000000000001},"max":{"1min":4.5449999999999999,"5min":21.131,"15min":30.702999999999999},"last":1.171},{"interface":"front","average":{"1min":2.3439999999999999,"5min":4.8090000000000002,"15min":3.8969999999999998},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.3860000000000001,"5min":86.691999999999993,"15min":114.93899999999999},"last":1.1100000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.9020000000000001,"15min":2.3180000000000001},"min":{"1min":0.46100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.282,"5min":21.013999999999999,"15min":30.670999999999999},"last":1.046},{"interface":"front","average":{"1min":2.9510000000000001,"5min":4.569,"15min":3.0659999999999998},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":17.640999999999998,"5min":62.164999999999999,"15min":68.652000000000001},"last":0.85699999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.3999999999999999,"5min":8.875,"15min":6.0069999999999997},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":11.361000000000001,"5min":219.733,"15min":219.733},"last":1.6499999999999999},{"interface":"front","average":{"1min":3.2280000000000002,"5min":4.7880000000000003,"15min":4.1319999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.4329999999999998,"5min":45.109999999999999,"15min":82.281000000000006},"last":1.9710000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1400000000000001,"15min":2.548},"min":{"1min":0.61799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.6210000000000004,"5min":21.064,"15min":30.870000000000001},"last":1.754},{"interface":"front","average":{"1min":2.8809999999999998,"5min":4.2519999999999998,"15min":3.149},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":17.747,"5min":40.045000000000002,"15min":68.744},"last":1.3520000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2320000000000002,"5min":4.9969999999999999,"15min":3.3300000000000001},"min":{"1min":0.81000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":17.678000000000001,"5min":90.986999999999995,"15min":90.986999999999995},"last":1.2490000000000001},{"interface":"front","average":{"1min":2.7949999999999999,"5min":5.0979999999999999,"15min":4.2149999999999999},"min":{"1min":0.91700000000000004,"5min":0.48499999999999999,"15min":0.35999999999999999},"max":{"1min":5.5149999999999997,"5min":88.194000000000003,"15min":115.137},"last":1.3819999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4460000000000002,"5min":3.2930000000000001,"15min":2.6640000000000001},"min":{"1min":0.65600000000000003,"5min":0.45800000000000002,"15min":0.438},"max":{"1min":9.5619999999999994,"5min":21.350000000000001,"15min":30.838999999999999},"last":2.0750000000000002},{"interface":"front","average":{"1min":2.964,"5min":4.508,"15min":3.2879999999999998},"min":{"1min":0.53700000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":17.712,"5min":39.990000000000002,"15min":68.778000000000006},"last":1.8129999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":5.2249999999999996,"15min":4.3390000000000004},"min":{"1min":0.83699999999999997,"5min":0.52400000000000002,"15min":0.42999999999999999},"max":{"1min":5.46,"5min":88.147000000000006,"15min":115.03400000000001},"last":1.508},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.7650000000000001,"15min":2.9079999999999999},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.502},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":2.1669999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":7.8390000000000004,"5min":8.7539999999999996,"15min":5.71},"min":{"1min":0.79100000000000004,"5min":0.74399999999999999,"15min":0.58499999999999996},"max":{"1min":30.074000000000002,"5min":91.082999999999998,"15min":91.082999999999998},"last":1.9019999999999999},{"interface":"front","average":{"1min":3.1200000000000001,"5min":7.5270000000000001,"15min":5.5899999999999999},"min":{"1min":0.86599999999999999,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":10.238,"5min":130.30099999999999,"15min":130.30099999999999},"last":1.929}]},{"osd":10,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":3.3820000000000001,"15min":2.7930000000000001},"min":{"1min":0.752,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.7010000000000005,"5min":21.236999999999998,"15min":30.774000000000001},"last":2.274},{"interface":"front","average":{"1min":3.028,"5min":4.8090000000000002,"15min":3.621},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":17.795999999999999,"5min":62.255000000000003,"15min":68.891000000000005},"last":1.581}]},{"osd":11,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":5.7510000000000003,"15min":4.6230000000000002},"min":{"1min":1.002,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":9.4730000000000008,"5min":88.225999999999999,"15min":114.999},"last":1.869},{"interface":"front","average":{"1min":2.4870000000000001,"5min":3.597,"15min":2.9289999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":9.6639999999999997,"5min":21.199999999999999,"15min":30.808},"last":2.3660000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444190,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357680,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":94014160,"statfs":{"total":96636764160,"available":96270499840,"internally_reserved":0,"allocated":1744896,"data_stored":3813836,"data_compressed":431039,"data_compressed_allocated":585728,"data_compressed_original":2867200,"omap_allocated":1595,"internal_metadata":364509637},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.0390000000000001,"15min":1.3999999999999999},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.26300000000000001},"max":{"1min":16.375,"5min":16.375,"15min":21.427},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.5379999999999998,"15min":1.6319999999999999},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":15.911,"5min":23.23,"15min":23.23},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.47299999999999998,"15min":0.54500000000000004},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":2.4430000000000001,"15min":14.186},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.46000000000000002,"15min":0.54500000000000004},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.835,"15min":14.391999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35799999999999998,"15min":0.379},"min":{"1min":0.246,"5min":0.188,"15min":0.188},"max":{"1min":0.45600000000000002,"5min":1.7629999999999999,"15min":2.5619999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.437,"5min":1.643,"15min":2.8940000000000001},"last":0.378}]},{"osd":3,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":4.46,"5min":2.6970000000000001,"15min":1.631},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":35.134,"5min":35.134,"15min":35.134},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.9460000000000002,"15min":1.786},"min":{"1min":0.47599999999999998,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":10.67,"5min":48.656999999999996,"15min":48.656999999999996},"last":0.94599999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56999999999999995,"15min":0.64700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27200000000000002},"max":{"1min":1.8029999999999999,"5min":1.905,"15min":14.831},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.34000000000000002,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":1.835,"5min":1.9670000000000001,"15min":14.846},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.8260000000000001,"15min":2.0169999999999999},"min":{"1min":0.44700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.5869999999999997,"5min":30.489000000000001,"15min":46.009999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":5.835,"5min":3.6000000000000001,"15min":2.738},"min":{"1min":0.41799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":31.315000000000001,"5min":36.401000000000003,"15min":67.126999999999995},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.27200000000000002},"max":{"1min":1.228,"5min":1.7769999999999999,"15min":14.211},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.621},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.309},"max":{"1min":1.2529999999999999,"5min":1.3959999999999999,"15min":14.241},"last":0.54100000000000004}]},{"osd":8,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88900000000000001,"5min":1.738,"15min":1.738},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":1.351,"15min":2.5870000000000002},"last":0.498}]},{"osd":9,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.6379999999999999,"15min":1.901},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":32.753999999999998,"5min":32.753999999999998,"15min":32.753999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":3.9740000000000002,"5min":2.8730000000000002,"15min":2.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":13.407,"5min":36.168999999999997,"15min":36.168999999999997},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":0.65900000000000003,"5min":1.4430000000000001,"15min":1.476},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":2.036,"15min":2.298},"last":0.628}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274380,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94097460,"statfs":{"total":96636764160,"available":96355799040,"internally_reserved":0,"allocated":331776,"data_stored":157118,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.313,"15min":0.33800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":0.372,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.373},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.33400000000000002,"15min":0.35199999999999998},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.39300000000000002,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.0299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80800000000000005,"5min":1.325,"15min":1.325},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":3.101,"15min":1.9830000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":6.1020000000000003,"5min":31.25,"15min":31.25},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.133,"5min":2.1749999999999998,"15min":1.607},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":5.4619999999999997,"5min":23.829000000000001,"15min":23.829000000000001},"last":0.627}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42499999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":0.48399999999999999,"5min":1.177,"15min":1.371},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26000000000000001},"max":{"1min":1.2090000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":3.4660000000000002,"15min":2.738},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.0510000000000002,"5min":103.301,"15min":103.301},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.5049999999999999,"5min":2.4889999999999999,"15min":1.651},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":7.774,"5min":19.571000000000002,"15min":19.866},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45700000000000002,"15min":0.47999999999999998},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":0.61799999999999999,"5min":1.0720000000000001,"15min":1.3819999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.502,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":1.153,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":1.774,"15min":2.3029999999999999},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.6389999999999998,"15min":2.0550000000000002},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":7.9050000000000002,"5min":23.103000000000002,"15min":31.655999999999999},"last":0.872},{"interface":"front","average":{"1min":1.482,"5min":3.7919999999999998,"15min":2.1720000000000002},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":7.0039999999999996,"5min":65.191999999999993,"15min":65.191999999999993},"last":0.73499999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51300000000000001,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.628,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57499999999999996}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61399999999999999,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.7450000000000001,"15min":2.3250000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444190,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279944,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091896,"statfs":{"total":96636764160,"available":96350101504,"internally_reserved":0,"allocated":327680,"data_stored":154308,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4009999999999998,"5min":5.548,"15min":3.5800000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":20.800000000000001,"5min":46.143000000000001,"15min":46.143000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":5.774,"5min":6.4850000000000003,"15min":4.1550000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":36.734999999999999,"5min":79.581000000000003,"15min":79.581000000000003},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.8959999999999999,"5min":5.3330000000000002,"15min":3.5960000000000001},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":36.805999999999997,"5min":79.177000000000007,"15min":79.177000000000007},"last":1.016},{"interface":"front","average":{"1min":3.2669999999999999,"5min":3.5049999999999999,"15min":2.4329999999999998},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.27600000000000002},"max":{"1min":12.286,"5min":23.809999999999999,"15min":23.809999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":3.8820000000000001,"15min":2.7919999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":20.562000000000001,"5min":46.396999999999998,"15min":46.396999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":3.302,"5min":3.5,"15min":2.5649999999999999},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.37},"max":{"1min":12.374000000000001,"5min":23.866,"15min":23.866},"last":0.90600000000000003}]},{"osd":4,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1340000000000003,"5min":5.4550000000000001,"15min":3.742},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":36.771000000000001,"5min":79.043999999999997,"15min":79.043999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":4.1699999999999999,"5min":4.3879999999999999,"15min":2.9750000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":20.638000000000002,"5min":46.530999999999999,"15min":46.530999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1269999999999998,"5min":5.3710000000000004,"15min":3.7719999999999998},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":36.646000000000001,"5min":79.094999999999999,"15min":79.094999999999999},"last":1.26},{"interface":"front","average":{"1min":4.2069999999999999,"5min":4.0679999999999996,"15min":2.9399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":20.765000000000001,"5min":46.567999999999998,"15min":46.567999999999998},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.629,"15min":2.6560000000000001},"min":{"1min":0.84599999999999997,"5min":0.55300000000000005,"15min":0.39500000000000002},"max":{"1min":13.209,"5min":23.776,"15min":23.776},"last":1.2350000000000001},{"interface":"front","average":{"1min":4.2469999999999999,"5min":5.6219999999999999,"15min":3.9750000000000001},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":36.840000000000003,"5min":79.140000000000001,"15min":79.140000000000001},"last":1.1599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.2770000000000001,"5min":4.1989999999999998,"15min":3.145},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":20.687999999999999,"5min":51.311,"15min":51.311},"last":1.1020000000000001},{"interface":"front","average":{"1min":3.4569999999999999,"5min":3.6499999999999999,"15min":2.79},"min":{"1min":0.73999999999999999,"5min":0.65000000000000002,"15min":0.436},"max":{"1min":13.279999999999999,"5min":23.745000000000001,"15min":23.745000000000001},"last":1.298}]},{"osd":9,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":6.2000000000000002,"5min":5.298,"15min":3.8900000000000001},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.41399999999999998},"max":{"1min":31.452000000000002,"5min":31.452000000000002,"15min":31.978999999999999},"last":1.347},{"interface":"front","average":{"1min":4.984,"5min":7.7460000000000004,"15min":5.452},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46300000000000002},"max":{"1min":37.411000000000001,"5min":79.388999999999996,"15min":79.388999999999996},"last":1.321}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.9279999999999999,"15min":3.0510000000000002},"min":{"1min":0.91000000000000003,"5min":0.73199999999999998,"15min":0.46000000000000002},"max":{"1min":13.244999999999999,"5min":23.838999999999999,"15min":31.469999999999999},"last":1.419},{"interface":"front","average":{"1min":4.7699999999999996,"5min":5.8140000000000001,"15min":4.1769999999999996},"min":{"1min":0.60499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.698,"5min":79.213999999999999,"15min":79.213999999999999},"last":1.361}]},{"osd":11,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4059999999999997,"5min":4.46,"15min":3.1960000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":20.728000000000002,"5min":51.438000000000002,"15min":51.438000000000002},"last":1.127},{"interface":"front","average":{"1min":3.456,"5min":3.855,"15min":3.0640000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.498},"max":{"1min":12.414,"5min":23.896999999999998,"15min":31.771999999999998},"last":1.3919999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231264,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94140576,"statfs":{"total":96636764160,"available":96399949824,"internally_reserved":0,"allocated":1662976,"data_stored":3219150,"data_compressed":397517,"data_compressed_allocated":540672,"data_compressed_original":2293760,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":2.3519999999999999,"15min":2.1890000000000001},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":24.849,"5min":29.721,"15min":115.97},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0029999999999999,"5min":2.4060000000000001,"15min":1.73},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9459999999999997,"5min":30.361999999999998,"15min":36.359999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41099999999999998,"15min":0.51800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57199999999999995,"5min":1.044,"15min":2.734},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42899999999999999,"15min":0.502},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":1.256,"15min":2.4340000000000002},"last":0.752}]},{"osd":3,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":2.6949999999999998,"15min":1.8560000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":3.8730000000000002,"5min":27.800000000000001,"15min":27.800000000000001},"last":0.5},{"interface":"front","average":{"1min":1.5640000000000001,"5min":2.7149999999999999,"15min":1.861},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.891,"5min":29.364999999999998,"15min":29.364999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47699999999999998,"15min":0.58299999999999996},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.089,"5min":1.3109999999999999,"15min":2.4729999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.23599999999999999},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.5419999999999998},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41199999999999998,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.534,"15min":2.903},"last":0.375},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.219},"max":{"1min":1.1120000000000001,"5min":1.6479999999999999,"15min":2.1869999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.9350000000000001,"15min":1.5680000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.6799999999999997,"5min":16.079000000000001,"15min":16.079000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.786,"5min":1.921,"15min":1.5880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.432},"max":{"1min":10.737,"5min":16.065000000000001,"15min":16.065000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.119,"15min":2.5470000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.755,"5min":1.6639999999999999,"15min":2.6259999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":1.3280000000000001,"5min":1.889,"15min":1.972},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":1.2390000000000001,"15min":1.8720000000000001},"last":0.47099999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.8450000000000002,"5min":5.1509999999999998,"15min":3.113},"min":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.40500000000000003},"max":{"1min":8.5630000000000006,"5min":118.07299999999999,"15min":118.07299999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.524,"5min":2.464,"15min":1.8600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.0650000000000004,"5min":18.303000000000001,"15min":25.349},"last":0.59499999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65800000000000003,"15min":0.72999999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.595,"15min":2.6739999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.68500000000000005},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":1.369,"15min":2.5110000000000001},"last":0.80100000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0489999999999999,"5min":1.837,"15min":2.9380000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":1.5009999999999999,"15min":2.9100000000000001},"last":0.57999999999999996}]}]},{"osd":1,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225796,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94146044,"statfs":{"total":96636764160,"available":96405549056,"internally_reserved":0,"allocated":323584,"data_stored":152854,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":230881735},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.671,"15min":1.54},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":4.1130000000000004,"5min":21.425000000000001,"15min":26.550000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":2.1509999999999998,"15min":1.5820000000000001},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":6.2539999999999996,"5min":26.841999999999999,"15min":31.741},"last":0.621}]},{"osd":2,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40999999999999998,"15min":0.625},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":1.155,"5min":2.1970000000000001,"15min":58.337000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":1.046,"5min":2.3119999999999998,"15min":60.276000000000003},"last":0.49099999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.1629999999999998,"15min":1.6240000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":7.1200000000000001,"5min":16.724,"15min":30.460000000000001},"last":0.438},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.347,"15min":1.6659999999999999},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":8.2010000000000005,"5min":19.312999999999999,"15min":20.971},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.378},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"min":{"1min":0.25,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0049999999999999,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.28799999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0229999999999999,"5min":1.8660000000000001,"15min":58.32},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.71199999999999997},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.236,"5min":2.3740000000000001,"15min":60.185000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":4.3849999999999998,"15min":3.1389999999999998},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.33300000000000002},"max":{"1min":8.3200000000000003,"5min":98.299999999999997,"15min":98.299999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.7290000000000001,"5min":2.7010000000000001,"15min":1.879},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":12.612,"5min":24.501999999999999,"15min":24.501999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.02,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49399999999999999,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":2.161,"15min":2.161},"last":0.38700000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3740000000000001,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55600000000000005,"15min":0.60699999999999998},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.33700000000000002},"max":{"1min":1.073,"5min":1.286,"15min":3.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Wed Feb 21 07:57:53 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":4.5640000000000001,"15min":2.9159999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.433},"max":{"1min":6.5940000000000003,"5min":91.182000000000002,"15min":91.182000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":2.423,"5min":3.081,"15min":2.1869999999999998},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.45500000000000002},"max":{"1min":14.013999999999999,"5min":32.460999999999999,"15min":32.460999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":1.242,"15min":1.242},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":1.0780000000000001},"last":0.56399999999999995}]}]},{"osd":0,"up_from":17,"seq":73014444191,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266064,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":94105776,"statfs":{"total":96636764160,"available":96364314624,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":3.3580000000000001,"15min":2.238},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.249},"max":{"1min":6.6929999999999996,"5min":54.454999999999998,"15min":54.454999999999998},"last":0.624},{"interface":"front","average":{"1min":2.355,"5min":3.1000000000000001,"15min":2.4830000000000001},"min":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.27400000000000002},"max":{"1min":15.474,"5min":27.855,"15min":67.233999999999995},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":4.016,"5min":3.4220000000000002,"15min":2.2530000000000001},"min":{"1min":0.34899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":34.563000000000002,"5min":34.563000000000002,"15min":34.563000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.532,"5min":3.7469999999999999,"15min":2.4390000000000001},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":32.026000000000003,"5min":54.421999999999997,"15min":54.421999999999997},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.786,"5min":5.3559999999999999,"15min":3.7480000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":16.306000000000001,"5min":79.024000000000001,"15min":79.024000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":5.343,"5min":5.181,"15min":3.3759999999999999},"min":{"1min":0.71499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":45.561999999999998,"5min":79.706999999999994,"15min":79.706999999999994},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1200000000000001,"5min":3.5680000000000001,"15min":2.4420000000000002},"min":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.39000000000000001},"max":{"1min":10.544,"5min":54.353000000000002,"15min":54.353000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":2.569,"5min":3.1429999999999998,"15min":2.7090000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":15.821999999999999,"5min":27.782,"15min":67.313000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":5.2709999999999999,"15min":3.9119999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":15.978,"5min":79.078000000000003,"15min":79.078000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":4.4340000000000002,"5min":7.2489999999999997,"15min":4.5309999999999997},"min":{"1min":0.66400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":17.498000000000001,"5min":86.691999999999993,"15min":86.691999999999993},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":3.3980000000000001,"15min":2.6030000000000002},"min":{"1min":0.51300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.2089999999999996,"5min":32.107999999999997,"15min":32.107999999999997},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.169,"5min":3.7080000000000002,"15min":2.625},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":10.457000000000001,"5min":54.386000000000003,"15min":54.386000000000003},"last":0.83899999999999997}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.681,"5min":3.7229999999999999,"15min":3.1080000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.439},"max":{"1min":16.138999999999999,"5min":27.902999999999999,"15min":67.387},"last":0.76900000000000002},{"interface":"front","average":{"1min":2.661,"5min":3.609,"15min":2.7909999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.437},"max":{"1min":8.2479999999999993,"5min":31.966999999999999,"15min":31.966999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":6.0140000000000002,"15min":4.4189999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.45200000000000001},"max":{"1min":10.692,"5min":40.402000000000001,"15min":152.25700000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":4.9989999999999997,"5min":6.6079999999999997,"15min":4.4859999999999998},"min":{"1min":0.70599999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"max":{"1min":19.376999999999999,"5min":111.746,"15min":111.746},"last":1.2030000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":4.0259999999999998,"15min":2.8439999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.503},"max":{"1min":10.574,"5min":54.490000000000002,"15min":54.490000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":3.577,"5min":3.8639999999999999,"15min":3.2440000000000002},"min":{"1min":0.78700000000000003,"5min":0.60099999999999998,"15min":0.54000000000000004},"max":{"1min":16.544,"5min":27.821000000000002,"15min":67.423000000000002},"last":1.0740000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":4.4470000000000001,"15min":3.0499999999999998},"min":{"1min":0.85999999999999999,"5min":0.71999999999999997,"15min":0.58699999999999997},"max":{"1min":10.599,"5min":54.298000000000002,"15min":54.298000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0149999999999997,"15min":3.3460000000000001},"min":{"1min":0.82599999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"max":{"1min":16.344999999999999,"5min":28.864999999999998,"15min":67.454999999999998},"last":1.1160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":3066968,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1359872,"data_stored":3067190,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:58:21.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:58:21.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.873+0000 7fe85e400640 1 Processor -- start 2024-02-21T07:58:21.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.873+0000 7fe85e400640 1 -- start start 2024-02-21T07:58:21.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe85e400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe85817c040 0x7fe8580706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe85e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe858070f30 0x7fe8580713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe85e400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8580f50d0 con 0x7fe858188c00 2024-02-21T07:58:21.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe85e400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8580f4ec0 con 0x7fe858070f30 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe85e400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8580f6450 con 0x7fe85817c040 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe856a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe858070f30 0x7fe8580713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe857400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe85817c040 0x7fe8580706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe856a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe858070f30 0x7fe8580713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54718/0 (socket says 172.21.15.100:54718) 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.875+0000 7fe856a00640 1 -- 172.21.15.100:0/1817722267 learned_addr learned my addr 172.21.15.100:0/1817722267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.876+0000 7fe856a00640 1 -- 172.21.15.100:0/1817722267 >> v2:172.21.15.170:3300/0 conn(0x7fe85817c040 msgr2=0x7fe8580706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:21.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.876+0000 7fe856a00640 1 --2- 172.21.15.100:0/1817722267 >> v2:172.21.15.170:3300/0 conn(0x7fe85817c040 0x7fe8580706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.876+0000 7fe856a00640 1 -- 172.21.15.100:0/1817722267 >> v1:172.21.15.100:6789/0 conn(0x7fe858188c00 legacy=0x7fe858189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.876+0000 7fe856a00640 1 -- 172.21.15.100:0/1817722267 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8580f53b0 con 0x7fe858070f30 2024-02-21T07:58:21.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.876+0000 7fe856000640 1 -- 172.21.15.100:0/1817722267 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950684306 0 0) 0x7fe8580f50d0 con 0x7fe858188c00 2024-02-21T07:58:21.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.877+0000 7fe856a00640 1 --2- 172.21.15.100:0/1817722267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe8580713a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe844009870 tx=0x7fe84402dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb7808409d27614 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.877+0000 7fe856000640 1 -- 172.21.15.100:0/1817722267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84402e9e0 con 0x7fe858070f30 2024-02-21T07:58:21.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.877+0000 7fe856000640 1 -- 172.21.15.100:0/1817722267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84402eb40 con 0x7fe858070f30 2024-02-21T07:58:21.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.877+0000 7fe856000640 1 -- 172.21.15.100:0/1817722267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844036440 con 0x7fe858070f30 2024-02-21T07:58:21.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 -- 172.21.15.100:0/1817722267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 msgr2=0x7fe8580713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 --2- 172.21.15.100:0/1817722267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe8580713a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe844009870 tx=0x7fe84402dc30 comp rx=0 tx=0).stop 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 -- 172.21.15.100:0/1817722267 shutdown_connections 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 --2- 172.21.15.100:0/1817722267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe8580713a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 --2- 172.21.15.100:0/1817722267 >> v2:172.21.15.170:3300/0 conn(0x7fe85817c040 0x7fe8580706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 -- 172.21.15.100:0/1817722267 >> 172.21.15.100:0/1817722267 conn(0x7fe8580ce160 msgr2=0x7fe8580ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 -- 172.21.15.100:0/1817722267 shutdown_connections 2024-02-21T07:58:21.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.878+0000 7fe85e400640 1 -- 172.21.15.100:0/1817722267 wait complete. 2024-02-21T07:58:21.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.880+0000 7fe85e400640 1 Processor -- start 2024-02-21T07:58:21.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.880+0000 7fe85e400640 1 -- start start 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85817c040 0x7fe858169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe858188c00 0x7fe8581639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8581698c0 con 0x7fe858070f30 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858168960 con 0x7fe85817c040 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.881+0000 7fe85e400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe858168c40 con 0x7fe858188c00 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54730/0 (socket says 172.21.15.100:54730) 2024-02-21T07:58:21.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 -- 172.21.15.100:0/3235486865 learned_addr learned my addr 172.21.15.100:0/3235486865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:21.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857e00640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe858188c00 0x7fe8581639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe856a00640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85817c040 0x7fe858169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 -- 172.21.15.100:0/3235486865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe858188c00 msgr2=0x7fe8581639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe858188c00 0x7fe8581639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 -- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85817c040 msgr2=0x7fe858169ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85817c040 0x7fe858169ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.882+0000 7fe857400640 1 -- 172.21.15.100:0/3235486865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440094d0 con 0x7fe858070f30 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe857400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe84800e9b0 tx=0x7fe84800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848009670 con 0x7fe858070f30 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84800c9a0 con 0x7fe858070f30 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800cd50 con 0x7fe858070f30 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe858168f20 con 0x7fe858070f30 2024-02-21T07:58:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.883+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8581694e0 con 0x7fe858070f30 2024-02-21T07:58:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.884+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858067c80 con 0x7fe858070f30 2024-02-21T07:58:21.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.886+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe848013470 con 0x7fe858070f30 2024-02-21T07:58:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.887+0000 7fe84f400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 0x7fe8380a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:21.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.887+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe8480c9c60 con 0x7fe858070f30 2024-02-21T07:58:21.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.888+0000 7fe856a00640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 0x7fe8380a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:21.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.888+0000 7fe856a00640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 0x7fe8380a1560 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe844038000 tx=0x7fe844032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:21.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:21.892+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe848093b20 con 0x7fe858070f30 2024-02-21T07:58:22.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.084+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8580cdea0 con 0x7fe83809f0a0 2024-02-21T07:58:22.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.097+0000 7fe84f400640 1 -- 172.21.15.100:0/3235486865 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+420605 (secure 0 0 0) 0x7fe8580cdea0 con 0x7fe83809f0a0 2024-02-21T07:58:22.105 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.105+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 msgr2=0x7fe8380a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.105+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 0x7fe8380a1560 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe844038000 tx=0x7fe844032000 comp rx=0 tx=0).stop 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 msgr2=0x7fe858168370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe84800e9b0 tx=0x7fe84800ee70 comp rx=0 tx=0).stop 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 shutdown_connections 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe858188c00 0x7fe8581639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85817c040 0x7fe858169ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe83809f0a0 0x7fe8380a1560 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 --2- 172.21.15.100:0/3235486865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe858070f30 0x7fe858168370 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 >> 172.21.15.100:0/3235486865 conn(0x7fe8580ce160 msgr2=0x7fe858071310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 shutdown_connections 2024-02-21T07:58:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.106+0000 7fe85e400640 1 -- 172.21.15.100:0/3235486865 wait complete. 2024-02-21T07:58:22.127 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-02-21T07:58:20.089238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3662778,"num_objects":78,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5816,"num_read_kb":10139,"num_write":755942,"num_write_kb":194947101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72890,"ondisk_log_size":72890,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3117696,"kb_used_data":6624,"kb_used_omap":18,"kb_used_meta":3110957,"kb_avail":1129344384,"statfs":{"total":1159641169920,"available":1156448649216,"internally_reserved":0,"allocated":6782976,"data_stored":9184040,"data_compressed":1002998,"data_compressed_allocated":1376256,"data_compressed_original":6144000,"omap_allocated":19141,"internal_metadata":3185620283},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4295213369,"num_objects":-1028,"num_object_clones":0,"num_object_copies":-4108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1028,"num_whiteouts":0,"num_read":90,"num_read_kb":59,"num_write":1038,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003348"},"pg_stats":[{"pgid":"2.1f","version":"30'109","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.687409+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:57:46.687409+0000","last_peered":"2024-02-21T07:57:46.687409+0000","last_clean":"2024-02-21T07:57:46.687409+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:57:46.687409+0000","last_undegraded":"2024-02-21T07:57:46.687409+0000","last_fullsized":"2024-02-21T07:57:46.687409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":57,"num_write":210,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"30'5","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859091+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:55:29.859091+0000","last_peered":"2024-02-21T07:55:29.859091+0000","last_clean":"2024-02-21T07:55:29.859091+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:55:29.859091+0000","last_undegraded":"2024-02-21T07:55:29.859091+0000","last_fullsized":"2024-02-21T07:55:29.859091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'2349","reported_seq":2379,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733484+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:58:07.733484+0000","last_peered":"2024-02-21T07:58:07.733484+0000","last_clean":"2024-02-21T07:58:07.733484+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:58:07.733484+0000","last_undegraded":"2024-02-21T07:58:07.733484+0000","last_fullsized":"2024-02-21T07:58:07.733484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25104,"num_write_kb":6480128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"30'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:30.027684+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:57:30.027684+0000","last_peered":"2024-02-21T07:57:30.027684+0000","last_clean":"2024-02-21T07:57:30.027684+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:57:30.027684+0000","last_undegraded":"2024-02-21T07:57:30.027684+0000","last_fullsized":"2024-02-21T07:57:30.027684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683193+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:55:54.683193+0000","last_peered":"2024-02-21T07:55:54.683193+0000","last_clean":"2024-02-21T07:55:54.683193+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:55:54.683193+0000","last_undegraded":"2024-02-21T07:55:54.683193+0000","last_fullsized":"2024-02-21T07:55:54.683193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'2450","reported_seq":2473,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.756048+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:58:07.756048+0000","last_peered":"2024-02-21T07:58:07.756048+0000","last_clean":"2024-02-21T07:58:07.756048+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:58:07.756048+0000","last_undegraded":"2024-02-21T07:58:07.756048+0000","last_fullsized":"2024-02-21T07:58:07.756048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26394,"num_write_kb":6774912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"30'6","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426615+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:57:46.426615+0000","last_peered":"2024-02-21T07:57:46.426615+0000","last_clean":"2024-02-21T07:57:46.426615+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:57:46.426615+0000","last_undegraded":"2024-02-21T07:57:46.426615+0000","last_fullsized":"2024-02-21T07:57:46.426615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.012104+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:55:29.012104+0000","last_peered":"2024-02-21T07:55:29.012104+0000","last_clean":"2024-02-21T07:55:29.012104+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:55:29.012104+0000","last_undegraded":"2024-02-21T07:55:29.012104+0000","last_fullsized":"2024-02-21T07:55:29.012104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1816","reported_seq":1857,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782324+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:58:07.782324+0000","last_peered":"2024-02-21T07:58:07.782324+0000","last_clean":"2024-02-21T07:58:07.782324+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:58:07.782324+0000","last_undegraded":"2024-02-21T07:58:07.782324+0000","last_fullsized":"2024-02-21T07:58:07.782324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19208,"num_write_kb":5027530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.425159+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:57:46.425159+0000","last_peered":"2024-02-21T07:57:46.425159+0000","last_clean":"2024-02-21T07:57:46.425159+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:57:46.425159+0000","last_undegraded":"2024-02-21T07:57:46.425159+0000","last_fullsized":"2024-02-21T07:57:46.425159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:59.075455+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:57:59.075455+0000","last_peered":"2024-02-21T07:57:59.075455+0000","last_clean":"2024-02-21T07:57:59.075455+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:57:59.075455+0000","last_undegraded":"2024-02-21T07:57:59.075455+0000","last_fullsized":"2024-02-21T07:57:59.075455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1978","reported_seq":2001,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.789935+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:58:07.789935+0000","last_peered":"2024-02-21T07:58:07.789935+0000","last_clean":"2024-02-21T07:58:07.789935+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:58:07.789935+0000","last_undegraded":"2024-02-21T07:58:07.789935+0000","last_fullsized":"2024-02-21T07:58:07.789935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21148,"num_write_kb":5478976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.017379+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:54:09.017379+0000","last_peered":"2024-02-21T07:54:09.017379+0000","last_clean":"2024-02-21T07:54:09.017379+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:54:09.017379+0000","last_undegraded":"2024-02-21T07:54:09.017379+0000","last_fullsized":"2024-02-21T07:54:09.017379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"30'54","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426547+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:57:46.426547+0000","last_peered":"2024-02-21T07:57:46.426547+0000","last_clean":"2024-02-21T07:57:46.426547+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:57:46.426547+0000","last_undegraded":"2024-02-21T07:57:46.426547+0000","last_fullsized":"2024-02-21T07:57:46.426547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"30'2241","reported_seq":2264,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820476+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:58:07.820476+0000","last_peered":"2024-02-21T07:58:07.820476+0000","last_clean":"2024-02-21T07:58:07.820476+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:58:07.820476+0000","last_undegraded":"2024-02-21T07:58:07.820476+0000","last_fullsized":"2024-02-21T07:58:07.820476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23912,"num_write_kb":6167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.804264+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:54:29.804264+0000","last_peered":"2024-02-21T07:54:29.804264+0000","last_clean":"2024-02-21T07:54:29.804264+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:54:29.804264+0000","last_undegraded":"2024-02-21T07:54:29.804264+0000","last_fullsized":"2024-02-21T07:54:29.804264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:44.800645+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:57:44.800645+0000","last_peered":"2024-02-21T07:57:44.800645+0000","last_clean":"2024-02-21T07:57:44.800645+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:57:44.800645+0000","last_undegraded":"2024-02-21T07:57:44.800645+0000","last_fullsized":"2024-02-21T07:57:44.800645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.620008+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:58:07.620008+0000","last_peered":"2024-02-21T07:58:07.620008+0000","last_clean":"2024-02-21T07:58:07.620008+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:58:07.620008+0000","last_undegraded":"2024-02-21T07:58:07.620008+0000","last_fullsized":"2024-02-21T07:58:07.620008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":23651,"num_write_kb":6110913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027473+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:54:09.027473+0000","last_peered":"2024-02-21T07:54:09.027473+0000","last_clean":"2024-02-21T07:54:09.027473+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:54:09.027473+0000","last_undegraded":"2024-02-21T07:54:09.027473+0000","last_fullsized":"2024-02-21T07:54:09.027473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.429810+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:57:46.429810+0000","last_peered":"2024-02-21T07:57:46.429810+0000","last_clean":"2024-02-21T07:57:46.429810+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:57:46.429810+0000","last_undegraded":"2024-02-21T07:57:46.429810+0000","last_fullsized":"2024-02-21T07:57:46.429810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'2353","reported_seq":2393,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739796+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:58:07.739796+0000","last_peered":"2024-02-21T07:58:07.739796+0000","last_clean":"2024-02-21T07:58:07.739796+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:58:07.739796+0000","last_undegraded":"2024-02-21T07:58:07.739796+0000","last_fullsized":"2024-02-21T07:58:07.739796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25161,"num_write_kb":6532545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"30'4","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:20.034801+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:56:20.034801+0000","last_peered":"2024-02-21T07:56:20.034801+0000","last_clean":"2024-02-21T07:56:20.034801+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:56:20.034801+0000","last_undegraded":"2024-02-21T07:56:20.034801+0000","last_fullsized":"2024-02-21T07:56:20.034801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:08.996967+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:54:08.996967+0000","last_peered":"2024-02-21T07:54:08.996967+0000","last_clean":"2024-02-21T07:54:08.996967+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:54:08.996967+0000","last_undegraded":"2024-02-21T07:54:08.996967+0000","last_fullsized":"2024-02-21T07:54:08.996967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"30'2033","reported_seq":2056,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.600262+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:58:07.600262+0000","last_peered":"2024-02-21T07:58:07.600262+0000","last_clean":"2024-02-21T07:58:07.600262+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:58:07.600262+0000","last_undegraded":"2024-02-21T07:58:07.600262+0000","last_fullsized":"2024-02-21T07:58:07.600262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21864,"num_write_kb":5639616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.525799+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:54:09.525799+0000","last_peered":"2024-02-21T07:54:09.525799+0000","last_clean":"2024-02-21T07:54:09.525799+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:54:09.525799+0000","last_undegraded":"2024-02-21T07:54:09.525799+0000","last_fullsized":"2024-02-21T07:54:09.525799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'52","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.394892+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:57:38.394892+0000","last_peered":"2024-02-21T07:57:38.394892+0000","last_clean":"2024-02-21T07:57:38.394892+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:57:38.394892+0000","last_undegraded":"2024-02-21T07:57:38.394892+0000","last_fullsized":"2024-02-21T07:57:38.394892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":19,"num_write":102,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"30'1849","reported_seq":1873,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739803+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:58:07.739803+0000","last_peered":"2024-02-21T07:58:07.739803+0000","last_clean":"2024-02-21T07:58:07.739803+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:58:07.739803+0000","last_undegraded":"2024-02-21T07:58:07.739803+0000","last_fullsized":"2024-02-21T07:58:07.739803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19868,"num_write_kb":5174912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764767+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:54:09.764767+0000","last_peered":"2024-02-21T07:54:09.764767+0000","last_clean":"2024-02-21T07:54:09.764767+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:54:09.764767+0000","last_undegraded":"2024-02-21T07:54:09.764767+0000","last_fullsized":"2024-02-21T07:54:09.764767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'77","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.687804+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:58:02.687804+0000","last_peered":"2024-02-21T07:58:02.687804+0000","last_clean":"2024-02-21T07:58:02.687804+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:58:02.687804+0000","last_undegraded":"2024-02-21T07:58:02.687804+0000","last_fullsized":"2024-02-21T07:58:02.687804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"30'2041","reported_seq":2065,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.718088+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:58:07.718088+0000","last_peered":"2024-02-21T07:58:07.718088+0000","last_clean":"2024-02-21T07:58:07.718088+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:58:07.718088+0000","last_undegraded":"2024-02-21T07:58:07.718088+0000","last_fullsized":"2024-02-21T07:58:07.718088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21885,"num_write_kb":5740224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.592062+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:57:46.592062+0000","last_peered":"2024-02-21T07:57:46.592062+0000","last_clean":"2024-02-21T07:57:46.592062+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:57:46.592062+0000","last_undegraded":"2024-02-21T07:57:46.592062+0000","last_fullsized":"2024-02-21T07:57:46.592062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:50.024901+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:55:50.024901+0000","last_peered":"2024-02-21T07:55:50.024901+0000","last_clean":"2024-02-21T07:55:50.024901+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:55:50.024901+0000","last_undegraded":"2024-02-21T07:55:50.024901+0000","last_fullsized":"2024-02-21T07:55:50.024901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"30'2741","reported_seq":2765,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.802965+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:58:07.802965+0000","last_peered":"2024-02-21T07:58:07.802965+0000","last_clean":"2024-02-21T07:58:07.802965+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:58:07.802965+0000","last_undegraded":"2024-02-21T07:58:07.802965+0000","last_fullsized":"2024-02-21T07:58:07.802965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28989,"num_write_kb":7541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.435662+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:57:46.435662+0000","last_peered":"2024-02-21T07:57:46.435662+0000","last_clean":"2024-02-21T07:57:46.435662+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:57:46.435662+0000","last_undegraded":"2024-02-21T07:57:46.435662+0000","last_fullsized":"2024-02-21T07:57:46.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.871861+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:55:54.871861+0000","last_peered":"2024-02-21T07:55:54.871861+0000","last_clean":"2024-02-21T07:55:54.871861+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:55:54.871861+0000","last_undegraded":"2024-02-21T07:55:54.871861+0000","last_fullsized":"2024-02-21T07:55:54.871861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"30'2464","reported_seq":2539,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.741906+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:58:07.741906+0000","last_peered":"2024-02-21T07:58:07.741906+0000","last_clean":"2024-02-21T07:58:07.741906+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:58:07.741906+0000","last_undegraded":"2024-02-21T07:58:07.741906+0000","last_fullsized":"2024-02-21T07:58:07.741906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":26392,"num_write_kb":6842521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.021766+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:55:54.021766+0000","last_peered":"2024-02-21T07:55:54.021766+0000","last_clean":"2024-02-21T07:55:54.021766+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:55:54.021766+0000","last_undegraded":"2024-02-21T07:55:54.021766+0000","last_fullsized":"2024-02-21T07:55:54.021766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.031796+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:55:54.031796+0000","last_peered":"2024-02-21T07:55:54.031796+0000","last_clean":"2024-02-21T07:55:54.031796+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:55:54.031796+0000","last_undegraded":"2024-02-21T07:55:54.031796+0000","last_fullsized":"2024-02-21T07:55:54.031796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"30'2384","reported_seq":2425,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.804283+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:58:07.804283+0000","last_peered":"2024-02-21T07:58:07.804283+0000","last_clean":"2024-02-21T07:58:07.804283+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:58:07.804283+0000","last_undegraded":"2024-02-21T07:58:07.804283+0000","last_fullsized":"2024-02-21T07:58:07.804283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25350,"num_write_kb":6611464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045880+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:55:29.045880+0000","last_peered":"2024-02-21T07:55:29.045880+0000","last_clean":"2024-02-21T07:55:29.045880+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:55:29.045880+0000","last_undegraded":"2024-02-21T07:55:29.045880+0000","last_fullsized":"2024-02-21T07:55:29.045880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'13","reported_seq":795,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:13.556100+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:58:13.556100+0000","last_peered":"2024-02-21T07:58:13.556100+0000","last_clean":"2024-02-21T07:58:13.556100+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:58:13.556100+0000","last_undegraded":"2024-02-21T07:58:13.556100+0000","last_fullsized":"2024-02-21T07:58:13.556100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":751,"num_read_kb":752,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"30'2406","reported_seq":2436,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796313+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:58:07.796313+0000","last_peered":"2024-02-21T07:58:07.796313+0000","last_clean":"2024-02-21T07:58:07.796313+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:58:07.796313+0000","last_undegraded":"2024-02-21T07:58:07.796313+0000","last_fullsized":"2024-02-21T07:58:07.796313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25497,"num_write_kb":6630592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:55.218164+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:55:55.218164+0000","last_peered":"2024-02-21T07:55:55.218164+0000","last_clean":"2024-02-21T07:55:55.218164+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:55:55.218164+0000","last_undegraded":"2024-02-21T07:55:55.218164+0000","last_fullsized":"2024-02-21T07:55:55.218164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026692+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:55:29.026692+0000","last_peered":"2024-02-21T07:55:29.026692+0000","last_clean":"2024-02-21T07:55:29.026692+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:55:29.026692+0000","last_undegraded":"2024-02-21T07:55:29.026692+0000","last_fullsized":"2024-02-21T07:55:29.026692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'2270","reported_seq":2293,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.769251+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:58:07.769251+0000","last_peered":"2024-02-21T07:58:07.769251+0000","last_clean":"2024-02-21T07:58:07.769251+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:58:07.769251+0000","last_undegraded":"2024-02-21T07:58:07.769251+0000","last_fullsized":"2024-02-21T07:58:07.769251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":6335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.905255+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:55:54.905255+0000","last_peered":"2024-02-21T07:55:54.905255+0000","last_clean":"2024-02-21T07:55:54.905255+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:55:54.905255+0000","last_undegraded":"2024-02-21T07:55:54.905255+0000","last_fullsized":"2024-02-21T07:55:54.905255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.037294+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:55:54.037294+0000","last_peered":"2024-02-21T07:55:54.037294+0000","last_clean":"2024-02-21T07:55:54.037294+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:55:54.037294+0000","last_undegraded":"2024-02-21T07:55:54.037294+0000","last_fullsized":"2024-02-21T07:55:54.037294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:24.026223+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:55:24.026223+0000","last_peered":"2024-02-21T07:55:24.026223+0000","last_clean":"2024-02-21T07:55:24.026223+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:55:24.026223+0000","last_undegraded":"2024-02-21T07:55:24.026223+0000","last_fullsized":"2024-02-21T07:55:24.026223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"30'2060","reported_seq":2118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.726474+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:58:07.726474+0000","last_peered":"2024-02-21T07:58:07.726474+0000","last_clean":"2024-02-21T07:58:07.726474+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:58:07.726474+0000","last_undegraded":"2024-02-21T07:58:07.726474+0000","last_fullsized":"2024-02-21T07:58:07.726474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22073,"num_write_kb":5629259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020805+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:54:29.020805+0000","last_peered":"2024-02-21T07:54:29.020805+0000","last_clean":"2024-02-21T07:54:29.020805+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:54:29.020805+0000","last_undegraded":"2024-02-21T07:54:29.020805+0000","last_fullsized":"2024-02-21T07:54:29.020805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.048015+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:56:44.048015+0000","last_peered":"2024-02-21T07:56:44.048015+0000","last_clean":"2024-02-21T07:56:44.048015+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:56:44.048015+0000","last_undegraded":"2024-02-21T07:56:44.048015+0000","last_fullsized":"2024-02-21T07:56:44.048015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"30'2311","reported_seq":2334,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733562+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:58:07.733562+0000","last_peered":"2024-02-21T07:58:07.733562+0000","last_clean":"2024-02-21T07:58:07.733562+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:58:07.733562+0000","last_undegraded":"2024-02-21T07:58:07.733562+0000","last_fullsized":"2024-02-21T07:58:07.733562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24846,"num_write_kb":6393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020785+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:54:29.020785+0000","last_peered":"2024-02-21T07:54:29.020785+0000","last_clean":"2024-02-21T07:54:29.020785+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:54:29.020785+0000","last_undegraded":"2024-02-21T07:54:29.020785+0000","last_fullsized":"2024-02-21T07:54:29.020785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"30'47","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.413600+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:57:38.413600+0000","last_peered":"2024-02-21T07:57:38.413600+0000","last_clean":"2024-02-21T07:57:38.413600+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:57:38.413600+0000","last_undegraded":"2024-02-21T07:57:38.413600+0000","last_fullsized":"2024-02-21T07:57:38.413600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":18,"num_write":93,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'2089","reported_seq":2119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.671207+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:58:07.671207+0000","last_peered":"2024-02-21T07:58:07.671207+0000","last_clean":"2024-02-21T07:58:07.671207+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:58:07.671207+0000","last_undegraded":"2024-02-21T07:58:07.671207+0000","last_fullsized":"2024-02-21T07:58:07.671207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22313,"num_write_kb":5873984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020816+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:54:29.020816+0000","last_peered":"2024-02-21T07:54:29.020816+0000","last_clean":"2024-02-21T07:54:29.020816+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:54:29.020816+0000","last_undegraded":"2024-02-21T07:54:29.020816+0000","last_fullsized":"2024-02-21T07:54:29.020816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042194+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:54:30.042194+0000","last_peered":"2024-02-21T07:54:30.042194+0000","last_clean":"2024-02-21T07:54:30.042194+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:54:30.042194+0000","last_undegraded":"2024-02-21T07:54:30.042194+0000","last_fullsized":"2024-02-21T07:54:30.042194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"30'1828","reported_seq":1851,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782512+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:58:07.782512+0000","last_peered":"2024-02-21T07:58:07.782512+0000","last_clean":"2024-02-21T07:58:07.782512+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:58:07.782512+0000","last_undegraded":"2024-02-21T07:58:07.782512+0000","last_fullsized":"2024-02-21T07:58:07.782512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19636,"num_write_kb":5096256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.031015+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:54:29.031015+0000","last_peered":"2024-02-21T07:54:29.031015+0000","last_clean":"2024-02-21T07:54:29.031015+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:54:29.031015+0000","last_undegraded":"2024-02-21T07:54:29.031015+0000","last_fullsized":"2024-02-21T07:54:29.031015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:25.006321+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:54:25.006321+0000","last_peered":"2024-02-21T07:54:25.006321+0000","last_clean":"2024-02-21T07:54:25.006321+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:54:25.006321+0000","last_undegraded":"2024-02-21T07:54:25.006321+0000","last_fullsized":"2024-02-21T07:54:25.006321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"30'2224","reported_seq":2282,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733641+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:58:07.733641+0000","last_peered":"2024-02-21T07:58:07.733641+0000","last_clean":"2024-02-21T07:58:07.733641+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:58:07.733641+0000","last_undegraded":"2024-02-21T07:58:07.733641+0000","last_fullsized":"2024-02-21T07:58:07.733641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":23814,"num_write_kb":6166061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.037449+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:54:49.037449+0000","last_peered":"2024-02-21T07:54:49.037449+0000","last_clean":"2024-02-21T07:54:49.037449+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:54:49.037449+0000","last_undegraded":"2024-02-21T07:54:49.037449+0000","last_fullsized":"2024-02-21T07:54:49.037449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"30'111","reported_seq":179,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:40.624401+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:57:40.624401+0000","last_peered":"2024-02-21T07:57:40.624401+0000","last_clean":"2024-02-21T07:57:40.624401+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:57:40.624401+0000","last_undegraded":"2024-02-21T07:57:40.624401+0000","last_fullsized":"2024-02-21T07:57:40.624401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":37,"num_write":210,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"30'2326","reported_seq":2368,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.824206+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:58:07.824206+0000","last_peered":"2024-02-21T07:58:07.824206+0000","last_clean":"2024-02-21T07:58:07.824206+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:58:07.824206+0000","last_undegraded":"2024-02-21T07:58:07.824206+0000","last_fullsized":"2024-02-21T07:58:07.824206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":25096,"num_write_kb":6462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.023243+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:54:49.023243+0000","last_peered":"2024-02-21T07:54:49.023243+0000","last_clean":"2024-02-21T07:54:49.023243+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:54:49.023243+0000","last_undegraded":"2024-02-21T07:54:49.023243+0000","last_fullsized":"2024-02-21T07:54:49.023243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":783,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.566167+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:58:17.566167+0000","last_peered":"2024-02-21T07:58:17.566167+0000","last_clean":"2024-02-21T07:58:17.566167+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:58:17.566167+0000","last_undegraded":"2024-02-21T07:58:17.566167+0000","last_fullsized":"2024-02-21T07:58:17.566167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"30'2447","reported_seq":2500,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.813049+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:58:07.813049+0000","last_peered":"2024-02-21T07:58:07.813049+0000","last_clean":"2024-02-21T07:58:07.813049+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:58:07.813049+0000","last_undegraded":"2024-02-21T07:58:07.813049+0000","last_fullsized":"2024-02-21T07:58:07.813049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2447,"log_dups_size":0,"ondisk_log_size":2447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":25865,"num_write_kb":6637076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"30'19","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.567604+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:57:46.567604+0000","last_peered":"2024-02-21T07:57:46.567604+0000","last_clean":"2024-02-21T07:57:46.567604+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:57:46.567604+0000","last_undegraded":"2024-02-21T07:57:46.567604+0000","last_fullsized":"2024-02-21T07:57:46.567604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"30'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.068511+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:57:09.068511+0000","last_peered":"2024-02-21T07:57:09.068511+0000","last_clean":"2024-02-21T07:57:09.068511+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:57:09.068511+0000","last_undegraded":"2024-02-21T07:57:09.068511+0000","last_fullsized":"2024-02-21T07:57:09.068511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2095","reported_seq":2152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.708515+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:58:07.708515+0000","last_peered":"2024-02-21T07:58:07.708515+0000","last_clean":"2024-02-21T07:58:07.708515+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:58:07.708515+0000","last_undegraded":"2024-02-21T07:58:07.708515+0000","last_fullsized":"2024-02-21T07:58:07.708515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22512,"num_write_kb":5792019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:10.380887+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:57:10.380887+0000","last_peered":"2024-02-21T07:57:10.380887+0000","last_clean":"2024-02-21T07:57:10.380887+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:57:10.380887+0000","last_undegraded":"2024-02-21T07:57:10.380887+0000","last_fullsized":"2024-02-21T07:57:10.380887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'57","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.399451+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:57:38.399451+0000","last_peered":"2024-02-21T07:57:38.399451+0000","last_clean":"2024-02-21T07:57:38.399451+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:57:38.399451+0000","last_undegraded":"2024-02-21T07:57:38.399451+0000","last_fullsized":"2024-02-21T07:57:38.399451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":20,"num_write":108,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"30'2154","reported_seq":2177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796003+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:58:07.796003+0000","last_peered":"2024-02-21T07:58:07.796003+0000","last_clean":"2024-02-21T07:58:07.796003+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:58:07.796003+0000","last_undegraded":"2024-02-21T07:58:07.796003+0000","last_fullsized":"2024-02-21T07:58:07.796003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":5940672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.016643+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:55:10.016643+0000","last_peered":"2024-02-21T07:55:10.016643+0000","last_clean":"2024-02-21T07:55:10.016643+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:55:10.016643+0000","last_undegraded":"2024-02-21T07:55:10.016643+0000","last_fullsized":"2024-02-21T07:55:10.016643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'757","reported_seq":2156,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.828091+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:58:17.828091+0000","last_peered":"2024-02-21T07:58:17.828091+0000","last_clean":"2024-02-21T07:58:17.828091+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:58:17.828091+0000","last_undegraded":"2024-02-21T07:58:17.828091+0000","last_fullsized":"2024-02-21T07:58:17.828091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":4919,"num_write":757,"num_write_kb":4594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"30'2054","reported_seq":2095,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782529+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:58:07.782529+0000","last_peered":"2024-02-21T07:58:07.782529+0000","last_clean":"2024-02-21T07:58:07.782529+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:58:07.782529+0000","last_undegraded":"2024-02-21T07:58:07.782529+0000","last_fullsized":"2024-02-21T07:58:07.782529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":21761,"num_write_kb":5639370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000237+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:54:49.000237+0000","last_peered":"2024-02-21T07:54:49.000237+0000","last_clean":"2024-02-21T07:54:49.000237+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:54:49.000237+0000","last_undegraded":"2024-02-21T07:54:49.000237+0000","last_fullsized":"2024-02-21T07:54:49.000237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"30'58","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:03.690539+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:58:03.690539+0000","last_peered":"2024-02-21T07:58:03.690539+0000","last_clean":"2024-02-21T07:58:03.690539+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:58:03.690539+0000","last_undegraded":"2024-02-21T07:58:03.690539+0000","last_fullsized":"2024-02-21T07:58:03.690539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":65,"num_read_kb":20,"num_write":105,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"30'2000","reported_seq":2057,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.805914+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:58:07.805914+0000","last_peered":"2024-02-21T07:58:07.805914+0000","last_clean":"2024-02-21T07:58:07.805914+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:58:07.805914+0000","last_undegraded":"2024-02-21T07:58:07.805914+0000","last_fullsized":"2024-02-21T07:58:07.805914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":21494,"num_write_kb":5470657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.793458+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:57:34.793458+0000","last_peered":"2024-02-21T07:57:34.793458+0000","last_clean":"2024-02-21T07:57:34.793458+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:57:34.793458+0000","last_undegraded":"2024-02-21T07:57:34.793458+0000","last_fullsized":"2024-02-21T07:57:34.793458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.025014+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:55:09.025014+0000","last_peered":"2024-02-21T07:55:09.025014+0000","last_clean":"2024-02-21T07:55:09.025014+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:55:09.025014+0000","last_undegraded":"2024-02-21T07:55:09.025014+0000","last_fullsized":"2024-02-21T07:55:09.025014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.786901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:58:07.786901+0000","last_peered":"2024-02-21T07:58:07.786901+0000","last_clean":"2024-02-21T07:58:07.786901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:58:07.786901+0000","last_undegraded":"2024-02-21T07:58:07.786901+0000","last_fullsized":"2024-02-21T07:58:07.786901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24168,"num_write_kb":6241728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.009169+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:55:09.009169+0000","last_peered":"2024-02-21T07:55:09.009169+0000","last_clean":"2024-02-21T07:55:09.009169+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:55:09.009169+0000","last_undegraded":"2024-02-21T07:55:09.009169+0000","last_fullsized":"2024-02-21T07:55:09.009169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"30'9","reported_seq":789,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.424032+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:58:17.424032+0000","last_peered":"2024-02-21T07:58:17.424032+0000","last_clean":"2024-02-21T07:58:17.424032+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:58:17.424032+0000","last_undegraded":"2024-02-21T07:58:17.424032+0000","last_fullsized":"2024-02-21T07:58:17.424032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":749,"num_read_kb":749,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"30'2195","reported_seq":2218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.772697+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:58:07.772697+0000","last_peered":"2024-02-21T07:58:07.772697+0000","last_clean":"2024-02-21T07:58:07.772697+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:58:07.772697+0000","last_undegraded":"2024-02-21T07:58:07.772697+0000","last_fullsized":"2024-02-21T07:58:07.772697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":6089984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1963","reported_seq":1987,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820640+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:58:07.820640+0000","last_peered":"2024-02-21T07:58:07.820640+0000","last_clean":"2024-02-21T07:58:07.820640+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:58:07.820640+0000","last_undegraded":"2024-02-21T07:58:07.820640+0000","last_fullsized":"2024-02-21T07:58:07.820640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21157,"num_write_kb":5478016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.839758+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:55:09.839758+0000","last_peered":"2024-02-21T07:55:09.839758+0000","last_clean":"2024-02-21T07:55:09.839758+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:55:09.839758+0000","last_undegraded":"2024-02-21T07:55:09.839758+0000","last_fullsized":"2024-02-21T07:55:09.839758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.041150+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:55:09.041150+0000","last_peered":"2024-02-21T07:55:09.041150+0000","last_clean":"2024-02-21T07:55:09.041150+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:55:09.041150+0000","last_undegraded":"2024-02-21T07:55:09.041150+0000","last_fullsized":"2024-02-21T07:55:09.041150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'2123","reported_seq":2147,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.673299+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:58:07.673299+0000","last_peered":"2024-02-21T07:58:07.673299+0000","last_clean":"2024-02-21T07:58:07.673299+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:58:07.673299+0000","last_undegraded":"2024-02-21T07:58:07.673299+0000","last_fullsized":"2024-02-21T07:58:07.673299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22656,"num_write_kb":5874432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.851290+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:55:09.851290+0000","last_peered":"2024-02-21T07:55:09.851290+0000","last_clean":"2024-02-21T07:55:09.851290+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:55:09.851290+0000","last_undegraded":"2024-02-21T07:55:09.851290+0000","last_fullsized":"2024-02-21T07:55:09.851290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.431540+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:57:46.431540+0000","last_peered":"2024-02-21T07:57:46.431540+0000","last_clean":"2024-02-21T07:57:46.431540+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:57:46.431540+0000","last_undegraded":"2024-02-21T07:57:46.431540+0000","last_fullsized":"2024-02-21T07:57:46.431540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017432+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:55:29.017432+0000","last_peered":"2024-02-21T07:55:29.017432+0000","last_clean":"2024-02-21T07:55:29.017432+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:55:29.017432+0000","last_undegraded":"2024-02-21T07:55:29.017432+0000","last_fullsized":"2024-02-21T07:55:29.017432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045903+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:55:29.045903+0000","last_peered":"2024-02-21T07:55:29.045903+0000","last_clean":"2024-02-21T07:55:29.045903+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:55:29.045903+0000","last_undegraded":"2024-02-21T07:55:29.045903+0000","last_fullsized":"2024-02-21T07:55:29.045903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2454","reported_seq":2477,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.742250+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:58:07.742250+0000","last_peered":"2024-02-21T07:58:07.742250+0000","last_clean":"2024-02-21T07:58:07.742250+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:58:07.742250+0000","last_undegraded":"2024-02-21T07:58:07.742250+0000","last_fullsized":"2024-02-21T07:58:07.742250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2454,"log_dups_size":0,"ondisk_log_size":2454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26408,"num_write_kb":6832640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'382","reported_seq":1552,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:18.425981+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:58:18.425981+0000","last_peered":"2024-02-21T07:58:18.425981+0000","last_clean":"2024-02-21T07:58:18.425981+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:58:18.425981+0000","last_undegraded":"2024-02-21T07:58:18.425981+0000","last_fullsized":"2024-02-21T07:58:18.425981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3066336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1139,"num_read_kb":3040,"num_write":379,"num_write_kb":3192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:30.023297+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:55:30.023297+0000","last_peered":"2024-02-21T07:55:30.023297+0000","last_clean":"2024-02-21T07:55:30.023297+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:55:30.023297+0000","last_undegraded":"2024-02-21T07:55:30.023297+0000","last_fullsized":"2024-02-21T07:55:30.023297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2254","reported_seq":2294,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.754893+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:58:07.754893+0000","last_peered":"2024-02-21T07:58:07.754893+0000","last_clean":"2024-02-21T07:58:07.754893+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:58:07.754893+0000","last_undegraded":"2024-02-21T07:58:07.754893+0000","last_fullsized":"2024-02-21T07:58:07.754893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":24317,"num_write_kb":6228160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048058+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:55:54.048058+0000","last_peered":"2024-02-21T07:55:54.048058+0000","last_clean":"2024-02-21T07:55:54.048058+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:55:54.048058+0000","last_undegraded":"2024-02-21T07:55:54.048058+0000","last_fullsized":"2024-02-21T07:55:54.048058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"30'12","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.038521+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:55:54.038521+0000","last_peered":"2024-02-21T07:55:54.038521+0000","last_clean":"2024-02-21T07:55:54.038521+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:55:54.038521+0000","last_undegraded":"2024-02-21T07:55:54.038521+0000","last_fullsized":"2024-02-21T07:55:54.038521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"30'14","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.344995+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:58:02.344995+0000","last_peered":"2024-02-21T07:58:02.344995+0000","last_clean":"2024-02-21T07:58:02.344995+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:58:02.344995+0000","last_undegraded":"2024-02-21T07:58:02.344995+0000","last_fullsized":"2024-02-21T07:58:02.344995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683133+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:55:54.683133+0000","last_peered":"2024-02-21T07:55:54.683133+0000","last_clean":"2024-02-21T07:55:54.683133+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:55:54.683133+0000","last_undegraded":"2024-02-21T07:55:54.683133+0000","last_fullsized":"2024-02-21T07:55:54.683133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.992212+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:54:09.992212+0000","last_peered":"2024-02-21T07:54:09.992212+0000","last_clean":"2024-02-21T07:54:09.992212+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:54:09.992212+0000","last_undegraded":"2024-02-21T07:54:09.992212+0000","last_fullsized":"2024-02-21T07:54:09.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:19.050175+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:56:19.050175+0000","last_peered":"2024-02-21T07:56:19.050175+0000","last_clean":"2024-02-21T07:56:19.050175+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:56:19.050175+0000","last_undegraded":"2024-02-21T07:56:19.050175+0000","last_fullsized":"2024-02-21T07:56:19.050175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"30'15","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027357+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:54:09.027357+0000","last_peered":"2024-02-21T07:54:09.027357+0000","last_clean":"2024-02-21T07:54:09.027357+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:54:09.027357+0000","last_undegraded":"2024-02-21T07:54:09.027357+0000","last_fullsized":"2024-02-21T07:54:09.027357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764753+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:54:09.764753+0000","last_peered":"2024-02-21T07:54:09.764753+0000","last_clean":"2024-02-21T07:54:09.764753+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:54:09.764753+0000","last_undegraded":"2024-02-21T07:54:09.764753+0000","last_fullsized":"2024-02-21T07:54:09.764753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027618+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:54:09.027618+0000","last_peered":"2024-02-21T07:54:09.027618+0000","last_clean":"2024-02-21T07:54:09.027618+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:54:09.027618+0000","last_undegraded":"2024-02-21T07:54:09.027618+0000","last_fullsized":"2024-02-21T07:54:09.027618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.984134+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:56:44.984134+0000","last_peered":"2024-02-21T07:56:44.984134+0000","last_clean":"2024-02-21T07:56:44.984134+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:56:44.984134+0000","last_undegraded":"2024-02-21T07:56:44.984134+0000","last_fullsized":"2024-02-21T07:56:44.984134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:28.998739+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:54:28.998739+0000","last_peered":"2024-02-21T07:54:28.998739+0000","last_clean":"2024-02-21T07:54:28.998739+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:54:28.998739+0000","last_undegraded":"2024-02-21T07:54:28.998739+0000","last_fullsized":"2024-02-21T07:54:28.998739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042162+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:54:30.042162+0000","last_peered":"2024-02-21T07:54:30.042162+0000","last_clean":"2024-02-21T07:54:30.042162+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:54:30.042162+0000","last_undegraded":"2024-02-21T07:54:30.042162+0000","last_fullsized":"2024-02-21T07:54:30.042162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030830+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:54:29.030830+0000","last_peered":"2024-02-21T07:54:29.030830+0000","last_clean":"2024-02-21T07:54:29.030830+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:54:29.030830+0000","last_undegraded":"2024-02-21T07:54:29.030830+0000","last_fullsized":"2024-02-21T07:54:29.030830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"30'7","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030443+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:54:29.030443+0000","last_peered":"2024-02-21T07:54:29.030443+0000","last_clean":"2024-02-21T07:54:29.030443+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:54:29.030443+0000","last_undegraded":"2024-02-21T07:54:29.030443+0000","last_fullsized":"2024-02-21T07:54:29.030443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.822291+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:54:49.822291+0000","last_peered":"2024-02-21T07:54:49.822291+0000","last_clean":"2024-02-21T07:54:49.822291+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:54:49.822291+0000","last_undegraded":"2024-02-21T07:54:49.822291+0000","last_fullsized":"2024-02-21T07:54:49.822291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.055257+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:57:09.055257+0000","last_peered":"2024-02-21T07:57:09.055257+0000","last_clean":"2024-02-21T07:57:09.055257+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:57:09.055257+0000","last_undegraded":"2024-02-21T07:57:09.055257+0000","last_fullsized":"2024-02-21T07:57:09.055257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000212+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:54:49.000212+0000","last_peered":"2024-02-21T07:54:49.000212+0000","last_clean":"2024-02-21T07:54:49.000212+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:54:49.000212+0000","last_undegraded":"2024-02-21T07:54:49.000212+0000","last_fullsized":"2024-02-21T07:54:49.000212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617208+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:54:49.617208+0000","last_peered":"2024-02-21T07:54:49.617208+0000","last_clean":"2024-02-21T07:54:49.617208+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:54:49.617208+0000","last_undegraded":"2024-02-21T07:54:49.617208+0000","last_fullsized":"2024-02-21T07:54:49.617208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617233+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:54:49.617233+0000","last_peered":"2024-02-21T07:54:49.617233+0000","last_clean":"2024-02-21T07:54:49.617233+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:54:49.617233+0000","last_undegraded":"2024-02-21T07:54:49.617233+0000","last_fullsized":"2024-02-21T07:54:49.617233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"30'10","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.198152+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:55:10.198152+0000","last_peered":"2024-02-21T07:55:10.198152+0000","last_clean":"2024-02-21T07:55:10.198152+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:55:10.198152+0000","last_undegraded":"2024-02-21T07:55:10.198152+0000","last_fullsized":"2024-02-21T07:55:10.198152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.434916+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:57:46.434916+0000","last_peered":"2024-02-21T07:57:46.434916+0000","last_clean":"2024-02-21T07:57:46.434916+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:57:46.434916+0000","last_undegraded":"2024-02-21T07:57:46.434916+0000","last_fullsized":"2024-02-21T07:57:46.434916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.024979+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:55:09.024979+0000","last_peered":"2024-02-21T07:55:09.024979+0000","last_clean":"2024-02-21T07:55:09.024979+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:55:09.024979+0000","last_undegraded":"2024-02-21T07:55:09.024979+0000","last_fullsized":"2024-02-21T07:55:09.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.013613+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:55:09.013613+0000","last_peered":"2024-02-21T07:55:09.013613+0000","last_clean":"2024-02-21T07:55:09.013613+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:55:09.013613+0000","last_undegraded":"2024-02-21T07:55:09.013613+0000","last_fullsized":"2024-02-21T07:55:09.013613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"30'13","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.039759+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:57:34.039759+0000","last_peered":"2024-02-21T07:57:34.039759+0000","last_clean":"2024-02-21T07:57:34.039759+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:57:34.039759+0000","last_undegraded":"2024-02-21T07:57:34.039759+0000","last_fullsized":"2024-02-21T07:57:34.039759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859041+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:55:29.859041+0000","last_peered":"2024-02-21T07:55:29.859041+0000","last_clean":"2024-02-21T07:55:29.859041+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:55:29.859041+0000","last_undegraded":"2024-02-21T07:55:29.859041+0000","last_fullsized":"2024-02-21T07:55:29.859041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026716+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:55:29.026716+0000","last_peered":"2024-02-21T07:55:29.026716+0000","last_clean":"2024-02-21T07:55:29.026716+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:55:29.026716+0000","last_undegraded":"2024-02-21T07:55:29.026716+0000","last_fullsized":"2024-02-21T07:55:29.026716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017415+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:55:29.017415+0000","last_peered":"2024-02-21T07:55:29.017415+0000","last_clean":"2024-02-21T07:55:29.017415+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:55:29.017415+0000","last_undegraded":"2024-02-21T07:55:29.017415+0000","last_fullsized":"2024-02-21T07:55:29.017415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.574348+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:57:46.574348+0000","last_peered":"2024-02-21T07:57:46.574348+0000","last_clean":"2024-02-21T07:57:46.574348+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:57:46.574348+0000","last_undegraded":"2024-02-21T07:57:46.574348+0000","last_fullsized":"2024-02-21T07:57:46.574348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.034016+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:55:29.034016+0000","last_peered":"2024-02-21T07:55:29.034016+0000","last_clean":"2024-02-21T07:55:29.034016+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:55:29.034016+0000","last_undegraded":"2024-02-21T07:55:29.034016+0000","last_fullsized":"2024-02-21T07:55:29.034016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683159+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:55:54.683159+0000","last_peered":"2024-02-21T07:55:54.683159+0000","last_clean":"2024-02-21T07:55:54.683159+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:55:54.683159+0000","last_undegraded":"2024-02-21T07:55:54.683159+0000","last_fullsized":"2024-02-21T07:55:54.683159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'4","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683176+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:55:54.683176+0000","last_peered":"2024-02-21T07:55:54.683176+0000","last_clean":"2024-02-21T07:55:54.683176+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:55:54.683176+0000","last_undegraded":"2024-02-21T07:55:54.683176+0000","last_fullsized":"2024-02-21T07:55:54.683176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048097+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:55:54.048097+0000","last_peered":"2024-02-21T07:55:54.048097+0000","last_clean":"2024-02-21T07:55:54.048097+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:55:54.048097+0000","last_undegraded":"2024-02-21T07:55:54.048097+0000","last_fullsized":"2024-02-21T07:55:54.048097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":753511,"num_write_kb":194935703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70426,"ondisk_log_size":70426,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3072176,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":5322,"num_read_kb":9662,"num_write":2211,"num_write_kb":8460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2834432,"data_stored":6144352,"data_compressed":766850,"data_compressed_allocated":1040384,"data_compressed_original":4505600,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94177980,"statfs":{"total":96636764160,"available":96438251520,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":198179268},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":2.1349999999999998,"15min":1.4990000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":18.609999999999999,"5min":18.609999999999999,"15min":41.207999999999998},"last":0.44},{"interface":"front","average":{"1min":1.883,"5min":1.532,"15min":1.25},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.26600000000000001},"max":{"1min":12.308999999999999,"5min":13.135999999999999,"15min":24.315999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.442,"15min":0.504},"min":{"1min":0.254,"5min":0.247,"15min":0.19900000000000001},"max":{"1min":0.63400000000000001,"5min":1.2669999999999999,"15min":1.9950000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.50700000000000001},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.048,"5min":1.8240000000000001,"15min":2.1419999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":3.089,"15min":3.089},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.218},"max":{"1min":0.75,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.76600000000000001,"5min":1.5880000000000001,"15min":2.0190000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":1.0029999999999999,"5min":1.8819999999999999,"15min":3.1059999999999999},"last":0.30199999999999999}]},{"osd":5,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.86699999999999999,"5min":1.6910000000000001,"15min":2.234},"last":0.504},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.28100000000000003,"5min":0.252,"15min":0.249},"max":{"1min":1.087,"5min":7.2640000000000002,"15min":7.2640000000000002},"last":0.432}]},{"osd":6,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.2970000000000002,"15min":1.631},"min":{"1min":0.40400000000000003,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":13.577,"5min":24.452000000000002,"15min":24.452000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.3380000000000001,"15min":1.6870000000000001},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.378},"max":{"1min":13.609,"5min":25.504000000000001,"15min":25.504000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.32800000000000001},"max":{"1min":1.0860000000000001,"5min":1.9870000000000001,"15min":3.1429999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.0649999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"last":0.38800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":1.665,"5min":1.665,"15min":3.0800000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.314},"max":{"1min":0.95199999999999996,"5min":1.9370000000000001,"15min":3.1989999999999998},"last":0.41199999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":3.6850000000000001,"15min":2.1760000000000002},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":7.5229999999999997,"5min":102.712,"15min":102.712},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.4379999999999999,"5min":2.8109999999999999,"15min":1.7170000000000001},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.48599999999999999},"max":{"1min":4.9980000000000002,"5min":27.137,"15min":27.137},"last":0.54800000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.214,"5min":1.972,"15min":3.2250000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.46100000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161940,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94209900,"statfs":{"total":96636764160,"available":96470937600,"internally_reserved":0,"allocated":339968,"data_stored":153098,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":165476800},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.8540000000000001,"15min":1.264},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":18.68,"5min":18.68,"15min":18.68},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.367,"5min":1.631,"15min":1.3480000000000001},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.4400000000000004,"5min":9.0079999999999991,"15min":13.788},"last":0.745}]},{"osd":1,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.34300000000000003},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.583},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.49399999999999999},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.2749999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.2629999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.9119999999999999,"15min":1.4099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39000000000000001,"15min":0.32600000000000001},"max":{"1min":5.6280000000000001,"5min":15.042999999999999,"15min":15.042999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.855,"5min":2.9950000000000001,"15min":1.669},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":13.597,"5min":52.374000000000002,"15min":52.374000000000002},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":1.4530000000000001,"5min":2.004,"15min":2.004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.24399999999999999},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.9199999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":1.167,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.421,"5min":1.694,"15min":1.897},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.51500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.27000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":1.0509999999999999},"last":0.67800000000000005}]},{"osd":8,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":1.228,"5min":1.857,"15min":1.857},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4750000000000001,"5min":1.958,"15min":1.958},"last":0.88400000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.698,"15min":1.73},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":26.867000000000001,"5min":26.867000000000001,"15min":26.867000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":4.8319999999999999,"5min":3.702,"15min":2.5569999999999999},"min":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.609000000000002,"5min":23.939,"15min":60.792000000000002},"last":0.871}]},{"osd":11,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.84299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444190,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368780,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":368446,"kb_avail":94003060,"statfs":{"total":96636764160,"available":96259133440,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":377289152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":5.3689999999999998,"15min":3.9129999999999998},"min":{"1min":0.57099999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":66.947999999999993},"last":0.874},{"interface":"front","average":{"1min":2.8740000000000001,"5min":4.423,"15min":3.1179999999999999},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":11.470000000000001,"5min":31.988,"15min":31.988},"last":1.804}]},{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":3.161,"15min":2.242},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":12.119,"5min":24.472000000000001,"15min":27.088999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.9749999999999996,"5min":4.5949999999999998,"15min":3.2799999999999998},"min":{"1min":0.59299999999999997,"5min":0.438,"15min":0.40799999999999997},"max":{"1min":44.505000000000003,"5min":44.505000000000003,"15min":66.670000000000002},"last":0.76000000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":3.206,"15min":2.3639999999999999},"min":{"1min":0.54600000000000004,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":10.294,"5min":30.081,"15min":30.081},"last":1.0009999999999999},{"interface":"front","average":{"1min":2.6360000000000001,"5min":3.306,"15min":2.3319999999999999},"min":{"1min":0.59699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":11.983000000000001,"5min":24.379999999999999,"15min":24.379999999999999},"last":1.167}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.3899999999999997,"5min":5.399,"15min":4.1059999999999999},"min":{"1min":0.66300000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":44.453000000000003,"5min":44.453000000000003,"15min":66.914000000000001},"last":1.284},{"interface":"front","average":{"1min":3.3170000000000002,"5min":5.4950000000000001,"15min":3.702},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.42699999999999999},"max":{"1min":10.785,"5min":30.513999999999999,"15min":30.513999999999999},"last":1.7130000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":3.5089999999999999,"15min":2.5299999999999998},"min":{"1min":0.56299999999999994,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.077,"5min":24.928999999999998,"15min":27.155999999999999},"last":1.081},{"interface":"front","average":{"1min":5.149,"5min":4.9880000000000004,"15min":3.5600000000000001},"min":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.496},"max":{"1min":44.542999999999999,"5min":44.542999999999999,"15min":66.802999999999997},"last":1.1180000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":3.4990000000000001,"15min":2.5470000000000002},"min":{"1min":0.64300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.154999999999999,"5min":24.510000000000002,"15min":26.954000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":2.4630000000000001,"5min":3.613,"15min":2.827},"min":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.51700000000000002},"max":{"1min":10.346,"5min":30.129999999999999,"15min":37.783000000000001},"last":1.242}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2839999999999998,"5min":5.1349999999999998,"15min":3.6930000000000001},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.50800000000000001},"max":{"1min":44.610999999999997,"5min":44.610999999999997,"15min":66.879000000000005},"last":1.208},{"interface":"front","average":{"1min":2.8759999999999999,"5min":3.7909999999999999,"15min":2.7170000000000001},"min":{"1min":0.68200000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":14.105,"5min":24.895,"15min":27.056999999999999},"last":1.4990000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2320000000000002,"5min":5.4660000000000002,"15min":3.8359999999999999},"min":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.53200000000000003},"max":{"1min":44.578000000000003,"5min":44.578000000000003,"15min":66.841999999999999},"last":1.48},{"interface":"front","average":{"1min":2.6389999999999998,"5min":3.7400000000000002,"15min":2.9540000000000002},"min":{"1min":0.82899999999999996,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":10.667999999999999,"5min":30.167999999999999,"15min":37.670999999999999},"last":1.3819999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":3.8079999999999998,"15min":2.77},"min":{"1min":0.70799999999999996,"5min":0.51100000000000001,"15min":0.45700000000000002},"max":{"1min":14.147,"5min":24.959,"15min":27.123000000000001},"last":1.764},{"interface":"front","average":{"1min":5.1989999999999998,"5min":5.3330000000000002,"15min":3.8809999999999998},"min":{"1min":0.751,"5min":0.66000000000000003,"15min":0.59999999999999998},"max":{"1min":44.643999999999998,"5min":44.643999999999998,"15min":66.760999999999996},"last":1.421}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.6709999999999998,"5min":3.8260000000000001,"15min":3.036},"min":{"1min":0.86499999999999999,"5min":0.77400000000000002,"15min":0.59399999999999997},"max":{"1min":10.712999999999999,"5min":30.198,"15min":37.747999999999998},"last":1.5900000000000001},{"interface":"front","average":{"1min":3.0339999999999998,"5min":3.851,"15min":2.8010000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":14.041,"5min":24.858000000000001,"15min":27.023},"last":1.871}]}]},{"osd":8,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179984,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.857,"15min":1.9650000000000001},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.952,"5min":26.353999999999999,"15min":205.21299999999999},"last":0.752},{"interface":"front","average":{"1min":2.4079999999999999,"5min":4.0979999999999999,"15min":2.1139999999999999},"min":{"1min":0.378,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.4779999999999998,"5min":65.656999999999996,"15min":65.656999999999996},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.071,"5min":1.3779999999999999,"15min":3.8900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":1.4179999999999999,"15min":3.024},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.46100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83499999999999996,"5min":2.0489999999999999,"15min":3.4990000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":1.484,"15min":3.794},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.9129999999999998,"15min":1.7929999999999999},"min":{"1min":0.48599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":13.1,"5min":23.033999999999999,"15min":23.033999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.7310000000000001,"5min":2.919,"15min":1.782},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.42299999999999999},"max":{"1min":13.138999999999999,"5min":23.047999999999998,"15min":23.047999999999998},"last":0.627}]},{"osd":4,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.58999999999999997},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":1.1279999999999999,"5min":1.242,"15min":3.3260000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.497,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0529999999999999,"5min":1.133,"15min":3.839},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27000000000000002},"max":{"1min":0.94299999999999995,"5min":1.359,"15min":2.9809999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":1.651,"15min":4.0069999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":2.2930000000000001,"5min":2.601,"15min":1.8240000000000001},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":13.859,"5min":19.280000000000001,"15min":19.280000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":4.5190000000000001,"5min":2.8199999999999998,"15min":1.7809999999999999},"min":{"1min":0.51300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.779,"5min":15.593999999999999,"15min":15.593999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.198,"15min":4.1059999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":1.4139999999999999,"15min":3.968},"last":0.63800000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":5.9560000000000004,"5min":5.1479999999999997,"15min":2.9540000000000002},"min":{"1min":0.60999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":28.902999999999999,"5min":71.158000000000001,"15min":71.158000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":4.7270000000000003,"5min":3.444,"15min":2.262},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.49199999999999999},"max":{"1min":27.178999999999998,"5min":27.178999999999998,"15min":27.178999999999998},"last":0.95799999999999996}]},{"osd":10,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":1.1319999999999999,"15min":1.855},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.2030000000000001,"15min":1.746},"last":0.76900000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.67800000000000005},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":1.887,"15min":4.3360000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77000000000000002,"5min":1.619,"15min":4.0720000000000001},"last":0.69899999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444190,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280012,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091828,"statfs":{"total":96636764160,"available":96350031872,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":286325194},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":4.1180000000000003,"5min":3.0129999999999999,"15min":1.7789999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":21.872,"5min":43.918999999999997,"15min":43.918999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.052,"15min":1.831},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.32900000000000001},"max":{"1min":21.887,"5min":43.935000000000002,"15min":43.935000000000002},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.224,"15min":0.20599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":1.1299999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":2.3140000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41299999999999998,"15min":0.48499999999999999},"min":{"1min":0.312,"5min":0.252,"15min":0.252},"max":{"1min":0.85799999999999998,"5min":1.196,"15min":1.77},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.958,"15min":1.425},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":8.1379999999999999,"5min":15.101000000000001,"15min":15.101000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":3.3479999999999999,"5min":3.1989999999999998,"15min":2.1680000000000001},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.28699999999999998},"max":{"1min":22.602,"5min":32.689999999999998,"15min":41.405000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38500000000000001,"15min":0.41099999999999998},"min":{"1min":0.307,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.8740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47599999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.60699999999999998,"5min":0.98099999999999998,"15min":13.967000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.61099999999999999},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.88900000000000001,"15min":13.952999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1989999999999998,"5min":2.504,"15min":1.8759999999999999},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":7.7069999999999999,"5min":23.959,"15min":23.959},"last":0.77500000000000002},{"interface":"front","average":{"1min":6.1200000000000001,"5min":3.806,"15min":2.3370000000000002},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":82.087000000000003,"5min":82.087000000000003,"15min":82.087000000000003},"last":0.747}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.1579999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.4930000000000001},"last":0.86599999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":3.524,"5min":2.577,"15min":1.95},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":13.708,"5min":16.113,"15min":27.177},"last":0.80700000000000005},{"interface":"front","average":{"1min":3.3530000000000002,"5min":3.25,"15min":2.327},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":33.146000000000001,"5min":33.146000000000001,"15min":34.470999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":2.5019999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":1.798,"5min":1.798,"15min":2.4580000000000002},"last":0.83299999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":327680,"data_stored":154436,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":5.5010000000000003,"15min":3.7109999999999999},"min":{"1min":0.46300000000000002,"5min":0.34499999999999997,"15min":0.313},"max":{"1min":17.585000000000001,"5min":91.042000000000002,"15min":91.042000000000002},"last":1.4730000000000001},{"interface":"front","average":{"1min":3.137,"5min":6.2519999999999998,"15min":4.9219999999999997},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.39800000000000002},"max":{"1min":13.849,"5min":88.256,"15min":115.06999999999999},"last":0.98799999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":2.778,"15min":2.1619999999999999},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.32500000000000001},"max":{"1min":4.5449999999999999,"5min":21.131,"15min":30.702999999999999},"last":1.171},{"interface":"front","average":{"1min":2.3439999999999999,"5min":4.8090000000000002,"15min":3.8969999999999998},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.3860000000000001,"5min":86.691999999999993,"15min":114.93899999999999},"last":1.1100000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.9020000000000001,"15min":2.3180000000000001},"min":{"1min":0.46100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.282,"5min":21.013999999999999,"15min":30.670999999999999},"last":1.046},{"interface":"front","average":{"1min":2.9510000000000001,"5min":4.569,"15min":3.0659999999999998},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":17.640999999999998,"5min":62.164999999999999,"15min":68.652000000000001},"last":0.85699999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.3999999999999999,"5min":8.875,"15min":6.0069999999999997},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":11.361000000000001,"5min":219.733,"15min":219.733},"last":1.6499999999999999},{"interface":"front","average":{"1min":3.2280000000000002,"5min":4.7880000000000003,"15min":4.1319999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.4329999999999998,"5min":45.109999999999999,"15min":82.281000000000006},"last":1.9710000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1400000000000001,"15min":2.548},"min":{"1min":0.61799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.6210000000000004,"5min":21.064,"15min":30.870000000000001},"last":1.754},{"interface":"front","average":{"1min":2.8809999999999998,"5min":4.2519999999999998,"15min":3.149},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":17.747,"5min":40.045000000000002,"15min":68.744},"last":1.3520000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2320000000000002,"5min":4.9969999999999999,"15min":3.3300000000000001},"min":{"1min":0.81000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":17.678000000000001,"5min":90.986999999999995,"15min":90.986999999999995},"last":1.2490000000000001},{"interface":"front","average":{"1min":2.7949999999999999,"5min":5.0979999999999999,"15min":4.2149999999999999},"min":{"1min":0.91700000000000004,"5min":0.48499999999999999,"15min":0.35999999999999999},"max":{"1min":5.5149999999999997,"5min":88.194000000000003,"15min":115.137},"last":1.3819999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4460000000000002,"5min":3.2930000000000001,"15min":2.6640000000000001},"min":{"1min":0.65600000000000003,"5min":0.45800000000000002,"15min":0.438},"max":{"1min":9.5619999999999994,"5min":21.350000000000001,"15min":30.838999999999999},"last":2.0750000000000002},{"interface":"front","average":{"1min":2.964,"5min":4.508,"15min":3.2879999999999998},"min":{"1min":0.53700000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":17.712,"5min":39.990000000000002,"15min":68.778000000000006},"last":1.8129999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":5.2249999999999996,"15min":4.3390000000000004},"min":{"1min":0.83699999999999997,"5min":0.52400000000000002,"15min":0.42999999999999999},"max":{"1min":5.46,"5min":88.147000000000006,"15min":115.03400000000001},"last":1.508},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.7650000000000001,"15min":2.9079999999999999},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.502},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":2.1669999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":7.8390000000000004,"5min":8.7539999999999996,"15min":5.71},"min":{"1min":0.79100000000000004,"5min":0.74399999999999999,"15min":0.58499999999999996},"max":{"1min":30.074000000000002,"5min":91.082999999999998,"15min":91.082999999999998},"last":1.9019999999999999},{"interface":"front","average":{"1min":3.1200000000000001,"5min":7.5270000000000001,"15min":5.5899999999999999},"min":{"1min":0.86599999999999999,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":10.238,"5min":130.30099999999999,"15min":130.30099999999999},"last":1.929}]},{"osd":10,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":3.3820000000000001,"15min":2.7930000000000001},"min":{"1min":0.752,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.7010000000000005,"5min":21.236999999999998,"15min":30.774000000000001},"last":2.274},{"interface":"front","average":{"1min":3.028,"5min":4.8090000000000002,"15min":3.621},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":17.795999999999999,"5min":62.255000000000003,"15min":68.891000000000005},"last":1.581}]},{"osd":11,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":5.7510000000000003,"15min":4.6230000000000002},"min":{"1min":1.002,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":9.4730000000000008,"5min":88.225999999999999,"15min":114.999},"last":1.869},{"interface":"front","average":{"1min":2.4870000000000001,"5min":3.597,"15min":2.9289999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":9.6639999999999997,"5min":21.199999999999999,"15min":30.808},"last":2.3660000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444190,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357680,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":94014160,"statfs":{"total":96636764160,"available":96270499840,"internally_reserved":0,"allocated":1744896,"data_stored":3813836,"data_compressed":431039,"data_compressed_allocated":585728,"data_compressed_original":2867200,"omap_allocated":1595,"internal_metadata":364509637},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.0390000000000001,"15min":1.3999999999999999},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.26300000000000001},"max":{"1min":16.375,"5min":16.375,"15min":21.427},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.5379999999999998,"15min":1.6319999999999999},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":15.911,"5min":23.23,"15min":23.23},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.47299999999999998,"15min":0.54500000000000004},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":2.4430000000000001,"15min":14.186},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.46000000000000002,"15min":0.54500000000000004},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.835,"15min":14.391999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35799999999999998,"15min":0.379},"min":{"1min":0.246,"5min":0.188,"15min":0.188},"max":{"1min":0.45600000000000002,"5min":1.7629999999999999,"15min":2.5619999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.437,"5min":1.643,"15min":2.8940000000000001},"last":0.378}]},{"osd":3,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":4.46,"5min":2.6970000000000001,"15min":1.631},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":35.134,"5min":35.134,"15min":35.134},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.9460000000000002,"15min":1.786},"min":{"1min":0.47599999999999998,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":10.67,"5min":48.656999999999996,"15min":48.656999999999996},"last":0.94599999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56999999999999995,"15min":0.64700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27200000000000002},"max":{"1min":1.8029999999999999,"5min":1.905,"15min":14.831},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.34000000000000002,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":1.835,"5min":1.9670000000000001,"15min":14.846},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.8260000000000001,"15min":2.0169999999999999},"min":{"1min":0.44700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.5869999999999997,"5min":30.489000000000001,"15min":46.009999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":5.835,"5min":3.6000000000000001,"15min":2.738},"min":{"1min":0.41799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":31.315000000000001,"5min":36.401000000000003,"15min":67.126999999999995},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.27200000000000002},"max":{"1min":1.228,"5min":1.7769999999999999,"15min":14.211},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.621},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.309},"max":{"1min":1.2529999999999999,"5min":1.3959999999999999,"15min":14.241},"last":0.54100000000000004}]},{"osd":8,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88900000000000001,"5min":1.738,"15min":1.738},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":1.351,"15min":2.5870000000000002},"last":0.498}]},{"osd":9,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.6379999999999999,"15min":1.901},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":32.753999999999998,"5min":32.753999999999998,"15min":32.753999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":3.9740000000000002,"5min":2.8730000000000002,"15min":2.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":13.407,"5min":36.168999999999997,"15min":36.168999999999997},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":0.65900000000000003,"5min":1.4430000000000001,"15min":1.476},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":2.036,"15min":2.298},"last":0.628}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274380,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94097460,"statfs":{"total":96636764160,"available":96355799040,"internally_reserved":0,"allocated":331776,"data_stored":157118,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.313,"15min":0.33800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":0.372,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.373},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.33400000000000002,"15min":0.35199999999999998},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.39300000000000002,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.0299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80800000000000005,"5min":1.325,"15min":1.325},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":3.101,"15min":1.9830000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":6.1020000000000003,"5min":31.25,"15min":31.25},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.133,"5min":2.1749999999999998,"15min":1.607},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":5.4619999999999997,"5min":23.829000000000001,"15min":23.829000000000001},"last":0.627}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42499999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":0.48399999999999999,"5min":1.177,"15min":1.371},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26000000000000001},"max":{"1min":1.2090000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":3.4660000000000002,"15min":2.738},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.0510000000000002,"5min":103.301,"15min":103.301},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.5049999999999999,"5min":2.4889999999999999,"15min":1.651},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":7.774,"5min":19.571000000000002,"15min":19.866},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45700000000000002,"15min":0.47999999999999998},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":0.61799999999999999,"5min":1.0720000000000001,"15min":1.3819999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.502,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":1.153,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":1.774,"15min":2.3029999999999999},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.6389999999999998,"15min":2.0550000000000002},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":7.9050000000000002,"5min":23.103000000000002,"15min":31.655999999999999},"last":0.872},{"interface":"front","average":{"1min":1.482,"5min":3.7919999999999998,"15min":2.1720000000000002},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":7.0039999999999996,"5min":65.191999999999993,"15min":65.191999999999993},"last":0.73499999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51300000000000001,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.628,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57499999999999996}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61399999999999999,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.7450000000000001,"15min":2.3250000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444190,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279944,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091896,"statfs":{"total":96636764160,"available":96350101504,"internally_reserved":0,"allocated":327680,"data_stored":154308,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4009999999999998,"5min":5.548,"15min":3.5800000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":20.800000000000001,"5min":46.143000000000001,"15min":46.143000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":5.774,"5min":6.4850000000000003,"15min":4.1550000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":36.734999999999999,"5min":79.581000000000003,"15min":79.581000000000003},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.8959999999999999,"5min":5.3330000000000002,"15min":3.5960000000000001},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":36.805999999999997,"5min":79.177000000000007,"15min":79.177000000000007},"last":1.016},{"interface":"front","average":{"1min":3.2669999999999999,"5min":3.5049999999999999,"15min":2.4329999999999998},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.27600000000000002},"max":{"1min":12.286,"5min":23.809999999999999,"15min":23.809999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":3.8820000000000001,"15min":2.7919999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":20.562000000000001,"5min":46.396999999999998,"15min":46.396999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":3.302,"5min":3.5,"15min":2.5649999999999999},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.37},"max":{"1min":12.374000000000001,"5min":23.866,"15min":23.866},"last":0.90600000000000003}]},{"osd":4,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1340000000000003,"5min":5.4550000000000001,"15min":3.742},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":36.771000000000001,"5min":79.043999999999997,"15min":79.043999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":4.1699999999999999,"5min":4.3879999999999999,"15min":2.9750000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":20.638000000000002,"5min":46.530999999999999,"15min":46.530999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1269999999999998,"5min":5.3710000000000004,"15min":3.7719999999999998},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":36.646000000000001,"5min":79.094999999999999,"15min":79.094999999999999},"last":1.26},{"interface":"front","average":{"1min":4.2069999999999999,"5min":4.0679999999999996,"15min":2.9399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":20.765000000000001,"5min":46.567999999999998,"15min":46.567999999999998},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.629,"15min":2.6560000000000001},"min":{"1min":0.84599999999999997,"5min":0.55300000000000005,"15min":0.39500000000000002},"max":{"1min":13.209,"5min":23.776,"15min":23.776},"last":1.2350000000000001},{"interface":"front","average":{"1min":4.2469999999999999,"5min":5.6219999999999999,"15min":3.9750000000000001},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":36.840000000000003,"5min":79.140000000000001,"15min":79.140000000000001},"last":1.1599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.2770000000000001,"5min":4.1989999999999998,"15min":3.145},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":20.687999999999999,"5min":51.311,"15min":51.311},"last":1.1020000000000001},{"interface":"front","average":{"1min":3.4569999999999999,"5min":3.6499999999999999,"15min":2.79},"min":{"1min":0.73999999999999999,"5min":0.65000000000000002,"15min":0.436},"max":{"1min":13.279999999999999,"5min":23.745000000000001,"15min":23.745000000000001},"last":1.298}]},{"osd":9,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":6.2000000000000002,"5min":5.298,"15min":3.8900000000000001},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.41399999999999998},"max":{"1min":31.452000000000002,"5min":31.452000000000002,"15min":31.978999999999999},"last":1.347},{"interface":"front","average":{"1min":4.984,"5min":7.7460000000000004,"15min":5.452},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46300000000000002},"max":{"1min":37.411000000000001,"5min":79.388999999999996,"15min":79.388999999999996},"last":1.321}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.9279999999999999,"15min":3.0510000000000002},"min":{"1min":0.91000000000000003,"5min":0.73199999999999998,"15min":0.46000000000000002},"max":{"1min":13.244999999999999,"5min":23.838999999999999,"15min":31.469999999999999},"last":1.419},{"interface":"front","average":{"1min":4.7699999999999996,"5min":5.8140000000000001,"15min":4.1769999999999996},"min":{"1min":0.60499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.698,"5min":79.213999999999999,"15min":79.213999999999999},"last":1.361}]},{"osd":11,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4059999999999997,"5min":4.46,"15min":3.1960000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":20.728000000000002,"5min":51.438000000000002,"15min":51.438000000000002},"last":1.127},{"interface":"front","average":{"1min":3.456,"5min":3.855,"15min":3.0640000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.498},"max":{"1min":12.414,"5min":23.896999999999998,"15min":31.771999999999998},"last":1.3919999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231264,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94140576,"statfs":{"total":96636764160,"available":96399949824,"internally_reserved":0,"allocated":1662976,"data_stored":3219150,"data_compressed":397517,"data_compressed_allocated":540672,"data_compressed_original":2293760,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":2.3519999999999999,"15min":2.1890000000000001},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":24.849,"5min":29.721,"15min":115.97},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0029999999999999,"5min":2.4060000000000001,"15min":1.73},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9459999999999997,"5min":30.361999999999998,"15min":36.359999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41099999999999998,"15min":0.51800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57199999999999995,"5min":1.044,"15min":2.734},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42899999999999999,"15min":0.502},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":1.256,"15min":2.4340000000000002},"last":0.752}]},{"osd":3,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":2.6949999999999998,"15min":1.8560000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":3.8730000000000002,"5min":27.800000000000001,"15min":27.800000000000001},"last":0.5},{"interface":"front","average":{"1min":1.5640000000000001,"5min":2.7149999999999999,"15min":1.861},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.891,"5min":29.364999999999998,"15min":29.364999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47699999999999998,"15min":0.58299999999999996},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.089,"5min":1.3109999999999999,"15min":2.4729999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.23599999999999999},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.5419999999999998},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41199999999999998,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.534,"15min":2.903},"last":0.375},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.219},"max":{"1min":1.1120000000000001,"5min":1.6479999999999999,"15min":2.1869999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.9350000000000001,"15min":1.5680000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.6799999999999997,"5min":16.079000000000001,"15min":16.079000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.786,"5min":1.921,"15min":1.5880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.432},"max":{"1min":10.737,"5min":16.065000000000001,"15min":16.065000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.119,"15min":2.5470000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.755,"5min":1.6639999999999999,"15min":2.6259999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":1.3280000000000001,"5min":1.889,"15min":1.972},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":1.2390000000000001,"15min":1.8720000000000001},"last":0.47099999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.8450000000000002,"5min":5.1509999999999998,"15min":3.113},"min":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.40500000000000003},"max":{"1min":8.5630000000000006,"5min":118.07299999999999,"15min":118.07299999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.524,"5min":2.464,"15min":1.8600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.0650000000000004,"5min":18.303000000000001,"15min":25.349},"last":0.59499999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65800000000000003,"15min":0.72999999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.595,"15min":2.6739999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.68500000000000005},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":1.369,"15min":2.5110000000000001},"last":0.80100000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0489999999999999,"5min":1.837,"15min":2.9380000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":1.5009999999999999,"15min":2.9100000000000001},"last":0.57999999999999996}]}]},{"osd":1,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225796,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94146044,"statfs":{"total":96636764160,"available":96405549056,"internally_reserved":0,"allocated":323584,"data_stored":152854,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":230881735},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.671,"15min":1.54},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":4.1130000000000004,"5min":21.425000000000001,"15min":26.550000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":2.1509999999999998,"15min":1.5820000000000001},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":6.2539999999999996,"5min":26.841999999999999,"15min":31.741},"last":0.621}]},{"osd":2,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40999999999999998,"15min":0.625},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":1.155,"5min":2.1970000000000001,"15min":58.337000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":1.046,"5min":2.3119999999999998,"15min":60.276000000000003},"last":0.49099999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.1629999999999998,"15min":1.6240000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":7.1200000000000001,"5min":16.724,"15min":30.460000000000001},"last":0.438},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.347,"15min":1.6659999999999999},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":8.2010000000000005,"5min":19.312999999999999,"15min":20.971},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.378},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"min":{"1min":0.25,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0049999999999999,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.28799999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0229999999999999,"5min":1.8660000000000001,"15min":58.32},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.71199999999999997},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.236,"5min":2.3740000000000001,"15min":60.185000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":4.3849999999999998,"15min":3.1389999999999998},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.33300000000000002},"max":{"1min":8.3200000000000003,"5min":98.299999999999997,"15min":98.299999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.7290000000000001,"5min":2.7010000000000001,"15min":1.879},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":12.612,"5min":24.501999999999999,"15min":24.501999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.02,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49399999999999999,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":2.161,"15min":2.161},"last":0.38700000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3740000000000001,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55600000000000005,"15min":0.60699999999999998},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.33700000000000002},"max":{"1min":1.073,"5min":1.286,"15min":3.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Wed Feb 21 07:57:53 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":4.5640000000000001,"15min":2.9159999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.433},"max":{"1min":6.5940000000000003,"5min":91.182000000000002,"15min":91.182000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":2.423,"5min":3.081,"15min":2.1869999999999998},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.45500000000000002},"max":{"1min":14.013999999999999,"5min":32.460999999999999,"15min":32.460999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":1.242,"15min":1.242},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":1.0780000000000001},"last":0.56399999999999995}]}]},{"osd":0,"up_from":17,"seq":73014444191,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266064,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":94105776,"statfs":{"total":96636764160,"available":96364314624,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":3.3580000000000001,"15min":2.238},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.249},"max":{"1min":6.6929999999999996,"5min":54.454999999999998,"15min":54.454999999999998},"last":0.624},{"interface":"front","average":{"1min":2.355,"5min":3.1000000000000001,"15min":2.4830000000000001},"min":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.27400000000000002},"max":{"1min":15.474,"5min":27.855,"15min":67.233999999999995},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":4.016,"5min":3.4220000000000002,"15min":2.2530000000000001},"min":{"1min":0.34899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":34.563000000000002,"5min":34.563000000000002,"15min":34.563000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.532,"5min":3.7469999999999999,"15min":2.4390000000000001},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":32.026000000000003,"5min":54.421999999999997,"15min":54.421999999999997},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.786,"5min":5.3559999999999999,"15min":3.7480000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":16.306000000000001,"5min":79.024000000000001,"15min":79.024000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":5.343,"5min":5.181,"15min":3.3759999999999999},"min":{"1min":0.71499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":45.561999999999998,"5min":79.706999999999994,"15min":79.706999999999994},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1200000000000001,"5min":3.5680000000000001,"15min":2.4420000000000002},"min":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.39000000000000001},"max":{"1min":10.544,"5min":54.353000000000002,"15min":54.353000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":2.569,"5min":3.1429999999999998,"15min":2.7090000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":15.821999999999999,"5min":27.782,"15min":67.313000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":5.2709999999999999,"15min":3.9119999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":15.978,"5min":79.078000000000003,"15min":79.078000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":4.4340000000000002,"5min":7.2489999999999997,"15min":4.5309999999999997},"min":{"1min":0.66400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":17.498000000000001,"5min":86.691999999999993,"15min":86.691999999999993},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":3.3980000000000001,"15min":2.6030000000000002},"min":{"1min":0.51300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.2089999999999996,"5min":32.107999999999997,"15min":32.107999999999997},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.169,"5min":3.7080000000000002,"15min":2.625},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":10.457000000000001,"5min":54.386000000000003,"15min":54.386000000000003},"last":0.83899999999999997}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.681,"5min":3.7229999999999999,"15min":3.1080000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.439},"max":{"1min":16.138999999999999,"5min":27.902999999999999,"15min":67.387},"last":0.76900000000000002},{"interface":"front","average":{"1min":2.661,"5min":3.609,"15min":2.7909999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.437},"max":{"1min":8.2479999999999993,"5min":31.966999999999999,"15min":31.966999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":6.0140000000000002,"15min":4.4189999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.45200000000000001},"max":{"1min":10.692,"5min":40.402000000000001,"15min":152.25700000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":4.9989999999999997,"5min":6.6079999999999997,"15min":4.4859999999999998},"min":{"1min":0.70599999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"max":{"1min":19.376999999999999,"5min":111.746,"15min":111.746},"last":1.2030000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":4.0259999999999998,"15min":2.8439999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.503},"max":{"1min":10.574,"5min":54.490000000000002,"15min":54.490000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":3.577,"5min":3.8639999999999999,"15min":3.2440000000000002},"min":{"1min":0.78700000000000003,"5min":0.60099999999999998,"15min":0.54000000000000004},"max":{"1min":16.544,"5min":27.821000000000002,"15min":67.423000000000002},"last":1.0740000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":4.4470000000000001,"15min":3.0499999999999998},"min":{"1min":0.85999999999999999,"5min":0.71999999999999997,"15min":0.58699999999999997},"max":{"1min":10.599,"5min":54.298000000000002,"15min":54.298000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0149999999999997,"15min":3.3460000000000001},"min":{"1min":0.82599999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"max":{"1min":16.344999999999999,"5min":28.864999999999998,"15min":67.454999999999998},"last":1.1160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":3066968,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1359872,"data_stored":3067190,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:58:22.133 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T07:58:22.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:58:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.382+0000 7f8f4b000640 1 Processor -- start 2024-02-21T07:58:22.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.382+0000 7f8f4b000640 1 -- start start 2024-02-21T07:58:22.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f4b000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8f44185f20 0x7f8f440f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f4b000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f440f9ac0 con 0x7f8f44188770 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f4b000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4406dc90 con 0x7f8f441866e0 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f4b000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4406df70 con 0x7f8f44185f20 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f43e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8f44185f20 0x7f8f440f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f43e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8f44185f20 0x7f8f440f9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54738/0 (socket says 172.21.15.100:54738) 2024-02-21T07:58:22.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.384+0000 7f8f43e00640 1 -- 172.21.15.100:0/3111695662 learned_addr learned my addr 172.21.15.100:0/3111695662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.385+0000 7f8f43e00640 1 -- 172.21.15.100:0/3111695662 >> v1:172.21.15.170:6789/0 conn(0x7f8f441866e0 legacy=0x7f8f44186b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.385+0000 7f8f43e00640 1 -- 172.21.15.100:0/3111695662 >> v1:172.21.15.156:6789/0 conn(0x7f8f44188770 legacy=0x7f8f44188c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.385+0000 7f8f43e00640 1 -- 172.21.15.100:0/3111695662 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4406e250 con 0x7f8f44185f20 2024-02-21T07:58:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.386+0000 7f8f43e00640 1 --2- 172.21.15.100:0/3111695662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f44185f20 0x7f8f440f9580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009870 tx=0x7f8f3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34758e835211fbc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.386+0000 7f8f42a00640 1 -- 172.21.15.100:0/3111695662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34031870 con 0x7f8f44185f20 2024-02-21T07:58:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.386+0000 7f8f42a00640 1 -- 172.21.15.100:0/3111695662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340319d0 con 0x7f8f44185f20 2024-02-21T07:58:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.386+0000 7f8f42a00640 1 -- 172.21.15.100:0/3111695662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34031d60 con 0x7f8f44185f20 2024-02-21T07:58:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 -- 172.21.15.100:0/3111695662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f44185f20 msgr2=0x7f8f440f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 --2- 172.21.15.100:0/3111695662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f44185f20 0x7f8f440f9580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009870 tx=0x7f8f3402b910 comp rx=0 tx=0).stop 2024-02-21T07:58:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 -- 172.21.15.100:0/3111695662 shutdown_connections 2024-02-21T07:58:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 --2- 172.21.15.100:0/3111695662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f44185f20 0x7f8f440f9580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 -- 172.21.15.100:0/3111695662 >> 172.21.15.100:0/3111695662 conn(0x7f8f440ce160 msgr2=0x7f8f440ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 -- 172.21.15.100:0/3111695662 shutdown_connections 2024-02-21T07:58:22.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.387+0000 7f8f4b000640 1 -- 172.21.15.100:0/3111695662 wait complete. 2024-02-21T07:58:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.389+0000 7f8f4b000640 1 Processor -- start 2024-02-21T07:58:22.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.389+0000 7f8f4b000640 1 -- start start 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 0x7f8f440f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f44188770 0x7f8f440f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f44168c70 con 0x7f8f441866e0 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440f57d0 con 0x7f8f44185f20 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f4b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f441893d0 con 0x7f8f44188770 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.390+0000 7f8f43400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 0x7f8f440f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46320/0 (socket says 172.21.15.100:46320) 2024-02-21T07:58:22.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43e00640 1 -- 172.21.15.100:0/4228738807 learned_addr learned my addr 172.21.15.100:0/4228738807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f49000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f44188770 0x7f8f440f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 -- 172.21.15.100:0/4228738807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f44188770 msgr2=0x7f8f440f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f44188770 0x7f8f440f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 -- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 msgr2=0x7f8f440ecea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 -- 172.21.15.100:0/4228738807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340094d0 con 0x7f8f441866e0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43e00640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.391+0000 7f8f43400640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 0x7f8f440f4510 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c3c0 tx=0x7f8f3000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.392+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f300052d0 con 0x7f8f441866e0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.392+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f30005450 con 0x7f8f441866e0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.392+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30007260 con 0x7f8f441866e0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.392+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f440f4f90 con 0x7f8f441866e0 2024-02-21T07:58:22.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.392+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f440f54f0 con 0x7f8f441866e0 2024-02-21T07:58:22.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.393+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f44067c80 con 0x7f8f441866e0 2024-02-21T07:58:22.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.395+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8f300073c0 con 0x7f8f441866e0 2024-02-21T07:58:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.396+0000 7f8f3be00640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 0x7f8f240a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.396+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8f300c8d40 con 0x7f8f441866e0 2024-02-21T07:58:22.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.396+0000 7f8f43e00640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 0x7f8f240a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.397+0000 7f8f43e00640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 0x7f8f240a1560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f340090b0 tx=0x7f8f3403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.400+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f3004c8c0 con 0x7f8f441866e0 2024-02-21T07:58:22.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.594+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f4406e810 con 0x7f8f2409f0a0 2024-02-21T07:58:22.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.606+0000 7f8f3be00640 1 -- 172.21.15.100:0/4228738807 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+420699 (secure 0 0 0) 0x7f8f340303c0 con 0x7f8f2409f0a0 2024-02-21T07:58:22.610 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:22.616 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 msgr2=0x7f8f240a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 0x7f8f240a1560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f340090b0 tx=0x7f8f3403c040 comp rx=0 tx=0).stop 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 msgr2=0x7f8f440f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 0x7f8f440f4510 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c3c0 tx=0x7f8f3000c880 comp rx=0 tx=0).stop 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 shutdown_connections 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f44188770 0x7f8f440f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8f2409f0a0 0x7f8f240a1560 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f441866e0 0x7f8f440f4510 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 --2- 172.21.15.100:0/4228738807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f44185f20 0x7f8f440ecea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 >> 172.21.15.100:0/4228738807 conn(0x7f8f440ce160 msgr2=0x7f8f44211b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:22.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 shutdown_connections 2024-02-21T07:58:22.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.615+0000 7f8f4b000640 1 -- 172.21.15.100:0/4228738807 wait complete. 2024-02-21T07:58:22.636 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-02-21T07:58:22.095745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3662778,"num_objects":78,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5821,"num_read_kb":10144,"num_write":755942,"num_write_kb":194947101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72890,"ondisk_log_size":72890,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3117696,"kb_used_data":6624,"kb_used_omap":18,"kb_used_meta":3110957,"kb_avail":1129344384,"statfs":{"total":1159641169920,"available":1156448649216,"internally_reserved":0,"allocated":6782976,"data_stored":9184040,"data_compressed":1002998,"data_compressed_allocated":1376256,"data_compressed_original":6144000,"omap_allocated":19141,"internal_metadata":3185620283},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-859828407,"num_objects":-205,"num_object_clones":0,"num_object_copies":-820,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-205,"num_whiteouts":0,"num_read":69,"num_read_kb":42,"num_write":210,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009483"},"pg_stats":[{"pgid":"2.1f","version":"30'109","reported_seq":198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.687409+0000","last_change":"2024-02-21T07:45:25.243262+0000","last_active":"2024-02-21T07:57:46.687409+0000","last_peered":"2024-02-21T07:57:46.687409+0000","last_clean":"2024-02-21T07:57:46.687409+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:57:46.687409+0000","last_undegraded":"2024-02-21T07:57:46.687409+0000","last_fullsized":"2024-02-21T07:57:46.687409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":57,"num_write":210,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"30'5","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859091+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:55:29.859091+0000","last_peered":"2024-02-21T07:55:29.859091+0000","last_clean":"2024-02-21T07:55:29.859091+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:55:29.859091+0000","last_undegraded":"2024-02-21T07:55:29.859091+0000","last_fullsized":"2024-02-21T07:55:29.859091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'2349","reported_seq":2379,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733484+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:58:07.733484+0000","last_peered":"2024-02-21T07:58:07.733484+0000","last_clean":"2024-02-21T07:58:07.733484+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:58:07.733484+0000","last_undegraded":"2024-02-21T07:58:07.733484+0000","last_fullsized":"2024-02-21T07:58:07.733484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25104,"num_write_kb":6480128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"30'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:30.027684+0000","last_change":"2024-02-21T07:45:25.239525+0000","last_active":"2024-02-21T07:57:30.027684+0000","last_peered":"2024-02-21T07:57:30.027684+0000","last_clean":"2024-02-21T07:57:30.027684+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:57:30.027684+0000","last_undegraded":"2024-02-21T07:57:30.027684+0000","last_fullsized":"2024-02-21T07:57:30.027684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683193+0000","last_change":"2024-02-21T07:45:26.279887+0000","last_active":"2024-02-21T07:55:54.683193+0000","last_peered":"2024-02-21T07:55:54.683193+0000","last_clean":"2024-02-21T07:55:54.683193+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:55:54.683193+0000","last_undegraded":"2024-02-21T07:55:54.683193+0000","last_fullsized":"2024-02-21T07:55:54.683193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'2450","reported_seq":2473,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.756048+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:58:07.756048+0000","last_peered":"2024-02-21T07:58:07.756048+0000","last_clean":"2024-02-21T07:58:07.756048+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:58:07.756048+0000","last_undegraded":"2024-02-21T07:58:07.756048+0000","last_fullsized":"2024-02-21T07:58:07.756048+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26394,"num_write_kb":6774912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"30'6","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426615+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:57:46.426615+0000","last_peered":"2024-02-21T07:57:46.426615+0000","last_clean":"2024-02-21T07:57:46.426615+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:57:46.426615+0000","last_undegraded":"2024-02-21T07:57:46.426615+0000","last_fullsized":"2024-02-21T07:57:46.426615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.012104+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:55:29.012104+0000","last_peered":"2024-02-21T07:55:29.012104+0000","last_clean":"2024-02-21T07:55:29.012104+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:55:29.012104+0000","last_undegraded":"2024-02-21T07:55:29.012104+0000","last_fullsized":"2024-02-21T07:55:29.012104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1816","reported_seq":1857,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782324+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:58:07.782324+0000","last_peered":"2024-02-21T07:58:07.782324+0000","last_clean":"2024-02-21T07:58:07.782324+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:58:07.782324+0000","last_undegraded":"2024-02-21T07:58:07.782324+0000","last_fullsized":"2024-02-21T07:58:07.782324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19208,"num_write_kb":5027530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.425159+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:57:46.425159+0000","last_peered":"2024-02-21T07:57:46.425159+0000","last_clean":"2024-02-21T07:57:46.425159+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:57:46.425159+0000","last_undegraded":"2024-02-21T07:57:46.425159+0000","last_fullsized":"2024-02-21T07:57:46.425159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:59.075455+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:57:59.075455+0000","last_peered":"2024-02-21T07:57:59.075455+0000","last_clean":"2024-02-21T07:57:59.075455+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:57:59.075455+0000","last_undegraded":"2024-02-21T07:57:59.075455+0000","last_fullsized":"2024-02-21T07:57:59.075455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1978","reported_seq":2001,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.789935+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:58:07.789935+0000","last_peered":"2024-02-21T07:58:07.789935+0000","last_clean":"2024-02-21T07:58:07.789935+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:58:07.789935+0000","last_undegraded":"2024-02-21T07:58:07.789935+0000","last_fullsized":"2024-02-21T07:58:07.789935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:52.072585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21148,"num_write_kb":5478976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.017379+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:54:09.017379+0000","last_peered":"2024-02-21T07:54:09.017379+0000","last_clean":"2024-02-21T07:54:09.017379+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:54:09.017379+0000","last_undegraded":"2024-02-21T07:54:09.017379+0000","last_fullsized":"2024-02-21T07:54:09.017379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"30'54","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426547+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:57:46.426547+0000","last_peered":"2024-02-21T07:57:46.426547+0000","last_clean":"2024-02-21T07:57:46.426547+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:57:46.426547+0000","last_undegraded":"2024-02-21T07:57:46.426547+0000","last_fullsized":"2024-02-21T07:57:46.426547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"30'2241","reported_seq":2264,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820476+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:58:07.820476+0000","last_peered":"2024-02-21T07:58:07.820476+0000","last_clean":"2024-02-21T07:58:07.820476+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:58:07.820476+0000","last_undegraded":"2024-02-21T07:58:07.820476+0000","last_fullsized":"2024-02-21T07:58:07.820476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23912,"num_write_kb":6167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.804264+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:54:29.804264+0000","last_peered":"2024-02-21T07:54:29.804264+0000","last_clean":"2024-02-21T07:54:29.804264+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:54:29.804264+0000","last_undegraded":"2024-02-21T07:54:29.804264+0000","last_fullsized":"2024-02-21T07:54:29.804264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:44.800645+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:57:44.800645+0000","last_peered":"2024-02-21T07:57:44.800645+0000","last_clean":"2024-02-21T07:57:44.800645+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:57:44.800645+0000","last_undegraded":"2024-02-21T07:57:44.800645+0000","last_fullsized":"2024-02-21T07:57:44.800645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.620008+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:58:07.620008+0000","last_peered":"2024-02-21T07:58:07.620008+0000","last_clean":"2024-02-21T07:58:07.620008+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:58:07.620008+0000","last_undegraded":"2024-02-21T07:58:07.620008+0000","last_fullsized":"2024-02-21T07:58:07.620008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":23651,"num_write_kb":6110913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027473+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:54:09.027473+0000","last_peered":"2024-02-21T07:54:09.027473+0000","last_clean":"2024-02-21T07:54:09.027473+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:54:09.027473+0000","last_undegraded":"2024-02-21T07:54:09.027473+0000","last_fullsized":"2024-02-21T07:54:09.027473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.429810+0000","last_change":"2024-02-21T07:45:25.244023+0000","last_active":"2024-02-21T07:57:46.429810+0000","last_peered":"2024-02-21T07:57:46.429810+0000","last_clean":"2024-02-21T07:57:46.429810+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:57:46.429810+0000","last_undegraded":"2024-02-21T07:57:46.429810+0000","last_fullsized":"2024-02-21T07:57:46.429810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'2353","reported_seq":2393,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739796+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:58:07.739796+0000","last_peered":"2024-02-21T07:58:07.739796+0000","last_clean":"2024-02-21T07:58:07.739796+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:58:07.739796+0000","last_undegraded":"2024-02-21T07:58:07.739796+0000","last_fullsized":"2024-02-21T07:58:07.739796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25161,"num_write_kb":6532545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"30'4","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:20.034801+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:56:20.034801+0000","last_peered":"2024-02-21T07:56:20.034801+0000","last_clean":"2024-02-21T07:56:20.034801+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:56:20.034801+0000","last_undegraded":"2024-02-21T07:56:20.034801+0000","last_fullsized":"2024-02-21T07:56:20.034801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:08.996967+0000","last_change":"2024-02-21T07:45:25.231813+0000","last_active":"2024-02-21T07:54:08.996967+0000","last_peered":"2024-02-21T07:54:08.996967+0000","last_clean":"2024-02-21T07:54:08.996967+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:54:08.996967+0000","last_undegraded":"2024-02-21T07:54:08.996967+0000","last_fullsized":"2024-02-21T07:54:08.996967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"30'2033","reported_seq":2056,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.600262+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:58:07.600262+0000","last_peered":"2024-02-21T07:58:07.600262+0000","last_clean":"2024-02-21T07:58:07.600262+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:58:07.600262+0000","last_undegraded":"2024-02-21T07:58:07.600262+0000","last_fullsized":"2024-02-21T07:58:07.600262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21864,"num_write_kb":5639616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.525799+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:54:09.525799+0000","last_peered":"2024-02-21T07:54:09.525799+0000","last_clean":"2024-02-21T07:54:09.525799+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:54:09.525799+0000","last_undegraded":"2024-02-21T07:54:09.525799+0000","last_fullsized":"2024-02-21T07:54:09.525799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'52","reported_seq":102,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.394892+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:57:38.394892+0000","last_peered":"2024-02-21T07:57:38.394892+0000","last_clean":"2024-02-21T07:57:38.394892+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:57:38.394892+0000","last_undegraded":"2024-02-21T07:57:38.394892+0000","last_fullsized":"2024-02-21T07:57:38.394892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":19,"num_write":102,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"30'1849","reported_seq":1873,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739803+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:58:07.739803+0000","last_peered":"2024-02-21T07:58:07.739803+0000","last_clean":"2024-02-21T07:58:07.739803+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:58:07.739803+0000","last_undegraded":"2024-02-21T07:58:07.739803+0000","last_fullsized":"2024-02-21T07:58:07.739803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19868,"num_write_kb":5174912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764767+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:54:09.764767+0000","last_peered":"2024-02-21T07:54:09.764767+0000","last_clean":"2024-02-21T07:54:09.764767+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:54:09.764767+0000","last_undegraded":"2024-02-21T07:54:09.764767+0000","last_fullsized":"2024-02-21T07:54:09.764767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'77","reported_seq":108,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.687804+0000","last_change":"2024-02-21T07:45:25.244196+0000","last_active":"2024-02-21T07:58:02.687804+0000","last_peered":"2024-02-21T07:58:02.687804+0000","last_clean":"2024-02-21T07:58:02.687804+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:58:02.687804+0000","last_undegraded":"2024-02-21T07:58:02.687804+0000","last_fullsized":"2024-02-21T07:58:02.687804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:52:13.146844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"30'2041","reported_seq":2065,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.718088+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:58:07.718088+0000","last_peered":"2024-02-21T07:58:07.718088+0000","last_clean":"2024-02-21T07:58:07.718088+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:58:07.718088+0000","last_undegraded":"2024-02-21T07:58:07.718088+0000","last_fullsized":"2024-02-21T07:58:07.718088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21885,"num_write_kb":5740224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.592062+0000","last_change":"2024-02-21T07:45:26.258257+0000","last_active":"2024-02-21T07:57:46.592062+0000","last_peered":"2024-02-21T07:57:46.592062+0000","last_clean":"2024-02-21T07:57:46.592062+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:57:46.592062+0000","last_undegraded":"2024-02-21T07:57:46.592062+0000","last_fullsized":"2024-02-21T07:57:46.592062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:50.024901+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:55:50.024901+0000","last_peered":"2024-02-21T07:55:50.024901+0000","last_clean":"2024-02-21T07:55:50.024901+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:55:50.024901+0000","last_undegraded":"2024-02-21T07:55:50.024901+0000","last_fullsized":"2024-02-21T07:55:50.024901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"30'2741","reported_seq":2765,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.802965+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:58:07.802965+0000","last_peered":"2024-02-21T07:58:07.802965+0000","last_clean":"2024-02-21T07:58:07.802965+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:58:07.802965+0000","last_undegraded":"2024-02-21T07:58:07.802965+0000","last_fullsized":"2024-02-21T07:58:07.802965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28989,"num_write_kb":7541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"30'6","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.435662+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:57:46.435662+0000","last_peered":"2024-02-21T07:57:46.435662+0000","last_clean":"2024-02-21T07:57:46.435662+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:57:46.435662+0000","last_undegraded":"2024-02-21T07:57:46.435662+0000","last_fullsized":"2024-02-21T07:57:46.435662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.871861+0000","last_change":"2024-02-21T07:45:25.240492+0000","last_active":"2024-02-21T07:55:54.871861+0000","last_peered":"2024-02-21T07:55:54.871861+0000","last_clean":"2024-02-21T07:55:54.871861+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:55:54.871861+0000","last_undegraded":"2024-02-21T07:55:54.871861+0000","last_fullsized":"2024-02-21T07:55:54.871861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"30'2464","reported_seq":2539,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.741906+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:58:07.741906+0000","last_peered":"2024-02-21T07:58:07.741906+0000","last_clean":"2024-02-21T07:58:07.741906+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:58:07.741906+0000","last_undegraded":"2024-02-21T07:58:07.741906+0000","last_fullsized":"2024-02-21T07:58:07.741906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":26392,"num_write_kb":6842521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.021766+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:55:54.021766+0000","last_peered":"2024-02-21T07:55:54.021766+0000","last_clean":"2024-02-21T07:55:54.021766+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:55:54.021766+0000","last_undegraded":"2024-02-21T07:55:54.021766+0000","last_fullsized":"2024-02-21T07:55:54.021766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.031796+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:55:54.031796+0000","last_peered":"2024-02-21T07:55:54.031796+0000","last_clean":"2024-02-21T07:55:54.031796+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:55:54.031796+0000","last_undegraded":"2024-02-21T07:55:54.031796+0000","last_fullsized":"2024-02-21T07:55:54.031796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"30'2384","reported_seq":2425,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.804283+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:58:07.804283+0000","last_peered":"2024-02-21T07:58:07.804283+0000","last_clean":"2024-02-21T07:58:07.804283+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:58:07.804283+0000","last_undegraded":"2024-02-21T07:58:07.804283+0000","last_fullsized":"2024-02-21T07:58:07.804283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25350,"num_write_kb":6611464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045880+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:55:29.045880+0000","last_peered":"2024-02-21T07:55:29.045880+0000","last_clean":"2024-02-21T07:55:29.045880+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:55:29.045880+0000","last_undegraded":"2024-02-21T07:55:29.045880+0000","last_fullsized":"2024-02-21T07:55:29.045880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'13","reported_seq":800,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:18.567172+0000","last_change":"2024-02-21T07:45:25.240968+0000","last_active":"2024-02-21T07:58:18.567172+0000","last_peered":"2024-02-21T07:58:18.567172+0000","last_clean":"2024-02-21T07:58:18.567172+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:58:18.567172+0000","last_undegraded":"2024-02-21T07:58:18.567172+0000","last_fullsized":"2024-02-21T07:58:18.567172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":756,"num_read_kb":757,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"30'2406","reported_seq":2436,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796313+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:58:07.796313+0000","last_peered":"2024-02-21T07:58:07.796313+0000","last_clean":"2024-02-21T07:58:07.796313+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:58:07.796313+0000","last_undegraded":"2024-02-21T07:58:07.796313+0000","last_fullsized":"2024-02-21T07:58:07.796313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:10.471177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25497,"num_write_kb":6630592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:55.218164+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:55:55.218164+0000","last_peered":"2024-02-21T07:55:55.218164+0000","last_clean":"2024-02-21T07:55:55.218164+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:55:55.218164+0000","last_undegraded":"2024-02-21T07:55:55.218164+0000","last_fullsized":"2024-02-21T07:55:55.218164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026692+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:55:29.026692+0000","last_peered":"2024-02-21T07:55:29.026692+0000","last_clean":"2024-02-21T07:55:29.026692+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:55:29.026692+0000","last_undegraded":"2024-02-21T07:55:29.026692+0000","last_fullsized":"2024-02-21T07:55:29.026692+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'2270","reported_seq":2293,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.769251+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:58:07.769251+0000","last_peered":"2024-02-21T07:58:07.769251+0000","last_clean":"2024-02-21T07:58:07.769251+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:58:07.769251+0000","last_undegraded":"2024-02-21T07:58:07.769251+0000","last_fullsized":"2024-02-21T07:58:07.769251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":6335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.905255+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:55:54.905255+0000","last_peered":"2024-02-21T07:55:54.905255+0000","last_clean":"2024-02-21T07:55:54.905255+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:55:54.905255+0000","last_undegraded":"2024-02-21T07:55:54.905255+0000","last_fullsized":"2024-02-21T07:55:54.905255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'3","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.037294+0000","last_change":"2024-02-21T07:45:25.220428+0000","last_active":"2024-02-21T07:55:54.037294+0000","last_peered":"2024-02-21T07:55:54.037294+0000","last_clean":"2024-02-21T07:55:54.037294+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:55:54.037294+0000","last_undegraded":"2024-02-21T07:55:54.037294+0000","last_fullsized":"2024-02-21T07:55:54.037294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":211,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:24.026223+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:55:24.026223+0000","last_peered":"2024-02-21T07:55:24.026223+0000","last_clean":"2024-02-21T07:55:24.026223+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:55:24.026223+0000","last_undegraded":"2024-02-21T07:55:24.026223+0000","last_fullsized":"2024-02-21T07:55:24.026223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:05:04.234440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"30'2060","reported_seq":2118,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.726474+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:58:07.726474+0000","last_peered":"2024-02-21T07:58:07.726474+0000","last_clean":"2024-02-21T07:58:07.726474+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:58:07.726474+0000","last_undegraded":"2024-02-21T07:58:07.726474+0000","last_fullsized":"2024-02-21T07:58:07.726474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:07:29.129115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22073,"num_write_kb":5629259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020805+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:54:29.020805+0000","last_peered":"2024-02-21T07:54:29.020805+0000","last_clean":"2024-02-21T07:54:29.020805+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:54:29.020805+0000","last_undegraded":"2024-02-21T07:54:29.020805+0000","last_fullsized":"2024-02-21T07:54:29.020805+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:48.859730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.048015+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:56:44.048015+0000","last_peered":"2024-02-21T07:56:44.048015+0000","last_clean":"2024-02-21T07:56:44.048015+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:56:44.048015+0000","last_undegraded":"2024-02-21T07:56:44.048015+0000","last_fullsized":"2024-02-21T07:56:44.048015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"30'2311","reported_seq":2334,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733562+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:58:07.733562+0000","last_peered":"2024-02-21T07:58:07.733562+0000","last_clean":"2024-02-21T07:58:07.733562+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:58:07.733562+0000","last_undegraded":"2024-02-21T07:58:07.733562+0000","last_fullsized":"2024-02-21T07:58:07.733562+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24846,"num_write_kb":6393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020785+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:54:29.020785+0000","last_peered":"2024-02-21T07:54:29.020785+0000","last_clean":"2024-02-21T07:54:29.020785+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:54:29.020785+0000","last_undegraded":"2024-02-21T07:54:29.020785+0000","last_fullsized":"2024-02-21T07:54:29.020785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"30'47","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.413600+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:57:38.413600+0000","last_peered":"2024-02-21T07:57:38.413600+0000","last_clean":"2024-02-21T07:57:38.413600+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:57:38.413600+0000","last_undegraded":"2024-02-21T07:57:38.413600+0000","last_fullsized":"2024-02-21T07:57:38.413600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":18,"num_write":93,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'2089","reported_seq":2119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.671207+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:58:07.671207+0000","last_peered":"2024-02-21T07:58:07.671207+0000","last_clean":"2024-02-21T07:58:07.671207+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:58:07.671207+0000","last_undegraded":"2024-02-21T07:58:07.671207+0000","last_fullsized":"2024-02-21T07:58:07.671207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:58:21.549333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22313,"num_write_kb":5873984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.020816+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:54:29.020816+0000","last_peered":"2024-02-21T07:54:29.020816+0000","last_clean":"2024-02-21T07:54:29.020816+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:54:29.020816+0000","last_undegraded":"2024-02-21T07:54:29.020816+0000","last_fullsized":"2024-02-21T07:54:29.020816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:30:59.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042194+0000","last_change":"2024-02-21T07:45:25.247614+0000","last_active":"2024-02-21T07:54:30.042194+0000","last_peered":"2024-02-21T07:54:30.042194+0000","last_clean":"2024-02-21T07:54:30.042194+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:54:30.042194+0000","last_undegraded":"2024-02-21T07:54:30.042194+0000","last_fullsized":"2024-02-21T07:54:30.042194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"30'1828","reported_seq":1851,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782512+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:58:07.782512+0000","last_peered":"2024-02-21T07:58:07.782512+0000","last_clean":"2024-02-21T07:58:07.782512+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:58:07.782512+0000","last_undegraded":"2024-02-21T07:58:07.782512+0000","last_fullsized":"2024-02-21T07:58:07.782512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19636,"num_write_kb":5096256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.031015+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:54:29.031015+0000","last_peered":"2024-02-21T07:54:29.031015+0000","last_clean":"2024-02-21T07:54:29.031015+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:54:29.031015+0000","last_undegraded":"2024-02-21T07:54:29.031015+0000","last_fullsized":"2024-02-21T07:54:29.031015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:25.006321+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:54:25.006321+0000","last_peered":"2024-02-21T07:54:25.006321+0000","last_clean":"2024-02-21T07:54:25.006321+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:54:25.006321+0000","last_undegraded":"2024-02-21T07:54:25.006321+0000","last_fullsized":"2024-02-21T07:54:25.006321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"30'2224","reported_seq":2282,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733641+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:58:07.733641+0000","last_peered":"2024-02-21T07:58:07.733641+0000","last_clean":"2024-02-21T07:58:07.733641+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:58:07.733641+0000","last_undegraded":"2024-02-21T07:58:07.733641+0000","last_fullsized":"2024-02-21T07:58:07.733641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":23814,"num_write_kb":6166061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.037449+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:54:49.037449+0000","last_peered":"2024-02-21T07:54:49.037449+0000","last_clean":"2024-02-21T07:54:49.037449+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:54:49.037449+0000","last_undegraded":"2024-02-21T07:54:49.037449+0000","last_fullsized":"2024-02-21T07:54:49.037449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"30'111","reported_seq":179,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:40.624401+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:57:40.624401+0000","last_peered":"2024-02-21T07:57:40.624401+0000","last_clean":"2024-02-21T07:57:40.624401+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:57:40.624401+0000","last_undegraded":"2024-02-21T07:57:40.624401+0000","last_fullsized":"2024-02-21T07:57:40.624401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":37,"num_write":210,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"30'2326","reported_seq":2368,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.824206+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:58:07.824206+0000","last_peered":"2024-02-21T07:58:07.824206+0000","last_clean":"2024-02-21T07:58:07.824206+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:58:07.824206+0000","last_undegraded":"2024-02-21T07:58:07.824206+0000","last_fullsized":"2024-02-21T07:58:07.824206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":25096,"num_write_kb":6462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.023243+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:54:49.023243+0000","last_peered":"2024-02-21T07:54:49.023243+0000","last_clean":"2024-02-21T07:54:49.023243+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:54:49.023243+0000","last_undegraded":"2024-02-21T07:54:49.023243+0000","last_fullsized":"2024-02-21T07:54:49.023243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":783,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.566167+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:58:17.566167+0000","last_peered":"2024-02-21T07:58:17.566167+0000","last_clean":"2024-02-21T07:58:17.566167+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:58:17.566167+0000","last_undegraded":"2024-02-21T07:58:17.566167+0000","last_fullsized":"2024-02-21T07:58:17.566167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"30'2447","reported_seq":2500,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.813049+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:58:07.813049+0000","last_peered":"2024-02-21T07:58:07.813049+0000","last_clean":"2024-02-21T07:58:07.813049+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:58:07.813049+0000","last_undegraded":"2024-02-21T07:58:07.813049+0000","last_fullsized":"2024-02-21T07:58:07.813049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2447,"log_dups_size":0,"ondisk_log_size":2447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":25865,"num_write_kb":6637076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"30'19","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.567604+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:57:46.567604+0000","last_peered":"2024-02-21T07:57:46.567604+0000","last_clean":"2024-02-21T07:57:46.567604+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:57:46.567604+0000","last_undegraded":"2024-02-21T07:57:46.567604+0000","last_fullsized":"2024-02-21T07:57:46.567604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"30'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.068511+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:57:09.068511+0000","last_peered":"2024-02-21T07:57:09.068511+0000","last_clean":"2024-02-21T07:57:09.068511+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:57:09.068511+0000","last_undegraded":"2024-02-21T07:57:09.068511+0000","last_fullsized":"2024-02-21T07:57:09.068511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2095","reported_seq":2152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.708515+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:58:07.708515+0000","last_peered":"2024-02-21T07:58:07.708515+0000","last_clean":"2024-02-21T07:58:07.708515+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:58:07.708515+0000","last_undegraded":"2024-02-21T07:58:07.708515+0000","last_fullsized":"2024-02-21T07:58:07.708515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22512,"num_write_kb":5792019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:10.380887+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:57:10.380887+0000","last_peered":"2024-02-21T07:57:10.380887+0000","last_clean":"2024-02-21T07:57:10.380887+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:57:10.380887+0000","last_undegraded":"2024-02-21T07:57:10.380887+0000","last_fullsized":"2024-02-21T07:57:10.380887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'57","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.399451+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:57:38.399451+0000","last_peered":"2024-02-21T07:57:38.399451+0000","last_clean":"2024-02-21T07:57:38.399451+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:57:38.399451+0000","last_undegraded":"2024-02-21T07:57:38.399451+0000","last_fullsized":"2024-02-21T07:57:38.399451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":20,"num_write":108,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"30'2154","reported_seq":2177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796003+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:58:07.796003+0000","last_peered":"2024-02-21T07:58:07.796003+0000","last_clean":"2024-02-21T07:58:07.796003+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:58:07.796003+0000","last_undegraded":"2024-02-21T07:58:07.796003+0000","last_fullsized":"2024-02-21T07:58:07.796003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":5940672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.016643+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:55:10.016643+0000","last_peered":"2024-02-21T07:55:10.016643+0000","last_clean":"2024-02-21T07:55:10.016643+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:55:10.016643+0000","last_undegraded":"2024-02-21T07:55:10.016643+0000","last_fullsized":"2024-02-21T07:55:10.016643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'757","reported_seq":2156,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.828091+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:58:17.828091+0000","last_peered":"2024-02-21T07:58:17.828091+0000","last_clean":"2024-02-21T07:58:17.828091+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:58:17.828091+0000","last_undegraded":"2024-02-21T07:58:17.828091+0000","last_fullsized":"2024-02-21T07:58:17.828091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1368,"num_read_kb":4919,"num_write":757,"num_write_kb":4594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"30'2054","reported_seq":2095,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782529+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:58:07.782529+0000","last_peered":"2024-02-21T07:58:07.782529+0000","last_clean":"2024-02-21T07:58:07.782529+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:58:07.782529+0000","last_undegraded":"2024-02-21T07:58:07.782529+0000","last_fullsized":"2024-02-21T07:58:07.782529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":21761,"num_write_kb":5639370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000237+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:54:49.000237+0000","last_peered":"2024-02-21T07:54:49.000237+0000","last_clean":"2024-02-21T07:54:49.000237+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:54:49.000237+0000","last_undegraded":"2024-02-21T07:54:49.000237+0000","last_fullsized":"2024-02-21T07:54:49.000237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"30'58","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:03.690539+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:58:03.690539+0000","last_peered":"2024-02-21T07:58:03.690539+0000","last_clean":"2024-02-21T07:58:03.690539+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:58:03.690539+0000","last_undegraded":"2024-02-21T07:58:03.690539+0000","last_fullsized":"2024-02-21T07:58:03.690539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":65,"num_read_kb":20,"num_write":105,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"30'2000","reported_seq":2057,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.805914+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:58:07.805914+0000","last_peered":"2024-02-21T07:58:07.805914+0000","last_clean":"2024-02-21T07:58:07.805914+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:58:07.805914+0000","last_undegraded":"2024-02-21T07:58:07.805914+0000","last_fullsized":"2024-02-21T07:58:07.805914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:27:11.881533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":21494,"num_write_kb":5470657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.793458+0000","last_change":"2024-02-21T07:45:26.279235+0000","last_active":"2024-02-21T07:57:34.793458+0000","last_peered":"2024-02-21T07:57:34.793458+0000","last_clean":"2024-02-21T07:57:34.793458+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:57:34.793458+0000","last_undegraded":"2024-02-21T07:57:34.793458+0000","last_fullsized":"2024-02-21T07:57:34.793458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":33,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.025014+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:55:09.025014+0000","last_peered":"2024-02-21T07:55:09.025014+0000","last_clean":"2024-02-21T07:55:09.025014+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:55:09.025014+0000","last_undegraded":"2024-02-21T07:55:09.025014+0000","last_fullsized":"2024-02-21T07:55:09.025014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"30'2237","reported_seq":2279,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.786901+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:58:07.786901+0000","last_peered":"2024-02-21T07:58:07.786901+0000","last_clean":"2024-02-21T07:58:07.786901+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:58:07.786901+0000","last_undegraded":"2024-02-21T07:58:07.786901+0000","last_fullsized":"2024-02-21T07:58:07.786901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:31.892204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24168,"num_write_kb":6241728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.009169+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:55:09.009169+0000","last_peered":"2024-02-21T07:55:09.009169+0000","last_clean":"2024-02-21T07:55:09.009169+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:55:09.009169+0000","last_undegraded":"2024-02-21T07:55:09.009169+0000","last_fullsized":"2024-02-21T07:55:09.009169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"30'9","reported_seq":789,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:17.424032+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:58:17.424032+0000","last_peered":"2024-02-21T07:58:17.424032+0000","last_clean":"2024-02-21T07:58:17.424032+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:58:17.424032+0000","last_undegraded":"2024-02-21T07:58:17.424032+0000","last_fullsized":"2024-02-21T07:58:17.424032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":749,"num_read_kb":749,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"30'2195","reported_seq":2218,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.772697+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:58:07.772697+0000","last_peered":"2024-02-21T07:58:07.772697+0000","last_clean":"2024-02-21T07:58:07.772697+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:58:07.772697+0000","last_undegraded":"2024-02-21T07:58:07.772697+0000","last_fullsized":"2024-02-21T07:58:07.772697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":6089984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1963","reported_seq":1987,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820640+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:58:07.820640+0000","last_peered":"2024-02-21T07:58:07.820640+0000","last_clean":"2024-02-21T07:58:07.820640+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:58:07.820640+0000","last_undegraded":"2024-02-21T07:58:07.820640+0000","last_fullsized":"2024-02-21T07:58:07.820640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21157,"num_write_kb":5478016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.839758+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:55:09.839758+0000","last_peered":"2024-02-21T07:55:09.839758+0000","last_clean":"2024-02-21T07:55:09.839758+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:55:09.839758+0000","last_undegraded":"2024-02-21T07:55:09.839758+0000","last_fullsized":"2024-02-21T07:55:09.839758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.041150+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:55:09.041150+0000","last_peered":"2024-02-21T07:55:09.041150+0000","last_clean":"2024-02-21T07:55:09.041150+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:55:09.041150+0000","last_undegraded":"2024-02-21T07:55:09.041150+0000","last_fullsized":"2024-02-21T07:55:09.041150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'2123","reported_seq":2147,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.673299+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:58:07.673299+0000","last_peered":"2024-02-21T07:58:07.673299+0000","last_clean":"2024-02-21T07:58:07.673299+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:58:07.673299+0000","last_undegraded":"2024-02-21T07:58:07.673299+0000","last_fullsized":"2024-02-21T07:58:07.673299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22656,"num_write_kb":5874432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.851290+0000","last_change":"2024-02-21T07:45:26.262093+0000","last_active":"2024-02-21T07:55:09.851290+0000","last_peered":"2024-02-21T07:55:09.851290+0000","last_clean":"2024-02-21T07:55:09.851290+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:55:09.851290+0000","last_undegraded":"2024-02-21T07:55:09.851290+0000","last_fullsized":"2024-02-21T07:55:09.851290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'5","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.431540+0000","last_change":"2024-02-21T07:45:25.229015+0000","last_active":"2024-02-21T07:57:46.431540+0000","last_peered":"2024-02-21T07:57:46.431540+0000","last_clean":"2024-02-21T07:57:46.431540+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:57:46.431540+0000","last_undegraded":"2024-02-21T07:57:46.431540+0000","last_fullsized":"2024-02-21T07:57:46.431540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017432+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:55:29.017432+0000","last_peered":"2024-02-21T07:55:29.017432+0000","last_clean":"2024-02-21T07:55:29.017432+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:55:29.017432+0000","last_undegraded":"2024-02-21T07:55:29.017432+0000","last_fullsized":"2024-02-21T07:55:29.017432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.045903+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:55:29.045903+0000","last_peered":"2024-02-21T07:55:29.045903+0000","last_clean":"2024-02-21T07:55:29.045903+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:55:29.045903+0000","last_undegraded":"2024-02-21T07:55:29.045903+0000","last_fullsized":"2024-02-21T07:55:29.045903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2454","reported_seq":2477,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.742250+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:58:07.742250+0000","last_peered":"2024-02-21T07:58:07.742250+0000","last_clean":"2024-02-21T07:58:07.742250+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:58:07.742250+0000","last_undegraded":"2024-02-21T07:58:07.742250+0000","last_fullsized":"2024-02-21T07:58:07.742250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2454,"log_dups_size":0,"ondisk_log_size":2454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26408,"num_write_kb":6832640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'382","reported_seq":1552,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:18.425981+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:58:18.425981+0000","last_peered":"2024-02-21T07:58:18.425981+0000","last_clean":"2024-02-21T07:58:18.425981+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:58:18.425981+0000","last_undegraded":"2024-02-21T07:58:18.425981+0000","last_fullsized":"2024-02-21T07:58:18.425981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3066336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1139,"num_read_kb":3040,"num_write":379,"num_write_kb":3192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:30.023297+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:55:30.023297+0000","last_peered":"2024-02-21T07:55:30.023297+0000","last_clean":"2024-02-21T07:55:30.023297+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:55:30.023297+0000","last_undegraded":"2024-02-21T07:55:30.023297+0000","last_fullsized":"2024-02-21T07:55:30.023297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2254","reported_seq":2294,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.754893+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:58:07.754893+0000","last_peered":"2024-02-21T07:58:07.754893+0000","last_clean":"2024-02-21T07:58:07.754893+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:58:07.754893+0000","last_undegraded":"2024-02-21T07:58:07.754893+0000","last_fullsized":"2024-02-21T07:58:07.754893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":24317,"num_write_kb":6228160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048058+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:55:54.048058+0000","last_peered":"2024-02-21T07:55:54.048058+0000","last_clean":"2024-02-21T07:55:54.048058+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:55:54.048058+0000","last_undegraded":"2024-02-21T07:55:54.048058+0000","last_fullsized":"2024-02-21T07:55:54.048058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"30'12","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.038521+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:55:54.038521+0000","last_peered":"2024-02-21T07:55:54.038521+0000","last_clean":"2024-02-21T07:55:54.038521+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:55:54.038521+0000","last_undegraded":"2024-02-21T07:55:54.038521+0000","last_fullsized":"2024-02-21T07:55:54.038521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"30'14","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:02.344995+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:58:02.344995+0000","last_peered":"2024-02-21T07:58:02.344995+0000","last_clean":"2024-02-21T07:58:02.344995+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:58:02.344995+0000","last_undegraded":"2024-02-21T07:58:02.344995+0000","last_fullsized":"2024-02-21T07:58:02.344995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683133+0000","last_change":"2024-02-21T07:45:26.280812+0000","last_active":"2024-02-21T07:55:54.683133+0000","last_peered":"2024-02-21T07:55:54.683133+0000","last_clean":"2024-02-21T07:55:54.683133+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:55:54.683133+0000","last_undegraded":"2024-02-21T07:55:54.683133+0000","last_fullsized":"2024-02-21T07:55:54.683133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'4","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.992212+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:54:09.992212+0000","last_peered":"2024-02-21T07:54:09.992212+0000","last_clean":"2024-02-21T07:54:09.992212+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:54:09.992212+0000","last_undegraded":"2024-02-21T07:54:09.992212+0000","last_fullsized":"2024-02-21T07:54:09.992212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:19.050175+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:56:19.050175+0000","last_peered":"2024-02-21T07:56:19.050175+0000","last_clean":"2024-02-21T07:56:19.050175+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:56:19.050175+0000","last_undegraded":"2024-02-21T07:56:19.050175+0000","last_fullsized":"2024-02-21T07:56:19.050175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"30'15","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027357+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:54:09.027357+0000","last_peered":"2024-02-21T07:54:09.027357+0000","last_clean":"2024-02-21T07:54:09.027357+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:54:09.027357+0000","last_undegraded":"2024-02-21T07:54:09.027357+0000","last_fullsized":"2024-02-21T07:54:09.027357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'2","reported_seq":31,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.764753+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:54:09.764753+0000","last_peered":"2024-02-21T07:54:09.764753+0000","last_clean":"2024-02-21T07:54:09.764753+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:54:09.764753+0000","last_undegraded":"2024-02-21T07:54:09.764753+0000","last_fullsized":"2024-02-21T07:54:09.764753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:09.027618+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:54:09.027618+0000","last_peered":"2024-02-21T07:54:09.027618+0000","last_clean":"2024-02-21T07:54:09.027618+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:54:09.027618+0000","last_undegraded":"2024-02-21T07:54:09.027618+0000","last_fullsized":"2024-02-21T07:54:09.027618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.984134+0000","last_change":"2024-02-21T07:45:26.267547+0000","last_active":"2024-02-21T07:56:44.984134+0000","last_peered":"2024-02-21T07:56:44.984134+0000","last_clean":"2024-02-21T07:56:44.984134+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:56:44.984134+0000","last_undegraded":"2024-02-21T07:56:44.984134+0000","last_fullsized":"2024-02-21T07:56:44.984134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:28.998739+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:54:28.998739+0000","last_peered":"2024-02-21T07:54:28.998739+0000","last_clean":"2024-02-21T07:54:28.998739+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:54:28.998739+0000","last_undegraded":"2024-02-21T07:54:28.998739+0000","last_fullsized":"2024-02-21T07:54:28.998739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'11","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:30.042162+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:54:30.042162+0000","last_peered":"2024-02-21T07:54:30.042162+0000","last_clean":"2024-02-21T07:54:30.042162+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:54:30.042162+0000","last_undegraded":"2024-02-21T07:54:30.042162+0000","last_fullsized":"2024-02-21T07:54:30.042162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"30'8","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030830+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:54:29.030830+0000","last_peered":"2024-02-21T07:54:29.030830+0000","last_clean":"2024-02-21T07:54:29.030830+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:54:29.030830+0000","last_undegraded":"2024-02-21T07:54:29.030830+0000","last_fullsized":"2024-02-21T07:54:29.030830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"30'7","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:29.030443+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:54:29.030443+0000","last_peered":"2024-02-21T07:54:29.030443+0000","last_clean":"2024-02-21T07:54:29.030443+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:54:29.030443+0000","last_undegraded":"2024-02-21T07:54:29.030443+0000","last_fullsized":"2024-02-21T07:54:29.030443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.822291+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:54:49.822291+0000","last_peered":"2024-02-21T07:54:49.822291+0000","last_clean":"2024-02-21T07:54:49.822291+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:54:49.822291+0000","last_undegraded":"2024-02-21T07:54:49.822291+0000","last_fullsized":"2024-02-21T07:54:49.822291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.055257+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:57:09.055257+0000","last_peered":"2024-02-21T07:57:09.055257+0000","last_clean":"2024-02-21T07:57:09.055257+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:57:09.055257+0000","last_undegraded":"2024-02-21T07:57:09.055257+0000","last_fullsized":"2024-02-21T07:57:09.055257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.000212+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:54:49.000212+0000","last_peered":"2024-02-21T07:54:49.000212+0000","last_clean":"2024-02-21T07:54:49.000212+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:54:49.000212+0000","last_undegraded":"2024-02-21T07:54:49.000212+0000","last_fullsized":"2024-02-21T07:54:49.000212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617208+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:54:49.617208+0000","last_peered":"2024-02-21T07:54:49.617208+0000","last_clean":"2024-02-21T07:54:49.617208+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:54:49.617208+0000","last_undegraded":"2024-02-21T07:54:49.617208+0000","last_fullsized":"2024-02-21T07:54:49.617208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"30'7","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:49.617233+0000","last_change":"2024-02-21T07:45:26.277873+0000","last_active":"2024-02-21T07:54:49.617233+0000","last_peered":"2024-02-21T07:54:49.617233+0000","last_clean":"2024-02-21T07:54:49.617233+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:54:49.617233+0000","last_undegraded":"2024-02-21T07:54:49.617233+0000","last_fullsized":"2024-02-21T07:54:49.617233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"30'10","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:10.198152+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:55:10.198152+0000","last_peered":"2024-02-21T07:55:10.198152+0000","last_clean":"2024-02-21T07:55:10.198152+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:55:10.198152+0000","last_undegraded":"2024-02-21T07:55:10.198152+0000","last_fullsized":"2024-02-21T07:55:10.198152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.434916+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:57:46.434916+0000","last_peered":"2024-02-21T07:57:46.434916+0000","last_clean":"2024-02-21T07:57:46.434916+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:57:46.434916+0000","last_undegraded":"2024-02-21T07:57:46.434916+0000","last_fullsized":"2024-02-21T07:57:46.434916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.024979+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:55:09.024979+0000","last_peered":"2024-02-21T07:55:09.024979+0000","last_clean":"2024-02-21T07:55:09.024979+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:55:09.024979+0000","last_undegraded":"2024-02-21T07:55:09.024979+0000","last_fullsized":"2024-02-21T07:55:09.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:57.154723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'17","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.013613+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:55:09.013613+0000","last_peered":"2024-02-21T07:55:09.013613+0000","last_clean":"2024-02-21T07:55:09.013613+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:55:09.013613+0000","last_undegraded":"2024-02-21T07:55:09.013613+0000","last_fullsized":"2024-02-21T07:55:09.013613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"30'13","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.039759+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:57:34.039759+0000","last_peered":"2024-02-21T07:57:34.039759+0000","last_clean":"2024-02-21T07:57:34.039759+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:57:34.039759+0000","last_undegraded":"2024-02-21T07:57:34.039759+0000","last_fullsized":"2024-02-21T07:57:34.039759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:31:26.020585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.859041+0000","last_change":"2024-02-21T07:45:26.266313+0000","last_active":"2024-02-21T07:55:29.859041+0000","last_peered":"2024-02-21T07:55:29.859041+0000","last_clean":"2024-02-21T07:55:29.859041+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:55:29.859041+0000","last_undegraded":"2024-02-21T07:55:29.859041+0000","last_fullsized":"2024-02-21T07:55:29.859041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'5","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.026716+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:55:29.026716+0000","last_peered":"2024-02-21T07:55:29.026716+0000","last_clean":"2024-02-21T07:55:29.026716+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:55:29.026716+0000","last_undegraded":"2024-02-21T07:55:29.026716+0000","last_fullsized":"2024-02-21T07:55:29.026716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017415+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:55:29.017415+0000","last_peered":"2024-02-21T07:55:29.017415+0000","last_clean":"2024-02-21T07:55:29.017415+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:55:29.017415+0000","last_undegraded":"2024-02-21T07:55:29.017415+0000","last_fullsized":"2024-02-21T07:55:29.017415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"30'6","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.574348+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:57:46.574348+0000","last_peered":"2024-02-21T07:57:46.574348+0000","last_clean":"2024-02-21T07:57:46.574348+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:57:46.574348+0000","last_undegraded":"2024-02-21T07:57:46.574348+0000","last_fullsized":"2024-02-21T07:57:46.574348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.034016+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:55:29.034016+0000","last_peered":"2024-02-21T07:55:29.034016+0000","last_clean":"2024-02-21T07:55:29.034016+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:55:29.034016+0000","last_undegraded":"2024-02-21T07:55:29.034016+0000","last_fullsized":"2024-02-21T07:55:29.034016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"30'7","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683159+0000","last_change":"2024-02-21T07:45:26.279815+0000","last_active":"2024-02-21T07:55:54.683159+0000","last_peered":"2024-02-21T07:55:54.683159+0000","last_clean":"2024-02-21T07:55:54.683159+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:55:54.683159+0000","last_undegraded":"2024-02-21T07:55:54.683159+0000","last_fullsized":"2024-02-21T07:55:54.683159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'4","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.683176+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:55:54.683176+0000","last_peered":"2024-02-21T07:55:54.683176+0000","last_clean":"2024-02-21T07:55:54.683176+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:55:54.683176+0000","last_undegraded":"2024-02-21T07:55:54.683176+0000","last_fullsized":"2024-02-21T07:55:54.683176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"30'8","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:54.048097+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:55:54.048097+0000","last_peered":"2024-02-21T07:55:54.048097+0000","last_clean":"2024-02-21T07:55:54.048097+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:55:54.048097+0000","last_undegraded":"2024-02-21T07:55:54.048097+0000","last_fullsized":"2024-02-21T07:55:54.048097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":753511,"num_write_kb":194935703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70426,"ondisk_log_size":70426,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":539,"ondisk_log_size":539,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3072176,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":5327,"num_read_kb":9667,"num_write":2211,"num_write_kb":8460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2834432,"data_stored":6144352,"data_compressed":766850,"data_compressed_allocated":1040384,"data_compressed_original":4505600,"omap_allocated":0,"internal_metadata":0},"log_size":1788,"ondisk_log_size":1788,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444190,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94177980,"statfs":{"total":96636764160,"available":96438251520,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":198179268},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":2.1349999999999998,"15min":1.4990000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":18.609999999999999,"5min":18.609999999999999,"15min":41.207999999999998},"last":0.44},{"interface":"front","average":{"1min":1.883,"5min":1.532,"15min":1.25},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.26600000000000001},"max":{"1min":12.308999999999999,"5min":13.135999999999999,"15min":24.315999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.442,"15min":0.504},"min":{"1min":0.254,"5min":0.247,"15min":0.19900000000000001},"max":{"1min":0.63400000000000001,"5min":1.2669999999999999,"15min":1.9950000000000001},"last":0.374},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.50700000000000001},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.048,"5min":1.8240000000000001,"15min":2.1419999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":3.089,"15min":3.089},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.218},"max":{"1min":0.75,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":0.33400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.76600000000000001,"5min":1.5880000000000001,"15min":2.0190000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":1.0029999999999999,"5min":1.8819999999999999,"15min":3.1059999999999999},"last":0.30199999999999999}]},{"osd":5,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.86699999999999999,"5min":1.6910000000000001,"15min":2.234},"last":0.504},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.28100000000000003,"5min":0.252,"15min":0.249},"max":{"1min":1.087,"5min":7.2640000000000002,"15min":7.2640000000000002},"last":0.432}]},{"osd":6,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.2970000000000002,"15min":1.631},"min":{"1min":0.40400000000000003,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":13.577,"5min":24.452000000000002,"15min":24.452000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.3380000000000001,"15min":1.6870000000000001},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.378},"max":{"1min":13.609,"5min":25.504000000000001,"15min":25.504000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.32800000000000001},"max":{"1min":1.0860000000000001,"5min":1.9870000000000001,"15min":3.1429999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.0649999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"last":0.38800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":1.665,"5min":1.665,"15min":3.0800000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.314},"max":{"1min":0.95199999999999996,"5min":1.9370000000000001,"15min":3.1989999999999998},"last":0.41199999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":3.6850000000000001,"15min":2.1760000000000002},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":7.5229999999999997,"5min":102.712,"15min":102.712},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.4379999999999999,"5min":2.8109999999999999,"15min":1.7170000000000001},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.48599999999999999},"max":{"1min":4.9980000000000002,"5min":27.137,"15min":27.137},"last":0.54800000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.214,"5min":1.972,"15min":3.2250000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.46100000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444191,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161940,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94209900,"statfs":{"total":96636764160,"available":96470937600,"internally_reserved":0,"allocated":339968,"data_stored":153098,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":165476800},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.8540000000000001,"15min":1.264},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":18.68,"5min":18.68,"15min":18.68},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.367,"5min":1.631,"15min":1.3480000000000001},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.4400000000000004,"5min":9.0079999999999991,"15min":13.788},"last":0.745}]},{"osd":1,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.34300000000000003},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.583},"last":0.59699999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.49399999999999999},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.2749999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.2629999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.9119999999999999,"15min":1.4099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39000000000000001,"15min":0.32600000000000001},"max":{"1min":5.6280000000000001,"5min":15.042999999999999,"15min":15.042999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.855,"5min":2.9950000000000001,"15min":1.669},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":13.597,"5min":52.374000000000002,"15min":52.374000000000002},"last":0.63600000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":1.4530000000000001,"5min":2.004,"15min":2.004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.24399999999999999},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.9199999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":1.167,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.421,"5min":1.694,"15min":1.897},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.51500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.27000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":1.0509999999999999},"last":0.67800000000000005}]},{"osd":8,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":1.228,"5min":1.857,"15min":1.857},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4750000000000001,"5min":1.958,"15min":1.958},"last":0.88400000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.698,"15min":1.73},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":26.867000000000001,"5min":26.867000000000001,"15min":26.867000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":4.8319999999999999,"5min":3.702,"15min":2.5569999999999999},"min":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.609000000000002,"5min":23.939,"15min":60.792000000000002},"last":0.871}]},{"osd":11,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.84299999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444191,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368780,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":368446,"kb_avail":94003060,"statfs":{"total":96636764160,"available":96259133440,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":377289152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":5.3689999999999998,"15min":3.9129999999999998},"min":{"1min":0.57099999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":66.947999999999993},"last":0.52100000000000002},{"interface":"front","average":{"1min":2.8740000000000001,"5min":4.423,"15min":3.1179999999999999},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":11.470000000000001,"5min":31.988,"15min":31.988},"last":0.64300000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":3.161,"15min":2.242},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":12.119,"5min":24.472000000000001,"15min":27.088999999999999},"last":0.746},{"interface":"front","average":{"1min":4.9749999999999996,"5min":4.5949999999999998,"15min":3.2799999999999998},"min":{"1min":0.59299999999999997,"5min":0.438,"15min":0.40799999999999997},"max":{"1min":44.505000000000003,"5min":44.505000000000003,"15min":66.670000000000002},"last":0.84699999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":3.206,"15min":2.3639999999999999},"min":{"1min":0.54600000000000004,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":10.294,"5min":30.081,"15min":30.081},"last":0.92600000000000005},{"interface":"front","average":{"1min":2.6360000000000001,"5min":3.306,"15min":2.3319999999999999},"min":{"1min":0.59699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":11.983000000000001,"5min":24.379999999999999,"15min":24.379999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.3899999999999997,"5min":5.399,"15min":4.1059999999999999},"min":{"1min":0.66300000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":44.453000000000003,"5min":44.453000000000003,"15min":66.914000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":3.3170000000000002,"5min":5.4950000000000001,"15min":3.702},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.42699999999999999},"max":{"1min":10.785,"5min":30.513999999999999,"15min":30.513999999999999},"last":1.0860000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":3.5089999999999999,"15min":2.5299999999999998},"min":{"1min":0.56299999999999994,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.077,"5min":24.928999999999998,"15min":27.155999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":5.149,"5min":4.9880000000000004,"15min":3.5600000000000001},"min":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.496},"max":{"1min":44.542999999999999,"5min":44.542999999999999,"15min":66.802999999999997},"last":0.77000000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":3.4990000000000001,"15min":2.5470000000000002},"min":{"1min":0.64300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.154999999999999,"5min":24.510000000000002,"15min":26.954000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":2.4630000000000001,"5min":3.613,"15min":2.827},"min":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.51700000000000002},"max":{"1min":10.346,"5min":30.129999999999999,"15min":37.783000000000001},"last":1.1379999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2839999999999998,"5min":5.1349999999999998,"15min":3.6930000000000001},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.50800000000000001},"max":{"1min":44.610999999999997,"5min":44.610999999999997,"15min":66.879000000000005},"last":0.95899999999999996},{"interface":"front","average":{"1min":2.8759999999999999,"5min":3.7909999999999999,"15min":2.7170000000000001},"min":{"1min":0.68200000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":14.105,"5min":24.895,"15min":27.056999999999999},"last":0.97899999999999998}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2320000000000002,"5min":5.4660000000000002,"15min":3.8359999999999999},"min":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.53200000000000003},"max":{"1min":44.578000000000003,"5min":44.578000000000003,"15min":66.841999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.6389999999999998,"5min":3.7400000000000002,"15min":2.9540000000000002},"min":{"1min":0.82899999999999996,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":10.667999999999999,"5min":30.167999999999999,"15min":37.670999999999999},"last":1.0229999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":3.8079999999999998,"15min":2.77},"min":{"1min":0.70799999999999996,"5min":0.51100000000000001,"15min":0.45700000000000002},"max":{"1min":14.147,"5min":24.959,"15min":27.123000000000001},"last":0.876},{"interface":"front","average":{"1min":5.1989999999999998,"5min":5.3330000000000002,"15min":3.8809999999999998},"min":{"1min":0.751,"5min":0.66000000000000003,"15min":0.59999999999999998},"max":{"1min":44.643999999999998,"5min":44.643999999999998,"15min":66.760999999999996},"last":1.002}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.6709999999999998,"5min":3.8260000000000001,"15min":3.036},"min":{"1min":0.86499999999999999,"5min":0.77400000000000002,"15min":0.59399999999999997},"max":{"1min":10.712999999999999,"5min":30.198,"15min":37.747999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":3.0339999999999998,"5min":3.851,"15min":2.8010000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":14.041,"5min":24.858000000000001,"15min":27.023},"last":1.05}]}]},{"osd":8,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179984,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.857,"15min":1.9650000000000001},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.952,"5min":26.353999999999999,"15min":205.21299999999999},"last":0.752},{"interface":"front","average":{"1min":2.4079999999999999,"5min":4.0979999999999999,"15min":2.1139999999999999},"min":{"1min":0.378,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.4779999999999998,"5min":65.656999999999996,"15min":65.656999999999996},"last":0.72899999999999998}]},{"osd":1,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.071,"5min":1.3779999999999999,"15min":3.8900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":1.4179999999999999,"15min":3.024},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.46100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83499999999999996,"5min":2.0489999999999999,"15min":3.4990000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":1.484,"15min":3.794},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.9129999999999998,"15min":1.7929999999999999},"min":{"1min":0.48599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":13.1,"5min":23.033999999999999,"15min":23.033999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.7310000000000001,"5min":2.919,"15min":1.782},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.42299999999999999},"max":{"1min":13.138999999999999,"5min":23.047999999999998,"15min":23.047999999999998},"last":0.627}]},{"osd":4,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.58999999999999997},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":1.1279999999999999,"5min":1.242,"15min":3.3260000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.497,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0529999999999999,"5min":1.133,"15min":3.839},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27000000000000002},"max":{"1min":0.94299999999999995,"5min":1.359,"15min":2.9809999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":1.651,"15min":4.0069999999999997},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":2.2930000000000001,"5min":2.601,"15min":1.8240000000000001},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":13.859,"5min":19.280000000000001,"15min":19.280000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":4.5190000000000001,"5min":2.8199999999999998,"15min":1.7809999999999999},"min":{"1min":0.51300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.779,"5min":15.593999999999999,"15min":15.593999999999999},"last":0.78900000000000003}]},{"osd":7,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.198,"15min":4.1059999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":1.4139999999999999,"15min":3.968},"last":0.63800000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":5.9560000000000004,"5min":5.1479999999999997,"15min":2.9540000000000002},"min":{"1min":0.60999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":28.902999999999999,"5min":71.158000000000001,"15min":71.158000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":4.7270000000000003,"5min":3.444,"15min":2.262},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.49199999999999999},"max":{"1min":27.178999999999998,"5min":27.178999999999998,"15min":27.178999999999998},"last":0.95799999999999996}]},{"osd":10,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":1.1319999999999999,"15min":1.855},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.2030000000000001,"15min":1.746},"last":0.76900000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.67800000000000005},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":1.887,"15min":4.3360000000000003},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77000000000000002,"5min":1.619,"15min":4.0720000000000001},"last":0.69899999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444190,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280012,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091828,"statfs":{"total":96636764160,"available":96350031872,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":286325194},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":4.1180000000000003,"5min":3.0129999999999999,"15min":1.7789999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":21.872,"5min":43.918999999999997,"15min":43.918999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.052,"15min":1.831},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.32900000000000001},"max":{"1min":21.887,"5min":43.935000000000002,"15min":43.935000000000002},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.224,"15min":0.20599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":1.1299999999999999},"last":0.50900000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":2.3140000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41299999999999998,"15min":0.48499999999999999},"min":{"1min":0.312,"5min":0.252,"15min":0.252},"max":{"1min":0.85799999999999998,"5min":1.196,"15min":1.77},"last":0.61299999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.958,"15min":1.425},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":8.1379999999999999,"5min":15.101000000000001,"15min":15.101000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":3.3479999999999999,"5min":3.1989999999999998,"15min":2.1680000000000001},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.28699999999999998},"max":{"1min":22.602,"5min":32.689999999999998,"15min":41.405000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38500000000000001,"15min":0.41099999999999998},"min":{"1min":0.307,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.8740000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47599999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.60699999999999998,"5min":0.98099999999999998,"15min":13.967000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.61099999999999999},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.88900000000000001,"15min":13.952999999999999},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1989999999999998,"5min":2.504,"15min":1.8759999999999999},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":7.7069999999999999,"5min":23.959,"15min":23.959},"last":0.77500000000000002},{"interface":"front","average":{"1min":6.1200000000000001,"5min":3.806,"15min":2.3370000000000002},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":82.087000000000003,"5min":82.087000000000003,"15min":82.087000000000003},"last":0.747}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.1579999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.4930000000000001},"last":0.86599999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":3.524,"5min":2.577,"15min":1.95},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":13.708,"5min":16.113,"15min":27.177},"last":0.80700000000000005},{"interface":"front","average":{"1min":3.3530000000000002,"5min":3.25,"15min":2.327},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":33.146000000000001,"5min":33.146000000000001,"15min":34.470999999999997},"last":0.876}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":2.5019999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":1.798,"5min":1.798,"15min":2.4580000000000002},"last":0.83299999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444191,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":327680,"data_stored":154436,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":5.5010000000000003,"15min":3.7109999999999999},"min":{"1min":0.46300000000000002,"5min":0.34499999999999997,"15min":0.313},"max":{"1min":17.585000000000001,"5min":91.042000000000002,"15min":91.042000000000002},"last":0.97599999999999998},{"interface":"front","average":{"1min":3.137,"5min":6.2519999999999998,"15min":4.9219999999999997},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.39800000000000002},"max":{"1min":13.849,"5min":88.256,"15min":115.06999999999999},"last":0.93799999999999994}]},{"osd":1,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":2.778,"15min":2.1619999999999999},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.32500000000000001},"max":{"1min":4.5449999999999999,"5min":21.131,"15min":30.702999999999999},"last":1.016},{"interface":"front","average":{"1min":2.3439999999999999,"5min":4.8090000000000002,"15min":3.8969999999999998},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.3860000000000001,"5min":86.691999999999993,"15min":114.93899999999999},"last":1.1259999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.9020000000000001,"15min":2.3180000000000001},"min":{"1min":0.46100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.282,"5min":21.013999999999999,"15min":30.670999999999999},"last":1.405},{"interface":"front","average":{"1min":2.9510000000000001,"5min":4.569,"15min":3.0659999999999998},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":17.640999999999998,"5min":62.164999999999999,"15min":68.652000000000001},"last":1.25}]},{"osd":3,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.3999999999999999,"5min":8.875,"15min":6.0069999999999997},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":11.361000000000001,"5min":219.733,"15min":219.733},"last":1.2010000000000001},{"interface":"front","average":{"1min":3.2280000000000002,"5min":4.7880000000000003,"15min":4.1319999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.4329999999999998,"5min":45.109999999999999,"15min":82.281000000000006},"last":1.5660000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1400000000000001,"15min":2.548},"min":{"1min":0.61799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.6210000000000004,"5min":21.064,"15min":30.870000000000001},"last":1.8069999999999999},{"interface":"front","average":{"1min":2.8809999999999998,"5min":4.2519999999999998,"15min":3.149},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":17.747,"5min":40.045000000000002,"15min":68.744},"last":1.633}]},{"osd":5,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2320000000000002,"5min":4.9969999999999999,"15min":3.3300000000000001},"min":{"1min":0.81000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":17.678000000000001,"5min":90.986999999999995,"15min":90.986999999999995},"last":1.502},{"interface":"front","average":{"1min":2.7949999999999999,"5min":5.0979999999999999,"15min":4.2149999999999999},"min":{"1min":0.91700000000000004,"5min":0.48499999999999999,"15min":0.35999999999999999},"max":{"1min":5.5149999999999997,"5min":88.194000000000003,"15min":115.137},"last":1.4450000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4460000000000002,"5min":3.2930000000000001,"15min":2.6640000000000001},"min":{"1min":0.65600000000000003,"5min":0.45800000000000002,"15min":0.438},"max":{"1min":9.5619999999999994,"5min":21.350000000000001,"15min":30.838999999999999},"last":1.665},{"interface":"front","average":{"1min":2.964,"5min":4.508,"15min":3.2879999999999998},"min":{"1min":0.53700000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":17.712,"5min":39.990000000000002,"15min":68.778000000000006},"last":1.768}]},{"osd":8,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":5.2249999999999996,"15min":4.3390000000000004},"min":{"1min":0.83699999999999997,"5min":0.52400000000000002,"15min":0.42999999999999999},"max":{"1min":5.46,"5min":88.147000000000006,"15min":115.03400000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.7650000000000001,"15min":2.9079999999999999},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.502},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.7370000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":7.8390000000000004,"5min":8.7539999999999996,"15min":5.71},"min":{"1min":0.79100000000000004,"5min":0.74399999999999999,"15min":0.58499999999999996},"max":{"1min":30.074000000000002,"5min":91.082999999999998,"15min":91.082999999999998},"last":1.5529999999999999},{"interface":"front","average":{"1min":3.1200000000000001,"5min":7.5270000000000001,"15min":5.5899999999999999},"min":{"1min":0.86599999999999999,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":10.238,"5min":130.30099999999999,"15min":130.30099999999999},"last":1.605}]},{"osd":10,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":3.3820000000000001,"15min":2.7930000000000001},"min":{"1min":0.752,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.7010000000000005,"5min":21.236999999999998,"15min":30.774000000000001},"last":1.8720000000000001},{"interface":"front","average":{"1min":3.028,"5min":4.8090000000000002,"15min":3.621},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":17.795999999999999,"5min":62.255000000000003,"15min":68.891000000000005},"last":1.6950000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":5.7510000000000003,"15min":4.6230000000000002},"min":{"1min":1.002,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":9.4730000000000008,"5min":88.225999999999999,"15min":114.999},"last":1.5309999999999999},{"interface":"front","average":{"1min":2.4870000000000001,"5min":3.597,"15min":2.9289999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":9.6639999999999997,"5min":21.199999999999999,"15min":30.808},"last":1.9359999999999999}]}]},{"osd":5,"up_from":17,"seq":73014444190,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357680,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":94014160,"statfs":{"total":96636764160,"available":96270499840,"internally_reserved":0,"allocated":1744896,"data_stored":3813836,"data_compressed":431039,"data_compressed_allocated":585728,"data_compressed_original":2867200,"omap_allocated":1595,"internal_metadata":364509637},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.0390000000000001,"15min":1.3999999999999999},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.26300000000000001},"max":{"1min":16.375,"5min":16.375,"15min":21.427},"last":0.80200000000000005},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.5379999999999998,"15min":1.6319999999999999},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":15.911,"5min":23.23,"15min":23.23},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.47299999999999998,"15min":0.54500000000000004},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":2.4430000000000001,"15min":14.186},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.46000000000000002,"15min":0.54500000000000004},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.835,"15min":14.391999999999999},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35799999999999998,"15min":0.379},"min":{"1min":0.246,"5min":0.188,"15min":0.188},"max":{"1min":0.45600000000000002,"5min":1.7629999999999999,"15min":2.5619999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.437,"5min":1.643,"15min":2.8940000000000001},"last":0.378}]},{"osd":3,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":4.46,"5min":2.6970000000000001,"15min":1.631},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":35.134,"5min":35.134,"15min":35.134},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.9460000000000002,"15min":1.786},"min":{"1min":0.47599999999999998,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":10.67,"5min":48.656999999999996,"15min":48.656999999999996},"last":0.94599999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56999999999999995,"15min":0.64700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27200000000000002},"max":{"1min":1.8029999999999999,"5min":1.905,"15min":14.831},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.34000000000000002,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":1.835,"5min":1.9670000000000001,"15min":14.846},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.8260000000000001,"15min":2.0169999999999999},"min":{"1min":0.44700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.5869999999999997,"5min":30.489000000000001,"15min":46.009999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":5.835,"5min":3.6000000000000001,"15min":2.738},"min":{"1min":0.41799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":31.315000000000001,"5min":36.401000000000003,"15min":67.126999999999995},"last":0.90100000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.27200000000000002},"max":{"1min":1.228,"5min":1.7769999999999999,"15min":14.211},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.621},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.309},"max":{"1min":1.2529999999999999,"5min":1.3959999999999999,"15min":14.241},"last":0.54100000000000004}]},{"osd":8,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88900000000000001,"5min":1.738,"15min":1.738},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":1.351,"15min":2.5870000000000002},"last":0.498}]},{"osd":9,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.6379999999999999,"15min":1.901},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":32.753999999999998,"5min":32.753999999999998,"15min":32.753999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":3.9740000000000002,"5min":2.8730000000000002,"15min":2.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":13.407,"5min":36.168999999999997,"15min":36.168999999999997},"last":0.91500000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":0.65900000000000003,"5min":1.4430000000000001,"15min":1.476},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":2.036,"15min":2.298},"last":0.628}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274380,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94097460,"statfs":{"total":96636764160,"available":96355799040,"internally_reserved":0,"allocated":331776,"data_stored":157118,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.313,"15min":0.33800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":0.372,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.373},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.33400000000000002,"15min":0.35199999999999998},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.39300000000000002,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.0299999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80800000000000005,"5min":1.325,"15min":1.325},"last":0.60899999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":3.101,"15min":1.9830000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":6.1020000000000003,"5min":31.25,"15min":31.25},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.133,"5min":2.1749999999999998,"15min":1.607},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":5.4619999999999997,"5min":23.829000000000001,"15min":23.829000000000001},"last":0.627}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42499999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":0.48399999999999999,"5min":1.177,"15min":1.371},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26000000000000001},"max":{"1min":1.2090000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":3.4660000000000002,"15min":2.738},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.0510000000000002,"5min":103.301,"15min":103.301},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.5049999999999999,"5min":2.4889999999999999,"15min":1.651},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":7.774,"5min":19.571000000000002,"15min":19.866},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45700000000000002,"15min":0.47999999999999998},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":0.61799999999999999,"5min":1.0720000000000001,"15min":1.3819999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.502,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":1.153,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":1.774,"15min":2.3029999999999999},"last":0.68899999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.6389999999999998,"15min":2.0550000000000002},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":7.9050000000000002,"5min":23.103000000000002,"15min":31.655999999999999},"last":0.872},{"interface":"front","average":{"1min":1.482,"5min":3.7919999999999998,"15min":2.1720000000000002},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":7.0039999999999996,"5min":65.191999999999993,"15min":65.191999999999993},"last":0.73499999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51300000000000001,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.628,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57499999999999996}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61399999999999999,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.7450000000000001,"15min":2.3250000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.63300000000000001}]}]},{"osd":3,"up_from":17,"seq":73014444190,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279944,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091896,"statfs":{"total":96636764160,"available":96350101504,"internally_reserved":0,"allocated":327680,"data_stored":154308,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4009999999999998,"5min":5.548,"15min":3.5800000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":20.800000000000001,"5min":46.143000000000001,"15min":46.143000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":5.774,"5min":6.4850000000000003,"15min":4.1550000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":36.734999999999999,"5min":79.581000000000003,"15min":79.581000000000003},"last":0.74399999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.8959999999999999,"5min":5.3330000000000002,"15min":3.5960000000000001},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":36.805999999999997,"5min":79.177000000000007,"15min":79.177000000000007},"last":1.016},{"interface":"front","average":{"1min":3.2669999999999999,"5min":3.5049999999999999,"15min":2.4329999999999998},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.27600000000000002},"max":{"1min":12.286,"5min":23.809999999999999,"15min":23.809999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":3.8820000000000001,"15min":2.7919999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":20.562000000000001,"5min":46.396999999999998,"15min":46.396999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":3.302,"5min":3.5,"15min":2.5649999999999999},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.37},"max":{"1min":12.374000000000001,"5min":23.866,"15min":23.866},"last":0.90600000000000003}]},{"osd":4,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1340000000000003,"5min":5.4550000000000001,"15min":3.742},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":36.771000000000001,"5min":79.043999999999997,"15min":79.043999999999997},"last":1.0800000000000001},{"interface":"front","average":{"1min":4.1699999999999999,"5min":4.3879999999999999,"15min":2.9750000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":20.638000000000002,"5min":46.530999999999999,"15min":46.530999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1269999999999998,"5min":5.3710000000000004,"15min":3.7719999999999998},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":36.646000000000001,"5min":79.094999999999999,"15min":79.094999999999999},"last":1.26},{"interface":"front","average":{"1min":4.2069999999999999,"5min":4.0679999999999996,"15min":2.9399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":20.765000000000001,"5min":46.567999999999998,"15min":46.567999999999998},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.629,"15min":2.6560000000000001},"min":{"1min":0.84599999999999997,"5min":0.55300000000000005,"15min":0.39500000000000002},"max":{"1min":13.209,"5min":23.776,"15min":23.776},"last":1.2350000000000001},{"interface":"front","average":{"1min":4.2469999999999999,"5min":5.6219999999999999,"15min":3.9750000000000001},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":36.840000000000003,"5min":79.140000000000001,"15min":79.140000000000001},"last":1.1599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.2770000000000001,"5min":4.1989999999999998,"15min":3.145},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":20.687999999999999,"5min":51.311,"15min":51.311},"last":1.1020000000000001},{"interface":"front","average":{"1min":3.4569999999999999,"5min":3.6499999999999999,"15min":2.79},"min":{"1min":0.73999999999999999,"5min":0.65000000000000002,"15min":0.436},"max":{"1min":13.279999999999999,"5min":23.745000000000001,"15min":23.745000000000001},"last":1.298}]},{"osd":9,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":6.2000000000000002,"5min":5.298,"15min":3.8900000000000001},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.41399999999999998},"max":{"1min":31.452000000000002,"5min":31.452000000000002,"15min":31.978999999999999},"last":1.347},{"interface":"front","average":{"1min":4.984,"5min":7.7460000000000004,"15min":5.452},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46300000000000002},"max":{"1min":37.411000000000001,"5min":79.388999999999996,"15min":79.388999999999996},"last":1.321}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.9279999999999999,"15min":3.0510000000000002},"min":{"1min":0.91000000000000003,"5min":0.73199999999999998,"15min":0.46000000000000002},"max":{"1min":13.244999999999999,"5min":23.838999999999999,"15min":31.469999999999999},"last":1.419},{"interface":"front","average":{"1min":4.7699999999999996,"5min":5.8140000000000001,"15min":4.1769999999999996},"min":{"1min":0.60499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.698,"5min":79.213999999999999,"15min":79.213999999999999},"last":1.361}]},{"osd":11,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4059999999999997,"5min":4.46,"15min":3.1960000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":20.728000000000002,"5min":51.438000000000002,"15min":51.438000000000002},"last":1.127},{"interface":"front","average":{"1min":3.456,"5min":3.855,"15min":3.0640000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.498},"max":{"1min":12.414,"5min":23.896999999999998,"15min":31.771999999999998},"last":1.3919999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444191,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231264,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94140576,"statfs":{"total":96636764160,"available":96399949824,"internally_reserved":0,"allocated":1662976,"data_stored":3219150,"data_compressed":397517,"data_compressed_allocated":540672,"data_compressed_original":2293760,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":2.3519999999999999,"15min":2.1890000000000001},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":24.849,"5min":29.721,"15min":115.97},"last":0.56499999999999995},{"interface":"front","average":{"1min":1.0029999999999999,"5min":2.4060000000000001,"15min":1.73},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9459999999999997,"5min":30.361999999999998,"15min":36.359999999999999},"last":0.66800000000000004}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41099999999999998,"15min":0.51800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57199999999999995,"5min":1.044,"15min":2.734},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42899999999999999,"15min":0.502},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":1.256,"15min":2.4340000000000002},"last":0.752}]},{"osd":3,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":2.6949999999999998,"15min":1.8560000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":3.8730000000000002,"5min":27.800000000000001,"15min":27.800000000000001},"last":0.5},{"interface":"front","average":{"1min":1.5640000000000001,"5min":2.7149999999999999,"15min":1.861},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.891,"5min":29.364999999999998,"15min":29.364999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47699999999999998,"15min":0.58299999999999996},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.089,"5min":1.3109999999999999,"15min":2.4729999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.23599999999999999},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.5419999999999998},"last":0.72999999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41199999999999998,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.534,"15min":2.903},"last":0.375},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.219},"max":{"1min":1.1120000000000001,"5min":1.6479999999999999,"15min":2.1869999999999998},"last":0.52100000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.9350000000000001,"15min":1.5680000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.6799999999999997,"5min":16.079000000000001,"15min":16.079000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.786,"5min":1.921,"15min":1.5880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.432},"max":{"1min":10.737,"5min":16.065000000000001,"15min":16.065000000000001},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.119,"15min":2.5470000000000002},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.755,"5min":1.6639999999999999,"15min":2.6259999999999999},"last":0.61599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":1.3280000000000001,"5min":1.889,"15min":1.972},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":1.2390000000000001,"15min":1.8720000000000001},"last":0.47099999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.8450000000000002,"5min":5.1509999999999998,"15min":3.113},"min":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.40500000000000003},"max":{"1min":8.5630000000000006,"5min":118.07299999999999,"15min":118.07299999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.524,"5min":2.464,"15min":1.8600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.0650000000000004,"5min":18.303000000000001,"15min":25.349},"last":0.59499999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65800000000000003,"15min":0.72999999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.595,"15min":2.6739999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.68500000000000005},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":1.369,"15min":2.5110000000000001},"last":0.80100000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0489999999999999,"5min":1.837,"15min":2.9380000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":1.5009999999999999,"15min":2.9100000000000001},"last":0.57999999999999996}]}]},{"osd":1,"up_from":17,"seq":73014444191,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225796,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94146044,"statfs":{"total":96636764160,"available":96405549056,"internally_reserved":0,"allocated":323584,"data_stored":152854,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":230881735},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.671,"15min":1.54},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":4.1130000000000004,"5min":21.425000000000001,"15min":26.550000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.1819999999999999,"5min":2.1509999999999998,"15min":1.5820000000000001},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":6.2539999999999996,"5min":26.841999999999999,"15min":31.741},"last":0.621}]},{"osd":2,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40999999999999998,"15min":0.625},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":1.155,"5min":2.1970000000000001,"15min":58.337000000000003},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":1.046,"5min":2.3119999999999998,"15min":60.276000000000003},"last":0.49099999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.1629999999999998,"15min":1.6240000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":7.1200000000000001,"5min":16.724,"15min":30.460000000000001},"last":0.438},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.347,"15min":1.6659999999999999},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":8.2010000000000005,"5min":19.312999999999999,"15min":20.971},"last":0.54800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.378},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"min":{"1min":0.25,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0049999999999999,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.28799999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0229999999999999,"5min":1.8660000000000001,"15min":58.32},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.71199999999999997},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.236,"5min":2.3740000000000001,"15min":60.185000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":4.3849999999999998,"15min":3.1389999999999998},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.33300000000000002},"max":{"1min":8.3200000000000003,"5min":98.299999999999997,"15min":98.299999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.7290000000000001,"5min":2.7010000000000001,"15min":1.879},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":12.612,"5min":24.501999999999999,"15min":24.501999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.02,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49399999999999999,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":2.161,"15min":2.161},"last":0.38700000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3740000000000001,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55600000000000005,"15min":0.60699999999999998},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.33700000000000002},"max":{"1min":1.073,"5min":1.286,"15min":3.637},"last":0.57799999999999996}]},{"osd":9,"last update":"Wed Feb 21 07:57:53 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":4.5640000000000001,"15min":2.9159999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.433},"max":{"1min":6.5940000000000003,"5min":91.182000000000002,"15min":91.182000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":2.423,"5min":3.081,"15min":2.1869999999999998},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.45500000000000002},"max":{"1min":14.013999999999999,"5min":32.460999999999999,"15min":32.460999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":1.242,"15min":1.242},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":1.0780000000000001},"last":0.56399999999999995}]}]},{"osd":0,"up_from":17,"seq":73014444191,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266064,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":94105776,"statfs":{"total":96636764160,"available":96364314624,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":3.3580000000000001,"15min":2.238},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.249},"max":{"1min":6.6929999999999996,"5min":54.454999999999998,"15min":54.454999999999998},"last":0.624},{"interface":"front","average":{"1min":2.355,"5min":3.1000000000000001,"15min":2.4830000000000001},"min":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.27400000000000002},"max":{"1min":15.474,"5min":27.855,"15min":67.233999999999995},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":4.016,"5min":3.4220000000000002,"15min":2.2530000000000001},"min":{"1min":0.34899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":34.563000000000002,"5min":34.563000000000002,"15min":34.563000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":3.532,"5min":3.7469999999999999,"15min":2.4390000000000001},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":32.026000000000003,"5min":54.421999999999997,"15min":54.421999999999997},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.786,"5min":5.3559999999999999,"15min":3.7480000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":16.306000000000001,"5min":79.024000000000001,"15min":79.024000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":5.343,"5min":5.181,"15min":3.3759999999999999},"min":{"1min":0.71499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":45.561999999999998,"5min":79.706999999999994,"15min":79.706999999999994},"last":0.74199999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1200000000000001,"5min":3.5680000000000001,"15min":2.4420000000000002},"min":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.39000000000000001},"max":{"1min":10.544,"5min":54.353000000000002,"15min":54.353000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":2.569,"5min":3.1429999999999998,"15min":2.7090000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":15.821999999999999,"5min":27.782,"15min":67.313000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":5.2709999999999999,"15min":3.9119999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":15.978,"5min":79.078000000000003,"15min":79.078000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":4.4340000000000002,"5min":7.2489999999999997,"15min":4.5309999999999997},"min":{"1min":0.66400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":17.498000000000001,"5min":86.691999999999993,"15min":86.691999999999993},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":3.3980000000000001,"15min":2.6030000000000002},"min":{"1min":0.51300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.2089999999999996,"5min":32.107999999999997,"15min":32.107999999999997},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.169,"5min":3.7080000000000002,"15min":2.625},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":10.457000000000001,"5min":54.386000000000003,"15min":54.386000000000003},"last":0.83899999999999997}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.681,"5min":3.7229999999999999,"15min":3.1080000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.439},"max":{"1min":16.138999999999999,"5min":27.902999999999999,"15min":67.387},"last":0.76900000000000002},{"interface":"front","average":{"1min":2.661,"5min":3.609,"15min":2.7909999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.437},"max":{"1min":8.2479999999999993,"5min":31.966999999999999,"15min":31.966999999999999},"last":0.81200000000000006}]},{"osd":9,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":6.0140000000000002,"15min":4.4189999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.45200000000000001},"max":{"1min":10.692,"5min":40.402000000000001,"15min":152.25700000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":4.9989999999999997,"5min":6.6079999999999997,"15min":4.4859999999999998},"min":{"1min":0.70599999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"max":{"1min":19.376999999999999,"5min":111.746,"15min":111.746},"last":1.2030000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":4.0259999999999998,"15min":2.8439999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.503},"max":{"1min":10.574,"5min":54.490000000000002,"15min":54.490000000000002},"last":0.98199999999999998},{"interface":"front","average":{"1min":3.577,"5min":3.8639999999999999,"15min":3.2440000000000002},"min":{"1min":0.78700000000000003,"5min":0.60099999999999998,"15min":0.54000000000000004},"max":{"1min":16.544,"5min":27.821000000000002,"15min":67.423000000000002},"last":1.0740000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":4.4470000000000001,"15min":3.0499999999999998},"min":{"1min":0.85999999999999999,"5min":0.71999999999999997,"15min":0.58699999999999997},"max":{"1min":10.599,"5min":54.298000000000002,"15min":54.298000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0149999999999997,"15min":3.3460000000000001},"min":{"1min":0.82599999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"max":{"1min":16.344999999999999,"5min":28.864999999999998,"15min":67.454999999999998},"last":1.1160000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1347584,"data_stored":3066968,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1359872,"data_stored":3067190,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:58:22.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:58:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.893+0000 7f2f83600640 1 Processor -- start 2024-02-21T07:58:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.893+0000 7f2f83600640 1 -- start start 2024-02-21T07:58:22.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.895+0000 7f2f83600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f7c183f70 0x7f2f7c1844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.895+0000 7f2f83600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c187520 con 0x7f2f7c06ec10 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.895+0000 7f2f83600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0cbb00 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.895+0000 7f2f83600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c06e390 con 0x7f2f7c183f70 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f80c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2f7c183f70 0x7f2f7c1844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f81600640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f2f7c06ec10 0x7f2f7c0ca5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48860/0 (socket says 172.21.15.100:48860) 2024-02-21T07:58:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f81600640 1 -- 172.21.15.100:0/3233442855 learned_addr learned my addr 172.21.15.100:0/3233442855 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580501896 0 0) 0x7f2f7c187520 con 0x7f2f7c06ec10 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f60003520 con 0x7f2f7c06ec10 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429680100 0 0) 0x7f2f7c0cbb00 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f7c187520 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f80c00640 1 -- 172.21.15.100:0/3233442855 >> v1:172.21.15.170:6789/0 conn(0x7f2f7c06e7b0 legacy=0x7f2f7c0f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f80c00640 1 -- 172.21.15.100:0/3233442855 >> v1:172.21.15.156:6789/0 conn(0x7f2f7c06ec10 legacy=0x7f2f7c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.896+0000 7f2f80c00640 1 -- 172.21.15.100:0/3233442855 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0cb820 con 0x7f2f7c183f70 2024-02-21T07:58:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.898+0000 7f2f80c00640 1 --2- 172.21.15.100:0/3233442855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1844e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097a0 tx=0x7f2f6c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dc10fba04db6bff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.898+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c02e070 con 0x7f2f7c183f70 2024-02-21T07:58:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.898+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0315a0 con 0x7f2f7c183f70 2024-02-21T07:58:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.898+0000 7f2f7be00640 1 -- 172.21.15.100:0/3233442855 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c031910 con 0x7f2f7c183f70 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 -- 172.21.15.100:0/3233442855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c183f70 msgr2=0x7f2f7c1844e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 --2- 172.21.15.100:0/3233442855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1844e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097a0 tx=0x7f2f6c02b840 comp rx=0 tx=0).stop 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 -- 172.21.15.100:0/3233442855 shutdown_connections 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 --2- 172.21.15.100:0/3233442855 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1844e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 -- 172.21.15.100:0/3233442855 >> 172.21.15.100:0/3233442855 conn(0x7f2f7c0ce160 msgr2=0x7f2f7c0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 -- 172.21.15.100:0/3233442855 shutdown_connections 2024-02-21T07:58:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.899+0000 7f2f83600640 1 -- 172.21.15.100:0/3233442855 wait complete. 2024-02-21T07:58:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.901+0000 7f2f83600640 1 Processor -- start 2024-02-21T07:58:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.901+0000 7f2f83600640 1 -- start start 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c06ec10 0x7f2f7c168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1878d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0cf080 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c17ba00 con 0x7f2f7c06ec10 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f83600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c169300 con 0x7f2f7c183f70 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f80c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f73e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c06ec10 0x7f2f7c168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f80c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54750/0 (socket says 172.21.15.100:54750) 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.903+0000 7f2f80c00640 1 -- 172.21.15.100:0/3592801551 learned_addr learned my addr 172.21.15.100:0/3592801551 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f81600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 -- 172.21.15.100:0/3592801551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7c183f70 msgr2=0x7f2f7c1878d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1878d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 -- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c06ec10 msgr2=0x7f2f7c168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c06ec10 0x7f2f7c168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 -- 172.21.15.100:0/3592801551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009400 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f80c00640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034040 tx=0x7f2f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.904+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032840 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.905+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c031f00 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.905+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032ba0 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.905+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c17a680 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.905+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c17ac40 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.906+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c067c80 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.908+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2f6c032d00 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.910+0000 7f2f79600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 0x7f2f580a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.910+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2f6c0eb590 con 0x7f2f7c06e7b0 2024-02-21T07:58:22.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.910+0000 7f2f73e00640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 0x7f2f580a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:22.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.911+0000 7f2f73e00640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 0x7f2f580a1590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:22.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:22.914+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f6c0b5280 con 0x7f2f7c06e7b0 2024-02-21T07:58:23.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.110+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f7c0ed570 con 0x7f2f7c06e7b0 2024-02-21T07:58:23.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.113+0000 7f2f79600640 1 -- 172.21.15.100:0/3592801551 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7f2f6c0b71b0 con 0x7f2f7c06e7b0 2024-02-21T07:58:23.115 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:23.115 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 msgr2=0x7f2f580a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 0x7f2f580a1590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64009040 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 msgr2=0x7f2f7c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034040 tx=0x7f2f6c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 shutdown_connections 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f7c183f70 0x7f2f7c1878d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f7c06ec10 0x7f2f7c168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2f5809f0d0 0x7f2f580a1590 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 --2- 172.21.15.100:0/3592801551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c06e7b0 0x7f2f7c0ceb40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 >> 172.21.15.100:0/3592801551 conn(0x7f2f7c0ce160 msgr2=0x7f2f7c0c8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.116+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 shutdown_connections 2024-02-21T07:58:23.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:23.117+0000 7f2f83600640 1 -- 172.21.15.100:0/3592801551 wait complete. 2024-02-21T07:58:24.141 INFO:tasks.ceph:Scrubbing osd.0 2024-02-21T07:58:24.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.366+0000 7fb96c600640 1 Processor -- start 2024-02-21T07:58:24.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.366+0000 7fb96c600640 1 -- start start 2024-02-21T07:58:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.368+0000 7fb96c600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640d5c90 con 0x7fb964182570 2024-02-21T07:58:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.368+0000 7fb96c600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb964182e00 con 0x7fb96406c440 2024-02-21T07:58:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.368+0000 7fb96c600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9641898b0 con 0x7fb964182950 2024-02-21T07:58:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.368+0000 7fb969c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb964182570 0x7fb9641891a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56540/0 (socket says 172.21.15.100:56540) 2024-02-21T07:58:24.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.368+0000 7fb969c00640 1 -- 172.21.15.100:0/1812873100 learned_addr learned my addr 172.21.15.100:0/1812873100 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:24.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920743101 0 0) 0x7fb9640d5c90 con 0x7fb964182570 2024-02-21T07:58:24.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb94c003520 con 0x7fb964182570 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924885273 0 0) 0x7fb964182e00 con 0x7fb96406c440 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9640d5c90 con 0x7fb96406c440 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899599215 0 0) 0x7fb9641898b0 con 0x7fb964182950 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb964182e00 con 0x7fb964182950 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3108466748 0 0) 0x7fb964182e00 con 0x7fb964182950 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 >> v1:172.21.15.156:6789/0 conn(0x7fb96406c440 legacy=0x7fb9640d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 >> v1:172.21.15.100:6789/0 conn(0x7fb964182570 legacy=0x7fb9641891a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96406ac90 con 0x7fb964182950 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7fb950001590 con 0x7fb964182950 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 >> v1:172.21.15.170:6789/0 conn(0x7fb964182950 legacy=0x7fb96406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb94c004d70 0x7fb94c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c003820 0x7fb94c003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.369+0000 7fb963e00640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 0x7fb94c00bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c001590 con 0x7fb94c004d70 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c00c320 con 0x7fb94c003820 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c00c4e0 con 0x7fb94c009970 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb969c00640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb94c004d70 0x7fb94c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 0x7fb94c00bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb969200640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c003820 0x7fb94c003ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 -- 172.21.15.100:0/1812873100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c003820 msgr2=0x7fb94c003ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c003820 0x7fb94c003ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 -- 172.21.15.100:0/1812873100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb94c004d70 msgr2=0x7fb94c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb94c004d70 0x7fb94c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb96a600640 1 -- 172.21.15.100:0/1812873100 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964182e00 con 0x7fb94c009970 2024-02-21T07:58:24.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.370+0000 7fb969c00640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb94c004d70 0x7fb94c005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:24.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.371+0000 7fb96a600640 1 -- 172.21.15.100:0/1812873100 reap_dead start 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.371+0000 7fb96a600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 0x7fb94c00bd60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c320 tx=0x7fb94c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef1faf605617fcf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.372+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c02cc20 con 0x7fb94c009970 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.372+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c02cd80 con 0x7fb94c009970 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.372+0000 7fb963e00640 1 -- 172.21.15.100:0/1812873100 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003bb0 con 0x7fb94c009970 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.372+0000 7fb96c600640 1 -- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 msgr2=0x7fb94c00bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.372+0000 7fb96c600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 0x7fb94c00bd60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c320 tx=0x7fb94c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.373+0000 7fb96c600640 1 -- 172.21.15.100:0/1812873100 shutdown_connections 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.373+0000 7fb96c600640 1 --2- 172.21.15.100:0/1812873100 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb94c009970 0x7fb94c00bd60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.373+0000 7fb96c600640 1 -- 172.21.15.100:0/1812873100 >> 172.21.15.100:0/1812873100 conn(0x7fb9640d26f0 msgr2=0x7fb9640d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.373+0000 7fb96c600640 1 -- 172.21.15.100:0/1812873100 shutdown_connections 2024-02-21T07:58:24.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.373+0000 7fb96c600640 1 -- 172.21.15.100:0/1812873100 wait complete. 2024-02-21T07:58:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.375+0000 7fb96c600640 1 Processor -- start 2024-02-21T07:58:24.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.375+0000 7fb96c600640 1 -- start start 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 0x7fb964163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9640cdce0 0x7fb9640ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb964187620 0x7fb964187aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640ce6a0 con 0x7fb964187620 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640ce900 con 0x7fb94c009970 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96c600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640cebe0 con 0x7fb9640cdce0 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb96a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb964187620 0x7fb964187aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.376+0000 7fb969c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 0x7fb964163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 0x7fb964163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46352/0 (socket says 172.21.15.100:46352) 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 -- 172.21.15.100:0/624008847 learned_addr learned my addr 172.21.15.100:0/624008847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969200640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9640cdce0 0x7fb9640ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 -- 172.21.15.100:0/624008847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9640cdce0 msgr2=0x7fb9640ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb9640cdce0 0x7fb9640ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 -- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb964187620 msgr2=0x7fb964187aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb964187620 0x7fb964187aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640ceec0 con 0x7fb94c009970 2024-02-21T07:58:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.377+0000 7fb969c00640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 0x7fb964163e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb958007290 tx=0x7fb958007750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.378+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958001d30 con 0x7fb94c009970 2024-02-21T07:58:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.378+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800f940 con 0x7fb94c009970 2024-02-21T07:58:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.378+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800fcd0 con 0x7fb94c009970 2024-02-21T07:58:24.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.378+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640cf1a0 con 0x7fb94c009970 2024-02-21T07:58:24.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.378+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb964187100 con 0x7fb94c009970 2024-02-21T07:58:24.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.379+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb96406b530 con 0x7fb94c009970 2024-02-21T07:58:24.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.381+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb958027430 con 0x7fb94c009970 2024-02-21T07:58:24.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.382+0000 7fb961600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb94409f0a0 0x7fb9440a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.382+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb9580ca5b0 con 0x7fb94c009970 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb969200640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb94409f0a0 0x7fb9440a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb961600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7fb9440a9bd0 0x7fb9440ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9440ac740 con 0x7fb9440a9bd0 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9580ca920 con 0x7fb94c009970 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb96a600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7fb9440a9bd0 0x7fb9440ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.383+0000 7fb969200640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb94409f0a0 0x7fb9440a1560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb9500016c0 tx=0x7fb9500014d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.384+0000 7fb96a600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7fb9440a9bd0 0x7fb9440ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.384+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== osd.0 v2:172.21.15.100:6800/2845630909 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb9440ac740 con 0x7fb9440a9bd0 2024-02-21T07:58:24.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.400+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 --> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb96406b250 con 0x7fb9440a9bd0 2024-02-21T07:58:24.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.401+0000 7fb961600640 1 -- 172.21.15.100:0/624008847 <== osd.0 v2:172.21.15.100:6800/2845630909 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb95c03c040 con 0x7fb9440a9bd0 2024-02-21T07:58:24.402 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:24.402 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:24.402 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.401+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7fb9440a9bd0 msgr2=0x7fb9440ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.401+0000 7fb96c600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.100:6800/2845630909,v1:172.21.15.100:6801/2845630909] conn(0x7fb9440a9bd0 0x7fb9440ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb94409f0a0 msgr2=0x7fb9440a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fb94409f0a0 0x7fb9440a1560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb9500016c0 tx=0x7fb9500014d0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 msgr2=0x7fb964163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 --2- 172.21.15.100:0/624008847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb94c009970 0x7fb964163e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb958007290 tx=0x7fb958007750 comp rx=0 tx=0).stop 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96a600640 1 -- 172.21.15.100:0/624008847 reap_dead start 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 shutdown_connections 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 >> 172.21.15.100:0/624008847 conn(0x7fb9640d26f0 msgr2=0x7fb9641703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 shutdown_connections 2024-02-21T07:58:24.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.402+0000 7fb96c600640 1 -- 172.21.15.100:0/624008847 wait complete. 2024-02-21T07:58:24.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-21T07:58:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.605+0000 7f5c23c00640 1 Processor -- start 2024-02-21T07:58:24.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.606+0000 7f5c23c00640 1 -- start start 2024-02-21T07:58:24.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.607+0000 7f5c23c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c1c06ab60 0x7f5c1c1871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.607+0000 7f5c23c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 0x7f5c1c18a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c23c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c1c0ca6a0 con 0x7f5c1c189ca0 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c23c00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c187700 con 0x7f5c1c18a080 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c23c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c0f6200 con 0x7f5c1c06ab60 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c21c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 0x7f5c1c18a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1be00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5c1c06ab60 0x7f5c1c1871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c21200640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5c1c189ca0 0x7f5c1c0cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:44164/0 (socket says 172.21.15.100:44164) 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c21200640 1 -- 172.21.15.100:0/3239539452 learned_addr learned my addr 172.21.15.100:0/3239539452 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c21c00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 0x7f5c1c18a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46368/0 (socket says 172.21.15.100:46368) 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1be00640 1 -- 172.21.15.100:0/3239539452 >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 msgr2=0x7f5c1c18a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1be00640 1 --2- 172.21.15.100:0/3239539452 >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 0x7f5c1c18a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1be00640 1 -- 172.21.15.100:0/3239539452 >> v1:172.21.15.170:6789/0 conn(0x7f5c1c189ca0 legacy=0x7f5c1c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1be00640 1 -- 172.21.15.100:0/3239539452 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c06afc0 con 0x7f5c1c06ab60 2024-02-21T07:58:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.608+0000 7f5c1b400640 1 -- 172.21.15.100:0/3239539452 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923849409 0 0) 0x7f5c1c0ca6a0 con 0x7f5c1c189ca0 2024-02-21T07:58:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.610+0000 7f5c1be00640 1 --2- 172.21.15.100:0/3239539452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c1871c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c067a70 tx=0x7f5c0802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d62dec896c0329 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.610+0000 7f5c1b400640 1 -- 172.21.15.100:0/3239539452 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031830 con 0x7f5c1c06ab60 2024-02-21T07:58:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.610+0000 7f5c1b400640 1 -- 172.21.15.100:0/3239539452 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c08031990 con 0x7f5c1c06ab60 2024-02-21T07:58:24.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.610+0000 7f5c1b400640 1 -- 172.21.15.100:0/3239539452 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08031d20 con 0x7f5c1c06ab60 2024-02-21T07:58:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 -- 172.21.15.100:0/3239539452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c06ab60 msgr2=0x7f5c1c1871c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 --2- 172.21.15.100:0/3239539452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c1871c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c067a70 tx=0x7f5c0802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 -- 172.21.15.100:0/3239539452 shutdown_connections 2024-02-21T07:58:24.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 --2- 172.21.15.100:0/3239539452 >> v2:172.21.15.156:3300/0 conn(0x7f5c1c18a080 0x7f5c1c18a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 --2- 172.21.15.100:0/3239539452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c1871c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 -- 172.21.15.100:0/3239539452 >> 172.21.15.100:0/3239539452 conn(0x7f5c1c0668b0 msgr2=0x7f5c1c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 -- 172.21.15.100:0/3239539452 shutdown_connections 2024-02-21T07:58:24.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.611+0000 7f5c23c00640 1 -- 172.21.15.100:0/3239539452 wait complete. 2024-02-21T07:58:24.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.613+0000 7f5c23c00640 1 Processor -- start 2024-02-21T07:58:24.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.613+0000 7f5c23c00640 1 -- start start 2024-02-21T07:58:24.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c189ca0 0x7f5c1c180ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 0x7f5c1c16df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c17fb50 con 0x7f5c1c189ca0 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c17fe30 con 0x7f5c1c06ab60 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.614+0000 7f5c23c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c180110 con 0x7f5c1c18a080 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c1be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c189ca0 0x7f5c1c180ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 0x7f5c1c16df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46376/0 (socket says 172.21.15.100:46376) 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21200640 1 -- 172.21.15.100:0/220641329 learned_addr learned my addr 172.21.15.100:0/220641329 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 -- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 msgr2=0x7f5c1c21a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 -- 172.21.15.100:0/220641329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c189ca0 msgr2=0x7f5c1c180ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c189ca0 0x7f5c1c180ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 -- 172.21.15.100:0/220641329 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c08009400 con 0x7f5c1c18a080 2024-02-21T07:58:24.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21200640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:24.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.615+0000 7f5c21c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 0x7f5c1c16df80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400eba0 tx=0x7f5c1400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.616+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400cd20 con 0x7f5c1c18a080 2024-02-21T07:58:24.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.616+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1400f040 con 0x7f5c1c18a080 2024-02-21T07:58:24.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.616+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c1803f0 con 0x7f5c1c18a080 2024-02-21T07:58:24.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.616+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140146c0 con 0x7f5c1c18a080 2024-02-21T07:58:24.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.616+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c1809b0 con 0x7f5c1c18a080 2024-02-21T07:58:24.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.617+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c08e1c0 con 0x7f5c1c18a080 2024-02-21T07:58:24.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.619+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5c14014820 con 0x7f5c1c18a080 2024-02-21T07:58:24.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.620+0000 7f5c18c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 0x7f5bfc0a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.621+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c140cace0 con 0x7f5c1c18a080 2024-02-21T07:58:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.621+0000 7f5c21200640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 0x7f5bfc0a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:24.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.622+0000 7f5c21200640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 0x7f5bfc0a14e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c10007b10 tx=0x7f5c10007a60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:24.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.623+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c14094b10 con 0x7f5c1c18a080 2024-02-21T07:58:24.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.822+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c1c0cabb0 con 0x7f5bfc09f020 2024-02-21T07:58:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.823+0000 7f5c18c00640 1 -- 172.21.15.100:0/220641329 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5c10004aa0 con 0x7f5bfc09f020 2024-02-21T07:58:24.824 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 msgr2=0x7f5bfc0a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 0x7f5bfc0a14e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c10007b10 tx=0x7f5c10007a60 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 msgr2=0x7f5c1c16df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 0x7f5c1c16df80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400eba0 tx=0x7f5c1400c490 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 shutdown_connections 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5c1c18a080 0x7f5c1c16df80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5bfc09f020 0x7f5bfc0a14e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c1c189ca0 0x7f5c1c180ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 --2- 172.21.15.100:0/220641329 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5c1c06ab60 0x7f5c1c21a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 >> 172.21.15.100:0/220641329 conn(0x7f5c1c0668b0 msgr2=0x7f5c1c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 shutdown_connections 2024-02-21T07:58:24.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:24.826+0000 7f5c23c00640 1 -- 172.21.15.100:0/220641329 wait complete. 2024-02-21T07:58:24.846 INFO:tasks.ceph:Scrubbing osd.3 2024-02-21T07:58:24.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:25.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.043+0000 7f71f0c00640 1 Processor -- start 2024-02-21T07:58:25.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.043+0000 7f71f0c00640 1 -- start start 2024-02-21T07:58:25.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.046+0000 7f71f0c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec189890 con 0x7f71ec18be10 2024-02-21T07:58:25.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.046+0000 7f71f0c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0fbd30 con 0x7f71ec0fd170 2024-02-21T07:58:25.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.046+0000 7f71f0c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0fc5d0 con 0x7f71ec0d5f70 2024-02-21T07:58:25.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.046+0000 7f71eb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f71ec18be10 0x7f71ec0fca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56556/0 (socket says 172.21.15.100:56556) 2024-02-21T07:58:25.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.046+0000 7f71eb400640 1 -- 172.21.15.100:0/2358818813 learned_addr learned my addr 172.21.15.100:0/2358818813 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104724254 0 0) 0x7f71ec0fbd30 con 0x7f71ec0fd170 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d0003520 con 0x7f71ec0fd170 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244538940 0 0) 0x7f71ec189890 con 0x7f71ec18be10 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ec0fbd30 con 0x7f71ec18be10 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988923026 0 0) 0x7f71ec0fc5d0 con 0x7f71ec0d5f70 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ec189890 con 0x7f71ec0d5f70 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.1 v1:172.21.15.156:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2680555279 0 0) 0x7f71d0003520 con 0x7f71ec0fd170 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 >> v1:172.21.15.170:6789/0 conn(0x7f71ec0d5f70 legacy=0x7f71ec18c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 >> v1:172.21.15.100:6789/0 conn(0x7f71ec18be10 legacy=0x7f71ec0fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> v1:172.21.15.156:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0d63a0 con 0x7f71ec0fd170 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.1 v1:172.21.15.156:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7f71d8001670 con 0x7f71ec0fd170 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 >> v1:172.21.15.156:6789/0 conn(0x7f71ec0fd170 legacy=0x7f71ec0d5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004d20 0x7f71d0005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71d00037d0 0x7f71d0003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 0x7f71d000ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d000c2b0 con 0x7f71d00037d0 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d000c420 con 0x7f71d0004d20 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.047+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d000c5e0 con 0x7f71d0004360 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71eb400640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004d20 0x7f71d0005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 0x7f71d000ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71eaa00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71d00037d0 0x7f71d0003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 -- 172.21.15.100:0/2358818813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004d20 msgr2=0x7f71d0005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004d20 0x7f71d0005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 -- 172.21.15.100:0/2358818813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71d00037d0 msgr2=0x7f71d0003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:25.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71d00037d0 0x7f71d0003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.048+0000 7f71ebe00640 1 -- 172.21.15.100:0/2358818813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0d63a0 con 0x7f71d0004360 2024-02-21T07:58:25.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.049+0000 7f71ebe00640 1 -- 172.21.15.100:0/2358818813 reap_dead start 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.049+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 0x7f71d000ba20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001f20 tx=0x7f71d00057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6c2e505cfb01ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.049+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4003b70 con 0x7f71d0004360 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.049+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4003cd0 con 0x7f71d0004360 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.049+0000 7f71ea000640 1 -- 172.21.15.100:0/2358818813 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4005310 con 0x7f71d0004360 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 -- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 msgr2=0x7f71d000ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 0x7f71d000ba20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f71e4001f20 tx=0x7f71d00057f0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 -- 172.21.15.100:0/2358818813 shutdown_connections 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 --2- 172.21.15.100:0/2358818813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71d0004360 0x7f71d000ba20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 -- 172.21.15.100:0/2358818813 >> 172.21.15.100:0/2358818813 conn(0x7f71ec0fdf30 msgr2=0x7f71ec0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 -- 172.21.15.100:0/2358818813 shutdown_connections 2024-02-21T07:58:25.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.050+0000 7f71f0c00640 1 -- 172.21.15.100:0/2358818813 wait complete. 2024-02-21T07:58:25.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.052+0000 7f71f0c00640 1 Processor -- start 2024-02-21T07:58:25.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.052+0000 7f71f0c00640 1 -- start start 2024-02-21T07:58:25.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004360 0x7f71ec0f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec181440 0x7f71ec18a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 0x7f71ec221930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1818c0 con 0x7f71ec18a600 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec189c30 con 0x7f71d0004360 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71f0c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0f9360 con 0x7f71ec181440 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 0x7f71ec221930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 0x7f71ec221930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54796/0 (socket says 172.21.15.100:54796) 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 -- 172.21.15.100:0/2641812528 learned_addr learned my addr 172.21.15.100:0/2641812528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71eb400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004360 0x7f71ec0f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71eaa00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec181440 0x7f71ec18a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 -- 172.21.15.100:0/2641812528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec181440 msgr2=0x7f71ec18a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec181440 0x7f71ec18a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 -- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004360 msgr2=0x7f71ec0f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004360 0x7f71ec0f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71ebe00640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0f9640 con 0x7f71ec18a600 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71eb400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71d0004360 0x7f71ec0f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:25.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.054+0000 7f71eaa00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71ec181440 0x7f71ec18a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71ebe00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 0x7f71ec221930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f71e4002010 tx=0x7f71e402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e40056f0 con 0x7f71ec18a600 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4005850 con 0x7f71ec18a600 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e402d6b0 con 0x7f71ec18a600 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec0f9920 con 0x7f71ec18a600 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.055+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec0f9ee0 con 0x7f71ec18a600 2024-02-21T07:58:25.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.056+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71ec0fbf80 con 0x7f71ec18a600 2024-02-21T07:58:25.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.058+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f71e402d810 con 0x7f71ec18a600 2024-02-21T07:58:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.059+0000 7f71e3400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71cc09f0d0 0x7f71cc0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.059+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f71e4003e40 con 0x7f71ec18a600 2024-02-21T07:58:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71eb400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71cc09f0d0 0x7f71cc0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71e3400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7f71cc0a9c10 0x7f71cc0ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71cc0ac780 con 0x7f71cc0a9c10 2024-02-21T07:58:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e40ebb80 con 0x7f71ec18a600 2024-02-21T07:58:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71eaa00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7f71cc0a9c10 0x7f71cc0ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.060+0000 7f71eb400640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71cc09f0d0 0x7f71cc0a1590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000c00 tx=0x7f71dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.061+0000 7f71eaa00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7f71cc0a9c10 0x7f71cc0ac0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.061+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== osd.3 v2:172.21.15.100:6817/2187722631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f71cc0ac780 con 0x7f71cc0a9c10 2024-02-21T07:58:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.076+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 --> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71ec0d68d0 con 0x7f71cc0a9c10 2024-02-21T07:58:25.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71e3400640 1 -- 172.21.15.100:0/2641812528 <== osd.3 v2:172.21.15.100:6817/2187722631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f71d8001610 con 0x7f71cc0a9c10 2024-02-21T07:58:25.078 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:25.078 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:25.078 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7f71cc0a9c10 msgr2=0x7f71cc0ac0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:6817/2187722631,v1:172.21.15.100:6818/2187722631] conn(0x7f71cc0a9c10 0x7f71cc0ac0b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71cc09f0d0 msgr2=0x7f71cc0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f71cc09f0d0 0x7f71cc0a1590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71dc000c00 tx=0x7f71dc009040 comp rx=0 tx=0).stop 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 msgr2=0x7f71ec221930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71f0c00640 1 --2- 172.21.15.100:0/2641812528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71ec18a600 0x7f71ec221930 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f71e4002010 tx=0x7f71e402e000 comp rx=0 tx=0).stop 2024-02-21T07:58:25.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.077+0000 7f71ebe00640 1 -- 172.21.15.100:0/2641812528 reap_dead start 2024-02-21T07:58:25.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.078+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 shutdown_connections 2024-02-21T07:58:25.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.078+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 >> 172.21.15.100:0/2641812528 conn(0x7f71ec0fdf30 msgr2=0x7f71ec0d4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.078+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 shutdown_connections 2024-02-21T07:58:25.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.078+0000 7f71f0c00640 1 -- 172.21.15.100:0/2641812528 wait complete. 2024-02-21T07:58:25.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-21T07:58:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.284+0000 7fe800000640 1 Processor -- start 2024-02-21T07:58:25.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.284+0000 7fe800000640 1 -- start start 2024-02-21T07:58:25.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe800000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7f806ab60 0x7fe7f80f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe800000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f808bfe0 con 0x7fe7f8188ab0 2024-02-21T07:58:25.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe800000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f808c880 con 0x7fe7f80f9ef0 2024-02-21T07:58:25.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe800000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f808d420 con 0x7fe7f806ab60 2024-02-21T07:58:25.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe7fcc00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe7f806ab60 0x7fe7f80f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe7fd600640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7fe7f8188ab0 0x7fe7f808cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48898/0 (socket says 172.21.15.100:48898) 2024-02-21T07:58:25.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe7fd600640 1 -- 172.21.15.100:0/2811837042 learned_addr learned my addr 172.21.15.100:0/2811837042 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:25.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.286+0000 7fe7fe000640 1 --1- 172.21.15.100:0/2811837042 >> v1:172.21.15.170:6789/0 conn(0x7fe7f80f9ef0 0x7fe7f8188e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:44188/0 (socket says 172.21.15.100:44188) 2024-02-21T07:58:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.287+0000 7fe7fcc00640 1 -- 172.21.15.100:0/2811837042 >> v1:172.21.15.170:6789/0 conn(0x7fe7f80f9ef0 legacy=0x7fe7f8188e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.287+0000 7fe7fcc00640 1 -- 172.21.15.100:0/2811837042 >> v1:172.21.15.156:6789/0 conn(0x7fe7f8188ab0 legacy=0x7fe7f808cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.287+0000 7fe7f7e00640 1 -- 172.21.15.100:0/2811837042 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977356463 0 0) 0x7fe7f808bfe0 con 0x7fe7f8188ab0 2024-02-21T07:58:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.287+0000 7fe7fcc00640 1 -- 172.21.15.100:0/2811837042 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f80fa660 con 0x7fe7f806ab60 2024-02-21T07:58:25.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.288+0000 7fe7fcc00640 1 --2- 172.21.15.100:0/2811837042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f806ab60 0x7fe7f80f99b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009720 tx=0x7fe7e402b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c28cf35a5f68e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.288+0000 7fe7f7e00640 1 -- 172.21.15.100:0/2811837042 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4030710 con 0x7fe7f806ab60 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.288+0000 7fe7f7e00640 1 -- 172.21.15.100:0/2811837042 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e402e050 con 0x7fe7f806ab60 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.288+0000 7fe7f7e00640 1 -- 172.21.15.100:0/2811837042 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4030a90 con 0x7fe7f806ab60 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 -- 172.21.15.100:0/2811837042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f806ab60 msgr2=0x7fe7f80f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 --2- 172.21.15.100:0/2811837042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f806ab60 0x7fe7f80f99b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009720 tx=0x7fe7e402b6a0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 -- 172.21.15.100:0/2811837042 shutdown_connections 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 --2- 172.21.15.100:0/2811837042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f806ab60 0x7fe7f80f99b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 -- 172.21.15.100:0/2811837042 >> 172.21.15.100:0/2811837042 conn(0x7fe7f80fe290 msgr2=0x7fe7f80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 -- 172.21.15.100:0/2811837042 shutdown_connections 2024-02-21T07:58:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.289+0000 7fe800000640 1 -- 172.21.15.100:0/2811837042 wait complete. 2024-02-21T07:58:25.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.291+0000 7fe800000640 1 Processor -- start 2024-02-21T07:58:25.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.291+0000 7fe800000640 1 -- start start 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 0x7fe7f8168760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f80f9ef0 0x7fe7f82201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80d10d0 con 0x7fe7f8188ab0 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80d13b0 con 0x7fe7f80f9ef0 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.292+0000 7fe800000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f80d1690 con 0x7fe7f806ab60 2024-02-21T07:58:25.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fe000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fe000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54810/0 (socket says 172.21.15.100:54810) 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 0x7fe7f8168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fe000640 1 -- 172.21.15.100:0/3894511452 learned_addr learned my addr 172.21.15.100:0/3894511452 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fcc00640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f80f9ef0 0x7fe7f82201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 -- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f80f9ef0 msgr2=0x7fe7f82201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f80f9ef0 0x7fe7f82201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 -- 172.21.15.100:0/3894511452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 msgr2=0x7fe7f82206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 -- 172.21.15.100:0/3894511452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4009400 con 0x7fe7f806ab60 2024-02-21T07:58:25.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fe000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:25.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.293+0000 7fe7fd600640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 0x7fe7f8168760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80012e0 tx=0x7fe7e800cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.294+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800cea0 con 0x7fe7f806ab60 2024-02-21T07:58:25.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.294+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800a640 con 0x7fe7f806ab60 2024-02-21T07:58:25.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.294+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f80d1970 con 0x7fe7f806ab60 2024-02-21T07:58:25.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.294+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800aa30 con 0x7fe7f806ab60 2024-02-21T07:58:25.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.294+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f80d1f30 con 0x7fe7f806ab60 2024-02-21T07:58:25.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.295+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f80d2150 con 0x7fe7f806ab60 2024-02-21T07:58:25.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.297+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe7e800ab90 con 0x7fe7f806ab60 2024-02-21T07:58:25.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.298+0000 7fe7f5600640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 0x7fe7d80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.298+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7e80c95b0 con 0x7fe7f806ab60 2024-02-21T07:58:25.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.299+0000 7fe7fcc00640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 0x7fe7d80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.299+0000 7fe7fcc00640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 0x7fe7d80a1560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4034000 tx=0x7fe7e4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.300+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7e8093470 con 0x7fe7f806ab60 2024-02-21T07:58:25.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.496+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7f808c510 con 0x7fe7d809f0a0 2024-02-21T07:58:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.497+0000 7fe7f5600640 1 -- 172.21.15.100:0/3894511452 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7e40308e0 con 0x7fe7d809f0a0 2024-02-21T07:58:25.499 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 msgr2=0x7fe7d80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 0x7fe7d80a1560 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4034000 tx=0x7fe7e4008030 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 msgr2=0x7fe7f8168760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 0x7fe7f8168760 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80012e0 tx=0x7fe7e800cc50 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 shutdown_connections 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe7d809f0a0 0x7fe7d80a1560 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7f8188ab0 0x7fe7f82206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7f80f9ef0 0x7fe7f82201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 --2- 172.21.15.100:0/3894511452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe7f806ab60 0x7fe7f8168760 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 >> 172.21.15.100:0/3894511452 conn(0x7fe7f80fe290 msgr2=0x7fe7f817cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.501+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 shutdown_connections 2024-02-21T07:58:25.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.502+0000 7fe800000640 1 -- 172.21.15.100:0/3894511452 wait complete. 2024-02-21T07:58:25.529 INFO:tasks.ceph:Scrubbing osd.6 2024-02-21T07:58:25.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:25.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.739+0000 7f4cbde00640 1 Processor -- start 2024-02-21T07:58:25.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.739+0000 7f4cbde00640 1 -- start start 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbde00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 0x7f4cb806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbde00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4cb80d65d0 0x7f4cb818a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbde00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80d6a00 con 0x7f4cb81826d0 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbde00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb818ce70 con 0x7f4cb80d65d0 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbde00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb818ab20 con 0x7f4cb8182ab0 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cb7e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 0x7f4cb806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbca00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f4cb81826d0 0x7f4cb8189ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48904/0 (socket says 172.21.15.100:48904) 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbca00640 1 -- 172.21.15.100:0/2645415322 learned_addr learned my addr 172.21.15.100:0/2645415322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.741+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2645415322 >> v2:172.21.15.100:3300/0 conn(0x7f4cb80d65d0 0x7f4cb818a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cb7400640 1 -- 172.21.15.100:0/2645415322 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106945098 0 0) 0x7f4cb80d6a00 con 0x7f4cb81826d0 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cb7400640 1 -- 172.21.15.100:0/2645415322 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca0003520 con 0x7f4cb81826d0 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cbd400640 1 -- 172.21.15.100:0/2645415322 >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 msgr2=0x7f4cb806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2645415322 >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 0x7f4cb806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cbd400640 1 -- 172.21.15.100:0/2645415322 >> v1:172.21.15.156:6789/0 conn(0x7f4cb81826d0 legacy=0x7f4cb8189ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cbd400640 1 -- 172.21.15.100:0/2645415322 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb806be40 con 0x7f4cb80d65d0 2024-02-21T07:58:25.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.742+0000 7f4cb7e00640 1 --2- 172.21.15.100:0/2645415322 >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 0x7f4cb806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.743+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2645415322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb80d65d0 0x7f4cb818a5e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8164b10 tx=0x7f4cb002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c83bffb89548648 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.743+0000 7f4cb7400640 1 -- 172.21.15.100:0/2645415322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb002cbe0 con 0x7f4cb80d65d0 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.743+0000 7f4cb7400640 1 -- 172.21.15.100:0/2645415322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb002cd40 con 0x7f4cb80d65d0 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.743+0000 7f4cb7400640 1 -- 172.21.15.100:0/2645415322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0034640 con 0x7f4cb80d65d0 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 -- 172.21.15.100:0/2645415322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb80d65d0 msgr2=0x7f4cb818a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2645415322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb80d65d0 0x7f4cb818a5e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8164b10 tx=0x7f4cb002be30 comp rx=0 tx=0).stop 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 -- 172.21.15.100:0/2645415322 shutdown_connections 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2645415322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb80d65d0 0x7f4cb818a5e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2645415322 >> v2:172.21.15.156:3300/0 conn(0x7f4cb8182ab0 0x7f4cb806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 -- 172.21.15.100:0/2645415322 >> 172.21.15.100:0/2645415322 conn(0x7f4cb80d2690 msgr2=0x7f4cb80d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 -- 172.21.15.100:0/2645415322 shutdown_connections 2024-02-21T07:58:25.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.744+0000 7f4cbde00640 1 -- 172.21.15.100:0/2645415322 wait complete. 2024-02-21T07:58:25.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.746+0000 7f4cbde00640 1 Processor -- start 2024-02-21T07:58:25.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.746+0000 7f4cbde00640 1 -- start start 2024-02-21T07:58:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.747+0000 7f4cbde00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cb80d65d0 0x7f4cb81672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbde00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cb81826d0 0x7f4cb817fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbde00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 0x7f4cb8149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbde00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8180670 con 0x7f4cb8182ab0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbde00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8180950 con 0x7f4cb80d65d0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbde00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8180c30 con 0x7f4cb81826d0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 0x7f4cb8149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 0x7f4cb8149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54816/0 (socket says 172.21.15.100:54816) 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbca00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cb80d65d0 0x7f4cb81672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 -- 172.21.15.100:0/2546605594 learned_addr learned my addr 172.21.15.100:0/2546605594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cb7e00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cb81826d0 0x7f4cb817fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 -- 172.21.15.100:0/2546605594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cb81826d0 msgr2=0x7f4cb817fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4cb81826d0 0x7f4cb817fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 -- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cb80d65d0 msgr2=0x7f4cb81672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4cb80d65d0 0x7f4cb81672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.748+0000 7f4cbd400640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4009400 con 0x7f4cb8182ab0 2024-02-21T07:58:25.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cbd400640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 0x7f4cb8149d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e80 tx=0x7f4cb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0007000 con 0x7f4cb8182ab0 2024-02-21T07:58:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb0040670 con 0x7f4cb8182ab0 2024-02-21T07:58:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0040a20 con 0x7f4cb8182ab0 2024-02-21T07:58:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb0009a70 con 0x7f4cb8182ab0 2024-02-21T07:58:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.749+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb81811f0 con 0x7f4cb8182ab0 2024-02-21T07:58:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.750+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4cb806c6e0 con 0x7f4cb8182ab0 2024-02-21T07:58:25.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.752+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4cb0040b80 con 0x7f4cb8182ab0 2024-02-21T07:58:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.753+0000 7f4cb4c00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c9809f0a0 0x7f4c980a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.753+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4cb00ecde0 con 0x7f4cb8182ab0 2024-02-21T07:58:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cb4c00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7f4c980a9bd0 0x7f4c980ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c980ac740 con 0x7f4c980a9bd0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cb00ed150 con 0x7f4cb8182ab0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cbca00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c9809f0a0 0x7f4c980a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cb7e00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7f4c980a9bd0 0x7f4c980ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cb7e00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7f4c980a9bd0 0x7f4c980ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.754+0000 7f4cbca00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c9809f0a0 0x7f4c980a1560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0011e0 tx=0x7f4cac007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.755+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== osd.6 v2:172.21.15.100:6808/3165398267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4c980ac740 con 0x7f4c980a9bd0 2024-02-21T07:58:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.769+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 --> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4cb806c400 con 0x7f4c980a9bd0 2024-02-21T07:58:25.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.769+0000 7f4cb4c00640 1 -- 172.21.15.100:0/2546605594 <== osd.6 v2:172.21.15.100:6808/3165398267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4ca4009280 con 0x7f4c980a9bd0 2024-02-21T07:58:25.771 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:25.771 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:25.771 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7f4c980a9bd0 msgr2=0x7f4c980ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:6808/3165398267,v1:172.21.15.100:6809/3165398267] conn(0x7f4c980a9bd0 0x7f4c980ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c9809f0a0 msgr2=0x7f4c980a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4c9809f0a0 0x7f4c980a1560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4cac0011e0 tx=0x7f4cac007d30 comp rx=0 tx=0).stop 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 msgr2=0x7f4cb8149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 --2- 172.21.15.100:0/2546605594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cb8182ab0 0x7f4cb8149d50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009e80 tx=0x7f4cb0004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbd400640 1 -- 172.21.15.100:0/2546605594 reap_dead start 2024-02-21T07:58:25.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 shutdown_connections 2024-02-21T07:58:25.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 >> 172.21.15.100:0/2546605594 conn(0x7f4cb80d2690 msgr2=0x7f4cb80fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.770+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 shutdown_connections 2024-02-21T07:58:25.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.771+0000 7f4cbde00640 1 -- 172.21.15.100:0/2546605594 wait complete. 2024-02-21T07:58:25.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-21T07:58:25.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.983+0000 7ff77f200640 1 Processor -- start 2024-02-21T07:58:25.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.983+0000 7ff77f200640 1 -- start start 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.985+0000 7ff77f200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7ff77808c6e0 0x7ff77808cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.985+0000 7ff77f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff778071490 con 0x7ff7781827e0 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.985+0000 7ff77f200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7780705a0 con 0x7ff7781864f0 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.985+0000 7ff77f200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff778182bc0 con 0x7ff77808c6e0 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff77d200640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7ff7781864f0 0x7ff778186980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48918/0 (socket says 172.21.15.100:48918) 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff77d200640 1 -- 172.21.15.100:0/3091799789 learned_addr learned my addr 172.21.15.100:0/3091799789 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:25.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff777400640 1 --2- 172.21.15.100:0/3091799789 >> v2:172.21.15.170:3300/0 conn(0x7ff77808c6e0 0x7ff77808cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637152763 0 0) 0x7ff7780705a0 con 0x7ff7781864f0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff75c003520 con 0x7ff7781864f0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209513511 0 0) 0x7ff778071490 con 0x7ff7781827e0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7780705a0 con 0x7ff7781827e0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff777400640 1 -- 172.21.15.100:0/3091799789 >> v1:172.21.15.156:6789/0 conn(0x7ff7781864f0 legacy=0x7ff778186980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff777400640 1 -- 172.21.15.100:0/3091799789 >> v1:172.21.15.100:6789/0 conn(0x7ff7781827e0 legacy=0x7ff77806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.986+0000 7ff777400640 1 -- 172.21.15.100:0/3091799789 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778070880 con 0x7ff77808c6e0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.987+0000 7ff777400640 1 --2- 172.21.15.100:0/3091799789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff77808c6e0 0x7ff77808cb40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff76400a940 tx=0x7ff76402cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f8e52e453a6499 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76402dab0 con 0x7ff77808c6e0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76402dc10 con 0x7ff77808c6e0 2024-02-21T07:58:25.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff776a00640 1 -- 172.21.15.100:0/3091799789 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764035440 con 0x7ff77808c6e0 2024-02-21T07:58:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 -- 172.21.15.100:0/3091799789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff77808c6e0 msgr2=0x7ff77808cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 --2- 172.21.15.100:0/3091799789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff77808c6e0 0x7ff77808cb40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff76400a940 tx=0x7ff76402cd00 comp rx=0 tx=0).stop 2024-02-21T07:58:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 -- 172.21.15.100:0/3091799789 shutdown_connections 2024-02-21T07:58:25.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 --2- 172.21.15.100:0/3091799789 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff77808c6e0 0x7ff77808cb40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 -- 172.21.15.100:0/3091799789 >> 172.21.15.100:0/3091799789 conn(0x7ff77806e380 msgr2=0x7ff77806e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 -- 172.21.15.100:0/3091799789 shutdown_connections 2024-02-21T07:58:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.988+0000 7ff77f200640 1 -- 172.21.15.100:0/3091799789 wait complete. 2024-02-21T07:58:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.990+0000 7ff77f200640 1 Processor -- start 2024-02-21T07:58:25.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.990+0000 7ff77f200640 1 -- start start 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff77808c6e0 0x7ff77817bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7781827e0 0x7ff778187320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77817c280 con 0x7ff7781864f0 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778187160 con 0x7ff77808c6e0 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.991+0000 7ff77f200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77806ad40 con 0x7ff7781827e0 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54818/0 (socket says 172.21.15.100:54818) 2024-02-21T07:58:25.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 -- 172.21.15.100:0/2617074131 learned_addr learned my addr 172.21.15.100:0/2617074131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff777e00640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff77808c6e0 0x7ff77817bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff777400640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7781827e0 0x7ff778187320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 -- 172.21.15.100:0/2617074131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7781827e0 msgr2=0x7ff778187320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7781827e0 0x7ff778187320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 -- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff77808c6e0 msgr2=0x7ff77817bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff77808c6e0 0x7ff77817bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 -- 172.21.15.100:0/2617074131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76400a5a0 con 0x7ff7781864f0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.992+0000 7ff77d200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff77000caf0 tx=0x7ff77000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.993+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000ac40 con 0x7ff7781864f0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.993+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000ada0 con 0x7ff7781864f0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.993+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff770012620 con 0x7ff7781864f0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.993+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77806b020 con 0x7ff7781864f0 2024-02-21T07:58:25.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.993+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77806b5e0 con 0x7ff7781864f0 2024-02-21T07:58:25.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.994+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff778067c80 con 0x7ff7781864f0 2024-02-21T07:58:25.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.996+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff770007070 con 0x7ff7781864f0 2024-02-21T07:58:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.997+0000 7ff76fe00640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 0x7ff7580a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:25.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.997+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff7700c99f0 con 0x7ff7781864f0 2024-02-21T07:58:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.998+0000 7ff777e00640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 0x7ff7580a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:25.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:25.998+0000 7ff777e00640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 0x7ff7580a1560 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff768007fd0 tx=0x7ff768009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.001+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7700938b0 con 0x7ff7781864f0 2024-02-21T07:58:26.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.195+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff778070e40 con 0x7ff75809f0a0 2024-02-21T07:58:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.196+0000 7ff76fe00640 1 -- 172.21.15.100:0/2617074131 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff76800f850 con 0x7ff75809f0a0 2024-02-21T07:58:26.197 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 msgr2=0x7ff7580a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 0x7ff7580a1560 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff768007fd0 tx=0x7ff768009040 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 msgr2=0x7ff77821f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff77000caf0 tx=0x7ff77000a060 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 shutdown_connections 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff75809f0a0 0x7ff7580a1560 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7781864f0 0x7ff77821f920 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7781827e0 0x7ff778187320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 --2- 172.21.15.100:0/2617074131 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff77808c6e0 0x7ff77817bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 >> 172.21.15.100:0/2617074131 conn(0x7ff77806e380 msgr2=0x7ff778184ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 shutdown_connections 2024-02-21T07:58:26.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.199+0000 7ff77f200640 1 -- 172.21.15.100:0/2617074131 wait complete. 2024-02-21T07:58:26.218 INFO:tasks.ceph:Scrubbing osd.9 2024-02-21T07:58:26.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:26.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.434+0000 7f0d50a00640 1 Processor -- start 2024-02-21T07:58:26.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.435+0000 7f0d50a00640 1 -- start start 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d50a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f0d4c0fd170 0x7f0d4c0d5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d50a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d4c0d5da0 0x7f0d4c18c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d50a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c0fbd30 con 0x7f0d4c18be10 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d50a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c0d4420 con 0x7f0d4c0d5da0 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d50a00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c189890 con 0x7f0d4c0fd170 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4b400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f0d4c18be10 0x7f0d4c0fca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48934/0 (socket says 172.21.15.100:48934) 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4b400640 1 -- 172.21.15.100:0/1699455016 learned_addr learned my addr 172.21.15.100:0/1699455016 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4be00640 1 --2- 172.21.15.100:0/1699455016 >> v2:172.21.15.100:3300/0 conn(0x7f0d4c0d5da0 0x7f0d4c18c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1699455016 >> v2:172.21.15.170:3300/0 conn(0x7f0d4c0fd170 0x7f0d4c0d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4aa00640 1 -- 172.21.15.100:0/1699455016 >> v2:172.21.15.100:3300/0 conn(0x7f0d4c0d5da0 msgr2=0x7f0d4c18c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1699455016 >> v2:172.21.15.100:3300/0 conn(0x7f0d4c0d5da0 0x7f0d4c18c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4aa00640 1 -- 172.21.15.100:0/1699455016 >> v1:172.21.15.156:6789/0 conn(0x7f0d4c18be10 legacy=0x7f0d4c0fca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4aa00640 1 -- 172.21.15.100:0/1699455016 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0fc5d0 con 0x7f0d4c0fd170 2024-02-21T07:58:26.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.437+0000 7f0d4a000640 1 -- 172.21.15.100:0/1699455016 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644588353 0 0) 0x7f0d4c0fbd30 con 0x7f0d4c18be10 2024-02-21T07:58:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1699455016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c0d5860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0f8530 tx=0x7f0d3402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc94f9edbef7d76d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d4a000640 1 -- 172.21.15.100:0/1699455016 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34031710 con 0x7f0d4c0fd170 2024-02-21T07:58:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d4a000640 1 -- 172.21.15.100:0/1699455016 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3402f050 con 0x7f0d4c0fd170 2024-02-21T07:58:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d4a000640 1 -- 172.21.15.100:0/1699455016 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34031a90 con 0x7f0d4c0fd170 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d50a00640 1 -- 172.21.15.100:0/1699455016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 msgr2=0x7f0d4c0d5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.439+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1699455016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c0d5860 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0f8530 tx=0x7f0d3402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 -- 172.21.15.100:0/1699455016 shutdown_connections 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1699455016 >> v2:172.21.15.100:3300/0 conn(0x7f0d4c0d5da0 0x7f0d4c18c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1699455016 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c0d5860 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 -- 172.21.15.100:0/1699455016 >> 172.21.15.100:0/1699455016 conn(0x7f0d4c0fdf30 msgr2=0x7f0d4c0fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 -- 172.21.15.100:0/1699455016 shutdown_connections 2024-02-21T07:58:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.440+0000 7f0d50a00640 1 -- 172.21.15.100:0/1699455016 wait complete. 2024-02-21T07:58:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.442+0000 7f0d50a00640 1 Processor -- start 2024-02-21T07:58:26.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.442+0000 7f0d50a00640 1 -- start start 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d4c0d5da0 0x7f0d4c16c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c17c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 0x7f0d4c220dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0cee00 con 0x7f0d4c18be10 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c21fd30 con 0x7f0d4c0d5da0 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d50a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c220010 con 0x7f0d4c0fd170 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 0x7f0d4c220dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d4b400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d4c0d5da0 0x7f0d4c16c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d4be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 0x7f0d4c220dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54832/0 (socket says 172.21.15.100:54832) 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d4be00640 1 -- 172.21.15.100:0/1404087920 learned_addr learned my addr 172.21.15.100:0/1404087920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.443+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c17c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 -- 172.21.15.100:0/1404087920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 msgr2=0x7f0d4c17c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d4c0fd170 0x7f0d4c17c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 -- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d4c0d5da0 msgr2=0x7f0d4c16c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0d4c0d5da0 0x7f0d4c16c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009400 con 0x7f0d4c18be10 2024-02-21T07:58:26.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d4be00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 0x7f0d4c220dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400e7f0 tx=0x7f0d4400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44009510 con 0x7f0d4c18be10 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4400ee40 con 0x7f0d4c18be10 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c2202f0 con 0x7f0d4c18be10 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400cb80 con 0x7f0d4c18be10 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.444+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c2208b0 con 0x7f0d4c18be10 2024-02-21T07:58:26.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.445+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d4c0fbf80 con 0x7f0d4c18be10 2024-02-21T07:58:26.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.447+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0d4400cce0 con 0x7f0d4c18be10 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.448+0000 7f0d43400640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d2809f0a0 0x7f0d280a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d440c9ec0 con 0x7f0d4c18be10 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d4b400640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d2809f0a0 0x7f0d280a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d43400640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7f0d280a9bd0 0x7f0d280ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d280ac740 con 0x7f0d280a9bd0 2024-02-21T07:58:26.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d440ca230 con 0x7f0d4c18be10 2024-02-21T07:58:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7f0d280a9bd0 0x7f0d280ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.449+0000 7f0d4b400640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d2809f0a0 0x7f0d280a1560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001920 tx=0x7f0d3c0018b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.450+0000 7f0d4aa00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7f0d280a9bd0 0x7f0d280ac070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.451+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== osd.9 v2:172.21.15.100:6816/4180078180 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0d280ac740 con 0x7f0d280a9bd0 2024-02-21T07:58:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.465+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 --> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0d4c0d68d0 con 0x7f0d280a9bd0 2024-02-21T07:58:26.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d43400640 1 -- 172.21.15.100:0/1404087920 <== osd.9 v2:172.21.15.100:6816/4180078180 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0d34031910 con 0x7f0d280a9bd0 2024-02-21T07:58:26.467 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:26.467 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:26.467 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7f0d280a9bd0 msgr2=0x7f0d280ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:6816/4180078180,v1:172.21.15.100:6819/4180078180] conn(0x7f0d280a9bd0 0x7f0d280ac070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d2809f0a0 msgr2=0x7f0d280a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0d2809f0a0 0x7f0d280a1560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c001920 tx=0x7f0d3c0018b0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 msgr2=0x7f0d4c220dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d50a00640 1 --2- 172.21.15.100:0/1404087920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d4c18be10 0x7f0d4c220dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400e7f0 tx=0x7f0d4400ebf0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.466+0000 7f0d4be00640 1 -- 172.21.15.100:0/1404087920 reap_dead start 2024-02-21T07:58:26.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.467+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 shutdown_connections 2024-02-21T07:58:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.467+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 >> 172.21.15.100:0/1404087920 conn(0x7f0d4c0fdf30 msgr2=0x7f0d4c06c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.467+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 shutdown_connections 2024-02-21T07:58:26.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.467+0000 7f0d50a00640 1 -- 172.21.15.100:0/1404087920 wait complete. 2024-02-21T07:58:26.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-02-21T07:58:26.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.694+0000 7fab57400640 1 Processor -- start 2024-02-21T07:58:26.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.694+0000 7fab57400640 1 -- start start 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab57400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fab50182f60 0x7fab50186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab57400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 0x7fab50189040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab57400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab50186670 con 0x7fab50071d40 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab57400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab50183340 con 0x7fab50188c30 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab57400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab50071010 con 0x7fab50182f60 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab54a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fab50182f60 0x7fab50186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab47e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fab50071d40 0x7fab500721d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56584/0 (socket says 172.21.15.100:56584) 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab47e00640 1 -- 172.21.15.100:0/396865786 learned_addr learned my addr 172.21.15.100:0/396865786 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:26.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.696+0000 7fab55400640 1 --2- 172.21.15.100:0/396865786 >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 0x7fab50189040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.697+0000 7fab54a00640 1 -- 172.21.15.100:0/396865786 >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 msgr2=0x7fab50189040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.697+0000 7fab54a00640 1 --2- 172.21.15.100:0/396865786 >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 0x7fab50189040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.697+0000 7fab54a00640 1 -- 172.21.15.100:0/396865786 >> v1:172.21.15.100:6789/0 conn(0x7fab50071d40 legacy=0x7fab500721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.697+0000 7fab54a00640 1 -- 172.21.15.100:0/396865786 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5006eb10 con 0x7fab50182f60 2024-02-21T07:58:26.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.697+0000 7fab55400640 1 --2- 172.21.15.100:0/396865786 >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 0x7fab50189040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:26.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.698+0000 7fab54a00640 1 --2- 172.21.15.100:0/396865786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50182f60 0x7fab50186130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fab5006cc20 tx=0x7fab3802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f5bf83420b0963 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.698+0000 7fab4fe00640 1 -- 172.21.15.100:0/396865786 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3802e070 con 0x7fab50182f60 2024-02-21T07:58:26.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.698+0000 7fab4fe00640 1 -- 172.21.15.100:0/396865786 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab380315a0 con 0x7fab50182f60 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.698+0000 7fab4fe00640 1 -- 172.21.15.100:0/396865786 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38031930 con 0x7fab50182f60 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 -- 172.21.15.100:0/396865786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50182f60 msgr2=0x7fab50186130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 --2- 172.21.15.100:0/396865786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50182f60 0x7fab50186130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fab5006cc20 tx=0x7fab3802b840 comp rx=0 tx=0).stop 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 -- 172.21.15.100:0/396865786 shutdown_connections 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 --2- 172.21.15.100:0/396865786 >> v2:172.21.15.100:3300/0 conn(0x7fab50188c30 0x7fab50189040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 --2- 172.21.15.100:0/396865786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50182f60 0x7fab50186130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 -- 172.21.15.100:0/396865786 >> 172.21.15.100:0/396865786 conn(0x7fab500668b0 msgr2=0x7fab50066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 -- 172.21.15.100:0/396865786 shutdown_connections 2024-02-21T07:58:26.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.699+0000 7fab57400640 1 -- 172.21.15.100:0/396865786 wait complete. 2024-02-21T07:58:26.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.701+0000 7fab57400640 1 Processor -- start 2024-02-21T07:58:26.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.701+0000 7fab57400640 1 -- start start 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50071d40 0x7fab501584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab50182f60 0x7fab50177fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50158a00 con 0x7fab50188c30 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50158c20 con 0x7fab50182f60 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab57400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab50158f00 con 0x7fab50071d40 2024-02-21T07:58:26.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab55400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab54a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50071d40 0x7fab501584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab55400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54856/0 (socket says 172.21.15.100:54856) 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.702+0000 7fab55400640 1 -- 172.21.15.100:0/1165357526 learned_addr learned my addr 172.21.15.100:0/1165357526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab47e00640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab50182f60 0x7fab50177fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 -- 172.21.15.100:0/1165357526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50071d40 msgr2=0x7fab501584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50071d40 0x7fab501584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 -- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab50182f60 msgr2=0x7fab50177fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab50182f60 0x7fab50177fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 -- 172.21.15.100:0/1165357526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38009400 con 0x7fab50188c30 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab55400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab48009ed0 tx=0x7fab480085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48010070 con 0x7fab50188c30 2024-02-21T07:58:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab48008da0 con 0x7fab50188c30 2024-02-21T07:58:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.703+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab501591e0 con 0x7fab50188c30 2024-02-21T07:58:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.704+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48003990 con 0x7fab50188c30 2024-02-21T07:58:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.704+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500f4fb0 con 0x7fab50188c30 2024-02-21T07:58:26.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.705+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50159400 con 0x7fab50188c30 2024-02-21T07:58:26.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.707+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fab48014070 con 0x7fab50188c30 2024-02-21T07:58:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.708+0000 7fab4d600640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 0x7fab2c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.708+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fab480c9420 con 0x7fab50188c30 2024-02-21T07:58:26.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.708+0000 7fab54a00640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 0x7fab2c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:26.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.709+0000 7fab54a00640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 0x7fab2c0a1560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fab38036000 tx=0x7fab3803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:26.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.712+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab480932e0 con 0x7fab50188c30 2024-02-21T07:58:26.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.909+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7fab50071260 con 0x7fab2c09f0a0 2024-02-21T07:58:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.910+0000 7fab4d600640 1 -- 172.21.15.100:0/1165357526 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab380319f0 con 0x7fab2c09f0a0 2024-02-21T07:58:26.911 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 9 to deep-scrub 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 msgr2=0x7fab2c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 0x7fab2c0a1560 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fab38036000 tx=0x7fab3803d040 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 msgr2=0x7fab500f54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab48009ed0 tx=0x7fab480085d0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 shutdown_connections 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fab2c09f0a0 0x7fab2c0a1560 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab50188c30 0x7fab500f54d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fab50182f60 0x7fab50177fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 --2- 172.21.15.100:0/1165357526 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fab50071d40 0x7fab501584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.912+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 >> 172.21.15.100:0/1165357526 conn(0x7fab500668b0 msgr2=0x7fab5015ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.913+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 shutdown_connections 2024-02-21T07:58:26.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:26.913+0000 7fab57400640 1 -- 172.21.15.100:0/1165357526 wait complete. 2024-02-21T07:58:26.933 INFO:tasks.ceph:Scrubbing osd.1 2024-02-21T07:58:26.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.137+0000 7feeed200640 1 Processor -- start 2024-02-21T07:58:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.138+0000 7feeed200640 1 -- start start 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.139+0000 7feeed200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7feee8188b90 0x7feee8183510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.139+0000 7feeed200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feee8183a50 0x7feee8189680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.139+0000 7feeed200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee8070fa0 con 0x7feee8072600 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.139+0000 7feeed200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8071280 con 0x7feee8183a50 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.139+0000 7feeed200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8071560 con 0x7feee8188b90 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feee8183a50 0x7feee8189680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feedfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7feee8072600 0x7feee8188f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56594/0 (socket says 172.21.15.100:56594) 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feedfe00640 1 -- 172.21.15.100:0/1697156306 learned_addr learned my addr 172.21.15.100:0/1697156306 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:27.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee5e00640 1 --2- 172.21.15.100:0/1697156306 >> v2:172.21.15.170:3300/0 conn(0x7feee8188b90 0x7feee8183510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee6800640 1 -- 172.21.15.100:0/1697156306 >> v2:172.21.15.170:3300/0 conn(0x7feee8188b90 msgr2=0x7feee8183510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee6800640 1 --2- 172.21.15.100:0/1697156306 >> v2:172.21.15.170:3300/0 conn(0x7feee8188b90 0x7feee8183510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee6800640 1 -- 172.21.15.100:0/1697156306 >> v1:172.21.15.100:6789/0 conn(0x7feee8072600 legacy=0x7feee8188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee6800640 1 -- 172.21.15.100:0/1697156306 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8071840 con 0x7feee8183a50 2024-02-21T07:58:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.140+0000 7feee5400640 1 -- 172.21.15.100:0/1697156306 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265013391 0 0) 0x7feee8070fa0 con 0x7feee8072600 2024-02-21T07:58:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.141+0000 7feee6800640 1 --2- 172.21.15.100:0/1697156306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8183a50 0x7feee8189680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feee808e750 tx=0x7feee002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729e73b5b705526d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feee5400640 1 -- 172.21.15.100:0/1697156306 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002cbf0 con 0x7feee8183a50 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feee5400640 1 -- 172.21.15.100:0/1697156306 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee002cd50 con 0x7feee8183a50 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feee5400640 1 -- 172.21.15.100:0/1697156306 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0034660 con 0x7feee8183a50 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 -- 172.21.15.100:0/1697156306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8183a50 msgr2=0x7feee8189680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 --2- 172.21.15.100:0/1697156306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8183a50 0x7feee8189680 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feee808e750 tx=0x7feee002be40 comp rx=0 tx=0).stop 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 -- 172.21.15.100:0/1697156306 shutdown_connections 2024-02-21T07:58:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 --2- 172.21.15.100:0/1697156306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8183a50 0x7feee8189680 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 --2- 172.21.15.100:0/1697156306 >> v2:172.21.15.170:3300/0 conn(0x7feee8188b90 0x7feee8183510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 -- 172.21.15.100:0/1697156306 >> 172.21.15.100:0/1697156306 conn(0x7feee80668b0 msgr2=0x7feee8066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.142+0000 7feeed200640 1 -- 172.21.15.100:0/1697156306 shutdown_connections 2024-02-21T07:58:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.143+0000 7feeed200640 1 -- 172.21.15.100:0/1697156306 wait complete. 2024-02-21T07:58:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.144+0000 7feeed200640 1 Processor -- start 2024-02-21T07:58:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.145+0000 7feeed200640 1 -- start start 2024-02-21T07:58:27.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 0x7feee815e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee8183a50 0x7feee8178df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8188b90 0x7feee80f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee815e7b0 con 0x7feee8188b90 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8222930 con 0x7feee8183a50 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feeed200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80f50e0 con 0x7feee8072600 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 0x7feee815e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8188b90 0x7feee80f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 0x7feee815e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:48842/0 (socket says 172.21.15.100:48842) 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 -- 172.21.15.100:0/3982313408 learned_addr learned my addr 172.21.15.100:0/3982313408 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feedfe00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee8183a50 0x7feee8178df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 -- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee8183a50 msgr2=0x7feee8178df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee8183a50 0x7feee8178df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 -- 172.21.15.100:0/3982313408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8188b90 msgr2=0x7feee80f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee8188b90 0x7feee80f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.146+0000 7feee5e00640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0009a70 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feee5e00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 0x7feee815e270 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7feed800e870 tx=0x7feed800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80094f0 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800c940 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800ccf0 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80f53c0 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.147+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8156840 con 0x7feee8072600 2024-02-21T07:58:27.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.148+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feee80720e0 con 0x7feee8072600 2024-02-21T07:58:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.151+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feed8013470 con 0x7feee8072600 2024-02-21T07:58:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.152+0000 7feede000640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feec409f0a0 0x7feec40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.152+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feed80c9f80 con 0x7feee8072600 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feedfe00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feec409f0a0 0x7feec40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feede000640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7feec40a9bd0 0x7feec40ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feec40ac740 con 0x7feec40a9bd0 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed80ca2f0 con 0x7feee8072600 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feee6800640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7feec40a9bd0 0x7feec40ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.153+0000 7feedfe00640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feec409f0a0 0x7feec40a1560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feed0007f70 tx=0x7feed0007f00 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.154+0000 7feee6800640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7feec40a9bd0 0x7feec40ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.154+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== osd.1 v2:172.21.15.156:6818/499558575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7feec40ac740 con 0x7feec40a9bd0 2024-02-21T07:58:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.169+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 --> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feee8071e00 con 0x7feec40a9bd0 2024-02-21T07:58:27.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feede000640 1 -- 172.21.15.100:0/3982313408 <== osd.1 v2:172.21.15.156:6818/499558575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feee0009450 con 0x7feec40a9bd0 2024-02-21T07:58:27.172 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:27.172 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:27.172 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7feec40a9bd0 msgr2=0x7feec40ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6818/499558575,v1:172.21.15.156:6819/499558575] conn(0x7feec40a9bd0 0x7feec40ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feec409f0a0 msgr2=0x7feec40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feec409f0a0 0x7feec40a1560 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feed0007f70 tx=0x7feed0007f00 comp rx=0 tx=0).stop 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 msgr2=0x7feee815e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 --2- 172.21.15.100:0/3982313408 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feee8072600 0x7feee815e270 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7feed800e870 tx=0x7feed800ed30 comp rx=0 tx=0).stop 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feee6800640 1 -- 172.21.15.100:0/3982313408 reap_dead start 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 shutdown_connections 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.170+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 >> 172.21.15.100:0/3982313408 conn(0x7feee80668b0 msgr2=0x7feee8066c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.171+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 shutdown_connections 2024-02-21T07:58:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.171+0000 7feeed200640 1 -- 172.21.15.100:0/3982313408 wait complete. 2024-02-21T07:58:27.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-21T07:58:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.389+0000 7f8c3c600640 1 Processor -- start 2024-02-21T07:58:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.390+0000 7f8c3c600640 1 -- start start 2024-02-21T07:58:27.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.391+0000 7f8c3c600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8c3418a790 0x7f8c3406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.391+0000 7f8c3c600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340ca6a0 con 0x7f8c3406ab60 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.391+0000 7f8c3c600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340f6200 con 0x7f8c34189ca0 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.391+0000 7f8c3c600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3418abe0 con 0x7f8c3418a790 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c39c00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f8c34189ca0 0x7f8c340cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48938/0 (socket says 172.21.15.100:48938) 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c39c00640 1 -- 172.21.15.100:0/4254911057 learned_addr learned my addr 172.21.15.100:0/4254911057 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:27.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c3a600640 1 --2- 172.21.15.100:0/4254911057 >> v2:172.21.15.100:3300/0 conn(0x7f8c3418a790 0x7f8c3406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126040702 0 0) 0x7f8c340f6200 con 0x7f8c34189ca0 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c1c003520 con 0x7f8c34189ca0 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c3a600640 1 -- 172.21.15.100:0/4254911057 >> v1:172.21.15.156:6789/0 conn(0x7f8c34189ca0 legacy=0x7f8c340cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c3a600640 1 -- 172.21.15.100:0/4254911057 >> v1:172.21.15.100:6789/0 conn(0x7f8c3406ab60 legacy=0x7f8c3418a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685578668 0 0) 0x7f8c340ca6a0 con 0x7f8c3406ab60 2024-02-21T07:58:27.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.392+0000 7f8c3a600640 1 -- 172.21.15.100:0/4254911057 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3406afc0 con 0x7f8c3418a790 2024-02-21T07:58:27.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.393+0000 7f8c3a600640 1 --2- 172.21.15.100:0/4254911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3418a790 0x7f8c3406ea40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009d90 tx=0x7f8c2c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6193b9ddccd1bedc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.393+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c02cd00 con 0x7f8c3418a790 2024-02-21T07:58:27.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.393+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c02ce60 con 0x7f8c3418a790 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.393+0000 7f8c33e00640 1 -- 172.21.15.100:0/4254911057 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c034660 con 0x7f8c3418a790 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 -- 172.21.15.100:0/4254911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3418a790 msgr2=0x7f8c3406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4254911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3418a790 0x7f8c3406ea40 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c009d90 tx=0x7f8c2c02bf50 comp rx=0 tx=0).stop 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 -- 172.21.15.100:0/4254911057 shutdown_connections 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4254911057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3418a790 0x7f8c3406ea40 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 -- 172.21.15.100:0/4254911057 >> 172.21.15.100:0/4254911057 conn(0x7f8c340668b0 msgr2=0x7f8c34066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 -- 172.21.15.100:0/4254911057 shutdown_connections 2024-02-21T07:58:27.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.394+0000 7f8c3c600640 1 -- 172.21.15.100:0/4254911057 wait complete. 2024-02-21T07:58:27.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.396+0000 7f8c3c600640 1 Processor -- start 2024-02-21T07:58:27.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.396+0000 7f8c3c600640 1 -- start start 2024-02-21T07:58:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.397+0000 7f8c3c600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.397+0000 7f8c3c600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c34189ca0 0x7f8c3416ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.397+0000 7f8c3c600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 0x7f8c3416f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.397+0000 7f8c3c600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34071010 con 0x7f8c3406ab60 2024-02-21T07:58:27.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.397+0000 7f8c3c600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34072150 con 0x7f8c3418a790 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c3c600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c341759f0 con 0x7f8c34189ca0 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54880/0 (socket says 172.21.15.100:54880) 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 -- 172.21.15.100:0/4013385853 learned_addr learned my addr 172.21.15.100:0/4013385853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39200640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c34189ca0 0x7f8c3416ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c3a600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 0x7f8c3416f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 -- 172.21.15.100:0/4013385853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c34189ca0 msgr2=0x7f8c3416ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c34189ca0 0x7f8c3416ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 -- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 msgr2=0x7f8c3416f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 0x7f8c3416f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c39c00640 1 -- 172.21.15.100:0/4013385853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009a70 con 0x7f8c3406ab60 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.398+0000 7f8c3a600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 0x7f8c3416f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c39c00640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c530 tx=0x7f8c2800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28005ce0 con 0x7f8c3406ab60 2024-02-21T07:58:27.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c28005e40 con 0x7f8c3406ab60 2024-02-21T07:58:27.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c280072b0 con 0x7f8c3406ab60 2024-02-21T07:58:27.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c34071260 con 0x7f8c3406ab60 2024-02-21T07:58:27.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.399+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c34071820 con 0x7f8c3406ab60 2024-02-21T07:58:27.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.400+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3408e1c0 con 0x7f8c3406ab60 2024-02-21T07:58:27.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.402+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f8c28007410 con 0x7f8c3406ab60 2024-02-21T07:58:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.403+0000 7f8c31600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 0x7f8c140a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.404+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8c280c90e0 con 0x7f8c3406ab60 2024-02-21T07:58:27.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.404+0000 7f8c39200640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 0x7f8c140a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.405+0000 7f8c39200640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 0x7f8c140a1560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c34175bd0 tx=0x7f8c20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.407+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c28092f10 con 0x7f8c3406ab60 2024-02-21T07:58:27.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.604+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c340ca8d0 con 0x7f8c1409f0a0 2024-02-21T07:58:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.605+0000 7f8c31600640 1 -- 172.21.15.100:0/4013385853 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8c20001490 con 0x7f8c1409f0a0 2024-02-21T07:58:27.606 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-02-21T07:58:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.607+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 msgr2=0x7f8c140a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.607+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 0x7f8c140a1560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8c34175bd0 tx=0x7f8c20009040 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.607+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 msgr2=0x7f8c34172a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.607+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800c530 tx=0x7f8c2800c9f0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 shutdown_connections 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3418a790 0x7f8c3416f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8c34189ca0 0x7f8c3416ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f8c1409f0a0 0x7f8c140a1560 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 --2- 172.21.15.100:0/4013385853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c3406ab60 0x7f8c34172a70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 >> 172.21.15.100:0/4013385853 conn(0x7f8c340668b0 msgr2=0x7f8c3418a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 shutdown_connections 2024-02-21T07:58:27.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.608+0000 7f8c3c600640 1 -- 172.21.15.100:0/4013385853 wait complete. 2024-02-21T07:58:27.628 INFO:tasks.ceph:Scrubbing osd.4 2024-02-21T07:58:27.629 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:27.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.832+0000 7f708e200640 1 Processor -- start 2024-02-21T07:58:27.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.833+0000 7f708e200640 1 -- start start 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.834+0000 7f708e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.834+0000 7f708e200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f70880ca750 0x7f70880caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.834+0000 7f708e200640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708806da60 con 0x7f7088187390 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.834+0000 7f708e200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708806e6e0 con 0x7f7088184050 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.834+0000 7f708e200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708806dd40 con 0x7f70880ca750 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7087400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f707fe00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f7088187390 0x7f7088184620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:44202/0 (socket says 172.21.15.100:44202) 2024-02-21T07:58:27.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f707fe00640 1 -- 172.21.15.100:0/650436621 learned_addr learned my addr 172.21.15.100:0/650436621 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:27.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7087400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54888/0 (socket says 172.21.15.100:54888) 2024-02-21T07:58:27.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7087e00640 1 --2- 172.21.15.100:0/650436621 >> v2:172.21.15.170:3300/0 conn(0x7f70880ca750 0x7f70880caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7086a00640 1 -- 172.21.15.100:0/650436621 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715365076 0 0) 0x7f708806da60 con 0x7f7088187390 2024-02-21T07:58:27.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7086a00640 1 -- 172.21.15.100:0/650436621 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f706c003520 con 0x7f7088187390 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7087e00640 1 -- 172.21.15.100:0/650436621 >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 msgr2=0x7f708806eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.835+0000 7f7087e00640 1 --2- 172.21.15.100:0/650436621 >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.836+0000 7f7087e00640 1 -- 172.21.15.100:0/650436621 >> v1:172.21.15.170:6789/0 conn(0x7f7088187390 legacy=0x7f7088184620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.836+0000 7f7087e00640 1 -- 172.21.15.100:0/650436621 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708806e020 con 0x7f70880ca750 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.836+0000 7f7087400640 1 --2- 172.21.15.100:0/650436621 >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:27.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.837+0000 7f7087e00640 1 --2- 172.21.15.100:0/650436621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70880ca750 0x7f70880caba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70880f7e20 tx=0x7f708002bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36889449275d34fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.837+0000 7f7086a00640 1 -- 172.21.15.100:0/650436621 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708002cb50 con 0x7f70880ca750 2024-02-21T07:58:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.837+0000 7f7086a00640 1 -- 172.21.15.100:0/650436621 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708002ccb0 con 0x7f70880ca750 2024-02-21T07:58:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.837+0000 7f7086a00640 1 -- 172.21.15.100:0/650436621 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080034660 con 0x7f70880ca750 2024-02-21T07:58:27.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 -- 172.21.15.100:0/650436621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70880ca750 msgr2=0x7f70880caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 --2- 172.21.15.100:0/650436621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70880ca750 0x7f70880caba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70880f7e20 tx=0x7f708002bda0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 -- 172.21.15.100:0/650436621 shutdown_connections 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 --2- 172.21.15.100:0/650436621 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70880ca750 0x7f70880caba0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 --2- 172.21.15.100:0/650436621 >> v2:172.21.15.100:3300/0 conn(0x7f7088184050 0x7f708806eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 -- 172.21.15.100:0/650436621 >> 172.21.15.100:0/650436621 conn(0x7f70880668b0 msgr2=0x7f7088066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 -- 172.21.15.100:0/650436621 shutdown_connections 2024-02-21T07:58:27.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.838+0000 7f708e200640 1 -- 172.21.15.100:0/650436621 wait complete. 2024-02-21T07:58:27.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.840+0000 7f708e200640 1 Processor -- start 2024-02-21T07:58:27.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.841+0000 7f708e200640 1 -- start start 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 0x7f708821f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 0x7f708821f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7088187390 0x7f70880f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880f2190 con 0x7f7088184050 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880f3290 con 0x7f70880ca750 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f708e200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880f23a0 con 0x7f7088187390 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f707fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 0x7f708821f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f7087400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 0x7f708821f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f7087400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 0x7f708821f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46478/0 (socket says 172.21.15.100:46478) 2024-02-21T07:58:27.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f707fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 0x7f708821f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54904/0 (socket says 172.21.15.100:54904) 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f7087400640 1 -- 172.21.15.100:0/2767927023 learned_addr learned my addr 172.21.15.100:0/2767927023 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.842+0000 7f7087e00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7088187390 0x7f70880f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 -- 172.21.15.100:0/2767927023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7088187390 msgr2=0x7f70880f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7088187390 0x7f70880f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 -- 172.21.15.100:0/2767927023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 msgr2=0x7f708821f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 0x7f708821f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009400 con 0x7f70880ca750 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f707fe00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7088184050 0x7f708821f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f7087400640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 0x7f708821f970 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f707800ebe0 tx=0x7f707800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078009760 con 0x7f70880ca750 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800cc30 con 0x7f70880ca750 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800eee0 con 0x7f70880ca750 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.843+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080009a70 con 0x7f70880ca750 2024-02-21T07:58:27.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.844+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70880f2960 con 0x7f70880ca750 2024-02-21T07:58:27.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.844+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70880cbb40 con 0x7f70880ca750 2024-02-21T07:58:27.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.846+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7078026480 con 0x7f70880ca750 2024-02-21T07:58:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707f400640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f706409f0a0 0x7f70640a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f70780ca580 con 0x7f70880ca750 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707f400640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7f70640a9bd0 0x7f70640ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70640ac740 con 0x7f70640a9bd0 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== mon.1 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70780ca8f0 con 0x7f70880ca750 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f707fe00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f706409f0a0 0x7f70640a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.848+0000 7f7087e00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7f70640a9bd0 0x7f70640ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.849+0000 7f707fe00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f706409f0a0 0x7f70640a1560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7088185dc0 tx=0x7f7070009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.849+0000 7f7087e00640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7f70640a9bd0 0x7f70640ac070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:27.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.850+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== osd.4 v2:172.21.15.156:6810/3390829461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f70640ac740 con 0x7f70640a9bd0 2024-02-21T07:58:27.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.864+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 --> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70880f33d0 con 0x7f70640a9bd0 2024-02-21T07:58:27.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.865+0000 7f707f400640 1 -- 172.21.15.100:0/2767927023 <== osd.4 v2:172.21.15.156:6810/3390829461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7080034540 con 0x7f70640a9bd0 2024-02-21T07:58:27.867 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:27.867 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:27.867 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7f70640a9bd0 msgr2=0x7f70640ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6810/3390829461,v1:172.21.15.156:6811/3390829461] conn(0x7f70640a9bd0 0x7f70640ac070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f706409f0a0 msgr2=0x7f70640a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f706409f0a0 0x7f70640a1560 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7088185dc0 tx=0x7f7070009040 comp rx=0 tx=0).stop 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 msgr2=0x7f708821f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:27.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 --2- 172.21.15.100:0/2767927023 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f70880ca750 0x7f708821f970 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f707800ebe0 tx=0x7f707800c520 comp rx=0 tx=0).stop 2024-02-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f7087e00640 1 -- 172.21.15.100:0/2767927023 reap_dead start 2024-02-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 shutdown_connections 2024-02-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 >> 172.21.15.100:0/2767927023 conn(0x7f70880668b0 msgr2=0x7f7088073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 shutdown_connections 2024-02-21T07:58:27.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:27.866+0000 7f708e200640 1 -- 172.21.15.100:0/2767927023 wait complete. 2024-02-21T07:58:27.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-21T07:58:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.089+0000 7f2c1c800640 1 Processor -- start 2024-02-21T07:58:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.090+0000 7f2c1c800640 1 -- start start 2024-02-21T07:58:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c1c800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f2c1418a790 0x7f2c1406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c1c800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140ca6a0 con 0x7f2c14189ca0 2024-02-21T07:58:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c1c800640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140f6200 con 0x7f2c1406ab60 2024-02-21T07:58:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c1c800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1418abe0 con 0x7f2c1418a790 2024-02-21T07:58:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c19e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2c14189ca0 0x7f2c140cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56616/0 (socket says 172.21.15.100:56616) 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c19e00640 1 -- 172.21.15.100:0/625115677 learned_addr learned my addr 172.21.15.100:0/625115677 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c19400640 1 --1- 172.21.15.100:0/625115677 >> v1:172.21.15.156:6789/0 conn(0x7f2c1406ab60 0x7f2c1418a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:48954/0 (socket says 172.21.15.100:48954) 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c1a800640 1 --2- 172.21.15.100:0/625115677 >> v2:172.21.15.156:3300/0 conn(0x7f2c1418a790 0x7f2c1406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.092+0000 7f2c18a00640 1 -- 172.21.15.100:0/625115677 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114766588 0 0) 0x7f2c140ca6a0 con 0x7f2c14189ca0 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.093+0000 7f2c1a800640 1 -- 172.21.15.100:0/625115677 >> v1:172.21.15.156:6789/0 conn(0x7f2c1406ab60 legacy=0x7f2c1418a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.093+0000 7f2c1a800640 1 -- 172.21.15.100:0/625115677 >> v1:172.21.15.100:6789/0 conn(0x7f2c14189ca0 legacy=0x7f2c140cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.093+0000 7f2c1a800640 1 -- 172.21.15.100:0/625115677 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1406afc0 con 0x7f2c1418a790 2024-02-21T07:58:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c1a800640 1 --2- 172.21.15.100:0/625115677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c1418a790 0x7f2c1406ea40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009d90 tx=0x7f2c1002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb70454ca1f2e10 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c18a00640 1 -- 172.21.15.100:0/625115677 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1002cd00 con 0x7f2c1418a790 2024-02-21T07:58:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c18a00640 1 -- 172.21.15.100:0/625115677 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1002ce60 con 0x7f2c1418a790 2024-02-21T07:58:28.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c18a00640 1 -- 172.21.15.100:0/625115677 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10034660 con 0x7f2c1418a790 2024-02-21T07:58:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c1c800640 1 -- 172.21.15.100:0/625115677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c1418a790 msgr2=0x7f2c1406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.094+0000 7f2c1c800640 1 --2- 172.21.15.100:0/625115677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c1418a790 0x7f2c1406ea40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009d90 tx=0x7f2c1002bf50 comp rx=0 tx=0).stop 2024-02-21T07:58:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.095+0000 7f2c1c800640 1 -- 172.21.15.100:0/625115677 shutdown_connections 2024-02-21T07:58:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.095+0000 7f2c1c800640 1 --2- 172.21.15.100:0/625115677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c1418a790 0x7f2c1406ea40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.095+0000 7f2c1c800640 1 -- 172.21.15.100:0/625115677 >> 172.21.15.100:0/625115677 conn(0x7f2c140668b0 msgr2=0x7f2c14066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.095+0000 7f2c1c800640 1 -- 172.21.15.100:0/625115677 shutdown_connections 2024-02-21T07:58:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.095+0000 7f2c1c800640 1 -- 172.21.15.100:0/625115677 wait complete. 2024-02-21T07:58:28.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.096+0000 7f2c1c800640 1 Processor -- start 2024-02-21T07:58:28.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.097+0000 7f2c1c800640 1 -- start start 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c14189ca0 0x7f2c1416f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c1418a790 0x7f2c1416fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141733e0 con 0x7f2c1406ab60 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14173100 con 0x7f2c14189ca0 2024-02-21T07:58:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c1c800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c14174740 con 0x7f2c1418a790 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c19e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c19e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54918/0 (socket says 172.21.15.100:54918) 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c19e00640 1 -- 172.21.15.100:0/1221826359 learned_addr learned my addr 172.21.15.100:0/1221826359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.098+0000 7f2c19400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c14189ca0 0x7f2c1416f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c1a800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c1418a790 0x7f2c1416fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 -- 172.21.15.100:0/1221826359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c1418a790 msgr2=0x7f2c1416fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c1418a790 0x7f2c1416fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 -- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c14189ca0 msgr2=0x7f2c1416f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c14189ca0 0x7f2c1416f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 -- 172.21.15.100:0/1221826359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10009a70 con 0x7f2c1406ab60 2024-02-21T07:58:28.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c19e00640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c520 tx=0x7f2c0800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080074e0 con 0x7f2c1406ab60 2024-02-21T07:58:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08007640 con 0x7f2c1406ab60 2024-02-21T07:58:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.099+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080049e0 con 0x7f2c1406ab60 2024-02-21T07:58:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.100+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c14174a20 con 0x7f2c1406ab60 2024-02-21T07:58:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.100+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c14174fe0 con 0x7f2c1406ab60 2024-02-21T07:58:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.101+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1408e1c0 con 0x7f2c1406ab60 2024-02-21T07:58:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.103+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2c08004b40 con 0x7f2c1406ab60 2024-02-21T07:58:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.104+0000 7f2c0e000640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 0x7f2bf80a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.104+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2c080c8cf0 con 0x7f2c1406ab60 2024-02-21T07:58:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.104+0000 7f2c19400640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 0x7f2bf80a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.105+0000 7f2c19400640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 0x7f2bf80a1590 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c1406e7d0 tx=0x7f2c04007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.108+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2c080929e0 con 0x7f2c1406ab60 2024-02-21T07:58:28.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.307+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c140cabb0 con 0x7f2bf809f0d0 2024-02-21T07:58:28.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.308+0000 7f2c0e000640 1 -- 172.21.15.100:0/1221826359 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c04004aa0 con 0x7f2bf809f0d0 2024-02-21T07:58:28.309 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 msgr2=0x7f2bf80a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 0x7f2bf80a1590 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2c1406e7d0 tx=0x7f2c04007e80 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 msgr2=0x7f2c1408bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c520 tx=0x7f2c0800c9e0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 shutdown_connections 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c1418a790 0x7f2c1416fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2c14189ca0 0x7f2c1416f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f2bf809f0d0 0x7f2bf80a1590 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 --2- 172.21.15.100:0/1221826359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c1406ab60 0x7f2c1408bfe0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 >> 172.21.15.100:0/1221826359 conn(0x7f2c140668b0 msgr2=0x7f2c1418a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 shutdown_connections 2024-02-21T07:58:28.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.311+0000 7f2c1c800640 1 -- 172.21.15.100:0/1221826359 wait complete. 2024-02-21T07:58:28.331 INFO:tasks.ceph:Scrubbing osd.7 2024-02-21T07:58:28.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.546+0000 7f6d86800640 1 Processor -- start 2024-02-21T07:58:28.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.546+0000 7f6d86800640 1 -- start start 2024-02-21T07:58:28.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d86800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6d80187390 0x7f6d8006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d86800640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6d800ca750 0x7f6d800caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d86800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8006da60 con 0x7f6d80184050 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d86800640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8006e6e0 con 0x7f6d800ca750 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d86800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8006dd40 con 0x7f6d80187390 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d7f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6d80184050 0x7f6d80184620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56622/0 (socket says 172.21.15.100:56622) 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.548+0000 7f6d7f400640 1 -- 172.21.15.100:0/3893621066 learned_addr learned my addr 172.21.15.100:0/3893621066 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/3893621066 >> v2:172.21.15.156:3300/0 conn(0x7f6d800ca750 0x7f6d800caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7ea00640 1 --2- 172.21.15.100:0/3893621066 >> v2:172.21.15.170:3300/0 conn(0x7f6d80187390 0x7f6d8006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7e000640 1 -- 172.21.15.100:0/3893621066 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792739893 0 0) 0x7f6d8006da60 con 0x7f6d80184050 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7e000640 1 -- 172.21.15.100:0/3893621066 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d64003520 con 0x7f6d80184050 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7fe00640 1 -- 172.21.15.100:0/3893621066 >> v2:172.21.15.170:3300/0 conn(0x7f6d80187390 msgr2=0x7f6d8006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/3893621066 >> v2:172.21.15.170:3300/0 conn(0x7f6d80187390 0x7f6d8006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7fe00640 1 -- 172.21.15.100:0/3893621066 >> v1:172.21.15.100:6789/0 conn(0x7f6d80184050 legacy=0x7f6d80184620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.549+0000 7f6d7fe00640 1 -- 172.21.15.100:0/3893621066 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8006e020 con 0x7f6d800ca750 2024-02-21T07:58:28.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.550+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/3893621066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d800ca750 0x7f6d800caba0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6d8008d210 tx=0x7f6d7802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405dd83920c6f419 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.550+0000 7f6d7e000640 1 -- 172.21.15.100:0/3893621066 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7802cb60 con 0x7f6d800ca750 2024-02-21T07:58:28.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.550+0000 7f6d7e000640 1 -- 172.21.15.100:0/3893621066 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7802ccc0 con 0x7f6d800ca750 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.550+0000 7f6d7e000640 1 -- 172.21.15.100:0/3893621066 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78034640 con 0x7f6d800ca750 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 -- 172.21.15.100:0/3893621066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d800ca750 msgr2=0x7f6d800caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 --2- 172.21.15.100:0/3893621066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d800ca750 0x7f6d800caba0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6d8008d210 tx=0x7f6d7802bdb0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 -- 172.21.15.100:0/3893621066 shutdown_connections 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 --2- 172.21.15.100:0/3893621066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d800ca750 0x7f6d800caba0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 --2- 172.21.15.100:0/3893621066 >> v2:172.21.15.170:3300/0 conn(0x7f6d80187390 0x7f6d8006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 -- 172.21.15.100:0/3893621066 >> 172.21.15.100:0/3893621066 conn(0x7f6d800668b0 msgr2=0x7f6d80066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 -- 172.21.15.100:0/3893621066 shutdown_connections 2024-02-21T07:58:28.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.551+0000 7f6d86800640 1 -- 172.21.15.100:0/3893621066 wait complete. 2024-02-21T07:58:28.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.553+0000 7f6d86800640 1 Processor -- start 2024-02-21T07:58:28.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.553+0000 7f6d86800640 1 -- start start 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d800ca750 0x7f6d801740a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d80184050 0x7f6d8021fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 0x7f6d80220090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800f5a80 con 0x7f6d80187390 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8006b300 con 0x7f6d80184050 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d86800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800f4b90 con 0x7f6d800ca750 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 0x7f6d80220090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d800ca750 0x7f6d801740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 0x7f6d80220090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54920/0 (socket says 172.21.15.100:54920) 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7fe00640 1 -- 172.21.15.100:0/2433688987 learned_addr learned my addr 172.21.15.100:0/2433688987 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7ea00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d80184050 0x7f6d8021fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 -- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d80184050 msgr2=0x7f6d8021fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6d80184050 0x7f6d8021fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 -- 172.21.15.100:0/2433688987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 msgr2=0x7f6d80220090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 0x7f6d80220090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7f400640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009a70 con 0x7f6d800ca750 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.555+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d80187390 0x7f6d80220090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d7f400640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d800ca750 0x7f6d801740a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c400 tx=0x7f6d7000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70005ce0 con 0x7f6d800ca750 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70005e40 con 0x7f6d800ca750 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d700072f0 con 0x7f6d800ca750 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d800f4e70 con 0x7f6d800ca750 2024-02-21T07:58:28.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.556+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d800f5430 con 0x7f6d800ca750 2024-02-21T07:58:28.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.557+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d800cbb40 con 0x7f6d800ca750 2024-02-21T07:58:28.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.559+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6d70007450 con 0x7f6d800ca750 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.560+0000 7f6d77400640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6d6009f0a0 0x7f6d600a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6d700c9760 con 0x7f6d800ca750 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d7ea00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6d6009f0a0 0x7f6d600a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d77400640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f6d600a9bd0 0x7f6d600ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d600ac740 con 0x7f6d600a9bd0 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d700c9ad0 con 0x7f6d800ca750 2024-02-21T07:58:28.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.561+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f6d600a9bd0 0x7f6d600ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.562+0000 7f6d7ea00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6d6009f0a0 0x7f6d600a1560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d80072fb0 tx=0x7f6d6c009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.562+0000 7f6d7fe00640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f6d600a9bd0 0x7f6d600ac070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.563+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== osd.7 v2:172.21.15.156:6802/717840990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6d600ac740 con 0x7f6d600a9bd0 2024-02-21T07:58:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.577+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 --> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6d80067c80 con 0x7f6d600a9bd0 2024-02-21T07:58:28.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d77400640 1 -- 172.21.15.100:0/2433688987 <== osd.7 v2:172.21.15.156:6802/717840990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6d80067c80 con 0x7f6d600a9bd0 2024-02-21T07:58:28.579 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:28.579 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:28.579 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f6d600a9bd0 msgr2=0x7f6d600ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6802/717840990,v1:172.21.15.156:6803/717840990] conn(0x7f6d600a9bd0 0x7f6d600ac070 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6d6009f0a0 msgr2=0x7f6d600a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6d6009f0a0 0x7f6d600a1560 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d80072fb0 tx=0x7f6d6c009190 comp rx=0 tx=0).stop 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d800ca750 msgr2=0x7f6d801740a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 --2- 172.21.15.100:0/2433688987 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6d800ca750 0x7f6d801740a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c400 tx=0x7f6d7000c8c0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d7fe00640 1 -- 172.21.15.100:0/2433688987 reap_dead start 2024-02-21T07:58:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 shutdown_connections 2024-02-21T07:58:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.578+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 >> 172.21.15.100:0/2433688987 conn(0x7f6d800668b0 msgr2=0x7f6d8006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.579+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 shutdown_connections 2024-02-21T07:58:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.579+0000 7f6d86800640 1 -- 172.21.15.100:0/2433688987 wait complete. 2024-02-21T07:58:28.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-21T07:58:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.804+0000 7f4f14000640 1 Processor -- start 2024-02-21T07:58:28.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.805+0000 7f4f14000640 1 -- start start 2024-02-21T07:58:28.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.806+0000 7f4f14000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f0c189ca0 0x7f4f0c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f14000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4f0c18a080 0x7f4f0c18a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f14000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0ca6a0 con 0x7f4f0c1871c0 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f14000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0f6200 con 0x7f4f0c189ca0 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f14000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0f6450 con 0x7f4f0c18a080 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f0c189ca0 0x7f4f0c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f0c189ca0 0x7f4f0c06ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54930/0 (socket says 172.21.15.100:54930) 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 -- 172.21.15.100:0/2851963643 learned_addr learned my addr 172.21.15.100:0/2851963643 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f12000640 1 --2- 172.21.15.100:0/2851963643 >> v2:172.21.15.170:3300/0 conn(0x7f4f0c18a080 0x7f4f0c18a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 -- 172.21.15.100:0/2851963643 >> v2:172.21.15.170:3300/0 conn(0x7f4f0c18a080 msgr2=0x7f4f0c18a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 --2- 172.21.15.100:0/2851963643 >> v2:172.21.15.170:3300/0 conn(0x7f4f0c18a080 0x7f4f0c18a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 -- 172.21.15.100:0/2851963643 >> v1:172.21.15.156:6789/0 conn(0x7f4f0c1871c0 legacy=0x7f4f0c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f11600640 1 -- 172.21.15.100:0/2851963643 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0ca8d0 con 0x7f4f0c189ca0 2024-02-21T07:58:28.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.807+0000 7f4f0be00640 1 -- 172.21.15.100:0/2851963643 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213648055 0 0) 0x7f4f0c0ca6a0 con 0x7f4f0c1871c0 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.809+0000 7f4f11600640 1 --2- 172.21.15.100:0/2851963643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c06ab60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f7940 tx=0x7f4f0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19934728c1fce8bd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.809+0000 7f4f0be00640 1 -- 172.21.15.100:0/2851963643 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00030860 con 0x7f4f0c189ca0 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.809+0000 7f4f0be00640 1 -- 172.21.15.100:0/2851963643 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f000309c0 con 0x7f4f0c189ca0 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.809+0000 7f4f0be00640 1 -- 172.21.15.100:0/2851963643 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00030d50 con 0x7f4f0c189ca0 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 -- 172.21.15.100:0/2851963643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c189ca0 msgr2=0x7f4f0c06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 --2- 172.21.15.100:0/2851963643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c06ab60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f7940 tx=0x7f4f0002b9a0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 -- 172.21.15.100:0/2851963643 shutdown_connections 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 --2- 172.21.15.100:0/2851963643 >> v2:172.21.15.170:3300/0 conn(0x7f4f0c18a080 0x7f4f0c18a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 --2- 172.21.15.100:0/2851963643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c06ab60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 -- 172.21.15.100:0/2851963643 >> 172.21.15.100:0/2851963643 conn(0x7f4f0c0668b0 msgr2=0x7f4f0c066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 -- 172.21.15.100:0/2851963643 shutdown_connections 2024-02-21T07:58:28.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.810+0000 7f4f14000640 1 -- 172.21.15.100:0/2851963643 wait complete. 2024-02-21T07:58:28.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.812+0000 7f4f14000640 1 Processor -- start 2024-02-21T07:58:28.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.812+0000 7f4f14000640 1 -- start start 2024-02-21T07:58:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c16d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f0c18a080 0x7f4f0c21dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c21c090 con 0x7f4f0c1871c0 2024-02-21T07:58:28.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c21d890 con 0x7f4f0c18a080 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f14000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c21b1a0 con 0x7f4f0c189ca0 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.813+0000 7f4f11600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54934/0 (socket says 172.21.15.100:54934) 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 -- 172.21.15.100:0/1721170563 learned_addr learned my addr 172.21.15.100:0/1721170563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f10c00640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c16d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f12000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f0c18a080 0x7f4f0c21dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 -- 172.21.15.100:0/1721170563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c189ca0 msgr2=0x7f4f0c16d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c16d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 -- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f0c18a080 msgr2=0x7f4f0c21dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f0c18a080 0x7f4f0c21dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 -- 172.21.15.100:0/1721170563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000094d0 con 0x7f4f0c1871c0 2024-02-21T07:58:28.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.814+0000 7f4f11600640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.815+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00039c90 con 0x7f4f0c1871c0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.815+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00039df0 con 0x7f4f0c1871c0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.815+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00043620 con 0x7f4f0c1871c0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.815+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c21b480 con 0x7f4f0c1871c0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.815+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c21ba40 con 0x7f4f0c1871c0 2024-02-21T07:58:28.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.816+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c08e1c0 con 0x7f4f0c1871c0 2024-02-21T07:58:28.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.818+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4f00043780 con 0x7f4f0c1871c0 2024-02-21T07:58:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.819+0000 7f4f09600640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 0x7f4eec0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.819+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4f0003e070 con 0x7f4f0c1871c0 2024-02-21T07:58:28.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.819+0000 7f4f10c00640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 0x7f4eec0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:28.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.820+0000 7f4f10c00640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 0x7f4eec0a1560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f9c90 tx=0x7f4ef8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:28.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:28.821+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4f000b7340 con 0x7f4f0c1871c0 2024-02-21T07:58:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.017+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f0c0cb170 con 0x7f4eec09f0a0 2024-02-21T07:58:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.018+0000 7f4f09600640 1 -- 172.21.15.100:0/1721170563 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ef8001490 con 0x7f4eec09f0a0 2024-02-21T07:58:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-02-21T07:58:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 msgr2=0x7f4eec0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 0x7f4eec0a1560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0f9c90 tx=0x7f4ef8009040 comp rx=0 tx=0).stop 2024-02-21T07:58:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 msgr2=0x7f4f0c21a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f00004730 comp rx=0 tx=0).stop 2024-02-21T07:58:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 shutdown_connections 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f0c18a080 0x7f4f0c21dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4f0c189ca0 0x7f4f0c16d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f4eec09f0a0 0x7f4eec0a1560 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 --2- 172.21.15.100:0/1721170563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f0c1871c0 0x7f4f0c21a900 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 >> 172.21.15.100:0/1721170563 conn(0x7f4f0c0668b0 msgr2=0x7f4f0c073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 shutdown_connections 2024-02-21T07:58:29.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.021+0000 7f4f14000640 1 -- 172.21.15.100:0/1721170563 wait complete. 2024-02-21T07:58:29.040 INFO:tasks.ceph:Scrubbing osd.10 2024-02-21T07:58:29.041 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:29.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.256+0000 7f687ee00640 1 Processor -- start 2024-02-21T07:58:29.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.256+0000 7f687ee00640 1 -- start start 2024-02-21T07:58:29.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687ee00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f6878186010 0x7f68781875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687ee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68781863f0 con 0x7f6878187f80 2024-02-21T07:58:29.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687ee00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687806e920 con 0x7f6878187b20 2024-02-21T07:58:29.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687ee00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687818b8b0 con 0x7f6878186010 2024-02-21T07:58:29.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687e400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6878187f80 0x7f687818c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56634/0 (socket says 172.21.15.100:56634) 2024-02-21T07:58:29.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.258+0000 7f687e400640 1 -- 172.21.15.100:0/759863344 learned_addr learned my addr 172.21.15.100:0/759863344 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:29.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f687da00640 1 --2- 172.21.15.100:0/759863344 >> v2:172.21.15.156:3300/0 conn(0x7f6878186010 0x7f68781875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614877578 0 0) 0x7f68781863f0 con 0x7f6878187f80 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6860003520 con 0x7f6878187f80 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896284561 0 0) 0x7f687806e920 con 0x7f6878187b20 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f687da00640 1 -- 172.21.15.100:0/759863344 >> v1:172.21.15.170:6789/0 conn(0x7f6878187b20 legacy=0x7f687818bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f687da00640 1 -- 172.21.15.100:0/759863344 >> v1:172.21.15.100:6789/0 conn(0x7f6878187f80 legacy=0x7f687818c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.259+0000 7f687da00640 1 -- 172.21.15.100:0/759863344 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6878186820 con 0x7f6878186010 2024-02-21T07:58:29.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.260+0000 7f687da00640 1 --2- 172.21.15.100:0/759863344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68781875e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097a0 tx=0x7f686c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc23eac94389c8ec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c02e070 con 0x7f6878186010 2024-02-21T07:58:29.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c0315a0 con 0x7f6878186010 2024-02-21T07:58:29.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f6877e00640 1 -- 172.21.15.100:0/759863344 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c031910 con 0x7f6878186010 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 -- 172.21.15.100:0/759863344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 msgr2=0x7f68781875e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 --2- 172.21.15.100:0/759863344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68781875e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f686c0097a0 tx=0x7f686c02b840 comp rx=0 tx=0).stop 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 -- 172.21.15.100:0/759863344 shutdown_connections 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 --2- 172.21.15.100:0/759863344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68781875e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 -- 172.21.15.100:0/759863344 >> 172.21.15.100:0/759863344 conn(0x7f68780f6580 msgr2=0x7f68780f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 -- 172.21.15.100:0/759863344 shutdown_connections 2024-02-21T07:58:29.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.261+0000 7f687ee00640 1 -- 172.21.15.100:0/759863344 wait complete. 2024-02-21T07:58:29.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.263+0000 7f687ee00640 1 Processor -- start 2024-02-21T07:58:29.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.264+0000 7f687ee00640 1 -- start start 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68780ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6878187b20 0x7f68780f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 0x7f687818a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687818aba0 con 0x7f6878187f80 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687818ae70 con 0x7f6878186010 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687ee00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687818b150 con 0x7f6878187b20 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 0x7f687818a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68780ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 0x7f687818a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54946/0 (socket says 172.21.15.100:54946) 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687e400640 1 -- 172.21.15.100:0/668430375 learned_addr learned my addr 172.21.15.100:0/668430375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687da00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68780ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.100:46542/0 (socket says 172.21.15.100:46542) 2024-02-21T07:58:29.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.265+0000 7f687d000640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6878187b20 0x7f68780f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 -- 172.21.15.100:0/668430375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6878187b20 msgr2=0x7f68780f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6878187b20 0x7f68780f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 -- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 msgr2=0x7f68780ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6878186010 0x7f68780ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009400 con 0x7f6878187f80 2024-02-21T07:58:29.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687e400640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 0x7f687818a660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f687000cb40 tx=0x7f687000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000aca0 con 0x7f6878187f80 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687000ae00 con 0x7f6878187f80 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870012620 con 0x7f6878187f80 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687818b430 con 0x7f6878187f80 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.266+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68780f57f0 con 0x7f6878187f80 2024-02-21T07:58:29.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.267+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68781870c0 con 0x7f6878187f80 2024-02-21T07:58:29.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.269+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6870007070 con 0x7f6878187f80 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f6875600640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f685809f0a0 0x7f68580a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68700ca2e0 con 0x7f6878187f80 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f687da00640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f685809f0a0 0x7f68580a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f6875600640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f68580a9bd0 0x7f68580ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68580ac740 con 0x7f68580a9bd0 2024-02-21T07:58:29.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68700ca650 con 0x7f6878187f80 2024-02-21T07:58:29.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.271+0000 7f687d000640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f68580a9bd0 0x7f68580ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.272+0000 7f687da00640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f685809f0a0 0x7f68580a1560 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f686c036000 tx=0x7f686c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.272+0000 7f687d000640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f68580a9bd0 0x7f68580ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.273+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== osd.10 v2:172.21.15.156:6826/196442047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f68580ac740 con 0x7f68580a9bd0 2024-02-21T07:58:29.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.287+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 --> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6878186de0 con 0x7f68580a9bd0 2024-02-21T07:58:29.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f6875600640 1 -- 172.21.15.100:0/668430375 <== osd.10 v2:172.21.15.156:6826/196442047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f68640013e0 con 0x7f68580a9bd0 2024-02-21T07:58:29.289 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:29.289 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:29.289 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:29.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f68580a9bd0 msgr2=0x7f68580ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6826/196442047,v1:172.21.15.156:6827/196442047] conn(0x7f68580a9bd0 0x7f68580ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f685809f0a0 msgr2=0x7f68580a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f685809f0a0 0x7f68580a1560 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f686c036000 tx=0x7f686c03d040 comp rx=0 tx=0).stop 2024-02-21T07:58:29.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 msgr2=0x7f687818a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687ee00640 1 --2- 172.21.15.100:0/668430375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6878187f80 0x7f687818a660 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f687000cb40 tx=0x7f687000a060 comp rx=0 tx=0).stop 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.288+0000 7f687e400640 1 -- 172.21.15.100:0/668430375 reap_dead start 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.289+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 shutdown_connections 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.289+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 >> 172.21.15.100:0/668430375 conn(0x7f68780f6580 msgr2=0x7f6878188440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.289+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 shutdown_connections 2024-02-21T07:58:29.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.289+0000 7f687ee00640 1 -- 172.21.15.100:0/668430375 wait complete. 2024-02-21T07:58:29.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-02-21T07:58:29.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.522+0000 7fd0f4400640 1 Processor -- start 2024-02-21T07:58:29.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.523+0000 7fd0f4400640 1 -- start start 2024-02-21T07:58:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.524+0000 7fd0f4400640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fd0ec186280 0x7fd0ec189dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.524+0000 7fd0f4400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0ec1888d0 0x7fd0ec188ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.524+0000 7fd0f4400640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec18aa20 con 0x7fd0ec070a70 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.524+0000 7fd0f4400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0f5580 con 0x7fd0ec1888d0 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.524+0000 7fd0f4400640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0f5860 con 0x7fd0ec186280 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0ec1888d0 0x7fd0ec188ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0ec1888d0 0x7fd0ec188ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54950/0 (socket says 172.21.15.100:54950) 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 -- 172.21.15.100:0/2512144029 learned_addr learned my addr 172.21.15.100:0/2512144029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f1a00640 1 --2- 172.21.15.100:0/2512144029 >> v2:172.21.15.156:3300/0 conn(0x7fd0ec186280 0x7fd0ec189dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0ebe00640 1 -- 172.21.15.100:0/2512144029 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486082647 0 0) 0x7fd0ec18aa20 con 0x7fd0ec070a70 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 -- 172.21.15.100:0/2512144029 >> v2:172.21.15.156:3300/0 conn(0x7fd0ec186280 msgr2=0x7fd0ec189dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 --2- 172.21.15.100:0/2512144029 >> v2:172.21.15.156:3300/0 conn(0x7fd0ec186280 0x7fd0ec189dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 -- 172.21.15.100:0/2512144029 >> v1:172.21.15.170:6789/0 conn(0x7fd0ec070a70 legacy=0x7fd0ec18a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.525+0000 7fd0f2400640 1 -- 172.21.15.100:0/2512144029 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0f5b40 con 0x7fd0ec1888d0 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.526+0000 7fd0f2400640 1 --2- 172.21.15.100:0/2512144029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec188ce0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec074b10 tx=0x7fd0e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f237f87ca872f8f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0ebe00640 1 -- 172.21.15.100:0/2512144029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4031870 con 0x7fd0ec1888d0 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0ebe00640 1 -- 172.21.15.100:0/2512144029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e40319d0 con 0x7fd0ec1888d0 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0ebe00640 1 -- 172.21.15.100:0/2512144029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4031d60 con 0x7fd0ec1888d0 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 -- 172.21.15.100:0/2512144029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec1888d0 msgr2=0x7fd0ec188ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 --2- 172.21.15.100:0/2512144029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec188ce0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec074b10 tx=0x7fd0e402b910 comp rx=0 tx=0).stop 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 -- 172.21.15.100:0/2512144029 shutdown_connections 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 --2- 172.21.15.100:0/2512144029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec188ce0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 --2- 172.21.15.100:0/2512144029 >> v2:172.21.15.156:3300/0 conn(0x7fd0ec186280 0x7fd0ec189dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 -- 172.21.15.100:0/2512144029 >> 172.21.15.100:0/2512144029 conn(0x7fd0ec0668b0 msgr2=0x7fd0ec066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 -- 172.21.15.100:0/2512144029 shutdown_connections 2024-02-21T07:58:29.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.527+0000 7fd0f4400640 1 -- 172.21.15.100:0/2512144029 wait complete. 2024-02-21T07:58:29.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.529+0000 7fd0f4400640 1 Processor -- start 2024-02-21T07:58:29.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.530+0000 7fd0f4400640 1 -- start start 2024-02-21T07:58:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 0x7fd0ec220060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec2205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec220ae0 con 0x7fd0ec070a70 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0f9370 con 0x7fd0ec186280 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f4400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0f8480 con 0x7fd0ec1888d0 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 0x7fd0ec220060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54952/0 (socket says 172.21.15.100:54952) 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 -- 172.21.15.100:0/3982292361 learned_addr learned my addr 172.21.15.100:0/3982292361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f2400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec2205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 -- 172.21.15.100:0/3982292361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0ec1888d0 msgr2=0x7fd0ec2205a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec2205a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 -- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 msgr2=0x7fd0ec220060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 0x7fd0ec220060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.531+0000 7fd0f1a00640 1 -- 172.21.15.100:0/3982292361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40094d0 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0f1000640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 0x7fd0ec220060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0f1a00640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000e870 tx=0x7fd0e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00094f0 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000c940 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e000ccf0 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec0f8760 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.532+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec0f8d20 con 0x7fd0ec070a70 2024-02-21T07:58:29.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.533+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec071e70 con 0x7fd0ec070a70 2024-02-21T07:58:29.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.536+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd0e0013470 con 0x7fd0ec070a70 2024-02-21T07:58:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.538+0000 7fd0e9600640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 0x7fd0d00a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.538+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd0e00c9c30 con 0x7fd0ec070a70 2024-02-21T07:58:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.539+0000 7fd0f1000640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 0x7fd0d00a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.539+0000 7fd0f1000640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 0x7fd0d00a1590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0cbce0 tx=0x7fd0dc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.543+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0e00939d0 con 0x7fd0ec070a70 2024-02-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.740+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0ec0f6100 con 0x7fd0d009f0d0 2024-02-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.741+0000 7fd0e9600640 1 -- 172.21.15.100:0/3982292361 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7fd0dc00fda0 con 0x7fd0d009f0d0 2024-02-21T07:58:29.742 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 10 to deep-scrub 2024-02-21T07:58:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 msgr2=0x7fd0d00a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 0x7fd0d00a1590 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0cbce0 tx=0x7fd0dc009040 comp rx=0 tx=0).stop 2024-02-21T07:58:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 msgr2=0x7fd0ec16ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd0e000e870 tx=0x7fd0e000ed30 comp rx=0 tx=0).stop 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 shutdown_connections 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0ec1888d0 0x7fd0ec2205a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0ec186280 0x7fd0ec220060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fd0d009f0d0 0x7fd0d00a1590 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 --2- 172.21.15.100:0/3982292361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec070a70 0x7fd0ec16ec30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 >> 172.21.15.100:0/3982292361 conn(0x7fd0ec0668b0 msgr2=0x7fd0ec06da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 shutdown_connections 2024-02-21T07:58:29.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.744+0000 7fd0f4400640 1 -- 172.21.15.100:0/3982292361 wait complete. 2024-02-21T07:58:29.763 INFO:tasks.ceph:Scrubbing osd.2 2024-02-21T07:58:29.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.975+0000 7f689dc00640 1 Processor -- start 2024-02-21T07:58:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.976+0000 7f689dc00640 1 -- start start 2024-02-21T07:58:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f689dc00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6898188b90 0x7f6898183510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f689dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 0x7f6898189680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f689dc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6898070fa0 con 0x7f6898072600 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f689dc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6898071280 con 0x7f6898183a50 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f689dc00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6898071560 con 0x7f6898188b90 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f6897400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 0x7f6898189680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f6896a00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6898188b90 0x7f6898183510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f6897400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 0x7f6898189680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58824/0 (socket says 172.21.15.100:58824) 2024-02-21T07:58:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.978+0000 7f6897400640 1 -- 172.21.15.100:0/1630950389 learned_addr learned my addr 172.21.15.100:0/1630950389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.979+0000 7f6896a00640 1 -- 172.21.15.100:0/1630950389 >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 msgr2=0x7f6898189680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.979+0000 7f6896a00640 1 --2- 172.21.15.100:0/1630950389 >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 0x7f6898189680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.979+0000 7f6896a00640 1 -- 172.21.15.100:0/1630950389 >> v1:172.21.15.100:6789/0 conn(0x7f6898072600 legacy=0x7f6898188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.979+0000 7f6896a00640 1 -- 172.21.15.100:0/1630950389 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898071840 con 0x7f6898188b90 2024-02-21T07:58:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.980+0000 7f6896a00640 1 --2- 172.21.15.100:0/1630950389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898188b90 0x7f6898183510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f689808e750 tx=0x7f688802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48e7bb63a7e2aef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.980+0000 7f6895600640 1 -- 172.21.15.100:0/1630950389 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688802e070 con 0x7f6898188b90 2024-02-21T07:58:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.980+0000 7f6895600640 1 -- 172.21.15.100:0/1630950389 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68880315a0 con 0x7f6898188b90 2024-02-21T07:58:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.980+0000 7f6895600640 1 -- 172.21.15.100:0/1630950389 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888031930 con 0x7f6898188b90 2024-02-21T07:58:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 -- 172.21.15.100:0/1630950389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898188b90 msgr2=0x7f6898183510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 --2- 172.21.15.100:0/1630950389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898188b90 0x7f6898183510 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f689808e750 tx=0x7f688802b840 comp rx=0 tx=0).stop 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 -- 172.21.15.100:0/1630950389 shutdown_connections 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 --2- 172.21.15.100:0/1630950389 >> v2:172.21.15.100:3300/0 conn(0x7f6898183a50 0x7f6898189680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 --2- 172.21.15.100:0/1630950389 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898188b90 0x7f6898183510 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 -- 172.21.15.100:0/1630950389 >> 172.21.15.100:0/1630950389 conn(0x7f68980668b0 msgr2=0x7f6898066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 -- 172.21.15.100:0/1630950389 shutdown_connections 2024-02-21T07:58:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.981+0000 7f689dc00640 1 -- 172.21.15.100:0/1630950389 wait complete. 2024-02-21T07:58:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.983+0000 7f689dc00640 1 Processor -- start 2024-02-21T07:58:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.983+0000 7f689dc00640 1 -- start start 2024-02-21T07:58:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 0x7f6898154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898183a50 0x7f6898175130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6898188b90 0x7f6898173be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689817e1f0 con 0x7f6898072600 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68981737c0 con 0x7f6898188b90 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.984+0000 7f689dc00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6898154d90 con 0x7f6898183a50 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 0x7f6898154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 0x7f6898154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58834/0 (socket says 172.21.15.100:58834) 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 -- 172.21.15.100:0/1385323290 learned_addr learned my addr 172.21.15.100:0/1385323290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896000640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898183a50 0x7f6898175130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6897400640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6898188b90 0x7f6898173be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 -- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898183a50 msgr2=0x7f6898175130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6898183a50 0x7f6898175130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 -- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6898188b90 msgr2=0x7f6898173be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6898188b90 0x7f6898173be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.985+0000 7f6896a00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6888009400 con 0x7f6898072600 2024-02-21T07:58:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f6896a00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 0x7f6898154850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6888009890 tx=0x7f68880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888032840 con 0x7f6898072600 2024-02-21T07:58:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68880329a0 con 0x7f6898072600 2024-02-21T07:58:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898175a70 con 0x7f6898072600 2024-02-21T07:58:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888032d50 con 0x7f6898072600 2024-02-21T07:58:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.986+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6898176030 con 0x7f6898072600 2024-02-21T07:58:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.987+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68980720e0 con 0x7f6898072600 2024-02-21T07:58:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.989+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f68880453f0 con 0x7f6898072600 2024-02-21T07:58:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.990+0000 7f688ea00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f687409f0d0 0x7f68740a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.990+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f68880ec0d0 con 0x7f6898072600 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.990+0000 7f6896000640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f687409f0d0 0x7f68740a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.990+0000 7f688ea00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f68740a9c00 0x7f68740ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.990+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68740ac770 con 0x7f68740a9c00 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.991+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68880ec440 con 0x7f6898072600 2024-02-21T07:58:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.991+0000 7f6897400640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f68740a9c00 0x7f68740ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.991+0000 7f6896000640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f687409f0d0 0x7f68740a1590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68980f6720 tx=0x7f6880009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.992+0000 7f6897400640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f68740a9c00 0x7f68740ac0a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:29.992+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== osd.2 v2:172.21.15.170:6808/2385898437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f68740ac770 con 0x7f68740a9c00 2024-02-21T07:58:30.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.007+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 --> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f68980749a0 con 0x7f68740a9c00 2024-02-21T07:58:30.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.007+0000 7f688ea00640 1 -- 172.21.15.100:0/1385323290 <== osd.2 v2:172.21.15.170:6808/2385898437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f68980749a0 con 0x7f68740a9c00 2024-02-21T07:58:30.009 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:30.009 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:30.009 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f68740a9c00 msgr2=0x7f68740ac0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.170:6808/2385898437,v1:172.21.15.170:6809/2385898437] conn(0x7f68740a9c00 0x7f68740ac0a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f687409f0d0 msgr2=0x7f68740a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f687409f0d0 0x7f68740a1590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68980f6720 tx=0x7f6880009040 comp rx=0 tx=0).stop 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 msgr2=0x7f6898154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 --2- 172.21.15.100:0/1385323290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6898072600 0x7f6898154850 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6888009890 tx=0x7f68880046c0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f6897400640 1 -- 172.21.15.100:0/1385323290 reap_dead start 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 shutdown_connections 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 >> 172.21.15.100:0/1385323290 conn(0x7f68980668b0 msgr2=0x7f689808cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 shutdown_connections 2024-02-21T07:58:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.008+0000 7f689dc00640 1 -- 172.21.15.100:0/1385323290 wait complete. 2024-02-21T07:58:30.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-21T07:58:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.239+0000 7ff724a00640 1 Processor -- start 2024-02-21T07:58:30.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.239+0000 7ff724a00640 1 -- start start 2024-02-21T07:58:30.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.241+0000 7ff724a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7201897c0 con 0x7ff7200fc630 2024-02-21T07:58:30.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.241+0000 7ff724a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff720182c30 con 0x7ff720189ca0 2024-02-21T07:58:30.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.241+0000 7ff724a00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200fcd60 con 0x7ff720182850 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff7200fc630 0x7ff7200d5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57284/0 (socket says 172.21.15.100:57284) 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71fe00640 1 -- 172.21.15.100:0/3957848243 learned_addr learned my addr 172.21.15.100:0/3957848243 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71ea00640 1 --1- 172.21.15.100:0/3957848243 >> v1:172.21.15.156:6789/0 conn(0x7ff720189ca0 0x7ff7200fbf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39674/0 (socket says 172.21.15.100:39674) 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805767220 0 0) 0x7ff7201897c0 con 0x7ff7200fc630 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700003520 con 0x7ff7200fc630 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339676663 0 0) 0x7ff7200fcd60 con 0x7ff720182850 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7201897c0 con 0x7ff720182850 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972022927 0 0) 0x7ff720182c30 con 0x7ff720189ca0 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7200fcd60 con 0x7ff720189ca0 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.242+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v1:172.21.15.170:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2835676144 0 0) 0x7ff7201897c0 con 0x7ff720182850 2024-02-21T07:58:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 >> v1:172.21.15.156:6789/0 conn(0x7ff720189ca0 legacy=0x7ff7200fbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 >> v1:172.21.15.100:6789/0 conn(0x7ff7200fc630 legacy=0x7ff7200d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> v1:172.21.15.170:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72006bad0 con 0x7ff720182850 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v1:172.21.15.170:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1528314909 0 0) 0x7ff710001690 con 0x7ff720182850 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 >> v1:172.21.15.170:6789/0 conn(0x7ff720182850 legacy=0x7ff72006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff700004d20 0x7ff700005100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff700003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff700004340 0x7ff70000ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180015b0 con 0x7ff700004d20 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70000c2e0 con 0x7ff700004340 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70000c4a0 con 0x7ff7000037b0 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71f400640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff700004d20 0x7ff700005100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff700003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71fe00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff700004340 0x7ff70000ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 -- 172.21.15.100:0/3957848243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff700004340 msgr2=0x7ff70000ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff700004340 0x7ff70000ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 -- 172.21.15.100:0/3957848243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff700004d20 msgr2=0x7ff700005100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff700004d20 0x7ff700005100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71ea00640 1 -- 172.21.15.100:0/3957848243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7201897c0 con 0x7ff7000037b0 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71f400640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff700004d20 0x7ff700005100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.243+0000 7ff71fe00640 1 -- 172.21.15.100:0/3957848243 reap_dead start 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff71ea00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff700003c30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff708001890 tx=0x7ff7000057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4533da3d09ab9a37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708007270 con 0x7ff7000037b0 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7080073f0 con 0x7ff7000037b0 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff71e000640 1 -- 172.21.15.100:0/3957848243 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7080047e0 con 0x7ff7000037b0 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff724a00640 1 -- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 msgr2=0x7ff700003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff724a00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff700003c30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff708001890 tx=0x7ff7000057f0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff724a00640 1 -- 172.21.15.100:0/3957848243 shutdown_connections 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff724a00640 1 --2- 172.21.15.100:0/3957848243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff700003c30 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.245+0000 7ff724a00640 1 -- 172.21.15.100:0/3957848243 >> 172.21.15.100:0/3957848243 conn(0x7ff7200fe020 msgr2=0x7ff7200fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.246+0000 7ff724a00640 1 -- 172.21.15.100:0/3957848243 shutdown_connections 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.246+0000 7ff724a00640 1 -- 172.21.15.100:0/3957848243 wait complete. 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.248+0000 7ff724a00640 1 Processor -- start 2024-02-21T07:58:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.248+0000 7ff724a00640 1 -- start start 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff720182e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff72016e360 0x7ff72021e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720184710 con 0x7ff72016e7e0 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720183540 con 0x7ff72016e360 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff724a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff720183820 con 0x7ff7000037b0 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58854/0 (socket says 172.21.15.100:58854) 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff71fe00640 1 -- 172.21.15.100:0/3926974234 learned_addr learned my addr 172.21.15.100:0/3926974234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff71f400640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff720182e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.249+0000 7ff71ea00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff72016e360 0x7ff72021e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 -- 172.21.15.100:0/3926974234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 msgr2=0x7ff720182e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff720182e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 -- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff72016e360 msgr2=0x7ff72021e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff72016e360 0x7ff72021e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 -- 172.21.15.100:0/3926974234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720183b00 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff71fe00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff7200d3650 tx=0x7ff7180079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180017e0 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71800a970 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71800ace0 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff720183de0 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.250+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7201843a0 con 0x7ff72016e7e0 2024-02-21T07:58:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.252+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff720184880 con 0x7ff72016e7e0 2024-02-21T07:58:30.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.254+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff7180133f0 con 0x7ff72016e7e0 2024-02-21T07:58:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.255+0000 7ff717400640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 0x7ff6fc0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.255+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff7180ca120 con 0x7ff72016e7e0 2024-02-21T07:58:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.255+0000 7ff71f400640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 0x7ff6fc0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.256+0000 7ff71f400640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 0x7ff6fc0a1590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff710001100 tx=0x7ff710009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.259+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff718093f30 con 0x7ff72016e7e0 2024-02-21T07:58:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.459+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff72006c370 con 0x7ff6fc09f0d0 2024-02-21T07:58:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.460+0000 7ff717400640 1 -- 172.21.15.100:0/3926974234 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff710001540 con 0x7ff6fc09f0d0 2024-02-21T07:58:30.461 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 msgr2=0x7ff6fc0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 0x7ff6fc0a1590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff710001100 tx=0x7ff710009040 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 msgr2=0x7ff72021ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff7200d3650 tx=0x7ff7180079d0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 shutdown_connections 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7ff6fc09f0d0 0x7ff6fc0a1590 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72016e7e0 0x7ff72021ee60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff72016e360 0x7ff72021e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 --2- 172.21.15.100:0/3926974234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff7000037b0 0x7ff720182e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 >> 172.21.15.100:0/3926974234 conn(0x7ff7200fe020 msgr2=0x7ff72006c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.462+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 shutdown_connections 2024-02-21T07:58:30.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.463+0000 7ff724a00640 1 -- 172.21.15.100:0/3926974234 wait complete. 2024-02-21T07:58:30.481 INFO:tasks.ceph:Scrubbing osd.5 2024-02-21T07:58:30.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.693+0000 7f94ca600640 1 Processor -- start 2024-02-21T07:58:30.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.693+0000 7f94ca600640 1 -- start start 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94ca600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f94c4189680 0x7f94c40f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94ca600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c4070fa0 con 0x7f94c4188b90 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94ca600640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c4071280 con 0x7f94c4072600 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94ca600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c4071560 con 0x7f94c4189680 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94c3e00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f94c4189680 0x7f94c40f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94c3400640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f94c4188b90 0x7f94c4183510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39684/0 (socket says 172.21.15.100:39684) 2024-02-21T07:58:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.695+0000 7f94c3400640 1 -- 172.21.15.100:0/897514691 learned_addr learned my addr 172.21.15.100:0/897514691 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596176238 0 0) 0x7f94c4070fa0 con 0x7f94c4188b90 2024-02-21T07:58:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a8005730 con 0x7f94c4188b90 2024-02-21T07:58:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034846203 0 0) 0x7f94c4071280 con 0x7f94c4072600 2024-02-21T07:58:30.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c3e00640 1 -- 172.21.15.100:0/897514691 >> v1:172.21.15.170:6789/0 conn(0x7f94c4072600 legacy=0x7f94c4188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c3e00640 1 -- 172.21.15.100:0/897514691 >> v1:172.21.15.156:6789/0 conn(0x7f94c4188b90 legacy=0x7f94c4183510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.696+0000 7f94c3e00640 1 -- 172.21.15.100:0/897514691 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4071840 con 0x7f94c4189680 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.697+0000 7f94c3e00640 1 --2- 172.21.15.100:0/897514691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c40f90a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009d90 tx=0x7f94bc02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eaca1caf4b26944 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.697+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc02cc60 con 0x7f94c4189680 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.697+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc02cdc0 con 0x7f94c4189680 2024-02-21T07:58:30.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.697+0000 7f94c2000640 1 -- 172.21.15.100:0/897514691 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc034660 con 0x7f94c4189680 2024-02-21T07:58:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 -- 172.21.15.100:0/897514691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 msgr2=0x7f94c40f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 --2- 172.21.15.100:0/897514691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c40f90a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f94bc009d90 tx=0x7f94bc02beb0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 -- 172.21.15.100:0/897514691 shutdown_connections 2024-02-21T07:58:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 --2- 172.21.15.100:0/897514691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c40f90a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 -- 172.21.15.100:0/897514691 >> 172.21.15.100:0/897514691 conn(0x7f94c40668b0 msgr2=0x7f94c4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 -- 172.21.15.100:0/897514691 shutdown_connections 2024-02-21T07:58:30.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.698+0000 7f94ca600640 1 -- 172.21.15.100:0/897514691 wait complete. 2024-02-21T07:58:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.700+0000 7f94ca600640 1 Processor -- start 2024-02-21T07:58:30.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.700+0000 7f94ca600640 1 -- start start 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 0x7f94c41725c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c4188b90 0x7f94c4070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c4070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c406f2d0 con 0x7f94c4072600 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c417e2c0 con 0x7f94c4189680 2024-02-21T07:58:30.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94ca600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c417e5a0 con 0x7f94c4188b90 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94c3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 0x7f94c41725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94c3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 0x7f94c41725c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58862/0 (socket says 172.21.15.100:58862) 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94c3400640 1 -- 172.21.15.100:0/286118536 learned_addr learned my addr 172.21.15.100:0/286118536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.701+0000 7f94c2a00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c4188b90 0x7f94c4070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3e00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c4070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 -- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c4188b90 msgr2=0x7f94c4070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f94c4188b90 0x7f94c4070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 -- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 msgr2=0x7f94c4070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94c4189680 0x7f94c4070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc009a70 con 0x7f94c4072600 2024-02-21T07:58:30.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94c3400640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 0x7f94c41725c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c500 tx=0x7f94b400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4005ce0 con 0x7f94c4072600 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4005e40 con 0x7f94c4072600 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.702+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007330 con 0x7f94c4072600 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.703+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c406f520 con 0x7f94c4072600 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.703+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c406fae0 con 0x7f94c4072600 2024-02-21T07:58:30.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.704+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94c40720e0 con 0x7f94c4072600 2024-02-21T07:58:30.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.706+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f94b4007550 con 0x7f94c4072600 2024-02-21T07:58:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94bb400640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f94a009f0a0 0x7f94a00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f94b40c97e0 con 0x7f94c4072600 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94c2a00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f94a009f0a0 0x7f94a00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94bb400640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7f94a00a9bd0 0x7f94a00ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94a00ac740 con 0x7f94a00a9bd0 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.707+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94b40c9b50 con 0x7f94c4072600 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.708+0000 7f94c3e00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7f94a00a9bd0 0x7f94a00ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.708+0000 7f94c2a00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f94a009f0a0 0x7f94a00a1560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94c421c650 tx=0x7f94ac009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.709+0000 7f94c3e00640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7f94a00a9bd0 0x7f94a00ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.709+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== osd.5 v2:172.21.15.170:6816/106220500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f94a00ac740 con 0x7f94a00a9bd0 2024-02-21T07:58:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.724+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 --> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94c4071e00 con 0x7f94a00a9bd0 2024-02-21T07:58:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.724+0000 7f94bb400640 1 -- 172.21.15.100:0/286118536 <== osd.5 v2:172.21.15.170:6816/106220500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f94bc02ca60 con 0x7f94a00a9bd0 2024-02-21T07:58:30.726 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:30.726 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:30.726 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7f94a00a9bd0 msgr2=0x7f94a00ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.170:6816/106220500,v1:172.21.15.170:6817/106220500] conn(0x7f94a00a9bd0 0x7f94a00ac070 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f94a009f0a0 msgr2=0x7f94a00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f94a009f0a0 0x7f94a00a1560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f94c421c650 tx=0x7f94ac009040 comp rx=0 tx=0).stop 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 msgr2=0x7f94c41725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 --2- 172.21.15.100:0/286118536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c4072600 0x7f94c41725c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f94b400c500 tx=0x7f94b400c9c0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94c3e00640 1 -- 172.21.15.100:0/286118536 reap_dead start 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 shutdown_connections 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 >> 172.21.15.100:0/286118536 conn(0x7f94c40668b0 msgr2=0x7f94c4188f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 shutdown_connections 2024-02-21T07:58:30.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.725+0000 7f94ca600640 1 -- 172.21.15.100:0/286118536 wait complete. 2024-02-21T07:58:30.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-21T07:58:30.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.950+0000 7fe92fe00640 1 Processor -- start 2024-02-21T07:58:30.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.950+0000 7fe92fe00640 1 -- start start 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 0x7fe9300cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9300cb630 0x7fe9300f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9300f94b0 0x7fe93006d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93017d490 con 0x7fe9300cb630 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300cac60 con 0x7fe93017d0b0 2024-02-21T07:58:30.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92fe00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9300cba90 con 0x7fe9300f94b0 2024-02-21T07:58:30.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9300f94b0 0x7fe93006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92ea00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 0x7fe9300cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92f400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7fe9300f94b0 0x7fe93006d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34400/0 (socket says 172.21.15.100:34400) 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.952+0000 7fe92f400640 1 -- 172.21.15.100:0/3397334620 learned_addr learned my addr 172.21.15.100:0/3397334620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe926000640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.100:3300/0 conn(0x7fe9300cb630 0x7fe9300f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92f400640 1 -- 172.21.15.100:0/3397334620 >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 msgr2=0x7fe9300cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92f400640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 0x7fe9300cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92f400640 1 -- 172.21.15.100:0/3397334620 >> v2:172.21.15.100:3300/0 conn(0x7fe9300cb630 msgr2=0x7fe9300f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92f400640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.100:3300/0 conn(0x7fe9300cb630 0x7fe9300f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92f400640 1 -- 172.21.15.100:0/3397334620 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93006e830 con 0x7fe9300f94b0 2024-02-21T07:58:30.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.953+0000 7fe92ea00640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 0x7fe9300cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.954+0000 7fe92f400640 1 --2- 172.21.15.100:0/3397334620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300f94b0 0x7fe93006d950 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe93008d5e0 tx=0x7fe92802bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182e3f4da7c39101 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.954+0000 7fe92e000640 1 -- 172.21.15.100:0/3397334620 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92802caa0 con 0x7fe9300f94b0 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.954+0000 7fe92e000640 1 -- 172.21.15.100:0/3397334620 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92802cc00 con 0x7fe9300f94b0 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.954+0000 7fe92e000640 1 -- 172.21.15.100:0/3397334620 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280343f0 con 0x7fe9300f94b0 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 -- 172.21.15.100:0/3397334620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300f94b0 msgr2=0x7fe93006d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 --2- 172.21.15.100:0/3397334620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300f94b0 0x7fe93006d950 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe93008d5e0 tx=0x7fe92802bf00 comp rx=0 tx=0).stop 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 -- 172.21.15.100:0/3397334620 shutdown_connections 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 --2- 172.21.15.100:0/3397334620 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300f94b0 0x7fe93006d950 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.100:3300/0 conn(0x7fe9300cb630 0x7fe9300f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 --2- 172.21.15.100:0/3397334620 >> v2:172.21.15.156:3300/0 conn(0x7fe93017d0b0 0x7fe9300cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 -- 172.21.15.100:0/3397334620 >> 172.21.15.100:0/3397334620 conn(0x7fe9300ce150 msgr2=0x7fe9300ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:30.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 -- 172.21.15.100:0/3397334620 shutdown_connections 2024-02-21T07:58:30.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.955+0000 7fe92fe00640 1 -- 172.21.15.100:0/3397334620 wait complete. 2024-02-21T07:58:30.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.957+0000 7fe92fe00640 1 Processor -- start 2024-02-21T07:58:30.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.957+0000 7fe92fe00640 1 -- start start 2024-02-21T07:58:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cb630 0x7fe9300cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9300f94b0 0x7fe93016e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930222720 con 0x7fe93017d0b0 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930071d50 con 0x7fe9300f94b0 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.958+0000 7fe92fe00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe930072030 con 0x7fe9300cb630 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58886/0 (socket says 172.21.15.100:58886) 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe926000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9300f94b0 0x7fe93016e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 -- 172.21.15.100:0/1155015298 learned_addr learned my addr 172.21.15.100:0/1155015298 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92ea00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cb630 0x7fe9300cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 -- 172.21.15.100:0/1155015298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cb630 msgr2=0x7fe9300cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cb630 0x7fe9300cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 -- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9300f94b0 msgr2=0x7fe93016e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:30.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9300f94b0 0x7fe93016e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:30.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 -- 172.21.15.100:0/1155015298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009400 con 0x7fe93017d0b0 2024-02-21T07:58:30.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.959+0000 7fe92f400640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe928036040 tx=0x7fe928004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.960+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928009510 con 0x7fe93017d0b0 2024-02-21T07:58:30.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.960+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92803e450 con 0x7fe93017d0b0 2024-02-21T07:58:30.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.960+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92803e800 con 0x7fe93017d0b0 2024-02-21T07:58:30.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.960+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe928009b30 con 0x7fe93017d0b0 2024-02-21T07:58:30.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.960+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300725f0 con 0x7fe93017d0b0 2024-02-21T07:58:30.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.961+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9300751d0 con 0x7fe93017d0b0 2024-02-21T07:58:30.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.963+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe92803e960 con 0x7fe93017d0b0 2024-02-21T07:58:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.964+0000 7fe927e00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 0x7fe90c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.964+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9280ec810 con 0x7fe93017d0b0 2024-02-21T07:58:30.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.964+0000 7fe92ea00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 0x7fe90c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:30.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.965+0000 7fe92ea00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 0x7fe90c0a1560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe920009c30 tx=0x7fe920009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:30.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:30.968+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe9280b6500 con 0x7fe93017d0b0 2024-02-21T07:58:31.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.164+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93006edf0 con 0x7fe90c09f0a0 2024-02-21T07:58:31.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.165+0000 7fe927e00640 1 -- 172.21.15.100:0/1155015298 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe920009880 con 0x7fe90c09f0a0 2024-02-21T07:58:31.166 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-02-21T07:58:31.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 msgr2=0x7fe90c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 0x7fe90c0a1560 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe920009c30 tx=0x7fe920009190 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 msgr2=0x7fe930070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe928036040 tx=0x7fe928004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 shutdown_connections 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fe90c09f0a0 0x7fe90c0a1560 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe93017d0b0 0x7fe930070f10 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe9300f94b0 0x7fe93016e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 --2- 172.21.15.100:0/1155015298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9300cb630 0x7fe9300cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 >> 172.21.15.100:0/1155015298 conn(0x7fe9300ce150 msgr2=0x7fe9300c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.167+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 shutdown_connections 2024-02-21T07:58:31.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.168+0000 7fe92fe00640 1 -- 172.21.15.100:0/1155015298 wait complete. 2024-02-21T07:58:31.187 INFO:tasks.ceph:Scrubbing osd.8 2024-02-21T07:58:31.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:31.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.399+0000 7fc5cb000640 1 Processor -- start 2024-02-21T07:58:31.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.400+0000 7fc5cb000640 1 -- start start 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5cb000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7fc5c418ab00 0x7fc5c406f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5cb000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c418a850 con 0x7fc5c418a470 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5cb000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c406e470 con 0x7fc5c406f750 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5cb000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c418dba0 con 0x7fc5c418ab00 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5c3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc5c418a470 0x7fc5c406e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57298/0 (socket says 172.21.15.100:57298) 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5c3e00640 1 -- 172.21.15.100:0/1741637749 learned_addr learned my addr 172.21.15.100:0/1741637749 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.402+0000 7fc5bb400640 1 --2- 172.21.15.100:0/1741637749 >> v2:172.21.15.156:3300/0 conn(0x7fc5c418ab00 0x7fc5c406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102218004 0 0) 0x7fc5c418a850 con 0x7fc5c418a470 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a8003520 con 0x7fc5c418a470 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518348692 0 0) 0x7fc5c406e470 con 0x7fc5c406f750 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c418a850 con 0x7fc5c406f750 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5bb400640 1 -- 172.21.15.100:0/1741637749 >> v1:172.21.15.170:6789/0 conn(0x7fc5c406f750 legacy=0x7fc5c40f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5bb400640 1 -- 172.21.15.100:0/1741637749 >> v1:172.21.15.100:6789/0 conn(0x7fc5c418a470 legacy=0x7fc5c406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.403+0000 7fc5bb400640 1 -- 172.21.15.100:0/1741637749 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c418af60 con 0x7fc5c418ab00 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.404+0000 7fc5bb400640 1 --2- 172.21.15.100:0/1741637749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c406f210 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0097a0 tx=0x7fc5ac02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab620925350750ae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.404+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac02e070 con 0x7fc5c418ab00 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.404+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac0315a0 con 0x7fc5c418ab00 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.404+0000 7fc5c3400640 1 -- 172.21.15.100:0/1741637749 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac031930 con 0x7fc5c418ab00 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 -- 172.21.15.100:0/1741637749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 msgr2=0x7fc5c406f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 --2- 172.21.15.100:0/1741637749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c406f210 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0097a0 tx=0x7fc5ac02b840 comp rx=0 tx=0).stop 2024-02-21T07:58:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 -- 172.21.15.100:0/1741637749 shutdown_connections 2024-02-21T07:58:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 --2- 172.21.15.100:0/1741637749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c406f210 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 -- 172.21.15.100:0/1741637749 >> 172.21.15.100:0/1741637749 conn(0x7fc5c40668b0 msgr2=0x7fc5c4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 -- 172.21.15.100:0/1741637749 shutdown_connections 2024-02-21T07:58:31.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.405+0000 7fc5cb000640 1 -- 172.21.15.100:0/1741637749 wait complete. 2024-02-21T07:58:31.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.407+0000 7fc5cb000640 1 Processor -- start 2024-02-21T07:58:31.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.407+0000 7fc5cb000640 1 -- start start 2024-02-21T07:58:31.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5c406f750 0x7fc5c4223a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 0x7fc5c40cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c41768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41858a0 con 0x7fc5c418a470 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40cc300 con 0x7fc5c418ab00 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5cb000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40cc5e0 con 0x7fc5c406f750 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 0x7fc5c40cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5c406f750 0x7fc5c4223a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 0x7fc5c40cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58890/0 (socket says 172.21.15.100:58890) 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 -- 172.21.15.100:0/4083875886 learned_addr learned my addr 172.21.15.100:0/4083875886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5c9000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c41768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 -- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5c406f750 msgr2=0x7fc5c4223a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc5c406f750 0x7fc5c4223a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 -- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 msgr2=0x7fc5c41768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc5c418ab00 0x7fc5c41768a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.409+0000 7fc5bb400640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ac009400 con 0x7fc5c418a470 2024-02-21T07:58:31.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5bb400640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 0x7fc5c40cd680 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac031f10 con 0x7fc5c418a470 2024-02-21T07:58:31.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac032860 con 0x7fc5c418a470 2024-02-21T07:58:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac032c10 con 0x7fc5c418a470 2024-02-21T07:58:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40cc8c0 con 0x7fc5c418a470 2024-02-21T07:58:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.410+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40cce80 con 0x7fc5c418a470 2024-02-21T07:58:31.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.411+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5c406de20 con 0x7fc5c418a470 2024-02-21T07:58:31.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.413+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc5ac04d3a0 con 0x7fc5c418a470 2024-02-21T07:58:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.414+0000 7fc5c0c00640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc5a009f0a0 0x7fc5a00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5ac0ebc30 con 0x7fc5c418a470 2024-02-21T07:58:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c0c00640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7fc5a00a9be0 0x7fc5a00ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5a00ac750 con 0x7fc5a00a9be0 2024-02-21T07:58:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c3e00640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc5a009f0a0 0x7fc5a00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ac0ec030 con 0x7fc5c418a470 2024-02-21T07:58:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c9000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7fc5a00a9be0 0x7fc5a00ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.415+0000 7fc5c3e00640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc5a009f0a0 0x7fc5a00a1560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000f60 tx=0x7fc5b4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.416+0000 7fc5c9000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7fc5a00a9be0 0x7fc5a00ac080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.416+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== osd.8 v2:172.21.15.170:6800/2369868004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5a00ac750 con 0x7fc5a00a9be0 2024-02-21T07:58:31.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.431+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 --> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5c406db40 con 0x7fc5a00a9be0 2024-02-21T07:58:31.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5c0c00640 1 -- 172.21.15.100:0/4083875886 <== osd.8 v2:172.21.15.170:6800/2369868004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5bc001aa0 con 0x7fc5a00a9be0 2024-02-21T07:58:31.433 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:31.433 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:31.433 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7fc5a00a9be0 msgr2=0x7fc5a00ac080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.170:6800/2369868004,v1:172.21.15.170:6801/2369868004] conn(0x7fc5a00a9be0 0x7fc5a00ac080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc5a009f0a0 msgr2=0x7fc5a00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7fc5a009f0a0 0x7fc5a00a1560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000f60 tx=0x7fc5b4009040 comp rx=0 tx=0).stop 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 msgr2=0x7fc5c40cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 --2- 172.21.15.100:0/4083875886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc5c418a470 0x7fc5c40cd680 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac000c00 tx=0x7fc5ac0046c0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5c9000640 1 -- 172.21.15.100:0/4083875886 reap_dead start 2024-02-21T07:58:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 shutdown_connections 2024-02-21T07:58:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.432+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 >> 172.21.15.100:0/4083875886 conn(0x7fc5c40668b0 msgr2=0x7fc5c4072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.433+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 shutdown_connections 2024-02-21T07:58:31.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.433+0000 7fc5cb000640 1 -- 172.21.15.100:0/4083875886 wait complete. 2024-02-21T07:58:31.450 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-02-21T07:58:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.653+0000 7f6a66c00640 1 Processor -- start 2024-02-21T07:58:31.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.653+0000 7f6a66c00640 1 -- start start 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a66c00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f6a600f9680 0x7f6a6006d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a66c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600cac60 con 0x7f6a6017d0b0 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a66c00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a600f9ab0 con 0x7f6a600cb800 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a66c00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6017d490 con 0x7f6a600f9680 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a64e00640 1 --1- >> v1:172.21.15.156:6789/0 conn(0x7f6a600cb800 0x7f6a600f8f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.156:6789/0 says I am v1:172.21.15.100:39696/0 (socket says 172.21.15.100:39696) 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a64e00640 1 -- 172.21.15.100:0/16503308 learned_addr learned my addr 172.21.15.100:0/16503308 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.655+0000 7f6a66200640 1 --2- 172.21.15.100:0/16503308 >> v2:172.21.15.170:3300/0 conn(0x7f6a600f9680 0x7f6a6006d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496742563 0 0) 0x7f6a600f9ab0 con 0x7f6a600cb800 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003520 con 0x7f6a600cb800 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a66200640 1 -- 172.21.15.100:0/16503308 >> v1:172.21.15.156:6789/0 conn(0x7f6a600cb800 legacy=0x7f6a600f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025734728 0 0) 0x7f6a600cac60 con 0x7f6a6017d0b0 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a66200640 1 -- 172.21.15.100:0/16503308 >> v1:172.21.15.100:6789/0 conn(0x7f6a6017d0b0 legacy=0x7f6a600cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.656+0000 7f6a66200640 1 -- 172.21.15.100:0/16503308 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6006e830 con 0x7f6a600f9680 2024-02-21T07:58:31.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.657+0000 7f6a66200640 1 --2- 172.21.15.100:0/16503308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6006d950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009d90 tx=0x7f6a5802bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed4aec4beeb80d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.657+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5802cd00 con 0x7f6a600f9680 2024-02-21T07:58:31.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.657+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5802ce60 con 0x7f6a600f9680 2024-02-21T07:58:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.657+0000 7f6a5fe00640 1 -- 172.21.15.100:0/16503308 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58034660 con 0x7f6a600f9680 2024-02-21T07:58:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 -- 172.21.15.100:0/16503308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 msgr2=0x7f6a6006d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 --2- 172.21.15.100:0/16503308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6006d950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009d90 tx=0x7f6a5802bf50 comp rx=0 tx=0).stop 2024-02-21T07:58:31.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 -- 172.21.15.100:0/16503308 shutdown_connections 2024-02-21T07:58:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 --2- 172.21.15.100:0/16503308 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6006d950 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 -- 172.21.15.100:0/16503308 >> 172.21.15.100:0/16503308 conn(0x7f6a600ce150 msgr2=0x7f6a600ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 -- 172.21.15.100:0/16503308 shutdown_connections 2024-02-21T07:58:31.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.658+0000 7f6a66c00640 1 -- 172.21.15.100:0/16503308 wait complete. 2024-02-21T07:58:31.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.660+0000 7f6a66c00640 1 Processor -- start 2024-02-21T07:58:31.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.661+0000 7f6a66c00640 1 -- start start 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 0x7f6a6021f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a6017d0b0 0x7f6a6021c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60220230 con 0x7f6a600cb800 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a60220510 con 0x7f6a6017d0b0 2024-02-21T07:58:31.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a602207f0 con 0x7f6a600f9680 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a64e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a65800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 0x7f6a6021f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a66200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a6017d0b0 0x7f6a6021c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a65800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 0x7f6a6021f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58902/0 (socket says 172.21.15.100:58902) 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a64e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34422/0 (socket says 172.21.15.100:34422) 2024-02-21T07:58:31.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.662+0000 7f6a65800640 1 -- 172.21.15.100:0/3967289698 learned_addr learned my addr 172.21.15.100:0/3967289698 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 -- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a6017d0b0 msgr2=0x7f6a6021c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a6017d0b0 0x7f6a6021c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 -- 172.21.15.100:0/3967289698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 msgr2=0x7f6a6021f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 0x7f6a6021f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 -- 172.21.15.100:0/3967289698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a58009a70 con 0x7f6a600f9680 2024-02-21T07:58:31.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a64e00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c3c0 tx=0x7f6a4c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c005ce0 con 0x7f6a600f9680 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c005e40 con 0x7f6a600f9680 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0072d0 con 0x7f6a600f9680 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.663+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a60220ad0 con 0x7f6a600f9680 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.664+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a60221090 con 0x7f6a600f9680 2024-02-21T07:58:31.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.665+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a600751d0 con 0x7f6a600f9680 2024-02-21T07:58:31.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.666+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6a4c0074f0 con 0x7f6a600f9680 2024-02-21T07:58:31.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.667+0000 7f6a5d600640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 0x7f6a400a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.668+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6a4c0c8f90 con 0x7f6a600f9680 2024-02-21T07:58:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.668+0000 7f6a65800640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 0x7f6a400a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:31.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.668+0000 7f6a65800640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 0x7f6a400a1560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6a540018c0 tx=0x7f6a54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:31.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.671+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a4c04d8c0 con 0x7f6a600f9680 2024-02-21T07:58:31.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.870+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a600c9e60 con 0x7f6a4009f0a0 2024-02-21T07:58:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.871+0000 7f6a5d600640 1 -- 172.21.15.100:0/3967289698 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a600c9e60 con 0x7f6a4009f0a0 2024-02-21T07:58:31.872 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 8 to deep-scrub 2024-02-21T07:58:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 msgr2=0x7f6a400a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 0x7f6a400a1560 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6a540018c0 tx=0x7f6a54009040 comp rx=0 tx=0).stop 2024-02-21T07:58:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 msgr2=0x7f6a6016b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00c3c0 tx=0x7f6a4c001e70 comp rx=0 tx=0).stop 2024-02-21T07:58:31.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 shutdown_connections 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6a6017d0b0 0x7f6a6021c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6a600f9680 0x7f6a6016b0b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.873+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f6a4009f0a0 0x7f6a400a1560 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.874+0000 7f6a66c00640 1 --2- 172.21.15.100:0/3967289698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a600cb800 0x7f6a6021f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.874+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 >> 172.21.15.100:0/3967289698 conn(0x7f6a600ce150 msgr2=0x7f6a600cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.874+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 shutdown_connections 2024-02-21T07:58:31.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:31.874+0000 7f6a66c00640 1 -- 172.21.15.100:0/3967289698 wait complete. 2024-02-21T07:58:31.895 INFO:tasks.ceph:Scrubbing osd.11 2024-02-21T07:58:31.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-02-21T07:58:32.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.110+0000 7f2075e00640 1 Processor -- start 2024-02-21T07:58:32.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.110+0000 7f2075e00640 1 -- start start 2024-02-21T07:58:32.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f2075e00640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f2070182d30 0x7f2070160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f2075e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20700f48e0 con 0x7f2070183320 2024-02-21T07:58:32.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f2075e00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20700f4b30 con 0x7f207006d910 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f2075e00640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20700f4e10 con 0x7f2070182d30 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f206fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2070183320 0x7f20700f5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57312/0 (socket says 172.21.15.100:57312) 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f206fe00640 1 -- 172.21.15.100:0/1439628090 learned_addr learned my addr 172.21.15.100:0/1439628090 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.112+0000 7f2074a00640 1 --2- 172.21.15.100:0/1439628090 >> v2:172.21.15.170:3300/0 conn(0x7f2070182d30 0x7f2070160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717266547 0 0) 0x7f20700f48e0 con 0x7f2070183320 2024-02-21T07:58:32.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2054003520 con 0x7f2070183320 2024-02-21T07:58:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565571974 0 0) 0x7f20700f4b30 con 0x7f207006d910 2024-02-21T07:58:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f2074a00640 1 -- 172.21.15.100:0/1439628090 >> v1:172.21.15.156:6789/0 conn(0x7f207006d910 legacy=0x7f207006dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f2074a00640 1 -- 172.21.15.100:0/1439628090 >> v1:172.21.15.100:6789/0 conn(0x7f2070183320 legacy=0x7f20700f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.113+0000 7f2074a00640 1 -- 172.21.15.100:0/1439628090 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700f50f0 con 0x7f2070182d30 2024-02-21T07:58:32.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.114+0000 7f2074a00640 1 --2- 172.21.15.100:0/1439628090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2070182d30 0x7f2070160d70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2060009d90 tx=0x7f206002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea954cb8357066d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.114+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206002cbd0 con 0x7f2070182d30 2024-02-21T07:58:32.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.114+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206002cd30 con 0x7f2070182d30 2024-02-21T07:58:32.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f206f400640 1 -- 172.21.15.100:0/1439628090 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206002cea0 con 0x7f2070182d30 2024-02-21T07:58:32.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 -- 172.21.15.100:0/1439628090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2070182d30 msgr2=0x7f2070160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 --2- 172.21.15.100:0/1439628090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2070182d30 0x7f2070160d70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2060009d90 tx=0x7f206002be20 comp rx=0 tx=0).stop 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 -- 172.21.15.100:0/1439628090 shutdown_connections 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 --2- 172.21.15.100:0/1439628090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2070182d30 0x7f2070160d70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 -- 172.21.15.100:0/1439628090 >> 172.21.15.100:0/1439628090 conn(0x7f20700f6580 msgr2=0x7f20700f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 -- 172.21.15.100:0/1439628090 shutdown_connections 2024-02-21T07:58:32.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.115+0000 7f2075e00640 1 -- 172.21.15.100:0/1439628090 wait complete. 2024-02-21T07:58:32.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.117+0000 7f2075e00640 1 Processor -- start 2024-02-21T07:58:32.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.117+0000 7f2075e00640 1 -- start start 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 0x7f2070180ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 0x7f207015e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2070183320 0x7f207017aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015ea60 con 0x7f2070182d30 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015f7c0 con 0x7f2070183320 2024-02-21T07:58:32.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.118+0000 7f2075e00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207015ec40 con 0x7f207006d910 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f206fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 0x7f207015e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 0x7f2070180ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f206fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 0x7f207015e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58906/0 (socket says 172.21.15.100:58906) 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2075400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2070183320 0x7f207017aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f206fe00640 1 -- 172.21.15.100:0/969353640 learned_addr learned my addr 172.21.15.100:0/969353640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 0x7f2070180ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:34432/0 (socket says 172.21.15.100:34432) 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 -- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2070183320 msgr2=0x7f207017aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2070183320 0x7f207017aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 -- 172.21.15.100:0/969353640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 msgr2=0x7f207015e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 0x7f207015e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2074a00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060009a70 con 0x7f207006d910 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f206fe00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2070182d30 0x7f207015e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.119+0000 7f2075400640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2070183320 0x7f207017aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f2074a00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 0x7f2070180ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2060033000 tx=0x7f2060004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206002cea0 con 0x7f207006d910 2024-02-21T07:58:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060009450 con 0x7f207006d910 2024-02-21T07:58:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060040670 con 0x7f207006d910 2024-02-21T07:58:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207015ef20 con 0x7f207006d910 2024-02-21T07:58:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.120+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207015f4e0 con 0x7f207006d910 2024-02-21T07:58:32.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.121+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20700f62e0 con 0x7f207006d910 2024-02-21T07:58:32.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.123+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f20600407d0 con 0x7f207006d910 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206cc00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f205009f0a0 0x7f20500a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f20600ece50 con 0x7f207006d910 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206fe00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f205009f0a0 0x7f20500a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206cc00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f20500a9bd0 0x7f20500ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20500ac740 con 0x7f20500a9bd0 2024-02-21T07:58:32.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20600ed1c0 con 0x7f207006d910 2024-02-21T07:58:32.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.125+0000 7f2075400640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f20500a9bd0 0x7f20500ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.126+0000 7f206fe00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f205009f0a0 0x7f20500a1560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20700d1c60 tx=0x7f205c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.126+0000 7f2075400640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f20500a9bd0 0x7f20500ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.127+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== osd.11 v2:172.21.15.170:6824/3451886285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f20500ac740 con 0x7f20500a9bd0 2024-02-21T07:58:32.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.141+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 --> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f207017b1e0 con 0x7f20500a9bd0 2024-02-21T07:58:32.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.142+0000 7f206cc00640 1 -- 172.21.15.100:0/969353640 <== osd.11 v2:172.21.15.170:6824/3451886285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f207017b1e0 con 0x7f20500a9bd0 2024-02-21T07:58:32.143 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-02-21T07:58:32.144 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T07:58:32.144 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f20500a9bd0 msgr2=0x7f20500ac070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:6824/3451886285,v1:172.21.15.170:6825/3451886285] conn(0x7f20500a9bd0 0x7f20500ac070 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f205009f0a0 msgr2=0x7f20500a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f205009f0a0 0x7f20500a1560 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20700d1c60 tx=0x7f205c009040 comp rx=0 tx=0).stop 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 msgr2=0x7f2070180ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 --2- 172.21.15.100:0/969353640 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f207006d910 0x7f2070180ff0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2060033000 tx=0x7f2060004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075400640 1 -- 172.21.15.100:0/969353640 reap_dead start 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 shutdown_connections 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 >> 172.21.15.100:0/969353640 conn(0x7f20700f6580 msgr2=0x7f2070073cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 shutdown_connections 2024-02-21T07:58:32.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.143+0000 7f2075e00640 1 -- 172.21.15.100:0/969353640 wait complete. 2024-02-21T07:58:32.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-02-21T07:58:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.373+0000 7feb78a00640 1 Processor -- start 2024-02-21T07:58:32.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.373+0000 7feb78a00640 1 -- start start 2024-02-21T07:58:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb78a00640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7feb74182f60 0x7feb74186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb78a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb74071d40 0x7feb740721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb78a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb74186670 con 0x7feb7406da30 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb78a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74183340 con 0x7feb74071d40 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb78a00640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74071010 con 0x7feb74182f60 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb71400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb74071d40 0x7feb740721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb71400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feb74071d40 0x7feb740721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58922/0 (socket says 172.21.15.100:58922) 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb71400640 1 -- 172.21.15.100:0/1920104149 learned_addr learned my addr 172.21.15.100:0/1920104149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:32.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.375+0000 7feb71e00640 1 --2- 172.21.15.100:0/1920104149 >> v2:172.21.15.156:3300/0 conn(0x7feb74182f60 0x7feb74186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.376+0000 7feb71400640 1 -- 172.21.15.100:0/1920104149 >> v2:172.21.15.156:3300/0 conn(0x7feb74182f60 msgr2=0x7feb74186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.376+0000 7feb71400640 1 --2- 172.21.15.100:0/1920104149 >> v2:172.21.15.156:3300/0 conn(0x7feb74182f60 0x7feb74186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.376+0000 7feb71400640 1 -- 172.21.15.100:0/1920104149 >> v1:172.21.15.100:6789/0 conn(0x7feb7406da30 legacy=0x7feb7406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.376+0000 7feb71400640 1 -- 172.21.15.100:0/1920104149 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74072710 con 0x7feb74071d40 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.376+0000 7feb70a00640 1 -- 172.21.15.100:0/1920104149 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728399322 0 0) 0x7feb74186670 con 0x7feb7406da30 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.377+0000 7feb71400640 1 --2- 172.21.15.100:0/1920104149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74071d40 0x7feb740721d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feb74183480 tx=0x7feb5c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceadd678b3262eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.377+0000 7feb70a00640 1 -- 172.21.15.100:0/1920104149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c02ec80 con 0x7feb74071d40 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.377+0000 7feb70a00640 1 -- 172.21.15.100:0/1920104149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c02ede0 con 0x7feb74071d40 2024-02-21T07:58:32.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.377+0000 7feb70a00640 1 -- 172.21.15.100:0/1920104149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c036610 con 0x7feb74071d40 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 -- 172.21.15.100:0/1920104149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74071d40 msgr2=0x7feb740721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 --2- 172.21.15.100:0/1920104149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74071d40 0x7feb740721d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feb74183480 tx=0x7feb5c02e0e0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 -- 172.21.15.100:0/1920104149 shutdown_connections 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 --2- 172.21.15.100:0/1920104149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74071d40 0x7feb740721d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 --2- 172.21.15.100:0/1920104149 >> v2:172.21.15.156:3300/0 conn(0x7feb74182f60 0x7feb74186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 -- 172.21.15.100:0/1920104149 >> 172.21.15.100:0/1920104149 conn(0x7feb740668b0 msgr2=0x7feb74066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 -- 172.21.15.100:0/1920104149 shutdown_connections 2024-02-21T07:58:32.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.378+0000 7feb78a00640 1 -- 172.21.15.100:0/1920104149 wait complete. 2024-02-21T07:58:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.380+0000 7feb78a00640 1 Processor -- start 2024-02-21T07:58:32.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.380+0000 7feb78a00640 1 -- start start 2024-02-21T07:58:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb7406da30 0x7feb7415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb74071d40 0x7feb74180780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb74218b30 con 0x7feb74182f60 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7406fe40 con 0x7feb7406da30 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.381+0000 7feb78a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741813a0 con 0x7feb74071d40 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58936/0 (socket says 172.21.15.100:58936) 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 -- 172.21.15.100:0/4002754552 learned_addr learned my addr 172.21.15.100:0/4002754552 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb71400640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb74071d40 0x7feb74180780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb71e00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb7406da30 0x7feb7415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 -- 172.21.15.100:0/4002754552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb74071d40 msgr2=0x7feb74180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb74071d40 0x7feb74180780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 -- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb7406da30 msgr2=0x7feb7415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb7406da30 0x7feb7415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 -- 172.21.15.100:0/4002754552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c009b30 con 0x7feb74182f60 2024-02-21T07:58:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.382+0000 7feb72800640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c3e0 tx=0x7feb6c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.383+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0035f0 con 0x7feb74182f60 2024-02-21T07:58:32.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.383+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c003750 con 0x7feb74182f60 2024-02-21T07:58:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.383+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c003b00 con 0x7feb74182f60 2024-02-21T07:58:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.383+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb74181680 con 0x7feb74182f60 2024-02-21T07:58:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.383+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb74181c40 con 0x7feb74182f60 2024-02-21T07:58:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.384+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb74218c70 con 0x7feb74182f60 2024-02-21T07:58:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.386+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7feb6c003c60 con 0x7feb74182f60 2024-02-21T07:58:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.387+0000 7feb6a000640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 0x7feb500a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.387+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feb6c0c8f90 con 0x7feb74182f60 2024-02-21T07:58:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.388+0000 7feb71e00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 0x7feb500a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.388+0000 7feb71e00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 0x7feb500a1560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feb64009b40 tx=0x7feb64009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.391+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feb74218c70 con 0x7feb74182f60 2024-02-21T07:58:32.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.588+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7feb7406edf0 con 0x7feb5009f0a0 2024-02-21T07:58:32.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.589+0000 7feb6a000640 1 -- 172.21.15.100:0/4002754552 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7feb64011a60 con 0x7feb5009f0a0 2024-02-21T07:58:32.590 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 11 to deep-scrub 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 msgr2=0x7feb500a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 0x7feb500a1560 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feb64009b40 tx=0x7feb64009190 comp rx=0 tx=0).stop 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 msgr2=0x7feb74180cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c3e0 tx=0x7feb6c00c8a0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 shutdown_connections 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7feb5009f0a0 0x7feb500a1560 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb74182f60 0x7feb74180cc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb74071d40 0x7feb74180780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 --2- 172.21.15.100:0/4002754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb7406da30 0x7feb7415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 >> 172.21.15.100:0/4002754552 conn(0x7feb740668b0 msgr2=0x7feb7406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 shutdown_connections 2024-02-21T07:58:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.592+0000 7feb78a00640 1 -- 172.21.15.100:0/4002754552 wait complete. 2024-02-21T07:58:32.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:58:32.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.823+0000 7f32c6600640 1 Processor -- start 2024-02-21T07:58:32.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.824+0000 7f32c6600640 1 -- start start 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.825+0000 7f32c6600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f32c017c040 0x7f32c00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.825+0000 7f32c6600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00f50d0 con 0x7f32c0185680 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.825+0000 7f32c6600640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00f53b0 con 0x7f32c0070f30 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.825+0000 7f32c6600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c0071ab0 con 0x7f32c017c040 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f32c0185680 0x7f32c0185b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57332/0 (socket says 172.21.15.100:57332) 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bfe00640 1 -- 172.21.15.100:0/321708000 learned_addr learned my addr 172.21.15.100:0/321708000 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:32.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bf400640 1 --2- 172.21.15.100:0/321708000 >> v2:172.21.15.156:3300/0 conn(0x7f32c017c040 0x7f32c00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bf400640 1 -- 172.21.15.100:0/321708000 >> v1:172.21.15.156:6789/0 conn(0x7f32c0070f30 legacy=0x7f32c00713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32be000640 1 -- 172.21.15.100:0/321708000 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342836845 0 0) 0x7f32c00f50d0 con 0x7f32c0185680 2024-02-21T07:58:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bf400640 1 -- 172.21.15.100:0/321708000 >> v1:172.21.15.100:6789/0 conn(0x7f32c0185680 legacy=0x7f32c0185b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.826+0000 7f32bf400640 1 -- 172.21.15.100:0/321708000 --> v2:172.21.15.156:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00f5690 con 0x7f32c017c040 2024-02-21T07:58:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.827+0000 7f32bf400640 1 --2- 172.21.15.100:0/321708000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c017c040 0x7f32c00706b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009750 tx=0x7f32b002b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44511aa5404d56c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32be000640 1 -- 172.21.15.100:0/321708000 <== mon.1 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0030710 con 0x7f32c017c040 2024-02-21T07:58:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32be000640 1 -- 172.21.15.100:0/321708000 <== mon.1 v2:172.21.15.156:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b002e050 con 0x7f32c017c040 2024-02-21T07:58:32.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32be000640 1 -- 172.21.15.100:0/321708000 <== mon.1 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0030a90 con 0x7f32c017c040 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 -- 172.21.15.100:0/321708000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c017c040 msgr2=0x7f32c00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 --2- 172.21.15.100:0/321708000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c017c040 0x7f32c00706b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009750 tx=0x7f32b002b730 comp rx=0 tx=0).stop 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 -- 172.21.15.100:0/321708000 shutdown_connections 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 --2- 172.21.15.100:0/321708000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c017c040 0x7f32c00706b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 -- 172.21.15.100:0/321708000 >> 172.21.15.100:0/321708000 conn(0x7f32c00ce160 msgr2=0x7f32c00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 -- 172.21.15.100:0/321708000 shutdown_connections 2024-02-21T07:58:32.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.828+0000 7f32c6600640 1 -- 172.21.15.100:0/321708000 wait complete. 2024-02-21T07:58:32.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.830+0000 7f32c6600640 1 Processor -- start 2024-02-21T07:58:32.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.830+0000 7f32c6600640 1 -- start start 2024-02-21T07:58:32.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 0x7f32c016fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c017c040 0x7f32c0166c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c01702c0 con 0x7f32c0185680 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0170590 con 0x7f32c0070f30 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32c6600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0170870 con 0x7f32c017c040 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58944/0 (socket says 172.21.15.100:58944) 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 -- 172.21.15.100:0/985883580 learned_addr learned my addr 172.21.15.100:0/985883580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bf400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 0x7f32c016fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bea00640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c017c040 0x7f32c0166c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 -- 172.21.15.100:0/985883580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c017c040 msgr2=0x7f32c0166c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c017c040 0x7f32c0166c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 -- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 msgr2=0x7f32c016fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 0x7f32c016fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bfe00640 1 -- 172.21.15.100:0/985883580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009400 con 0x7f32c0185680 2024-02-21T07:58:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.832+0000 7f32bf400640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 0x7f32c016fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:58:32.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32bfe00640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c730 tx=0x7f32b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800ce40 con 0x7f32c0185680 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800a640 con 0x7f32c0185680 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800aa70 con 0x7f32c0185680 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c0170b50 con 0x7f32c0185680 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.833+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c0171110 con 0x7f32c0185680 2024-02-21T07:58:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.834+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c0067c80 con 0x7f32c0185680 2024-02-21T07:58:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.836+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f32b800abd0 con 0x7f32c0185680 2024-02-21T07:58:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.838+0000 7f32b7400640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 0x7f329c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.838+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f32b80c8f50 con 0x7f32c0185680 2024-02-21T07:58:32.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.838+0000 7f32bf400640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 0x7f329c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.839+0000 7f32bf400640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 0x7f329c0a1590 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f32b0034000 tx=0x7f32b0008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:32.841+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32b8092d80 con 0x7f32c0185680 2024-02-21T07:58:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.038+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32c00f6450 con 0x7f329c09f0d0 2024-02-21T07:58:33.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.051+0000 7f32b7400640 1 -- 172.21.15.100:0/985883580 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+418939 (secure 0 0 0) 0x7f32b0030d20 con 0x7f329c09f0d0 2024-02-21T07:58:33.059 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:58:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 msgr2=0x7f329c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 0x7f329c0a1590 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f32b0034000 tx=0x7f32b0008030 comp rx=0 tx=0).stop 2024-02-21T07:58:33.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 msgr2=0x7f32c021c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f32b800c730 tx=0x7f32b800cbf0 comp rx=0 tx=0).stop 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 shutdown_connections 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f329c09f0d0 0x7f329c0a1590 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32c0185680 0x7f32c021c8b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f32c017c040 0x7f32c0166c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 --2- 172.21.15.100:0/985883580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32c0070f30 0x7f32c016fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 >> 172.21.15.100:0/985883580 conn(0x7f32c00ce160 msgr2=0x7f32c017aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 shutdown_connections 2024-02-21T07:58:33.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:33.060+0000 7f32c6600640 1 -- 172.21.15.100:0/985883580 wait complete. 2024-02-21T07:58:33.081 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-02-21T07:58:32.098718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3663200,"num_objects":78,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":5884,"num_read_kb":10177,"num_write":755950,"num_write_kb":194947105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6508,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73413,"ondisk_log_size":73413,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3117704,"kb_used_data":6632,"kb_used_omap":18,"kb_used_meta":3110957,"kb_avail":1129344376,"statfs":{"total":1159641169920,"available":1156448641024,"internally_reserved":0,"allocated":6791168,"data_stored":9184884,"data_compressed":1002998,"data_compressed_allocated":1376256,"data_compressed_original":6144000,"omap_allocated":19141,"internal_metadata":3185620283},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":422,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6508,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009479"},"pg_stats":[{"pgid":"2.1f","version":"30'114","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.865729+0000","last_change":"2024-02-21T07:58:28.865804+0000","last_active":"2024-02-21T07:58:28.865729+0000","last_peered":"2024-02-21T07:58:28.865729+0000","last_clean":"2024-02-21T07:58:28.865729+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:58:28.865729+0000","last_undegraded":"2024-02-21T07:58:28.865729+0000","last_fullsized":"2024-02-21T07:58:28.865729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'114","last_scrub_stamp":"2024-02-21T07:58:28.865626+0000","last_deep_scrub":"30'114","last_deep_scrub_stamp":"2024-02-21T07:58:28.865626+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.865626+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:46:18.140781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":57,"num_write":210,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1508,"num_omap_keys":3,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"30'9","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.871962+0000","last_change":"2024-02-21T07:45:26.276438+0000","last_active":"2024-02-21T07:58:20.871962+0000","last_peered":"2024-02-21T07:58:20.871962+0000","last_clean":"2024-02-21T07:58:20.871962+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:58:20.871962+0000","last_undegraded":"2024-02-21T07:58:20.871962+0000","last_fullsized":"2024-02-21T07:58:20.871962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'2349","reported_seq":2379,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733484+0000","last_change":"2024-02-21T07:46:13.532283+0000","last_active":"2024-02-21T07:58:07.733484+0000","last_peered":"2024-02-21T07:58:07.733484+0000","last_clean":"2024-02-21T07:58:07.733484+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:58:07.733484+0000","last_undegraded":"2024-02-21T07:58:07.733484+0000","last_fullsized":"2024-02-21T07:58:07.733484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25104,"num_write_kb":6480128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"30'3","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.158102+0000","last_change":"2024-02-21T07:58:26.158161+0000","last_active":"2024-02-21T07:58:26.158102+0000","last_peered":"2024-02-21T07:58:26.158102+0000","last_clean":"2024-02-21T07:58:26.158102+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:58:26.158102+0000","last_undegraded":"2024-02-21T07:58:26.158102+0000","last_fullsized":"2024-02-21T07:58:26.158102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:26.157938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:26.157938+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.157938+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:50:03.661609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.418282+0000","last_change":"2024-02-21T07:58:28.418320+0000","last_active":"2024-02-21T07:58:28.418282+0000","last_peered":"2024-02-21T07:58:28.418282+0000","last_clean":"2024-02-21T07:58:28.418282+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:58:28.418282+0000","last_undegraded":"2024-02-21T07:58:28.418282+0000","last_fullsized":"2024-02-21T07:58:28.418282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:28.418096+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:28.418096+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.418096+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:00.465147+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'2450","reported_seq":2474,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.789538+0000","last_change":"2024-02-21T07:45:30.317302+0000","last_active":"2024-02-21T07:58:07.789538+0000","last_peered":"2024-02-21T07:58:07.789538+0000","last_clean":"2024-02-21T07:58:07.789538+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:58:07.789538+0000","last_undegraded":"2024-02-21T07:58:07.789538+0000","last_fullsized":"2024-02-21T07:58:07.789538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26394,"num_write_kb":6774912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"30'6","reported_seq":37,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426615+0000","last_change":"2024-02-21T07:45:25.226952+0000","last_active":"2024-02-21T07:57:46.426615+0000","last_peered":"2024-02-21T07:57:46.426615+0000","last_clean":"2024-02-21T07:57:46.426615+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:57:46.426615+0000","last_undegraded":"2024-02-21T07:57:46.426615+0000","last_fullsized":"2024-02-21T07:57:46.426615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"30'16","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856629+0000","last_change":"2024-02-21T07:45:26.266323+0000","last_active":"2024-02-21T07:58:20.856629+0000","last_peered":"2024-02-21T07:58:20.856629+0000","last_clean":"2024-02-21T07:58:20.856629+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:58:20.856629+0000","last_undegraded":"2024-02-21T07:58:20.856629+0000","last_fullsized":"2024-02-21T07:58:20.856629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1816","reported_seq":1858,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.813512+0000","last_change":"2024-02-21T07:45:30.317289+0000","last_active":"2024-02-21T07:58:07.813512+0000","last_peered":"2024-02-21T07:58:07.813512+0000","last_clean":"2024-02-21T07:58:07.813512+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:58:07.813512+0000","last_undegraded":"2024-02-21T07:58:07.813512+0000","last_fullsized":"2024-02-21T07:58:07.813512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19208,"num_write_kb":5027530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.425159+0000","last_change":"2024-02-21T07:45:25.233641+0000","last_active":"2024-02-21T07:57:46.425159+0000","last_peered":"2024-02-21T07:57:46.425159+0000","last_clean":"2024-02-21T07:57:46.425159+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:57:46.425159+0000","last_undegraded":"2024-02-21T07:57:46.425159+0000","last_fullsized":"2024-02-21T07:57:46.425159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"30'28","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.853503+0000","last_change":"2024-02-21T07:45:26.264486+0000","last_active":"2024-02-21T07:58:20.853503+0000","last_peered":"2024-02-21T07:58:20.853503+0000","last_clean":"2024-02-21T07:58:20.853503+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:58:20.853503+0000","last_undegraded":"2024-02-21T07:58:20.853503+0000","last_fullsized":"2024-02-21T07:58:20.853503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1978","reported_seq":2002,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.795823+0000","last_change":"2024-02-21T07:45:30.311593+0000","last_active":"2024-02-21T07:58:07.795823+0000","last_peered":"2024-02-21T07:58:07.795823+0000","last_clean":"2024-02-21T07:58:07.795823+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:58:07.795823+0000","last_undegraded":"2024-02-21T07:58:07.795823+0000","last_fullsized":"2024-02-21T07:58:07.795823+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21148,"num_write_kb":5478976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"30'9","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.019085+0000","last_change":"2024-02-21T07:45:26.264296+0000","last_active":"2024-02-21T07:58:29.019085+0000","last_peered":"2024-02-21T07:58:29.019085+0000","last_clean":"2024-02-21T07:58:29.019085+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:58:29.019085+0000","last_undegraded":"2024-02-21T07:58:29.019085+0000","last_fullsized":"2024-02-21T07:58:29.019085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"30'54","reported_seq":86,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:46.426547+0000","last_change":"2024-02-21T07:45:25.226136+0000","last_active":"2024-02-21T07:57:46.426547+0000","last_peered":"2024-02-21T07:57:46.426547+0000","last_clean":"2024-02-21T07:57:46.426547+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:57:46.426547+0000","last_undegraded":"2024-02-21T07:57:46.426547+0000","last_fullsized":"2024-02-21T07:57:46.426547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"30'2241","reported_seq":2265,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.821749+0000","last_change":"2024-02-21T07:45:30.575832+0000","last_active":"2024-02-21T07:58:07.821749+0000","last_peered":"2024-02-21T07:58:07.821749+0000","last_clean":"2024-02-21T07:58:07.821749+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:58:07.821749+0000","last_undegraded":"2024-02-21T07:58:07.821749+0000","last_fullsized":"2024-02-21T07:58:07.821749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23912,"num_write_kb":6167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"30'16","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.882927+0000","last_change":"2024-02-21T07:45:26.282707+0000","last_active":"2024-02-21T07:58:20.882927+0000","last_peered":"2024-02-21T07:58:20.882927+0000","last_clean":"2024-02-21T07:58:20.882927+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:58:20.882927+0000","last_undegraded":"2024-02-21T07:58:20.882927+0000","last_fullsized":"2024-02-21T07:58:20.882927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"30'10","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:21.805448+0000","last_change":"2024-02-21T07:45:25.234770+0000","last_active":"2024-02-21T07:58:21.805448+0000","last_peered":"2024-02-21T07:58:21.805448+0000","last_clean":"2024-02-21T07:58:21.805448+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:58:21.805448+0000","last_undegraded":"2024-02-21T07:58:21.805448+0000","last_fullsized":"2024-02-21T07:58:21.805448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"30'2237","reported_seq":2280,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.682404+0000","last_change":"2024-02-21T07:45:30.331547+0000","last_active":"2024-02-21T07:58:07.682404+0000","last_peered":"2024-02-21T07:58:07.682404+0000","last_clean":"2024-02-21T07:58:07.682404+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:58:07.682404+0000","last_undegraded":"2024-02-21T07:58:07.682404+0000","last_fullsized":"2024-02-21T07:58:07.682404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":23651,"num_write_kb":6110913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'20","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.874920+0000","last_change":"2024-02-21T07:45:26.276626+0000","last_active":"2024-02-21T07:58:20.874920+0000","last_peered":"2024-02-21T07:58:20.874920+0000","last_clean":"2024-02-21T07:58:20.874920+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:58:20.874920+0000","last_undegraded":"2024-02-21T07:58:20.874920+0000","last_fullsized":"2024-02-21T07:58:20.874920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:14.129800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"30'7","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.153499+0000","last_change":"2024-02-21T07:58:27.153499+0000","last_active":"2024-02-21T07:58:27.153499+0000","last_peered":"2024-02-21T07:58:27.153499+0000","last_clean":"2024-02-21T07:58:27.153499+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:58:27.153499+0000","last_undegraded":"2024-02-21T07:58:27.153499+0000","last_fullsized":"2024-02-21T07:58:27.153499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-02-21T07:58:27.153398+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-02-21T07:58:27.153398+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.153398+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:23:47.994754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'2353","reported_seq":2394,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.778525+0000","last_change":"2024-02-21T07:45:30.328807+0000","last_active":"2024-02-21T07:58:07.778525+0000","last_peered":"2024-02-21T07:58:07.778525+0000","last_clean":"2024-02-21T07:58:07.778525+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:58:07.778525+0000","last_undegraded":"2024-02-21T07:58:07.778525+0000","last_fullsized":"2024-02-21T07:58:07.778525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25161,"num_write_kb":6532545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856859+0000","last_change":"2024-02-21T07:45:26.261515+0000","last_active":"2024-02-21T07:58:20.856859+0000","last_peered":"2024-02-21T07:58:20.856859+0000","last_clean":"2024-02-21T07:58:20.856859+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:58:20.856859+0000","last_undegraded":"2024-02-21T07:58:20.856859+0000","last_fullsized":"2024-02-21T07:58:20.856859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"30'3","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.331533+0000","last_change":"2024-02-21T07:58:28.331533+0000","last_active":"2024-02-21T07:58:28.331533+0000","last_peered":"2024-02-21T07:58:28.331533+0000","last_clean":"2024-02-21T07:58:28.331533+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:58:28.331533+0000","last_undegraded":"2024-02-21T07:58:28.331533+0000","last_fullsized":"2024-02-21T07:58:28.331533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:28.331382+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:28.331382+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.331382+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:46:54.315197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"30'2033","reported_seq":2057,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.684678+0000","last_change":"2024-02-21T07:45:30.577116+0000","last_active":"2024-02-21T07:58:07.684678+0000","last_peered":"2024-02-21T07:58:07.684678+0000","last_clean":"2024-02-21T07:58:07.684678+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:58:07.684678+0000","last_undegraded":"2024-02-21T07:58:07.684678+0000","last_fullsized":"2024-02-21T07:58:07.684678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21864,"num_write_kb":5639616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"30'16","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:24.824279+0000","last_change":"2024-02-21T07:45:26.285716+0000","last_active":"2024-02-21T07:58:24.824279+0000","last_peered":"2024-02-21T07:58:24.824279+0000","last_clean":"2024-02-21T07:58:24.824279+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:58:24.824279+0000","last_undegraded":"2024-02-21T07:58:24.824279+0000","last_fullsized":"2024-02-21T07:58:24.824279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'52","reported_seq":104,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.309170+0000","last_change":"2024-02-21T07:45:25.231520+0000","last_active":"2024-02-21T07:58:28.309170+0000","last_peered":"2024-02-21T07:58:28.309170+0000","last_clean":"2024-02-21T07:58:28.309170+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:58:28.309170+0000","last_undegraded":"2024-02-21T07:58:28.309170+0000","last_fullsized":"2024-02-21T07:58:28.309170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":19,"num_write":102,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"30'1849","reported_seq":1873,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.739803+0000","last_change":"2024-02-21T07:45:30.308673+0000","last_active":"2024-02-21T07:58:07.739803+0000","last_peered":"2024-02-21T07:58:07.739803+0000","last_clean":"2024-02-21T07:58:07.739803+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:58:07.739803+0000","last_undegraded":"2024-02-21T07:58:07.739803+0000","last_fullsized":"2024-02-21T07:58:07.739803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:12:52.935124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19868,"num_write_kb":5174912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'13","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:25.498704+0000","last_change":"2024-02-21T07:45:26.269992+0000","last_active":"2024-02-21T07:58:25.498704+0000","last_peered":"2024-02-21T07:58:25.498704+0000","last_clean":"2024-02-21T07:58:25.498704+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:58:25.498704+0000","last_undegraded":"2024-02-21T07:58:25.498704+0000","last_fullsized":"2024-02-21T07:58:25.498704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'79","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.876748+0000","last_change":"2024-02-21T07:58:29.876748+0000","last_active":"2024-02-21T07:58:29.876748+0000","last_peered":"2024-02-21T07:58:29.876748+0000","last_clean":"2024-02-21T07:58:29.876748+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:58:29.876748+0000","last_undegraded":"2024-02-21T07:58:29.876748+0000","last_fullsized":"2024-02-21T07:58:29.876748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2024-02-21T07:58:29.876522+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2024-02-21T07:58:29.876522+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.876522+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:50:07.380192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"30'2041","reported_seq":2066,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.754621+0000","last_change":"2024-02-21T07:45:30.576693+0000","last_active":"2024-02-21T07:58:07.754621+0000","last_peered":"2024-02-21T07:58:07.754621+0000","last_clean":"2024-02-21T07:58:07.754621+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:58:07.754621+0000","last_undegraded":"2024-02-21T07:58:07.754621+0000","last_fullsized":"2024-02-21T07:58:07.754621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21885,"num_write_kb":5740224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'17","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.641406+0000","last_change":"2024-02-21T07:58:29.641465+0000","last_active":"2024-02-21T07:58:29.641406+0000","last_peered":"2024-02-21T07:58:29.641406+0000","last_clean":"2024-02-21T07:58:29.641406+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:58:29.641406+0000","last_undegraded":"2024-02-21T07:58:29.641406+0000","last_fullsized":"2024-02-21T07:58:29.641406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-02-21T07:58:29.641243+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-02-21T07:58:29.641243+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.641243+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:51.655383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"28'1","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:50.024901+0000","last_change":"2024-02-21T07:45:25.243309+0000","last_active":"2024-02-21T07:55:50.024901+0000","last_peered":"2024-02-21T07:55:50.024901+0000","last_clean":"2024-02-21T07:55:50.024901+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:55:50.024901+0000","last_undegraded":"2024-02-21T07:55:50.024901+0000","last_fullsized":"2024-02-21T07:55:50.024901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:11.698848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"30'2741","reported_seq":2765,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.802965+0000","last_change":"2024-02-21T07:45:30.312641+0000","last_active":"2024-02-21T07:58:07.802965+0000","last_peered":"2024-02-21T07:58:07.802965+0000","last_clean":"2024-02-21T07:58:07.802965+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:58:07.802965+0000","last_undegraded":"2024-02-21T07:58:07.802965+0000","last_fullsized":"2024-02-21T07:58:07.802965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:52.043700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28989,"num_write_kb":7541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"30'13","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.871566+0000","last_change":"2024-02-21T07:45:26.271539+0000","last_active":"2024-02-21T07:58:20.871566+0000","last_peered":"2024-02-21T07:58:20.871566+0000","last_clean":"2024-02-21T07:58:20.871566+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:58:20.871566+0000","last_undegraded":"2024-02-21T07:58:20.871566+0000","last_fullsized":"2024-02-21T07:58:20.871566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.825185+0000","last_change":"2024-02-21T07:58:27.825208+0000","last_active":"2024-02-21T07:58:27.825185+0000","last_peered":"2024-02-21T07:58:27.825185+0000","last_clean":"2024-02-21T07:58:27.825185+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:58:27.825185+0000","last_undegraded":"2024-02-21T07:58:27.825185+0000","last_fullsized":"2024-02-21T07:58:27.825185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:58:27.825124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:58:27.825124+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.825124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:38:33.501443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"30'2464","reported_seq":2539,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.741906+0000","last_change":"2024-02-21T07:45:30.576316+0000","last_active":"2024-02-21T07:58:07.741906+0000","last_peered":"2024-02-21T07:58:07.741906+0000","last_clean":"2024-02-21T07:58:07.741906+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:58:07.741906+0000","last_undegraded":"2024-02-21T07:58:07.741906+0000","last_fullsized":"2024-02-21T07:58:07.741906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:20:52.759625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":26392,"num_write_kb":6842521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.853485+0000","last_change":"2024-02-21T07:45:26.262439+0000","last_active":"2024-02-21T07:58:20.853485+0000","last_peered":"2024-02-21T07:58:20.853485+0000","last_clean":"2024-02-21T07:58:20.853485+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:58:20.853485+0000","last_undegraded":"2024-02-21T07:58:20.853485+0000","last_fullsized":"2024-02-21T07:58:20.853485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:59.053491+0000","last_change":"2024-02-21T07:45:25.231694+0000","last_active":"2024-02-21T07:57:59.053491+0000","last_peered":"2024-02-21T07:57:59.053491+0000","last_clean":"2024-02-21T07:57:59.053491+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:57:59.053491+0000","last_undegraded":"2024-02-21T07:57:59.053491+0000","last_fullsized":"2024-02-21T07:57:59.053491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"30'2384","reported_seq":2426,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.816814+0000","last_change":"2024-02-21T07:45:30.325916+0000","last_active":"2024-02-21T07:58:07.816814+0000","last_peered":"2024-02-21T07:58:07.816814+0000","last_clean":"2024-02-21T07:58:07.816814+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:58:07.816814+0000","last_undegraded":"2024-02-21T07:58:07.816814+0000","last_fullsized":"2024-02-21T07:58:07.816814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25350,"num_write_kb":6611464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'13","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.857879+0000","last_change":"2024-02-21T07:45:26.263201+0000","last_active":"2024-02-21T07:58:20.857879+0000","last_peered":"2024-02-21T07:58:20.857879+0000","last_clean":"2024-02-21T07:58:20.857879+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:58:20.857879+0000","last_undegraded":"2024-02-21T07:58:20.857879+0000","last_fullsized":"2024-02-21T07:58:20.857879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'15","reported_seq":821,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.587379+0000","last_change":"2024-02-21T07:58:27.625231+0000","last_active":"2024-02-21T07:58:28.587379+0000","last_peered":"2024-02-21T07:58:28.587379+0000","last_clean":"2024-02-21T07:58:28.587379+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:58:28.587379+0000","last_undegraded":"2024-02-21T07:58:28.587379+0000","last_fullsized":"2024-02-21T07:58:28.587379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:27.625102+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:27.625102+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.625102+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:55:59.672153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":766,"num_read_kb":767,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"30'2406","reported_seq":2437,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.821915+0000","last_change":"2024-02-21T07:46:14.308347+0000","last_active":"2024-02-21T07:58:07.821915+0000","last_peered":"2024-02-21T07:58:07.821915+0000","last_clean":"2024-02-21T07:58:07.821915+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:58:07.821915+0000","last_undegraded":"2024-02-21T07:58:07.821915+0000","last_fullsized":"2024-02-21T07:58:07.821915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25497,"num_write_kb":6630592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856165+0000","last_change":"2024-02-21T07:45:26.263043+0000","last_active":"2024-02-21T07:58:20.856165+0000","last_peered":"2024-02-21T07:58:20.856165+0000","last_clean":"2024-02-21T07:58:20.856165+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:58:20.856165+0000","last_undegraded":"2024-02-21T07:58:20.856165+0000","last_fullsized":"2024-02-21T07:58:20.856165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"28'3","reported_seq":36,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:29.050163+0000","last_change":"2024-02-21T07:45:25.231880+0000","last_active":"2024-02-21T07:57:29.050163+0000","last_peered":"2024-02-21T07:57:29.050163+0000","last_clean":"2024-02-21T07:57:29.050163+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:57:29.050163+0000","last_undegraded":"2024-02-21T07:57:29.050163+0000","last_fullsized":"2024-02-21T07:57:29.050163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'2270","reported_seq":2293,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.769251+0000","last_change":"2024-02-21T07:45:30.576365+0000","last_active":"2024-02-21T07:58:07.769251+0000","last_peered":"2024-02-21T07:58:07.769251+0000","last_clean":"2024-02-21T07:58:07.769251+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:58:07.769251+0000","last_undegraded":"2024-02-21T07:58:07.769251+0000","last_fullsized":"2024-02-21T07:58:07.769251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:57:44.166792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":6335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.881290+0000","last_change":"2024-02-21T07:45:26.268472+0000","last_active":"2024-02-21T07:58:20.881290+0000","last_peered":"2024-02-21T07:58:20.881290+0000","last_clean":"2024-02-21T07:58:20.881290+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:58:20.881290+0000","last_undegraded":"2024-02-21T07:58:20.881290+0000","last_fullsized":"2024-02-21T07:58:20.881290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.765355+0000","last_change":"2024-02-21T07:58:28.765386+0000","last_active":"2024-02-21T07:58:28.765355+0000","last_peered":"2024-02-21T07:58:28.765355+0000","last_clean":"2024-02-21T07:58:28.765355+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:58:28.765355+0000","last_undegraded":"2024-02-21T07:58:28.765355+0000","last_fullsized":"2024-02-21T07:58:28.765355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-02-21T07:58:28.765256+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-02-21T07:58:28.765256+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.765256+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:42.197728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:24.049779+0000","last_change":"2024-02-21T07:45:21.363862+0000","last_active":"2024-02-21T07:57:24.049779+0000","last_peered":"2024-02-21T07:57:24.049779+0000","last_clean":"2024-02-21T07:57:24.049779+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:57:24.049779+0000","last_undegraded":"2024-02-21T07:57:24.049779+0000","last_fullsized":"2024-02-21T07:57:24.049779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:19.971841+0000","last_clean_scrub_stamp":"2024-02-21T07:45:19.971841+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"30'2060","reported_seq":2119,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.745845+0000","last_change":"2024-02-21T07:45:30.327624+0000","last_active":"2024-02-21T07:58:07.745845+0000","last_peered":"2024-02-21T07:58:07.745845+0000","last_clean":"2024-02-21T07:58:07.745845+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:58:07.745845+0000","last_undegraded":"2024-02-21T07:58:07.745845+0000","last_fullsized":"2024-02-21T07:58:07.745845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22073,"num_write_kb":5629259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"30'12","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.855188+0000","last_change":"2024-02-21T07:45:26.263466+0000","last_active":"2024-02-21T07:58:20.855188+0000","last_peered":"2024-02-21T07:58:20.855188+0000","last_clean":"2024-02-21T07:58:20.855188+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:58:20.855188+0000","last_undegraded":"2024-02-21T07:58:20.855188+0000","last_fullsized":"2024-02-21T07:58:20.855188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'4","reported_seq":35,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:56:44.048015+0000","last_change":"2024-02-21T07:45:25.232482+0000","last_active":"2024-02-21T07:56:44.048015+0000","last_peered":"2024-02-21T07:56:44.048015+0000","last_clean":"2024-02-21T07:56:44.048015+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:56:44.048015+0000","last_undegraded":"2024-02-21T07:56:44.048015+0000","last_fullsized":"2024-02-21T07:56:44.048015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"30'2311","reported_seq":2335,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796002+0000","last_change":"2024-02-21T07:45:30.315463+0000","last_active":"2024-02-21T07:58:07.796002+0000","last_peered":"2024-02-21T07:58:07.796002+0000","last_clean":"2024-02-21T07:58:07.796002+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:58:07.796002+0000","last_undegraded":"2024-02-21T07:58:07.796002+0000","last_fullsized":"2024-02-21T07:58:07.796002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24846,"num_write_kb":6393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'17","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.881129+0000","last_change":"2024-02-21T07:45:26.269881+0000","last_active":"2024-02-21T07:58:20.881129+0000","last_peered":"2024-02-21T07:58:20.881129+0000","last_clean":"2024-02-21T07:58:20.881129+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:58:20.881129+0000","last_undegraded":"2024-02-21T07:58:20.881129+0000","last_fullsized":"2024-02-21T07:58:20.881129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"30'47","reported_seq":96,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.413600+0000","last_change":"2024-02-21T07:45:25.225101+0000","last_active":"2024-02-21T07:57:38.413600+0000","last_peered":"2024-02-21T07:57:38.413600+0000","last_clean":"2024-02-21T07:57:38.413600+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:57:38.413600+0000","last_undegraded":"2024-02-21T07:57:38.413600+0000","last_fullsized":"2024-02-21T07:57:38.413600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:29:13.118375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":18,"num_write":93,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'2089","reported_seq":2120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.675273+0000","last_change":"2024-02-21T07:46:14.410441+0000","last_active":"2024-02-21T07:58:07.675273+0000","last_peered":"2024-02-21T07:58:07.675273+0000","last_clean":"2024-02-21T07:58:07.675273+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:58:07.675273+0000","last_undegraded":"2024-02-21T07:58:07.675273+0000","last_fullsized":"2024-02-21T07:58:07.675273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22313,"num_write_kb":5873984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.855148+0000","last_change":"2024-02-21T07:45:26.262583+0000","last_active":"2024-02-21T07:58:20.855148+0000","last_peered":"2024-02-21T07:58:20.855148+0000","last_clean":"2024-02-21T07:58:20.855148+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:58:20.855148+0000","last_undegraded":"2024-02-21T07:58:20.855148+0000","last_fullsized":"2024-02-21T07:58:20.855148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'3","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.610964+0000","last_change":"2024-02-21T07:58:28.611050+0000","last_active":"2024-02-21T07:58:28.610964+0000","last_peered":"2024-02-21T07:58:28.610964+0000","last_clean":"2024-02-21T07:58:28.610964+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:58:28.610964+0000","last_undegraded":"2024-02-21T07:58:28.610964+0000","last_fullsized":"2024-02-21T07:58:28.610964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:28.610746+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:28.610746+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.610746+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:14.733521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"30'1828","reported_seq":1851,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.782512+0000","last_change":"2024-02-21T07:45:30.310843+0000","last_active":"2024-02-21T07:58:07.782512+0000","last_peered":"2024-02-21T07:58:07.782512+0000","last_clean":"2024-02-21T07:58:07.782512+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:58:07.782512+0000","last_undegraded":"2024-02-21T07:58:07.782512+0000","last_fullsized":"2024-02-21T07:58:07.782512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:33:01.391241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19636,"num_write_kb":5096256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'9","reported_seq":38,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.851730+0000","last_change":"2024-02-21T07:45:26.266927+0000","last_active":"2024-02-21T07:58:20.851730+0000","last_peered":"2024-02-21T07:58:20.851730+0000","last_clean":"2024-02-21T07:58:20.851730+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:58:20.851730+0000","last_undegraded":"2024-02-21T07:58:20.851730+0000","last_fullsized":"2024-02-21T07:58:20.851730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"28'2","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:54:25.006321+0000","last_change":"2024-02-21T07:45:25.226735+0000","last_active":"2024-02-21T07:54:25.006321+0000","last_peered":"2024-02-21T07:54:25.006321+0000","last_clean":"2024-02-21T07:54:25.006321+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:54:25.006321+0000","last_undegraded":"2024-02-21T07:54:25.006321+0000","last_fullsized":"2024-02-21T07:54:25.006321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:49.132889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"30'2224","reported_seq":2282,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.733641+0000","last_change":"2024-02-21T07:45:30.321405+0000","last_active":"2024-02-21T07:58:07.733641+0000","last_peered":"2024-02-21T07:58:07.733641+0000","last_clean":"2024-02-21T07:58:07.733641+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:58:07.733641+0000","last_undegraded":"2024-02-21T07:58:07.733641+0000","last_fullsized":"2024-02-21T07:58:07.733641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:26:04.855064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":23814,"num_write_kb":6166061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"30'11","reported_seq":40,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.853905+0000","last_change":"2024-02-21T07:45:26.262716+0000","last_active":"2024-02-21T07:58:20.853905+0000","last_peered":"2024-02-21T07:58:20.853905+0000","last_clean":"2024-02-21T07:58:20.853905+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:58:20.853905+0000","last_undegraded":"2024-02-21T07:58:20.853905+0000","last_fullsized":"2024-02-21T07:58:20.853905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:26:57.895081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"30'111","reported_seq":179,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:40.624401+0000","last_change":"2024-02-21T07:45:25.237568+0000","last_active":"2024-02-21T07:57:40.624401+0000","last_peered":"2024-02-21T07:57:40.624401+0000","last_clean":"2024-02-21T07:57:40.624401+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:57:40.624401+0000","last_undegraded":"2024-02-21T07:57:40.624401+0000","last_fullsized":"2024-02-21T07:57:40.624401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:42.293741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":37,"num_write":210,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"30'2326","reported_seq":2369,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.824549+0000","last_change":"2024-02-21T07:45:30.332545+0000","last_active":"2024-02-21T07:58:07.824549+0000","last_peered":"2024-02-21T07:58:07.824549+0000","last_clean":"2024-02-21T07:58:07.824549+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:58:07.824549+0000","last_undegraded":"2024-02-21T07:58:07.824549+0000","last_fullsized":"2024-02-21T07:58:07.824549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":25096,"num_write_kb":6462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"30'11","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.851201+0000","last_change":"2024-02-21T07:45:26.265586+0000","last_active":"2024-02-21T07:58:20.851201+0000","last_peered":"2024-02-21T07:58:20.851201+0000","last_clean":"2024-02-21T07:58:20.851201+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:58:20.851201+0000","last_undegraded":"2024-02-21T07:58:20.851201+0000","last_fullsized":"2024-02-21T07:58:20.851201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'3","reported_seq":794,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.309170+0000","last_change":"2024-02-21T07:45:25.228687+0000","last_active":"2024-02-21T07:58:28.309170+0000","last_peered":"2024-02-21T07:58:28.309170+0000","last_clean":"2024-02-21T07:58:28.309170+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:58:28.309170+0000","last_undegraded":"2024-02-21T07:58:28.309170+0000","last_fullsized":"2024-02-21T07:58:28.309170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":760,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"30'2447","reported_seq":2500,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.813049+0000","last_change":"2024-02-21T07:46:13.654697+0000","last_active":"2024-02-21T07:58:07.813049+0000","last_peered":"2024-02-21T07:58:07.813049+0000","last_clean":"2024-02-21T07:58:07.813049+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:58:07.813049+0000","last_undegraded":"2024-02-21T07:58:07.813049+0000","last_fullsized":"2024-02-21T07:58:07.813049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2447,"log_dups_size":0,"ondisk_log_size":2447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:42:17.268916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":25865,"num_write_kb":6637076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"30'25","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.845921+0000","last_change":"2024-02-21T07:45:26.264832+0000","last_active":"2024-02-21T07:58:20.845921+0000","last_peered":"2024-02-21T07:58:20.845921+0000","last_clean":"2024-02-21T07:58:20.845921+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:58:20.845921+0000","last_undegraded":"2024-02-21T07:58:20.845921+0000","last_fullsized":"2024-02-21T07:58:20.845921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"30'4","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:09.068511+0000","last_change":"2024-02-21T07:45:25.241409+0000","last_active":"2024-02-21T07:57:09.068511+0000","last_peered":"2024-02-21T07:57:09.068511+0000","last_clean":"2024-02-21T07:57:09.068511+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:57:09.068511+0000","last_undegraded":"2024-02-21T07:57:09.068511+0000","last_fullsized":"2024-02-21T07:57:09.068511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:54:45.191386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2095","reported_seq":2152,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.708515+0000","last_change":"2024-02-21T07:45:30.333103+0000","last_active":"2024-02-21T07:58:07.708515+0000","last_peered":"2024-02-21T07:58:07.708515+0000","last_clean":"2024-02-21T07:58:07.708515+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:58:07.708515+0000","last_undegraded":"2024-02-21T07:58:07.708515+0000","last_fullsized":"2024-02-21T07:58:07.708515+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:27:01.970475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22512,"num_write_kb":5792019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"30'16","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.859753+0000","last_change":"2024-02-21T07:45:26.265605+0000","last_active":"2024-02-21T07:58:20.859753+0000","last_peered":"2024-02-21T07:58:20.859753+0000","last_clean":"2024-02-21T07:58:20.859753+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:58:20.859753+0000","last_undegraded":"2024-02-21T07:58:20.859753+0000","last_fullsized":"2024-02-21T07:58:20.859753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'57","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:38.399451+0000","last_change":"2024-02-21T07:45:25.220647+0000","last_active":"2024-02-21T07:57:38.399451+0000","last_peered":"2024-02-21T07:57:38.399451+0000","last_clean":"2024-02-21T07:57:38.399451+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:57:38.399451+0000","last_undegraded":"2024-02-21T07:57:38.399451+0000","last_fullsized":"2024-02-21T07:57:38.399451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":20,"num_write":108,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"30'2154","reported_seq":2177,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.796003+0000","last_change":"2024-02-21T07:45:30.315420+0000","last_active":"2024-02-21T07:58:07.796003+0000","last_peered":"2024-02-21T07:58:07.796003+0000","last_clean":"2024-02-21T07:58:07.796003+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:58:07.796003+0000","last_undegraded":"2024-02-21T07:58:07.796003+0000","last_fullsized":"2024-02-21T07:58:07.796003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:03:12.588672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":5940672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"30'14","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.854493+0000","last_change":"2024-02-21T07:45:26.262288+0000","last_active":"2024-02-21T07:58:20.854493+0000","last_peered":"2024-02-21T07:58:20.854493+0000","last_clean":"2024-02-21T07:58:20.854493+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:58:20.854493+0000","last_undegraded":"2024-02-21T07:58:20.854493+0000","last_fullsized":"2024-02-21T07:58:20.854493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:39:47.997191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'757","reported_seq":2166,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.871518+0000","last_change":"2024-02-21T07:45:25.233534+0000","last_active":"2024-02-21T07:58:27.871518+0000","last_peered":"2024-02-21T07:58:27.871518+0000","last_clean":"2024-02-21T07:58:27.871518+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:58:27.871518+0000","last_undegraded":"2024-02-21T07:58:27.871518+0000","last_fullsized":"2024-02-21T07:58:27.871518+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:44:00.509447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1378,"num_read_kb":4929,"num_write":757,"num_write_kb":4594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"30'2054","reported_seq":2096,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.795180+0000","last_change":"2024-02-21T07:45:30.318991+0000","last_active":"2024-02-21T07:58:07.795180+0000","last_peered":"2024-02-21T07:58:07.795180+0000","last_clean":"2024-02-21T07:58:07.795180+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:58:07.795180+0000","last_undegraded":"2024-02-21T07:58:07.795180+0000","last_fullsized":"2024-02-21T07:58:07.795180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":21761,"num_write_kb":5639370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.859369+0000","last_change":"2024-02-21T07:45:26.263831+0000","last_active":"2024-02-21T07:58:20.859369+0000","last_peered":"2024-02-21T07:58:20.859369+0000","last_clean":"2024-02-21T07:58:20.859369+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:58:20.859369+0000","last_undegraded":"2024-02-21T07:58:20.859369+0000","last_fullsized":"2024-02-21T07:58:20.859369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"30'58","reported_seq":109,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:03.690539+0000","last_change":"2024-02-21T07:45:25.245109+0000","last_active":"2024-02-21T07:58:03.690539+0000","last_peered":"2024-02-21T07:58:03.690539+0000","last_clean":"2024-02-21T07:58:03.690539+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:58:03.690539+0000","last_undegraded":"2024-02-21T07:58:03.690539+0000","last_fullsized":"2024-02-21T07:58:03.690539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:35.742061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":65,"num_read_kb":20,"num_write":105,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"30'2000","reported_seq":2058,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.811194+0000","last_change":"2024-02-21T07:45:30.317158+0000","last_active":"2024-02-21T07:58:07.811194+0000","last_peered":"2024-02-21T07:58:07.811194+0000","last_clean":"2024-02-21T07:58:07.811194+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:58:07.811194+0000","last_undegraded":"2024-02-21T07:58:07.811194+0000","last_fullsized":"2024-02-21T07:58:07.811194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":21494,"num_write_kb":5470657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"30'18","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.417685+0000","last_change":"2024-02-21T07:58:26.417709+0000","last_active":"2024-02-21T07:58:26.417685+0000","last_peered":"2024-02-21T07:58:26.417685+0000","last_clean":"2024-02-21T07:58:26.417685+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:58:26.417685+0000","last_undegraded":"2024-02-21T07:58:26.417685+0000","last_fullsized":"2024-02-21T07:58:26.417685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:26.417608+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:26.417608+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.417608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:56:22.796522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'2","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:57:34.050610+0000","last_change":"2024-02-21T07:45:25.233319+0000","last_active":"2024-02-21T07:57:34.050610+0000","last_peered":"2024-02-21T07:57:34.050610+0000","last_clean":"2024-02-21T07:57:34.050610+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:57:34.050610+0000","last_undegraded":"2024-02-21T07:57:34.050610+0000","last_fullsized":"2024-02-21T07:57:34.050610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"30'2237","reported_seq":2280,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.819337+0000","last_change":"2024-02-21T07:45:30.329476+0000","last_active":"2024-02-21T07:58:07.819337+0000","last_peered":"2024-02-21T07:58:07.819337+0000","last_clean":"2024-02-21T07:58:07.819337+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:58:07.819337+0000","last_undegraded":"2024-02-21T07:58:07.819337+0000","last_fullsized":"2024-02-21T07:58:07.819337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24168,"num_write_kb":6241728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"30'21","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.855936+0000","last_change":"2024-02-21T07:45:26.266611+0000","last_active":"2024-02-21T07:58:20.855936+0000","last_peered":"2024-02-21T07:58:20.855936+0000","last_clean":"2024-02-21T07:58:20.855936+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:58:20.855936+0000","last_undegraded":"2024-02-21T07:58:20.855936+0000","last_fullsized":"2024-02-21T07:58:20.855936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"30'10","reported_seq":800,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.441170+0000","last_change":"2024-02-21T07:45:25.225753+0000","last_active":"2024-02-21T07:58:27.441170+0000","last_peered":"2024-02-21T07:58:27.441170+0000","last_clean":"2024-02-21T07:58:27.441170+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:58:27.441170+0000","last_undegraded":"2024-02-21T07:58:27.441170+0000","last_fullsized":"2024-02-21T07:58:27.441170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:09.970358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":759,"num_read_kb":759,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"30'2195","reported_seq":2219,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.775183+0000","last_change":"2024-02-21T07:45:30.315971+0000","last_active":"2024-02-21T07:58:07.775183+0000","last_peered":"2024-02-21T07:58:07.775183+0000","last_clean":"2024-02-21T07:58:07.775183+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:58:07.775183+0000","last_undegraded":"2024-02-21T07:58:07.775183+0000","last_fullsized":"2024-02-21T07:58:07.775183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":6089984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1963","reported_seq":1988,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.820800+0000","last_change":"2024-02-21T07:45:30.322398+0000","last_active":"2024-02-21T07:58:07.820800+0000","last_peered":"2024-02-21T07:58:07.820800+0000","last_clean":"2024-02-21T07:58:07.820800+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:58:07.820800+0000","last_undegraded":"2024-02-21T07:58:07.820800+0000","last_fullsized":"2024-02-21T07:58:07.820800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21157,"num_write_kb":5478016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'21","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.877118+0000","last_change":"2024-02-21T07:45:26.279809+0000","last_active":"2024-02-21T07:58:20.877118+0000","last_peered":"2024-02-21T07:58:20.877118+0000","last_clean":"2024-02-21T07:58:20.877118+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:58:20.877118+0000","last_undegraded":"2024-02-21T07:58:20.877118+0000","last_fullsized":"2024-02-21T07:58:20.877118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":32,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:09.041150+0000","last_change":"2024-02-21T07:45:25.233299+0000","last_active":"2024-02-21T07:55:09.041150+0000","last_peered":"2024-02-21T07:55:09.041150+0000","last_clean":"2024-02-21T07:55:09.041150+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:55:09.041150+0000","last_undegraded":"2024-02-21T07:55:09.041150+0000","last_fullsized":"2024-02-21T07:55:09.041150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:53.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'2123","reported_seq":2147,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.673299+0000","last_change":"2024-02-21T07:45:30.333000+0000","last_active":"2024-02-21T07:58:07.673299+0000","last_peered":"2024-02-21T07:58:07.673299+0000","last_clean":"2024-02-21T07:58:07.673299+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:58:07.673299+0000","last_undegraded":"2024-02-21T07:58:07.673299+0000","last_fullsized":"2024-02-21T07:58:07.673299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:14.827642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22656,"num_write_kb":5874432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.102087+0000","last_change":"2024-02-21T07:58:28.102129+0000","last_active":"2024-02-21T07:58:28.102087+0000","last_peered":"2024-02-21T07:58:28.102087+0000","last_clean":"2024-02-21T07:58:28.102087+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:58:28.102087+0000","last_undegraded":"2024-02-21T07:58:28.102087+0000","last_fullsized":"2024-02-21T07:58:28.102087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:28.101969+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:28.101969+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.101969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:14.224743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.630720+0000","last_change":"2024-02-21T07:58:26.630770+0000","last_active":"2024-02-21T07:58:26.630720+0000","last_peered":"2024-02-21T07:58:26.630720+0000","last_clean":"2024-02-21T07:58:26.630720+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:58:26.630720+0000","last_undegraded":"2024-02-21T07:58:26.630720+0000","last_fullsized":"2024-02-21T07:58:26.630720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-02-21T07:58:26.630621+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-02-21T07:58:26.630621+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.630621+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:38.979198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"28'3","reported_seq":34,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:55:29.017432+0000","last_change":"2024-02-21T07:45:25.225212+0000","last_active":"2024-02-21T07:55:29.017432+0000","last_peered":"2024-02-21T07:55:29.017432+0000","last_clean":"2024-02-21T07:55:29.017432+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:55:29.017432+0000","last_undegraded":"2024-02-21T07:55:29.017432+0000","last_fullsized":"2024-02-21T07:55:29.017432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"30'20","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856485+0000","last_change":"2024-02-21T07:45:26.263029+0000","last_active":"2024-02-21T07:58:20.856485+0000","last_peered":"2024-02-21T07:58:20.856485+0000","last_clean":"2024-02-21T07:58:20.856485+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:58:20.856485+0000","last_undegraded":"2024-02-21T07:58:20.856485+0000","last_fullsized":"2024-02-21T07:58:20.856485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2454","reported_seq":2477,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.742250+0000","last_change":"2024-02-21T07:45:30.328073+0000","last_active":"2024-02-21T07:58:07.742250+0000","last_peered":"2024-02-21T07:58:07.742250+0000","last_clean":"2024-02-21T07:58:07.742250+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:58:07.742250+0000","last_undegraded":"2024-02-21T07:58:07.742250+0000","last_fullsized":"2024-02-21T07:58:07.742250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2454,"log_dups_size":0,"ondisk_log_size":2454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:31:03.569866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26408,"num_write_kb":6832640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'385","reported_seq":1578,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.443446+0000","last_change":"2024-02-21T07:45:25.225649+0000","last_active":"2024-02-21T07:58:28.443446+0000","last_peered":"2024-02-21T07:58:28.443446+0000","last_clean":"2024-02-21T07:58:28.443446+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:58:28.443446+0000","last_undegraded":"2024-02-21T07:58:28.443446+0000","last_fullsized":"2024-02-21T07:58:28.443446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:24.196531+0000","last_clean_scrub_stamp":"2024-02-21T07:45:24.196531+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:39:12.628758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3066758,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1162,"num_read_kb":3043,"num_write":382,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'14","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856505+0000","last_change":"2024-02-21T07:45:26.280066+0000","last_active":"2024-02-21T07:58:20.856505+0000","last_peered":"2024-02-21T07:58:20.856505+0000","last_clean":"2024-02-21T07:58:20.856505+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:58:20.856505+0000","last_undegraded":"2024-02-21T07:58:20.856505+0000","last_fullsized":"2024-02-21T07:58:20.856505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:09:47.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2254","reported_seq":2294,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:07.754893+0000","last_change":"2024-02-21T07:45:30.309248+0000","last_active":"2024-02-21T07:58:07.754893+0000","last_peered":"2024-02-21T07:58:07.754893+0000","last_clean":"2024-02-21T07:58:07.754893+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:58:07.754893+0000","last_undegraded":"2024-02-21T07:58:07.754893+0000","last_fullsized":"2024-02-21T07:58:07.754893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:29.283349+0000","last_clean_scrub_stamp":"2024-02-21T07:45:29.283349+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:28:01.230117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":24317,"num_write_kb":6228160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'19","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856417+0000","last_change":"2024-02-21T07:45:26.261142+0000","last_active":"2024-02-21T07:58:20.856417+0000","last_peered":"2024-02-21T07:58:20.856417+0000","last_clean":"2024-02-21T07:58:20.856417+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:58:20.856417+0000","last_undegraded":"2024-02-21T07:58:20.856417+0000","last_fullsized":"2024-02-21T07:58:20.856417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:27:36.753486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"30'23","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.855058+0000","last_change":"2024-02-21T07:45:26.264739+0000","last_active":"2024-02-21T07:58:20.855058+0000","last_peered":"2024-02-21T07:58:20.855058+0000","last_clean":"2024-02-21T07:58:20.855058+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:58:20.855058+0000","last_undegraded":"2024-02-21T07:58:20.855058+0000","last_fullsized":"2024-02-21T07:58:20.855058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"30'25","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.871696+0000","last_change":"2024-02-21T07:45:26.258484+0000","last_active":"2024-02-21T07:58:20.871696+0000","last_peered":"2024-02-21T07:58:20.871696+0000","last_clean":"2024-02-21T07:58:20.871696+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:58:20.871696+0000","last_undegraded":"2024-02-21T07:58:20.871696+0000","last_fullsized":"2024-02-21T07:58:20.871696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"30'14","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.440291+0000","last_change":"2024-02-21T07:58:29.440346+0000","last_active":"2024-02-21T07:58:29.440291+0000","last_peered":"2024-02-21T07:58:29.440291+0000","last_clean":"2024-02-21T07:58:29.440291+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:58:29.440291+0000","last_undegraded":"2024-02-21T07:58:29.440291+0000","last_fullsized":"2024-02-21T07:58:29.440291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:29.440121+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:29.440121+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.440121+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:15.562896+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'9","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.197846+0000","last_change":"2024-02-21T07:45:26.262518+0000","last_active":"2024-02-21T07:58:26.197846+0000","last_peered":"2024-02-21T07:58:26.197846+0000","last_clean":"2024-02-21T07:58:26.197846+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:58:26.197846+0000","last_undegraded":"2024-02-21T07:58:26.197846+0000","last_fullsized":"2024-02-21T07:58:26.197846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'13","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856691+0000","last_change":"2024-02-21T07:45:26.265472+0000","last_active":"2024-02-21T07:58:20.856691+0000","last_peered":"2024-02-21T07:58:20.856691+0000","last_clean":"2024-02-21T07:58:20.856691+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:58:20.856691+0000","last_undegraded":"2024-02-21T07:58:20.856691+0000","last_fullsized":"2024-02-21T07:58:20.856691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"30'23","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.858465+0000","last_change":"2024-02-21T07:45:26.263223+0000","last_active":"2024-02-21T07:58:20.858465+0000","last_peered":"2024-02-21T07:58:20.858465+0000","last_clean":"2024-02-21T07:58:20.858465+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:58:20.858465+0000","last_undegraded":"2024-02-21T07:58:20.858465+0000","last_fullsized":"2024-02-21T07:58:20.858465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:23:40.112563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'12","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:25.498715+0000","last_change":"2024-02-21T07:45:26.269098+0000","last_active":"2024-02-21T07:58:25.498715+0000","last_peered":"2024-02-21T07:58:25.498715+0000","last_clean":"2024-02-21T07:58:25.498715+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:58:25.498715+0000","last_undegraded":"2024-02-21T07:58:25.498715+0000","last_fullsized":"2024-02-21T07:58:25.498715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'14","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.857568+0000","last_change":"2024-02-21T07:45:26.279823+0000","last_active":"2024-02-21T07:58:20.857568+0000","last_peered":"2024-02-21T07:58:20.857568+0000","last_clean":"2024-02-21T07:58:20.857568+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:58:20.857568+0000","last_undegraded":"2024-02-21T07:58:20.857568+0000","last_fullsized":"2024-02-21T07:58:20.857568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:25:27.816810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"30'18","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.035795+0000","last_change":"2024-02-21T07:58:30.035837+0000","last_active":"2024-02-21T07:58:30.035795+0000","last_peered":"2024-02-21T07:58:30.035795+0000","last_clean":"2024-02-21T07:58:30.035795+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:58:30.035795+0000","last_undegraded":"2024-02-21T07:58:30.035795+0000","last_fullsized":"2024-02-21T07:58:30.035795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:30.035661+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:30.035661+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.035661+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:22.610717+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"30'16","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856806+0000","last_change":"2024-02-21T07:45:26.266580+0000","last_active":"2024-02-21T07:58:20.856806+0000","last_peered":"2024-02-21T07:58:20.856806+0000","last_clean":"2024-02-21T07:58:20.856806+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:58:20.856806+0000","last_undegraded":"2024-02-21T07:58:20.856806+0000","last_fullsized":"2024-02-21T07:58:20.856806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'22","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.872950+0000","last_change":"2024-02-21T07:45:26.272414+0000","last_active":"2024-02-21T07:58:20.872950+0000","last_peered":"2024-02-21T07:58:20.872950+0000","last_clean":"2024-02-21T07:58:20.872950+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:58:20.872950+0000","last_undegraded":"2024-02-21T07:58:20.872950+0000","last_fullsized":"2024-02-21T07:58:20.872950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"30'19","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.855467+0000","last_change":"2024-02-21T07:45:26.262305+0000","last_active":"2024-02-21T07:58:20.855467+0000","last_peered":"2024-02-21T07:58:20.855467+0000","last_clean":"2024-02-21T07:58:20.855467+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:58:20.855467+0000","last_undegraded":"2024-02-21T07:58:20.855467+0000","last_fullsized":"2024-02-21T07:58:20.855467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:06:54.902798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"30'14","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.873257+0000","last_change":"2024-02-21T07:45:26.259322+0000","last_active":"2024-02-21T07:58:20.873257+0000","last_peered":"2024-02-21T07:58:20.873257+0000","last_clean":"2024-02-21T07:58:20.873257+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:58:20.873257+0000","last_undegraded":"2024-02-21T07:58:20.873257+0000","last_fullsized":"2024-02-21T07:58:20.873257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"30'21","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.872236+0000","last_change":"2024-02-21T07:45:26.274425+0000","last_active":"2024-02-21T07:58:20.872236+0000","last_peered":"2024-02-21T07:58:20.872236+0000","last_clean":"2024-02-21T07:58:20.872236+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:58:20.872236+0000","last_undegraded":"2024-02-21T07:58:20.872236+0000","last_fullsized":"2024-02-21T07:58:20.872236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"30'16","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856952+0000","last_change":"2024-02-21T07:45:26.263498+0000","last_active":"2024-02-21T07:58:20.856952+0000","last_peered":"2024-02-21T07:58:20.856952+0000","last_clean":"2024-02-21T07:58:20.856952+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:58:20.856952+0000","last_undegraded":"2024-02-21T07:58:20.856952+0000","last_fullsized":"2024-02-21T07:58:20.856952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:09:11.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"30'16","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856068+0000","last_change":"2024-02-21T07:45:26.267815+0000","last_active":"2024-02-21T07:58:20.856068+0000","last_peered":"2024-02-21T07:58:20.856068+0000","last_clean":"2024-02-21T07:58:20.856068+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:58:20.856068+0000","last_undegraded":"2024-02-21T07:58:20.856068+0000","last_fullsized":"2024-02-21T07:58:20.856068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"30'16","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.880770+0000","last_change":"2024-02-21T07:45:26.284008+0000","last_active":"2024-02-21T07:58:20.880770+0000","last_peered":"2024-02-21T07:58:20.880770+0000","last_clean":"2024-02-21T07:58:20.880770+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:58:20.880770+0000","last_undegraded":"2024-02-21T07:58:20.880770+0000","last_fullsized":"2024-02-21T07:58:20.880770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:25.423969+0000","last_change":"2024-02-21T07:58:25.424008+0000","last_active":"2024-02-21T07:58:25.423969+0000","last_peered":"2024-02-21T07:58:25.423969+0000","last_clean":"2024-02-21T07:58:25.423969+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:58:25.423969+0000","last_undegraded":"2024-02-21T07:58:25.423969+0000","last_fullsized":"2024-02-21T07:58:25.423969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:25.423864+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:25.423864+0000","last_clean_scrub_stamp":"2024-02-21T07:58:25.423864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:46:14.699018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"30'15","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.864089+0000","last_change":"2024-02-21T07:45:26.260101+0000","last_active":"2024-02-21T07:58:20.864089+0000","last_peered":"2024-02-21T07:58:20.864089+0000","last_clean":"2024-02-21T07:58:20.864089+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:58:20.864089+0000","last_undegraded":"2024-02-21T07:58:20.864089+0000","last_fullsized":"2024-02-21T07:58:20.864089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'14","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.853337+0000","last_change":"2024-02-21T07:45:26.262808+0000","last_active":"2024-02-21T07:58:20.853337+0000","last_peered":"2024-02-21T07:58:20.853337+0000","last_clean":"2024-02-21T07:58:20.853337+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:58:20.853337+0000","last_undegraded":"2024-02-21T07:58:20.853337+0000","last_fullsized":"2024-02-21T07:58:20.853337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"30'15","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.857147+0000","last_change":"2024-02-21T07:45:26.263529+0000","last_active":"2024-02-21T07:58:20.857147+0000","last_peered":"2024-02-21T07:58:20.857147+0000","last_clean":"2024-02-21T07:58:20.857147+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:58:20.857147+0000","last_undegraded":"2024-02-21T07:58:20.857147+0000","last_fullsized":"2024-02-21T07:58:20.857147+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'23","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856425+0000","last_change":"2024-02-21T07:45:26.261108+0000","last_active":"2024-02-21T07:58:20.856425+0000","last_peered":"2024-02-21T07:58:20.856425+0000","last_clean":"2024-02-21T07:58:20.856425+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:58:20.856425+0000","last_undegraded":"2024-02-21T07:58:20.856425+0000","last_fullsized":"2024-02-21T07:58:20.856425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:27:50.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"30'21","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.857501+0000","last_change":"2024-02-21T07:45:26.268923+0000","last_active":"2024-02-21T07:58:20.857501+0000","last_peered":"2024-02-21T07:58:20.857501+0000","last_clean":"2024-02-21T07:58:20.857501+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:58:20.857501+0000","last_undegraded":"2024-02-21T07:58:20.857501+0000","last_fullsized":"2024-02-21T07:58:20.857501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.078461+0000","last_change":"2024-02-21T07:58:29.078487+0000","last_active":"2024-02-21T07:58:29.078461+0000","last_peered":"2024-02-21T07:58:29.078461+0000","last_clean":"2024-02-21T07:58:29.078461+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:58:29.078461+0000","last_undegraded":"2024-02-21T07:58:29.078461+0000","last_fullsized":"2024-02-21T07:58:29.078461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:29.078386+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:29.078386+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.078386+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:51.092527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'19","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.859554+0000","last_change":"2024-02-21T07:45:26.279957+0000","last_active":"2024-02-21T07:58:20.859554+0000","last_peered":"2024-02-21T07:58:20.859554+0000","last_clean":"2024-02-21T07:58:20.859554+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:58:20.859554+0000","last_undegraded":"2024-02-21T07:58:20.859554+0000","last_fullsized":"2024-02-21T07:58:20.859554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"30'15","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.856541+0000","last_change":"2024-02-21T07:45:26.279911+0000","last_active":"2024-02-21T07:58:20.856541+0000","last_peered":"2024-02-21T07:58:20.856541+0000","last_clean":"2024-02-21T07:58:20.856541+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:58:20.856541+0000","last_undegraded":"2024-02-21T07:58:20.856541+0000","last_fullsized":"2024-02-21T07:58:20.856541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:24:43.305166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"30'10","reported_seq":39,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.878722+0000","last_change":"2024-02-21T07:45:26.283667+0000","last_active":"2024-02-21T07:58:20.878722+0000","last_peered":"2024-02-21T07:58:20.878722+0000","last_clean":"2024-02-21T07:58:20.878722+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:58:20.878722+0000","last_undegraded":"2024-02-21T07:58:20.878722+0000","last_fullsized":"2024-02-21T07:58:20.878722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:21:10.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"30'15","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.858327+0000","last_change":"2024-02-21T07:45:26.264314+0000","last_active":"2024-02-21T07:58:20.858327+0000","last_peered":"2024-02-21T07:58:20.858327+0000","last_clean":"2024-02-21T07:58:20.858327+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:58:20.858327+0000","last_undegraded":"2024-02-21T07:58:20.858327+0000","last_fullsized":"2024-02-21T07:58:20.858327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.427715+0000","last_change":"2024-02-21T07:58:27.427778+0000","last_active":"2024-02-21T07:58:27.427715+0000","last_peered":"2024-02-21T07:58:27.427715+0000","last_clean":"2024-02-21T07:58:27.427715+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:58:27.427715+0000","last_undegraded":"2024-02-21T07:58:27.427715+0000","last_fullsized":"2024-02-21T07:58:27.427715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:27.427606+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:27.427606+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.427606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:40.860078+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.875797+0000","last_change":"2024-02-21T07:45:26.281054+0000","last_active":"2024-02-21T07:58:20.875797+0000","last_peered":"2024-02-21T07:58:20.875797+0000","last_clean":"2024-02-21T07:58:20.875797+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:58:20.875797+0000","last_undegraded":"2024-02-21T07:58:20.875797+0000","last_fullsized":"2024-02-21T07:58:20.875797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"30'17","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:20.857187+0000","last_change":"2024-02-21T07:45:26.262828+0000","last_active":"2024-02-21T07:58:20.857187+0000","last_peered":"2024-02-21T07:58:20.857187+0000","last_clean":"2024-02-21T07:58:20.857187+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:58:20.857187+0000","last_undegraded":"2024-02-21T07:58:20.857187+0000","last_fullsized":"2024-02-21T07:58:20.857187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:45:25.207955+0000","last_clean_scrub_stamp":"2024-02-21T07:45:25.207955+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:07:12.710272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":753511,"num_write_kb":194935703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70426,"ondisk_log_size":70426,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1039,"ondisk_log_size":1039,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3072598,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":5390,"num_read_kb":9700,"num_write":2219,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6508,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2842624,"data_stored":6145196,"data_compressed":766850,"data_compressed_allocated":1040384,"data_compressed_original":4505600,"omap_allocated":0,"internal_metadata":0},"log_size":1811,"ondisk_log_size":1811,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444192,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94177980,"statfs":{"total":96636764160,"available":96438251520,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":198179268},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":2.1349999999999998,"15min":1.4990000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":18.609999999999999,"5min":18.609999999999999,"15min":41.207999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":1.883,"5min":1.532,"15min":1.25},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.26600000000000001},"max":{"1min":12.308999999999999,"5min":13.135999999999999,"15min":24.315999999999999},"last":0.76100000000000001}]},{"osd":1,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.442,"15min":0.504},"min":{"1min":0.254,"5min":0.247,"15min":0.19900000000000001},"max":{"1min":0.63400000000000001,"5min":1.2669999999999999,"15min":1.9950000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.46200000000000002,"15min":0.50700000000000001},"min":{"1min":0.252,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.048,"5min":1.8240000000000001,"15min":2.1419999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.39100000000000001,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.70999999999999996,"5min":3.089,"15min":3.089},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.436,"5min":0.44700000000000001,"15min":0.441},"min":{"1min":0.26200000000000001,"5min":0.22600000000000001,"15min":0.218},"max":{"1min":0.75,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52800000000000002,"15min":0.56599999999999995},"min":{"1min":0.33200000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.76600000000000001,"5min":1.5880000000000001,"15min":2.0190000000000001},"last":0.747},{"interface":"front","average":{"1min":0.499,"5min":0.51100000000000001,"15min":0.55500000000000005},"min":{"1min":0.312,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":1.0029999999999999,"5min":1.8819999999999999,"15min":3.1059999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46999999999999997,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.86699999999999999,"5min":1.6910000000000001,"15min":2.234},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.28100000000000003,"5min":0.252,"15min":0.249},"max":{"1min":1.087,"5min":7.2640000000000002,"15min":7.2640000000000002},"last":0.42599999999999999}]},{"osd":6,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":2.2970000000000002,"15min":1.631},"min":{"1min":0.40400000000000003,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":13.577,"5min":24.452000000000002,"15min":24.452000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.0499999999999998,"5min":2.3380000000000001,"15min":1.6870000000000001},"min":{"1min":0.46700000000000003,"5min":0.42599999999999999,"15min":0.378},"max":{"1min":13.609,"5min":25.504000000000001,"15min":25.504000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60399999999999998,"15min":0.64100000000000001},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.32800000000000001},"max":{"1min":1.0860000000000001,"5min":1.9870000000000001,"15min":3.1429999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.624},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":1.0649999999999999,"5min":3.8479999999999999,"15min":3.8479999999999999},"last":0.628}]},{"osd":8,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.59299999999999997},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":1.665,"5min":1.665,"15min":3.0800000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.314},"max":{"1min":0.95199999999999996,"5min":1.9370000000000001,"15min":3.1989999999999998},"last":0.47599999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:47 2024","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":3.6850000000000001,"15min":2.1760000000000002},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":7.5229999999999997,"5min":102.712,"15min":102.712},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.4379999999999999,"5min":2.8109999999999999,"15min":1.7170000000000001},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.48599999999999999},"max":{"1min":4.9980000000000002,"5min":27.137,"15min":27.137},"last":0.77700000000000002}]},{"osd":10,"last update":"Wed Feb 21 07:57:37 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1.214,"5min":1.972,"15min":3.2250000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.65900000000000003,"15min":0.67800000000000005},"min":{"1min":0.45400000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"max":{"1min":1.02,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.79400000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161940,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94209900,"statfs":{"total":96636764160,"available":96470937600,"internally_reserved":0,"allocated":339968,"data_stored":153098,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":165476800},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":2.149,"5min":1.8540000000000001,"15min":1.264},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":18.68,"5min":18.68,"15min":18.68},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.367,"5min":1.631,"15min":1.3480000000000001},"min":{"1min":0.39200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.4400000000000004,"5min":9.0079999999999991,"15min":13.788},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.32100000000000001,"15min":0.34300000000000003},"min":{"1min":0.245,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.36599999999999999},"min":{"1min":0.22900000000000001,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.583},"last":0.45600000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42199999999999999,"15min":0.49399999999999999},"min":{"1min":0.26300000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":1.083,"5min":1.083,"15min":1.2749999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.45800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.27000000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.2629999999999999},"last":0.60299999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.9119999999999999,"15min":1.4099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39000000000000001,"15min":0.32600000000000001},"max":{"1min":5.6280000000000001,"5min":15.042999999999999,"15min":15.042999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":2.855,"5min":2.9950000000000001,"15min":1.669},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":13.597,"5min":52.374000000000002,"15min":52.374000000000002},"last":0.71099999999999997}]},{"osd":4,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":1.4530000000000001,"5min":2.004,"15min":2.004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.496,"15min":0.51300000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.24399999999999999},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.9199999999999999},"last":0.751}]},{"osd":5,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.54000000000000004},"min":{"1min":0.32000000000000001,"5min":0.30499999999999999,"15min":0.29199999999999998},"max":{"1min":1.167,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.54200000000000004,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.421,"5min":1.694,"15min":1.897},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.51500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29799999999999999,"15min":0.27000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.70799999999999996,"5min":0.73599999999999999,"15min":1.0509999999999999},"last":0.63100000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:45 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.33800000000000002},"max":{"1min":1.228,"5min":1.857,"15min":1.857},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.61199999999999999,"15min":0.65000000000000002},"min":{"1min":0.41399999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.4750000000000001,"5min":1.958,"15min":1.958},"last":0.90100000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.698,"15min":1.73},"min":{"1min":0.52000000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":26.867000000000001,"5min":26.867000000000001,"15min":26.867000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":4.8319999999999999,"5min":3.702,"15min":2.5569999999999999},"min":{"1min":0.49199999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.609000000000002,"5min":23.939,"15min":60.792000000000002},"last":0.93300000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:41 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.67000000000000004,"15min":0.68700000000000006},"min":{"1min":0.44500000000000001,"5min":0.41899999999999998,"15min":0.41399999999999998},"max":{"1min":4.8070000000000004,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.877},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.64700000000000002,"15min":0.64800000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":5.8109999999999999,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.73999999999999999}]}]},{"osd":9,"up_from":17,"seq":73014444193,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368780,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":368446,"kb_avail":94003060,"statfs":{"total":96636764160,"available":96259133440,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":377289152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.6239999999999997,"5min":5.3689999999999998,"15min":3.9129999999999998},"min":{"1min":0.57099999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":44.676000000000002,"5min":44.676000000000002,"15min":66.947999999999993},"last":0.45100000000000001},{"interface":"front","average":{"1min":2.8740000000000001,"5min":4.423,"15min":3.1179999999999999},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":11.470000000000001,"5min":31.988,"15min":31.988},"last":0.67800000000000005}]},{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5489999999999999,"5min":3.161,"15min":2.242},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":12.119,"5min":24.472000000000001,"15min":27.088999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":4.9749999999999996,"5min":4.5949999999999998,"15min":3.2799999999999998},"min":{"1min":0.59299999999999997,"5min":0.438,"15min":0.40799999999999997},"max":{"1min":44.505000000000003,"5min":44.505000000000003,"15min":66.670000000000002},"last":0.379}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.024,"5min":3.206,"15min":2.3639999999999999},"min":{"1min":0.54600000000000004,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":10.294,"5min":30.081,"15min":30.081},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.6360000000000001,"5min":3.306,"15min":2.3319999999999999},"min":{"1min":0.59699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":11.983000000000001,"5min":24.379999999999999,"15min":24.379999999999999},"last":0.91700000000000004}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.3899999999999997,"5min":5.399,"15min":4.1059999999999999},"min":{"1min":0.66300000000000003,"5min":0.59399999999999997,"15min":0.38900000000000001},"max":{"1min":44.453000000000003,"5min":44.453000000000003,"15min":66.914000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":3.3170000000000002,"5min":5.4950000000000001,"15min":3.702},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.42699999999999999},"max":{"1min":10.785,"5min":30.513999999999999,"15min":30.513999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":3.5089999999999999,"15min":2.5299999999999998},"min":{"1min":0.56299999999999994,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.077,"5min":24.928999999999998,"15min":27.155999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":5.149,"5min":4.9880000000000004,"15min":3.5600000000000001},"min":{"1min":0.65300000000000002,"5min":0.56699999999999995,"15min":0.496},"max":{"1min":44.542999999999999,"5min":44.542999999999999,"15min":66.802999999999997},"last":0.51100000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.7120000000000002,"5min":3.4990000000000001,"15min":2.5470000000000002},"min":{"1min":0.64300000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.154999999999999,"5min":24.510000000000002,"15min":26.954000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":2.4630000000000001,"5min":3.613,"15min":2.827},"min":{"1min":0.73199999999999998,"5min":0.63600000000000001,"15min":0.51700000000000002},"max":{"1min":10.346,"5min":30.129999999999999,"15min":37.783000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2839999999999998,"5min":5.1349999999999998,"15min":3.6930000000000001},"min":{"1min":0.69299999999999995,"5min":0.59999999999999998,"15min":0.50800000000000001},"max":{"1min":44.610999999999997,"5min":44.610999999999997,"15min":66.879000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":2.8759999999999999,"5min":3.7909999999999999,"15min":2.7170000000000001},"min":{"1min":0.68200000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":14.105,"5min":24.895,"15min":27.056999999999999},"last":1.026}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":5.2320000000000002,"5min":5.4660000000000002,"15min":3.8359999999999999},"min":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.53200000000000003},"max":{"1min":44.578000000000003,"5min":44.578000000000003,"15min":66.841999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":2.6389999999999998,"5min":3.7400000000000002,"15min":2.9540000000000002},"min":{"1min":0.82899999999999996,"5min":0.63800000000000001,"15min":0.60999999999999999},"max":{"1min":10.667999999999999,"5min":30.167999999999999,"15min":37.670999999999999},"last":0.88600000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":3.8079999999999998,"15min":2.77},"min":{"1min":0.70799999999999996,"5min":0.51100000000000001,"15min":0.45700000000000002},"max":{"1min":14.147,"5min":24.959,"15min":27.123000000000001},"last":1.145},{"interface":"front","average":{"1min":5.1989999999999998,"5min":5.3330000000000002,"15min":3.8809999999999998},"min":{"1min":0.751,"5min":0.66000000000000003,"15min":0.59999999999999998},"max":{"1min":44.643999999999998,"5min":44.643999999999998,"15min":66.760999999999996},"last":0.77700000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.6709999999999998,"5min":3.8260000000000001,"15min":3.036},"min":{"1min":0.86499999999999999,"5min":0.77400000000000002,"15min":0.59399999999999997},"max":{"1min":10.712999999999999,"5min":30.198,"15min":37.747999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":3.0339999999999998,"5min":3.851,"15min":2.8010000000000002},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":14.041,"5min":24.858000000000001,"15min":27.023},"last":1.208}]}]},{"osd":8,"up_from":17,"seq":73014444193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179984,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":1.857,"15min":1.9650000000000001},"min":{"1min":0.33000000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.952,"5min":26.353999999999999,"15min":205.21299999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":2.4079999999999999,"5min":4.0979999999999999,"15min":2.1139999999999999},"min":{"1min":0.378,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":8.4779999999999998,"5min":65.656999999999996,"15min":65.656999999999996},"last":0.82599999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42599999999999999,"15min":0.53600000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.071,"5min":1.3779999999999999,"15min":3.8900000000000001},"last":0.623},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.435,"15min":0.53100000000000003},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.55300000000000005,"5min":1.4179999999999999,"15min":3.024},"last":0.69799999999999995}]},{"osd":2,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.46100000000000002},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.83499999999999996,"5min":2.0489999999999999,"15min":3.4990000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.45100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":1.484,"15min":3.794},"last":0.439}]},{"osd":3,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":2.9129999999999998,"15min":1.7929999999999999},"min":{"1min":0.48599999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":13.1,"5min":23.033999999999999,"15min":23.033999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.7310000000000001,"5min":2.919,"15min":1.782},"min":{"1min":0.439,"5min":0.42599999999999999,"15min":0.42299999999999999},"max":{"1min":13.138999999999999,"5min":23.047999999999998,"15min":23.047999999999998},"last":0.64300000000000002}]},{"osd":4,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.58999999999999997},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":1.1279999999999999,"5min":1.242,"15min":3.3260000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.497,"15min":0.59599999999999997},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.0529999999999999,"5min":1.133,"15min":3.839},"last":0.71699999999999997}]},{"osd":5,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27000000000000002},"max":{"1min":0.94299999999999995,"5min":1.359,"15min":2.9809999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.54100000000000004},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":1.651,"15min":4.0069999999999997},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":2.2930000000000001,"5min":2.601,"15min":1.8240000000000001},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":13.859,"5min":19.280000000000001,"15min":19.280000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":4.5190000000000001,"5min":2.8199999999999998,"15min":1.7809999999999999},"min":{"1min":0.51300000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":11.779,"5min":15.593999999999999,"15min":15.593999999999999},"last":0.86099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.58499999999999996,"15min":0.68000000000000005},"min":{"1min":0.374,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.198,"15min":4.1059999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59399999999999997,"15min":0.67600000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.80800000000000005,"5min":1.4139999999999999,"15min":3.968},"last":0.78100000000000003}]},{"osd":9,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":5.9560000000000004,"5min":5.1479999999999997,"15min":2.9540000000000002},"min":{"1min":0.60999999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":28.902999999999999,"5min":71.158000000000001,"15min":71.158000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":4.7270000000000003,"5min":3.444,"15min":2.262},"min":{"1min":0.63700000000000001,"5min":0.53400000000000003,"15min":0.49199999999999999},"max":{"1min":27.178999999999998,"5min":27.178999999999998,"15min":27.178999999999998},"last":0.93700000000000006}]},{"osd":10,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61799999999999999,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.90100000000000002,"5min":1.1319999999999999,"15min":1.855},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63800000000000001,"15min":0.69299999999999995},"min":{"1min":0.44400000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.81100000000000005,"5min":1.2030000000000001,"15min":1.746},"last":0.96699999999999997}]},{"osd":11,"last update":"Wed Feb 21 07:57:48 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.67800000000000005},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38600000000000001},"max":{"1min":0.88300000000000001,"5min":1.887,"15min":4.3360000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.65700000000000003},"min":{"1min":0.45700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.77000000000000002,"5min":1.619,"15min":4.0720000000000001},"last":0.68300000000000005}]}]},{"osd":7,"up_from":17,"seq":73014444192,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":280012,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091828,"statfs":{"total":96636764160,"available":96350031872,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":286325194},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":4.1180000000000003,"5min":3.0129999999999999,"15min":1.7789999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":21.872,"5min":43.918999999999997,"15min":43.918999999999997},"last":1.0669999999999999},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.052,"15min":1.831},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.32900000000000001},"max":{"1min":21.887,"5min":43.935000000000002,"15min":43.935000000000002},"last":1.0509999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.224,"15min":0.20599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.318},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":1.1299999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":2.3140000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.41299999999999998,"15min":0.48499999999999999},"min":{"1min":0.312,"5min":0.252,"15min":0.252},"max":{"1min":0.85799999999999998,"5min":1.196,"15min":1.77},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.958,"15min":1.425},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":8.1379999999999999,"5min":15.101000000000001,"15min":15.101000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":3.3479999999999999,"5min":3.1989999999999998,"15min":2.1680000000000001},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.28699999999999998},"max":{"1min":22.602,"5min":32.689999999999998,"15min":41.405000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38500000000000001,"15min":0.41099999999999998},"min":{"1min":0.307,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.8740000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.436}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47599999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.60699999999999998,"5min":0.98099999999999998,"15min":13.967000000000001},"last":0.624},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.61099999999999999},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.88900000000000001,"15min":13.952999999999999},"last":0.53300000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1989999999999998,"5min":2.504,"15min":1.8759999999999999},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":7.7069999999999999,"5min":23.959,"15min":23.959},"last":0.67600000000000005},{"interface":"front","average":{"1min":6.1200000000000001,"5min":3.806,"15min":2.3370000000000002},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":82.087000000000003,"5min":82.087000000000003,"15min":82.087000000000003},"last":0.66300000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.1579999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.4930000000000001},"last":0.51500000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":3.524,"5min":2.577,"15min":1.95},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":13.708,"5min":16.113,"15min":27.177},"last":0.55000000000000004},{"interface":"front","average":{"1min":3.3530000000000002,"5min":3.25,"15min":2.327},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":33.146000000000001,"5min":33.146000000000001,"15min":34.470999999999997},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":2.5019999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":1.798,"5min":1.798,"15min":2.4580000000000002},"last":0.57699999999999996}]}]},{"osd":6,"up_from":17,"seq":73014444193,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":327680,"data_stored":154436,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.742,"5min":5.5010000000000003,"15min":3.7109999999999999},"min":{"1min":0.46300000000000002,"5min":0.34499999999999997,"15min":0.313},"max":{"1min":17.585000000000001,"5min":91.042000000000002,"15min":91.042000000000002},"last":1.298},{"interface":"front","average":{"1min":3.137,"5min":6.2519999999999998,"15min":4.9219999999999997},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.39800000000000002},"max":{"1min":13.849,"5min":88.256,"15min":115.06999999999999},"last":0.81100000000000005}]},{"osd":1,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":2.778,"15min":2.1619999999999999},"min":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.32500000000000001},"max":{"1min":4.5449999999999999,"5min":21.131,"15min":30.702999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":2.3439999999999999,"5min":4.8090000000000002,"15min":3.8969999999999998},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.3860000000000001,"5min":86.691999999999993,"15min":114.93899999999999},"last":1.0609999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":1.9319999999999999,"5min":2.9020000000000001,"15min":2.3180000000000001},"min":{"1min":0.46100000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":5.282,"5min":21.013999999999999,"15min":30.670999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":2.9510000000000001,"5min":4.569,"15min":3.0659999999999998},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":17.640999999999998,"5min":62.164999999999999,"15min":68.652000000000001},"last":1.0429999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.3999999999999999,"5min":8.875,"15min":6.0069999999999997},"min":{"1min":0.496,"5min":0.45700000000000002,"15min":0.36599999999999999},"max":{"1min":11.361000000000001,"5min":219.733,"15min":219.733},"last":1.2789999999999999},{"interface":"front","average":{"1min":3.2280000000000002,"5min":4.7880000000000003,"15min":4.1319999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.4329999999999998,"5min":45.109999999999999,"15min":82.281000000000006},"last":1.397}]},{"osd":4,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":3.1400000000000001,"15min":2.548},"min":{"1min":0.61799999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.6210000000000004,"5min":21.064,"15min":30.870000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":2.8809999999999998,"5min":4.2519999999999998,"15min":3.149},"min":{"1min":0.48999999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":17.747,"5min":40.045000000000002,"15min":68.744},"last":0.98399999999999999}]},{"osd":5,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2320000000000002,"5min":4.9969999999999999,"15min":3.3300000000000001},"min":{"1min":0.81000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":17.678000000000001,"5min":90.986999999999995,"15min":90.986999999999995},"last":0.88200000000000001},{"interface":"front","average":{"1min":2.7949999999999999,"5min":5.0979999999999999,"15min":4.2149999999999999},"min":{"1min":0.91700000000000004,"5min":0.48499999999999999,"15min":0.35999999999999999},"max":{"1min":5.5149999999999997,"5min":88.194000000000003,"15min":115.137},"last":0.94899999999999995}]},{"osd":7,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4460000000000002,"5min":3.2930000000000001,"15min":2.6640000000000001},"min":{"1min":0.65600000000000003,"5min":0.45800000000000002,"15min":0.438},"max":{"1min":9.5619999999999994,"5min":21.350000000000001,"15min":30.838999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":2.964,"5min":4.508,"15min":3.2879999999999998},"min":{"1min":0.53700000000000003,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":17.712,"5min":39.990000000000002,"15min":68.778000000000006},"last":1.137}]},{"osd":8,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.8039999999999998,"5min":5.2249999999999996,"15min":4.3390000000000004},"min":{"1min":0.83699999999999997,"5min":0.52400000000000002,"15min":0.42999999999999999},"max":{"1min":5.46,"5min":88.147000000000006,"15min":115.03400000000001},"last":1.018},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.7650000000000001,"15min":2.9079999999999999},"min":{"1min":0.60599999999999998,"5min":0.52100000000000002,"15min":0.502},"max":{"1min":36.106000000000002,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.2609999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":7.8390000000000004,"5min":8.7539999999999996,"15min":5.71},"min":{"1min":0.79100000000000004,"5min":0.74399999999999999,"15min":0.58499999999999996},"max":{"1min":30.074000000000002,"5min":91.082999999999998,"15min":91.082999999999998},"last":1.339},{"interface":"front","average":{"1min":3.1200000000000001,"5min":7.5270000000000001,"15min":5.5899999999999999},"min":{"1min":0.86599999999999999,"5min":0.55800000000000005,"15min":0.51700000000000002},"max":{"1min":10.238,"5min":130.30099999999999,"15min":130.30099999999999},"last":1.236}]},{"osd":10,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":3.3820000000000001,"15min":2.7930000000000001},"min":{"1min":0.752,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.7010000000000005,"5min":21.236999999999998,"15min":30.774000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":3.028,"5min":4.8090000000000002,"15min":3.621},"min":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":17.795999999999999,"5min":62.255000000000003,"15min":68.891000000000005},"last":1.218}]},{"osd":11,"last update":"Wed Feb 21 07:57:46 2024","interfaces":[{"interface":"back","average":{"1min":3.2989999999999999,"5min":5.7510000000000003,"15min":4.6230000000000002},"min":{"1min":1.002,"5min":0.60699999999999998,"15min":0.54000000000000004},"max":{"1min":9.4730000000000008,"5min":88.225999999999999,"15min":114.999},"last":1.1599999999999999},{"interface":"front","average":{"1min":2.4870000000000001,"5min":3.597,"15min":2.9289999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":9.6639999999999997,"5min":21.199999999999999,"15min":30.808},"last":1.3640000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444192,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357684,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":94014156,"statfs":{"total":96636764160,"available":96270495744,"internally_reserved":0,"allocated":1748992,"data_stored":3814258,"data_compressed":431039,"data_compressed_allocated":585728,"data_compressed_original":2867200,"omap_allocated":1595,"internal_metadata":364509637},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.0390000000000001,"15min":1.3999999999999999},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.26300000000000001},"max":{"1min":16.375,"5min":16.375,"15min":21.427},"last":0.41799999999999998},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.5379999999999998,"15min":1.6319999999999999},"min":{"1min":0.377,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":15.911,"5min":23.23,"15min":23.23},"last":0.75800000000000001}]},{"osd":1,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.47299999999999998,"15min":0.54500000000000004},"min":{"1min":0.27000000000000002,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":0.50700000000000001,"5min":2.4430000000000001,"15min":14.186},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.46000000000000002,"15min":0.54500000000000004},"min":{"1min":0.26400000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.81499999999999995,"5min":1.835,"15min":14.391999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35799999999999998,"15min":0.379},"min":{"1min":0.246,"5min":0.188,"15min":0.188},"max":{"1min":0.45600000000000002,"5min":1.7629999999999999,"15min":2.5619999999999998},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.375,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.437,"5min":1.643,"15min":2.8940000000000001},"last":0.36699999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":4.46,"5min":2.6970000000000001,"15min":1.631},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":35.134,"5min":35.134,"15min":35.134},"last":0.59799999999999998},{"interface":"front","average":{"1min":2.1469999999999998,"5min":2.9460000000000002,"15min":1.786},"min":{"1min":0.47599999999999998,"5min":0.375,"15min":0.33500000000000002},"max":{"1min":10.67,"5min":48.656999999999996,"15min":48.656999999999996},"last":0.79700000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56999999999999995,"15min":0.64700000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27200000000000002},"max":{"1min":1.8029999999999999,"5min":1.905,"15min":14.831},"last":0.63},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.62,"15min":0.67700000000000005},"min":{"1min":0.34000000000000002,"5min":0.27300000000000002,"15min":0.25700000000000001},"max":{"1min":1.835,"5min":1.9670000000000001,"15min":14.846},"last":0.72799999999999998}]},{"osd":6,"last update":"Wed Feb 21 07:57:35 2024","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.8260000000000001,"15min":2.0169999999999999},"min":{"1min":0.44700000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":6.5869999999999997,"5min":30.489000000000001,"15min":46.009999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":5.835,"5min":3.6000000000000001,"15min":2.738},"min":{"1min":0.41799999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":31.315000000000001,"5min":36.401000000000003,"15min":67.126999999999995},"last":0.77400000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.27200000000000002},"max":{"1min":1.228,"5min":1.7769999999999999,"15min":14.211},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.621},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.309},"max":{"1min":1.2529999999999999,"5min":1.3959999999999999,"15min":14.241},"last":0.50700000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.34999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.88900000000000001,"5min":1.738,"15min":1.738},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.33200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.627,"5min":1.351,"15min":2.5870000000000002},"last":0.39400000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":3.6429999999999998,"5min":2.6379999999999999,"15min":1.901},"min":{"1min":0.46100000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":32.753999999999998,"5min":32.753999999999998,"15min":32.753999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":3.9740000000000002,"5min":2.8730000000000002,"15min":2.0049999999999999},"min":{"1min":0.54900000000000004,"5min":0.496,"15min":0.42199999999999999},"max":{"1min":13.407,"5min":36.168999999999997,"15min":36.168999999999997},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:57:34 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.59599999999999997,"15min":0.63200000000000001},"min":{"1min":0.432,"5min":0.40799999999999997,"15min":0.38700000000000001},"max":{"1min":0.65900000000000003,"5min":1.4430000000000001,"15min":1.476},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":2.036,"15min":2.298},"last":0.66500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274380,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94097460,"statfs":{"total":96636764160,"available":96355799040,"internally_reserved":0,"allocated":331776,"data_stored":157118,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.313,"15min":0.33800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":0.372,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.33400000000000002,"15min":0.35199999999999998},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.39300000000000002,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.36899999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.0299999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80800000000000005,"5min":1.325,"15min":1.325},"last":0.55200000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":3.101,"15min":1.9830000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":6.1020000000000003,"5min":31.25,"15min":31.25},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.133,"5min":2.1749999999999998,"15min":1.607},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":5.4619999999999997,"5min":23.829000000000001,"15min":23.829000000000001},"last":0.64700000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42499999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":0.48399999999999999,"5min":1.177,"15min":1.371},"last":0.495},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26000000000000001},"max":{"1min":1.2090000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.56999999999999995}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":3.4660000000000002,"15min":2.738},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.0510000000000002,"5min":103.301,"15min":103.301},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.5049999999999999,"5min":2.4889999999999999,"15min":1.651},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":7.774,"5min":19.571000000000002,"15min":19.866},"last":0.71899999999999997}]},{"osd":7,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45700000000000002,"15min":0.47999999999999998},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":0.61799999999999999,"5min":1.0720000000000001,"15min":1.3819999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.502,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.45500000000000002}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":1.153,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.749},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":1.774,"15min":2.3029999999999999},"last":0.68100000000000005}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.6389999999999998,"15min":2.0550000000000002},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":7.9050000000000002,"5min":23.103000000000002,"15min":31.655999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.482,"5min":3.7919999999999998,"15min":2.1720000000000002},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":7.0039999999999996,"5min":65.191999999999993,"15min":65.191999999999993},"last":0.76100000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.627},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51300000000000001,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.628,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.66100000000000003}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61399999999999999,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.7450000000000001,"15min":2.3250000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.69399999999999995}]}]},{"osd":3,"up_from":17,"seq":73014444192,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279944,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091896,"statfs":{"total":96636764160,"available":96350101504,"internally_reserved":0,"allocated":327680,"data_stored":154308,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4009999999999998,"5min":5.548,"15min":3.5800000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":20.800000000000001,"5min":46.143000000000001,"15min":46.143000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":5.774,"5min":6.4850000000000003,"15min":4.1550000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":36.734999999999999,"5min":79.581000000000003,"15min":79.581000000000003},"last":0.39400000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.8959999999999999,"5min":5.3330000000000002,"15min":3.5960000000000001},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":36.805999999999997,"5min":79.177000000000007,"15min":79.177000000000007},"last":0.82199999999999995},{"interface":"front","average":{"1min":3.2669999999999999,"5min":3.5049999999999999,"15min":2.4329999999999998},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.27600000000000002},"max":{"1min":12.286,"5min":23.809999999999999,"15min":23.809999999999999},"last":0.89100000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":3.8820000000000001,"15min":2.7919999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":20.562000000000001,"5min":46.396999999999998,"15min":46.396999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":3.302,"5min":3.5,"15min":2.5649999999999999},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.37},"max":{"1min":12.374000000000001,"5min":23.866,"15min":23.866},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1340000000000003,"5min":5.4550000000000001,"15min":3.742},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":36.771000000000001,"5min":79.043999999999997,"15min":79.043999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":4.1699999999999999,"5min":4.3879999999999999,"15min":2.9750000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":20.638000000000002,"5min":46.530999999999999,"15min":46.530999999999999},"last":0.745}]},{"osd":5,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1269999999999998,"5min":5.3710000000000004,"15min":3.7719999999999998},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":36.646000000000001,"5min":79.094999999999999,"15min":79.094999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":4.2069999999999999,"5min":4.0679999999999996,"15min":2.9399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":20.765000000000001,"5min":46.567999999999998,"15min":46.567999999999998},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.629,"15min":2.6560000000000001},"min":{"1min":0.84599999999999997,"5min":0.55300000000000005,"15min":0.39500000000000002},"max":{"1min":13.209,"5min":23.776,"15min":23.776},"last":0.83099999999999996},{"interface":"front","average":{"1min":4.2469999999999999,"5min":5.6219999999999999,"15min":3.9750000000000001},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":36.840000000000003,"5min":79.140000000000001,"15min":79.140000000000001},"last":0.72599999999999998}]},{"osd":8,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.2770000000000001,"5min":4.1989999999999998,"15min":3.145},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":20.687999999999999,"5min":51.311,"15min":51.311},"last":0.54900000000000004},{"interface":"front","average":{"1min":3.4569999999999999,"5min":3.6499999999999999,"15min":2.79},"min":{"1min":0.73999999999999999,"5min":0.65000000000000002,"15min":0.436},"max":{"1min":13.279999999999999,"5min":23.745000000000001,"15min":23.745000000000001},"last":0.77100000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":6.2000000000000002,"5min":5.298,"15min":3.8900000000000001},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.41399999999999998},"max":{"1min":31.452000000000002,"5min":31.452000000000002,"15min":31.978999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":4.984,"5min":7.7460000000000004,"15min":5.452},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46300000000000002},"max":{"1min":37.411000000000001,"5min":79.388999999999996,"15min":79.388999999999996},"last":0.76200000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.9279999999999999,"15min":3.0510000000000002},"min":{"1min":0.91000000000000003,"5min":0.73199999999999998,"15min":0.46000000000000002},"max":{"1min":13.244999999999999,"5min":23.838999999999999,"15min":31.469999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":4.7699999999999996,"5min":5.8140000000000001,"15min":4.1769999999999996},"min":{"1min":0.60499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.698,"5min":79.213999999999999,"15min":79.213999999999999},"last":0.85199999999999998}]},{"osd":11,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4059999999999997,"5min":4.46,"15min":3.1960000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":20.728000000000002,"5min":51.438000000000002,"15min":51.438000000000002},"last":0.628},{"interface":"front","average":{"1min":3.456,"5min":3.855,"15min":3.0640000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.498},"max":{"1min":12.414,"5min":23.896999999999998,"15min":31.771999999999998},"last":1.034}]}]},{"osd":2,"up_from":17,"seq":73014444193,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231268,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94140572,"statfs":{"total":96636764160,"available":96399945728,"internally_reserved":0,"allocated":1667072,"data_stored":3219572,"data_compressed":397517,"data_compressed_allocated":540672,"data_compressed_original":2293760,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":2.3519999999999999,"15min":2.1890000000000001},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":24.849,"5min":29.721,"15min":115.97},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":2.4060000000000001,"15min":1.73},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9459999999999997,"5min":30.361999999999998,"15min":36.359999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41099999999999998,"15min":0.51800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57199999999999995,"5min":1.044,"15min":2.734},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42899999999999999,"15min":0.502},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":1.256,"15min":2.4340000000000002},"last":0.80600000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":2.6949999999999998,"15min":1.8560000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":3.8730000000000002,"5min":27.800000000000001,"15min":27.800000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":2.7149999999999999,"15min":1.861},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.891,"5min":29.364999999999998,"15min":29.364999999999998},"last":0.79200000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47699999999999998,"15min":0.58299999999999996},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.089,"5min":1.3109999999999999,"15min":2.4729999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.23599999999999999},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.5419999999999998},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41199999999999998,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.534,"15min":2.903},"last":0.372},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.219},"max":{"1min":1.1120000000000001,"5min":1.6479999999999999,"15min":2.1869999999999998},"last":0.41199999999999998}]},{"osd":6,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.9350000000000001,"15min":1.5680000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.6799999999999997,"5min":16.079000000000001,"15min":16.079000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.786,"5min":1.921,"15min":1.5880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.432},"max":{"1min":10.737,"5min":16.065000000000001,"15min":16.065000000000001},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.119,"15min":2.5470000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.755,"5min":1.6639999999999999,"15min":2.6259999999999999},"last":0.56899999999999995}]},{"osd":8,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":1.3280000000000001,"5min":1.889,"15min":1.972},"last":0.443},{"interface":"front","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":1.2390000000000001,"15min":1.8720000000000001},"last":0.54900000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.8450000000000002,"5min":5.1509999999999998,"15min":3.113},"min":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.40500000000000003},"max":{"1min":8.5630000000000006,"5min":118.07299999999999,"15min":118.07299999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":1.524,"5min":2.464,"15min":1.8600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.0650000000000004,"5min":18.303000000000001,"15min":25.349},"last":0.753}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65800000000000003,"15min":0.72999999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.595,"15min":2.6739999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.68500000000000005},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":1.369,"15min":2.5110000000000001},"last":0.77700000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0489999999999999,"5min":1.837,"15min":2.9380000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":1.5009999999999999,"15min":2.9100000000000001},"last":0.72099999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444193,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225796,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94146044,"statfs":{"total":96636764160,"available":96405549056,"internally_reserved":0,"allocated":323584,"data_stored":152854,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":230881735},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.671,"15min":1.54},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":4.1130000000000004,"5min":21.425000000000001,"15min":26.550000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":2.1509999999999998,"15min":1.5820000000000001},"min":{"1min":0.35899999999999999,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":6.2539999999999996,"5min":26.841999999999999,"15min":31.741},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.40999999999999998,"15min":0.625},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":1.155,"5min":2.1970000000000001,"15min":58.337000000000003},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.65300000000000002},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":1.046,"5min":2.3119999999999998,"15min":60.276000000000003},"last":0.45700000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":2.105,"5min":2.1629999999999998,"15min":1.6240000000000001},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":7.1200000000000001,"5min":16.724,"15min":30.460000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.6299999999999999,"5min":2.347,"15min":1.6659999999999999},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":8.2010000000000005,"5min":19.312999999999999,"15min":20.971},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.378},"min":{"1min":0.254,"5min":0.214,"15min":0.214},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.436},"min":{"1min":0.25,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.0049999999999999,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.38}]},{"osd":5,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.68100000000000005},"min":{"1min":0.32800000000000001,"5min":0.248,"15min":0.248},"max":{"1min":1.0229999999999999,"5min":1.8660000000000001,"15min":58.32},"last":0.435},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.51900000000000002,"15min":0.71199999999999997},"min":{"1min":0.33300000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.236,"5min":2.3740000000000001,"15min":60.185000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":1.885,"5min":4.3849999999999998,"15min":3.1389999999999998},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.33300000000000002},"max":{"1min":8.3200000000000003,"5min":98.299999999999997,"15min":98.299999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":2.7290000000000001,"5min":2.7010000000000001,"15min":1.879},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":12.612,"5min":24.501999999999999,"15min":24.501999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45700000000000002,"15min":0.47199999999999998},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.02,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.49399999999999999,"15min":0.52100000000000002},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.79200000000000004,"5min":2.161,"15min":2.161},"last":0.47499999999999998}]},{"osd":8,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3740000000000001,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.55600000000000005,"15min":0.60699999999999998},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.33700000000000002},"max":{"1min":1.073,"5min":1.286,"15min":3.637},"last":0.51800000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:53 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":4.5640000000000001,"15min":2.9159999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.433},"max":{"1min":6.5940000000000003,"5min":91.182000000000002,"15min":91.182000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":2.423,"5min":3.081,"15min":2.1869999999999998},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.45500000000000002},"max":{"1min":14.013999999999999,"5min":32.460999999999999,"15min":32.460999999999999},"last":0.83499999999999996}]},{"osd":10,"last update":"Wed Feb 21 07:57:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52400000000000002,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":1.242,"15min":1.242},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74199999999999999,"5min":0.92100000000000004,"15min":1.0780000000000001},"last":0.58199999999999996}]}]},{"osd":0,"up_from":17,"seq":73014444193,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266064,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":94105776,"statfs":{"total":96636764160,"available":96364314624,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":3.3580000000000001,"15min":2.238},"min":{"1min":0.36499999999999999,"5min":0.317,"15min":0.249},"max":{"1min":6.6929999999999996,"5min":54.454999999999998,"15min":54.454999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.355,"5min":3.1000000000000001,"15min":2.4830000000000001},"min":{"1min":0.35999999999999999,"5min":0.34899999999999998,"15min":0.27400000000000002},"max":{"1min":15.474,"5min":27.855,"15min":67.233999999999995},"last":0.77700000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":4.016,"5min":3.4220000000000002,"15min":2.2530000000000001},"min":{"1min":0.34899999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":34.563000000000002,"5min":34.563000000000002,"15min":34.563000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":3.532,"5min":3.7469999999999999,"15min":2.4390000000000001},"min":{"1min":0.42299999999999999,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":32.026000000000003,"5min":54.421999999999997,"15min":54.421999999999997},"last":0.72899999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.786,"5min":5.3559999999999999,"15min":3.7480000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":16.306000000000001,"5min":79.024000000000001,"15min":79.024000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":5.343,"5min":5.181,"15min":3.3759999999999999},"min":{"1min":0.71499999999999997,"5min":0.313,"15min":0.313},"max":{"1min":45.561999999999998,"5min":79.706999999999994,"15min":79.706999999999994},"last":1.0309999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.1200000000000001,"5min":3.5680000000000001,"15min":2.4420000000000002},"min":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.39000000000000001},"max":{"1min":10.544,"5min":54.353000000000002,"15min":54.353000000000002},"last":0.94299999999999995},{"interface":"front","average":{"1min":2.569,"5min":3.1429999999999998,"15min":2.7090000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":15.821999999999999,"5min":27.782,"15min":67.313000000000002},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":5.2709999999999999,"15min":3.9119999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":15.978,"5min":79.078000000000003,"15min":79.078000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.4340000000000002,"5min":7.2489999999999997,"15min":4.5309999999999997},"min":{"1min":0.66400000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":17.498000000000001,"5min":86.691999999999993,"15min":86.691999999999993},"last":1.123}]},{"osd":7,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.5830000000000002,"5min":3.3980000000000001,"15min":2.6030000000000002},"min":{"1min":0.51300000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":8.2089999999999996,"5min":32.107999999999997,"15min":32.107999999999997},"last":1.379},{"interface":"front","average":{"1min":2.169,"5min":3.7080000000000002,"15min":2.625},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":10.457000000000001,"5min":54.386000000000003,"15min":54.386000000000003},"last":1.2889999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.681,"5min":3.7229999999999999,"15min":3.1080000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.439},"max":{"1min":16.138999999999999,"5min":27.902999999999999,"15min":67.387},"last":0.70899999999999996},{"interface":"front","average":{"1min":2.661,"5min":3.609,"15min":2.7909999999999999},"min":{"1min":0.56799999999999995,"5min":0.48399999999999999,"15min":0.437},"max":{"1min":8.2479999999999993,"5min":31.966999999999999,"15min":31.966999999999999},"last":1.5389999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":3.2109999999999999,"5min":6.0140000000000002,"15min":4.4189999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.45200000000000001},"max":{"1min":10.692,"5min":40.402000000000001,"15min":152.25700000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":4.9989999999999997,"5min":6.6079999999999997,"15min":4.4859999999999998},"min":{"1min":0.70599999999999996,"5min":0.56000000000000005,"15min":0.54000000000000004},"max":{"1min":19.376999999999999,"5min":111.746,"15min":111.746},"last":1.2130000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:57:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5099999999999998,"5min":4.0259999999999998,"15min":2.8439999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.503},"max":{"1min":10.574,"5min":54.490000000000002,"15min":54.490000000000002},"last":1.4199999999999999},{"interface":"front","average":{"1min":3.577,"5min":3.8639999999999999,"15min":3.2440000000000002},"min":{"1min":0.78700000000000003,"5min":0.60099999999999998,"15min":0.54000000000000004},"max":{"1min":16.544,"5min":27.821000000000002,"15min":67.423000000000002},"last":0.82999999999999996}]},{"osd":11,"last update":"Wed Feb 21 07:57:38 2024","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":4.4470000000000001,"15min":3.0499999999999998},"min":{"1min":0.85999999999999999,"5min":0.71999999999999997,"15min":0.58699999999999997},"max":{"1min":10.599,"5min":54.298000000000002,"15min":54.298000000000002},"last":1.5840000000000001},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0149999999999997,"15min":3.3460000000000001},"min":{"1min":0.82599999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"max":{"1min":16.344999999999999,"5min":28.864999999999998,"15min":67.454999999999998},"last":1.1499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1351680,"data_stored":3067390,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1363968,"data_stored":3067612,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:58:33.092 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.093 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.094 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.095 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.096 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-21T07:45:19.971841+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=19, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.097 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.098 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.099 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.100 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.101 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-02-21T07:45:24.196531+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=24, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-21T07:45:29.283349+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=29, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.102 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.103 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.104 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-21T07:45:25.207955+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=45, tm_sec=25, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=7, tm_min=58, tm_sec=23, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T07:58:33.105 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-21T07:58:49.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:49.183 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:49.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:58:53.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:58:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.324+0000 7f5a45400640 1 Processor -- start 2024-02-21T07:58:53.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.325+0000 7f5a45400640 1 -- start start 2024-02-21T07:58:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.326+0000 7f5a45400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a401894d0 0x7f5a4006c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a45400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5a4006c8d0 0x7f5a4018a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a45400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4006d200 con 0x7f5a401861d0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a45400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4006daa0 con 0x7f5a401894d0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a45400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a401865b0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5a401861d0 0x7f5a40188dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39520/0 (socket says 172.21.15.100:39520) 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3e800640 1 -- 172.21.15.100:0/1120605164 learned_addr learned my addr 172.21.15.100:0/1120605164 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3de00640 1 --2- 172.21.15.100:0/1120605164 >> v2:172.21.15.100:3300/0 conn(0x7f5a401894d0 0x7f5a4006c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3f200640 1 --2- 172.21.15.100:0/1120605164 >> v2:172.21.15.170:3300/0 conn(0x7f5a4006c8d0 0x7f5a4018a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3d400640 1 -- 172.21.15.100:0/1120605164 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836666565 0 0) 0x7f5a4006d200 con 0x7f5a401861d0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3d400640 1 -- 172.21.15.100:0/1120605164 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a24003520 con 0x7f5a401861d0 2024-02-21T07:58:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3de00640 1 -- 172.21.15.100:0/1120605164 >> v2:172.21.15.170:3300/0 conn(0x7f5a4006c8d0 msgr2=0x7f5a4018a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3de00640 1 --2- 172.21.15.100:0/1120605164 >> v2:172.21.15.170:3300/0 conn(0x7f5a4006c8d0 0x7f5a4018a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.327+0000 7f5a3de00640 1 -- 172.21.15.100:0/1120605164 >> v1:172.21.15.100:6789/0 conn(0x7f5a401861d0 legacy=0x7f5a40188dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.328+0000 7f5a3de00640 1 -- 172.21.15.100:0/1120605164 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4006d4e0 con 0x7f5a401894d0 2024-02-21T07:58:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.329+0000 7f5a3de00640 1 --2- 172.21.15.100:0/1120605164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401894d0 0x7f5a4006c390 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5a4006c320 tx=0x7f5a2802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bda7de17b9377f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.329+0000 7f5a3d400640 1 -- 172.21.15.100:0/1120605164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28031520 con 0x7f5a401894d0 2024-02-21T07:58:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.329+0000 7f5a3d400640 1 -- 172.21.15.100:0/1120605164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28031680 con 0x7f5a401894d0 2024-02-21T07:58:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.329+0000 7f5a3d400640 1 -- 172.21.15.100:0/1120605164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28031a10 con 0x7f5a401894d0 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.329+0000 7f5a45400640 1 -- 172.21.15.100:0/1120605164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401894d0 msgr2=0x7f5a4006c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 --2- 172.21.15.100:0/1120605164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401894d0 0x7f5a4006c390 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5a4006c320 tx=0x7f5a2802b7c0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 -- 172.21.15.100:0/1120605164 shutdown_connections 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 --2- 172.21.15.100:0/1120605164 >> v2:172.21.15.170:3300/0 conn(0x7f5a4006c8d0 0x7f5a4018a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 --2- 172.21.15.100:0/1120605164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401894d0 0x7f5a4006c390 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 -- 172.21.15.100:0/1120605164 >> 172.21.15.100:0/1120605164 conn(0x7f5a4006e380 msgr2=0x7f5a4006e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 -- 172.21.15.100:0/1120605164 shutdown_connections 2024-02-21T07:58:53.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.330+0000 7f5a45400640 1 -- 172.21.15.100:0/1120605164 wait complete. 2024-02-21T07:58:53.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.332+0000 7f5a45400640 1 Processor -- start 2024-02-21T07:58:53.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.332+0000 7f5a45400640 1 -- start start 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 0x7f5a4017e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 0x7f5a4017ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4017fc80 con 0x7f5a401861d0 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4017f6c0 con 0x7f5a401894d0 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a45400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4017f9a0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 0x7f5a4017e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:33340/0 (socket says 172.21.15.100:33340) 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 0x7f5a4017e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52672/0 (socket says 172.21.15.100:52672) 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3e800640 1 -- 172.21.15.100:0/2619095634 learned_addr learned my addr 172.21.15.100:0/2619095634 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.333+0000 7f5a3f200640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 0x7f5a4017ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 -- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 msgr2=0x7f5a4017ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 0x7f5a4017ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 -- 172.21.15.100:0/2619095634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 msgr2=0x7f5a4017e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 0x7f5a4017e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 -- 172.21.15.100:0/2619095634 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009400 con 0x7f5a4006c8d0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3f200640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 0x7f5a4017ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a3e800640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c430 tx=0x7f5a3000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30005ce0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30005e40 con 0x7f5a4006c8d0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300072f0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a401771b0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.334+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a40177770 con 0x7f5a4006c8d0 2024-02-21T07:58:53.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.336+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a400676c0 con 0x7f5a4006c8d0 2024-02-21T07:58:53.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.338+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5a30007450 con 0x7f5a4006c8d0 2024-02-21T07:58:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.339+0000 7f5a36a00640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 0x7f5a1c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.339+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5a300c9160 con 0x7f5a4006c8d0 2024-02-21T07:58:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.339+0000 7f5a3de00640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 0x7f5a1c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.340+0000 7f5a3de00640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 0x7f5a1c0a1560 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a28035000 tx=0x7f5a28030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.344+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mon.2 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a30096a70 con 0x7f5a4006c8d0 2024-02-21T07:58:53.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.534+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 --> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a40189f20 con 0x7f5a1c09f0a0 2024-02-21T07:58:53.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.548+0000 7f5a36a00640 1 -- 172.21.15.100:0/2619095634 <== mgr.4111 v2:172.21.15.156:6800/1289369955 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+421204 (secure 0 0 0) 0x7f5a28041070 con 0x7f5a1c09f0a0 2024-02-21T07:58:53.557 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:53.559 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-02-21T07:58:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 msgr2=0x7f5a1c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 0x7f5a1c0a1560 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5a28035000 tx=0x7f5a28030000 comp rx=0 tx=0).stop 2024-02-21T07:58:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 msgr2=0x7f5a4016da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c430 tx=0x7f5a3000c8f0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 shutdown_connections 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5a401894d0 0x7f5a4017ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5a1c09f0a0 0x7f5a1c0a1560 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a401861d0 0x7f5a4017e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 --2- 172.21.15.100:0/2619095634 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5a4006c8d0 0x7f5a4016da00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 >> 172.21.15.100:0/2619095634 conn(0x7f5a4006e380 msgr2=0x7f5a4018b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 shutdown_connections 2024-02-21T07:58:53.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.556+0000 7f5a45400640 1 -- 172.21.15.100:0/2619095634 wait complete. 2024-02-21T07:58:53.577 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-02-21T07:58:52.104725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3663200,"num_objects":78,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":6004,"num_read_kb":10237,"num_write":755950,"num_write_kb":194947105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30270,"num_omap_keys":57,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73462,"ondisk_log_size":73462,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":3121864,"kb_used_data":6632,"kb_used_omap":18,"kb_used_meta":3115117,"kb_avail":1129340216,"statfs":{"total":1159641169920,"available":1156444381184,"internally_reserved":0,"allocated":6791168,"data_stored":9184884,"data_compressed":1002998,"data_compressed_allocated":1376256,"data_compressed_original":6144000,"omap_allocated":19141,"internal_metadata":3189880123},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003682"},"pg_stats":[{"pgid":"2.1f","version":"30'114","reported_seq":212,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.865729+0000","last_change":"2024-02-21T07:58:28.865804+0000","last_active":"2024-02-21T07:58:28.865729+0000","last_peered":"2024-02-21T07:58:28.865729+0000","last_clean":"2024-02-21T07:58:28.865729+0000","last_became_active":"2024-02-21T07:45:25.242909+0000","last_became_peered":"2024-02-21T07:45:25.242909+0000","last_unstale":"2024-02-21T07:58:28.865729+0000","last_undegraded":"2024-02-21T07:58:28.865729+0000","last_fullsized":"2024-02-21T07:58:28.865729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'114","last_scrub_stamp":"2024-02-21T07:58:28.865626+0000","last_deep_scrub":"30'114","last_deep_scrub_stamp":"2024-02-21T07:58:28.865626+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.865626+0000","objects_scrubbed":5,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:46:18.140781+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":57,"num_write":210,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1508,"num_omap_keys":3,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"30'9","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.983994+0000","last_change":"2024-02-21T07:58:33.984055+0000","last_active":"2024-02-21T07:58:33.983994+0000","last_peered":"2024-02-21T07:58:33.983994+0000","last_clean":"2024-02-21T07:58:33.983994+0000","last_became_active":"2024-02-21T07:45:26.272687+0000","last_became_peered":"2024-02-21T07:45:26.272687+0000","last_unstale":"2024-02-21T07:58:33.983994+0000","last_undegraded":"2024-02-21T07:58:33.983994+0000","last_fullsized":"2024-02-21T07:58:33.983994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-02-21T07:58:33.983829+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-02-21T07:58:33.983829+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.983829+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:36:11.520562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"30'2349","reported_seq":2388,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.239337+0000","last_change":"2024-02-21T07:58:41.239367+0000","last_active":"2024-02-21T07:58:41.239337+0000","last_peered":"2024-02-21T07:58:41.239337+0000","last_clean":"2024-02-21T07:58:41.239337+0000","last_became_active":"2024-02-21T07:46:13.531807+0000","last_became_peered":"2024-02-21T07:46:13.531807+0000","last_unstale":"2024-02-21T07:58:41.239337+0000","last_undegraded":"2024-02-21T07:58:41.239337+0000","last_fullsized":"2024-02-21T07:58:41.239337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2349","last_scrub_stamp":"2024-02-21T07:58:41.239244+0000","last_deep_scrub":"30'2349","last_deep_scrub_stamp":"2024-02-21T07:58:41.239244+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.239244+0000","objects_scrubbed":0,"log_size":2349,"log_dups_size":0,"ondisk_log_size":2349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:38:41.378849+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25104,"num_write_kb":6480128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"30'3","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.158102+0000","last_change":"2024-02-21T07:58:26.158161+0000","last_active":"2024-02-21T07:58:26.158102+0000","last_peered":"2024-02-21T07:58:26.158102+0000","last_clean":"2024-02-21T07:58:26.158102+0000","last_became_active":"2024-02-21T07:45:25.239259+0000","last_became_peered":"2024-02-21T07:45:25.239259+0000","last_unstale":"2024-02-21T07:58:26.158102+0000","last_undegraded":"2024-02-21T07:58:26.158102+0000","last_fullsized":"2024-02-21T07:58:26.158102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:26.157938+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:26.157938+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.157938+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:50:03.661609+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.418282+0000","last_change":"2024-02-21T07:58:28.418320+0000","last_active":"2024-02-21T07:58:28.418282+0000","last_peered":"2024-02-21T07:58:28.418282+0000","last_clean":"2024-02-21T07:58:28.418282+0000","last_became_active":"2024-02-21T07:45:26.279558+0000","last_became_peered":"2024-02-21T07:45:26.279558+0000","last_unstale":"2024-02-21T07:58:28.418282+0000","last_undegraded":"2024-02-21T07:58:28.418282+0000","last_fullsized":"2024-02-21T07:58:28.418282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:28.418096+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:28.418096+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.418096+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:00.465147+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"30'2450","reported_seq":2482,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.814096+0000","last_change":"2024-02-21T07:58:35.814149+0000","last_active":"2024-02-21T07:58:35.814096+0000","last_peered":"2024-02-21T07:58:35.814096+0000","last_clean":"2024-02-21T07:58:35.814096+0000","last_became_active":"2024-02-21T07:45:30.316808+0000","last_became_peered":"2024-02-21T07:45:30.316808+0000","last_unstale":"2024-02-21T07:58:35.814096+0000","last_undegraded":"2024-02-21T07:58:35.814096+0000","last_fullsized":"2024-02-21T07:58:35.814096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2450","last_scrub_stamp":"2024-02-21T07:58:35.813965+0000","last_deep_scrub":"30'2450","last_deep_scrub_stamp":"2024-02-21T07:58:35.813965+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.813965+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:29.642353+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26394,"num_write_kb":6774912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"30'8","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.042453+0000","last_change":"2024-02-21T07:58:34.042481+0000","last_active":"2024-02-21T07:58:34.042453+0000","last_peered":"2024-02-21T07:58:34.042453+0000","last_clean":"2024-02-21T07:58:34.042453+0000","last_became_active":"2024-02-21T07:45:25.225618+0000","last_became_peered":"2024-02-21T07:45:25.225618+0000","last_unstale":"2024-02-21T07:58:34.042453+0000","last_undegraded":"2024-02-21T07:58:34.042453+0000","last_fullsized":"2024-02-21T07:58:34.042453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-02-21T07:58:34.042376+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-02-21T07:58:34.042376+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.042376+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:20.165151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.287478+0000","last_change":"2024-02-21T07:58:30.287504+0000","last_active":"2024-02-21T07:58:30.287478+0000","last_peered":"2024-02-21T07:58:30.287478+0000","last_clean":"2024-02-21T07:58:30.287478+0000","last_became_active":"2024-02-21T07:45:26.266061+0000","last_became_peered":"2024-02-21T07:45:26.266061+0000","last_unstale":"2024-02-21T07:58:30.287478+0000","last_undegraded":"2024-02-21T07:58:30.287478+0000","last_fullsized":"2024-02-21T07:58:30.287478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:30.287394+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:30.287394+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.287394+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:37:46.478911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1816","reported_seq":1866,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.853491+0000","last_change":"2024-02-21T07:58:36.853521+0000","last_active":"2024-02-21T07:58:36.853491+0000","last_peered":"2024-02-21T07:58:36.853491+0000","last_clean":"2024-02-21T07:58:36.853491+0000","last_became_active":"2024-02-21T07:45:30.316747+0000","last_became_peered":"2024-02-21T07:45:30.316747+0000","last_unstale":"2024-02-21T07:58:36.853491+0000","last_undegraded":"2024-02-21T07:58:36.853491+0000","last_fullsized":"2024-02-21T07:58:36.853491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1816","last_scrub_stamp":"2024-02-21T07:58:36.853393+0000","last_deep_scrub":"30'1816","last_deep_scrub_stamp":"2024-02-21T07:58:36.853393+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.853393+0000","objects_scrubbed":0,"log_size":1816,"log_dups_size":0,"ondisk_log_size":1816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:36:14.390127+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19208,"num_write_kb":5027530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'4","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.021259+0000","last_change":"2024-02-21T07:58:35.021285+0000","last_active":"2024-02-21T07:58:35.021259+0000","last_peered":"2024-02-21T07:58:35.021259+0000","last_clean":"2024-02-21T07:58:35.021259+0000","last_became_active":"2024-02-21T07:45:25.233327+0000","last_became_peered":"2024-02-21T07:45:25.233327+0000","last_unstale":"2024-02-21T07:58:35.021259+0000","last_undegraded":"2024-02-21T07:58:35.021259+0000","last_fullsized":"2024-02-21T07:58:35.021259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-21T07:58:35.021185+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-21T07:58:35.021185+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.021185+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:30:56.970522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"30'28","reported_seq":66,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.440727+0000","last_change":"2024-02-21T07:58:39.440753+0000","last_active":"2024-02-21T07:58:39.440727+0000","last_peered":"2024-02-21T07:58:39.440727+0000","last_clean":"2024-02-21T07:58:39.440727+0000","last_became_active":"2024-02-21T07:45:26.264186+0000","last_became_peered":"2024-02-21T07:45:26.264186+0000","last_unstale":"2024-02-21T07:58:39.440727+0000","last_undegraded":"2024-02-21T07:58:39.440727+0000","last_fullsized":"2024-02-21T07:58:39.440727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'28","last_scrub_stamp":"2024-02-21T07:58:39.440640+0000","last_deep_scrub":"30'28","last_deep_scrub_stamp":"2024-02-21T07:58:39.440640+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.440640+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:02:27.029480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1978","reported_seq":2010,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.821958+0000","last_change":"2024-02-21T07:58:33.821988+0000","last_active":"2024-02-21T07:58:33.821958+0000","last_peered":"2024-02-21T07:58:33.821958+0000","last_clean":"2024-02-21T07:58:33.821958+0000","last_became_active":"2024-02-21T07:45:30.311147+0000","last_became_peered":"2024-02-21T07:45:30.311147+0000","last_unstale":"2024-02-21T07:58:33.821958+0000","last_undegraded":"2024-02-21T07:58:33.821958+0000","last_fullsized":"2024-02-21T07:58:33.821958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1978","last_scrub_stamp":"2024-02-21T07:58:33.821859+0000","last_deep_scrub":"30'1978","last_deep_scrub_stamp":"2024-02-21T07:58:33.821859+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.821859+0000","objects_scrubbed":0,"log_size":1978,"log_dups_size":0,"ondisk_log_size":1978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:06:55.598292+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21148,"num_write_kb":5478976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"30'9","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.456809+0000","last_change":"2024-02-21T07:58:36.456849+0000","last_active":"2024-02-21T07:58:36.456809+0000","last_peered":"2024-02-21T07:58:36.456809+0000","last_clean":"2024-02-21T07:58:36.456809+0000","last_became_active":"2024-02-21T07:45:26.263986+0000","last_became_peered":"2024-02-21T07:45:26.263986+0000","last_unstale":"2024-02-21T07:58:36.456809+0000","last_undegraded":"2024-02-21T07:58:36.456809+0000","last_fullsized":"2024-02-21T07:58:36.456809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-02-21T07:58:36.456722+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-02-21T07:58:36.456722+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.456722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:30.285111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"30'56","reported_seq":97,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.046793+0000","last_change":"2024-02-21T07:58:32.046827+0000","last_active":"2024-02-21T07:58:32.046793+0000","last_peered":"2024-02-21T07:58:32.046793+0000","last_clean":"2024-02-21T07:58:32.046793+0000","last_became_active":"2024-02-21T07:45:25.225572+0000","last_became_peered":"2024-02-21T07:45:25.225572+0000","last_unstale":"2024-02-21T07:58:32.046793+0000","last_undegraded":"2024-02-21T07:58:32.046793+0000","last_fullsized":"2024-02-21T07:58:32.046793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'56","last_scrub_stamp":"2024-02-21T07:58:32.046711+0000","last_deep_scrub":"30'56","last_deep_scrub_stamp":"2024-02-21T07:58:32.046711+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.046711+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:44.395287+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":56,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":364,"num_omap_keys":1,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"30'2241","reported_seq":2273,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.853594+0000","last_change":"2024-02-21T07:58:38.853625+0000","last_active":"2024-02-21T07:58:38.853594+0000","last_peered":"2024-02-21T07:58:38.853594+0000","last_clean":"2024-02-21T07:58:38.853594+0000","last_became_active":"2024-02-21T07:45:30.575360+0000","last_became_peered":"2024-02-21T07:45:30.575360+0000","last_unstale":"2024-02-21T07:58:38.853594+0000","last_undegraded":"2024-02-21T07:58:38.853594+0000","last_fullsized":"2024-02-21T07:58:38.853594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2241","last_scrub_stamp":"2024-02-21T07:58:38.853488+0000","last_deep_scrub":"30'2241","last_deep_scrub_stamp":"2024-02-21T07:58:38.853488+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.853488+0000","objects_scrubbed":0,"log_size":2241,"log_dups_size":0,"ondisk_log_size":2241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:11:34.007565+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23912,"num_write_kb":6167616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.032833+0000","last_change":"2024-02-21T07:58:35.032901+0000","last_active":"2024-02-21T07:58:35.032833+0000","last_peered":"2024-02-21T07:58:35.032833+0000","last_clean":"2024-02-21T07:58:35.032833+0000","last_became_active":"2024-02-21T07:45:26.282362+0000","last_became_peered":"2024-02-21T07:45:26.282362+0000","last_unstale":"2024-02-21T07:58:35.032833+0000","last_undegraded":"2024-02-21T07:58:35.032833+0000","last_fullsized":"2024-02-21T07:58:35.032833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:35.032575+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:35.032575+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.032575+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:22.585616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"30'10","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.251158+0000","last_change":"2024-02-21T07:58:33.251185+0000","last_active":"2024-02-21T07:58:33.251158+0000","last_peered":"2024-02-21T07:58:33.251158+0000","last_clean":"2024-02-21T07:58:33.251158+0000","last_became_active":"2024-02-21T07:45:25.234370+0000","last_became_peered":"2024-02-21T07:45:25.234370+0000","last_unstale":"2024-02-21T07:58:33.251158+0000","last_undegraded":"2024-02-21T07:58:33.251158+0000","last_fullsized":"2024-02-21T07:58:33.251158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-02-21T07:58:33.251072+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-02-21T07:58:33.251072+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.251072+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:19.373847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"30'2237","reported_seq":2288,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.816878+0000","last_change":"2024-02-21T07:58:37.816935+0000","last_active":"2024-02-21T07:58:37.816878+0000","last_peered":"2024-02-21T07:58:37.816878+0000","last_clean":"2024-02-21T07:58:37.816878+0000","last_became_active":"2024-02-21T07:45:30.331247+0000","last_became_peered":"2024-02-21T07:45:30.331247+0000","last_unstale":"2024-02-21T07:58:37.816878+0000","last_undegraded":"2024-02-21T07:58:37.816878+0000","last_fullsized":"2024-02-21T07:58:37.816878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2237","last_scrub_stamp":"2024-02-21T07:58:37.816728+0000","last_deep_scrub":"30'2237","last_deep_scrub_stamp":"2024-02-21T07:58:37.816728+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.816728+0000","objects_scrubbed":1,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:13:59.421733+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":23651,"num_write_kb":6110913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"30'20","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.926687+0000","last_change":"2024-02-21T07:58:38.926726+0000","last_active":"2024-02-21T07:58:38.926687+0000","last_peered":"2024-02-21T07:58:38.926687+0000","last_clean":"2024-02-21T07:58:38.926687+0000","last_became_active":"2024-02-21T07:45:26.276382+0000","last_became_peered":"2024-02-21T07:45:26.276382+0000","last_unstale":"2024-02-21T07:58:38.926687+0000","last_undegraded":"2024-02-21T07:58:38.926687+0000","last_fullsized":"2024-02-21T07:58:38.926687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-02-21T07:58:38.926600+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-02-21T07:58:38.926600+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.926600+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:31.501656+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"30'7","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.153499+0000","last_change":"2024-02-21T07:58:27.153499+0000","last_active":"2024-02-21T07:58:27.153499+0000","last_peered":"2024-02-21T07:58:27.153499+0000","last_clean":"2024-02-21T07:58:27.153499+0000","last_became_active":"2024-02-21T07:45:25.243080+0000","last_became_peered":"2024-02-21T07:45:25.243080+0000","last_unstale":"2024-02-21T07:58:27.153499+0000","last_undegraded":"2024-02-21T07:58:27.153499+0000","last_fullsized":"2024-02-21T07:58:27.153499+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-02-21T07:58:27.153398+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-02-21T07:58:27.153398+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.153398+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:23:47.994754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"30'2353","reported_seq":2402,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.907920+0000","last_change":"2024-02-21T07:58:33.907986+0000","last_active":"2024-02-21T07:58:33.907920+0000","last_peered":"2024-02-21T07:58:33.907920+0000","last_clean":"2024-02-21T07:58:33.907920+0000","last_became_active":"2024-02-21T07:45:30.326670+0000","last_became_peered":"2024-02-21T07:45:30.326670+0000","last_unstale":"2024-02-21T07:58:33.907920+0000","last_undegraded":"2024-02-21T07:58:33.907920+0000","last_fullsized":"2024-02-21T07:58:33.907920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2353","last_scrub_stamp":"2024-02-21T07:58:33.907712+0000","last_deep_scrub":"30'2353","last_deep_scrub_stamp":"2024-02-21T07:58:33.907712+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.907712+0000","objects_scrubbed":0,"log_size":2353,"log_dups_size":0,"ondisk_log_size":2353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:30:55.857049+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25161,"num_write_kb":6532545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.001835+0000","last_change":"2024-02-21T07:58:38.001895+0000","last_active":"2024-02-21T07:58:38.001835+0000","last_peered":"2024-02-21T07:58:38.001835+0000","last_clean":"2024-02-21T07:58:38.001835+0000","last_became_active":"2024-02-21T07:45:26.261129+0000","last_became_peered":"2024-02-21T07:45:26.261129+0000","last_unstale":"2024-02-21T07:58:38.001835+0000","last_undegraded":"2024-02-21T07:58:38.001835+0000","last_fullsized":"2024-02-21T07:58:38.001835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:38.001737+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:38.001737+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.001737+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:13:26.139867+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"30'3","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.331533+0000","last_change":"2024-02-21T07:58:28.331533+0000","last_active":"2024-02-21T07:58:28.331533+0000","last_peered":"2024-02-21T07:58:28.331533+0000","last_clean":"2024-02-21T07:58:28.331533+0000","last_became_active":"2024-02-21T07:45:25.231518+0000","last_became_peered":"2024-02-21T07:45:25.231518+0000","last_unstale":"2024-02-21T07:58:28.331533+0000","last_undegraded":"2024-02-21T07:58:28.331533+0000","last_fullsized":"2024-02-21T07:58:28.331533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:28.331382+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:28.331382+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.331382+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:46:54.315197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"30'2033","reported_seq":2065,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.832043+0000","last_change":"2024-02-21T07:58:39.832071+0000","last_active":"2024-02-21T07:58:39.832043+0000","last_peered":"2024-02-21T07:58:39.832043+0000","last_clean":"2024-02-21T07:58:39.832043+0000","last_became_active":"2024-02-21T07:45:30.576435+0000","last_became_peered":"2024-02-21T07:45:30.576435+0000","last_unstale":"2024-02-21T07:58:39.832043+0000","last_undegraded":"2024-02-21T07:58:39.832043+0000","last_fullsized":"2024-02-21T07:58:39.832043+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2033","last_scrub_stamp":"2024-02-21T07:58:39.831923+0000","last_deep_scrub":"30'2033","last_deep_scrub_stamp":"2024-02-21T07:58:39.831923+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.831923+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:44:07.210556+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21864,"num_write_kb":5639616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"30'16","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.474702+0000","last_change":"2024-02-21T07:58:32.474749+0000","last_active":"2024-02-21T07:58:32.474702+0000","last_peered":"2024-02-21T07:58:32.474702+0000","last_clean":"2024-02-21T07:58:32.474702+0000","last_became_active":"2024-02-21T07:45:26.285286+0000","last_became_peered":"2024-02-21T07:45:26.285286+0000","last_unstale":"2024-02-21T07:58:32.474702+0000","last_undegraded":"2024-02-21T07:58:32.474702+0000","last_fullsized":"2024-02-21T07:58:32.474702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:32.474589+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:32.474589+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.474589+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:06:54.251022+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'55","reported_seq":115,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.813982+0000","last_change":"2024-02-21T07:58:30.814029+0000","last_active":"2024-02-21T07:58:30.813982+0000","last_peered":"2024-02-21T07:58:30.813982+0000","last_clean":"2024-02-21T07:58:30.813982+0000","last_became_active":"2024-02-21T07:45:25.231028+0000","last_became_peered":"2024-02-21T07:45:25.231028+0000","last_unstale":"2024-02-21T07:58:30.813982+0000","last_undegraded":"2024-02-21T07:58:30.813982+0000","last_fullsized":"2024-02-21T07:58:30.813982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'55","last_scrub_stamp":"2024-02-21T07:58:30.813906+0000","last_deep_scrub":"30'55","last_deep_scrub_stamp":"2024-02-21T07:58:30.813906+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.813906+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:16.936681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":19,"num_write":102,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1156,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"30'1849","reported_seq":1882,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.241147+0000","last_change":"2024-02-21T07:58:38.241176+0000","last_active":"2024-02-21T07:58:38.241147+0000","last_peered":"2024-02-21T07:58:38.241147+0000","last_clean":"2024-02-21T07:58:38.241147+0000","last_became_active":"2024-02-21T07:45:30.308232+0000","last_became_peered":"2024-02-21T07:45:30.308232+0000","last_unstale":"2024-02-21T07:58:38.241147+0000","last_undegraded":"2024-02-21T07:58:38.241147+0000","last_fullsized":"2024-02-21T07:58:38.241147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1849","last_scrub_stamp":"2024-02-21T07:58:38.241044+0000","last_deep_scrub":"30'1849","last_deep_scrub_stamp":"2024-02-21T07:58:38.241044+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.241044+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:31:18.639672+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19868,"num_write_kb":5174912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"30'13","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.991599+0000","last_change":"2024-02-21T07:58:32.991659+0000","last_active":"2024-02-21T07:58:32.991599+0000","last_peered":"2024-02-21T07:58:32.991599+0000","last_clean":"2024-02-21T07:58:32.991599+0000","last_became_active":"2024-02-21T07:45:26.269628+0000","last_became_peered":"2024-02-21T07:45:26.269628+0000","last_unstale":"2024-02-21T07:58:32.991599+0000","last_undegraded":"2024-02-21T07:58:32.991599+0000","last_fullsized":"2024-02-21T07:58:32.991599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-02-21T07:58:32.991407+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-02-21T07:58:32.991407+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.991407+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:26.819796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"30'79","reported_seq":120,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.876748+0000","last_change":"2024-02-21T07:58:29.876748+0000","last_active":"2024-02-21T07:58:29.876748+0000","last_peered":"2024-02-21T07:58:29.876748+0000","last_clean":"2024-02-21T07:58:29.876748+0000","last_became_active":"2024-02-21T07:45:25.243903+0000","last_became_peered":"2024-02-21T07:45:25.243903+0000","last_unstale":"2024-02-21T07:58:29.876748+0000","last_undegraded":"2024-02-21T07:58:29.876748+0000","last_fullsized":"2024-02-21T07:58:29.876748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'79","last_scrub_stamp":"2024-02-21T07:58:29.876522+0000","last_deep_scrub":"30'79","last_deep_scrub_stamp":"2024-02-21T07:58:29.876522+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.876522+0000","objects_scrubbed":2,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:50:07.380192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":103,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"30'2041","reported_seq":2074,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.073093+0000","last_change":"2024-02-21T07:58:37.073157+0000","last_active":"2024-02-21T07:58:37.073093+0000","last_peered":"2024-02-21T07:58:37.073093+0000","last_clean":"2024-02-21T07:58:37.073093+0000","last_became_active":"2024-02-21T07:45:30.575628+0000","last_became_peered":"2024-02-21T07:45:30.575628+0000","last_unstale":"2024-02-21T07:58:37.073093+0000","last_undegraded":"2024-02-21T07:58:37.073093+0000","last_fullsized":"2024-02-21T07:58:37.073093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2041","last_scrub_stamp":"2024-02-21T07:58:37.072906+0000","last_deep_scrub":"30'2041","last_deep_scrub_stamp":"2024-02-21T07:58:37.072906+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.072906+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:44:04.451539+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21885,"num_write_kb":5740224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"30'17","reported_seq":55,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.641406+0000","last_change":"2024-02-21T07:58:29.641465+0000","last_active":"2024-02-21T07:58:29.641406+0000","last_peered":"2024-02-21T07:58:29.641406+0000","last_clean":"2024-02-21T07:58:29.641406+0000","last_became_active":"2024-02-21T07:45:26.257203+0000","last_became_peered":"2024-02-21T07:45:26.257203+0000","last_unstale":"2024-02-21T07:58:29.641406+0000","last_undegraded":"2024-02-21T07:58:29.641406+0000","last_fullsized":"2024-02-21T07:58:29.641406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-02-21T07:58:29.641243+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-02-21T07:58:29.641243+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.641243+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:51.655383+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"30'2","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.002353+0000","last_change":"2024-02-21T07:58:37.002382+0000","last_active":"2024-02-21T07:58:37.002353+0000","last_peered":"2024-02-21T07:58:37.002353+0000","last_clean":"2024-02-21T07:58:37.002353+0000","last_became_active":"2024-02-21T07:45:25.243092+0000","last_became_peered":"2024-02-21T07:45:25.243092+0000","last_unstale":"2024-02-21T07:58:37.002353+0000","last_undegraded":"2024-02-21T07:58:37.002353+0000","last_fullsized":"2024-02-21T07:58:37.002353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-02-21T07:58:37.002277+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-02-21T07:58:37.002277+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.002277+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:15:26.112061+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"30'2741","reported_seq":2774,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.977013+0000","last_change":"2024-02-21T07:58:39.977038+0000","last_active":"2024-02-21T07:58:39.977013+0000","last_peered":"2024-02-21T07:58:39.977013+0000","last_clean":"2024-02-21T07:58:39.977013+0000","last_became_active":"2024-02-21T07:45:30.312018+0000","last_became_peered":"2024-02-21T07:45:30.312018+0000","last_unstale":"2024-02-21T07:58:39.977013+0000","last_undegraded":"2024-02-21T07:58:39.977013+0000","last_fullsized":"2024-02-21T07:58:39.977013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2741","last_scrub_stamp":"2024-02-21T07:58:39.976911+0000","last_deep_scrub":"30'2741","last_deep_scrub_stamp":"2024-02-21T07:58:39.976911+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.976911+0000","objects_scrubbed":0,"log_size":2741,"log_dups_size":0,"ondisk_log_size":2741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:43:00.837593+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28989,"num_write_kb":7541504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"30'13","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.993253+0000","last_change":"2024-02-21T07:58:34.993314+0000","last_active":"2024-02-21T07:58:34.993253+0000","last_peered":"2024-02-21T07:58:34.993253+0000","last_clean":"2024-02-21T07:58:34.993253+0000","last_became_active":"2024-02-21T07:45:26.271261+0000","last_became_peered":"2024-02-21T07:45:26.271261+0000","last_unstale":"2024-02-21T07:58:34.993253+0000","last_undegraded":"2024-02-21T07:58:34.993253+0000","last_fullsized":"2024-02-21T07:58:34.993253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-02-21T07:58:34.993159+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-02-21T07:58:34.993159+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.993159+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:23:55.834515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.825185+0000","last_change":"2024-02-21T07:58:27.825208+0000","last_active":"2024-02-21T07:58:27.825185+0000","last_peered":"2024-02-21T07:58:27.825185+0000","last_clean":"2024-02-21T07:58:27.825185+0000","last_became_active":"2024-02-21T07:45:25.240116+0000","last_became_peered":"2024-02-21T07:45:25.240116+0000","last_unstale":"2024-02-21T07:58:27.825185+0000","last_undegraded":"2024-02-21T07:58:27.825185+0000","last_fullsized":"2024-02-21T07:58:27.825185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:58:27.825124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:58:27.825124+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.825124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:38:33.501443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"30'2464","reported_seq":2548,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.964124+0000","last_change":"2024-02-21T07:58:41.964158+0000","last_active":"2024-02-21T07:58:41.964124+0000","last_peered":"2024-02-21T07:58:41.964124+0000","last_clean":"2024-02-21T07:58:41.964124+0000","last_became_active":"2024-02-21T07:45:30.575832+0000","last_became_peered":"2024-02-21T07:45:30.575832+0000","last_unstale":"2024-02-21T07:58:41.964124+0000","last_undegraded":"2024-02-21T07:58:41.964124+0000","last_fullsized":"2024-02-21T07:58:41.964124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2464","last_scrub_stamp":"2024-02-21T07:58:41.964035+0000","last_deep_scrub":"30'2464","last_deep_scrub_stamp":"2024-02-21T07:58:41.964035+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.964035+0000","objects_scrubbed":0,"log_size":2464,"log_dups_size":0,"ondisk_log_size":2464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:02:29.552875+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":26392,"num_write_kb":6842521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.021537+0000","last_change":"2024-02-21T07:58:34.021579+0000","last_active":"2024-02-21T07:58:34.021537+0000","last_peered":"2024-02-21T07:58:34.021537+0000","last_clean":"2024-02-21T07:58:34.021537+0000","last_became_active":"2024-02-21T07:45:26.262123+0000","last_became_peered":"2024-02-21T07:45:26.262123+0000","last_unstale":"2024-02-21T07:58:34.021537+0000","last_undegraded":"2024-02-21T07:58:34.021537+0000","last_fullsized":"2024-02-21T07:58:34.021537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:34.021454+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:34.021454+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.021454+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:47.453926+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"28'1","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.451049+0000","last_change":"2024-02-21T07:58:30.451092+0000","last_active":"2024-02-21T07:58:30.451049+0000","last_peered":"2024-02-21T07:58:30.451049+0000","last_clean":"2024-02-21T07:58:30.451049+0000","last_became_active":"2024-02-21T07:45:25.231368+0000","last_became_peered":"2024-02-21T07:45:25.231368+0000","last_unstale":"2024-02-21T07:58:30.451049+0000","last_undegraded":"2024-02-21T07:58:30.451049+0000","last_fullsized":"2024-02-21T07:58:30.451049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-02-21T07:58:30.450934+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-02-21T07:58:30.450934+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.450934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:02.497984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"30'2384","reported_seq":2434,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.736366+0000","last_change":"2024-02-21T07:58:35.736491+0000","last_active":"2024-02-21T07:58:35.736366+0000","last_peered":"2024-02-21T07:58:35.736366+0000","last_clean":"2024-02-21T07:58:35.736366+0000","last_became_active":"2024-02-21T07:45:30.324745+0000","last_became_peered":"2024-02-21T07:45:30.324745+0000","last_unstale":"2024-02-21T07:58:35.736366+0000","last_undegraded":"2024-02-21T07:58:35.736366+0000","last_fullsized":"2024-02-21T07:58:35.736366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2384","last_scrub_stamp":"2024-02-21T07:58:35.736142+0000","last_deep_scrub":"30'2384","last_deep_scrub_stamp":"2024-02-21T07:58:35.736142+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.736142+0000","objects_scrubbed":0,"log_size":2384,"log_dups_size":0,"ondisk_log_size":2384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:23.289183+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":25350,"num_write_kb":6611464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"30'13","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.433041+0000","last_change":"2024-02-21T07:58:38.433081+0000","last_active":"2024-02-21T07:58:38.433041+0000","last_peered":"2024-02-21T07:58:38.433041+0000","last_clean":"2024-02-21T07:58:38.433041+0000","last_became_active":"2024-02-21T07:45:26.262926+0000","last_became_peered":"2024-02-21T07:45:26.262926+0000","last_unstale":"2024-02-21T07:58:38.433041+0000","last_undegraded":"2024-02-21T07:58:38.433041+0000","last_fullsized":"2024-02-21T07:58:38.433041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-02-21T07:58:38.432936+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-02-21T07:58:38.432936+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.432936+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:04:00.135250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"30'15","reported_seq":841,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:48.631607+0000","last_change":"2024-02-21T07:58:27.625231+0000","last_active":"2024-02-21T07:58:48.631607+0000","last_peered":"2024-02-21T07:58:48.631607+0000","last_clean":"2024-02-21T07:58:48.631607+0000","last_became_active":"2024-02-21T07:45:25.240628+0000","last_became_peered":"2024-02-21T07:45:25.240628+0000","last_unstale":"2024-02-21T07:58:48.631607+0000","last_undegraded":"2024-02-21T07:58:48.631607+0000","last_fullsized":"2024-02-21T07:58:48.631607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:27.625102+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:27.625102+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.625102+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:55:59.672153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2036,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":786,"num_read_kb":787,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"30'2406","reported_seq":2446,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.686127+0000","last_change":"2024-02-21T07:58:37.686206+0000","last_active":"2024-02-21T07:58:37.686127+0000","last_peered":"2024-02-21T07:58:37.686127+0000","last_clean":"2024-02-21T07:58:37.686127+0000","last_became_active":"2024-02-21T07:46:14.307221+0000","last_became_peered":"2024-02-21T07:46:14.307221+0000","last_unstale":"2024-02-21T07:58:37.686127+0000","last_undegraded":"2024-02-21T07:58:37.686127+0000","last_fullsized":"2024-02-21T07:58:37.686127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2406","last_scrub_stamp":"2024-02-21T07:58:37.685846+0000","last_deep_scrub":"30'2406","last_deep_scrub_stamp":"2024-02-21T07:58:37.685846+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.685846+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:44:05.064479+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25497,"num_write_kb":6630592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8,10,0],"acting":[6,8,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"30'12","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.629858+0000","last_change":"2024-02-21T07:58:32.629886+0000","last_active":"2024-02-21T07:58:32.629858+0000","last_peered":"2024-02-21T07:58:32.629858+0000","last_clean":"2024-02-21T07:58:32.629858+0000","last_became_active":"2024-02-21T07:45:26.262160+0000","last_became_peered":"2024-02-21T07:45:26.262160+0000","last_unstale":"2024-02-21T07:58:32.629858+0000","last_undegraded":"2024-02-21T07:58:32.629858+0000","last_fullsized":"2024-02-21T07:58:32.629858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-02-21T07:58:32.629743+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-02-21T07:58:32.629743+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.629743+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:38.824241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"30'4","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.495437+0000","last_change":"2024-02-21T07:58:31.495469+0000","last_active":"2024-02-21T07:58:31.495437+0000","last_peered":"2024-02-21T07:58:31.495437+0000","last_clean":"2024-02-21T07:58:31.495437+0000","last_became_active":"2024-02-21T07:45:25.231588+0000","last_became_peered":"2024-02-21T07:45:25.231588+0000","last_unstale":"2024-02-21T07:58:31.495437+0000","last_undegraded":"2024-02-21T07:58:31.495437+0000","last_fullsized":"2024-02-21T07:58:31.495437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-21T07:58:31.495349+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-21T07:58:31.495349+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.495349+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:17.618124+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"30'2270","reported_seq":2303,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:44.518426+0000","last_change":"2024-02-21T07:58:44.518454+0000","last_active":"2024-02-21T07:58:44.518426+0000","last_peered":"2024-02-21T07:58:44.518426+0000","last_clean":"2024-02-21T07:58:44.518426+0000","last_became_active":"2024-02-21T07:45:30.575948+0000","last_became_peered":"2024-02-21T07:45:30.575948+0000","last_unstale":"2024-02-21T07:58:44.518426+0000","last_undegraded":"2024-02-21T07:58:44.518426+0000","last_fullsized":"2024-02-21T07:58:44.518426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2270","last_scrub_stamp":"2024-02-21T07:58:44.518306+0000","last_deep_scrub":"30'2270","last_deep_scrub_stamp":"2024-02-21T07:58:44.518306+0000","last_clean_scrub_stamp":"2024-02-21T07:58:44.518306+0000","objects_scrubbed":0,"log_size":2270,"log_dups_size":0,"ondisk_log_size":2270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:43:05.850062+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24328,"num_write_kb":6335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"30'20","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.988630+0000","last_change":"2024-02-21T07:58:30.988661+0000","last_active":"2024-02-21T07:58:30.988630+0000","last_peered":"2024-02-21T07:58:30.988630+0000","last_clean":"2024-02-21T07:58:30.988630+0000","last_became_active":"2024-02-21T07:45:26.267250+0000","last_became_peered":"2024-02-21T07:45:26.267250+0000","last_unstale":"2024-02-21T07:58:30.988630+0000","last_undegraded":"2024-02-21T07:58:30.988630+0000","last_fullsized":"2024-02-21T07:58:30.988630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-02-21T07:58:30.988541+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-02-21T07:58:30.988541+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.988541+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:51.849224+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"30'6","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.765355+0000","last_change":"2024-02-21T07:58:28.765386+0000","last_active":"2024-02-21T07:58:28.765355+0000","last_peered":"2024-02-21T07:58:28.765355+0000","last_clean":"2024-02-21T07:58:28.765355+0000","last_became_active":"2024-02-21T07:45:25.220145+0000","last_became_peered":"2024-02-21T07:45:25.220145+0000","last_unstale":"2024-02-21T07:58:28.765355+0000","last_undegraded":"2024-02-21T07:58:28.765355+0000","last_fullsized":"2024-02-21T07:58:28.765355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-02-21T07:58:28.765256+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-02-21T07:58:28.765256+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.765256+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:42.197728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"30'139","reported_seq":222,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.409614+0000","last_change":"2024-02-21T07:58:29.409651+0000","last_active":"2024-02-21T07:58:29.409614+0000","last_peered":"2024-02-21T07:58:29.409614+0000","last_clean":"2024-02-21T07:58:29.409614+0000","last_became_active":"2024-02-21T07:45:21.363040+0000","last_became_peered":"2024-02-21T07:45:21.363040+0000","last_unstale":"2024-02-21T07:58:29.409614+0000","last_undegraded":"2024-02-21T07:58:29.409614+0000","last_fullsized":"2024-02-21T07:58:29.409614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'139","last_scrub_stamp":"2024-02-21T07:58:29.409538+0000","last_deep_scrub":"30'139","last_deep_scrub_stamp":"2024-02-21T07:58:29.409538+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.409538+0000","objects_scrubbed":2,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:41.758115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"30'2060","reported_seq":2127,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.347972+0000","last_change":"2024-02-21T07:58:41.348020+0000","last_active":"2024-02-21T07:58:41.347972+0000","last_peered":"2024-02-21T07:58:41.347972+0000","last_clean":"2024-02-21T07:58:41.347972+0000","last_became_active":"2024-02-21T07:45:30.327352+0000","last_became_peered":"2024-02-21T07:45:30.327352+0000","last_unstale":"2024-02-21T07:58:41.347972+0000","last_undegraded":"2024-02-21T07:58:41.347972+0000","last_fullsized":"2024-02-21T07:58:41.347972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2060","last_scrub_stamp":"2024-02-21T07:58:41.347878+0000","last_deep_scrub":"30'2060","last_deep_scrub_stamp":"2024-02-21T07:58:41.347878+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.347878+0000","objects_scrubbed":1,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:50:18.211852+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22073,"num_write_kb":5629259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"30'12","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.419560+0000","last_change":"2024-02-21T07:58:34.419587+0000","last_active":"2024-02-21T07:58:34.419560+0000","last_peered":"2024-02-21T07:58:34.419560+0000","last_clean":"2024-02-21T07:58:34.419560+0000","last_became_active":"2024-02-21T07:45:26.263156+0000","last_became_peered":"2024-02-21T07:45:26.263156+0000","last_unstale":"2024-02-21T07:58:34.419560+0000","last_undegraded":"2024-02-21T07:58:34.419560+0000","last_fullsized":"2024-02-21T07:58:34.419560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-02-21T07:58:34.419439+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-02-21T07:58:34.419439+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.419439+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:55.280122+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'6","reported_seq":46,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.296612+0000","last_change":"2024-02-21T07:58:32.296645+0000","last_active":"2024-02-21T07:58:32.296612+0000","last_peered":"2024-02-21T07:58:32.296612+0000","last_clean":"2024-02-21T07:58:32.296612+0000","last_became_active":"2024-02-21T07:45:25.232170+0000","last_became_peered":"2024-02-21T07:45:25.232170+0000","last_unstale":"2024-02-21T07:58:32.296612+0000","last_undegraded":"2024-02-21T07:58:32.296612+0000","last_fullsized":"2024-02-21T07:58:32.296612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-02-21T07:58:32.296526+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-02-21T07:58:32.296526+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.296526+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:04.343577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"30'2311","reported_seq":2344,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.229393+0000","last_change":"2024-02-21T07:58:35.229421+0000","last_active":"2024-02-21T07:58:35.229393+0000","last_peered":"2024-02-21T07:58:35.229393+0000","last_clean":"2024-02-21T07:58:35.229393+0000","last_became_active":"2024-02-21T07:45:30.314968+0000","last_became_peered":"2024-02-21T07:45:30.314968+0000","last_unstale":"2024-02-21T07:58:35.229393+0000","last_undegraded":"2024-02-21T07:58:35.229393+0000","last_fullsized":"2024-02-21T07:58:35.229393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2311","last_scrub_stamp":"2024-02-21T07:58:35.229300+0000","last_deep_scrub":"30'2311","last_deep_scrub_stamp":"2024-02-21T07:58:35.229300+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.229300+0000","objects_scrubbed":0,"log_size":2311,"log_dups_size":0,"ondisk_log_size":2311,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:27.804356+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24846,"num_write_kb":6393408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'18","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.405252+0000","last_change":"2024-02-21T07:58:39.405285+0000","last_active":"2024-02-21T07:58:39.405252+0000","last_peered":"2024-02-21T07:58:39.405252+0000","last_clean":"2024-02-21T07:58:39.405252+0000","last_became_active":"2024-02-21T07:45:26.269554+0000","last_became_peered":"2024-02-21T07:45:26.269554+0000","last_unstale":"2024-02-21T07:58:39.405252+0000","last_undegraded":"2024-02-21T07:58:39.405252+0000","last_fullsized":"2024-02-21T07:58:39.405252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:39.405159+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:39.405159+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.405159+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:04:01.107473+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"30'49","reported_seq":107,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.276470+0000","last_change":"2024-02-21T07:58:31.276500+0000","last_active":"2024-02-21T07:58:31.276470+0000","last_peered":"2024-02-21T07:58:31.276470+0000","last_clean":"2024-02-21T07:58:31.276470+0000","last_became_active":"2024-02-21T07:45:25.224745+0000","last_became_peered":"2024-02-21T07:45:25.224745+0000","last_unstale":"2024-02-21T07:58:31.276470+0000","last_undegraded":"2024-02-21T07:58:31.276470+0000","last_fullsized":"2024-02-21T07:58:31.276470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'49","last_scrub_stamp":"2024-02-21T07:58:31.276388+0000","last_deep_scrub":"30'49","last_deep_scrub_stamp":"2024-02-21T07:58:31.276388+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.276388+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:17.399163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":62,"num_read_kb":18,"num_write":93,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9604,"num_omap_keys":16,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"30'2089","reported_seq":2128,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.513908+0000","last_change":"2024-02-21T07:58:34.514024+0000","last_active":"2024-02-21T07:58:34.513908+0000","last_peered":"2024-02-21T07:58:34.513908+0000","last_clean":"2024-02-21T07:58:34.513908+0000","last_became_active":"2024-02-21T07:46:14.409683+0000","last_became_peered":"2024-02-21T07:46:14.409683+0000","last_unstale":"2024-02-21T07:58:34.513908+0000","last_undegraded":"2024-02-21T07:58:34.513908+0000","last_fullsized":"2024-02-21T07:58:34.513908+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2089","last_scrub_stamp":"2024-02-21T07:58:34.513689+0000","last_deep_scrub":"30'2089","last_deep_scrub_stamp":"2024-02-21T07:58:34.513689+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.513689+0000","objects_scrubbed":0,"log_size":2089,"log_dups_size":0,"ondisk_log_size":2089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:28.342077+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22313,"num_write_kb":5873984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,10,1,4],"acting":[0,10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.461679+0000","last_change":"2024-02-21T07:58:33.461703+0000","last_active":"2024-02-21T07:58:33.461679+0000","last_peered":"2024-02-21T07:58:33.461679+0000","last_clean":"2024-02-21T07:58:33.461679+0000","last_became_active":"2024-02-21T07:45:26.262294+0000","last_became_peered":"2024-02-21T07:45:26.262294+0000","last_unstale":"2024-02-21T07:58:33.461679+0000","last_undegraded":"2024-02-21T07:58:33.461679+0000","last_fullsized":"2024-02-21T07:58:33.461679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:33.461595+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:33.461595+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.461595+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:26.036651+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'3","reported_seq":42,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.610964+0000","last_change":"2024-02-21T07:58:28.611050+0000","last_active":"2024-02-21T07:58:28.610964+0000","last_peered":"2024-02-21T07:58:28.610964+0000","last_clean":"2024-02-21T07:58:28.610964+0000","last_became_active":"2024-02-21T07:45:25.246364+0000","last_became_peered":"2024-02-21T07:45:25.246364+0000","last_unstale":"2024-02-21T07:58:28.610964+0000","last_undegraded":"2024-02-21T07:58:28.610964+0000","last_fullsized":"2024-02-21T07:58:28.610964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:28.610746+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:28.610746+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.610746+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:14.733521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"30'1828","reported_seq":1861,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.444887+0000","last_change":"2024-02-21T07:58:41.444943+0000","last_active":"2024-02-21T07:58:41.444887+0000","last_peered":"2024-02-21T07:58:41.444887+0000","last_clean":"2024-02-21T07:58:41.444887+0000","last_became_active":"2024-02-21T07:45:30.310375+0000","last_became_peered":"2024-02-21T07:45:30.310375+0000","last_unstale":"2024-02-21T07:58:41.444887+0000","last_undegraded":"2024-02-21T07:58:41.444887+0000","last_fullsized":"2024-02-21T07:58:41.444887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1828","last_scrub_stamp":"2024-02-21T07:58:41.444795+0000","last_deep_scrub":"30'1828","last_deep_scrub_stamp":"2024-02-21T07:58:41.444795+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.444795+0000","objects_scrubbed":0,"log_size":1828,"log_dups_size":0,"ondisk_log_size":1828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:23:25.014926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19636,"num_write_kb":5096256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"30'9","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.934557+0000","last_change":"2024-02-21T07:58:37.934587+0000","last_active":"2024-02-21T07:58:37.934557+0000","last_peered":"2024-02-21T07:58:37.934557+0000","last_clean":"2024-02-21T07:58:37.934557+0000","last_became_active":"2024-02-21T07:45:26.266634+0000","last_became_peered":"2024-02-21T07:45:26.266634+0000","last_unstale":"2024-02-21T07:58:37.934557+0000","last_undegraded":"2024-02-21T07:58:37.934557+0000","last_fullsized":"2024-02-21T07:58:37.934557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-02-21T07:58:37.934462+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-02-21T07:58:37.934462+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.934462+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:59.948603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"30'4","reported_seq":45,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.055457+0000","last_change":"2024-02-21T07:58:33.055490+0000","last_active":"2024-02-21T07:58:33.055457+0000","last_peered":"2024-02-21T07:58:33.055457+0000","last_clean":"2024-02-21T07:58:33.055457+0000","last_became_active":"2024-02-21T07:45:25.226144+0000","last_became_peered":"2024-02-21T07:45:25.226144+0000","last_unstale":"2024-02-21T07:58:33.055457+0000","last_undegraded":"2024-02-21T07:58:33.055457+0000","last_fullsized":"2024-02-21T07:58:33.055457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-21T07:58:33.055371+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-21T07:58:33.055371+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.055371+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:05.102421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"30'2224","reported_seq":2292,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:43.509887+0000","last_change":"2024-02-21T07:58:43.509949+0000","last_active":"2024-02-21T07:58:43.509887+0000","last_peered":"2024-02-21T07:58:43.509887+0000","last_clean":"2024-02-21T07:58:43.509887+0000","last_became_active":"2024-02-21T07:45:30.321014+0000","last_became_peered":"2024-02-21T07:45:30.321014+0000","last_unstale":"2024-02-21T07:58:43.509887+0000","last_undegraded":"2024-02-21T07:58:43.509887+0000","last_fullsized":"2024-02-21T07:58:43.509887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2224","last_scrub_stamp":"2024-02-21T07:58:43.509760+0000","last_deep_scrub":"30'2224","last_deep_scrub_stamp":"2024-02-21T07:58:43.509760+0000","last_clean_scrub_stamp":"2024-02-21T07:58:43.509760+0000","objects_scrubbed":0,"log_size":2224,"log_dups_size":0,"ondisk_log_size":2224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:07:12.559393+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":23814,"num_write_kb":6166061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"30'11","reported_seq":49,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.411889+0000","last_change":"2024-02-21T07:58:36.411923+0000","last_active":"2024-02-21T07:58:36.411889+0000","last_peered":"2024-02-21T07:58:36.411889+0000","last_clean":"2024-02-21T07:58:36.411889+0000","last_became_active":"2024-02-21T07:45:26.262413+0000","last_became_peered":"2024-02-21T07:45:26.262413+0000","last_unstale":"2024-02-21T07:58:36.411889+0000","last_undegraded":"2024-02-21T07:58:36.411889+0000","last_fullsized":"2024-02-21T07:58:36.411889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-02-21T07:58:36.411803+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-02-21T07:58:36.411803+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.411803+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:53:54.272574+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"30'120","reported_seq":197,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.007762+0000","last_change":"2024-02-21T07:58:36.007812+0000","last_active":"2024-02-21T07:58:36.007762+0000","last_peered":"2024-02-21T07:58:36.007762+0000","last_clean":"2024-02-21T07:58:36.007762+0000","last_became_active":"2024-02-21T07:45:25.237234+0000","last_became_peered":"2024-02-21T07:45:25.237234+0000","last_unstale":"2024-02-21T07:58:36.007762+0000","last_undegraded":"2024-02-21T07:58:36.007762+0000","last_fullsized":"2024-02-21T07:58:36.007762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'120","last_scrub_stamp":"2024-02-21T07:58:36.007643+0000","last_deep_scrub":"30'120","last_deep_scrub_stamp":"2024-02-21T07:58:36.007643+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.007643+0000","objects_scrubbed":9,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:08:46.154086+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":37,"num_write":210,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1516,"num_omap_keys":3,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"30'2326","reported_seq":2377,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.697563+0000","last_change":"2024-02-21T07:58:36.697732+0000","last_active":"2024-02-21T07:58:36.697563+0000","last_peered":"2024-02-21T07:58:36.697563+0000","last_clean":"2024-02-21T07:58:36.697563+0000","last_became_active":"2024-02-21T07:45:30.332148+0000","last_became_peered":"2024-02-21T07:45:30.332148+0000","last_unstale":"2024-02-21T07:58:36.697563+0000","last_undegraded":"2024-02-21T07:58:36.697563+0000","last_fullsized":"2024-02-21T07:58:36.697563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2326","last_scrub_stamp":"2024-02-21T07:58:36.697324+0000","last_deep_scrub":"30'2326","last_deep_scrub_stamp":"2024-02-21T07:58:36.697324+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.697324+0000","objects_scrubbed":1,"log_size":2326,"log_dups_size":0,"ondisk_log_size":2326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:11:31.851401+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":25096,"num_write_kb":6462656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"30'12","reported_seq":50,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.427927+0000","last_change":"2024-02-21T07:58:38.427954+0000","last_active":"2024-02-21T07:58:38.427927+0000","last_peered":"2024-02-21T07:58:38.427927+0000","last_clean":"2024-02-21T07:58:38.427927+0000","last_became_active":"2024-02-21T07:45:26.265218+0000","last_became_peered":"2024-02-21T07:45:26.265218+0000","last_unstale":"2024-02-21T07:58:38.427927+0000","last_undegraded":"2024-02-21T07:58:38.427927+0000","last_fullsized":"2024-02-21T07:58:38.427927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-02-21T07:58:38.427844+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-02-21T07:58:38.427844+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.427844+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:25.980885+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"30'5","reported_seq":824,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:47.630217+0000","last_change":"2024-02-21T07:58:29.812002+0000","last_active":"2024-02-21T07:58:47.630217+0000","last_peered":"2024-02-21T07:58:47.630217+0000","last_clean":"2024-02-21T07:58:47.630217+0000","last_became_active":"2024-02-21T07:45:25.228351+0000","last_became_peered":"2024-02-21T07:45:25.228351+0000","last_unstale":"2024-02-21T07:58:47.630217+0000","last_undegraded":"2024-02-21T07:58:47.630217+0000","last_fullsized":"2024-02-21T07:58:47.630217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'5","last_scrub_stamp":"2024-02-21T07:58:29.811872+0000","last_deep_scrub":"30'5","last_deep_scrub_stamp":"2024-02-21T07:58:29.811872+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.811872+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:56:01.858922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":780,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"30'2447","reported_seq":2509,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:43.010895+0000","last_change":"2024-02-21T07:58:43.010941+0000","last_active":"2024-02-21T07:58:43.010895+0000","last_peered":"2024-02-21T07:58:43.010895+0000","last_clean":"2024-02-21T07:58:43.010895+0000","last_became_active":"2024-02-21T07:46:13.654207+0000","last_became_peered":"2024-02-21T07:46:13.654207+0000","last_unstale":"2024-02-21T07:58:43.010895+0000","last_undegraded":"2024-02-21T07:58:43.010895+0000","last_fullsized":"2024-02-21T07:58:43.010895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2447","last_scrub_stamp":"2024-02-21T07:58:43.010798+0000","last_deep_scrub":"30'2447","last_deep_scrub_stamp":"2024-02-21T07:58:43.010798+0000","last_clean_scrub_stamp":"2024-02-21T07:58:43.010798+0000","objects_scrubbed":0,"log_size":2447,"log_dups_size":0,"ondisk_log_size":2447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:38:43.150403+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":25865,"num_write_kb":6637076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7,0,3],"acting":[8,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.13","version":"30'25","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.418099+0000","last_change":"2024-02-21T07:58:37.418140+0000","last_active":"2024-02-21T07:58:37.418099+0000","last_peered":"2024-02-21T07:58:37.418099+0000","last_clean":"2024-02-21T07:58:37.418099+0000","last_became_active":"2024-02-21T07:45:26.263400+0000","last_became_peered":"2024-02-21T07:45:26.263400+0000","last_unstale":"2024-02-21T07:58:37.418099+0000","last_undegraded":"2024-02-21T07:58:37.418099+0000","last_fullsized":"2024-02-21T07:58:37.418099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-02-21T07:58:37.418010+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-02-21T07:58:37.418010+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.418010+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:36:14.954743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"30'6","reported_seq":65,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.334564+0000","last_change":"2024-02-21T07:58:34.334607+0000","last_active":"2024-02-21T07:58:34.334564+0000","last_peered":"2024-02-21T07:58:34.334564+0000","last_clean":"2024-02-21T07:58:34.334564+0000","last_became_active":"2024-02-21T07:45:25.241083+0000","last_became_peered":"2024-02-21T07:45:25.241083+0000","last_unstale":"2024-02-21T07:58:34.334564+0000","last_undegraded":"2024-02-21T07:58:34.334564+0000","last_fullsized":"2024-02-21T07:58:34.334564+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'6","last_scrub_stamp":"2024-02-21T07:58:34.334462+0000","last_deep_scrub":"30'6","last_deep_scrub_stamp":"2024-02-21T07:58:34.334462+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.334462+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:15:23.444246+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'2095","reported_seq":2161,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.955666+0000","last_change":"2024-02-21T07:58:41.955725+0000","last_active":"2024-02-21T07:58:41.955666+0000","last_peered":"2024-02-21T07:58:41.955666+0000","last_clean":"2024-02-21T07:58:41.955666+0000","last_became_active":"2024-02-21T07:45:30.332747+0000","last_became_peered":"2024-02-21T07:45:30.332747+0000","last_unstale":"2024-02-21T07:58:41.955666+0000","last_undegraded":"2024-02-21T07:58:41.955666+0000","last_fullsized":"2024-02-21T07:58:41.955666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2095","last_scrub_stamp":"2024-02-21T07:58:41.955561+0000","last_deep_scrub":"30'2095","last_deep_scrub_stamp":"2024-02-21T07:58:41.955561+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.955561+0000","objects_scrubbed":0,"log_size":2095,"log_dups_size":0,"ondisk_log_size":2095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:35.783949+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22512,"num_write_kb":5792019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"30'16","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.629622+0000","last_change":"2024-02-21T07:58:33.629680+0000","last_active":"2024-02-21T07:58:33.629622+0000","last_peered":"2024-02-21T07:58:33.629622+0000","last_clean":"2024-02-21T07:58:33.629622+0000","last_became_active":"2024-02-21T07:45:26.265010+0000","last_became_peered":"2024-02-21T07:45:26.265010+0000","last_unstale":"2024-02-21T07:58:33.629622+0000","last_undegraded":"2024-02-21T07:58:33.629622+0000","last_fullsized":"2024-02-21T07:58:33.629622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:33.629461+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:33.629461+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.629461+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:27.457850+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"30'62","reported_seq":121,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.293636+0000","last_change":"2024-02-21T07:58:31.293685+0000","last_active":"2024-02-21T07:58:31.293636+0000","last_peered":"2024-02-21T07:58:31.293636+0000","last_clean":"2024-02-21T07:58:31.293636+0000","last_became_active":"2024-02-21T07:45:25.220297+0000","last_became_peered":"2024-02-21T07:45:25.220297+0000","last_unstale":"2024-02-21T07:58:31.293636+0000","last_undegraded":"2024-02-21T07:58:31.293636+0000","last_fullsized":"2024-02-21T07:58:31.293636+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'62","last_scrub_stamp":"2024-02-21T07:58:31.293551+0000","last_deep_scrub":"30'62","last_deep_scrub_stamp":"2024-02-21T07:58:31.293551+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.293551+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:43.642127+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":20,"num_write":108,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5561,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"30'2154","reported_seq":2186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:42.474053+0000","last_change":"2024-02-21T07:58:42.474081+0000","last_active":"2024-02-21T07:58:42.474053+0000","last_peered":"2024-02-21T07:58:42.474053+0000","last_clean":"2024-02-21T07:58:42.474053+0000","last_became_active":"2024-02-21T07:45:30.314942+0000","last_became_peered":"2024-02-21T07:45:30.314942+0000","last_unstale":"2024-02-21T07:58:42.474053+0000","last_undegraded":"2024-02-21T07:58:42.474053+0000","last_fullsized":"2024-02-21T07:58:42.474053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2154","last_scrub_stamp":"2024-02-21T07:58:42.473955+0000","last_deep_scrub":"30'2154","last_deep_scrub_stamp":"2024-02-21T07:58:42.473955+0000","last_clean_scrub_stamp":"2024-02-21T07:58:42.473955+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:41:56.841579+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23058,"num_write_kb":5940672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"30'14","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:38.966727+0000","last_change":"2024-02-21T07:58:38.966758+0000","last_active":"2024-02-21T07:58:38.966727+0000","last_peered":"2024-02-21T07:58:38.966727+0000","last_clean":"2024-02-21T07:58:38.966727+0000","last_became_active":"2024-02-21T07:45:26.261943+0000","last_became_peered":"2024-02-21T07:45:26.261943+0000","last_unstale":"2024-02-21T07:58:38.966727+0000","last_undegraded":"2024-02-21T07:58:38.966727+0000","last_fullsized":"2024-02-21T07:58:38.966727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:38.966625+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:38.966625+0000","last_clean_scrub_stamp":"2024-02-21T07:58:38.966625+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:53:56.827396+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"30'760","reported_seq":2198,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:47.917094+0000","last_change":"2024-02-21T07:58:32.004745+0000","last_active":"2024-02-21T07:58:47.917094+0000","last_peered":"2024-02-21T07:58:47.917094+0000","last_clean":"2024-02-21T07:58:47.917094+0000","last_became_active":"2024-02-21T07:45:25.232921+0000","last_became_peered":"2024-02-21T07:45:25.232921+0000","last_unstale":"2024-02-21T07:58:47.917094+0000","last_undegraded":"2024-02-21T07:58:47.917094+0000","last_fullsized":"2024-02-21T07:58:47.917094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'760","last_scrub_stamp":"2024-02-21T07:58:32.004581+0000","last_deep_scrub":"30'760","last_deep_scrub_stamp":"2024-02-21T07:58:32.004581+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.004581+0000","objects_scrubbed":4,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:36.990129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":4949,"num_write":757,"num_write_kb":4594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"30'2054","reported_seq":2104,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.850899+0000","last_change":"2024-02-21T07:58:32.850924+0000","last_active":"2024-02-21T07:58:32.850899+0000","last_peered":"2024-02-21T07:58:32.850899+0000","last_clean":"2024-02-21T07:58:32.850899+0000","last_became_active":"2024-02-21T07:45:30.317184+0000","last_became_peered":"2024-02-21T07:45:30.317184+0000","last_unstale":"2024-02-21T07:58:32.850899+0000","last_undegraded":"2024-02-21T07:58:32.850899+0000","last_fullsized":"2024-02-21T07:58:32.850899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2054","last_scrub_stamp":"2024-02-21T07:58:32.850809+0000","last_deep_scrub":"30'2054","last_deep_scrub_stamp":"2024-02-21T07:58:32.850809+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.850809+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:33:50.170771+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":21761,"num_write_kb":5639370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.325618+0000","last_change":"2024-02-21T07:58:29.325656+0000","last_active":"2024-02-21T07:58:29.325618+0000","last_peered":"2024-02-21T07:58:29.325618+0000","last_clean":"2024-02-21T07:58:29.325618+0000","last_became_active":"2024-02-21T07:45:26.263567+0000","last_became_peered":"2024-02-21T07:45:26.263567+0000","last_unstale":"2024-02-21T07:58:29.325618+0000","last_undegraded":"2024-02-21T07:58:29.325618+0000","last_fullsized":"2024-02-21T07:58:29.325618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:29.325525+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:29.325525+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.325525+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:34.311073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"30'61","reported_seq":121,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.374143+0000","last_change":"2024-02-21T07:58:35.374180+0000","last_active":"2024-02-21T07:58:35.374143+0000","last_peered":"2024-02-21T07:58:35.374143+0000","last_clean":"2024-02-21T07:58:35.374143+0000","last_became_active":"2024-02-21T07:45:25.244794+0000","last_became_peered":"2024-02-21T07:45:25.244794+0000","last_unstale":"2024-02-21T07:58:35.374143+0000","last_undegraded":"2024-02-21T07:58:35.374143+0000","last_fullsized":"2024-02-21T07:58:35.374143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'61","last_scrub_stamp":"2024-02-21T07:58:35.374061+0000","last_deep_scrub":"30'61","last_deep_scrub_stamp":"2024-02-21T07:58:35.374061+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.374061+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:13:23.512191+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":65,"num_read_kb":20,"num_write":105,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":561,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"30'2000","reported_seq":2066,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.809834+0000","last_change":"2024-02-21T07:58:34.809862+0000","last_active":"2024-02-21T07:58:34.809834+0000","last_peered":"2024-02-21T07:58:34.809834+0000","last_clean":"2024-02-21T07:58:34.809834+0000","last_became_active":"2024-02-21T07:45:30.316710+0000","last_became_peered":"2024-02-21T07:45:30.316710+0000","last_unstale":"2024-02-21T07:58:34.809834+0000","last_undegraded":"2024-02-21T07:58:34.809834+0000","last_fullsized":"2024-02-21T07:58:34.809834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2000","last_scrub_stamp":"2024-02-21T07:58:34.809731+0000","last_deep_scrub":"30'2000","last_deep_scrub_stamp":"2024-02-21T07:58:34.809731+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.809731+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:41.004229+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":21494,"num_write_kb":5470657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"30'18","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.417685+0000","last_change":"2024-02-21T07:58:26.417709+0000","last_active":"2024-02-21T07:58:26.417685+0000","last_peered":"2024-02-21T07:58:26.417685+0000","last_clean":"2024-02-21T07:58:26.417685+0000","last_became_active":"2024-02-21T07:45:26.278708+0000","last_became_peered":"2024-02-21T07:45:26.278708+0000","last_unstale":"2024-02-21T07:58:26.417685+0000","last_undegraded":"2024-02-21T07:58:26.417685+0000","last_fullsized":"2024-02-21T07:58:26.417685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:26.417608+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:26.417608+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.417608+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:56:22.796522+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"30'3","reported_seq":43,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.497435+0000","last_change":"2024-02-21T07:58:32.497466+0000","last_active":"2024-02-21T07:58:32.497435+0000","last_peered":"2024-02-21T07:58:32.497435+0000","last_clean":"2024-02-21T07:58:32.497435+0000","last_became_active":"2024-02-21T07:45:25.232967+0000","last_became_peered":"2024-02-21T07:45:25.232967+0000","last_unstale":"2024-02-21T07:58:32.497435+0000","last_undegraded":"2024-02-21T07:58:32.497435+0000","last_fullsized":"2024-02-21T07:58:32.497435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-02-21T07:58:32.497350+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-02-21T07:58:32.497350+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.497350+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:54.511490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"30'2237","reported_seq":2288,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.863045+0000","last_change":"2024-02-21T07:58:34.863116+0000","last_active":"2024-02-21T07:58:34.863045+0000","last_peered":"2024-02-21T07:58:34.863045+0000","last_clean":"2024-02-21T07:58:34.863045+0000","last_became_active":"2024-02-21T07:45:30.328446+0000","last_became_peered":"2024-02-21T07:45:30.328446+0000","last_unstale":"2024-02-21T07:58:34.863045+0000","last_undegraded":"2024-02-21T07:58:34.863045+0000","last_fullsized":"2024-02-21T07:58:34.863045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2237","last_scrub_stamp":"2024-02-21T07:58:34.862855+0000","last_deep_scrub":"30'2237","last_deep_scrub_stamp":"2024-02-21T07:58:34.862855+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.862855+0000","objects_scrubbed":1,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:55.723538+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":24168,"num_write_kb":6241728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"30'21","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.251330+0000","last_change":"2024-02-21T07:58:32.251355+0000","last_active":"2024-02-21T07:58:32.251330+0000","last_peered":"2024-02-21T07:58:32.251330+0000","last_clean":"2024-02-21T07:58:32.251330+0000","last_became_active":"2024-02-21T07:45:26.264927+0000","last_became_peered":"2024-02-21T07:45:26.264927+0000","last_unstale":"2024-02-21T07:58:32.251330+0000","last_undegraded":"2024-02-21T07:58:32.251330+0000","last_fullsized":"2024-02-21T07:58:32.251330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-02-21T07:58:32.251247+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-02-21T07:58:32.251247+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.251247+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:23:53.092603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"30'11","reported_seq":830,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:47.473622+0000","last_change":"2024-02-21T07:58:30.995689+0000","last_active":"2024-02-21T07:58:47.473622+0000","last_peered":"2024-02-21T07:58:47.473622+0000","last_clean":"2024-02-21T07:58:47.473622+0000","last_became_active":"2024-02-21T07:45:25.225472+0000","last_became_peered":"2024-02-21T07:45:25.225472+0000","last_unstale":"2024-02-21T07:58:47.473622+0000","last_undegraded":"2024-02-21T07:58:47.473622+0000","last_fullsized":"2024-02-21T07:58:47.473622+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'11","last_scrub_stamp":"2024-02-21T07:58:30.995493+0000","last_deep_scrub":"30'11","last_deep_scrub_stamp":"2024-02-21T07:58:30.995493+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.995493+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:50:38.596529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":779,"num_read_kb":779,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"30'2195","reported_seq":2227,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.062560+0000","last_change":"2024-02-21T07:58:36.062696+0000","last_active":"2024-02-21T07:58:36.062560+0000","last_peered":"2024-02-21T07:58:36.062560+0000","last_clean":"2024-02-21T07:58:36.062560+0000","last_became_active":"2024-02-21T07:45:30.310663+0000","last_became_peered":"2024-02-21T07:45:30.310663+0000","last_unstale":"2024-02-21T07:58:36.062560+0000","last_undegraded":"2024-02-21T07:58:36.062560+0000","last_fullsized":"2024-02-21T07:58:36.062560+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2195","last_scrub_stamp":"2024-02-21T07:58:36.062363+0000","last_deep_scrub":"30'2195","last_deep_scrub_stamp":"2024-02-21T07:58:36.062363+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.062363+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:11:31.216441+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23586,"num_write_kb":6089984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1963","reported_seq":1996,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.513959+0000","last_change":"2024-02-21T07:58:33.514024+0000","last_active":"2024-02-21T07:58:33.513959+0000","last_peered":"2024-02-21T07:58:33.513959+0000","last_clean":"2024-02-21T07:58:33.513959+0000","last_became_active":"2024-02-21T07:45:30.321951+0000","last_became_peered":"2024-02-21T07:45:30.321951+0000","last_unstale":"2024-02-21T07:58:33.513959+0000","last_undegraded":"2024-02-21T07:58:33.513959+0000","last_fullsized":"2024-02-21T07:58:33.513959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1963","last_scrub_stamp":"2024-02-21T07:58:33.513735+0000","last_deep_scrub":"30'1963","last_deep_scrub_stamp":"2024-02-21T07:58:33.513735+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.513735+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:39.708233+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21157,"num_write_kb":5478016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"30'21","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.860098+0000","last_change":"2024-02-21T07:58:31.860153+0000","last_active":"2024-02-21T07:58:31.860098+0000","last_peered":"2024-02-21T07:58:31.860098+0000","last_clean":"2024-02-21T07:58:31.860098+0000","last_became_active":"2024-02-21T07:45:26.275503+0000","last_became_peered":"2024-02-21T07:45:26.275503+0000","last_unstale":"2024-02-21T07:58:31.860098+0000","last_undegraded":"2024-02-21T07:58:31.860098+0000","last_fullsized":"2024-02-21T07:58:31.860098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-02-21T07:58:31.859924+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-02-21T07:58:31.859924+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.859924+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:53:22.505668+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"28'1","reported_seq":41,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.285388+0000","last_change":"2024-02-21T07:58:33.285416+0000","last_active":"2024-02-21T07:58:33.285388+0000","last_peered":"2024-02-21T07:58:33.285388+0000","last_clean":"2024-02-21T07:58:33.285388+0000","last_became_active":"2024-02-21T07:45:25.233015+0000","last_became_peered":"2024-02-21T07:45:25.233015+0000","last_unstale":"2024-02-21T07:58:33.285388+0000","last_undegraded":"2024-02-21T07:58:33.285388+0000","last_fullsized":"2024-02-21T07:58:33.285388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-02-21T07:58:33.285310+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-02-21T07:58:33.285310+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.285310+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:08:43.431753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'2123","reported_seq":2156,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.005152+0000","last_change":"2024-02-21T07:58:41.005181+0000","last_active":"2024-02-21T07:58:41.005152+0000","last_peered":"2024-02-21T07:58:41.005152+0000","last_clean":"2024-02-21T07:58:41.005152+0000","last_became_active":"2024-02-21T07:45:30.332681+0000","last_became_peered":"2024-02-21T07:45:30.332681+0000","last_unstale":"2024-02-21T07:58:41.005152+0000","last_undegraded":"2024-02-21T07:58:41.005152+0000","last_fullsized":"2024-02-21T07:58:41.005152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2123","last_scrub_stamp":"2024-02-21T07:58:41.005061+0000","last_deep_scrub":"30'2123","last_deep_scrub_stamp":"2024-02-21T07:58:41.005061+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.005061+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:47.199559+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22656,"num_write_kb":5874432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:28.102087+0000","last_change":"2024-02-21T07:58:28.102129+0000","last_active":"2024-02-21T07:58:28.102087+0000","last_peered":"2024-02-21T07:58:28.102087+0000","last_clean":"2024-02-21T07:58:28.102087+0000","last_became_active":"2024-02-21T07:45:26.261236+0000","last_became_peered":"2024-02-21T07:45:26.261236+0000","last_unstale":"2024-02-21T07:58:28.102087+0000","last_undegraded":"2024-02-21T07:58:28.102087+0000","last_fullsized":"2024-02-21T07:58:28.102087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:28.101969+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:28.101969+0000","last_clean_scrub_stamp":"2024-02-21T07:58:28.101969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:14.224743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"30'7","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:26.630720+0000","last_change":"2024-02-21T07:58:26.630770+0000","last_active":"2024-02-21T07:58:26.630720+0000","last_peered":"2024-02-21T07:58:26.630720+0000","last_clean":"2024-02-21T07:58:26.630720+0000","last_became_active":"2024-02-21T07:45:25.228283+0000","last_became_peered":"2024-02-21T07:45:25.228283+0000","last_unstale":"2024-02-21T07:58:26.630720+0000","last_undegraded":"2024-02-21T07:58:26.630720+0000","last_fullsized":"2024-02-21T07:58:26.630720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'7","last_scrub_stamp":"2024-02-21T07:58:26.630621+0000","last_deep_scrub":"30'7","last_deep_scrub_stamp":"2024-02-21T07:58:26.630621+0000","last_clean_scrub_stamp":"2024-02-21T07:58:26.630621+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:38.979198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"30'4","reported_seq":44,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.950808+0000","last_change":"2024-02-21T07:58:29.950847+0000","last_active":"2024-02-21T07:58:29.950808+0000","last_peered":"2024-02-21T07:58:29.950808+0000","last_clean":"2024-02-21T07:58:29.950808+0000","last_became_active":"2024-02-21T07:45:25.224873+0000","last_became_peered":"2024-02-21T07:45:25.224873+0000","last_unstale":"2024-02-21T07:58:29.950808+0000","last_undegraded":"2024-02-21T07:58:29.950808+0000","last_fullsized":"2024-02-21T07:58:29.950808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-02-21T07:58:29.950715+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-02-21T07:58:29.950715+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.950715+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:23:59.643005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"30'20","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.404924+0000","last_change":"2024-02-21T07:58:37.404952+0000","last_active":"2024-02-21T07:58:37.404924+0000","last_peered":"2024-02-21T07:58:37.404924+0000","last_clean":"2024-02-21T07:58:37.404924+0000","last_became_active":"2024-02-21T07:45:26.262679+0000","last_became_peered":"2024-02-21T07:45:26.262679+0000","last_unstale":"2024-02-21T07:58:37.404924+0000","last_undegraded":"2024-02-21T07:58:37.404924+0000","last_fullsized":"2024-02-21T07:58:37.404924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'20","last_scrub_stamp":"2024-02-21T07:58:37.404828+0000","last_deep_scrub":"30'20","last_deep_scrub_stamp":"2024-02-21T07:58:37.404828+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.404828+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:31:17.803456+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2454","reported_seq":2486,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:40.224001+0000","last_change":"2024-02-21T07:58:40.224031+0000","last_active":"2024-02-21T07:58:40.224001+0000","last_peered":"2024-02-21T07:58:40.224001+0000","last_clean":"2024-02-21T07:58:40.224001+0000","last_became_active":"2024-02-21T07:45:30.327436+0000","last_became_peered":"2024-02-21T07:45:30.327436+0000","last_unstale":"2024-02-21T07:58:40.224001+0000","last_undegraded":"2024-02-21T07:58:40.224001+0000","last_fullsized":"2024-02-21T07:58:40.224001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2454","last_scrub_stamp":"2024-02-21T07:58:40.223895+0000","last_deep_scrub":"30'2454","last_deep_scrub_stamp":"2024-02-21T07:58:40.223895+0000","last_clean_scrub_stamp":"2024-02-21T07:58:40.223895+0000","objects_scrubbed":0,"log_size":2454,"log_dups_size":0,"ondisk_log_size":2454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:11:35.377972+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26408,"num_write_kb":6832640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"30'386","reported_seq":1628,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:48.475982+0000","last_change":"2024-02-21T07:58:32.279994+0000","last_active":"2024-02-21T07:58:48.475982+0000","last_peered":"2024-02-21T07:58:48.475982+0000","last_clean":"2024-02-21T07:58:48.475982+0000","last_became_active":"2024-02-21T07:45:25.225285+0000","last_became_peered":"2024-02-21T07:45:25.225285+0000","last_unstale":"2024-02-21T07:58:48.475982+0000","last_undegraded":"2024-02-21T07:58:48.475982+0000","last_fullsized":"2024-02-21T07:58:48.475982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'386","last_scrub_stamp":"2024-02-21T07:58:32.279855+0000","last_deep_scrub":"30'386","last_deep_scrub_stamp":"2024-02-21T07:58:32.279855+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.279855+0000","objects_scrubbed":3,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:30:54.229192+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3066758,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1202,"num_read_kb":3043,"num_write":382,"num_write_kb":3195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"30'14","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.969257+0000","last_change":"2024-02-21T07:58:39.969282+0000","last_active":"2024-02-21T07:58:39.969257+0000","last_peered":"2024-02-21T07:58:39.969257+0000","last_clean":"2024-02-21T07:58:39.969257+0000","last_became_active":"2024-02-21T07:45:26.279771+0000","last_became_peered":"2024-02-21T07:45:26.279771+0000","last_unstale":"2024-02-21T07:58:39.969257+0000","last_undegraded":"2024-02-21T07:58:39.969257+0000","last_fullsized":"2024-02-21T07:58:39.969257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:39.969180+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:39.969180+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.969180+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:31:20.367808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2254","reported_seq":2303,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:39.253411+0000","last_change":"2024-02-21T07:58:39.253439+0000","last_active":"2024-02-21T07:58:39.253411+0000","last_peered":"2024-02-21T07:58:39.253411+0000","last_clean":"2024-02-21T07:58:39.253411+0000","last_became_active":"2024-02-21T07:45:30.308815+0000","last_became_peered":"2024-02-21T07:45:30.308815+0000","last_unstale":"2024-02-21T07:58:39.253411+0000","last_undegraded":"2024-02-21T07:58:39.253411+0000","last_fullsized":"2024-02-21T07:58:39.253411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2254","last_scrub_stamp":"2024-02-21T07:58:39.253272+0000","last_deep_scrub":"30'2254","last_deep_scrub_stamp":"2024-02-21T07:58:39.253272+0000","last_clean_scrub_stamp":"2024-02-21T07:58:39.253272+0000","objects_scrubbed":0,"log_size":2254,"log_dups_size":0,"ondisk_log_size":2254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:14:00.858277+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":24317,"num_write_kb":6228160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"30'19","reported_seq":58,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.926816+0000","last_change":"2024-02-21T07:58:32.926867+0000","last_active":"2024-02-21T07:58:32.926816+0000","last_peered":"2024-02-21T07:58:32.926816+0000","last_clean":"2024-02-21T07:58:32.926816+0000","last_became_active":"2024-02-21T07:45:26.260846+0000","last_became_peered":"2024-02-21T07:45:26.260846+0000","last_unstale":"2024-02-21T07:58:32.926816+0000","last_undegraded":"2024-02-21T07:58:32.926816+0000","last_fullsized":"2024-02-21T07:58:32.926816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-02-21T07:58:32.926712+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-02-21T07:58:32.926712+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.926712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:46:22.201866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"30'23","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:37.224369+0000","last_change":"2024-02-21T07:58:37.224398+0000","last_active":"2024-02-21T07:58:37.224369+0000","last_peered":"2024-02-21T07:58:37.224369+0000","last_clean":"2024-02-21T07:58:37.224369+0000","last_became_active":"2024-02-21T07:45:26.264456+0000","last_became_peered":"2024-02-21T07:45:26.264456+0000","last_unstale":"2024-02-21T07:58:37.224369+0000","last_undegraded":"2024-02-21T07:58:37.224369+0000","last_fullsized":"2024-02-21T07:58:37.224369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-02-21T07:58:37.224245+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-02-21T07:58:37.224245+0000","last_clean_scrub_stamp":"2024-02-21T07:58:37.224245+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:12:31.052634+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"30'25","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.212047+0000","last_change":"2024-02-21T07:58:34.212080+0000","last_active":"2024-02-21T07:58:34.212047+0000","last_peered":"2024-02-21T07:58:34.212047+0000","last_clean":"2024-02-21T07:58:34.212047+0000","last_became_active":"2024-02-21T07:45:26.258158+0000","last_became_peered":"2024-02-21T07:45:26.258158+0000","last_unstale":"2024-02-21T07:58:34.212047+0000","last_undegraded":"2024-02-21T07:58:34.212047+0000","last_fullsized":"2024-02-21T07:58:34.212047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'25","last_scrub_stamp":"2024-02-21T07:58:34.211925+0000","last_deep_scrub":"30'25","last_deep_scrub_stamp":"2024-02-21T07:58:34.211925+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.211925+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:56.226065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"30'14","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.440291+0000","last_change":"2024-02-21T07:58:29.440346+0000","last_active":"2024-02-21T07:58:29.440291+0000","last_peered":"2024-02-21T07:58:29.440291+0000","last_clean":"2024-02-21T07:58:29.440291+0000","last_became_active":"2024-02-21T07:45:26.280483+0000","last_became_peered":"2024-02-21T07:45:26.280483+0000","last_unstale":"2024-02-21T07:58:29.440291+0000","last_undegraded":"2024-02-21T07:58:29.440291+0000","last_fullsized":"2024-02-21T07:58:29.440291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:29.440121+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:29.440121+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.440121+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:15.562896+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"30'9","reported_seq":47,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.648254+0000","last_change":"2024-02-21T07:58:31.648276+0000","last_active":"2024-02-21T07:58:31.648254+0000","last_peered":"2024-02-21T07:58:31.648254+0000","last_clean":"2024-02-21T07:58:31.648254+0000","last_became_active":"2024-02-21T07:45:26.261883+0000","last_became_peered":"2024-02-21T07:45:26.261883+0000","last_unstale":"2024-02-21T07:58:31.648254+0000","last_undegraded":"2024-02-21T07:58:31.648254+0000","last_fullsized":"2024-02-21T07:58:31.648254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'9","last_scrub_stamp":"2024-02-21T07:58:31.648187+0000","last_deep_scrub":"30'9","last_deep_scrub_stamp":"2024-02-21T07:58:31.648187+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.648187+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:42:52.508870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"30'13","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.911928+0000","last_change":"2024-02-21T07:58:36.911953+0000","last_active":"2024-02-21T07:58:36.911928+0000","last_peered":"2024-02-21T07:58:36.911928+0000","last_clean":"2024-02-21T07:58:36.911928+0000","last_became_active":"2024-02-21T07:45:26.265170+0000","last_became_peered":"2024-02-21T07:45:26.265170+0000","last_unstale":"2024-02-21T07:58:36.911928+0000","last_undegraded":"2024-02-21T07:58:36.911928+0000","last_fullsized":"2024-02-21T07:58:36.911928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'13","last_scrub_stamp":"2024-02-21T07:58:36.911834+0000","last_deep_scrub":"30'13","last_deep_scrub_stamp":"2024-02-21T07:58:36.911834+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.911834+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:34:23.034609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"30'23","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.191701+0000","last_change":"2024-02-21T07:58:36.191727+0000","last_active":"2024-02-21T07:58:36.191701+0000","last_peered":"2024-02-21T07:58:36.191701+0000","last_clean":"2024-02-21T07:58:36.191701+0000","last_became_active":"2024-02-21T07:45:26.262945+0000","last_became_peered":"2024-02-21T07:45:26.262945+0000","last_unstale":"2024-02-21T07:58:36.191701+0000","last_undegraded":"2024-02-21T07:58:36.191701+0000","last_fullsized":"2024-02-21T07:58:36.191701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'23","last_scrub_stamp":"2024-02-21T07:58:36.191614+0000","last_deep_scrub":"30'23","last_deep_scrub_stamp":"2024-02-21T07:58:36.191614+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.191614+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:06:57.968047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"30'12","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.953444+0000","last_change":"2024-02-21T07:58:31.953488+0000","last_active":"2024-02-21T07:58:31.953444+0000","last_peered":"2024-02-21T07:58:31.953444+0000","last_clean":"2024-02-21T07:58:31.953444+0000","last_became_active":"2024-02-21T07:45:26.268562+0000","last_became_peered":"2024-02-21T07:45:26.268562+0000","last_unstale":"2024-02-21T07:58:31.953444+0000","last_undegraded":"2024-02-21T07:58:31.953444+0000","last_fullsized":"2024-02-21T07:58:31.953444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'12","last_scrub_stamp":"2024-02-21T07:58:31.953349+0000","last_deep_scrub":"30'12","last_deep_scrub_stamp":"2024-02-21T07:58:31.953349+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.953349+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:38.147847+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"30'14","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:40.462492+0000","last_change":"2024-02-21T07:58:40.462543+0000","last_active":"2024-02-21T07:58:40.462492+0000","last_peered":"2024-02-21T07:58:40.462492+0000","last_clean":"2024-02-21T07:58:40.462492+0000","last_became_active":"2024-02-21T07:45:26.279469+0000","last_became_peered":"2024-02-21T07:45:26.279469+0000","last_unstale":"2024-02-21T07:58:40.462492+0000","last_undegraded":"2024-02-21T07:58:40.462492+0000","last_fullsized":"2024-02-21T07:58:40.462492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:40.462397+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:40.462397+0000","last_clean_scrub_stamp":"2024-02-21T07:58:40.462397+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:38:40.602001+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"30'18","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.035795+0000","last_change":"2024-02-21T07:58:30.035837+0000","last_active":"2024-02-21T07:58:30.035795+0000","last_peered":"2024-02-21T07:58:30.035795+0000","last_clean":"2024-02-21T07:58:30.035795+0000","last_became_active":"2024-02-21T07:45:26.266906+0000","last_became_peered":"2024-02-21T07:45:26.266906+0000","last_unstale":"2024-02-21T07:58:30.035795+0000","last_undegraded":"2024-02-21T07:58:30.035795+0000","last_fullsized":"2024-02-21T07:58:30.035795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:30.035661+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:30.035661+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.035661+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:22.610717+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.281734+0000","last_change":"2024-02-21T07:58:31.281759+0000","last_active":"2024-02-21T07:58:31.281734+0000","last_peered":"2024-02-21T07:58:31.281734+0000","last_clean":"2024-02-21T07:58:31.281734+0000","last_became_active":"2024-02-21T07:45:26.266270+0000","last_became_peered":"2024-02-21T07:45:26.266270+0000","last_unstale":"2024-02-21T07:58:31.281734+0000","last_undegraded":"2024-02-21T07:58:31.281734+0000","last_fullsized":"2024-02-21T07:58:31.281734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:31.281653+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:31.281653+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.281653+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:44.714125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"30'22","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.693404+0000","last_change":"2024-02-21T07:58:34.693466+0000","last_active":"2024-02-21T07:58:34.693404+0000","last_peered":"2024-02-21T07:58:34.693404+0000","last_clean":"2024-02-21T07:58:34.693404+0000","last_became_active":"2024-02-21T07:45:26.272036+0000","last_became_peered":"2024-02-21T07:45:26.272036+0000","last_unstale":"2024-02-21T07:58:34.693404+0000","last_undegraded":"2024-02-21T07:58:34.693404+0000","last_fullsized":"2024-02-21T07:58:34.693404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'22","last_scrub_stamp":"2024-02-21T07:58:34.693206+0000","last_deep_scrub":"30'22","last_deep_scrub_stamp":"2024-02-21T07:58:34.693206+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.693206+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:36:12.229939+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"30'19","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.948213+0000","last_change":"2024-02-21T07:58:33.948241+0000","last_active":"2024-02-21T07:58:33.948213+0000","last_peered":"2024-02-21T07:58:33.948213+0000","last_clean":"2024-02-21T07:58:33.948213+0000","last_became_active":"2024-02-21T07:45:26.262024+0000","last_became_peered":"2024-02-21T07:45:26.262024+0000","last_unstale":"2024-02-21T07:58:33.948213+0000","last_undegraded":"2024-02-21T07:58:33.948213+0000","last_fullsized":"2024-02-21T07:58:33.948213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-02-21T07:58:33.948129+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-02-21T07:58:33.948129+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.948129+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:56:30.327043+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"30'14","reported_seq":51,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.176484+0000","last_change":"2024-02-21T07:58:35.176511+0000","last_active":"2024-02-21T07:58:35.176484+0000","last_peered":"2024-02-21T07:58:35.176484+0000","last_clean":"2024-02-21T07:58:35.176484+0000","last_became_active":"2024-02-21T07:45:26.258986+0000","last_became_peered":"2024-02-21T07:45:26.258986+0000","last_unstale":"2024-02-21T07:58:35.176484+0000","last_undegraded":"2024-02-21T07:58:35.176484+0000","last_fullsized":"2024-02-21T07:58:35.176484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:35.176395+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:35.176395+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.176395+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:27.751451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"30'21","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.908869+0000","last_change":"2024-02-21T07:58:30.908986+0000","last_active":"2024-02-21T07:58:30.908869+0000","last_peered":"2024-02-21T07:58:30.908869+0000","last_clean":"2024-02-21T07:58:30.908869+0000","last_became_active":"2024-02-21T07:45:26.274089+0000","last_became_peered":"2024-02-21T07:45:26.274089+0000","last_unstale":"2024-02-21T07:58:30.908869+0000","last_undegraded":"2024-02-21T07:58:30.908869+0000","last_fullsized":"2024-02-21T07:58:30.908869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-02-21T07:58:30.908632+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-02-21T07:58:30.908632+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.908632+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:08:43.257208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.941187+0000","last_change":"2024-02-21T07:58:35.941213+0000","last_active":"2024-02-21T07:58:35.941187+0000","last_peered":"2024-02-21T07:58:35.941187+0000","last_clean":"2024-02-21T07:58:35.941187+0000","last_became_active":"2024-02-21T07:45:26.263220+0000","last_became_peered":"2024-02-21T07:45:26.263220+0000","last_unstale":"2024-02-21T07:58:35.941187+0000","last_undegraded":"2024-02-21T07:58:35.941187+0000","last_fullsized":"2024-02-21T07:58:35.941187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:35.941060+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:35.941060+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.941060+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T10:23:56.782416+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:33.243733+0000","last_change":"2024-02-21T07:58:33.243779+0000","last_active":"2024-02-21T07:58:33.243733+0000","last_peered":"2024-02-21T07:58:33.243733+0000","last_clean":"2024-02-21T07:58:33.243733+0000","last_became_active":"2024-02-21T07:45:26.267495+0000","last_became_peered":"2024-02-21T07:45:26.267495+0000","last_unstale":"2024-02-21T07:58:33.243733+0000","last_undegraded":"2024-02-21T07:58:33.243733+0000","last_fullsized":"2024-02-21T07:58:33.243733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:33.243622+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:33.243622+0000","last_clean_scrub_stamp":"2024-02-21T07:58:33.243622+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:53:23.889365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.455908+0000","last_change":"2024-02-21T07:58:31.455953+0000","last_active":"2024-02-21T07:58:31.455908+0000","last_peered":"2024-02-21T07:58:31.455908+0000","last_clean":"2024-02-21T07:58:31.455908+0000","last_became_active":"2024-02-21T07:45:26.278457+0000","last_became_peered":"2024-02-21T07:45:26.278457+0000","last_unstale":"2024-02-21T07:58:31.455908+0000","last_undegraded":"2024-02-21T07:58:31.455908+0000","last_fullsized":"2024-02-21T07:58:31.455908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:31.455775+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:31.455775+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.455775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:08:41.602217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:25.423969+0000","last_change":"2024-02-21T07:58:25.424008+0000","last_active":"2024-02-21T07:58:25.423969+0000","last_peered":"2024-02-21T07:58:25.423969+0000","last_clean":"2024-02-21T07:58:25.423969+0000","last_became_active":"2024-02-21T07:45:26.276846+0000","last_became_peered":"2024-02-21T07:45:26.276846+0000","last_unstale":"2024-02-21T07:58:25.423969+0000","last_undegraded":"2024-02-21T07:58:25.423969+0000","last_fullsized":"2024-02-21T07:58:25.423969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:25.423864+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:25.423864+0000","last_clean_scrub_stamp":"2024-02-21T07:58:25.423864+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:46:14.699018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"30'15","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.687268+0000","last_change":"2024-02-21T07:58:30.687291+0000","last_active":"2024-02-21T07:58:30.687268+0000","last_peered":"2024-02-21T07:58:30.687268+0000","last_clean":"2024-02-21T07:58:30.687268+0000","last_became_active":"2024-02-21T07:45:26.259546+0000","last_became_peered":"2024-02-21T07:45:26.259546+0000","last_unstale":"2024-02-21T07:58:30.687268+0000","last_undegraded":"2024-02-21T07:58:30.687268+0000","last_fullsized":"2024-02-21T07:58:30.687268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:30.687184+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:30.687184+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.687184+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:10:23.262241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"30'14","reported_seq":52,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:31.808715+0000","last_change":"2024-02-21T07:58:31.808763+0000","last_active":"2024-02-21T07:58:31.808715+0000","last_peered":"2024-02-21T07:58:31.808715+0000","last_clean":"2024-02-21T07:58:31.808715+0000","last_became_active":"2024-02-21T07:45:26.262526+0000","last_became_peered":"2024-02-21T07:45:26.262526+0000","last_unstale":"2024-02-21T07:58:31.808715+0000","last_undegraded":"2024-02-21T07:58:31.808715+0000","last_fullsized":"2024-02-21T07:58:31.808715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'14","last_scrub_stamp":"2024-02-21T07:58:31.808620+0000","last_deep_scrub":"30'14","last_deep_scrub_stamp":"2024-02-21T07:58:31.808620+0000","last_clean_scrub_stamp":"2024-02-21T07:58:31.808620+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:53.822761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:35.426120+0000","last_change":"2024-02-21T07:58:35.426185+0000","last_active":"2024-02-21T07:58:35.426120+0000","last_peered":"2024-02-21T07:58:35.426120+0000","last_clean":"2024-02-21T07:58:35.426120+0000","last_became_active":"2024-02-21T07:45:26.263229+0000","last_became_peered":"2024-02-21T07:45:26.263229+0000","last_unstale":"2024-02-21T07:58:35.426120+0000","last_undegraded":"2024-02-21T07:58:35.426120+0000","last_fullsized":"2024-02-21T07:58:35.426120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:35.426032+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:35.426032+0000","last_clean_scrub_stamp":"2024-02-21T07:58:35.426032+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:41.620530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"30'24","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.971397+0000","last_change":"2024-02-21T07:58:32.971429+0000","last_active":"2024-02-21T07:58:32.971397+0000","last_peered":"2024-02-21T07:58:32.971397+0000","last_clean":"2024-02-21T07:58:32.971397+0000","last_became_active":"2024-02-21T07:45:26.260737+0000","last_became_peered":"2024-02-21T07:45:26.260737+0000","last_unstale":"2024-02-21T07:58:32.971397+0000","last_undegraded":"2024-02-21T07:58:32.971397+0000","last_fullsized":"2024-02-21T07:58:32.971397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'24","last_scrub_stamp":"2024-02-21T07:58:32.971280+0000","last_deep_scrub":"30'24","last_deep_scrub_stamp":"2024-02-21T07:58:32.971280+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.971280+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:37:49.162798+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"30'21","reported_seq":59,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.211637+0000","last_change":"2024-02-21T07:58:34.211663+0000","last_active":"2024-02-21T07:58:34.211637+0000","last_peered":"2024-02-21T07:58:34.211637+0000","last_clean":"2024-02-21T07:58:34.211637+0000","last_became_active":"2024-02-21T07:45:26.268567+0000","last_became_peered":"2024-02-21T07:45:26.268567+0000","last_unstale":"2024-02-21T07:58:34.211637+0000","last_undegraded":"2024-02-21T07:58:34.211637+0000","last_fullsized":"2024-02-21T07:58:34.211637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'21","last_scrub_stamp":"2024-02-21T07:58:34.211530+0000","last_deep_scrub":"30'21","last_deep_scrub_stamp":"2024-02-21T07:58:34.211530+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.211530+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:33:51.531492+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"30'16","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:29.078461+0000","last_change":"2024-02-21T07:58:29.078487+0000","last_active":"2024-02-21T07:58:29.078461+0000","last_peered":"2024-02-21T07:58:29.078461+0000","last_clean":"2024-02-21T07:58:29.078461+0000","last_became_active":"2024-02-21T07:45:26.265731+0000","last_became_peered":"2024-02-21T07:45:26.265731+0000","last_unstale":"2024-02-21T07:58:29.078461+0000","last_undegraded":"2024-02-21T07:58:29.078461+0000","last_fullsized":"2024-02-21T07:58:29.078461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'16","last_scrub_stamp":"2024-02-21T07:58:29.078386+0000","last_deep_scrub":"30'16","last_deep_scrub_stamp":"2024-02-21T07:58:29.078386+0000","last_clean_scrub_stamp":"2024-02-21T07:58:29.078386+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:51.092527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'19","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:40.380926+0000","last_change":"2024-02-21T07:58:40.380951+0000","last_active":"2024-02-21T07:58:40.380926+0000","last_peered":"2024-02-21T07:58:40.380926+0000","last_clean":"2024-02-21T07:58:40.380926+0000","last_became_active":"2024-02-21T07:45:26.279643+0000","last_became_peered":"2024-02-21T07:45:26.279643+0000","last_unstale":"2024-02-21T07:58:40.380926+0000","last_undegraded":"2024-02-21T07:58:40.380926+0000","last_fullsized":"2024-02-21T07:58:40.380926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'19","last_scrub_stamp":"2024-02-21T07:58:40.380835+0000","last_deep_scrub":"30'19","last_deep_scrub_stamp":"2024-02-21T07:58:40.380835+0000","last_clean_scrub_stamp":"2024-02-21T07:58:40.380835+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:44:07.759468+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"30'15","reported_seq":53,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:36.010301+0000","last_change":"2024-02-21T07:58:36.010349+0000","last_active":"2024-02-21T07:58:36.010301+0000","last_peered":"2024-02-21T07:58:36.010301+0000","last_clean":"2024-02-21T07:58:36.010301+0000","last_became_active":"2024-02-21T07:45:26.279563+0000","last_became_peered":"2024-02-21T07:45:26.279563+0000","last_unstale":"2024-02-21T07:58:36.010301+0000","last_undegraded":"2024-02-21T07:58:36.010301+0000","last_fullsized":"2024-02-21T07:58:36.010301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:36.010210+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:36.010210+0000","last_clean_scrub_stamp":"2024-02-21T07:58:36.010210+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:53:26.655953+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"30'10","reported_seq":48,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:41.002231+0000","last_change":"2024-02-21T07:58:41.002261+0000","last_active":"2024-02-21T07:58:41.002231+0000","last_peered":"2024-02-21T07:58:41.002231+0000","last_clean":"2024-02-21T07:58:41.002231+0000","last_became_active":"2024-02-21T07:45:26.283270+0000","last_became_peered":"2024-02-21T07:45:26.283270+0000","last_unstale":"2024-02-21T07:58:41.002231+0000","last_undegraded":"2024-02-21T07:58:41.002231+0000","last_fullsized":"2024-02-21T07:58:41.002231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'10","last_scrub_stamp":"2024-02-21T07:58:41.002123+0000","last_deep_scrub":"30'10","last_deep_scrub_stamp":"2024-02-21T07:58:41.002123+0000","last_clean_scrub_stamp":"2024-02-21T07:58:41.002123+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:04:02.704437+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:32.790810+0000","last_change":"2024-02-21T07:58:32.790851+0000","last_active":"2024-02-21T07:58:32.790810+0000","last_peered":"2024-02-21T07:58:32.790810+0000","last_clean":"2024-02-21T07:58:32.790810+0000","last_became_active":"2024-02-21T07:45:26.263953+0000","last_became_peered":"2024-02-21T07:45:26.263953+0000","last_unstale":"2024-02-21T07:58:32.790810+0000","last_undegraded":"2024-02-21T07:58:32.790810+0000","last_fullsized":"2024-02-21T07:58:32.790810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:32.790689+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:32.790689+0000","last_clean_scrub_stamp":"2024-02-21T07:58:32.790689+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:08:42.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"30'15","reported_seq":54,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:27.427715+0000","last_change":"2024-02-21T07:58:27.427778+0000","last_active":"2024-02-21T07:58:27.427715+0000","last_peered":"2024-02-21T07:58:27.427715+0000","last_clean":"2024-02-21T07:58:27.427715+0000","last_became_active":"2024-02-21T07:45:26.279158+0000","last_became_peered":"2024-02-21T07:45:26.279158+0000","last_unstale":"2024-02-21T07:58:27.427715+0000","last_undegraded":"2024-02-21T07:58:27.427715+0000","last_fullsized":"2024-02-21T07:58:27.427715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'15","last_scrub_stamp":"2024-02-21T07:58:27.427606+0000","last_deep_scrub":"30'15","last_deep_scrub_stamp":"2024-02-21T07:58:27.427606+0000","last_clean_scrub_stamp":"2024-02-21T07:58:27.427606+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:40.860078+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"30'18","reported_seq":57,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:30.409596+0000","last_change":"2024-02-21T07:58:30.409638+0000","last_active":"2024-02-21T07:58:30.409596+0000","last_peered":"2024-02-21T07:58:30.409596+0000","last_clean":"2024-02-21T07:58:30.409596+0000","last_became_active":"2024-02-21T07:45:26.279739+0000","last_became_peered":"2024-02-21T07:45:26.279739+0000","last_unstale":"2024-02-21T07:58:30.409596+0000","last_undegraded":"2024-02-21T07:58:30.409596+0000","last_fullsized":"2024-02-21T07:58:30.409596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'18","last_scrub_stamp":"2024-02-21T07:58:30.409489+0000","last_deep_scrub":"30'18","last_deep_scrub_stamp":"2024-02-21T07:58:30.409489+0000","last_clean_scrub_stamp":"2024-02-21T07:58:30.409489+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:29:52.423629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"30'17","reported_seq":56,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-02-21T07:58:34.942424+0000","last_change":"2024-02-21T07:58:34.942452+0000","last_active":"2024-02-21T07:58:34.942424+0000","last_peered":"2024-02-21T07:58:34.942424+0000","last_clean":"2024-02-21T07:58:34.942424+0000","last_became_active":"2024-02-21T07:45:26.262559+0000","last_became_peered":"2024-02-21T07:45:26.262559+0000","last_unstale":"2024-02-21T07:58:34.942424+0000","last_undegraded":"2024-02-21T07:58:34.942424+0000","last_fullsized":"2024-02-21T07:58:34.942424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'17","last_scrub_stamp":"2024-02-21T07:58:34.942316+0000","last_deep_scrub":"30'17","last_deep_scrub_stamp":"2024-02-21T07:58:34.942316+0000","last_clean_scrub_stamp":"2024-02-21T07:58:34.942316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:44:48.374788+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":368,"num_read_kb":368,"num_write":753511,"num_write_kb":194935703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70426,"ondisk_log_size":70426,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1042,"ondisk_log_size":1042,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3072598,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":5510,"num_read_kb":9760,"num_write":2219,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30270,"num_omap_keys":57,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2842624,"data_stored":6145196,"data_compressed":766850,"data_compressed_allocated":1040384,"data_compressed_original":4505600,"omap_allocated":0,"internal_metadata":0},"log_size":1855,"ondisk_log_size":1855,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":67044,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444196,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193860,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94177980,"statfs":{"total":96636764160,"available":96438251520,"internally_reserved":0,"allocated":323584,"data_stored":156860,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1596,"internal_metadata":198179268},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.698,"15min":1.52},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":7.7160000000000002,"5min":18.609999999999999,"15min":41.207999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":1.2310000000000001,"15min":1.2430000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.26600000000000001},"max":{"1min":1.556,"5min":12.308999999999999,"15min":24.315999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.498},"min":{"1min":0.252,"5min":0.252,"15min":0.19900000000000001},"max":{"1min":0.83099999999999996,"5min":1.2669999999999999,"15min":1.9950000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.498},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23300000000000001},"max":{"1min":0.68100000000000005,"5min":1.823,"15min":2.1419999999999999},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.39200000000000002,"15min":0.39400000000000002},"min":{"1min":0.223,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.46700000000000003,"5min":3.089,"15min":3.089},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.438},"min":{"1min":0.29899999999999999,"5min":0.25900000000000001,"15min":0.218},"max":{"1min":0.59099999999999997,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.36699999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.85999999999999999,"5min":1.5880000000000001,"15min":2.0190000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51300000000000001,"15min":0.55000000000000004},"min":{"1min":0.30199999999999999,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":0.76600000000000001,"5min":1.8819999999999999,"15min":3.1059999999999999},"last":0.64500000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.33000000000000002,"5min":0.26100000000000001,"15min":0.222},"max":{"1min":0.85599999999999998,"5min":1.6910000000000001,"15min":2.234},"last":0.437},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54800000000000004,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27200000000000002,"15min":0.249},"max":{"1min":0.753,"5min":7.2640000000000002,"15min":7.2640000000000002},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.6819999999999999,"15min":1.6359999999999999},"min":{"1min":0.41499999999999998,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":2.198,"5min":14.513,"15min":24.452000000000002},"last":0.749},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.702,"15min":1.6930000000000001},"min":{"1min":0.46200000000000002,"5min":0.42599999999999999,"15min":0.378},"max":{"1min":2.2189999999999999,"5min":14.536,"15min":25.504000000000001},"last":1.034}]},{"osd":7,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58399999999999996,"15min":0.63300000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32800000000000001},"max":{"1min":0.80400000000000005,"5min":1.855,"15min":3.1429999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60399999999999998,"15min":0.61399999999999999},"min":{"1min":0.34300000000000003,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":0.81399999999999995,"5min":3.8479999999999999,"15min":3.8479999999999999},"last":0.63}]},{"osd":8,"last update":"Wed Feb 21 07:58:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.439,"5min":0.34399999999999997,"15min":0.309},"max":{"1min":0.86899999999999999,"5min":1.665,"15min":3.0800000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55700000000000005,"15min":0.57899999999999996},"min":{"1min":0.40400000000000003,"5min":0.316,"15min":0.314},"max":{"1min":0.71599999999999997,"5min":1.778,"15min":3.1989999999999998},"last":0.61399999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:58:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.923,"15min":2.1890000000000001},"min":{"1min":0.5,"5min":0.48599999999999999,"15min":0.40600000000000003},"max":{"1min":6.6159999999999997,"5min":11.380000000000001,"15min":102.712},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.804,"15min":1.712},"min":{"1min":0.54800000000000004,"5min":0.53500000000000003,"15min":0.48599999999999999},"max":{"1min":1.0029999999999999,"5min":17.058,"15min":27.137},"last":0.78700000000000003}]},{"osd":10,"last update":"Wed Feb 21 07:58:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.67200000000000004,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.442},"max":{"1min":0.94499999999999995,"5min":1.911,"15min":3.2250000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.66600000000000004,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":3.8980000000000001,"15min":3.8980000000000001},"last":0.77500000000000002}]}]},{"osd":10,"up_from":17,"seq":73014444197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161940,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94209900,"statfs":{"total":96636764160,"available":96470937600,"internally_reserved":0,"allocated":339968,"data_stored":153098,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":165476800},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":1.4650000000000001,"15min":1.274},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.28899999999999998},"max":{"1min":2.419,"5min":18.68,"15min":18.68},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.391,"15min":1.359},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":4.2510000000000003,"5min":9.0079999999999991,"15min":13.788},"last":0.878}]},{"osd":1,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.34200000000000003,"15min":0.34399999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.20999999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.251,"5min":0.22700000000000001,"15min":0.218},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.36399999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.46000000000000002,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.79500000000000004,"5min":1.083,"15min":1.2749999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.48999999999999999,"15min":0.51800000000000002},"min":{"1min":0.34200000000000003,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.77700000000000002,"5min":1.0680000000000001,"15min":1.2629999999999999},"last":0.69799999999999995}]},{"osd":3,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.5720000000000001,"15min":1.4330000000000001},"min":{"1min":0.57299999999999995,"5min":0.39500000000000002,"15min":0.32600000000000001},"max":{"1min":5.5069999999999997,"5min":12.013,"15min":15.042999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":2.363,"15min":1.669},"min":{"1min":0.39900000000000002,"5min":0.35899999999999999,"15min":0.34100000000000003},"max":{"1min":0.83999999999999997,"5min":52.374000000000002,"15min":52.374000000000002},"last":0.64500000000000002}]},{"osd":4,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.436},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23799999999999999},"max":{"1min":0.66000000000000003,"5min":1.4530000000000001,"15min":2.004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.52400000000000002,"15min":0.51500000000000001},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.24399999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.9199999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.745,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.38900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.897},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.371,"5min":0.29799999999999999,"15min":0.27000000000000002},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.45600000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.312,"15min":0.27400000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":1.0509999999999999},"last":0.39300000000000002}]},{"osd":8,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.436,"5min":0.38800000000000001,"15min":0.33800000000000002},"max":{"1min":0.83099999999999996,"5min":1.857,"15min":1.857},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.443,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":1.8660000000000001,"5min":1.958,"15min":1.958},"last":0.621}]},{"osd":9,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":2.347,"15min":1.7709999999999999},"min":{"1min":0.52700000000000002,"5min":0.45900000000000002,"15min":0.42999999999999999},"max":{"1min":6.2629999999999999,"5min":26.867000000000001,"15min":26.867000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.1839999999999999,"5min":2.8330000000000002,"15min":2.581},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":6.492,"5min":21.609000000000002,"15min":60.792000000000002},"last":0.73999999999999999}]},{"osd":11,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71399999999999997,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.44500000000000001,"15min":0.41399999999999998},"max":{"1min":1.8999999999999999,"5min":4.8070000000000004,"15min":4.8070000000000004},"last":0.754},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66500000000000004,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.41299999999999998,"15min":0.39800000000000002},"max":{"1min":0.84299999999999997,"5min":5.8109999999999999,"15min":5.8109999999999999},"last":0.73099999999999998}]}]},{"osd":9,"up_from":17,"seq":73014444197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368780,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":368446,"kb_avail":94003060,"statfs":{"total":96636764160,"available":96259133440,"internally_reserved":0,"allocated":331776,"data_stored":161046,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":377289152},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":3.9039999999999999,"15min":3.9060000000000001},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.5759999999999996,"5min":44.676000000000002,"15min":66.947999999999993},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":3.96,"15min":3.113},"min":{"1min":0.31,"5min":0.31,"15min":0.28299999999999997},"max":{"1min":4.6630000000000003,"5min":31.988,"15min":31.988},"last":1.786}]},{"osd":1,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":2.8330000000000002,"15min":2.2570000000000001},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.33700000000000002},"max":{"1min":9.4169999999999998,"5min":24.472000000000001,"15min":27.088999999999999},"last":1.137},{"interface":"front","average":{"1min":1.1080000000000001,"5min":3.5640000000000001,"15min":3.2749999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.625,"5min":44.505000000000003,"15min":66.670000000000002},"last":1.071}]},{"osd":2,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":2.9399999999999999,"15min":2.3599999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.40400000000000003},"max":{"1min":3.859,"5min":30.081,"15min":30.081},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.5,"5min":3.077,"15min":2.3559999999999999},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":9.4649999999999999,"5min":24.379999999999999,"15min":24.379999999999999},"last":1.7030000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":4.3719999999999999,"15min":4.1139999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.38900000000000001},"max":{"1min":4.702,"5min":44.453000000000003,"15min":66.914000000000001},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.27,"5min":4.3789999999999996,"15min":3.694},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.42699999999999999},"max":{"1min":4.1360000000000001,"5min":30.513999999999999,"15min":30.513999999999999},"last":1.5329999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6259999999999999,"5min":3.1320000000000001,"15min":2.5489999999999999},"min":{"1min":0.45800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":9.5510000000000002,"5min":24.928999999999998,"15min":27.155999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.5509999999999999,"5min":4.0140000000000002,"15min":3.569},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.496},"max":{"1min":6.4420000000000002,"5min":44.542999999999999,"15min":66.802999999999997},"last":1.1779999999999999}]},{"osd":5,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":3.1539999999999999,"15min":2.569},"min":{"1min":0.71499999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.5090000000000003,"5min":24.510000000000002,"15min":26.954000000000001},"last":1.841},{"interface":"front","average":{"1min":1.3320000000000001,"5min":3.335,"15min":2.8180000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":4.0270000000000001,"5min":30.129999999999999,"15min":37.783000000000001},"last":1.3460000000000001}]},{"osd":7,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.583,"5min":4.1820000000000004,"15min":3.6930000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.50800000000000001},"max":{"1min":4.7359999999999998,"5min":44.610999999999997,"15min":66.879000000000005},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.903,"5min":3.4580000000000002,"15min":2.7360000000000002},"min":{"1min":0.748,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":10.173,"5min":24.895,"15min":27.056999999999999},"last":2.0379999999999998}]},{"osd":8,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.631,"5min":4.2220000000000004,"15min":3.831},"min":{"1min":0.69299999999999995,"5min":0.63200000000000001,"15min":0.53200000000000003},"max":{"1min":4.6639999999999997,"5min":44.578000000000003,"15min":66.841999999999999},"last":1.911},{"interface":"front","average":{"1min":1.421,"5min":3.4830000000000001,"15min":2.9430000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.9620000000000002,"5min":30.167999999999999,"15min":37.670999999999999},"last":1.952}]},{"osd":10,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":2.0459999999999998,"5min":3.492,"15min":2.7970000000000002},"min":{"1min":0.78300000000000003,"5min":0.51100000000000001,"15min":0.45700000000000002},"max":{"1min":9.9819999999999993,"5min":24.959,"15min":27.123000000000001},"last":2.177},{"interface":"front","average":{"1min":1.6779999999999999,"5min":4.1950000000000003,"15min":3.8780000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.59999999999999998},"max":{"1min":4.7690000000000001,"5min":44.643999999999998,"15min":66.760999999999996},"last":2.0019999999999998}]},{"osd":11,"last update":"Wed Feb 21 07:58:42 2024","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":3.5569999999999999,"15min":3.0270000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.0919999999999996,"5min":30.198,"15min":37.747999999999998},"last":1.881},{"interface":"front","average":{"1min":2.105,"5min":3.5640000000000001,"15min":2.8290000000000002},"min":{"1min":0.83399999999999996,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":9.5830000000000002,"5min":24.858000000000001,"15min":27.023},"last":2.117}]}]},{"osd":8,"up_from":17,"seq":73014444197,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":179984,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":335872,"data_stored":156434,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.8049999999999999,"15min":2},"min":{"1min":0.34100000000000003,"5min":0.29199999999999998,"15min":0.27100000000000002},"max":{"1min":15.634,"5min":26.353999999999999,"15min":205.21299999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.878,"5min":3.4399999999999999,"15min":2.1230000000000002},"min":{"1min":0.32200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":4.819,"5min":65.656999999999996,"15min":65.656999999999996},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.433,"15min":0.51900000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69699999999999995,"5min":1.071,"15min":3.8900000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.51500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69799999999999995,"5min":1.4179999999999999,"15min":3.024},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.40600000000000003,"15min":0.45700000000000002},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.219},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":3.4990000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.38700000000000001,"15min":0.44},"min":{"1min":0.26800000000000002,"5min":0.23999999999999999,"15min":0.23699999999999999},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":3.794},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":2.2890000000000001,"15min":1.788},"min":{"1min":0.43099999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":4.8849999999999998,"5min":21.527999999999999,"15min":23.033999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0880000000000001,"5min":2.319,"15min":1.7949999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":5.1120000000000001,"5min":21.652999999999999,"15min":23.047999999999998},"last":0.81100000000000005}]},{"osd":4,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.57599999999999996},"min":{"1min":0.34300000000000003,"5min":0.28100000000000003,"15min":0.25900000000000001},"max":{"1min":0.78800000000000003,"5min":1.1279999999999999,"15min":3.3260000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.52100000000000002,"15min":0.58699999999999997},"min":{"1min":0.36399999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":3.839},"last":0.54900000000000004}]},{"osd":5,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47199999999999998,"15min":0.49099999999999999},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27000000000000002},"max":{"1min":0.85099999999999998,"5min":0.94299999999999995,"15min":2.9809999999999999},"last":0.313},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48599999999999999,"15min":0.53000000000000003},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.28299999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":4.0069999999999997},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":2.2810000000000001,"15min":1.8340000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38900000000000001},"max":{"1min":4.2880000000000003,"5min":19.280000000000001,"15min":19.280000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.89400000000000002,"5min":2.4590000000000001,"15min":1.7749999999999999},"min":{"1min":0.47499999999999998,"5min":0.36699999999999999,"15min":0.36199999999999999},"max":{"1min":2.827,"5min":15.593999999999999,"15min":15.593999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.59899999999999998,"15min":0.66900000000000004},"min":{"1min":0.41499999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":4.1059999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.59599999999999997,"15min":0.66100000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35099999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":3.968},"last":0.623}]},{"osd":9,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":3.8820000000000001,"15min":2.9529999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.8559999999999999,"5min":32.622,"15min":71.158000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":3.012,"15min":2.2429999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.4990000000000001,"5min":27.178999999999998,"15min":27.178999999999998},"last":0.84499999999999997}]},{"osd":10,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61499999999999999,"15min":0.66200000000000003},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":1.855},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.65900000000000003,"15min":0.69499999999999995},"min":{"1min":0.51600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":0.64900000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.59799999999999998,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.41499999999999998,"15min":0.38600000000000001},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":4.3360000000000003},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58499999999999996,"15min":0.64400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.643,"5min":1.643,"15min":4.0720000000000001},"last":0.56899999999999995}]}]},{"osd":7,"up_from":17,"seq":73014444196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284172,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":94087668,"statfs":{"total":96636764160,"available":96345772032,"internally_reserved":0,"allocated":397312,"data_stored":751912,"data_compressed":47614,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":290585034},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":4.1180000000000003,"5min":3.0129999999999999,"15min":1.7789999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.29199999999999998},"max":{"1min":21.872,"5min":43.918999999999997,"15min":43.918999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":4.1100000000000003,"5min":3.052,"15min":1.831},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.32900000000000001},"max":{"1min":21.887,"5min":43.935000000000002,"15min":43.935000000000002},"last":0.96299999999999997}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.315,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.224,"15min":0.20599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65500000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.36199999999999999},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":1.1299999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.373,"15min":0.45600000000000002},"min":{"1min":0.26800000000000002,"5min":0.252,"15min":0.23799999999999999},"max":{"1min":0.505,"5min":0.65200000000000002,"15min":2.3140000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.443,"5min":0.41299999999999998,"15min":0.48499999999999999},"min":{"1min":0.312,"5min":0.252,"15min":0.252},"max":{"1min":0.85799999999999998,"5min":1.196,"15min":1.77},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.6699999999999999,"5min":1.958,"15min":1.425},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.28499999999999998},"max":{"1min":8.1379999999999999,"5min":15.101000000000001,"15min":15.101000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":3.3479999999999999,"5min":3.1989999999999998,"15min":2.1680000000000001},"min":{"1min":0.40899999999999997,"5min":0.34499999999999997,"15min":0.28699999999999998},"max":{"1min":22.602,"5min":32.689999999999998,"15min":41.405000000000001},"last":0.82799999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.38500000000000001,"15min":0.41099999999999998},"min":{"1min":0.307,"5min":0.249,"15min":0.23799999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.8740000000000001},"last":0.498},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.318,"5min":0.27500000000000002,"15min":0.247},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.52200000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47599999999999998,"15min":0.59099999999999997},"min":{"1min":0.376,"5min":0.30399999999999999,"15min":0.26700000000000002},"max":{"1min":0.60699999999999998,"5min":0.98099999999999998,"15min":13.967000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.499,"5min":0.48699999999999999,"15min":0.61099999999999999},"min":{"1min":0.377,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.72599999999999998,"5min":0.88900000000000001,"15min":13.952999999999999},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":2.1989999999999998,"5min":2.504,"15min":1.8759999999999999},"min":{"1min":0.502,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":7.7069999999999999,"5min":23.959,"15min":23.959},"last":0.81599999999999995},{"interface":"front","average":{"1min":6.1200000000000001,"5min":3.806,"15min":2.3370000000000002},"min":{"1min":0.41999999999999998,"5min":0.40899999999999997,"15min":0.36199999999999999},"max":{"1min":82.087000000000003,"5min":82.087000000000003,"15min":82.087000000000003},"last":1.024}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.35199999999999998},"max":{"1min":0.82599999999999996,"5min":0.89200000000000002,"15min":1.1579999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.61799999999999999},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"max":{"1min":0.80300000000000005,"5min":0.95899999999999996,"15min":1.4930000000000001},"last":0.63500000000000001}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":3.524,"5min":2.577,"15min":1.95},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":13.708,"5min":16.113,"15min":27.177},"last":0.89700000000000002},{"interface":"front","average":{"1min":3.3530000000000002,"5min":3.25,"15min":2.327},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.442},"max":{"1min":33.146000000000001,"5min":33.146000000000001,"15min":34.470999999999997},"last":1.0089999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":2.5019999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.58599999999999997,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.35899999999999999},"max":{"1min":1.798,"5min":1.798,"15min":2.4580000000000002},"last":0.75}]}]},{"osd":6,"up_from":17,"seq":73014444197,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":327680,"data_stored":154436,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":304806342},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":3.7320000000000002,"15min":3.7530000000000001},"min":{"1min":0.40200000000000002,"5min":0.34499999999999997,"15min":0.313},"max":{"1min":6.8479999999999999,"5min":17.585000000000001,"15min":91.042000000000002},"last":1.325},{"interface":"front","average":{"1min":1.486,"5min":4.3259999999999996,"15min":4.9459999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":4.2430000000000003,"5min":82.932000000000002,"15min":115.06999999999999},"last":1.7}]},{"osd":1,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":2.1480000000000001,"15min":2.153},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":1.7889999999999999,"5min":16.561,"15min":30.702999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.105,"5min":3.222,"15min":3.8849999999999998},"min":{"1min":0.53600000000000003,"5min":0.38500000000000001,"15min":0.34100000000000003},"max":{"1min":2.403,"5min":48.497999999999998,"15min":114.93899999999999},"last":0.872}]},{"osd":2,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":2.3279999999999998,"15min":2.3079999999999998},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":2.141,"5min":16.742999999999999,"15min":30.670999999999999},"last":1.046},{"interface":"front","average":{"1min":1.4099999999999999,"5min":3.1560000000000001,"15min":3.0720000000000001},"min":{"1min":0.39500000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":3.9449999999999998,"5min":19.484000000000002,"15min":68.652000000000001},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.738,"5min":4.8609999999999998,"15min":6.0179999999999998},"min":{"1min":0.57799999999999996,"5min":0.496,"15min":0.36599999999999999},"max":{"1min":3.9100000000000001,"5min":82.992000000000004,"15min":219.733},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.653,"5min":3.6579999999999999,"15min":4.125},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":3.1019999999999999,"5min":23.568000000000001,"15min":82.281000000000006},"last":1.5469999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":2.6389999999999998,"15min":2.536},"min":{"1min":0.42899999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.2509999999999999,"5min":16.672999999999998,"15min":30.870000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":3.1150000000000002,"15min":3.141},"min":{"1min":0.69399999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.7599999999999998,"5min":17.747,"15min":68.744},"last":1.0980000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":3.3079999999999998,"15min":3.3210000000000002},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.8690000000000002,"5min":17.678000000000001,"15min":90.986999999999995},"last":1.466},{"interface":"front","average":{"1min":1.661,"5min":3.484,"15min":4.2119999999999997},"min":{"1min":0.73899999999999999,"5min":0.48499999999999999,"15min":0.35999999999999999},"max":{"1min":6.7370000000000001,"5min":48.469999999999999,"15min":115.137},"last":1.1759999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.5960000000000001,"5min":2.7309999999999999,"15min":2.649},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.438},"max":{"1min":2.375,"5min":16.632000000000001,"15min":30.838999999999999},"last":1.659},{"interface":"front","average":{"1min":1.786,"5min":3.3540000000000001,"15min":3.2919999999999998},"min":{"1min":0.82399999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":3.9900000000000002,"5min":19.065000000000001,"15min":68.778000000000006},"last":1.792}]},{"osd":8,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":3.5049999999999999,"15min":4.3170000000000002},"min":{"1min":0.77300000000000002,"5min":0.54800000000000004,"15min":0.42999999999999999},"max":{"1min":2.4700000000000002,"5min":48.432000000000002,"15min":115.03400000000001},"last":1.399},{"interface":"front","average":{"1min":1.5880000000000001,"5min":3.0979999999999999,"15min":2.8849999999999998},"min":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.502},"max":{"1min":2.5699999999999998,"5min":36.106000000000002,"15min":36.106000000000002},"last":1.75}]},{"osd":9,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":6.4020000000000001,"15min":5.7210000000000001},"min":{"1min":0.90900000000000003,"5min":0.74399999999999999,"15min":0.58499999999999996},"max":{"1min":6.8920000000000003,"5min":44.161000000000001,"15min":91.082999999999998},"last":2.0800000000000001},{"interface":"front","average":{"1min":2.698,"5min":5.024,"15min":5.6340000000000003},"min":{"1min":0.98999999999999999,"5min":0.621,"15min":0.51700000000000002},"max":{"1min":7.2060000000000004,"5min":62.496000000000002,"15min":130.30099999999999},"last":1.9930000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":2.8180000000000001,"15min":2.7719999999999998},"min":{"1min":0.67900000000000005,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.6269999999999998,"5min":16.709,"15min":30.774000000000001},"last":1.9450000000000001},{"interface":"front","average":{"1min":1.7490000000000001,"5min":3.4020000000000001,"15min":3.6110000000000002},"min":{"1min":0.85999999999999999,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":3.9620000000000002,"5min":19.155000000000001,"15min":68.891000000000005},"last":1.9219999999999999}]},{"osd":11,"last update":"Wed Feb 21 07:58:49 2024","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":3.851,"15min":4.6059999999999999},"min":{"1min":0.90300000000000002,"5min":0.65700000000000003,"15min":0.54000000000000004},"max":{"1min":2.5339999999999998,"5min":48.524999999999999,"15min":114.999},"last":1.827},{"interface":"front","average":{"1min":1.7430000000000001,"5min":2.8919999999999999,"15min":2.9089999999999998},"min":{"1min":0.63,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.6629999999999998,"5min":16.777999999999999,"15min":30.808},"last":1.859}]}]},{"osd":5,"up_from":17,"seq":73014444196,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357684,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":355966,"kb_avail":94014156,"statfs":{"total":96636764160,"available":96270495744,"internally_reserved":0,"allocated":1748992,"data_stored":3814258,"data_compressed":431039,"data_compressed_allocated":585728,"data_compressed_original":2867200,"omap_allocated":1595,"internal_metadata":364509637},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.964,"15min":1.4419999999999999},"min":{"1min":0.41799999999999998,"5min":0.27500000000000002,"15min":0.26300000000000001},"max":{"1min":4.0069999999999997,"5min":16.375,"15min":21.427},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.002,"5min":2.2549999999999999,"15min":1.655},"min":{"1min":0.317,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":6.0510000000000002,"5min":23.23,"15min":23.23},"last":0.66800000000000004}]},{"osd":1,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47199999999999998,"15min":0.54100000000000004},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.24299999999999999},"max":{"1min":0.83599999999999997,"5min":2.4430000000000001,"15min":14.186},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47099999999999997,"15min":0.54000000000000004},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.22700000000000001},"max":{"1min":0.89600000000000002,"5min":1.806,"15min":14.391999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.373,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.188,"15min":0.188},"max":{"1min":1.004,"5min":1.7629999999999999,"15min":2.5619999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.378,"15min":0.39800000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23000000000000001},"max":{"1min":0.74199999999999999,"5min":1.643,"15min":2.8940000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":2.6880000000000002,"15min":1.7130000000000001},"min":{"1min":0.378,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":20.231000000000002,"5min":35.134,"15min":35.134},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.5569999999999999,"5min":2.4980000000000002,"15min":1.8440000000000001},"min":{"1min":0.41799999999999998,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":15.984,"5min":48.656999999999996,"15min":48.656999999999996},"last":0.76900000000000002}]},{"osd":4,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.64100000000000001},"min":{"1min":0.33000000000000002,"5min":0.28999999999999998,"15min":0.27200000000000002},"max":{"1min":1.179,"5min":1.905,"15min":14.831},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.67100000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.25700000000000001},"max":{"1min":0.86099999999999999,"5min":1.8899999999999999,"15min":14.846},"last":0.58099999999999996}]},{"osd":6,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":2.395,"15min":2.0609999999999999},"min":{"1min":0.46100000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":7.0890000000000004,"5min":30.489000000000001,"15min":46.009999999999998},"last":0.871},{"interface":"front","average":{"1min":2.2240000000000002,"5min":3.387,"15min":2.835},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":30.288,"5min":36.401000000000003,"15min":67.126999999999995},"last":0.78900000000000003}]},{"osd":7,"last update":"Wed Feb 21 07:57:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56200000000000006,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.27200000000000002},"max":{"1min":1.228,"5min":1.7769999999999999,"15min":14.211},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.54200000000000004,"15min":0.621},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.309},"max":{"1min":1.2529999999999999,"5min":1.3959999999999999,"15min":14.241},"last":0.61599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.50800000000000001,"15min":0.501},"min":{"1min":0.29399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76400000000000001,"5min":1.738,"15min":1.738},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.52500000000000002,"15min":0.55100000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.3100000000000001,"5min":1.351,"15min":2.5870000000000002},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":2.2719999999999998,"15min":1.9390000000000001},"min":{"1min":0.46200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":9.2639999999999993,"5min":32.753999999999998,"15min":32.753999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":2.4990000000000001,"15min":2.0289999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42199999999999999},"max":{"1min":6.2560000000000002,"5min":17.030000000000001,"15min":36.168999999999997},"last":0.98099999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:58:37 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.38700000000000001},"max":{"1min":1.1679999999999999,"5min":1.2669999999999999,"15min":1.476},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":0.66700000000000004},"min":{"1min":0.40899999999999997,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1.1579999999999999,"5min":2.036,"15min":2.298},"last":0.68500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444197,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274380,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":94097460,"statfs":{"total":96636764160,"available":96355799040,"internally_reserved":0,"allocated":331776,"data_stored":157118,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":1,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.313,"15min":0.33800000000000002},"min":{"1min":0.20899999999999999,"5min":0.20399999999999999,"15min":0.19800000000000001},"max":{"1min":0.372,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.314},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.33400000000000002,"15min":0.35199999999999998},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.20200000000000001},"max":{"1min":0.39300000000000002,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":0.36399999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47199999999999998,"15min":0.497},"min":{"1min":0.26700000000000002,"5min":0.25900000000000001,"15min":0.254},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":2.0299999999999998},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.41199999999999998,"15min":0.46300000000000002},"min":{"1min":0.26100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80800000000000005,"5min":1.325,"15min":1.325},"last":0.40400000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":3.101,"15min":1.9830000000000001},"min":{"1min":0.374,"5min":0.34999999999999998,"15min":0.30399999999999999},"max":{"1min":6.1020000000000003,"5min":31.25,"15min":31.25},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.133,"5min":2.1749999999999998,"15min":1.607},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35399999999999998},"max":{"1min":5.4619999999999997,"5min":23.829000000000001,"15min":23.829000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.42499999999999999,"15min":0.48399999999999999},"min":{"1min":0.246,"5min":0.24299999999999999,"15min":0.23999999999999999},"max":{"1min":0.48399999999999999,"5min":1.177,"15min":1.371},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.26000000000000001},"max":{"1min":1.2090000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.45200000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":3.4660000000000002,"15min":2.738},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":5.0510000000000002,"5min":103.301,"15min":103.301},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.5049999999999999,"5min":2.4889999999999999,"15min":1.651},"min":{"1min":0.38400000000000001,"5min":0.371,"15min":0.34000000000000002},"max":{"1min":7.774,"5min":19.571000000000002,"15min":19.866},"last":0.97799999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.45700000000000002,"15min":0.47999999999999998},"min":{"1min":0.34799999999999998,"5min":0.29599999999999999,"15min":0.254},"max":{"1min":0.61799999999999999,"5min":1.0720000000000001,"15min":1.3819999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.44600000000000001},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.502,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.5}]},{"osd":8,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32300000000000001},"max":{"1min":1.153,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.60299999999999998,"15min":0.61199999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.73799999999999999,"5min":1.774,"15min":2.3029999999999999},"last":0.51900000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":2.6389999999999998,"15min":2.0550000000000002},"min":{"1min":0.49199999999999999,"5min":0.47099999999999997,"15min":0.40000000000000002},"max":{"1min":7.9050000000000002,"5min":23.103000000000002,"15min":31.655999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.482,"5min":3.7919999999999998,"15min":2.1720000000000002},"min":{"1min":0.497,"5min":0.48599999999999999,"15min":0.45800000000000002},"max":{"1min":7.0039999999999996,"5min":65.191999999999993,"15min":65.191999999999993},"last":0.66100000000000003}]},{"osd":10,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.52100000000000002},"min":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.57199999999999995,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.51300000000000001,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.628,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.57099999999999995}]},{"osd":11,"last update":"Wed Feb 21 07:57:49 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61399999999999999,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.76600000000000001,"5min":1.7450000000000001,"15min":2.3250000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.58299999999999996,"15min":0.628},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.67400000000000004}]}]},{"osd":3,"up_from":17,"seq":73014444196,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279944,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":279614,"kb_avail":94091896,"statfs":{"total":96636764160,"available":96350101504,"internally_reserved":0,"allocated":327680,"data_stored":154308,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":286325191},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4009999999999998,"5min":5.548,"15min":3.5800000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29499999999999998},"max":{"1min":20.800000000000001,"5min":46.143000000000001,"15min":46.143000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":5.774,"5min":6.4850000000000003,"15min":4.1550000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":36.734999999999999,"5min":79.581000000000003,"15min":79.581000000000003},"last":1.4179999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.8959999999999999,"5min":5.3330000000000002,"15min":3.5960000000000001},"min":{"1min":0.36299999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":36.805999999999997,"5min":79.177000000000007,"15min":79.177000000000007},"last":1.0580000000000001},{"interface":"front","average":{"1min":3.2669999999999999,"5min":3.5049999999999999,"15min":2.4329999999999998},"min":{"1min":0.58599999999999997,"5min":0.48099999999999998,"15min":0.27600000000000002},"max":{"1min":12.286,"5min":23.809999999999999,"15min":23.809999999999999},"last":1.258}]},{"osd":2,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":3.8820000000000001,"15min":2.7919999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.375},"max":{"1min":20.562000000000001,"5min":46.396999999999998,"15min":46.396999999999998},"last":1.2230000000000001},{"interface":"front","average":{"1min":3.302,"5min":3.5,"15min":2.5649999999999999},"min":{"1min":0.66300000000000003,"5min":0.61499999999999999,"15min":0.37},"max":{"1min":12.374000000000001,"5min":23.866,"15min":23.866},"last":1.103}]},{"osd":4,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1340000000000003,"5min":5.4550000000000001,"15min":3.742},"min":{"1min":0.47599999999999998,"5min":0.379,"15min":0.379},"max":{"1min":36.771000000000001,"5min":79.043999999999997,"15min":79.043999999999997},"last":1.1799999999999999},{"interface":"front","average":{"1min":4.1699999999999999,"5min":4.3879999999999999,"15min":2.9750000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":20.638000000000002,"5min":46.530999999999999,"15min":46.530999999999999},"last":0.997}]},{"osd":5,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.1269999999999998,"5min":5.3710000000000004,"15min":3.7719999999999998},"min":{"1min":0.51200000000000001,"5min":0.432,"15min":0.432},"max":{"1min":36.646000000000001,"5min":79.094999999999999,"15min":79.094999999999999},"last":1.302},{"interface":"front","average":{"1min":4.2069999999999999,"5min":4.0679999999999996,"15min":2.9399999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":20.765000000000001,"5min":46.567999999999998,"15min":46.567999999999998},"last":1.1479999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.629,"15min":2.6560000000000001},"min":{"1min":0.84599999999999997,"5min":0.55300000000000005,"15min":0.39500000000000002},"max":{"1min":13.209,"5min":23.776,"15min":23.776},"last":1.335},{"interface":"front","average":{"1min":4.2469999999999999,"5min":5.6219999999999999,"15min":3.9750000000000001},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":36.840000000000003,"5min":79.140000000000001,"15min":79.140000000000001},"last":1.3620000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.2770000000000001,"5min":4.1989999999999998,"15min":3.145},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":20.687999999999999,"5min":51.311,"15min":51.311},"last":1.286},{"interface":"front","average":{"1min":3.4569999999999999,"5min":3.6499999999999999,"15min":2.79},"min":{"1min":0.73999999999999999,"5min":0.65000000000000002,"15min":0.436},"max":{"1min":13.279999999999999,"5min":23.745000000000001,"15min":23.745000000000001},"last":1.571}]},{"osd":9,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":6.2000000000000002,"5min":5.298,"15min":3.8900000000000001},"min":{"1min":0.92600000000000005,"5min":0.59899999999999998,"15min":0.41399999999999998},"max":{"1min":31.452000000000002,"5min":31.452000000000002,"15min":31.978999999999999},"last":1.9690000000000001},{"interface":"front","average":{"1min":4.984,"5min":7.7460000000000004,"15min":5.452},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.46300000000000002},"max":{"1min":37.411000000000001,"5min":79.388999999999996,"15min":79.388999999999996},"last":1.536}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":3.9279999999999999,"15min":3.0510000000000002},"min":{"1min":0.91000000000000003,"5min":0.73199999999999998,"15min":0.46000000000000002},"max":{"1min":13.244999999999999,"5min":23.838999999999999,"15min":31.469999999999999},"last":1.829},{"interface":"front","average":{"1min":4.7699999999999996,"5min":5.8140000000000001,"15min":4.1769999999999996},"min":{"1min":0.60499999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.698,"5min":79.213999999999999,"15min":79.213999999999999},"last":1.484}]},{"osd":11,"last update":"Wed Feb 21 07:57:51 2024","interfaces":[{"interface":"back","average":{"1min":4.4059999999999997,"5min":4.46,"15min":3.1960000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":20.728000000000002,"5min":51.438000000000002,"15min":51.438000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":3.456,"5min":3.855,"15min":3.0640000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.498},"max":{"1min":12.414,"5min":23.896999999999998,"15min":31.771999999999998},"last":1.909}]}]},{"osd":2,"up_from":17,"seq":73014444197,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231268,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94140572,"statfs":{"total":96636764160,"available":96399945728,"internally_reserved":0,"allocated":1667072,"data_stored":3219572,"data_compressed":397517,"data_compressed_allocated":540672,"data_compressed_original":2293760,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":2.3519999999999999,"15min":2.1890000000000001},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.27900000000000003},"max":{"1min":24.849,"5min":29.721,"15min":115.97},"last":0.71799999999999997},{"interface":"front","average":{"1min":1.0029999999999999,"5min":2.4060000000000001,"15min":1.73},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":4.9459999999999997,"5min":30.361999999999998,"15min":36.359999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.41099999999999998,"15min":0.51800000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.57199999999999995,"5min":1.044,"15min":2.734},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.42899999999999999,"15min":0.502},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.59399999999999997,"5min":1.256,"15min":2.4340000000000002},"last":0.623}]},{"osd":3,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.55,"5min":2.6949999999999998,"15min":1.8560000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.29799999999999999},"max":{"1min":3.8730000000000002,"5min":27.800000000000001,"15min":27.800000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.5640000000000001,"5min":2.7149999999999999,"15min":1.861},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.891,"5min":29.364999999999998,"15min":29.364999999999998},"last":0.93500000000000005}]},{"osd":4,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47699999999999998,"15min":0.58299999999999996},"min":{"1min":0.27400000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.089,"5min":1.3109999999999999,"15min":2.4729999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.63700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28100000000000003,"15min":0.23599999999999999},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.5419999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.41199999999999998,"15min":0.47899999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.498,"5min":1.534,"15min":2.903},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47099999999999997,"15min":0.49099999999999999},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.219},"max":{"1min":1.1120000000000001,"5min":1.6479999999999999,"15min":2.1869999999999998},"last":0.36299999999999999}]},{"osd":6,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.9350000000000001,"15min":1.5680000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.6799999999999997,"5min":16.079000000000001,"15min":16.079000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.786,"5min":1.921,"15min":1.5880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.432},"max":{"1min":10.737,"5min":16.065000000000001,"15min":16.065000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.53000000000000003,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67300000000000004,"5min":1.119,"15min":2.5470000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.57799999999999996,"15min":0.63700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.755,"5min":1.6639999999999999,"15min":2.6259999999999999},"last":0.50800000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":1.3280000000000001,"5min":1.889,"15min":1.972},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.316},"max":{"1min":0.68600000000000005,"5min":1.2390000000000001,"15min":1.8720000000000001},"last":0.47199999999999998}]},{"osd":9,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":2.8450000000000002,"5min":5.1509999999999998,"15min":3.113},"min":{"1min":0.49299999999999999,"5min":0.48099999999999998,"15min":0.40500000000000003},"max":{"1min":8.5630000000000006,"5min":118.07299999999999,"15min":118.07299999999999},"last":0.88},{"interface":"front","average":{"1min":1.524,"5min":2.464,"15min":1.8600000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":6.0650000000000004,"5min":18.303000000000001,"15min":25.349},"last":0.755}]},{"osd":10,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.65800000000000003,"15min":0.72999999999999998},"min":{"1min":0.42899999999999999,"5min":0.40300000000000002,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.595,"15min":2.6739999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.624,"15min":0.68500000000000005},"min":{"1min":0.44800000000000001,"5min":0.41599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77200000000000002,"5min":1.369,"15min":2.5110000000000001},"last":0.69799999999999995}]},{"osd":11,"last update":"Wed Feb 21 07:57:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.624,"15min":0.70799999999999996},"min":{"1min":0.41599999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0489999999999999,"5min":1.837,"15min":2.9380000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.58999999999999997,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40300000000000002,"15min":0.35599999999999998},"max":{"1min":0.68200000000000005,"5min":1.5009999999999999,"15min":2.9100000000000001},"last":0.63700000000000001}]}]},{"osd":1,"up_from":17,"seq":73014444197,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225796,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":225470,"kb_avail":94146044,"statfs":{"total":96636764160,"available":96405549056,"internally_reserved":0,"allocated":323584,"data_stored":152854,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":230881735},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3839999999999999,"15min":1.569},"min":{"1min":0.34699999999999998,"5min":0.32300000000000001,"15min":0.27800000000000002},"max":{"1min":12.814,"5min":12.814,"15min":26.550000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":1.419,"15min":1.5780000000000001},"min":{"1min":0.438,"5min":0.29699999999999999,"15min":0.27000000000000002},"max":{"1min":1.04,"5min":11.151,"15min":31.741},"last":0.72499999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.434,"15min":0.61899999999999999},"min":{"1min":0.28599999999999998,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":0.753,"5min":2.1970000000000001,"15min":58.337000000000003},"last":0.497},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.432,"15min":0.64600000000000002},"min":{"1min":0.254,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.76300000000000001,"5min":1.417,"15min":60.276000000000003},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":1.722,"15min":1.619},"min":{"1min":0.438,"5min":0.36399999999999999,"15min":0.35599999999999998},"max":{"1min":3.0049999999999999,"5min":10.879,"15min":30.460000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":1.9079999999999999,"15min":1.6619999999999999},"min":{"1min":0.42199999999999999,"5min":0.33500000000000002,"15min":0.32400000000000001},"max":{"1min":1,"5min":19.312999999999999,"15min":20.971},"last":0.66600000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.35299999999999998,"15min":0.373},"min":{"1min":0.28799999999999998,"5min":0.224,"15min":0.214},"max":{"1min":0.60599999999999998,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.373},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.441,"15min":0.42999999999999999},"min":{"1min":0.27100000000000002,"5min":0.245,"15min":0.20399999999999999},"max":{"1min":0.57299999999999995,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48799999999999999,"15min":0.67400000000000004},"min":{"1min":0.311,"5min":0.248,"15min":0.248},"max":{"1min":0.77800000000000002,"5min":1.8660000000000001,"15min":58.32},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52400000000000002,"15min":0.70699999999999996},"min":{"1min":0.36099999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.67600000000000005,"5min":2.3740000000000001,"15min":60.185000000000002},"last":0.55400000000000005}]},{"osd":6,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":1.9550000000000001,"15min":3.1320000000000001},"min":{"1min":0.52000000000000002,"5min":0.39100000000000001,"15min":0.33300000000000002},"max":{"1min":0.91700000000000004,"5min":11.625,"15min":98.299999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":2.129,"15min":1.879},"min":{"1min":0.45600000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.5819999999999999,"5min":24.469000000000001,"15min":24.501999999999999},"last":0.755}]},{"osd":7,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.33000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.622,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.497,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.69199999999999995,"5min":2.161,"15min":2.161},"last":0.63100000000000001}]},{"osd":8,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.61499999999999999,"15min":0.60199999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72499999999999998,"5min":4.1239999999999997,"15min":4.1239999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56299999999999994,"15min":0.59699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.33700000000000002},"max":{"1min":0.71999999999999997,"5min":1.286,"15min":3.637},"last":0.51900000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:57:53 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":4.5640000000000001,"15min":2.9159999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.433},"max":{"1min":6.5940000000000003,"5min":91.182000000000002,"15min":91.182000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":2.423,"5min":3.081,"15min":2.1869999999999998},"min":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.45500000000000002},"max":{"1min":14.013999999999999,"5min":32.460999999999999,"15min":32.460999999999999},"last":0.98499999999999999}]},{"osd":10,"last update":"Wed Feb 21 07:58:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52900000000000003,"15min":0.56999999999999995},"min":{"1min":0.41499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83099999999999996,"5min":1.242,"15min":1.242},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.92100000000000004,"15min":1.0780000000000001},"last":0.68500000000000005}]}]},{"osd":0,"up_from":17,"seq":73014444197,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266064,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":265726,"kb_avail":94105776,"statfs":{"total":96636764160,"available":96364314624,"internally_reserved":0,"allocated":335872,"data_stored":152988,"data_compressed":14092,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":272103877},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":2.8439999999999999,"5min":2.5299999999999998,"15min":2.367},"min":{"1min":0.54900000000000004,"5min":0.34899999999999998,"15min":0.249},"max":{"1min":27.899000000000001,"5min":27.899000000000001,"15min":54.454999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.248,"5min":2.359,"15min":2.5070000000000001},"min":{"1min":0.45900000000000002,"5min":0.34899999999999998,"15min":0.27400000000000002},"max":{"1min":4.2839999999999998,"5min":23.396000000000001,"15min":67.233999999999995},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":2.5760000000000001,"15min":2.242},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.224,"5min":34.563000000000002,"15min":34.563000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":2.7829999999999999,"5min":2.871,"15min":2.5569999999999999},"min":{"1min":0.56999999999999995,"5min":0.39000000000000001,"15min":0.311},"max":{"1min":26.449000000000002,"5min":32.026000000000003,"15min":54.421999999999997},"last":1.266}]},{"osd":3,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":3.5619999999999998,"15min":3.7839999999999998},"min":{"1min":0.54300000000000004,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":4.9619999999999997,"5min":21.390999999999998,"15min":79.024000000000001},"last":1.2210000000000001},{"interface":"front","average":{"1min":2.0390000000000001,"5min":3.5870000000000002,"15min":3.4300000000000002},"min":{"1min":0.434,"5min":0.313,"15min":0.313},"max":{"1min":17.091999999999999,"5min":45.561999999999998,"15min":79.706999999999994},"last":1.506}]},{"osd":4,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":3.0030000000000001,"5min":2.746,"15min":2.5670000000000002},"min":{"1min":0.66900000000000004,"5min":0.46600000000000003,"15min":0.39000000000000001},"max":{"1min":27.788,"5min":27.788,"15min":54.353000000000002},"last":1.157},{"interface":"front","average":{"1min":1.5489999999999999,"5min":2.419,"15min":2.7250000000000001},"min":{"1min":0.66000000000000003,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":4.375,"5min":15.821999999999999,"15min":67.313000000000002},"last":0.96999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":3.4020000000000001,"15min":3.9489999999999998},"min":{"1min":0.58799999999999997,"5min":0.45100000000000001,"15min":0.43099999999999999},"max":{"1min":6.1459999999999999,"5min":17.474,"15min":79.078000000000003},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.468,"5min":5.8609999999999998,"15min":4.5300000000000002},"min":{"1min":0.59599999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.5019999999999998,"5min":86.691999999999993,"15min":86.691999999999993},"last":1.8979999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":2.6030000000000002,"15min":2.589},"min":{"1min":0.57999999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4369999999999998,"5min":16.353999999999999,"15min":32.107999999999997},"last":1.657},{"interface":"front","average":{"1min":3.1509999999999998,"5min":2.794,"15min":2.7400000000000002},"min":{"1min":0.77400000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":27.963000000000001,"5min":27.963000000000001,"15min":54.386000000000003},"last":1.448}]},{"osd":8,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":2.7109999999999999,"15min":3.1150000000000002},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.439},"max":{"1min":4.4039999999999999,"5min":17.352,"15min":67.387},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.417,"5min":2.806,"15min":2.7749999999999999},"min":{"1min":0.63200000000000001,"5min":0.48399999999999999,"15min":0.437},"max":{"1min":2.4809999999999999,"5min":16.385999999999999,"15min":31.966999999999999},"last":1.8049999999999999}]},{"osd":9,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":3.6280000000000001,"5min":4.5289999999999999,"15min":4.5499999999999998},"min":{"1min":1.006,"5min":0.58599999999999997,"15min":0.45200000000000001},"max":{"1min":27.995000000000001,"5min":37.704999999999998,"15min":152.25700000000001},"last":1.8500000000000001},{"interface":"front","average":{"1min":2.331,"5min":4.4119999999999999,"15min":4.5270000000000001},"min":{"1min":0.61499999999999999,"5min":0.56000000000000005,"15min":0.54000000000000004},"max":{"1min":10.397,"5min":46.000999999999998,"15min":111.746},"last":1.698}]},{"osd":10,"last update":"Wed Feb 21 07:58:31 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":3.2360000000000002,"15min":2.9580000000000002},"min":{"1min":0.97699999999999998,"5min":0.55400000000000005,"15min":0.503},"max":{"1min":27.931999999999999,"5min":27.931999999999999,"15min":54.490000000000002},"last":1.597},{"interface":"front","average":{"1min":1.8600000000000001,"5min":3.0310000000000001,"15min":3.2450000000000001},"min":{"1min":0.82999999999999996,"5min":0.66900000000000004,"15min":0.54000000000000004},"max":{"1min":5.1689999999999996,"5min":17.402999999999999,"15min":67.423000000000002},"last":1.3049999999999999}]},{"osd":11,"last update":"Wed Feb 21 07:58:39 2024","interfaces":[{"interface":"back","average":{"1min":3.3620000000000001,"5min":3.3500000000000001,"15min":3.1669999999999998},"min":{"1min":0.81200000000000006,"5min":0.71999999999999997,"15min":0.58699999999999997},"max":{"1min":27.850999999999999,"5min":27.850999999999999,"15min":54.298000000000002},"last":1.758},{"interface":"front","average":{"1min":2.0009999999999999,"5min":2.9470000000000001,"15min":3.359},"min":{"1min":0.64600000000000002,"5min":0.59899999999999998,"15min":0.58299999999999996},"max":{"1min":5.2009999999999996,"5min":17.439,"15min":67.454999999999998},"last":1.4079999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33522,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1351680,"data_stored":3067390,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1363968,"data_stored":3067612,"data_compressed":383425,"data_compressed_allocated":520192,"data_compressed_original":2252800,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:58:53.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-21T07:58:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.819+0000 7f436d200640 1 Processor -- start 2024-02-21T07:58:53.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.819+0000 7f436d200640 1 -- start start 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f436808e630 0x7f436817e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f4368070670 0x7f4368185df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4368070b20 0x7f4368186330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680f4760 con 0x7f4368070b20 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680f49b0 con 0x7f436808e630 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f436d200640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680f4c90 con 0x7f4368070670 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f4366800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4368070b20 0x7f4368186330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f4366800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4368070b20 0x7f4368186330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52680/0 (socket says 172.21.15.100:52680) 2024-02-21T07:58:53.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f4366800640 1 -- 172.21.15.100:0/3202978768 learned_addr learned my addr 172.21.15.100:0/3202978768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f4365e00640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.156:3300/0 conn(0x7f436808e630 0x7f436817e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.821+0000 7f4365400640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.170:3300/0 conn(0x7f4368070670 0x7f4368185df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.822+0000 7f4366800640 1 -- 172.21.15.100:0/3202978768 >> v2:172.21.15.170:3300/0 conn(0x7f4368070670 msgr2=0x7f4368185df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.822+0000 7f4366800640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.170:3300/0 conn(0x7f4368070670 0x7f4368185df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.822+0000 7f4366800640 1 -- 172.21.15.100:0/3202978768 >> v2:172.21.15.156:3300/0 conn(0x7f436808e630 msgr2=0x7f436817e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.822+0000 7f4366800640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.156:3300/0 conn(0x7f436808e630 0x7f436817e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.822+0000 7f4366800640 1 -- 172.21.15.100:0/3202978768 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680f4f70 con 0x7f4368070b20 2024-02-21T07:58:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.823+0000 7f4366800640 1 --2- 172.21.15.100:0/3202978768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4368070b20 0x7f4368186330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4368074b10 tx=0x7f436002bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70124e55c399848 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.823+0000 7f4364a00640 1 -- 172.21.15.100:0/3202978768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436002c980 con 0x7f4368070b20 2024-02-21T07:58:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.823+0000 7f4364a00640 1 -- 172.21.15.100:0/3202978768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436002cae0 con 0x7f4368070b20 2024-02-21T07:58:53.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.823+0000 7f4364a00640 1 -- 172.21.15.100:0/3202978768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436002ce70 con 0x7f4368070b20 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 -- 172.21.15.100:0/3202978768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4368070b20 msgr2=0x7f4368186330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 --2- 172.21.15.100:0/3202978768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4368070b20 0x7f4368186330 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4368074b10 tx=0x7f436002bde0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 -- 172.21.15.100:0/3202978768 shutdown_connections 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 --2- 172.21.15.100:0/3202978768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4368070b20 0x7f4368186330 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.170:3300/0 conn(0x7f4368070670 0x7f4368185df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 --2- 172.21.15.100:0/3202978768 >> v2:172.21.15.156:3300/0 conn(0x7f436808e630 0x7f436817e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 -- 172.21.15.100:0/3202978768 >> 172.21.15.100:0/3202978768 conn(0x7f43680668b0 msgr2=0x7f4368066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 -- 172.21.15.100:0/3202978768 shutdown_connections 2024-02-21T07:58:53.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.824+0000 7f436d200640 1 -- 172.21.15.100:0/3202978768 wait complete. 2024-02-21T07:58:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.826+0000 7f436d200640 1 Processor -- start 2024-02-21T07:58:53.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.826+0000 7f436d200640 1 -- start start 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4368070670 0x7f436815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4368070b20 0x7f436821dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436821d920 con 0x7f436808e630 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436821c770 con 0x7f4368070670 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f436d200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436821c9c0 con 0x7f4368070b20 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f4366800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f4366800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52684/0 (socket says 172.21.15.100:52684) 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f4366800640 1 -- 172.21.15.100:0/281306920 learned_addr learned my addr 172.21.15.100:0/281306920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f4365e00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4368070670 0x7f436815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.827+0000 7f4365400640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4368070b20 0x7f436821dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 -- 172.21.15.100:0/281306920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4368070b20 msgr2=0x7f436821dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4368070b20 0x7f436821dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 -- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4368070670 msgr2=0x7f436815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4368070670 0x7f436815dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 -- 172.21.15.100:0/281306920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4360009b30 con 0x7f436808e630 2024-02-21T07:58:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f4366800640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f436002c320 tx=0x7f4360004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360009510 con 0x7f436808e630 2024-02-21T07:58:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360007a30 con 0x7f436808e630 2024-02-21T07:58:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436821cca0 con 0x7f436808e630 2024-02-21T07:58:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360007de0 con 0x7f436808e630 2024-02-21T07:58:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.828+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436821d260 con 0x7f436808e630 2024-02-21T07:58:53.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.830+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436821da60 con 0x7f436808e630 2024-02-21T07:58:53.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.831+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f436003e450 con 0x7f436808e630 2024-02-21T07:58:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.832+0000 7f435e000640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 0x7f43480a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.833+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f43600ec3d0 con 0x7f436808e630 2024-02-21T07:58:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.833+0000 7f4365e00640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 0x7f43480a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:53.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.833+0000 7f4365e00640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 0x7f43480a1590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4358009aa0 tx=0x7f4358009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:53.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:53.836+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f436821da60 con 0x7f436808e630 2024-02-21T07:58:54.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.014+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f436821da60 con 0x7f436808e630 2024-02-21T07:58:54.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.022+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f436821da60 con 0x7f436808e630 2024-02-21T07:58:54.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.023+0000 7f435e000640 1 -- 172.21.15.100:0/281306920 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f43600b60c0 con 0x7f436808e630 2024-02-21T07:58:54.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 msgr2=0x7f43480a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 0x7f43480a1590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4358009aa0 tx=0x7f4358009190 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 msgr2=0x7f436821e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f436002c320 tx=0x7f4360004a40 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 shutdown_connections 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f434809f0d0 0x7f43480a1590 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f436808e630 0x7f436821e280 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4368070b20 0x7f436821dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 --2- 172.21.15.100:0/281306920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4368070670 0x7f436815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 >> 172.21.15.100:0/281306920 conn(0x7f43680668b0 msgr2=0x7f4368165590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:54.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 shutdown_connections 2024-02-21T07:58:54.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.025+0000 7f436d200640 1 -- 172.21.15.100:0/281306920 wait complete. 2024-02-21T07:58:54.045 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-21T07:58:54.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:58:54.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.253+0000 7f381e800640 1 Processor -- start 2024-02-21T07:58:54.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.254+0000 7f381e800640 1 -- start start 2024-02-21T07:58:54.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f381e800640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f381817c040 0x7f38180706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f381e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3818070f30 0x7f38180713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f381e800640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180f50d0 con 0x7f3818188c00 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f381e800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180f4ec0 con 0x7f3818070f30 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f381e800640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180f6450 con 0x7f381817c040 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f3816a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3818070f30 0x7f38180713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f3816a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3818070f30 0x7f38180713a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52690/0 (socket says 172.21.15.100:52690) 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f3816a00640 1 -- 172.21.15.100:0/3770592869 learned_addr learned my addr 172.21.15.100:0/3770592869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.255+0000 7f3817400640 1 --2- 172.21.15.100:0/3770592869 >> v2:172.21.15.170:3300/0 conn(0x7f381817c040 0x7f38180706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.256+0000 7f3816a00640 1 -- 172.21.15.100:0/3770592869 >> v2:172.21.15.170:3300/0 conn(0x7f381817c040 msgr2=0x7f38180706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.256+0000 7f3816a00640 1 --2- 172.21.15.100:0/3770592869 >> v2:172.21.15.170:3300/0 conn(0x7f381817c040 0x7f38180706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.256+0000 7f3816a00640 1 -- 172.21.15.100:0/3770592869 >> v1:172.21.15.170:6789/0 conn(0x7f3818188c00 legacy=0x7f3818189090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.256+0000 7f3816a00640 1 -- 172.21.15.100:0/3770592869 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180f53b0 con 0x7f3818070f30 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.257+0000 7f3816a00640 1 --2- 172.21.15.100:0/3770592869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818070f30 0x7f38180713a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f73161b9b963103 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.257+0000 7f3816000640 1 -- 172.21.15.100:0/3770592869 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380002f840 con 0x7f3818070f30 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.257+0000 7f3816000640 1 -- 172.21.15.100:0/3770592869 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f380002f9a0 con 0x7f3818070f30 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.257+0000 7f3816000640 1 -- 172.21.15.100:0/3770592869 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380002fd50 con 0x7f3818070f30 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 -- 172.21.15.100:0/3770592869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818070f30 msgr2=0x7f38180713a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 --2- 172.21.15.100:0/3770592869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818070f30 0x7f38180713a0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380002ba20 comp rx=0 tx=0).stop 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 -- 172.21.15.100:0/3770592869 shutdown_connections 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 --2- 172.21.15.100:0/3770592869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818070f30 0x7f38180713a0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 --2- 172.21.15.100:0/3770592869 >> v2:172.21.15.170:3300/0 conn(0x7f381817c040 0x7f38180706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 -- 172.21.15.100:0/3770592869 >> 172.21.15.100:0/3770592869 conn(0x7f38180ce160 msgr2=0x7f38180ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:54.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 -- 172.21.15.100:0/3770592869 shutdown_connections 2024-02-21T07:58:54.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.258+0000 7f381e800640 1 -- 172.21.15.100:0/3770592869 wait complete. 2024-02-21T07:58:54.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.260+0000 7f381e800640 1 Processor -- start 2024-02-21T07:58:54.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.260+0000 7f381e800640 1 -- start start 2024-02-21T07:58:54.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3818070f30 0x7f381821d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3818188c00 0x7f381821dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cc720 con 0x7f381817c040 2024-02-21T07:58:54.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180cc970 con 0x7f3818188c00 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.261+0000 7f381e800640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ccc50 con 0x7f3818070f30 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52698/0 (socket says 172.21.15.100:52698) 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 -- 172.21.15.100:0/672076239 learned_addr learned my addr 172.21.15.100:0/672076239 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3817e00640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3818188c00 0x7f381821dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3817400640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3818070f30 0x7f381821d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 -- 172.21.15.100:0/672076239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3818070f30 msgr2=0x7f381821d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3818070f30 0x7f381821d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 -- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3818188c00 msgr2=0x7f381821dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3818188c00 0x7f381821dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 -- 172.21.15.100:0/672076239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000094d0 con 0x7f381817c040 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.262+0000 7f3816a00640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3800000c00 tx=0x7f3800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.263+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800037c40 con 0x7f381817c040 2024-02-21T07:58:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.263+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3800037da0 con 0x7f381817c040 2024-02-21T07:58:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.263+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800041660 con 0x7f381817c040 2024-02-21T07:58:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.263+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180ccf30 con 0x7f381817c040 2024-02-21T07:58:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.263+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38180cd4f0 con 0x7f381817c040 2024-02-21T07:58:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.264+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3818067c80 con 0x7f381817c040 2024-02-21T07:58:54.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.266+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f38000417c0 con 0x7f381817c040 2024-02-21T07:58:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.267+0000 7f380f400640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 0x7f37f40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.267+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f380003c070 con 0x7f381817c040 2024-02-21T07:58:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.267+0000 7f3817400640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 0x7f37f40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.268+0000 7f3817400640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 0x7f37f40a1560 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3808009b40 tx=0x7f3808009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.271+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f38000b66d0 con 0x7f381817c040 2024-02-21T07:58:54.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.508+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38180ed570 con 0x7f381817c040 2024-02-21T07:58:54.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.509+0000 7f380f400640 1 -- 172.21.15.100:0/672076239 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11340 (secure 0 0 0) 0x7f38000b9d90 con 0x7f381817c040 2024-02-21T07:58:54.511 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:54.511 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:57:46.332710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:58:54.511 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-02-21T07:58:54.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 msgr2=0x7f37f40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 0x7f37f40a1560 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3808009b40 tx=0x7f3808009190 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 msgr2=0x7f381816bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3800000c00 tx=0x7f3800004730 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 shutdown_connections 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3818188c00 0x7f381821dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f37f409f0a0 0x7f37f40a1560 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f381817c040 0x7f381816bfb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 --2- 172.21.15.100:0/672076239 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3818070f30 0x7f381821d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 >> 172.21.15.100:0/672076239 conn(0x7f38180ce160 msgr2=0x7f3818179860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 shutdown_connections 2024-02-21T07:58:54.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.512+0000 7f381e800640 1 -- 172.21.15.100:0/672076239 wait complete. 2024-02-21T07:58:54.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:58:54.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.744+0000 7f3bb7000640 1 Processor -- start 2024-02-21T07:58:54.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.744+0000 7f3bb7000640 1 -- start start 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.746+0000 7f3bb7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3bb00f9800 0x7f3bb0186510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.746+0000 7f3bb7000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00cb5d0 con 0x7f3bb0183f70 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.746+0000 7f3bb7000640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb006eec0 con 0x7f3bb01844e0 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.746+0000 7f3bb7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb006e390 con 0x7f3bb00f9800 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3bb5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3bb00f9800 0x7f3bb0186510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3ba7400640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f3bb01844e0 0x7f3bb00f90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40652/0 (socket says 172.21.15.100:40652) 2024-02-21T07:58:54.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3ba7400640 1 -- 172.21.15.100:0/878482098 learned_addr learned my addr 172.21.15.100:0/878482098 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 <== mon.2 v1:172.21.15.170:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721651875 0 0) 0x7f3bb006eec0 con 0x7f3bb01844e0 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 --> v1:172.21.15.170:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b94003520 con 0x7f3bb01844e0 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3bb5000640 1 -- 172.21.15.100:0/878482098 >> v1:172.21.15.170:6789/0 conn(0x7f3bb01844e0 legacy=0x7f3bb00f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3bb5000640 1 -- 172.21.15.100:0/878482098 >> v1:172.21.15.100:6789/0 conn(0x7f3bb0183f70 legacy=0x7f3bb006e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050833845 0 0) 0x7f3bb00cb5d0 con 0x7f3bb0183f70 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.747+0000 7f3bb5000640 1 -- 172.21.15.100:0/878482098 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00cbb00 con 0x7f3bb00f9800 2024-02-21T07:58:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.748+0000 7f3bb5000640 1 --2- 172.21.15.100:0/878482098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0186510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009d90 tx=0x7f3ba802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78df55bab96f3d49 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba802cbd0 con 0x7f3bb00f9800 2024-02-21T07:58:54.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3ba802cd30 con 0x7f3bb00f9800 2024-02-21T07:58:54.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3baf400640 1 -- 172.21.15.100:0/878482098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba802cea0 con 0x7f3bb00f9800 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 -- 172.21.15.100:0/878482098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 msgr2=0x7f3bb0186510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 --2- 172.21.15.100:0/878482098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0186510 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009d90 tx=0x7f3ba802be20 comp rx=0 tx=0).stop 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 -- 172.21.15.100:0/878482098 shutdown_connections 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 --2- 172.21.15.100:0/878482098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0186510 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 -- 172.21.15.100:0/878482098 >> 172.21.15.100:0/878482098 conn(0x7f3bb00ce160 msgr2=0x7f3bb00ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 -- 172.21.15.100:0/878482098 shutdown_connections 2024-02-21T07:58:54.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.749+0000 7f3bb7000640 1 -- 172.21.15.100:0/878482098 wait complete. 2024-02-21T07:58:54.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.751+0000 7f3bb7000640 1 Processor -- start 2024-02-21T07:58:54.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.752+0000 7f3bb7000640 1 -- start start 2024-02-21T07:58:54.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb0183f70 0x7f3bb00f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb01844e0 0x7f3bb00f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00f5090 con 0x7f3bb00f9800 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00f5370 con 0x7f3bb0183f70 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb7000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00f5650 con 0x7f3bb01844e0 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52712/0 (socket says 172.21.15.100:52712) 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bafe00640 1 -- 172.21.15.100:0/2412449295 learned_addr learned my addr 172.21.15.100:0/2412449295 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bb5000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb01844e0 0x7f3bb00f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3ba7400640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb0183f70 0x7f3bb00f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bafe00640 1 -- 172.21.15.100:0/2412449295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb01844e0 msgr2=0x7f3bb00f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.753+0000 7f3bafe00640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb01844e0 0x7f3bb00f4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bafe00640 1 -- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb0183f70 msgr2=0x7f3bb00f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bafe00640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb0183f70 0x7f3bb00f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bafe00640 1 -- 172.21.15.100:0/2412449295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba8009a70 con 0x7f3bb00f9800 2024-02-21T07:58:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bafe00640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c3c0 tx=0x7f3ba000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba00035f0 con 0x7f3bb00f9800 2024-02-21T07:58:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3ba0003770 con 0x7f3bb00f9800 2024-02-21T07:58:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0003b40 con 0x7f3bb00f9800 2024-02-21T07:58:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0187980 con 0x7f3bb00f9800 2024-02-21T07:58:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.754+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0187f40 con 0x7f3bb00f9800 2024-02-21T07:58:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.755+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb01877e0 con 0x7f3bb00f9800 2024-02-21T07:58:54.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.757+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3ba0003ca0 con 0x7f3bb00f9800 2024-02-21T07:58:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.758+0000 7f3bacc00640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 0x7f3b8c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.759+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3ba00c9160 con 0x7f3bb00f9800 2024-02-21T07:58:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.759+0000 7f3ba7400640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 0x7f3b8c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:54.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.759+0000 7f3ba7400640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 0x7f3b8c0a1560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d24d0 tx=0x7f3b98007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.763+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3bb01877e0 con 0x7f3bb00f9800 2024-02-21T07:58:54.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.998+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bb01877e0 con 0x7f3bb00f9800 2024-02-21T07:58:55.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:54.999+0000 7f3bacc00640 1 -- 172.21.15.100:0/2412449295 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11340 (secure 0 0 0) 0x7f3bb01877e0 con 0x7f3bb00f9800 2024-02-21T07:58:55.001 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:55.001 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/4248558030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":4248558030},{"type":"v1","addr":"172.21.15.156:6835","nonce":4248558030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/2378643625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":2378643625},{"type":"v1","addr":"172.21.15.156:6837","nonce":2378643625}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4315,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6840/1383449647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1383449647},{"type":"v1","addr":"172.21.15.156:6840","nonce":1383449647}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4321,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6841/4041519674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6839","nonce":4041519674},{"type":"v1","addr":"172.21.15.156:6841","nonce":4041519674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4322,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6833/3994333273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3994333273},{"type":"v1","addr":"172.21.15.170:6833","nonce":3994333273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/4145011984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":4145011984},{"type":"v1","addr":"172.21.15.170:6835","nonce":4145011984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:45:25.700152+0000","modified":"2024-02-21T07:57:46.332710+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4354,"mds_1":4352,"mds_2":4349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4333":{"gid":4333,"name":"i","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6837/2184142898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":2184142898},{"type":"v1","addr":"172.21.15.170:6837","nonce":2184142898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/541693286","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":541693286},{"type":"v1","addr":"172.21.15.170:6839","nonce":541693286}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/2969717403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":2969717403},{"type":"v1","addr":"172.21.15.100:6833","nonce":2969717403}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4349":{"gid":4349,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6835/224612086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":224612086},{"type":"v1","addr":"172.21.15.100:6835","nonce":224612086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":8,"addr":"172.21.15.100:6837/1627545450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1627545450},{"type":"v1","addr":"172.21.15.100:6837","nonce":1627545450}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4354":{"gid":4354,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/1953723394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1953723394},{"type":"v1","addr":"172.21.15.100:6839","nonce":1953723394}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:58:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 18 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 msgr2=0x7f3b8c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 0x7f3b8c0a1560 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d24d0 tx=0x7f3b98007d30 comp rx=0 tx=0).stop 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 msgr2=0x7f3bb0177cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000c3c0 tx=0x7f3ba000c880 comp rx=0 tx=0).stop 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 shutdown_connections 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb01844e0 0x7f3bb00f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3bb0183f70 0x7f3bb00f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3b8c09f0a0 0x7f3b8c0a1560 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 --2- 172.21.15.100:0/2412449295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bb00f9800 0x7f3bb0177cb0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.001+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 >> 172.21.15.100:0/2412449295 conn(0x7f3bb00ce160 msgr2=0x7f3bb0183140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.002+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 shutdown_connections 2024-02-21T07:58:55.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.002+0000 7f3bb7000640 1 -- 172.21.15.100:0/2412449295 wait complete. 2024-02-21T07:58:55.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:58:55.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.232+0000 7f1e5b000640 1 Processor -- start 2024-02-21T07:58:55.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.232+0000 7f1e5b000640 1 -- start start 2024-02-21T07:58:55.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e5b000640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f1e54183f70 0x7f1e541844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e5b000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e5406e7b0 0x7f1e540f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e5b000640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540cb5d0 con 0x7f1e5406ec10 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e5b000640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5406e390 con 0x7f1e54183f70 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e5b000640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e54187520 con 0x7f1e5406e7b0 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e53400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e5406e7b0 0x7f1e540f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e53400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f1e5406e7b0 0x7f1e540f90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.100:33374/0 (socket says 172.21.15.100:33374) 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e53400640 1 -- 172.21.15.100:0/3612976597 learned_addr learned my addr 172.21.15.100:0/3612976597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:55.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.234+0000 7f1e53e00640 1 --2- 172.21.15.100:0/3612976597 >> v2:172.21.15.156:3300/0 conn(0x7f1e54183f70 0x7f1e541844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e52a00640 1 -- 172.21.15.100:0/3612976597 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045574406 0 0) 0x7f1e540cb5d0 con 0x7f1e5406ec10 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e52a00640 1 -- 172.21.15.100:0/3612976597 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e38003520 con 0x7f1e5406ec10 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e53400640 1 -- 172.21.15.100:0/3612976597 >> v2:172.21.15.156:3300/0 conn(0x7f1e54183f70 msgr2=0x7f1e541844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e53400640 1 --2- 172.21.15.100:0/3612976597 >> v2:172.21.15.156:3300/0 conn(0x7f1e54183f70 0x7f1e541844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e53400640 1 -- 172.21.15.100:0/3612976597 >> v1:172.21.15.156:6789/0 conn(0x7f1e5406ec10 legacy=0x7f1e54189b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.235+0000 7f1e53400640 1 -- 172.21.15.100:0/3612976597 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540cbb00 con 0x7f1e5406e7b0 2024-02-21T07:58:55.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.236+0000 7f1e53400640 1 --2- 172.21.15.100:0/3612976597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e5406e7b0 0x7f1e540f90f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e540f4290 tx=0x7f1e4002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8116c68ff83323ef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.236+0000 7f1e52a00640 1 -- 172.21.15.100:0/3612976597 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40031870 con 0x7f1e5406e7b0 2024-02-21T07:58:55.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.236+0000 7f1e52a00640 1 -- 172.21.15.100:0/3612976597 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1e400319d0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.236+0000 7f1e52a00640 1 -- 172.21.15.100:0/3612976597 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40031d40 con 0x7f1e5406e7b0 2024-02-21T07:58:55.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 -- 172.21.15.100:0/3612976597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e5406e7b0 msgr2=0x7f1e540f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 --2- 172.21.15.100:0/3612976597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e5406e7b0 0x7f1e540f90f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1e540f4290 tx=0x7f1e4002b910 comp rx=0 tx=0).stop 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 -- 172.21.15.100:0/3612976597 shutdown_connections 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 --2- 172.21.15.100:0/3612976597 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e5406e7b0 0x7f1e540f90f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 --2- 172.21.15.100:0/3612976597 >> v2:172.21.15.156:3300/0 conn(0x7f1e54183f70 0x7f1e541844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 -- 172.21.15.100:0/3612976597 >> 172.21.15.100:0/3612976597 conn(0x7f1e540ce160 msgr2=0x7f1e540ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 -- 172.21.15.100:0/3612976597 shutdown_connections 2024-02-21T07:58:55.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.237+0000 7f1e5b000640 1 -- 172.21.15.100:0/3612976597 wait complete. 2024-02-21T07:58:55.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.239+0000 7f1e5b000640 1 Processor -- start 2024-02-21T07:58:55.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.239+0000 7f1e5b000640 1 -- start start 2024-02-21T07:58:55.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.240+0000 7f1e5b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.240+0000 7f1e5b000640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e5406ec10 0x7f1e54171090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e5b000640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e54183f70 0x7f1e54187d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e5b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e541878c0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e5b000640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540efb60 con 0x7f1e5406ec10 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e5b000640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540efe40 con 0x7f1e54183f70 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52716/0 (socket says 172.21.15.100:52716) 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 -- 172.21.15.100:0/746553741 learned_addr learned my addr 172.21.15.100:0/746553741 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53400640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e5406ec10 0x7f1e54171090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e59000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e54183f70 0x7f1e54187d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 -- 172.21.15.100:0/746553741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e54183f70 msgr2=0x7f1e54187d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e54183f70 0x7f1e54187d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 -- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e5406ec10 msgr2=0x7f1e54171090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e5406ec10 0x7f1e54171090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.241+0000 7f1e53e00640 1 -- 172.21.15.100:0/746553741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400094d0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e53e00640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e870 tx=0x7f1e4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440094f0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1e4400c940 con 0x7f1e5406e7b0 2024-02-21T07:58:55.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400cd10 con 0x7f1e5406e7b0 2024-02-21T07:58:55.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e540f0120 con 0x7f1e5406e7b0 2024-02-21T07:58:55.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.242+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540f06e0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.243+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e540f08d0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.245+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1e44013470 con 0x7f1e5406e7b0 2024-02-21T07:58:55.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.247+0000 7f1e4be00640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 0x7f1e340a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.247+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1e440c9cb0 con 0x7f1e5406e7b0 2024-02-21T07:58:55.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.247+0000 7f1e53400640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 0x7f1e340a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.248+0000 7f1e53400640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 0x7f1e340a1560 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e40036000 tx=0x7f1e4003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.251+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e44093a50 con 0x7f1e5406e7b0 2024-02-21T07:58:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.431+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e54067c80 con 0x7f1e5406e7b0 2024-02-21T07:58:55.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.434+0000 7f1e4be00640 1 -- 172.21.15.100:0/746553741 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23771 (secure 0 0 0) 0x7f1e44095980 con 0x7f1e5406e7b0 2024-02-21T07:58:55.436 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-02-21T07:58:55.436 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"b9cc1397-a437-4ace-98ff-c29f55191169","created":"2024-02-21T07:45:07.846086+0000","modified":"2024-02-21T07:46:13.519020+0000","last_up_change":"2024-02-21T07:45:18.920110+0000","last_in_change":"2024-02-21T07:45:11.388291+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:45:19.971603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:45:24.188294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:45:24.701198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:45:28.341392+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5087f197-fd25-4d04-8010-787a7afd62e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6801","nonce":2845630909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6803","nonce":2845630909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6807","nonce":2845630909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2845630909},{"type":"v1","addr":"172.21.15.100:6805","nonce":2845630909}]},"public_addr":"172.21.15.100:6801/2845630909","cluster_addr":"172.21.15.100:6803/2845630909","heartbeat_back_addr":"172.21.15.100:6807/2845630909","heartbeat_front_addr":"172.21.15.100:6805/2845630909","state":["exists","up"]},{"osd":1,"uuid":"a7ecb7d7-d016-4fd7-9323-b9a3be4887b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6819","nonce":499558575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6821","nonce":499558575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6825","nonce":499558575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":499558575},{"type":"v1","addr":"172.21.15.156:6823","nonce":499558575}]},"public_addr":"172.21.15.156:6819/499558575","cluster_addr":"172.21.15.156:6821/499558575","heartbeat_back_addr":"172.21.15.156:6825/499558575","heartbeat_front_addr":"172.21.15.156:6823/499558575","state":["exists","up"]},{"osd":2,"uuid":"da0beef3-d546-4996-9432-3f9e3f014ed2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6809","nonce":2385898437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6811","nonce":2385898437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6815","nonce":2385898437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2385898437},{"type":"v1","addr":"172.21.15.170:6813","nonce":2385898437}]},"public_addr":"172.21.15.170:6809/2385898437","cluster_addr":"172.21.15.170:6811/2385898437","heartbeat_back_addr":"172.21.15.170:6815/2385898437","heartbeat_front_addr":"172.21.15.170:6813/2385898437","state":["exists","up"]},{"osd":3,"uuid":"d3b9c560-7f82-4ac2-b55d-39b34315fc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6818","nonce":2187722631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6822","nonce":2187722631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6831","nonce":2187722631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6825","nonce":2187722631},{"type":"v1","addr":"172.21.15.100:6827","nonce":2187722631}]},"public_addr":"172.21.15.100:6818/2187722631","cluster_addr":"172.21.15.100:6822/2187722631","heartbeat_back_addr":"172.21.15.100:6831/2187722631","heartbeat_front_addr":"172.21.15.100:6827/2187722631","state":["exists","up"]},{"osd":4,"uuid":"2251e8ec-8c4e-405a-85f8-2974bbde76c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6811","nonce":3390829461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6813","nonce":3390829461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6817","nonce":3390829461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3390829461},{"type":"v1","addr":"172.21.15.156:6815","nonce":3390829461}]},"public_addr":"172.21.15.156:6811/3390829461","cluster_addr":"172.21.15.156:6813/3390829461","heartbeat_back_addr":"172.21.15.156:6817/3390829461","heartbeat_front_addr":"172.21.15.156:6815/3390829461","state":["exists","up"]},{"osd":5,"uuid":"fd91e9bc-7a56-4ff3-abde-4eee4ef470b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6817","nonce":106220500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6819","nonce":106220500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6823","nonce":106220500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":106220500},{"type":"v1","addr":"172.21.15.170:6821","nonce":106220500}]},"public_addr":"172.21.15.170:6817/106220500","cluster_addr":"172.21.15.170:6819/106220500","heartbeat_back_addr":"172.21.15.170:6823/106220500","heartbeat_front_addr":"172.21.15.170:6821/106220500","state":["exists","up"]},{"osd":6,"uuid":"24754c33-0e0a-406f-9ed3-bc812d10b6e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6809","nonce":3165398267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6811","nonce":3165398267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6815","nonce":3165398267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3165398267},{"type":"v1","addr":"172.21.15.100:6813","nonce":3165398267}]},"public_addr":"172.21.15.100:6809/3165398267","cluster_addr":"172.21.15.100:6811/3165398267","heartbeat_back_addr":"172.21.15.100:6815/3165398267","heartbeat_front_addr":"172.21.15.100:6813/3165398267","state":["exists","up"]},{"osd":7,"uuid":"2957fc8b-1094-46d8-bfb4-43cb3d6694c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6803","nonce":717840990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6805","nonce":717840990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6809","nonce":717840990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":717840990},{"type":"v1","addr":"172.21.15.156:6807","nonce":717840990}]},"public_addr":"172.21.15.156:6803/717840990","cluster_addr":"172.21.15.156:6805/717840990","heartbeat_back_addr":"172.21.15.156:6809/717840990","heartbeat_front_addr":"172.21.15.156:6807/717840990","state":["exists","up"]},{"osd":8,"uuid":"aea16fdd-0d2f-4db0-ba6d-05a20e15c645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6801","nonce":2369868004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6803","nonce":2369868004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6807","nonce":2369868004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2369868004},{"type":"v1","addr":"172.21.15.170:6805","nonce":2369868004}]},"public_addr":"172.21.15.170:6801/2369868004","cluster_addr":"172.21.15.170:6803/2369868004","heartbeat_back_addr":"172.21.15.170:6807/2369868004","heartbeat_front_addr":"172.21.15.170:6805/2369868004","state":["exists","up"]},{"osd":9,"uuid":"9ac5d21d-b0e0-41d5-b544-49602cdcd15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6819","nonce":4180078180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6821","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6823","nonce":4180078180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6829","nonce":4180078180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":4180078180},{"type":"v1","addr":"172.21.15.100:6826","nonce":4180078180}]},"public_addr":"172.21.15.100:6819/4180078180","cluster_addr":"172.21.15.100:6823/4180078180","heartbeat_back_addr":"172.21.15.100:6829/4180078180","heartbeat_front_addr":"172.21.15.100:6826/4180078180","state":["exists","up"]},{"osd":10,"uuid":"c1745981-51b6-4827-b1d9-030e5f5deecc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6827","nonce":196442047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6829","nonce":196442047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6833","nonce":196442047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":196442047},{"type":"v1","addr":"172.21.15.156:6831","nonce":196442047}]},"public_addr":"172.21.15.156:6827/196442047","cluster_addr":"172.21.15.156:6829/196442047","heartbeat_back_addr":"172.21.15.156:6833/196442047","heartbeat_front_addr":"172.21.15.156:6831/196442047","state":["exists","up"]},{"osd":11,"uuid":"0247d8a5-53aa-4031-b998-b413e831aa22","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6825","nonce":3451886285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6827","nonce":3451886285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6831","nonce":3451886285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":3451886285},{"type":"v1","addr":"172.21.15.170:6829","nonce":3451886285}]},"public_addr":"172.21.15.170:6825/3451886285","cluster_addr":"172.21.15.170:6827/3451886285","heartbeat_back_addr":"172.21.15.170:6831/3451886285","heartbeat_front_addr":"172.21.15.170:6829/3451886285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.675164+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.618709+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.568322+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.414597+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.539722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.534576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.666019+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.546398+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.563598+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.670090+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.654325+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:45:16.588691+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":5,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":10}]},{"pgid":"4.17","mappings":[{"from":9,"to":8}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 msgr2=0x7f1e340a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 0x7f1e340a1560 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1e40036000 tx=0x7f1e4003c040 comp rx=0 tx=0).stop 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 msgr2=0x7f1e540ef2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e870 tx=0x7f1e4400ed30 comp rx=0 tx=0).stop 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 shutdown_connections 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e54183f70 0x7f1e54187d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.437+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1e5406ec10 0x7f1e54171090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.438+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f1e3409f0a0 0x7f1e340a1560 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.438+0000 7f1e5b000640 1 --2- 172.21.15.100:0/746553741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e5406e7b0 0x7f1e540ef2c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.438+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 >> 172.21.15.100:0/746553741 conn(0x7f1e540ce160 msgr2=0x7f1e540cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.438+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 shutdown_connections 2024-02-21T07:58:55.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.438+0000 7f1e5b000640 1 -- 172.21.15.100:0/746553741 wait complete. 2024-02-21T07:58:55.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-21T07:58:55.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.659+0000 7f5e19c00640 1 Processor -- start 2024-02-21T07:58:55.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.659+0000 7f5e19c00640 1 -- start start 2024-02-21T07:58:55.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e140cb800 0x7f5e140f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e140cac60 con 0x7f5e140f94b0 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19c00640 1 -- --> v1:172.21.15.170:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1406e830 con 0x7f5e1417d0b0 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1417d490 con 0x7f5e140cb800 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e13400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e140cb800 0x7f5e140f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5e140f94b0 0x7f5e1406d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39526/0 (socket says 172.21.15.100:39526) 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e13e00640 1 --1- >> v1:172.21.15.170:6789/0 conn(0x7f5e1417d0b0 0x7f5e140cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.170:6789/0 says I am v1:172.21.15.100:40660/0 (socket says 172.21.15.100:40660) 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.661+0000 7f5e19200640 1 -- 172.21.15.100:0/2671803637 learned_addr learned my addr 172.21.15.100:0/2671803637 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.662+0000 7f5e13400640 1 -- 172.21.15.100:0/2671803637 >> v1:172.21.15.170:6789/0 conn(0x7f5e1417d0b0 legacy=0x7f5e140cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.662+0000 7f5e13400640 1 -- 172.21.15.100:0/2671803637 >> v1:172.21.15.100:6789/0 conn(0x7f5e140f94b0 legacy=0x7f5e1406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.662+0000 7f5e13400640 1 -- 172.21.15.100:0/2671803637 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1406eb10 con 0x7f5e140cb800 2024-02-21T07:58:55.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.662+0000 7f5e12a00640 1 -- 172.21.15.100:0/2671803637 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528351248 0 0) 0x7f5e140cac60 con 0x7f5e140f94b0 2024-02-21T07:58:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.663+0000 7f5e13400640 1 --2- 172.21.15.100:0/2671803637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e140f8f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5e000097a0 tx=0x7f5e0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75da78785cce3d77 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.663+0000 7f5e12a00640 1 -- 172.21.15.100:0/2671803637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00030610 con 0x7f5e140cb800 2024-02-21T07:58:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.663+0000 7f5e12a00640 1 -- 172.21.15.100:0/2671803637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e00030770 con 0x7f5e140cb800 2024-02-21T07:58:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.663+0000 7f5e12a00640 1 -- 172.21.15.100:0/2671803637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00030b20 con 0x7f5e140cb800 2024-02-21T07:58:55.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 -- 172.21.15.100:0/2671803637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 msgr2=0x7f5e140f8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 --2- 172.21.15.100:0/2671803637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e140f8f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5e000097a0 tx=0x7f5e0002b960 comp rx=0 tx=0).stop 2024-02-21T07:58:55.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 -- 172.21.15.100:0/2671803637 shutdown_connections 2024-02-21T07:58:55.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 --2- 172.21.15.100:0/2671803637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e140f8f70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 -- 172.21.15.100:0/2671803637 >> 172.21.15.100:0/2671803637 conn(0x7f5e140ce150 msgr2=0x7f5e140ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:55.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 -- 172.21.15.100:0/2671803637 shutdown_connections 2024-02-21T07:58:55.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.664+0000 7f5e19c00640 1 -- 172.21.15.100:0/2671803637 wait complete. 2024-02-21T07:58:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.667+0000 7f5e19c00640 1 Processor -- start 2024-02-21T07:58:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.667+0000 7f5e19c00640 1 -- start start 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e140f94b0 0x7f5e142221e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e1417d0b0 0x7f5e14222720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140cdbf0 con 0x7f5e140cb800 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1420f9b0 con 0x7f5e140f94b0 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e19c00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1420fc90 con 0x7f5e1417d0b0 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52728/0 (socket says 172.21.15.100:52728) 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e13e00640 1 -- 172.21.15.100:0/3528673768 learned_addr learned my addr 172.21.15.100:0/3528673768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.668+0000 7f5e13400640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e140f94b0 0x7f5e142221e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e19200640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e1417d0b0 0x7f5e14222720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 -- 172.21.15.100:0/3528673768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e1417d0b0 msgr2=0x7f5e14222720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e1417d0b0 0x7f5e14222720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 -- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e140f94b0 msgr2=0x7f5e142221e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e140f94b0 0x7f5e142221e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 -- 172.21.15.100:0/3528673768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00009400 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e13e00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c4d0 tx=0x7f5e0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04007480 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e040075e0 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1420ff70 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.669+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e040049e0 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.670+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e141894a0 con 0x7f5e140cb800 2024-02-21T07:58:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.671+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e14210490 con 0x7f5e140cb800 2024-02-21T07:58:55.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.673+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5e04004b40 con 0x7f5e140cb800 2024-02-21T07:58:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.675+0000 7f5e0be00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 0x7f5df40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.676+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5e040c9080 con 0x7f5e140cb800 2024-02-21T07:58:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.676+0000 7f5e13400640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 0x7f5df40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.676+0000 7f5e13400640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 0x7f5df40a1560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5e00036000 tx=0x7f5e00008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:55.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.681+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5e040fc8c0 con 0x7f5e140cb800 2024-02-21T07:58:55.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.917+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e140751d0 con 0x7f5e140cb800 2024-02-21T07:58:55.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.921+0000 7f5e0be00640 1 -- 172.21.15.100:0/3528673768 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e04018020 con 0x7f5e140cb800 2024-02-21T07:58:55.923 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-21T07:58:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.928+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 msgr2=0x7f5df40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.929+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 0x7f5df40a1560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5e00036000 tx=0x7f5e00008030 comp rx=0 tx=0).stop 2024-02-21T07:58:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.929+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 msgr2=0x7f5e14188f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:55.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.929+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400c4d0 tx=0x7f5e0400c990 comp rx=0 tx=0).stop 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 shutdown_connections 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5e1417d0b0 0x7f5e14222720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e140f94b0 0x7f5e142221e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5df409f0a0 0x7f5df40a1560 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 --2- 172.21.15.100:0/3528673768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e140cb800 0x7f5e14188f60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.931+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 >> 172.21.15.100:0/3528673768 conn(0x7f5e140ce150 msgr2=0x7f5e140f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:55.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.932+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 shutdown_connections 2024-02-21T07:58:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:55.932+0000 7f5e19c00640 1 -- 172.21.15.100:0/3528673768 wait complete. 2024-02-21T07:58:55.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-21T07:58:56.004 INFO:tasks.ceph.mds.l.smithi170.stdout:starting mds.l at 2024-02-21T07:58:56.005 INFO:tasks.ceph.mds.i.smithi170.stdout:starting mds.i at 2024-02-21T07:58:56.038 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-02-21T07:58:56.047 INFO:tasks.ceph.mds.g.smithi100.stdout:starting mds.g at 2024-02-21T07:58:56.048 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-02-21T07:58:56.049 INFO:tasks.ceph.mds.j.smithi100.stdout:starting mds.j at 2024-02-21T07:58:56.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.143+0000 7f7695600640 1 Processor -- start 2024-02-21T07:58:56.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.143+0000 7f7695600640 1 -- start start 2024-02-21T07:58:56.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f7695600640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7690184000 0x7f76900711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f7695600640 1 --2- >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 0x7f76901880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f7695600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7690184470 con 0x7f7690183c20 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f7695600640 1 -- --> v2:172.21.15.156:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7690072a90 con 0x7f7690187c90 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f7695600640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769006f520 con 0x7f7690184000 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768e000640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f7690184000 0x7f76900711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7690183c20 0x7f769006ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39568/0 (socket says 172.21.15.100:39568) 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768ea00640 1 -- 172.21.15.100:0/1401764165 learned_addr learned my addr 172.21.15.100:0/1401764165 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768f400640 1 --2- 172.21.15.100:0/1401764165 >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 0x7f76901880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768e000640 1 -- 172.21.15.100:0/1401764165 >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 msgr2=0x7f76901880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768e000640 1 --2- 172.21.15.100:0/1401764165 >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 0x7f76901880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768e000640 1 -- 172.21.15.100:0/1401764165 >> v1:172.21.15.100:6789/0 conn(0x7f7690183c20 legacy=0x7f769006ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768e000640 1 -- 172.21.15.100:0/1401764165 --> v2:172.21.15.170:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690072eb0 con 0x7f7690184000 2024-02-21T07:58:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.145+0000 7f768f400640 1 --2- 172.21.15.100:0/1401764165 >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 0x7f76901880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:56.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.146+0000 7f768e000640 1 --2- 172.21.15.100:0/1401764165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f76900711f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f76900fd010 tx=0x7f767c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca135dd4d2a03cb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f768d600640 1 -- 172.21.15.100:0/1401764165 <== mon.2 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c02e070 con 0x7f7690184000 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f768d600640 1 -- 172.21.15.100:0/1401764165 <== mon.2 v2:172.21.15.170:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f767c0315a0 con 0x7f7690184000 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f768d600640 1 -- 172.21.15.100:0/1401764165 <== mon.2 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c031950 con 0x7f7690184000 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 -- 172.21.15.100:0/1401764165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 msgr2=0x7f76900711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 --2- 172.21.15.100:0/1401764165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f76900711f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f76900fd010 tx=0x7f767c02b840 comp rx=0 tx=0).stop 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 -- 172.21.15.100:0/1401764165 shutdown_connections 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 --2- 172.21.15.100:0/1401764165 >> v2:172.21.15.156:3300/0 conn(0x7f7690187c90 0x7f76901880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 --2- 172.21.15.100:0/1401764165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f76900711f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 -- 172.21.15.100:0/1401764165 >> 172.21.15.100:0/1401764165 conn(0x7f769006ab60 msgr2=0x7f769006af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 -- 172.21.15.100:0/1401764165 shutdown_connections 2024-02-21T07:58:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.147+0000 7f7695600640 1 -- 172.21.15.100:0/1401764165 wait complete. 2024-02-21T07:58:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.149+0000 7f7695600640 1 Processor -- start 2024-02-21T07:58:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.149+0000 7f7695600640 1 -- start start 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.150+0000 7f7695600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.150+0000 7f7695600640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f769021e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.150+0000 7f7695600640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7690187c90 0x7f769021ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f7695600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769021ce10 con 0x7f7690183c20 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f7695600640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769021d460 con 0x7f7690187c90 2024-02-21T07:58:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f7695600640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769021d740 con 0x7f7690184000 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52828/0 (socket says 172.21.15.100:52828) 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 -- 172.21.15.100:0/197835726 learned_addr learned my addr 172.21.15.100:0/197835726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768e000640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f769021e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768f400640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7690187c90 0x7f769021ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 -- 172.21.15.100:0/197835726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 msgr2=0x7f769021e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f769021e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 -- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7690187c90 msgr2=0x7f769021ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7690187c90 0x7f769021ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 -- 172.21.15.100:0/197835726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009400 con 0x7f7690183c20 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.151+0000 7f768ea00640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f768000cb10 tx=0x7f768000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.152+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768000ac70 con 0x7f7690183c20 2024-02-21T07:58:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.152+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f768000add0 con 0x7f7690183c20 2024-02-21T07:58:56.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.152+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680012640 con 0x7f7690183c20 2024-02-21T07:58:56.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.152+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769021da20 con 0x7f7690183c20 2024-02-21T07:58:56.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.152+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769021dfe0 con 0x7f7690183c20 2024-02-21T07:58:56.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.153+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7690067c80 con 0x7f7690183c20 2024-02-21T07:58:56.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.155+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7680007070 con 0x7f7690183c20 2024-02-21T07:58:56.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.157+0000 7f7686a00640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 0x7f76700a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:56.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.157+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8746+0+0 (secure 0 0 0) 0x7f76800c9a90 con 0x7f7690183c20 2024-02-21T07:58:56.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.157+0000 7f768e000640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 0x7f76700a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:56.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.158+0000 7f768e000640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 0x7f76700a1560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f767c036000 tx=0x7f767c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:56.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.161+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7680093730 con 0x7f7690183c20 2024-02-21T07:58:56.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.391+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7690184470 con 0x7f7690183c20 2024-02-21T07:58:56.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.931+0000 7f7686a00640 1 -- 172.21.15.100:0/197835726 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7690184470 con 0x7f7690183c20 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 msgr2=0x7f76700a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 0x7f76700a1560 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f767c036000 tx=0x7f767c03d040 comp rx=0 tx=0).stop 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 msgr2=0x7f769015b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f768000cb10 tx=0x7f768000a060 comp rx=0 tx=0).stop 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 shutdown_connections 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7690187c90 0x7f769021ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7690184000 0x7f769021e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f767009f0a0 0x7f76700a1560 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 --2- 172.21.15.100:0/197835726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7690183c20 0x7f769015b690 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:56.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 >> 172.21.15.100:0/197835726 conn(0x7f769006ab60 msgr2=0x7f769006af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:56.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 shutdown_connections 2024-02-21T07:58:56.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:56.935+0000 7f7695600640 1 -- 172.21.15.100:0/197835726 wait complete. 2024-02-21T07:58:56.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-21T07:58:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.156+0000 7f5d68400640 1 Processor -- start 2024-02-21T07:58:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.156+0000 7f5d68400640 1 -- start start 2024-02-21T07:58:57.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d68400640 1 --2- >> v2:172.21.15.170:3300/0 conn(0x7f5d6015dc10 0x7f5d60189240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d68400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d600d2020 0x7f5d600d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d68400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d60189e50 con 0x7f5d600d29c0 2024-02-21T07:58:57.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d68400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600d2e60 con 0x7f5d600d2020 2024-02-21T07:58:57.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d68400640 1 -- --> v2:172.21.15.170:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d600d3140 con 0x7f5d6015dc10 2024-02-21T07:58:57.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d65000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d600d2020 0x7f5d600d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d66400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5d600d29c0 0x7f5d6018a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39576/0 (socket says 172.21.15.100:39576) 2024-02-21T07:58:57.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d66400640 1 -- 172.21.15.100:0/3763101664 learned_addr learned my addr 172.21.15.100:0/3763101664 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:57.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.158+0000 7f5d65a00640 1 --2- 172.21.15.100:0/3763101664 >> v2:172.21.15.170:3300/0 conn(0x7f5d6015dc10 0x7f5d60189240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d5fe00640 1 -- 172.21.15.100:0/3763101664 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724916668 0 0) 0x7f5d60189e50 con 0x7f5d600d29c0 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d5fe00640 1 -- 172.21.15.100:0/3763101664 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d48003520 con 0x7f5d600d29c0 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d65000640 1 -- 172.21.15.100:0/3763101664 >> v2:172.21.15.170:3300/0 conn(0x7f5d6015dc10 msgr2=0x7f5d60189240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d65000640 1 --2- 172.21.15.100:0/3763101664 >> v2:172.21.15.170:3300/0 conn(0x7f5d6015dc10 0x7f5d60189240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d65000640 1 -- 172.21.15.100:0/3763101664 >> v1:172.21.15.100:6789/0 conn(0x7f5d600d29c0 legacy=0x7f5d6018a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.159+0000 7f5d65000640 1 -- 172.21.15.100:0/3763101664 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600d3420 con 0x7f5d600d2020 2024-02-21T07:58:57.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.160+0000 7f5d65000640 1 --2- 172.21.15.100:0/3763101664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d2020 0x7f5d600d2480 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d600f9b50 tx=0x7f5d4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b88a31640f5c107 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:57.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.160+0000 7f5d5fe00640 1 -- 172.21.15.100:0/3763101664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c02e070 con 0x7f5d600d2020 2024-02-21T07:58:57.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.160+0000 7f5d5fe00640 1 -- 172.21.15.100:0/3763101664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d4c0315a0 con 0x7f5d600d2020 2024-02-21T07:58:57.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.160+0000 7f5d5fe00640 1 -- 172.21.15.100:0/3763101664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c031950 con 0x7f5d600d2020 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 -- 172.21.15.100:0/3763101664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d2020 msgr2=0x7f5d600d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 --2- 172.21.15.100:0/3763101664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d2020 0x7f5d600d2480 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5d600f9b50 tx=0x7f5d4c02b840 comp rx=0 tx=0).stop 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 -- 172.21.15.100:0/3763101664 shutdown_connections 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 --2- 172.21.15.100:0/3763101664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d2020 0x7f5d600d2480 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 --2- 172.21.15.100:0/3763101664 >> v2:172.21.15.170:3300/0 conn(0x7f5d6015dc10 0x7f5d60189240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 -- 172.21.15.100:0/3763101664 >> 172.21.15.100:0/3763101664 conn(0x7f5d600d0520 msgr2=0x7f5d600d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 -- 172.21.15.100:0/3763101664 shutdown_connections 2024-02-21T07:58:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.161+0000 7f5d68400640 1 -- 172.21.15.100:0/3763101664 wait complete. 2024-02-21T07:58:57.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.163+0000 7f5d68400640 1 Processor -- start 2024-02-21T07:58:57.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.163+0000 7f5d68400640 1 -- start start 2024-02-21T07:58:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d600d2020 0x7f5d60158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6015dc10 0x7f5d60187630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d601871a0 con 0x7f5d600d29c0 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60179120 con 0x7f5d600d2020 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.164+0000 7f5d68400640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d60186870 con 0x7f5d6015dc10 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52848/0 (socket says 172.21.15.100:52848) 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 -- 172.21.15.100:0/4273811191 learned_addr learned my addr 172.21.15.100:0/4273811191 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d66400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6015dc10 0x7f5d60187630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65a00640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d600d2020 0x7f5d60158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 -- 172.21.15.100:0/4273811191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6015dc10 msgr2=0x7f5d60187630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6015dc10 0x7f5d60187630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 -- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d600d2020 msgr2=0x7f5d60158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d600d2020 0x7f5d60158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.165+0000 7f5d65000640 1 -- 172.21.15.100:0/4273811191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c009400 con 0x7f5d600d29c0 2024-02-21T07:58:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d65000640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009890 tx=0x7f5d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c031f10 con 0x7f5d600d29c0 2024-02-21T07:58:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d4c032860 con 0x7f5d600d29c0 2024-02-21T07:58:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c032c30 con 0x7f5d600d29c0 2024-02-21T07:58:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d60186b50 con 0x7f5d600d29c0 2024-02-21T07:58:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.166+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d60158d50 con 0x7f5d600d29c0 2024-02-21T07:58:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.167+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d60068390 con 0x7f5d600d29c0 2024-02-21T07:58:57.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.169+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5d4c03b3f0 con 0x7f5d600d29c0 2024-02-21T07:58:57.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.170+0000 7f5d5d600640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 0x7f5d400a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:57.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.170+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8746+0+0 (secure 0 0 0) 0x7f5d4c0ebc70 con 0x7f5d600d29c0 2024-02-21T07:58:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.171+0000 7f5d65a00640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 0x7f5d400a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.172+0000 7f5d65a00640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 0x7f5d400a1560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5d6015a280 tx=0x7f5d54009190 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:57.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.174+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d4c0b5860 con 0x7f5d600d29c0 2024-02-21T07:58:57.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.368+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d6018a850 con 0x7f5d600d29c0 2024-02-21T07:58:57.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.942+0000 7f5d5d600640 1 -- 172.21.15.100:0/4273811191 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5d4c0b7790 con 0x7f5d600d29c0 2024-02-21T07:58:57.944 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-02-21T07:58:57.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.947+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 msgr2=0x7f5d400a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.947+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 0x7f5d400a1560 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5d6015a280 tx=0x7f5d54009190 comp rx=0 tx=0).stop 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.947+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 msgr2=0x7f5d601880c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.947+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c009890 tx=0x7f5d4c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 shutdown_connections 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5d6015dc10 0x7f5d60187630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f5d4009f0a0 0x7f5d400a1560 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d600d29c0 0x7f5d601880c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 --2- 172.21.15.100:0/4273811191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d600d2020 0x7f5d60158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:57.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.948+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 >> 172.21.15.100:0/4273811191 conn(0x7f5d600d0520 msgr2=0x7f5d600d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:57.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.949+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 shutdown_connections 2024-02-21T07:58:57.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:57.950+0000 7f5d68400640 1 -- 172.21.15.100:0/4273811191 wait complete. 2024-02-21T07:58:57.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-21T07:58:58.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.176+0000 7f0de1a00640 1 Processor -- start 2024-02-21T07:58:58.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.176+0000 7f0de1a00640 1 -- start start 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.177+0000 7f0de1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0ddc189680 0x7f0ddc0f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.177+0000 7f0de1a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc070fa0 con 0x7f0ddc072600 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.177+0000 7f0de1a00640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc071280 con 0x7f0ddc188b90 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.177+0000 7f0de1a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc071560 con 0x7f0ddc189680 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dd2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0ddc072600 0x7f0ddc188f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39582/0 (socket says 172.21.15.100:39582) 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dd2000640 1 -- 172.21.15.100:0/2699928403 learned_addr learned my addr 172.21.15.100:0/2699928403 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:58.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0ddb400640 1 --2- 172.21.15.100:0/2699928403 >> v2:172.21.15.100:3300/0 conn(0x7f0ddc189680 0x7f0ddc0f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488219760 0 0) 0x7f0ddc070fa0 con 0x7f0ddc072600 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc0005730 con 0x7f0ddc072600 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638772928 0 0) 0x7f0ddc071280 con 0x7f0ddc188b90 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 --> v1:172.21.15.156:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ddc070fa0 con 0x7f0ddc188b90 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0ddb400640 1 -- 172.21.15.100:0/2699928403 >> v1:172.21.15.156:6789/0 conn(0x7f0ddc188b90 legacy=0x7f0ddc183510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0ddb400640 1 -- 172.21.15.100:0/2699928403 >> v1:172.21.15.100:6789/0 conn(0x7f0ddc072600 legacy=0x7f0ddc188f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.178+0000 7f0ddb400640 1 -- 172.21.15.100:0/2699928403 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc071840 con 0x7f0ddc189680 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0ddb400640 1 --2- 172.21.15.100:0/2699928403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc189680 0x7f0ddc0f90a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e237827dcbd5aaf4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd402cc60 con 0x7f0ddc189680 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0dd402cdc0 con 0x7f0ddc189680 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0dda000640 1 -- 172.21.15.100:0/2699928403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4034680 con 0x7f0ddc189680 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0de1a00640 1 -- 172.21.15.100:0/2699928403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc189680 msgr2=0x7f0ddc0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.180+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2699928403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc189680 0x7f0ddc0f90a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009d90 tx=0x7f0dd402beb0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.181+0000 7f0de1a00640 1 -- 172.21.15.100:0/2699928403 shutdown_connections 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.181+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2699928403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc189680 0x7f0ddc0f90a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.181+0000 7f0de1a00640 1 -- 172.21.15.100:0/2699928403 >> 172.21.15.100:0/2699928403 conn(0x7f0ddc0668b0 msgr2=0x7f0ddc066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.181+0000 7f0de1a00640 1 -- 172.21.15.100:0/2699928403 shutdown_connections 2024-02-21T07:58:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.181+0000 7f0de1a00640 1 -- 172.21.15.100:0/2699928403 wait complete. 2024-02-21T07:58:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.183+0000 7f0de1a00640 1 Processor -- start 2024-02-21T07:58:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.183+0000 7f0de1a00640 1 -- start start 2024-02-21T07:58:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ddc072600 0x7f0ddc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 0x7f0ddc154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc17ad10 con 0x7f0ddc188b90 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc179e60 con 0x7f0ddc189680 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0de1a00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc17a100 con 0x7f0ddc072600 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0dd2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0dd2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52874/0 (socket says 172.21.15.100:52874) 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0dd2000640 1 -- 172.21.15.100:0/2831896537 learned_addr learned my addr 172.21.15.100:0/2831896537 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0ddb400640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 0x7f0ddc154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.184+0000 7f0ddaa00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ddc072600 0x7f0ddc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 -- 172.21.15.100:0/2831896537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ddc072600 msgr2=0x7f0ddc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ddc072600 0x7f0ddc0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 -- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 msgr2=0x7f0ddc154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 0x7f0ddc154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 -- 172.21.15.100:0/2831896537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd4009a70 con 0x7f0ddc188b90 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0ddb400640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 0x7f0ddc154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:58:58.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd2000640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c450 tx=0x7f0dc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4005da0 con 0x7f0ddc188b90 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0dc4007070 con 0x7f0ddc188b90 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4007420 con 0x7f0ddc188b90 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc17a3e0 con 0x7f0ddc188b90 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.185+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc17a9a0 con 0x7f0ddc188b90 2024-02-21T07:58:58.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.187+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc17aec0 con 0x7f0ddc188b90 2024-02-21T07:58:58.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.188+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0dc4007580 con 0x7f0ddc188b90 2024-02-21T07:58:58.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.190+0000 7f0dd3400640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 0x7f0db80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:58.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.191+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8308+0+0 (secure 0 0 0) 0x7f0dc40c9180 con 0x7f0ddc188b90 2024-02-21T07:58:58.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.191+0000 7f0ddaa00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 0x7f0db80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:58.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.192+0000 7f0ddaa00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 0x7f0db80a1560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0011e0 tx=0x7f0dcc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:58.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.195+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0ddc17aec0 con 0x7f0ddc188b90 2024-02-21T07:58:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.394+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ddc067c80 con 0x7f0ddc188b90 2024-02-21T07:58:58.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.945+0000 7f0dd3400640 1 -- 172.21.15.100:0/2831896537 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0dc4092f20 con 0x7f0ddc188b90 2024-02-21T07:58:58.947 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 msgr2=0x7f0db80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 0x7f0db80a1560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0011e0 tx=0x7f0dcc009040 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 msgr2=0x7f0ddc17d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c450 tx=0x7f0dc400c910 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 shutdown_connections 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ddc189680 0x7f0ddc154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f0db809f0a0 0x7f0db80a1560 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ddc188b90 0x7f0ddc17d400 secure :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c450 tx=0x7f0dc400c910 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 --2- 172.21.15.100:0/2831896537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0ddc072600 0x7f0ddc0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:58.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.950+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 >> 172.21.15.100:0/2831896537 conn(0x7f0ddc0668b0 msgr2=0x7f0ddc184190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.953+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 shutdown_connections 2024-02-21T07:58:58.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:58.954+0000 7f0de1a00640 1 -- 172.21.15.100:0/2831896537 wait complete. 2024-02-21T07:58:58.986 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-02-21T07:58:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.179+0000 7f3a83200640 1 Processor -- start 2024-02-21T07:58:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.180+0000 7f3a83200640 1 -- start start 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.181+0000 7f3a83200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a84183320 0x7f3a840f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a83200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840f48e0 con 0x7f3a840f6110 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a83200640 1 -- --> v1:172.21.15.156:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840f4b30 con 0x7f3a84182d30 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a83200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a84161480 con 0x7f3a84183320 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a81400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a84183320 0x7f3a840f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a82800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3a840f6110 0x7f3a8406d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39588/0 (socket says 172.21.15.100:39588) 2024-02-21T07:58:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a82800640 1 -- 172.21.15.100:0/557859668 learned_addr learned my addr 172.21.15.100:0/557859668 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-02-21T07:58:59.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a80a00640 1 -- 172.21.15.100:0/557859668 <== mon.1 v1:172.21.15.156:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174952144 0 0) 0x7f3a840f4b30 con 0x7f3a84182d30 2024-02-21T07:58:59.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a81400640 1 -- 172.21.15.100:0/557859668 >> v1:172.21.15.156:6789/0 conn(0x7f3a84182d30 legacy=0x7f3a84160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a81400640 1 -- 172.21.15.100:0/557859668 >> v1:172.21.15.100:6789/0 conn(0x7f3a840f6110 legacy=0x7f3a8406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.182+0000 7f3a81400640 1 -- 172.21.15.100:0/557859668 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840f4e10 con 0x7f3a84183320 2024-02-21T07:58:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.184+0000 7f3a81400640 1 --2- 172.21.15.100:0/557859668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a840f5bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c02bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beae2dd93fd25e27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.184+0000 7f3a80a00640 1 -- 172.21.15.100:0/557859668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c02c990 con 0x7f3a84183320 2024-02-21T07:58:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.184+0000 7f3a80a00640 1 -- 172.21.15.100:0/557859668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3a6c02caf0 con 0x7f3a84183320 2024-02-21T07:58:59.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.184+0000 7f3a80a00640 1 -- 172.21.15.100:0/557859668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c02cea0 con 0x7f3a84183320 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 -- 172.21.15.100:0/557859668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 msgr2=0x7f3a840f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 --2- 172.21.15.100:0/557859668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a840f5bd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c02bc60 comp rx=0 tx=0).stop 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 -- 172.21.15.100:0/557859668 shutdown_connections 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 --2- 172.21.15.100:0/557859668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a840f5bd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 -- 172.21.15.100:0/557859668 >> 172.21.15.100:0/557859668 conn(0x7f3a840f6580 msgr2=0x7f3a840f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 -- 172.21.15.100:0/557859668 shutdown_connections 2024-02-21T07:58:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.185+0000 7f3a83200640 1 -- 172.21.15.100:0/557859668 wait complete. 2024-02-21T07:58:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.187+0000 7f3a83200640 1 Processor -- start 2024-02-21T07:58:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.187+0000 7f3a83200640 1 -- start start 2024-02-21T07:58:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840f6110 0x7f3a84180550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84182d30 0x7f3a841777d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8415cb30 con 0x7f3a84183320 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840f0790 con 0x7f3a840f6110 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.188+0000 7f3a83200640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840efc10 con 0x7f3a84182d30 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52894/0 (socket says 172.21.15.100:52894) 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 -- 172.21.15.100:0/4009557540 learned_addr learned my addr 172.21.15.100:0/4009557540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a81400640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84182d30 0x7f3a841777d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a81e00640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840f6110 0x7f3a84180550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 -- 172.21.15.100:0/4009557540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84182d30 msgr2=0x7f3a841777d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84182d30 0x7f3a841777d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 -- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840f6110 msgr2=0x7f3a84180550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840f6110 0x7f3a84180550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 -- 172.21.15.100:0/4009557540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c009a70 con 0x7f3a84183320 2024-02-21T07:58:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.189+0000 7f3a82800640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00c780 tx=0x7f3a7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.190+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0072d0 con 0x7f3a84183320 2024-02-21T07:58:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.190+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3a7c007430 con 0x7f3a84183320 2024-02-21T07:58:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.190+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a840efef0 con 0x7f3a84183320 2024-02-21T07:58:59.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.190+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0047e0 con 0x7f3a84183320 2024-02-21T07:58:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.190+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a840f04b0 con 0x7f3a84183320 2024-02-21T07:58:59.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.191+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84067c80 con 0x7f3a84183320 2024-02-21T07:58:59.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.193+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3a7c004940 con 0x7f3a84183320 2024-02-21T07:58:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.195+0000 7f3a7a000640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 0x7f3a600a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:58:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.195+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7894+0+0 (secure 0 0 0) 0x7f3a7c0c8f00 con 0x7f3a84183320 2024-02-21T07:58:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.195+0000 7f3a81e00640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 0x7f3a600a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:58:59.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.196+0000 7f3a81e00640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 0x7f3a600a1560 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3a84184d70 tx=0x7f3a74009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:58:59.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.200+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a7c096b60 con 0x7f3a84183320 2024-02-21T07:58:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.395+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a84185190 con 0x7f3a84183320 2024-02-21T07:58:59.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.973+0000 7f3a7a000640 1 -- 172.21.15.100:0/4009557540 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3a7c018020 con 0x7f3a84183320 2024-02-21T07:58:59.975 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' removed 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.976+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 msgr2=0x7f3a600a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.976+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 0x7f3a600a1560 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3a84184d70 tx=0x7f3a74009040 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 msgr2=0x7f3a84177d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00c780 tx=0x7f3a7c00cc40 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 shutdown_connections 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:6800/1289369955,v1:172.21.15.156:6801/1289369955] conn(0x7f3a6009f0a0 0x7f3a600a1560 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a84183320 0x7f3a84177d10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a84182d30 0x7f3a841777d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 --2- 172.21.15.100:0/4009557540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3a840f6110 0x7f3a84180550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:58:59.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.977+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 >> 172.21.15.100:0/4009557540 conn(0x7f3a840f6580 msgr2=0x7f3a840f6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:58:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.979+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 shutdown_connections 2024-02-21T07:58:59.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-02-21T07:58:59.979+0000 7f3a83200640 1 -- 172.21.15.100:0/4009557540 wait complete. 2024-02-21T07:59:00.015 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-21T07:59:00.015 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-21T07:59:00.015 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.047 INFO:tasks.ceph.mds.a:Stopped 2024-02-21T07:59:00.047 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-21T07:59:00.047 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.106 INFO:tasks.ceph.mds.d:Stopped 2024-02-21T07:59:00.106 DEBUG:tasks.ceph.mds.g:waiting for process to exit 2024-02-21T07:59:00.106 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.167 INFO:tasks.ceph.mds.g:Stopped 2024-02-21T07:59:00.167 DEBUG:tasks.ceph.mds.j:waiting for process to exit 2024-02-21T07:59:00.168 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.228 INFO:tasks.ceph.mds.j:Stopped 2024-02-21T07:59:00.228 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-21T07:59:00.228 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.237 INFO:tasks.ceph.mds.b:Stopped 2024-02-21T07:59:00.237 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-02-21T07:59:00.238 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.287 INFO:tasks.ceph.mds.e:Stopped 2024-02-21T07:59:00.287 DEBUG:tasks.ceph.mds.h:waiting for process to exit 2024-02-21T07:59:00.288 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.337 INFO:tasks.ceph.mds.h:Stopped 2024-02-21T07:59:00.337 DEBUG:tasks.ceph.mds.k:waiting for process to exit 2024-02-21T07:59:00.337 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.387 INFO:tasks.ceph.mds.k:Stopped 2024-02-21T07:59:00.387 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-21T07:59:00.387 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.399 INFO:tasks.ceph.mds.c:Stopped 2024-02-21T07:59:00.400 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-02-21T07:59:00.400 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.459 INFO:tasks.ceph.mds.f:Stopped 2024-02-21T07:59:00.476 DEBUG:tasks.ceph.mds.i:waiting for process to exit 2024-02-21T07:59:00.476 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.514 INFO:tasks.ceph.mds.i:Stopped 2024-02-21T07:59:00.514 DEBUG:tasks.ceph.mds.l:waiting for process to exit 2024-02-21T07:59:00.514 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:00.567 INFO:tasks.ceph.mds.l:Stopped 2024-02-21T07:59:00.568 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-21T07:59:00.568 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-21T07:59:00.568 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:03.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-02-21T07:59:06.670 INFO:tasks.ceph.osd.0:Stopped 2024-02-21T07:59:06.671 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-21T07:59:06.671 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-02-21T07:59:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-02-21T07:59:12.773 INFO:tasks.ceph.osd.3:Stopped 2024-02-21T07:59:12.774 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-21T07:59:12.774 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:16.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-02-21T07:59:16.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-02-21T07:59:18.876 INFO:tasks.ceph.osd.6:Stopped 2024-02-21T07:59:18.876 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-02-21T07:59:18.876 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:19.376 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:19.384 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:19.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:23.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2024-02-21T07:59:23.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-02-21T07:59:24.978 INFO:tasks.ceph.osd.9:Stopped 2024-02-21T07:59:24.978 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-21T07:59:24.978 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.024 INFO:tasks.ceph.osd.1:Stopped 2024-02-21T07:59:25.024 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-21T07:59:25.024 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.079 INFO:tasks.ceph.osd.4:Stopped 2024-02-21T07:59:25.079 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-21T07:59:25.079 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.131 INFO:tasks.ceph.osd.7:Stopped 2024-02-21T07:59:25.131 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-02-21T07:59:25.131 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.179 INFO:tasks.ceph.osd.10:Stopped 2024-02-21T07:59:25.179 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-21T07:59:25.180 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.232 INFO:tasks.ceph.osd.2:Stopped 2024-02-21T07:59:25.233 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-21T07:59:25.233 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.290 INFO:tasks.ceph.osd.5:Stopped 2024-02-21T07:59:25.291 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-02-21T07:59:25.291 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.343 INFO:tasks.ceph.osd.8:Stopped 2024-02-21T07:59:25.343 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-02-21T07:59:25.343 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.396 INFO:tasks.ceph.osd.11:Stopped 2024-02-21T07:59:25.397 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-21T07:59:25.397 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-21T07:59:25.397 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.497 INFO:tasks.ceph.mgr.x:Stopped 2024-02-21T07:59:25.497 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-21T07:59:25.497 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.524 INFO:tasks.ceph.mgr.y:Stopped 2024-02-21T07:59:25.524 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-02-21T07:59:25.524 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.564 INFO:tasks.ceph.mgr.z:Stopped 2024-02-21T07:59:25.564 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-21T07:59:25.564 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-21T07:59:25.564 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.593 INFO:tasks.ceph.mon.a:Stopped 2024-02-21T07:59:25.593 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-21T07:59:25.593 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.606 INFO:tasks.ceph.mon.b:Stopped 2024-02-21T07:59:25.606 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-21T07:59:25.606 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:59:25.621 INFO:tasks.ceph.mon.c:Stopped 2024-02-21T07:59:25.622 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-21T07:59:25.622 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-02-21T07:59:25.807 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:59:25.807 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-21T07:59:26.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:59:26.095 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-21T07:59:26.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:59:26.285 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-21T07:59:26.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T07:59:26.449 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-02-21T07:59:26.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:59:26.646 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-21T07:59:26.896 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:59:26.897 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-21T07:59:26.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:59:26.986 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-21T07:59:27.052 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T07:59:27.053 DEBUG:teuthology.orchestra.run.smithi156:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-02-21T07:59:27.111 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:59:27.112 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-21T07:59:27.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:59:27.431 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-21T07:59:27.582 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:59:27.583 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-02-21T07:59:27.656 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T07:59:27.656 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-02-21T07:59:27.731 INFO:tasks.ceph:Archiving mon data... 2024-02-21T07:59:27.732 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/data/mon.a.tgz 2024-02-21T07:59:27.732 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-02-21T07:59:27.800 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.5HBRnJuiVP 2024-02-21T07:59:27.800 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5HBRnJuiVP 2024-02-21T07:59:28.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.5HBRnJuiVP 2024-02-21T07:59:28.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2024-02-21T07:59:28.190 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.5HBRnJuiVP is 437KB 2024-02-21T07:59:28.300 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.5HBRnJuiVP 2024-02-21T07:59:28.356 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/data/mon.b.tgz 2024-02-21T07:59:28.356 DEBUG:teuthology.orchestra.run.smithi156:> mktemp 2024-02-21T07:59:28.373 INFO:teuthology.orchestra.run.smithi156.stdout:/tmp/tmp.KoYf7Aq25Y 2024-02-21T07:59:28.374 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KoYf7Aq25Y 2024-02-21T07:59:28.582 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 0666 /tmp/tmp.KoYf7Aq25Y 2024-02-21T07:59:28.667 DEBUG:teuthology.orchestra.remote:smithi156:/tmp/tmp.KoYf7Aq25Y is 440KB 2024-02-21T07:59:28.764 DEBUG:teuthology.orchestra.run.smithi156:> rm -fr /tmp/tmp.KoYf7Aq25Y 2024-02-21T07:59:28.778 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/data/mon.c.tgz 2024-02-21T07:59:28.778 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-02-21T07:59:28.821 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.bWT4ZdSk1n 2024-02-21T07:59:28.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bWT4ZdSk1n 2024-02-21T07:59:28.987 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.bWT4ZdSk1n 2024-02-21T07:59:29.064 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.bWT4ZdSk1n is 440KB 2024-02-21T07:59:29.162 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.bWT4ZdSk1n 2024-02-21T07:59:29.177 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-21T07:59:29.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:59:29.184 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:59:29.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:59:29.327 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:59:29.342 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:59:29.358 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:59:29.358 INFO:tasks.ceph:Archiving crash dumps... 2024-02-21T07:59:29.360 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi100/crash 2024-02-21T07:59:29.361 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:59:29.448 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi156/crash 2024-02-21T07:59:29.449 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:59:29.476 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi170/crash 2024-02-21T07:59:29.477 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:59:29.503 INFO:tasks.ceph:Shutting down logrotate 2024-02-21T07:59:29.503 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.511 DEBUG:teuthology.orchestra.run.smithi156:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.520 DEBUG:teuthology.orchestra.run.smithi170:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.760 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.787 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:59:29.836 INFO:tasks.ceph:Compressing logs... 2024-02-21T07:59:29.836 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:59:29.843 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:59:29.846 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:59:29.869 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-02-21T07:59:29.870 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:59:29.871 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-21T07:59:29.871 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-21T07:59:29.871 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-21T07:59:29.872 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.k.log 2024-02-21T07:59:29.872 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.h.log 2024-02-21T07:59:29.872 INFO:teuthology.orchestra.run.smithi156.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:59:29.872 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-21T07:59:29.873 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-02-21T07:59:29.873 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-21T07:59:29.874 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mds.e.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-21T07:59:29.874 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:59:29.876 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mgr.y.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.k.log.gz 2024-02-21T07:59:29.876 INFO:teuthology.orchestra.run.smithi156.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.h.log.gz 2024-02-21T07:59:29.876 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-21T07:59:29.876 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-02-21T07:59:29.884 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ceph-mon.b.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:59:29.885 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38920.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.l.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38758.log: /var/log/ceph/ceph-client.admin.38920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38598.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.l.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38920.log.gz 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38598.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.i.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38638.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38638.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.z.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38638.log.gz 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38878.log 2024-02-21T07:59:29.886 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.z.log: /var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38718.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38878.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph-client.admin.38718.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38718.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38478.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr: 88.5% 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38598.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38678.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38478.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38478.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- 93.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr: /var/log/ceph/ceph-osd.2.log 2024-02-21T07:59:29.887 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-21T07:59:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:59:29.888 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38838.log 2024-02-21T07:59:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mds.c.log: 94.5% -- replaced with /var/log/ceph/ceph-mgr.z.log.gz 2024-02-21T07:59:29.890 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38558.log 2024-02-21T07:59:29.891 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38838.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-21T07:59:29.892 INFO:teuthology.orchestra.run.smithi170.stderr: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.38838.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.38798.log 2024-02-21T07:59:29.892 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-02-21T07:59:29.892 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2024-02-21T07:59:29.893 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38558.log: /var/log/ceph/ceph-client.admin.38798.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38558.log.gz 2024-02-21T07:59:29.893 INFO:teuthology.orchestra.run.smithi170.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-21T07:59:29.893 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38798.log.gz 2024-02-21T07:59:29.893 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.38518.log: /var/log/ceph/ceph-mon.c.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2024-02-21T07:59:29.920 INFO:teuthology.orchestra.run.smithi170.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.i.log.gz 2024-02-21T07:59:29.944 INFO:teuthology.orchestra.run.smithi170.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.l.log.gz 2024-02-21T07:59:29.947 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55862.log 2024-02-21T07:59:29.949 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57191.log 2024-02-21T07:59:29.951 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45249.log 2024-02-21T07:59:29.951 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.55862.log.gz 2024-02-21T07:59:29.952 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62132.log 2024-02-21T07:59:29.952 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57191.log.gz 2024-02-21T07:59:29.953 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52721.log 2024-02-21T07:59:29.955 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62132.log: gzip -5 87.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.62132.log.gz 2024-02-21T07:59:29.955 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.49206.log 2024-02-21T07:59:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52721.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-21T07:59:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44761.log 2024-02-21T07:59:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62174.log 2024-02-21T07:59:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61586.log 2024-02-21T07:59:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2024-02-21T07:59:29.961 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62174.log.gz 2024-02-21T07:59:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61586.log.gz 2024-02-21T07:59:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41990.log 2024-02-21T07:59:29.963 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57524.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45249.log.gz 2024-02-21T07:59:29.963 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-21T07:59:29.963 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2024-02-21T07:59:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2024-02-21T07:59:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58141.log 2024-02-21T07:59:29.966 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41990.log.gz 2024-02-21T07:59:29.966 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-02-21T07:59:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58141.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2024-02-21T07:59:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58141.log.gz -5 2024-02-21T07:59:29.968 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61239.log 2024-02-21T07:59:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48116.log 2024-02-21T07:59:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57582.log 2024-02-21T07:59:29.970 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61239.log.gz 2024-02-21T07:59:29.970 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48116.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44761.log.gz 2024-02-21T07:59:29.971 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-02-21T07:59:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2024-02-21T07:59:29.972 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48116.log.gz 2024-02-21T07:59:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47232.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57582.log.gz 2024-02-21T07:59:29.973 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-02-21T07:59:29.974 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59201.log 2024-02-21T07:59:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-02-21T07:59:29.975 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-02-21T07:59:29.976 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42259.log 2024-02-21T07:59:29.976 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2024-02-21T07:59:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47779.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59201.log.gz 2024-02-21T07:59:29.977 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61154.log 2024-02-21T07:59:29.978 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47569.log 2024-02-21T07:59:29.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46323.log 2024-02-21T07:59:29.979 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61154.log.gz 2024-02-21T07:59:29.980 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61417.log 2024-02-21T07:59:29.980 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42259.log.gz 2024-02-21T07:59:29.980 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47569.log.gz 2024-02-21T07:59:29.981 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57976.log 2024-02-21T07:59:29.981 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46323.log.gz 2024-02-21T07:59:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57324.log 2024-02-21T07:59:29.982 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61417.log.gz 2024-02-21T07:59:29.982 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2024-02-21T07:59:29.983 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57976.log.gz 2024-02-21T07:59:29.983 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53971.log 2024-02-21T07:59:29.984 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2024-02-21T07:59:29.984 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50816.log 2024-02-21T07:59:29.985 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57324.log.gz 2024-02-21T07:59:29.985 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41789.log 2024-02-21T07:59:29.986 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2024-02-21T07:59:29.987 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56404.log 2024-02-21T07:59:29.988 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44752.log 2024-02-21T07:59:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56404.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2024-02-21T07:59:29.989 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46940.log 2024-02-21T07:59:29.989 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56404.log.gz 2024-02-21T07:59:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62400.log 2024-02-21T07:59:29.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.46940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46940.log.gz 2024-02-21T07:59:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-02-21T07:59:29.991 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2024-02-21T07:59:29.992 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62400.log.gz 2024-02-21T07:59:29.992 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53284.log 2024-02-21T07:59:29.993 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55971.log 2024-02-21T07:59:29.994 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46197.log: /var/log/ceph/ceph-client.admin.53284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60462.log 2024-02-21T07:59:29.995 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57034.log 2024-02-21T07:59:29.995 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.55971.log.gz 2024-02-21T07:59:29.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2024-02-21T07:59:29.996 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60462.log.gz 2024-02-21T07:59:29.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-02-21T07:59:29.997 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45986.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57034.log.gz 2024-02-21T07:59:29.997 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-02-21T07:59:29.998 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58210.log 2024-02-21T07:59:29.998 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2024-02-21T07:59:29.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42427.log 2024-02-21T07:59:30.000 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-02-21T07:59:30.000 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44737.log 2024-02-21T07:59:30.001 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.58210.log.gz 2024-02-21T07:59:30.002 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2024-02-21T07:59:30.002 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2024-02-21T07:59:30.002 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-02-21T07:59:30.002 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52359.log 2024-02-21T07:59:30.002 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-02-21T07:59:30.003 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48341.log 2024-02-21T07:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52359.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44752.log.gz 2024-02-21T07:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47400.log 2024-02-21T07:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42427.log.gz 2024-02-21T07:59:30.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2024-02-21T07:59:30.005 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50508.log 2024-02-21T07:59:30.006 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56352.log 2024-02-21T07:59:30.006 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48341.log.gz 2024-02-21T07:59:30.007 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56845.log 2024-02-21T07:59:30.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38047.log 2024-02-21T07:59:30.009 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56352.log.gz 2024-02-21T07:59:30.009 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41942.log 2024-02-21T07:59:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38047.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56845.log.gz 2024-02-21T07:59:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53104.log 2024-02-21T07:59:30.010 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47400.log.gz 2024-02-21T07:59:30.010 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2024-02-21T07:59:30.011 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-02-21T07:59:30.012 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-02-21T07:59:30.013 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56647.log 2024-02-21T07:59:30.014 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56236.log 2024-02-21T07:59:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52315.log 2024-02-21T07:59:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56236.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56647.log.gz 2024-02-21T07:59:30.015 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2024-02-21T07:59:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52315.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56236.log.gz 2024-02-21T07:59:30.016 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-02-21T07:59:30.017 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62526.log 2024-02-21T07:59:30.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54988.log 2024-02-21T07:59:30.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50732.log 2024-02-21T07:59:30.019 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62526.log.gz 2024-02-21T07:59:30.020 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51313.log 2024-02-21T07:59:30.020 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2024-02-21T07:59:30.020 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.54988.log.gz 2024-02-21T07:59:30.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52972.log 2024-02-21T07:59:30.021 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41942.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53284.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51313.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52315.log.gz 2024-02-21T07:59:30.022 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48712.log 2024-02-21T07:59:30.023 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52972.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50732.log.gz 2024-02-21T07:59:30.023 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50361.log 2024-02-21T07:59:30.023 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.51313.log.gz 2024-02-21T07:59:30.024 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45243.log 2024-02-21T07:59:30.024 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53718.log 2024-02-21T07:59:30.025 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57456.log 2024-02-21T07:59:30.026 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2024-02-21T07:59:30.027 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45243.log.gz 2024-02-21T07:59:30.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57456.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48712.log.gz 2024-02-21T07:59:30.027 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60743.log 2024-02-21T07:59:30.028 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57456.log.gz 2024-02-21T07:59:30.028 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47274.log 2024-02-21T07:59:30.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60743.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz 2024-02-21T07:59:30.029 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60095.log 2024-02-21T07:59:30.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60743.log.gz 2024-02-21T07:59:30.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51859.log 2024-02-21T07:59:30.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60095.log: gzip -5 90.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.52721.log.gz -- 2024-02-21T07:59:30.031 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.45806.log 2024-02-21T07:59:30.031 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60095.log.gz 2024-02-21T07:59:30.031 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47274.log.gz 2024-02-21T07:59:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61502.log 2024-02-21T07:59:30.032 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61796.log 2024-02-21T07:59:30.033 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45268.log 2024-02-21T07:59:30.034 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61502.log.gz 2024-02-21T07:59:30.034 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-02-21T07:59:30.034 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61796.log.gz 2024-02-21T07:59:30.035 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56037.log 2024-02-21T07:59:30.035 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41789.log.gz 2024-02-21T07:59:30.035 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2024-02-21T07:59:30.036 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz 2024-02-21T07:59:30.036 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47316.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45268.log.gz 2024-02-21T07:59:30.036 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52794.log 2024-02-21T07:59:30.037 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60929.log 2024-02-21T07:59:30.037 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-02-21T07:59:30.038 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52794.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56037.log.gz 2024-02-21T07:59:30.038 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57910.log 2024-02-21T07:59:30.039 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55407.log 2024-02-21T07:59:30.039 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60929.log.gz 2024-02-21T07:59:30.040 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52540.log 2024-02-21T07:59:30.041 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57910.log.gz 2024-02-21T07:59:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37727.log 2024-02-21T07:59:30.041 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.52794.log.gz 2024-02-21T07:59:30.041 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.55407.log.gz 2024-02-21T07:59:30.042 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48844.log 2024-02-21T07:59:30.042 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.37727.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50361.log.gz 2024-02-21T07:59:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-02-21T07:59:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48844.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37727.log.gz 2024-02-21T07:59:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51684.log 2024-02-21T07:59:30.044 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.52540.log.gz 2024-02-21T07:59:30.044 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41618.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48844.log.gz 2024-02-21T07:59:30.045 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58910.log 2024-02-21T07:59:30.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61062.log 2024-02-21T07:59:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61838.log 2024-02-21T07:59:30.046 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58910.log.gz 2024-02-21T07:59:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52177.log 2024-02-21T07:59:30.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61062.log.gz 2024-02-21T07:59:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61754.log 2024-02-21T07:59:30.048 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61838.log.gz 2024-02-21T07:59:30.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46498.log 2024-02-21T07:59:30.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2024-02-21T07:59:30.050 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61754.log.gz 2024-02-21T07:59:30.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62006.log 2024-02-21T07:59:30.051 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54789.log 2024-02-21T07:59:30.051 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.46498.log.gz 2024-02-21T07:59:30.052 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53478.log 2024-02-21T07:59:30.052 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62006.log.gz 2024-02-21T07:59:30.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-02-21T07:59:30.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60335.log 2024-02-21T07:59:30.054 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54789.log.gz 2024-02-21T07:59:30.054 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53971.log.gz 2024-02-21T07:59:30.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2024-02-21T07:59:30.056 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45246.log 2024-02-21T07:59:30.056 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60335.log.gz 2024-02-21T07:59:30.056 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62048.log 2024-02-21T07:59:30.057 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52057.log 2024-02-21T07:59:30.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61331.log 2024-02-21T07:59:30.058 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62048.log.gz 2024-02-21T07:59:30.059 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38047.log.gz 2024-02-21T07:59:30.059 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55159.log 2024-02-21T07:59:30.060 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53918.log 2024-02-21T07:59:30.060 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61331.log.gz 2024-02-21T07:59:30.061 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-02-21T07:59:30.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42217.log 2024-02-21T07:59:30.061 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2024-02-21T07:59:30.061 INFO:teuthology.orchestra.run.smithi156.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-21T07:59:30.062 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55159.log.gz 2024-02-21T07:59:30.062 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42343.log 2024-02-21T07:59:30.062 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55251.log 2024-02-21T07:59:30.063 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42343.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42217.log.gz 2024-02-21T07:59:30.063 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48391.log 2024-02-21T07:59:30.064 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42343.log.gz 2024-02-21T07:59:30.064 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54590.log 2024-02-21T07:59:30.065 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48391.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55251.log.gz 2024-02-21T07:59:30.065 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-02-21T07:59:30.066 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54590.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52057.log.gz 2024-02-21T07:59:30.066 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62602.log 2024-02-21T07:59:30.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59830.log 2024-02-21T07:59:30.068 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62602.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-02-21T07:59:30.068 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-02-21T07:59:30.068 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48391.log.gz 2024-02-21T07:59:30.068 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62602.log.gz 2024-02-21T07:59:30.069 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2024-02-21T07:59:30.070 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48646.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-02-21T07:59:30.070 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59830.log.gz 2024-02-21T07:59:30.070 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45237.log 2024-02-21T07:59:30.070 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2024-02-21T07:59:30.070 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44737.log.gz 2024-02-21T07:59:30.071 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2024-02-21T07:59:30.072 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45246.log.gz 2024-02-21T07:59:30.072 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61196.log 2024-02-21T07:59:30.072 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-02-21T07:59:30.072 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46113.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-02-21T07:59:30.073 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50242.log 2024-02-21T07:59:30.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48230.log 2024-02-21T07:59:30.073 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61196.log.gz 2024-02-21T07:59:30.074 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50242.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:59:30.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41893.log 2024-02-21T07:59:30.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42469.log 2024-02-21T07:59:30.080 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50933.log 2024-02-21T07:59:30.080 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45237.log.gz 2024-02-21T07:59:30.082 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42469.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2024-02-21T07:59:30.082 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46366.log 2024-02-21T07:59:30.082 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41893.log.gz 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50933.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48230.log.gz 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42469.log.gz 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42385.log 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42385.log.gz 2024-02-21T07:59:30.083 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2024-02-21T07:59:30.084 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49030.log 2024-02-21T07:59:30.084 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49794.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50242.log.gz 2024-02-21T07:59:30.084 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56472.log 2024-02-21T07:59:30.085 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46366.log.gz 2024-02-21T07:59:30.085 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2024-02-21T07:59:30.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55473.log 2024-02-21T07:59:30.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57651.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56472.log.gz 2024-02-21T07:59:30.086 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47990.log 2024-02-21T07:59:30.087 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-02-21T07:59:30.088 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55473.log: gzip 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz -5 2024-02-21T07:59:30.088 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56581.log 2024-02-21T07:59:30.088 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55473.log.gz 2024-02-21T07:59:30.089 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51072.log 2024-02-21T07:59:30.089 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-02-21T07:59:30.089 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56581.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2024-02-21T07:59:30.090 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49030.log.gz 2024-02-21T07:59:30.090 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58042.log 2024-02-21T07:59:30.090 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56581.log.gz 2024-02-21T07:59:30.090 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53918.log.gz 2024-02-21T07:59:30.091 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51072.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47990.log.gz 2024-02-21T07:59:30.091 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-02-21T07:59:30.092 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50110.log 2024-02-21T07:59:30.092 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43224.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.58042.log.gz 2024-02-21T07:59:30.092 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58519.log 2024-02-21T07:59:30.094 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50110.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51684.log.gz 2024-02-21T07:59:30.094 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz 2024-02-21T07:59:30.094 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53104.log.gz 2024-02-21T07:59:30.094 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45892.log 2024-02-21T07:59:30.094 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-02-21T07:59:30.095 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2024-02-21T07:59:30.095 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58519.log.gz 2024-02-21T07:59:30.096 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42078.log 2024-02-21T07:59:30.096 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54484.log 2024-02-21T07:59:30.097 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58387.log 2024-02-21T07:59:30.097 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50110.log.gz 2024-02-21T07:59:30.098 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53236.log 2024-02-21T07:59:30.099 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45892.log.gz 2024-02-21T07:59:30.099 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49730.log 2024-02-21T07:59:30.100 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58387.log.gz 2024-02-21T07:59:30.100 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2024-02-21T07:59:30.100 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56713.log 2024-02-21T07:59:30.101 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49730.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42078.log.gz 2024-02-21T07:59:30.101 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62090.log 2024-02-21T07:59:30.101 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-02-21T07:59:30.102 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-02-21T07:59:30.103 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62090.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gz 2024-02-21T07:59:30.103 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.62090.log.gz -5 2024-02-21T07:59:30.103 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61628.log 2024-02-21T07:59:30.104 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58844.log 2024-02-21T07:59:30.105 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2024-02-21T07:59:30.105 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61628.log.gz 2024-02-21T07:59:30.106 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59318.log 2024-02-21T07:59:30.106 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.58844.log.gz 2024-02-21T07:59:30.106 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44251.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-02-21T07:59:30.107 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62686.log 2024-02-21T07:59:30.108 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54108.log 2024-02-21T07:59:30.108 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59318.log.gz 2024-02-21T07:59:30.109 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51180.log 2024-02-21T07:59:30.109 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62686.log.gz 2024-02-21T07:59:30.109 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-02-21T07:59:30.110 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51180.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53478.log.gz 2024-02-21T07:59:30.111 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2024-02-21T07:59:30.111 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54301.log 2024-02-21T07:59:30.111 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61712.log 2024-02-21T07:59:30.112 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56894.log 2024-02-21T07:59:30.113 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61712.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51180.log.gz 2024-02-21T07:59:30.114 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61375.log 2024-02-21T07:59:30.114 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-02-21T07:59:30.114 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61712.log.gz 2024-02-21T07:59:30.114 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58453.log 2024-02-21T07:59:30.115 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61375.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56894.log.gz 2024-02-21T07:59:30.115 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53170.log 2024-02-21T07:59:30.115 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61375.log.gz 2024-02-21T07:59:30.116 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54855.log 2024-02-21T07:59:30.116 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58453.log.gz 2024-02-21T07:59:30.117 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-02-21T07:59:30.117 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55672.log 2024-02-21T07:59:30.118 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42577.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54855.log.gz 2024-02-21T07:59:30.118 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44419.log 2024-02-21T07:59:30.119 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51493.log 2024-02-21T07:59:30.120 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44419.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55672.log.gz 2024-02-21T07:59:30.120 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58701.log 2024-02-21T07:59:30.121 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58090.log 2024-02-21T07:59:30.122 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44419.log.gz 2024-02-21T07:59:30.122 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45263.log 2024-02-21T07:59:30.122 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58701.log.gz 2024-02-21T07:59:30.123 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-02-21T07:59:30.123 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54108.log.gz 2024-02-21T07:59:30.123 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53236.log.gz 2024-02-21T07:59:30.124 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45263.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58090.log.gz 2024-02-21T07:59:30.124 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55928.log 2024-02-21T07:59:30.125 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44765.log 2024-02-21T07:59:30.125 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.51493.log.gz 2024-02-21T07:59:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55928.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gzgzip 2024-02-21T07:59:30.126 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50442.log 2024-02-21T07:59:30.126 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55928.log.gz 2024-02-21T07:59:30.126 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57778.log 2024-02-21T07:59:30.127 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2024-02-21T07:59:30.127 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44765.log.gz 2024-02-21T07:59:30.128 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57778.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51072.log.gz 2024-02-21T07:59:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-02-21T07:59:30.129 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57778.log.gz 2024-02-21T07:59:30.129 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54042.log 2024-02-21T07:59:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-02-21T07:59:30.131 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45263.log.gz 2024-02-21T07:59:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54042.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50442.log.gz 2024-02-21T07:59:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45259.log 2024-02-21T07:59:30.131 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-02-21T07:59:30.132 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2024-02-21T07:59:30.132 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60378.log 2024-02-21T07:59:30.133 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48032.log 2024-02-21T07:59:30.134 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60137.log 2024-02-21T07:59:30.134 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60378.log.gz 2024-02-21T07:59:30.135 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47484.log 2024-02-21T07:59:30.135 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48032.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-02-21T07:59:30.136 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2024-02-21T07:59:30.136 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2024-02-21T07:59:30.136 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2024-02-21T07:59:30.136 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47484.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60137.log.gz 2024-02-21T07:59:30.137 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45259.log.gz 2024-02-21T07:59:30.137 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59523.log 2024-02-21T07:59:30.138 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57390.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48032.log.gz 2024-02-21T07:59:30.138 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-02-21T07:59:30.139 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2024-02-21T07:59:30.139 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-02-21T07:59:30.139 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59523.log.gz 2024-02-21T07:59:30.139 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43308.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.g.log 2024-02-21T07:59:30.140 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2024-02-21T07:59:30.141 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.g.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47484.log.gz 2024-02-21T07:59:30.141 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59631.log 2024-02-21T07:59:30.142 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2024-02-21T07:59:30.143 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-02-21T07:59:30.143 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60029.log 2024-02-21T07:59:30.144 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59631.log.gz 2024-02-21T07:59:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-02-21T07:59:30.145 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54042.log.gz 2024-02-21T07:59:30.145 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-02-21T07:59:30.145 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2024-02-21T07:59:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60029.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54484.log.gz 2024-02-21T07:59:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45570.log 2024-02-21T07:59:30.146 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2024-02-21T07:59:30.146 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60029.log.gz -5 2024-02-21T07:59:30.146 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2024-02-21T07:59:30.147 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43678.log: /var/log/ceph/ceph-client.admin.45570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-02-21T07:59:30.148 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46281.log 2024-02-21T07:59:30.148 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-02-21T07:59:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62484.log 2024-02-21T07:59:30.149 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59565.log 2024-02-21T07:59:30.150 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61922.log 2024-02-21T07:59:30.151 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62484.log.gz 2024-02-21T07:59:30.151 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7%/var/log/ceph/ceph-client.admin.59565.log: -- replaced with /var/log/ceph/ceph-client.admin.45570.log.gz 2024-02-21T07:59:30.151 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54536.log 2024-02-21T07:59:30.152 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.59565.log.gz 2024-02-21T07:59:30.152 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49519.log 2024-02-21T07:59:30.153 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61922.log.gz 2024-02-21T07:59:30.154 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54536.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46281.log.gz 2024-02-21T07:59:30.154 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:59:30.154 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-02-21T07:59:30.154 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44758.log 2024-02-21T07:59:30.154 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49519.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31423.log 2024-02-21T07:59:30.155 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58931.log 2024-02-21T07:59:30.156 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.31423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44758.log.gz 2024-02-21T07:59:30.156 INFO:teuthology.orchestra.run.smithi100.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.31423.log.gz -5 2024-02-21T07:59:30.156 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2024-02-21T07:59:30.157 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58931.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.j.log 2024-02-21T07:59:30.158 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.58931.log.gz 2024-02-21T07:59:30.158 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50042.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54536.log.gz 2024-02-21T07:59:30.158 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62442.log 2024-02-21T07:59:30.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-02-21T07:59:30.160 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2024-02-21T07:59:30.160 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62442.log.gz 2024-02-21T07:59:30.160 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49519.log.gz 2024-02-21T07:59:30.161 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2024-02-21T07:59:30.161 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2024-02-21T07:59:30.162 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-02-21T07:59:30.163 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-02-21T07:59:30.163 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-21T07:59:30.164 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52672.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2024-02-21T07:59:30.164 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47442.log 2024-02-21T07:59:30.165 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48074.log 2024-02-21T07:59:30.166 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2024-02-21T07:59:30.166 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-02-21T07:59:30.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2024-02-21T07:59:30.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2024-02-21T07:59:30.168 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2024-02-21T07:59:30.169 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54417.log 2024-02-21T07:59:30.170 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56235.log 2024-02-21T07:59:30.171 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-02-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.56235.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60420.log 2024-02-21T07:59:30.172 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2024-02-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.56235.log.gz 2024-02-21T07:59:30.173 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47442.log.gz 2024-02-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56779.log 2024-02-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60420.log.gz 2024-02-21T07:59:30.174 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2024-02-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48074.log.gz 2024-02-21T07:59:30.175 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54150.log 2024-02-21T07:59:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49098.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.56779.log.gz 2024-02-21T07:59:30.176 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2024-02-21T07:59:30.176 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2024-02-21T07:59:30.177 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47948.log 2024-02-21T07:59:30.178 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2024-02-21T07:59:30.178 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43756.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2024-02-21T07:59:30.178 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2024-02-21T07:59:30.178 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gz 2024-02-21T07:59:30.179 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57258.log 2024-02-21T07:59:30.179 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-02-21T07:59:30.180 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45267.log 2024-02-21T07:59:30.180 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gz 2024-02-21T07:59:30.181 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50882.log 2024-02-21T07:59:30.181 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2024-02-21T07:59:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45267.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.57258.log.gz 2024-02-21T07:59:30.182 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59457.log 2024-02-21T07:59:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43009.log 2024-02-21T07:59:30.183 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2024-02-21T07:59:30.183 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52863.log 2024-02-21T07:59:30.185 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2024-02-21T07:59:30.185 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43009.log: -- replaced with /var/log/ceph/ceph-client.admin.59457.log.gz 2024-02-21T07:59:30.185 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47948.log.gz 2024-02-21T07:59:30.185 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45267.log.gz 2024-02-21T07:59:30.185 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.54150.log.gz 2024-02-21T07:59:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-02-21T07:59:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52863.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50882.log.gz 2024-02-21T07:59:30.186 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55105.log 2024-02-21T07:59:30.187 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62358.log 2024-02-21T07:59:30.188 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60504.log 2024-02-21T07:59:30.188 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52863.log.gz 2024-02-21T07:59:30.189 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62358.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.55105.log.gz 2024-02-21T07:59:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46071.log 2024-02-21T07:59:30.190 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62358.log.gz 2024-02-21T07:59:30.190 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-02-21T07:59:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60504.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60504.log.gz 2024-02-21T07:59:30.190 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58752.log 2024-02-21T07:59:30.191 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49338.log 2024-02-21T07:59:30.192 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-02-21T07:59:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49338.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58752.log.gz 2024-02-21T07:59:30.193 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42173.log 2024-02-21T07:59:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59764.log 2024-02-21T07:59:30.194 INFO:teuthology.orchestra.run.smithi170.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-21T07:59:30.194 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54921.log 2024-02-21T07:59:30.195 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46071.log.gz 2024-02-21T07:59:30.195 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2024-02-21T07:59:30.196 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59764.log.gz 2024-02-21T07:59:30.196 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-02-21T07:59:30.197 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43882.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54921.log.gz 2024-02-21T07:59:30.197 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2024-02-21T07:59:30.198 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-02-21T07:59:30.198 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55540.log 2024-02-21T07:59:30.199 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62258.log 2024-02-21T07:59:30.200 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61282.log 2024-02-21T07:59:30.201 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42173.log.gz 2024-02-21T07:59:30.201 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 90.9%/var/log/ceph/ceph-client.admin.62258.log: -5 -- replaced with /var/log/ceph/ceph-client.admin.55540.log.gz --verbose 2024-02-21T07:59:30.201 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.47148.log 2024-02-21T07:59:30.202 INFO:teuthology.orchestra.run.smithi100.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62258.log.gz 2024-02-21T07:59:30.202 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61282.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz -5 2024-02-21T07:59:30.202 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60845.log 2024-02-21T07:59:30.202 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61282.log.gz 2024-02-21T07:59:30.203 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-21T07:59:30.204 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2024-02-21T07:59:30.204 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60845.log.gz 2024-02-21T07:59:30.205 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38129.log 2024-02-21T07:59:30.205 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2024-02-21T07:59:30.206 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56964.log 2024-02-21T07:59:30.207 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.38129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-02-21T07:59:30.207 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2024-02-21T07:59:30.208 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60546.log 2024-02-21T07:59:30.208 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2024-02-21T07:59:30.208 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56964.log.gz 2024-02-21T07:59:30.208 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38129.log.gz 2024-02-21T07:59:30.209 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59133.log 2024-02-21T07:59:30.210 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58278.log 2024-02-21T07:59:30.210 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60546.log.gz 2024-02-21T07:59:30.211 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53038.log 2024-02-21T07:59:30.212 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.59133.log.gz 2024-02-21T07:59:30.212 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52177.log.gz 2024-02-21T07:59:30.212 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58278.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52359.log.gz 2024-02-21T07:59:30.212 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-02-21T07:59:30.212 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.52972.log.gz 2024-02-21T07:59:30.213 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53170.log.gz 2024-02-21T07:59:30.213 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2024-02-21T07:59:30.213 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-02-21T07:59:30.213 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58278.log.gz 2024-02-21T07:59:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59878.log 2024-02-21T07:59:30.214 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54301.log.gz 2024-02-21T07:59:30.214 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54590.log.gz 2024-02-21T07:59:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49453.log 2024-02-21T07:59:30.215 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9%/var/log/ceph/ceph-client.admin.59878.log: -- replaced with /var/log/ceph/ceph-client.admin.53038.log.gz 2024-02-21T07:59:30.215 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56103.log 2024-02-21T07:59:30.216 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2024-02-21T07:59:30.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49453.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54417.log.gz 2024-02-21T07:59:30.216 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.59878.log.gz 2024-02-21T07:59:30.216 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49164.log 2024-02-21T07:59:30.217 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-02-21T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49164.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56103.log.gz 2024-02-21T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57100.log 2024-02-21T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46028.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49164.log.gz 2024-02-21T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2024-02-21T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-02-21T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51138.log 2024-02-21T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz -- replaced with /var/log/ceph/ceph-client.admin.57100.log.gz 2024-02-21T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-02-21T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51750.log 2024-02-21T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-02-21T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55722.log 2024-02-21T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51991.log 2024-02-21T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-02-21T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50665.log 2024-02-21T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55722.log.gz 2024-02-21T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52105.log 2024-02-21T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54746.log 2024-02-21T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49338.log.gz 2024-02-21T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52105.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-21T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49453.log.gz 2024-02-21T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51138.log.gz 2024-02-21T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54746.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51750.log.gz 2024-02-21T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61880.log 2024-02-21T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54746.log.gz 2024-02-21T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59697.log 2024-02-21T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51991.log.gz 2024-02-21T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-02-21T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61880.log.gz 2024-02-21T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-02-21T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45238.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.59697.log.gz 2024-02-21T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53544.log 2024-02-21T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43468.log: 90.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.50665.log.gz -5 2024-02-21T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56538.log 2024-02-21T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54680.log 2024-02-21T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56538.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52105.log.gz 2024-02-21T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61670.log 2024-02-21T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56538.log.gz 2024-02-21T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-02-21T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-02-21T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53544.log.gz 2024-02-21T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-02-21T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62318.log 2024-02-21T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54680.log.gz 2024-02-21T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61670.log: /var/log/ceph/ceph-client.admin.44081.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61670.log.gz 2024-02-21T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50599.log 2024-02-21T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60887.log 2024-02-21T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-02-21T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62318.log.gz 2024-02-21T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47358.log 2024-02-21T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53784.log 2024-02-21T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60887.log.gz 2024-02-21T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2024-02-21T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50599.log.gz 2024-02-21T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55054.log 2024-02-21T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47358.log.gz 2024-02-21T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51379.log 2024-02-21T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59388.log 2024-02-21T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.55054.log.gz 2024-02-21T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54297.log 2024-02-21T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59388.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.59388.log.gz 2024-02-21T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55364.log 2024-02-21T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.53784.log.gz 2024-02-21T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-02-21T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57122.log 2024-02-21T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57844.log 2024-02-21T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55364.log.gz 2024-02-21T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2024-02-21T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54297.log.gz 2024-02-21T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57122.log.gz 2024-02-21T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57844.log: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-02-21T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57844.log.gz 2024-02-21T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53586.log 2024-02-21T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46155.log: /var/log/ceph/ceph-client.admin.44209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62728.log 2024-02-21T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-02-21T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61964.log 2024-02-21T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62728.log.gz 2024-02-21T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45937.log 2024-02-21T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47653.log 2024-02-21T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61964.log.gz 2024-02-21T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44757.log 2024-02-21T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61460.log 2024-02-21T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44757.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2024-02-21T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47822.log 2024-02-21T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-02-21T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61460.log.gz 2024-02-21T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-02-21T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55606.log 2024-02-21T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44763.log 2024-02-21T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53586.log.gz 2024-02-21T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-02-21T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44377.log 2024-02-21T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44763.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.55606.log.gz 2024-02-21T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45937.log.gz 2024-02-21T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47611.log 2024-02-21T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52426.log 2024-02-21T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2024-02-21T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47653.log.gz 2024-02-21T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52426.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44757.log.gz 2024-02-21T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43840.log 2024-02-21T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47822.log.gz 2024-02-21T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51925.log 2024-02-21T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49934.log 2024-02-21T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-02-21T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51925.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-02-21T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57718.log 2024-02-21T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62216.log 2024-02-21T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44763.log.gz 2024-02-21T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61111.log 2024-02-21T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57718.log.gz 2024-02-21T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44377.log.gz 2024-02-21T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55250.log 2024-02-21T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62216.log.gz 2024-02-21T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47611.log.gz 2024-02-21T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47864.log 2024-02-21T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2024-02-21T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2024-02-21T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53409.log 2024-02-21T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43840.log.gz 2024-02-21T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47864.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55250.log.gz 2024-02-21T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-02-21T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49934.log.gz 2024-02-21T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51925.log.gz 2024-02-21T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48158.log 2024-02-21T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47864.log.gz 2024-02-21T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-02-21T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-02-21T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58963.log 2024-02-21T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60701.log 2024-02-21T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52422.log 2024-02-21T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58963.log.gz 2024-02-21T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52930.log 2024-02-21T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60701.log.gz 2024-02-21T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52422.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2024-02-21T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-02-21T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2024-02-21T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59067.log 2024-02-21T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58652.log 2024-02-21T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60785.log 2024-02-21T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58652.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59067.log.gz 2024-02-21T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61544.log 2024-02-21T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60785.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.58652.log.gz 2024-02-21T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51544.log 2024-02-21T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60785.log.gz 2024-02-21T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-02-21T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61544.log.gz 2024-02-21T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48158.log.gz 2024-02-21T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51544.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-21T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52606.log 2024-02-21T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.52426.log.gz 2024-02-21T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47906.log 2024-02-21T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-02-21T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-02-21T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60269.log 2024-02-21T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52606.log: /var/log/ceph/ceph-client.admin.47906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43798.log 2024-02-21T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58585.log 2024-02-21T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43798.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60269.log.gz 2024-02-21T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58345.log 2024-02-21T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53652.log 2024-02-21T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58345.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.58585.log.gz 2024-02-21T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53356.log 2024-02-21T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58345.log.gz 2024-02-21T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41843.log 2024-02-21T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41484.log 2024-02-21T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2024-02-21T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41484.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-21T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62770.log 2024-02-21T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55791.log 2024-02-21T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52930.log.gz 2024-02-21T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62770.log: /var/log/ceph/ceph-client.admin.43392.log 2024-02-21T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52422.log.gz 2024-02-21T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62770.log.gz 2024-02-21T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55791.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2024-02-21T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2024-02-21T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.55791.log.gz 2024-02-21T07:59:30.305 INFO:teuthology.orchestra.run.smithi156.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-21T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43392.log: /var/log/ceph/ceph-client.admin.41741.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-02-21T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2024-02-21T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43798.log.gz 2024-02-21T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.52606.log.gz 2024-02-21T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53652.log.gz 2024-02-21T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41484.log.gz 2024-02-21T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2024-02-21T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41843.log.gz 2024-02-21T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47906.log.gz 2024-02-21T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2024-02-21T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53356.log.gz 2024-02-21T07:59:30.630 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-21T07:59:30.722 INFO:teuthology.orchestra.run.smithi100.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-21T07:59:30.940 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.j.log.gz 2024-02-21T07:59:31.505 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50933.log.gz 2024-02-21T07:59:31.506 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.50816.log.gz 2024-02-21T07:59:31.506 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.51379.log.gz 2024-02-21T07:59:31.506 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.51544.log.gz 2024-02-21T07:59:31.506 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-02-21T07:59:31.510 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-02-21T07:59:31.511 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-02-21T07:59:31.512 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50508.log.gz 2024-02-21T07:59:31.513 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-02-21T07:59:31.514 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49730.log.gz 2024-02-21T07:59:31.514 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2024-02-21T07:59:31.514 INFO:teuthology.orchestra.run.smithi100.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz 2024-02-21T07:59:31.514 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-02-21T07:59:31.514 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-02-21T07:59:32.545 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.g.log.gz 2024-02-21T07:59:36.822 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-21T07:59:49.205 INFO:teuthology.orchestra.run.smithi100.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-21T08:00:09.144 INFO:teuthology.orchestra.run.smithi156.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-02-21T08:00:17.748 INFO:teuthology.orchestra.run.smithi156.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-21T08:00:18.362 INFO:teuthology.orchestra.run.smithi170.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-02-21T08:00:18.696 INFO:teuthology.orchestra.run.smithi170.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-02-21T08:00:23.987 INFO:teuthology.orchestra.run.smithi170.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-21T08:00:34.927 INFO:teuthology.orchestra.run.smithi156.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-21T08:00:36.120 INFO:teuthology.orchestra.run.smithi156.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-21T08:00:36.121 INFO:teuthology.orchestra.run.smithi156.stderr: 2024-02-21T08:00:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:real 1m6.264s 2024-02-21T08:00:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:user 3m31.503s 2024-02-21T08:00:36.122 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m7.017s 2024-02-21T08:00:54.776 INFO:teuthology.orchestra.run.smithi170.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-21T08:00:54.778 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-02-21T08:00:54.778 INFO:teuthology.orchestra.run.smithi170.stderr:real 1m24.919s 2024-02-21T08:00:54.778 INFO:teuthology.orchestra.run.smithi170.stderr:user 3m48.160s 2024-02-21T08:00:54.778 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m7.708s 2024-02-21T08:04:26.410 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-21T08:05:21.209 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-21T08:05:40.312 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-21T08:05:59.253 INFO:teuthology.orchestra.run.smithi100.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-02-21T08:05:59.259 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-02-21T08:05:59.259 INFO:teuthology.orchestra.run.smithi100.stderr:real 6m29.371s 2024-02-21T08:05:59.260 INFO:teuthology.orchestra.run.smithi100.stderr:user 9m5.170s 2024-02-21T08:05:59.260 INFO:teuthology.orchestra.run.smithi100.stderr:sys 1m9.783s 2024-02-21T08:05:59.260 INFO:tasks.ceph:Archiving logs... 2024-02-21T08:05:59.260 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi100/log 2024-02-21T08:05:59.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T08:06:44.846 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi156/log 2024-02-21T08:06:44.847 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T08:07:19.027 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi170/log 2024-02-21T08:07:19.029 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T08:07:56.503 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-21T08:07:56.520 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-21T08:07:56.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T08:07:56.529 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T08:07:56.533 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T08:07:56.697 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-21T08:07:56.707 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-21T08:07:56.707 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T08:07:56.715 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T08:07:56.718 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T08:07:56.731 INFO:teuthology.orchestra.run.smithi156.stderr:bash: line 1: ntpq: command not found 2024-02-21T08:07:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +1321us[+1337us] +/- 89ms 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -520us[ -504us] +/- 56ms 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -389us[ -373us] +/- 87ms 2024-02-21T08:07:56.735 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T08:07:56.763 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +1302us[+1332us] +/- 90ms 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 11 -528us[ -498us] +/- 56ms 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -398us[ -368us] +/- 87ms 2024-02-21T08:07:56.833 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T08:07:56.864 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T08:07:56.864 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-02-21T08:07:56.864 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 +1278us[+1281us] +/- 90ms 2024-02-21T08:07:56.865 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -543us[ -540us] +/- 56ms 2024-02-21T08:07:56.865 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -419us[ -417us] +/- 87ms 2024-02-21T08:07:56.865 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T08:07:56.867 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-21T08:07:56.877 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-21T08:07:56.878 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-21T08:07:56.888 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T08:07:57.167 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T08:07:57.239 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T08:07:57.319 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T08:07:57.420 INFO:teuthology.orchestra.run.smithi100.stdout:type=AVC msg=audit(1708500953.706:193): avc: denied { checkpoint_restore } for pid=1191 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-21T08:07:57.421 DEBUG:teuthology.task.selinux:ubuntu@smithi100.front.sepia.ceph.com has 1 denials 2024-02-21T08:07:57.421 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T08:07:57.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T08:07:57.456 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T08:07:57.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T08:07:57.489 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: ['type=AVC msg=audit(1708500953.706:193): avc: denied { checkpoint_restore } for pid=1191 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-21T08:07:57.490 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-21T08:07:57.500 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-21T08:07:57.510 INFO:teuthology.task.internal:Duration was 1926.434252 seconds 2024-02-21T08:07:57.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-21T08:07:57.521 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-21T08:07:57.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T08:07:57.528 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T08:07:57.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T08:07:57.575 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T08:07:57.592 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T08:07:57.737 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T08:07:58.268 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-21T08:07:58.268 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-02-21T08:07:58.269 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T08:07:58.334 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2024-02-21T08:07:58.334 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T08:07:58.361 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-02-21T08:07:58.361 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T08:07:58.386 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-21T08:07:58.387 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T08:07:58.394 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T08:07:58.404 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T08:07:58.486 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-21T08:07:58.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T08:07:58.491 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T08:07:58.494 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T08:07:58.695 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-21T08:07:58.706 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-21T08:07:58.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T08:07:58.801 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T08:07:58.829 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T08:07:58.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-21T08:07:58.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:58.874 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:58.876 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:58.900 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2024-02-21T08:07:58.928 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-02-21T08:07:59.017 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-02-21T08:07:59.075 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:59.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T08:07:59.127 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:59.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T08:07:59.141 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T08:07:59.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T08:07:59.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-21T08:07:59.166 INFO:teuthology.task.internal:Transferring archived files... 2024-02-21T08:07:59.168 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi100 2024-02-21T08:07:59.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T08:07:59.274 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi156 2024-02-21T08:07:59.274 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T08:07:59.310 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311/remote/smithi170 2024-02-21T08:07:59.310 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T08:07:59.346 INFO:teuthology.task.internal:Removing archive directory... 2024-02-21T08:07:59.346 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T08:07:59.354 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T08:07:59.356 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T08:07:59.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-21T08:07:59.417 INFO:teuthology.task.internal:Not uploading archives. 2024-02-21T08:07:59.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-21T08:07:59.445 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-21T08:07:59.445 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T08:07:59.452 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T08:07:59.454 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T08:07:59.466 INFO:teuthology.orchestra.run.smithi156.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 08:07 /home/ubuntu/cephtest 2024-02-21T08:07:59.468 INFO:teuthology.orchestra.run.smithi170.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 08:07 /home/ubuntu/cephtest 2024-02-21T08:07:59.502 INFO:teuthology.orchestra.run.smithi100.stdout: 394732 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 08:07 /home/ubuntu/cephtest 2024-02-21T08:07:59.505 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-21T08:07:59.516 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-21T08:07:59.529 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: ['type=AVC msg=audit(1708500953.706:193): avc: denied { checkpoint_restore } for pid=1191 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-21T08:07:59.529 INFO:teuthology.nuke:Checking targets against current locks 2024-02-21T08:07:59.554 DEBUG:teuthology.nuke:shortname: smithi100 2024-02-21T08:07:59.554 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T08:07:59.578 DEBUG:teuthology.nuke:shortname: smithi156 2024-02-21T08:07:59.578 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T08:07:59.583 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.084229', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABq3/artMQBkN1Ql1hO4MSkY3sikJEVMzCZG/+2std8s60rb4V+in2DLqkSTzv5sg6XQE4i8Lhx+hcdEc+SvoY='} 2024-02-21T08:07:59.601 DEBUG:teuthology.nuke:shortname: smithi170 2024-02-21T08:07:59.602 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T08:07:59.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.086030', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6aCInOFSF360JZMBeUckUwL80ZeVFRCcgJ48fg7L0LunU59aHFTzAVazDlWkAzvyftqLqJO+F6D3yZrlHmj7Y='} 2024-02-21T08:07:59.635 INFO:teuthology.orchestra.console.smithi100:Power off 2024-02-21T08:07:59.636 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T08:07:59.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569311', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:24:07.087585', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD1B0xZ16DhDXJZ5ClgNzYsiuU+sg2ZmyyDdgZWx1ZeB/AukG67zU/PeVGlgmTyhVv/GQkIzAjCk+2ydaEsJuNk='} 2024-02-21T08:07:59.658 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-02-21T08:07:59.658 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:07:59.674 INFO:teuthology.orchestra.console.smithi156:Power off 2024-02-21T08:07:59.675 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T08:07:59.685 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-21T08:07:59.698 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-02-21T08:07:59.698 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:07:59.712 INFO:teuthology.orchestra.console.smithi170:Power off 2024-02-21T08:07:59.712 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T08:07:59.721 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-02-21T08:07:59.734 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-02-21T08:07:59.734 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:07:59.756 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-02-21T08:08:03.686 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:03.723 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:03.756 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:03.796 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-21T08:08:03.832 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-02-21T08:08:03.864 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-02-21T08:08:07.801 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:07.833 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:07.866 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:07.914 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-02-21T08:08:07.941 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-02-21T08:08:07.975 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-02-21T08:08:08.076 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-02-21T08:08:11.919 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:11.942 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T08:08:12.028 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-02-21T08:08:12.050 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-02-21T08:08:12.130 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-02-21T08:08:12.151 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-02-21T08:08:12.256 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1130e053228021b1be9cac260b5ed52c5a9027c5 description: fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} duration: 1926.4342517852783 failure_reason: 'SELinux denials found on ubuntu@smithi100.front.sepia.ceph.com: [''type=AVC msg=audit(1708500953.706:193): avc: denied { checkpoint_restore } for pid=1191 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2024-02-21T08:08:12.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T08:08:12.336 INFO:teuthology.run:FAIL